2024-09-12T17:18:45.739 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T17:18:45.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:18:45.845 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731 branch: wip-rgw-meta-handlers description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7902731' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/7Y8/FoCFwqVkeKNL1j+0j422pFSjWpBlMNOzLLfEjG6rQ81o2Oq7fPUUbOEajzVVJVQ1M2iE6SQKS96uOf58= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKudc8UzzrEuTOa/mo+gPDEi4ce1f1sEz8PxIYT2lxpoJgxXECpl/iTFlkjOazqA7JpUXH9bRCAoXhaQj7VmNH4= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T17:18:45.845 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T17:18:45.846 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T17:18:45.846 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T17:18:45.849 INFO:teuthology.task.internal:Checking packages... 2024-09-12T17:18:45.873 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T17:18:45.873 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T17:18:45.873 INFO:teuthology.packaging:ref: None 2024-09-12T17:18:45.873 INFO:teuthology.packaging:tag: None 2024-09-12T17:18:45.873 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T17:18:45.873 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:18:45.873 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T17:18:46.028 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762.gbad475c1 2024-09-12T17:18:46.030 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T17:18:46.037 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T17:18:46.037 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T17:18:46.099 INFO:teuthology.task.internal:Saving configuration 2024-09-12T17:18:46.117 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T17:18:46.124 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T17:18:46.148 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:13:31.139481', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/7Y8/FoCFwqVkeKNL1j+0j422pFSjWpBlMNOzLLfEjG6rQ81o2Oq7fPUUbOEajzVVJVQ1M2iE6SQKS96uOf58='} 2024-09-12T17:18:46.168 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:13:31.137677', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKudc8UzzrEuTOa/mo+gPDEi4ce1f1sEz8PxIYT2lxpoJgxXECpl/iTFlkjOazqA7JpUXH9bRCAoXhaQj7VmNH4='} 2024-09-12T17:18:46.168 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T17:18:46.174 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:18:46.174 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:18:46.174 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T17:18:46.266 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb0bafc3ac0>, signals=[15]) 2024-09-12T17:18:46.266 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T17:18:46.272 INFO:teuthology.task.internal:Opening connections... 2024-09-12T17:18:46.273 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T17:18:46.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:18:46.364 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T17:18:46.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:18:46.444 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T17:18:46.450 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-09-12T17:18:46.469 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-09-12T17:18:46.469 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-09-12T17:18:46.528 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-09-12T17:18:46.528 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-09-12T17:18:46.528 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-09-12T17:18:46.528 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-09-12T17:18:46.528 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-09-12T17:18:46.528 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-09-12T17:18:46.528 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T17:18:46.529 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-09-12T17:18:46.529 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-09-12T17:18:46.529 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T17:18:46.529 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-09-12T17:18:46.529 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T17:18:46.529 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T17:18:46.529 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T17:18:46.530 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-09-12T17:18:46.567 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-09-12T17:18:46.586 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-09-12T17:18:46.586 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-09-12T17:18:46.643 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-09-12T17:18:46.643 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-09-12T17:18:46.644 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-09-12T17:18:46.644 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-09-12T17:18:46.644 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-09-12T17:18:46.644 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-09-12T17:18:46.644 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T17:18:46.644 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-09-12T17:18:46.644 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-09-12T17:18:46.644 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T17:18:46.644 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-09-12T17:18:46.644 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T17:18:46.644 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T17:18:46.644 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T17:18:46.645 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-09-12T17:18:46.667 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T17:18:46.676 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T17:18:46.681 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T17:18:46.681 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:18:46.684 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:18:46.701 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T17:18:46.709 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T17:18:46.709 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:18:46.742 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:18:47.056 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T17:18:47.108 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T17:18:47.123 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T17:18:47.123 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T17:18:47.123 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:18:47.124 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:18:47.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:18:47.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:18:47.141 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-09-12T17:18:47.142 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-12T17:18:47.199 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-503.el9.x86_64 2024-09-12T17:18:47.200 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-503.el9.x86_64 2024-09-12T17:18:47.200 INFO:teuthology.task.kernel:Running kernel on smithi148: 5.14.0-503.el9.x86_64 2024-09-12T17:18:47.200 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum install -y kernel 2024-09-12T17:18:47.200 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.14.0-503.el9.x86_64 2024-09-12T17:18:47.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2024-09-12T17:18:51.962 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-09-12T17:18:52.960 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.2 MB 00:04 2024-09-12T17:18:53.730 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-12T17:18:56.668 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 20 MB 00:02 2024-09-12T17:18:58.989 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-12T17:19:00.764 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-12T17:19:01.144 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T17:19:01.701 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T17:19:02.794 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-12T17:19:03.982 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-12T17:19:07.215 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-12T17:19:09.197 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T17:19:09.198 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T17:19:09.293 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-12T17:19:09.302 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout:Install 4 Packages 2024-09-12T17:19:09.303 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:19:09.304 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 79 M 2024-09-12T17:19:09.304 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 126 M 2024-09-12T17:19:09.304 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-12T17:19:09.428 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-12T17:19:09.492 INFO:teuthology.orchestra.run.smithi148.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 311 kB/s | 23 kB 00:00 2024-09-12T17:19:09.942 INFO:teuthology.orchestra.run.smithi148.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-12T17:19:10.301 INFO:teuthology.orchestra.run.smithi148.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 39 MB/s | 35 MB 00:00 2024-09-12T17:19:10.718 INFO:teuthology.orchestra.run.smithi148.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 23 MB/s | 29 MB 00:01 2024-09-12T17:19:10.718 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:19:10.718 INFO:teuthology.orchestra.run.smithi148.stdout:Total 56 MB/s | 79 MB 00:01 2024-09-12T17:19:11.377 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T17:19:11.377 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T17:19:11.400 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-12T17:19:11.468 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-12T17:19:11.474 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-12T17:19:11.474 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-09-12T17:19:11.474 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-12T17:19:11.474 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-12T17:19:11.474 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T17:19:11.474 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-12T17:19:11.474 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T17:19:11.474 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T17:19:11.475 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T17:19:11.475 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:19:11.475 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-12T17:19:11.475 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-12T17:19:11.475 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2024-09-12T17:19:11.475 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:19:11.475 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 79 M 2024-09-12T17:19:11.476 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 126 M 2024-09-12T17:19:11.476 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-12T17:19:11.680 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 267 kB/s | 23 kB 00:00 2024-09-12T17:19:11.736 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-12T17:19:11.736 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-12T17:19:12.055 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-12T17:19:12.480 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 39 MB/s | 35 MB 00:00 2024-09-12T17:19:12.686 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-12T17:19:12.686 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-12T17:19:12.831 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-12T17:19:12.831 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:19:12.831 INFO:teuthology.orchestra.run.smithi107.stdout:Total 58 MB/s | 79 MB 00:01 2024-09-12T17:19:13.519 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-12T17:19:13.856 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-12T17:19:13.857 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-12T17:19:14.813 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-12T17:19:14.814 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-12T17:19:15.155 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-12T17:19:16.044 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:19:16.134 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:19:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-12T17:19:17.993 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:19:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:19:18.933 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:19:19.069 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:19:20.875 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:19:21.008 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:19:23.911 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:19:23.952 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:19:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:19:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:19:28.816 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:19:30.706 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:20:07.192 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:20:07.232 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:20:07.563 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:20:07.563 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:20:07.563 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:20:07.564 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:20:08.416 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:20:08.416 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:20:08.416 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-12T17:20:08.416 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T17:20:08.416 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T17:20:08.417 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T17:20:08.417 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T17:20:08.417 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:20:08.417 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-12T17:20:08.759 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:20:08.887 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:20:08.888 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:20:08.888 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T17:20:08.888 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:20:08.888 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:20:08.888 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T17:20:08.888 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:20:08.889 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:20:08.947 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:20:08.948 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:20:08.948 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2024-09-12T17:20:08.980 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2024-09-12T17:20:08.980 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2024-09-12T17:20:08.980 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.06 2024-09-12T17:20:08.980 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 82.el9 2024-09-12T17:20:08.980 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:Group : Unspecified 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 8274670 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : builder@centos.org 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : CentOS 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2024-09-12T17:20:08.981 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:20:08.982 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T17:20:08.982 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T17:20:08.982 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T17:20:08.982 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2024-09-12T17:20:08.982 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:20:08.982 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T17:20:08.983 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T17:20:08.983 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 5.14.0-505.el9.x86_64 2024-09-12T17:20:08.983 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T17:20:09.063 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:20:09.111 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:20:09.473 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:20:09.474 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:20:09.474 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:20:09.474 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:20:09.626 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-09-12T17:20:10.293 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:20:10.294 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:20:10.294 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-12T17:20:10.294 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T17:20:10.294 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T17:20:10.294 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T17:20:10.294 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T17:20:10.294 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:20:10.294 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-12T17:20:10.664 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:20:10.747 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:20:10.747 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:20:10.747 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T17:20:10.747 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:20:10.747 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:20:10.747 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T17:20:10.747 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:20:10.748 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:20:10.806 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:20:10.806 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:20:10.806 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2024-09-12T17:20:10.838 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2024-09-12T17:20:10.838 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2024-09-12T17:20:10.838 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2024-09-12T17:20:10.838 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 82.el9 2024-09-12T17:20:10.838 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2024-09-12T17:20:10.838 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8274670 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2024-09-12T17:20:10.839 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:20:10.840 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T17:20:10.840 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T17:20:10.840 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T17:20:10.840 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2024-09-12T17:20:10.840 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:20:10.840 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T17:20:10.841 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T17:20:10.841 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 5.14.0-505.el9.x86_64 2024-09-12T17:20:10.841 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T17:20:10.946 INFO:teuthology.orchestra.run.smithi148.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T17:20:10.981 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-09-12T17:20:10.982 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-09-12T17:20:10.997 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.igE8M1fqx4 2024-09-12T17:20:10.998 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.igE8M1fqx4 2024-09-12T17:20:11.065 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.igE8M1fqx4 2024-09-12T17:20:11.197 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.igE8M1fqx4 is 6KB 2024-09-12T17:20:11.246 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.igE8M1fqx4 2024-09-12T17:20:11.261 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T17:20:11.323 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T17:20:11.324 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T17:20:11.324 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T17:20:11.324 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T17:20:11.325 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T17:20:11.465 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-09-12T17:20:11.470 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2024-09-12T17:20:12.807 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T17:20:12.835 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-09-12T17:20:12.844 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-09-12T17:20:12.876 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.BWvNBxbWHO 2024-09-12T17:20:12.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BWvNBxbWHO 2024-09-12T17:20:12.944 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.BWvNBxbWHO 2024-09-12T17:20:13.093 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.BWvNBxbWHO is 6KB 2024-09-12T17:20:13.141 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.BWvNBxbWHO 2024-09-12T17:20:13.155 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T17:20:13.218 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T17:20:13.218 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T17:20:13.218 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T17:20:13.218 INFO:teuthology.orchestra.run.smithi107.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T17:20:13.219 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T17:20:13.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-09-12T17:20:41.501 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T17:20:41.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T17:20:41.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:20:43.360 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T17:20:43.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T17:20:43.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:21:16.097 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-12T17:21:17.888 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-12T17:21:25.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T17:21:25.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:21:26.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T17:21:26.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:21:45.277 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-09-12T17:21:57.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T17:21:57.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:21:57.553 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-12T17:21:57.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T17:21:57.905 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T17:21:57.906 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-09-12T17:21:57.920 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-505.el9.x86_64 2024-09-12T17:21:57.921 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T17:21:57.921 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:21:57.921 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T17:21:58.922 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T17:21:58.922 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:21:59.010 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-09-12T17:21:59.038 DEBUG:teuthology.parallel:result is None 2024-09-12T17:22:25.105 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:22:37.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T17:22:37.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:22:37.363 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-12T17:22:37.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T17:22:37.727 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T17:22:37.727 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-12T17:22:37.743 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-505.el9.x86_64 2024-09-12T17:22:37.743 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T17:22:37.743 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:22:37.743 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T17:22:38.744 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T17:22:38.745 DEBUG:teuthology.orchestra.run.smithi148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:22:38.821 INFO:teuthology.orchestra.run.smithi148.stdout:ttyS1 2024-09-12T17:22:38.838 DEBUG:teuthology.parallel:result is None 2024-09-12T17:22:38.838 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T17:22:38.846 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T17:22:38.846 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:22:38.849 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:22:38.867 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T17:22:38.901 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T17:22:38.923 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T17:22:38.923 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:22:38.926 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:22:38.961 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T17:22:38.970 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T17:22:38.970 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:22:38.988 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:22:39.032 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:22:39.043 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:22:39.045 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T17:22:39.051 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T17:22:39.052 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:22:39.071 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:22:39.112 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T17:22:39.121 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T17:22:39.121 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:22:39.139 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:22:39.168 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:22:39.235 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:22:39.286 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:22:39.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:22:39.410 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:22:39.410 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:22:39.475 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:22:39.519 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:22:39.572 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:22:39.654 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:22:39.699 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:22:39.699 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:22:39.765 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-09-12T17:22:39.768 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-09-12T17:22:39.822 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:22:39.863 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:22:40.206 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T17:22:40.214 INFO:teuthology.task.internal:Starting timer... 2024-09-12T17:22:40.214 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T17:22:40.230 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T17:22:40.249 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-09-12T17:22:40.319 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-09-12T17:22:40.321 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2024-09-12T17:22:40.379 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2024-09-12T17:22:40.381 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T17:22:40.381 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-09-12T17:22:40.403 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-09-12T17:22:40.403 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2024-09-12T17:22:40.429 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2024-09-12T17:22:40.430 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi107.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi148.front.sepia.ceph.com': 'permissive'} 2024-09-12T17:22:40.430 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:22:40.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:22:40.469 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:22:40.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:22:40.496 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T17:22:40.496 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-09-12T17:22:40.540 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2024-09-12T17:22:40.568 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T17:22:40.577 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T17:22:40.580 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T17:22:40.697 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T17:22:40.708 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T17:22:40.709 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi107.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:26:23.868 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2024-09-12T17:26:23.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T17:26:23.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:26:23.953 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-09-12T17:26:24.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-09-12T17:26:24.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T17:26:24.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:26:24.115 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-12T17:26:24.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T17:26:24.200 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:26:24.211 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:26:24.211 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:26:24.212 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:26:24.214 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:26:24.214 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:26:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T17:26:24.255 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T17:26:24.270 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T17:26:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-09-12T17:26:24.284 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T17:26:24.290 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-09-12T17:26:24.304 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T17:26:24.309 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2024-09-12T17:26:24.318 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T17:26:24.319 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2024-09-12T17:26:24.338 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T17:26:24.348 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T17:26:24.374 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:26:24.377 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:26:24.377 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-12T17:26:24.378 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:26:24.378 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:26:24.378 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:26:24.378 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:26:24.410 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:26:24.414 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:26:24.414 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-12T17:26:24.414 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:26:24.414 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:26:24.414 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:26:24.414 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:26:24.415 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:26:24.423 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:26:24.424 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:26:24.424 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T17:26:24.424 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:26:24.429 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:26:24.429 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:26:24.430 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T17:26:24.430 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:26:24.433 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T17:26:24.433 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:26:24.583 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T17:26:24.583 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T17:26:24.587 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T17:26:24.587 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T17:26:24.701 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T17:26:24.701 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:26:24.701 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T17:26:24.711 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T17:26:24.711 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:26:24.711 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T17:26:24.728 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T17:26:24.728 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T17:26:24.738 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T17:26:24.738 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T17:26:24.794 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T17:26:24.806 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T17:26:24.868 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T17:26:24.881 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T17:26:24.933 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2024-09-12T17:26:24.935 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2024-09-12T17:26:24.945 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-09-12T17:26:24.947 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-09-12T17:26:25.169 INFO:teuthology.orchestra.run.smithi148.stdout:45 files removed 2024-09-12T17:26:25.172 INFO:teuthology.orchestra.run.smithi107.stdout:45 files removed 2024-09-12T17:26:25.197 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T17:26:25.199 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T17:26:25.751 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-12T17:26:25.751 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-12T17:26:26.034 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-12T17:26:26.034 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-12T17:26:26.310 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-12T17:26:26.310 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-12T17:26:27.402 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 7.8 MB/s | 8.2 MB 00:01 2024-09-12T17:26:27.893 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-09-12T17:26:29.536 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-12T17:26:29.678 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-12T17:26:34.487 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.5 MB 00:01 2024-09-12T17:26:35.829 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-12T17:26:36.137 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-12T17:26:36.917 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T17:26:37.582 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-12T17:26:38.492 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T17:26:42.364 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-12T17:26:43.963 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-12T17:26:44.650 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:26:44.650 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:26:44.744 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-12T17:26:44.771 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================================== 2024-09-12T17:26:44.772 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-12T17:26:44.772 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================================== 2024-09-12T17:26:44.772 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-12T17:26:44.772 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T17:26:44.772 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:26:44.772 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T17:26:44.772 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T17:26:44.772 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T17:26:44.772 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T17:26:44.772 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T17:26:44.773 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T17:26:44.773 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T17:26:44.773 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T17:26:44.773 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T17:26:44.773 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T17:26:44.773 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T17:26:44.773 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T17:26:44.773 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T17:26:44.773 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T17:26:44.773 INFO:teuthology.orchestra.run.smithi148.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T17:26:44.773 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:26:44.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T17:26:44.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T17:26:44.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T17:26:44.774 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T17:26:44.774 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:26:44.774 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T17:26:44.774 INFO:teuthology.orchestra.run.smithi148.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T17:26:44.774 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-09-12T17:26:44.774 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T17:26:44.774 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:26:44.775 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-12T17:26:44.775 INFO:teuthology.orchestra.run.smithi148.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T17:26:44.775 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T17:26:44.775 INFO:teuthology.orchestra.run.smithi148.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T17:26:44.775 INFO:teuthology.orchestra.run.smithi148.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T17:26:44.775 INFO:teuthology.orchestra.run.smithi148.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T17:26:44.775 INFO:teuthology.orchestra.run.smithi148.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T17:26:44.775 INFO:teuthology.orchestra.run.smithi148.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T17:26:44.775 INFO:teuthology.orchestra.run.smithi148.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T17:26:44.775 INFO:teuthology.orchestra.run.smithi148.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T17:26:44.775 INFO:teuthology.orchestra.run.smithi148.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T17:26:44.775 INFO:teuthology.orchestra.run.smithi148.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T17:26:44.776 INFO:teuthology.orchestra.run.smithi148.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T17:26:44.776 INFO:teuthology.orchestra.run.smithi148.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T17:26:44.776 INFO:teuthology.orchestra.run.smithi148.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T17:26:44.776 INFO:teuthology.orchestra.run.smithi148.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T17:26:44.776 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T17:26:44.776 INFO:teuthology.orchestra.run.smithi148.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T17:26:44.776 INFO:teuthology.orchestra.run.smithi148.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T17:26:44.776 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T17:26:44.776 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T17:26:44.776 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T17:26:44.777 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T17:26:44.777 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T17:26:44.777 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T17:26:44.777 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T17:26:44.777 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T17:26:44.777 INFO:teuthology.orchestra.run.smithi148.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T17:26:44.777 INFO:teuthology.orchestra.run.smithi148.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T17:26:44.777 INFO:teuthology.orchestra.run.smithi148.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T17:26:44.777 INFO:teuthology.orchestra.run.smithi148.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T17:26:44.777 INFO:teuthology.orchestra.run.smithi148.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T17:26:44.777 INFO:teuthology.orchestra.run.smithi148.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T17:26:44.778 INFO:teuthology.orchestra.run.smithi148.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T17:26:44.778 INFO:teuthology.orchestra.run.smithi148.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T17:26:44.778 INFO:teuthology.orchestra.run.smithi148.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T17:26:44.778 INFO:teuthology.orchestra.run.smithi148.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T17:26:44.778 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T17:26:44.778 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T17:26:44.778 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T17:26:44.778 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T17:26:44.778 INFO:teuthology.orchestra.run.smithi148.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T17:26:44.778 INFO:teuthology.orchestra.run.smithi148.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T17:26:44.778 INFO:teuthology.orchestra.run.smithi148.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T17:26:44.778 INFO:teuthology.orchestra.run.smithi148.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T17:26:44.779 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T17:26:44.779 INFO:teuthology.orchestra.run.smithi148.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T17:26:44.779 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T17:26:44.779 INFO:teuthology.orchestra.run.smithi148.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T17:26:44.779 INFO:teuthology.orchestra.run.smithi148.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T17:26:44.779 INFO:teuthology.orchestra.run.smithi148.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T17:26:44.779 INFO:teuthology.orchestra.run.smithi148.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T17:26:44.779 INFO:teuthology.orchestra.run.smithi148.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T17:26:44.779 INFO:teuthology.orchestra.run.smithi148.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T17:26:44.779 INFO:teuthology.orchestra.run.smithi148.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T17:26:44.779 INFO:teuthology.orchestra.run.smithi148.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T17:26:44.780 INFO:teuthology.orchestra.run.smithi148.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T17:26:44.780 INFO:teuthology.orchestra.run.smithi148.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T17:26:44.780 INFO:teuthology.orchestra.run.smithi148.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T17:26:44.780 INFO:teuthology.orchestra.run.smithi148.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T17:26:44.780 INFO:teuthology.orchestra.run.smithi148.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T17:26:44.780 INFO:teuthology.orchestra.run.smithi148.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T17:26:44.780 INFO:teuthology.orchestra.run.smithi148.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T17:26:44.780 INFO:teuthology.orchestra.run.smithi148.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T17:26:44.780 INFO:teuthology.orchestra.run.smithi148.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T17:26:44.780 INFO:teuthology.orchestra.run.smithi148.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T17:26:44.780 INFO:teuthology.orchestra.run.smithi148.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T17:26:44.781 INFO:teuthology.orchestra.run.smithi148.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T17:26:44.781 INFO:teuthology.orchestra.run.smithi148.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T17:26:44.781 INFO:teuthology.orchestra.run.smithi148.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T17:26:44.781 INFO:teuthology.orchestra.run.smithi148.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T17:26:44.781 INFO:teuthology.orchestra.run.smithi148.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T17:26:44.781 INFO:teuthology.orchestra.run.smithi148.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T17:26:44.781 INFO:teuthology.orchestra.run.smithi148.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T17:26:44.781 INFO:teuthology.orchestra.run.smithi148.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T17:26:44.781 INFO:teuthology.orchestra.run.smithi148.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T17:26:44.781 INFO:teuthology.orchestra.run.smithi148.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T17:26:44.782 INFO:teuthology.orchestra.run.smithi148.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T17:26:44.782 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T17:26:44.782 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T17:26:44.782 INFO:teuthology.orchestra.run.smithi148.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T17:26:44.782 INFO:teuthology.orchestra.run.smithi148.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T17:26:44.782 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:26:44.782 INFO:teuthology.orchestra.run.smithi148.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T17:26:44.782 INFO:teuthology.orchestra.run.smithi148.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T17:26:44.782 INFO:teuthology.orchestra.run.smithi148.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T17:26:44.782 INFO:teuthology.orchestra.run.smithi148.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T17:26:44.782 INFO:teuthology.orchestra.run.smithi148.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T17:26:44.783 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T17:26:44.783 INFO:teuthology.orchestra.run.smithi148.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T17:26:44.783 INFO:teuthology.orchestra.run.smithi148.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T17:26:44.783 INFO:teuthology.orchestra.run.smithi148.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T17:26:44.783 INFO:teuthology.orchestra.run.smithi148.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T17:26:44.783 INFO:teuthology.orchestra.run.smithi148.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T17:26:44.783 INFO:teuthology.orchestra.run.smithi148.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T17:26:44.783 INFO:teuthology.orchestra.run.smithi148.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T17:26:44.783 INFO:teuthology.orchestra.run.smithi148.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T17:26:44.783 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T17:26:44.783 INFO:teuthology.orchestra.run.smithi148.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T17:26:44.784 INFO:teuthology.orchestra.run.smithi148.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T17:26:44.784 INFO:teuthology.orchestra.run.smithi148.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T17:26:44.784 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T17:26:44.784 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T17:26:44.784 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T17:26:44.784 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T17:26:44.784 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T17:26:44.784 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:26:44.784 INFO:teuthology.orchestra.run.smithi148.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T17:26:44.784 INFO:teuthology.orchestra.run.smithi148.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T17:26:44.784 INFO:teuthology.orchestra.run.smithi148.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T17:26:44.785 INFO:teuthology.orchestra.run.smithi148.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T17:26:44.785 INFO:teuthology.orchestra.run.smithi148.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T17:26:44.785 INFO:teuthology.orchestra.run.smithi148.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T17:26:44.785 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T17:26:44.785 INFO:teuthology.orchestra.run.smithi148.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T17:26:44.785 INFO:teuthology.orchestra.run.smithi148.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T17:26:44.785 INFO:teuthology.orchestra.run.smithi148.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T17:26:44.785 INFO:teuthology.orchestra.run.smithi148.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T17:26:44.785 INFO:teuthology.orchestra.run.smithi148.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T17:26:44.785 INFO:teuthology.orchestra.run.smithi148.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T17:26:44.785 INFO:teuthology.orchestra.run.smithi148.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T17:26:44.785 INFO:teuthology.orchestra.run.smithi148.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T17:26:44.786 INFO:teuthology.orchestra.run.smithi148.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T17:26:44.786 INFO:teuthology.orchestra.run.smithi148.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T17:26:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T17:26:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T17:26:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T17:26:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T17:26:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T17:26:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T17:26:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T17:26:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T17:26:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T17:26:44.789 INFO:teuthology.orchestra.run.smithi148.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T17:26:44.789 INFO:teuthology.orchestra.run.smithi148.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T17:26:44.789 INFO:teuthology.orchestra.run.smithi148.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T17:26:44.789 INFO:teuthology.orchestra.run.smithi148.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T17:26:44.789 INFO:teuthology.orchestra.run.smithi148.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T17:26:44.789 INFO:teuthology.orchestra.run.smithi148.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T17:26:44.789 INFO:teuthology.orchestra.run.smithi148.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T17:26:44.789 INFO:teuthology.orchestra.run.smithi148.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T17:26:44.789 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T17:26:44.789 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T17:26:44.789 INFO:teuthology.orchestra.run.smithi148.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T17:26:44.790 INFO:teuthology.orchestra.run.smithi148.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T17:26:44.790 INFO:teuthology.orchestra.run.smithi148.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T17:26:44.790 INFO:teuthology.orchestra.run.smithi148.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T17:26:44.790 INFO:teuthology.orchestra.run.smithi148.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T17:26:44.790 INFO:teuthology.orchestra.run.smithi148.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T17:26:44.790 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T17:26:44.790 INFO:teuthology.orchestra.run.smithi148.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T17:26:44.790 INFO:teuthology.orchestra.run.smithi148.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T17:26:44.790 INFO:teuthology.orchestra.run.smithi148.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T17:26:44.790 INFO:teuthology.orchestra.run.smithi148.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T17:26:44.791 INFO:teuthology.orchestra.run.smithi148.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T17:26:44.791 INFO:teuthology.orchestra.run.smithi148.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T17:26:44.791 INFO:teuthology.orchestra.run.smithi148.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T17:26:44.791 INFO:teuthology.orchestra.run.smithi148.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T17:26:44.791 INFO:teuthology.orchestra.run.smithi148.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T17:26:44.791 INFO:teuthology.orchestra.run.smithi148.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T17:26:44.791 INFO:teuthology.orchestra.run.smithi148.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T17:26:44.791 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T17:26:44.791 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T17:26:44.791 INFO:teuthology.orchestra.run.smithi148.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T17:26:44.791 INFO:teuthology.orchestra.run.smithi148.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T17:26:44.791 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T17:26:44.792 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T17:26:44.792 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T17:26:44.792 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T17:26:44.792 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T17:26:44.792 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T17:26:44.792 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T17:26:44.792 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T17:26:44.792 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T17:26:44.792 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T17:26:44.792 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T17:26:44.793 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T17:26:44.793 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T17:26:44.793 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T17:26:44.793 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T17:26:44.793 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T17:26:44.793 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T17:26:44.793 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T17:26:44.793 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T17:26:44.793 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T17:26:44.793 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T17:26:44.793 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T17:26:44.794 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T17:26:44.794 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T17:26:44.794 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T17:26:44.794 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T17:26:44.794 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T17:26:44.794 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T17:26:44.794 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T17:26:44.794 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T17:26:44.794 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T17:26:44.794 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T17:26:44.794 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T17:26:44.794 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T17:26:44.795 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T17:26:44.795 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T17:26:44.795 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T17:26:44.795 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T17:26:44.795 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T17:26:44.795 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T17:26:44.795 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T17:26:44.795 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T17:26:44.795 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T17:26:44.795 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T17:26:44.795 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T17:26:44.796 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T17:26:44.796 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T17:26:44.796 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T17:26:44.796 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T17:26:44.796 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T17:26:44.796 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T17:26:44.796 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T17:26:44.796 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T17:26:44.796 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T17:26:44.796 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T17:26:44.797 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T17:26:44.797 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T17:26:44.797 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T17:26:44.797 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T17:26:44.797 INFO:teuthology.orchestra.run.smithi148.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T17:26:44.797 INFO:teuthology.orchestra.run.smithi148.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T17:26:44.797 INFO:teuthology.orchestra.run.smithi148.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T17:26:44.797 INFO:teuthology.orchestra.run.smithi148.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T17:26:44.797 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T17:26:44.797 INFO:teuthology.orchestra.run.smithi148.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T17:26:44.797 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T17:26:44.797 INFO:teuthology.orchestra.run.smithi148.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T17:26:44.798 INFO:teuthology.orchestra.run.smithi148.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T17:26:44.798 INFO:teuthology.orchestra.run.smithi148.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T17:26:44.798 INFO:teuthology.orchestra.run.smithi148.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T17:26:44.798 INFO:teuthology.orchestra.run.smithi148.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T17:26:44.798 INFO:teuthology.orchestra.run.smithi148.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T17:26:44.798 INFO:teuthology.orchestra.run.smithi148.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T17:26:44.798 INFO:teuthology.orchestra.run.smithi148.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T17:26:44.798 INFO:teuthology.orchestra.run.smithi148.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T17:26:44.798 INFO:teuthology.orchestra.run.smithi148.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T17:26:44.798 INFO:teuthology.orchestra.run.smithi148.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T17:26:44.798 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T17:26:44.799 INFO:teuthology.orchestra.run.smithi148.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T17:26:44.799 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2024-09-12T17:26:44.799 INFO:teuthology.orchestra.run.smithi148.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T17:26:44.799 INFO:teuthology.orchestra.run.smithi148.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T17:26:44.799 INFO:teuthology.orchestra.run.smithi148.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T17:26:44.799 INFO:teuthology.orchestra.run.smithi148.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T17:26:44.799 INFO:teuthology.orchestra.run.smithi148.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T17:26:44.799 INFO:teuthology.orchestra.run.smithi148.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T17:26:44.799 INFO:teuthology.orchestra.run.smithi148.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T17:26:44.799 INFO:teuthology.orchestra.run.smithi148.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T17:26:44.799 INFO:teuthology.orchestra.run.smithi148.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T17:26:44.800 INFO:teuthology.orchestra.run.smithi148.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T17:26:44.800 INFO:teuthology.orchestra.run.smithi148.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T17:26:44.800 INFO:teuthology.orchestra.run.smithi148.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T17:26:44.800 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T17:26:44.800 INFO:teuthology.orchestra.run.smithi148.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T17:26:44.800 INFO:teuthology.orchestra.run.smithi148.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T17:26:44.800 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:26:44.800 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-12T17:26:44.800 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================================== 2024-09-12T17:26:44.800 INFO:teuthology.orchestra.run.smithi148.stdout:Install 283 Packages 2024-09-12T17:26:44.800 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 2 Packages 2024-09-12T17:26:44.801 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:26:44.801 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 322 M 2024-09-12T17:26:44.801 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-12T17:26:45.341 INFO:teuthology.orchestra.run.smithi148.stdout:(1/285): ceph-19.3.0-4762.gbad475c1.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-12T17:26:45.532 INFO:teuthology.orchestra.run.smithi148.stdout:(2/285): ceph-fuse-19.3.0-4762.gbad475c1.el9.x8 4.6 MB/s | 900 kB 00:00 2024-09-12T17:26:45.624 INFO:teuthology.orchestra.run.smithi148.stdout:(3/285): ceph-base-19.3.0-4762.gbad475c1.el9.x8 13 MB/s | 5.5 MB 00:00 2024-09-12T17:26:45.649 INFO:teuthology.orchestra.run.smithi148.stdout:(4/285): ceph-immutable-object-cache-19.3.0-476 1.2 MB/s | 145 kB 00:00 2024-09-12T17:26:45.742 INFO:teuthology.orchestra.run.smithi148.stdout:(5/285): ceph-mds-19.3.0-4762.gbad475c1.el9.x86 20 MB/s | 2.4 MB 00:00 2024-09-12T17:26:45.850 INFO:teuthology.orchestra.run.smithi148.stdout:(6/285): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86 7.6 MB/s | 1.5 MB 00:00 2024-09-12T17:26:45.934 INFO:teuthology.orchestra.run.smithi148.stdout:(7/285): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 25 MB/s | 4.8 MB 00:00 2024-09-12T17:26:46.266 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:26:46.266 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:26:46.357 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-12T17:26:46.380 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================================== 2024-09-12T17:26:46.380 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-12T17:26:46.380 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================================== 2024-09-12T17:26:46.380 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-12T17:26:46.380 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T17:26:46.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:26:46.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T17:26:46.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T17:26:46.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T17:26:46.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T17:26:46.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T17:26:46.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T17:26:46.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T17:26:46.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T17:26:46.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T17:26:46.381 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T17:26:46.381 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-09-12T17:26:46.382 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T17:26:46.383 INFO:teuthology.orchestra.run.smithi107.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T17:26:46.384 INFO:teuthology.orchestra.run.smithi107.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T17:26:46.384 INFO:teuthology.orchestra.run.smithi107.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T17:26:46.384 INFO:teuthology.orchestra.run.smithi107.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T17:26:46.384 INFO:teuthology.orchestra.run.smithi107.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T17:26:46.384 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T17:26:46.384 INFO:teuthology.orchestra.run.smithi107.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T17:26:46.384 INFO:teuthology.orchestra.run.smithi107.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T17:26:46.384 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T17:26:46.384 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T17:26:46.384 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T17:26:46.384 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T17:26:46.385 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T17:26:46.385 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T17:26:46.385 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T17:26:46.385 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T17:26:46.385 INFO:teuthology.orchestra.run.smithi107.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T17:26:46.385 INFO:teuthology.orchestra.run.smithi107.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T17:26:46.385 INFO:teuthology.orchestra.run.smithi107.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T17:26:46.385 INFO:teuthology.orchestra.run.smithi107.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T17:26:46.385 INFO:teuthology.orchestra.run.smithi107.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T17:26:46.385 INFO:teuthology.orchestra.run.smithi107.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T17:26:46.385 INFO:teuthology.orchestra.run.smithi107.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T17:26:46.385 INFO:teuthology.orchestra.run.smithi107.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T17:26:46.386 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T17:26:46.387 INFO:teuthology.orchestra.run.smithi107.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T17:26:46.388 INFO:teuthology.orchestra.run.smithi107.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T17:26:46.388 INFO:teuthology.orchestra.run.smithi107.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T17:26:46.388 INFO:teuthology.orchestra.run.smithi107.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T17:26:46.388 INFO:teuthology.orchestra.run.smithi107.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T17:26:46.388 INFO:teuthology.orchestra.run.smithi107.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T17:26:46.388 INFO:teuthology.orchestra.run.smithi107.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T17:26:46.388 INFO:teuthology.orchestra.run.smithi107.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T17:26:46.388 INFO:teuthology.orchestra.run.smithi107.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T17:26:46.388 INFO:teuthology.orchestra.run.smithi107.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T17:26:46.388 INFO:teuthology.orchestra.run.smithi107.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T17:26:46.388 INFO:teuthology.orchestra.run.smithi107.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T17:26:46.388 INFO:teuthology.orchestra.run.smithi107.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T17:26:46.389 INFO:teuthology.orchestra.run.smithi107.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T17:26:46.390 INFO:teuthology.orchestra.run.smithi107.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T17:26:46.391 INFO:teuthology.orchestra.run.smithi107.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T17:26:46.391 INFO:teuthology.orchestra.run.smithi107.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T17:26:46.391 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T17:26:46.391 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T17:26:46.391 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T17:26:46.391 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T17:26:46.391 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T17:26:46.391 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:26:46.391 INFO:teuthology.orchestra.run.smithi107.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T17:26:46.391 INFO:teuthology.orchestra.run.smithi107.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T17:26:46.391 INFO:teuthology.orchestra.run.smithi107.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T17:26:46.391 INFO:teuthology.orchestra.run.smithi107.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T17:26:46.392 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T17:26:46.392 INFO:teuthology.orchestra.run.smithi107.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T17:26:46.392 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T17:26:46.392 INFO:teuthology.orchestra.run.smithi107.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T17:26:46.392 INFO:teuthology.orchestra.run.smithi107.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T17:26:46.392 INFO:teuthology.orchestra.run.smithi107.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T17:26:46.392 INFO:teuthology.orchestra.run.smithi107.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T17:26:46.392 INFO:teuthology.orchestra.run.smithi107.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T17:26:46.392 INFO:teuthology.orchestra.run.smithi107.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T17:26:46.392 INFO:teuthology.orchestra.run.smithi107.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T17:26:46.392 INFO:teuthology.orchestra.run.smithi107.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T17:26:46.393 INFO:teuthology.orchestra.run.smithi107.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T17:26:46.393 INFO:teuthology.orchestra.run.smithi107.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T17:26:46.393 INFO:teuthology.orchestra.run.smithi107.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T17:26:46.393 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T17:26:46.393 INFO:teuthology.orchestra.run.smithi107.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T17:26:46.393 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T17:26:46.393 INFO:teuthology.orchestra.run.smithi107.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T17:26:46.393 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T17:26:46.393 INFO:teuthology.orchestra.run.smithi107.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T17:26:46.393 INFO:teuthology.orchestra.run.smithi107.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T17:26:46.393 INFO:teuthology.orchestra.run.smithi107.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T17:26:46.393 INFO:teuthology.orchestra.run.smithi107.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T17:26:46.394 INFO:teuthology.orchestra.run.smithi107.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T17:26:46.395 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T17:26:46.396 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T17:26:46.397 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T17:26:46.398 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T17:26:46.399 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T17:26:46.399 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T17:26:46.399 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T17:26:46.399 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T17:26:46.399 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T17:26:46.399 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T17:26:46.399 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T17:26:46.399 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T17:26:46.399 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T17:26:46.399 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T17:26:46.399 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T17:26:46.399 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T17:26:46.400 INFO:teuthology.orchestra.run.smithi107.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T17:26:46.401 INFO:teuthology.orchestra.run.smithi107.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T17:26:46.401 INFO:teuthology.orchestra.run.smithi107.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T17:26:46.401 INFO:teuthology.orchestra.run.smithi107.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T17:26:46.401 INFO:teuthology.orchestra.run.smithi107.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T17:26:46.401 INFO:teuthology.orchestra.run.smithi107.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T17:26:46.401 INFO:teuthology.orchestra.run.smithi107.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T17:26:46.401 INFO:teuthology.orchestra.run.smithi107.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T17:26:46.401 INFO:teuthology.orchestra.run.smithi107.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T17:26:46.401 INFO:teuthology.orchestra.run.smithi107.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T17:26:46.401 INFO:teuthology.orchestra.run.smithi107.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T17:26:46.401 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T17:26:46.402 INFO:teuthology.orchestra.run.smithi107.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T17:26:46.403 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T17:26:46.403 INFO:teuthology.orchestra.run.smithi107.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T17:26:46.403 INFO:teuthology.orchestra.run.smithi107.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T17:26:46.403 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:26:46.403 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-12T17:26:46.403 INFO:teuthology.orchestra.run.smithi107.stdout:====================================================================================================== 2024-09-12T17:26:46.403 INFO:teuthology.orchestra.run.smithi107.stdout:Install 283 Packages 2024-09-12T17:26:46.403 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 2 Packages 2024-09-12T17:26:46.403 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:26:46.404 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 322 M 2024-09-12T17:26:46.404 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-12T17:26:46.451 INFO:teuthology.orchestra.run.smithi148.stdout:(8/285): ceph-radosgw-19.3.0-4762.gbad475c1.el9 21 MB/s | 11 MB 00:00 2024-09-12T17:26:46.501 INFO:teuthology.orchestra.run.smithi148.stdout:(9/285): ceph-selinux-19.3.0-4762.gbad475c1.el9 505 kB/s | 25 kB 00:00 2024-09-12T17:26:46.701 INFO:teuthology.orchestra.run.smithi148.stdout:(10/285): ceph-common-19.3.0-4762.gbad475c1.el9 14 MB/s | 22 MB 00:01 2024-09-12T17:26:46.743 INFO:teuthology.orchestra.run.smithi148.stdout:(11/285): libcephfs-devel-19.3.0-4762.gbad475c1 766 kB/s | 32 kB 00:00 2024-09-12T17:26:46.843 INFO:teuthology.orchestra.run.smithi148.stdout:(12/285): libcephfs2-19.3.0-4762.gbad475c1.el9. 7.4 MB/s | 756 kB 00:00 2024-09-12T17:26:46.918 INFO:teuthology.orchestra.run.smithi148.stdout:(13/285): libcephsqlite-19.3.0-4762.gbad475c1.e 2.1 MB/s | 161 kB 00:00 2024-09-12T17:26:46.994 INFO:teuthology.orchestra.run.smithi148.stdout:(14/285): librados-devel-19.3.0-4762.gbad475c1. 1.6 MB/s | 126 kB 00:00 2024-09-12T17:26:47.015 INFO:teuthology.orchestra.run.smithi107.stdout:(1/285): ceph-19.3.0-4762.gbad475c1.el9.x86_64. 36 kB/s | 6.6 kB 00:00 2024-09-12T17:26:47.077 INFO:teuthology.orchestra.run.smithi148.stdout:(15/285): libradosstriper1-19.3.0-4762.gbad475c 6.0 MB/s | 508 kB 00:00 2024-09-12T17:26:47.403 INFO:teuthology.orchestra.run.smithi148.stdout:(16/285): ceph-osd-19.3.0-4762.gbad475c1.el9.x8 11 MB/s | 17 MB 00:01 2024-09-12T17:26:47.486 INFO:teuthology.orchestra.run.smithi148.stdout:(17/285): librgw2-19.3.0-4762.gbad475c1.el9.x86 13 MB/s | 5.5 MB 00:00 2024-09-12T17:26:47.498 INFO:teuthology.orchestra.run.smithi107.stdout:(2/285): ceph-fuse-19.3.0-4762.gbad475c1.el9.x8 1.8 MB/s | 900 kB 00:00 2024-09-12T17:26:47.511 INFO:teuthology.orchestra.run.smithi148.stdout:(18/285): python3-ceph-argparse-19.3.0-4762.gba 416 kB/s | 45 kB 00:00 2024-09-12T17:26:47.537 INFO:teuthology.orchestra.run.smithi148.stdout:(19/285): python3-ceph-common-19.3.0-4762.gbad4 2.8 MB/s | 143 kB 00:00 2024-09-12T17:26:47.562 INFO:teuthology.orchestra.run.smithi148.stdout:(20/285): python3-cephfs-19.3.0-4762.gbad475c1. 3.1 MB/s | 161 kB 00:00 2024-09-12T17:26:47.565 INFO:teuthology.orchestra.run.smithi107.stdout:(3/285): ceph-immutable-object-cache-19.3.0-476 2.1 MB/s | 145 kB 00:00 2024-09-12T17:26:47.587 INFO:teuthology.orchestra.run.smithi148.stdout:(21/285): python3-rados-19.3.0-4762.gbad475c1.e 6.3 MB/s | 321 kB 00:00 2024-09-12T17:26:47.612 INFO:teuthology.orchestra.run.smithi148.stdout:(22/285): python3-rbd-19.3.0-4762.gbad475c1.el9 6.0 MB/s | 305 kB 00:00 2024-09-12T17:26:47.638 INFO:teuthology.orchestra.run.smithi148.stdout:(23/285): python3-rgw-19.3.0-4762.gbad475c1.el9 1.9 MB/s | 99 kB 00:00 2024-09-12T17:26:47.663 INFO:teuthology.orchestra.run.smithi148.stdout:(24/285): rbd-fuse-19.3.0-4762.gbad475c1.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-12T17:26:47.739 INFO:teuthology.orchestra.run.smithi148.stdout:(25/285): rbd-nbd-19.3.0-4762.gbad475c1.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-12T17:26:47.822 INFO:teuthology.orchestra.run.smithi148.stdout:(26/285): rbd-mirror-19.3.0-4762.gbad475c1.el9. 17 MB/s | 3.2 MB 00:00 2024-09-12T17:26:47.839 INFO:teuthology.orchestra.run.smithi148.stdout:(27/285): ceph-grafana-dashboards-19.3.0-4762.g 342 kB/s | 34 kB 00:00 2024-09-12T17:26:47.875 INFO:teuthology.orchestra.run.smithi148.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4762.gbad475c 2.9 MB/s | 154 kB 00:00 2024-09-12T17:26:47.882 INFO:teuthology.orchestra.run.smithi107.stdout:(4/285): ceph-base-19.3.0-4762.gbad475c1.el9.x8 5.3 MB/s | 5.5 MB 00:01 2024-09-12T17:26:48.325 INFO:teuthology.orchestra.run.smithi148.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-12T17:26:48.374 INFO:teuthology.orchestra.run.smithi107.stdout:(5/285): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86 3.1 MB/s | 1.5 MB 00:00 2024-09-12T17:26:48.474 INFO:teuthology.orchestra.run.smithi107.stdout:(6/285): ceph-mds-19.3.0-4762.gbad475c1.el9.x86 2.6 MB/s | 2.4 MB 00:00 2024-09-12T17:26:48.775 INFO:teuthology.orchestra.run.smithi148.stdout:(30/285): ceph-test-19.3.0-4762.gbad475c1.el9.x 20 MB/s | 45 MB 00:02 2024-09-12T17:26:48.801 INFO:teuthology.orchestra.run.smithi148.stdout:(31/285): ceph-mgr-modules-core-19.3.0-4762.gba 612 kB/s | 291 kB 00:00 2024-09-12T17:26:48.834 INFO:teuthology.orchestra.run.smithi148.stdout:(32/285): ceph-mgr-rook-19.3.0-4762.gbad475c1.e 847 kB/s | 49 kB 00:00 2024-09-12T17:26:48.862 INFO:teuthology.orchestra.run.smithi148.stdout:(33/285): ceph-prometheus-alerts-19.3.0-4762.gb 282 kB/s | 16 kB 00:00 2024-09-12T17:26:48.885 INFO:teuthology.orchestra.run.smithi148.stdout:(34/285): ceph-volume-19.3.0-4762.gbad475c1.el9 5.6 MB/s | 285 kB 00:00 2024-09-12T17:26:48.935 INFO:teuthology.orchestra.run.smithi148.stdout:(35/285): cephadm-19.3.0-4762.gbad475c1.el9.noa 10 MB/s | 783 kB 00:00 2024-09-12T17:26:49.035 INFO:teuthology.orchestra.run.smithi148.stdout:(36/285): ModemManager-glib-1.20.2-1.el9.x86_64 2.2 MB/s | 335 kB 00:00 2024-09-12T17:26:49.041 INFO:teuthology.orchestra.run.smithi107.stdout:(7/285): ceph-common-19.3.0-4762.gbad475c1.el9. 9.8 MB/s | 22 MB 00:02 2024-09-12T17:26:49.060 INFO:teuthology.orchestra.run.smithi148.stdout:(37/285): bluez-libs-5.56-6.el9.x86_64.rpm 677 kB/s | 85 kB 00:00 2024-09-12T17:26:49.086 INFO:teuthology.orchestra.run.smithi148.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 985 kB/s | 49 kB 00:00 2024-09-12T17:26:49.116 INFO:teuthology.orchestra.run.smithi107.stdout:(8/285): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 6.5 MB/s | 4.8 MB 00:00 2024-09-12T17:26:49.128 INFO:teuthology.orchestra.run.smithi148.stdout:(39/285): fuse-2.9.9-16.el9.x86_64.rpm 1.9 MB/s | 80 kB 00:00 2024-09-12T17:26:49.153 INFO:teuthology.orchestra.run.smithi148.stdout:(40/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.8 MB/s | 262 kB 00:00 2024-09-12T17:26:49.158 INFO:teuthology.orchestra.run.smithi107.stdout:(9/285): ceph-selinux-19.3.0-4762.gbad475c1.el9 605 kB/s | 25 kB 00:00 2024-09-12T17:26:49.303 INFO:teuthology.orchestra.run.smithi148.stdout:(41/285): ceph-mgr-dashboard-19.3.0-4762.gbad47 9.7 MB/s | 14 MB 00:01 2024-09-12T17:26:49.328 INFO:teuthology.orchestra.run.smithi148.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 154 kB/s | 27 kB 00:00 2024-09-12T17:26:49.362 INFO:teuthology.orchestra.run.smithi148.stdout:(43/285): libgfortran-11.5.0-2.el9.x86_64.rpm 3.3 MB/s | 801 kB 00:00 2024-09-12T17:26:49.379 INFO:teuthology.orchestra.run.smithi148.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-09-12T17:26:49.404 INFO:teuthology.orchestra.run.smithi148.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-09-12T17:26:49.438 INFO:teuthology.orchestra.run.smithi148.stdout:(46/285): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-12T17:26:49.463 INFO:teuthology.orchestra.run.smithi148.stdout:(47/285): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-12T17:26:49.475 INFO:teuthology.orchestra.run.smithi107.stdout:(10/285): ceph-radosgw-19.3.0-4762.gbad475c1.el 25 MB/s | 11 MB 00:00 2024-09-12T17:26:49.488 INFO:teuthology.orchestra.run.smithi148.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T17:26:49.513 INFO:teuthology.orchestra.run.smithi148.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T17:26:49.517 INFO:teuthology.orchestra.run.smithi107.stdout:(11/285): libcephfs-devel-19.3.0-4762.gbad475c1 766 kB/s | 32 kB 00:00 2024-09-12T17:26:49.539 INFO:teuthology.orchestra.run.smithi148.stdout:(50/285): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T17:26:49.572 INFO:teuthology.orchestra.run.smithi148.stdout:(51/285): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.2 MB 00:00 2024-09-12T17:26:49.575 INFO:teuthology.orchestra.run.smithi107.stdout:(12/285): libcephfs2-19.3.0-4762.gbad475c1.el9. 13 MB/s | 756 kB 00:00 2024-09-12T17:26:49.626 INFO:teuthology.orchestra.run.smithi107.stdout:(13/285): libcephsqlite-19.3.0-4762.gbad475c1.e 3.1 MB/s | 161 kB 00:00 2024-09-12T17:26:49.676 INFO:teuthology.orchestra.run.smithi107.stdout:(14/285): librados-devel-19.3.0-4762.gbad475c1. 2.5 MB/s | 126 kB 00:00 2024-09-12T17:26:49.726 INFO:teuthology.orchestra.run.smithi107.stdout:(15/285): libradosstriper1-19.3.0-4762.gbad475c 10 MB/s | 508 kB 00:00 2024-09-12T17:26:49.798 INFO:teuthology.orchestra.run.smithi148.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 2.2 MB/s | 650 kB 00:00 2024-09-12T17:26:49.831 INFO:teuthology.orchestra.run.smithi148.stdout:(53/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.0 MB/s | 523 kB 00:00 2024-09-12T17:26:49.856 INFO:teuthology.orchestra.run.smithi148.stdout:(54/285): apache-commons-cli-1.4-17.el9.noarch. 1.2 MB/s | 71 kB 00:00 2024-09-12T17:26:49.915 INFO:teuthology.orchestra.run.smithi148.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 3.5 MB/s | 302 kB 00:00 2024-09-12T17:26:49.935 INFO:teuthology.orchestra.run.smithi107.stdout:(16/285): librgw2-19.3.0-4762.gbad475c1.el9.x86 26 MB/s | 5.5 MB 00:00 2024-09-12T17:26:49.940 INFO:teuthology.orchestra.run.smithi148.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 3.3 MB/s | 283 kB 00:00 2024-09-12T17:26:49.977 INFO:teuthology.orchestra.run.smithi107.stdout:(17/285): python3-ceph-argparse-19.3.0-4762.gba 1.1 MB/s | 45 kB 00:00 2024-09-12T17:26:49.999 INFO:teuthology.orchestra.run.smithi148.stdout:(57/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T17:26:50.027 INFO:teuthology.orchestra.run.smithi107.stdout:(18/285): python3-ceph-common-19.3.0-4762.gbad4 2.8 MB/s | 143 kB 00:00 2024-09-12T17:26:50.057 INFO:teuthology.orchestra.run.smithi148.stdout:(58/285): apache-commons-lang3-3.12.0-6.el9.noa 3.8 MB/s | 559 kB 00:00 2024-09-12T17:26:50.086 INFO:teuthology.orchestra.run.smithi107.stdout:(19/285): python3-cephfs-19.3.0-4762.gbad475c1. 2.7 MB/s | 161 kB 00:00 2024-09-12T17:26:50.091 INFO:teuthology.orchestra.run.smithi148.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-09-12T17:26:50.117 INFO:teuthology.orchestra.run.smithi148.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 395 kB/s | 23 kB 00:00 2024-09-12T17:26:50.136 INFO:teuthology.orchestra.run.smithi107.stdout:(20/285): python3-rados-19.3.0-4762.gbad475c1.e 6.3 MB/s | 321 kB 00:00 2024-09-12T17:26:50.167 INFO:teuthology.orchestra.run.smithi148.stdout:(61/285): avahi-glib-0.8-21.el9.x86_64.rpm 299 kB/s | 15 kB 00:00 2024-09-12T17:26:50.186 INFO:teuthology.orchestra.run.smithi107.stdout:(21/285): python3-rbd-19.3.0-4762.gbad475c1.el9 6.0 MB/s | 305 kB 00:00 2024-09-12T17:26:50.192 INFO:teuthology.orchestra.run.smithi148.stdout:(62/285): atk-2.36.0-5.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-12T17:26:50.226 INFO:teuthology.orchestra.run.smithi148.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-12T17:26:50.236 INFO:teuthology.orchestra.run.smithi107.stdout:(22/285): python3-rgw-19.3.0-4762.gbad475c1.el9 1.9 MB/s | 99 kB 00:00 2024-09-12T17:26:50.251 INFO:teuthology.orchestra.run.smithi148.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 914 kB/s | 53 kB 00:00 2024-09-12T17:26:50.284 INFO:teuthology.orchestra.run.smithi148.stdout:(65/285): colord-libs-1.4.5-4.el9.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2024-09-12T17:26:50.287 INFO:teuthology.orchestra.run.smithi107.stdout:(23/285): rbd-fuse-19.3.0-4762.gbad475c1.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-12T17:26:50.310 INFO:teuthology.orchestra.run.smithi148.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-12T17:26:50.335 INFO:teuthology.orchestra.run.smithi148.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 561 kB/s | 28 kB 00:00 2024-09-12T17:26:50.361 INFO:teuthology.orchestra.run.smithi148.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-09-12T17:26:50.427 INFO:teuthology.orchestra.run.smithi148.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 5.6 MB/s | 525 kB 00:00 2024-09-12T17:26:50.437 INFO:teuthology.orchestra.run.smithi107.stdout:(24/285): rbd-mirror-19.3.0-4762.gbad475c1.el9. 21 MB/s | 3.2 MB 00:00 2024-09-12T17:26:50.488 INFO:teuthology.orchestra.run.smithi107.stdout:(25/285): rbd-nbd-19.3.0-4762.gbad475c1.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-12T17:26:50.528 INFO:teuthology.orchestra.run.smithi148.stdout:(70/285): exiv2-0.27.5-2.el9.x86_64.rpm 5.7 MB/s | 980 kB 00:00 2024-09-12T17:26:50.537 INFO:teuthology.orchestra.run.smithi107.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4762.g 687 kB/s | 34 kB 00:00 2024-09-12T17:26:50.586 INFO:teuthology.orchestra.run.smithi148.stdout:(71/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 4.8 MB/s | 781 kB 00:00 2024-09-12T17:26:50.588 INFO:teuthology.orchestra.run.smithi107.stdout:(27/285): ceph-mgr-cephadm-19.3.0-4762.gbad475c 3.0 MB/s | 154 kB 00:00 2024-09-12T17:26:50.612 INFO:teuthology.orchestra.run.smithi148.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.8 MB/s | 325 kB 00:00 2024-09-12T17:26:50.645 INFO:teuthology.orchestra.run.smithi148.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 3.6 MB/s | 218 kB 00:00 2024-09-12T17:26:50.695 INFO:teuthology.orchestra.run.smithi148.stdout:(74/285): flatpak-selinux-1.12.9-1.el9.noarch.r 432 kB/s | 22 kB 00:00 2024-09-12T17:26:50.754 INFO:teuthology.orchestra.run.smithi148.stdout:(75/285): flatpak-session-helper-1.12.9-1.el9.x 1.2 MB/s | 73 kB 00:00 2024-09-12T17:26:50.871 INFO:teuthology.orchestra.run.smithi148.stdout:(76/285): adwaita-icon-theme-40.1.1-3.el9.noarc 8.9 MB/s | 12 MB 00:01 2024-09-12T17:26:50.896 INFO:teuthology.orchestra.run.smithi148.stdout:(77/285): flexiblas-3.0.4-8.el9.x86_64.rpm 230 kB/s | 33 kB 00:00 2024-09-12T17:26:50.938 INFO:teuthology.orchestra.run.smithi148.stdout:(78/285): flatpak-1.12.9-1.el9.x86_64.rpm 5.3 MB/s | 1.7 MB 00:00 2024-09-12T17:26:50.963 INFO:teuthology.orchestra.run.smithi148.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-12T17:26:50.997 INFO:teuthology.orchestra.run.smithi148.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.5 MB/s | 89 kB 00:00 2024-09-12T17:26:51.014 INFO:teuthology.orchestra.run.smithi148.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 124 kB 00:00 2024-09-12T17:26:51.056 INFO:teuthology.orchestra.run.smithi148.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 829 kB/s | 49 kB 00:00 2024-09-12T17:26:51.063 INFO:teuthology.orchestra.run.smithi107.stdout:(28/285): ceph-mgr-dashboard-19.3.0-4762.gbad47 30 MB/s | 14 MB 00:00 2024-09-12T17:26:51.140 INFO:teuthology.orchestra.run.smithi148.stdout:(83/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-12T17:26:51.165 INFO:teuthology.orchestra.run.smithi148.stdout:(84/285): graphene-1.10.6-2.el9.x86_64.rpm 594 kB/s | 64 kB 00:00 2024-09-12T17:26:51.198 INFO:teuthology.orchestra.run.smithi148.stdout:(85/285): google-guice-4.2.3-9.el9.noarch.rpm 2.5 MB/s | 473 kB 00:00 2024-09-12T17:26:51.215 INFO:teuthology.orchestra.run.smithi148.stdout:(86/285): gsm-1.0.19-6.el9.x86_64.rpm 452 kB/s | 34 kB 00:00 2024-09-12T17:26:51.265 INFO:teuthology.orchestra.run.smithi148.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 662 kB/s | 33 kB 00:00 2024-09-12T17:26:51.307 INFO:teuthology.orchestra.run.smithi148.stdout:(88/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-12T17:26:51.330 INFO:teuthology.orchestra.run.smithi107.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 28 MB/s | 7.4 MB 00:00 2024-09-12T17:26:51.389 INFO:teuthology.orchestra.run.smithi107.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4762.gba 4.9 MB/s | 291 kB 00:00 2024-09-12T17:26:51.431 INFO:teuthology.orchestra.run.smithi107.stdout:(31/285): ceph-mgr-rook-19.3.0-4762.gbad475c1.e 1.2 MB/s | 49 kB 00:00 2024-09-12T17:26:51.464 INFO:teuthology.orchestra.run.smithi107.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4762.gb 491 kB/s | 16 kB 00:00 2024-09-12T17:26:51.466 INFO:teuthology.orchestra.run.smithi148.stdout:(89/285): gstreamer1-plugins-base-1.22.1-2.el9. 8.4 MB/s | 2.2 MB 00:00 2024-09-12T17:26:51.515 INFO:teuthology.orchestra.run.smithi107.stdout:(33/285): ceph-volume-19.3.0-4762.gbad475c1.el9 5.6 MB/s | 285 kB 00:00 2024-09-12T17:26:51.533 INFO:teuthology.orchestra.run.smithi148.stdout:(90/285): gtk3-3.24.31-5.el9.x86_64.rpm 18 MB/s | 4.9 MB 00:00 2024-09-12T17:26:51.573 INFO:teuthology.orchestra.run.smithi107.stdout:(34/285): cephadm-19.3.0-4762.gbad475c1.el9.noa 13 MB/s | 783 kB 00:00 2024-09-12T17:26:51.575 INFO:teuthology.orchestra.run.smithi148.stdout:(91/285): guava-30.1-6.el9.noarch.rpm 8.7 MB/s | 2.3 MB 00:00 2024-09-12T17:26:51.600 INFO:teuthology.orchestra.run.smithi148.stdout:(92/285): hicolor-icon-theme-0.17-13.el9.noarch 1.6 MB/s | 219 kB 00:00 2024-09-12T17:26:51.625 INFO:teuthology.orchestra.run.smithi148.stdout:(93/285): httpcomponents-client-4.5.13-3.el9.no 7.0 MB/s | 657 kB 00:00 2024-09-12T17:26:51.676 INFO:teuthology.orchestra.run.smithi148.stdout:(94/285): jakarta-annotations-1.3.5-13.el9.noar 899 kB/s | 45 kB 00:00 2024-09-12T17:26:51.701 INFO:teuthology.orchestra.run.smithi148.stdout:(95/285): httpcomponents-core-4.4.13-7.el9.noar 6.1 MB/s | 632 kB 00:00 2024-09-12T17:26:51.715 INFO:teuthology.orchestra.run.smithi107.stdout:(35/285): ModemManager-glib-1.20.2-1.el9.x86_64 2.3 MB/s | 335 kB 00:00 2024-09-12T17:26:51.726 INFO:teuthology.orchestra.run.smithi148.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 110 kB 00:00 2024-09-12T17:26:51.757 INFO:teuthology.orchestra.run.smithi107.stdout:(36/285): bluez-libs-5.56-6.el9.x86_64.rpm 2.0 MB/s | 85 kB 00:00 2024-09-12T17:26:51.768 INFO:teuthology.orchestra.run.smithi148.stdout:(97/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 6.0 MB/s | 413 kB 00:00 2024-09-12T17:26:51.799 INFO:teuthology.orchestra.run.smithi107.stdout:(37/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-09-12T17:26:51.849 INFO:teuthology.orchestra.run.smithi107.stdout:(38/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 5.1 MB/s | 262 kB 00:00 2024-09-12T17:26:51.894 INFO:teuthology.orchestra.run.smithi148.stdout:(98/285): java-11-openjdk-devel-11.0.20.1.1-2.e 20 MB/s | 3.3 MB 00:00 2024-09-12T17:26:51.944 INFO:teuthology.orchestra.run.smithi148.stdout:(99/285): iso-codes-4.6.0-3.el9.noarch.rpm 10 MB/s | 3.5 MB 00:00 2024-09-12T17:26:51.969 INFO:teuthology.orchestra.run.smithi148.stdout:(100/285): javapackages-filesystem-6.0.0-4.el9. 173 kB/s | 13 kB 00:00 2024-09-12T17:26:51.994 INFO:teuthology.orchestra.run.smithi148.stdout:(101/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-12T17:26:52.008 INFO:teuthology.orchestra.run.smithi107.stdout:(39/285): ceph-osd-19.3.0-4762.gbad475c1.el9.x8 4.9 MB/s | 17 MB 00:03 2024-09-12T17:26:52.020 INFO:teuthology.orchestra.run.smithi148.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 476 kB/s | 24 kB 00:00 2024-09-12T17:26:52.033 INFO:teuthology.orchestra.run.smithi107.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-09-12T17:26:52.053 INFO:teuthology.orchestra.run.smithi148.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 6.3 MB/s | 377 kB 00:00 2024-09-12T17:26:52.078 INFO:teuthology.orchestra.run.smithi148.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 607 kB/s | 35 kB 00:00 2024-09-12T17:26:52.083 INFO:teuthology.orchestra.run.smithi107.stdout:(41/285): libpciaccess-0.16-7.el9.x86_64.rpm 538 kB/s | 27 kB 00:00 2024-09-12T17:26:52.112 INFO:teuthology.orchestra.run.smithi148.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 2.8 MB/s | 168 kB 00:00 2024-09-12T17:26:52.126 INFO:teuthology.orchestra.run.smithi107.stdout:(42/285): libquadmath-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-12T17:26:52.137 INFO:teuthology.orchestra.run.smithi148.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 188 kB/s | 11 kB 00:00 2024-09-12T17:26:52.162 INFO:teuthology.orchestra.run.smithi148.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 482 kB/s | 24 kB 00:00 2024-09-12T17:26:52.167 INFO:teuthology.orchestra.run.smithi107.stdout:(43/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 2.2 MB/s | 94 kB 00:00 2024-09-12T17:26:52.196 INFO:teuthology.orchestra.run.smithi148.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 526 kB/s | 31 kB 00:00 2024-09-12T17:26:52.201 INFO:teuthology.orchestra.run.smithi107.stdout:(44/285): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-12T17:26:52.221 INFO:teuthology.orchestra.run.smithi148.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 390 kB/s | 23 kB 00:00 2024-09-12T17:26:52.243 INFO:teuthology.orchestra.run.smithi107.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-12T17:26:52.263 INFO:teuthology.orchestra.run.smithi148.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 296 kB/s | 20 kB 00:00 2024-09-12T17:26:52.285 INFO:teuthology.orchestra.run.smithi107.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-12T17:26:52.288 INFO:teuthology.orchestra.run.smithi148.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 590 kB/s | 40 kB 00:00 2024-09-12T17:26:52.322 INFO:teuthology.orchestra.run.smithi148.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 258 kB/s | 15 kB 00:00 2024-09-12T17:26:52.327 INFO:teuthology.orchestra.run.smithi107.stdout:(47/285): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-12T17:26:52.347 INFO:teuthology.orchestra.run.smithi148.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 486 kB/s | 28 kB 00:00 2024-09-12T17:26:52.369 INFO:teuthology.orchestra.run.smithi107.stdout:(48/285): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-12T17:26:52.373 INFO:teuthology.orchestra.run.smithi148.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 426 kB/s | 21 kB 00:00 2024-09-12T17:26:52.398 INFO:teuthology.orchestra.run.smithi148.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 379 kB/s | 19 kB 00:00 2024-09-12T17:26:52.432 INFO:teuthology.orchestra.run.smithi148.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 321 kB/s | 19 kB 00:00 2024-09-12T17:26:52.436 INFO:teuthology.orchestra.run.smithi107.stdout:(49/285): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-12T17:26:52.457 INFO:teuthology.orchestra.run.smithi148.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 518 kB/s | 30 kB 00:00 2024-09-12T17:26:52.491 INFO:teuthology.orchestra.run.smithi148.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-09-12T17:26:52.516 INFO:teuthology.orchestra.run.smithi148.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 543 kB/s | 32 kB 00:00 2024-09-12T17:26:52.549 INFO:teuthology.orchestra.run.smithi148.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-12T17:26:52.569 INFO:teuthology.orchestra.run.smithi107.stdout:(50/285): adwaita-cursor-theme-40.1.1-3.el9.noa 4.8 MB/s | 650 kB 00:00 2024-09-12T17:26:52.575 INFO:teuthology.orchestra.run.smithi148.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-09-12T17:26:52.611 INFO:teuthology.orchestra.run.smithi107.stdout:(51/285): python3-cryptography-36.0.1-4.el9.x86 3.0 MB/s | 1.2 MB 00:00 2024-09-12T17:26:52.617 INFO:teuthology.orchestra.run.smithi148.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 6.3 MB/s | 435 kB 00:00 2024-09-12T17:26:52.634 INFO:teuthology.orchestra.run.smithi148.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 528 kB/s | 31 kB 00:00 2024-09-12T17:26:52.667 INFO:teuthology.orchestra.run.smithi148.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-12T17:26:52.693 INFO:teuthology.orchestra.run.smithi148.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 2.3 MB/s | 135 kB 00:00 2024-09-12T17:26:52.726 INFO:teuthology.orchestra.run.smithi148.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 628 kB/s | 37 kB 00:00 2024-09-12T17:26:52.752 INFO:teuthology.orchestra.run.smithi148.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.4 MB/s | 142 kB 00:00 2024-09-12T17:26:52.753 INFO:teuthology.orchestra.run.smithi107.stdout:(52/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 3.6 MB/s | 523 kB 00:00 2024-09-12T17:26:52.785 INFO:teuthology.orchestra.run.smithi148.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-09-12T17:26:52.811 INFO:teuthology.orchestra.run.smithi148.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-09-12T17:26:52.844 INFO:teuthology.orchestra.run.smithi148.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-12T17:26:52.869 INFO:teuthology.orchestra.run.smithi148.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 707 kB/s | 41 kB 00:00 2024-09-12T17:26:52.878 INFO:teuthology.orchestra.run.smithi107.stdout:(53/285): adwaita-icon-theme-40.1.1-3.el9.noarc 39 MB/s | 12 MB 00:00 2024-09-12T17:26:52.894 INFO:teuthology.orchestra.run.smithi148.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 867 kB/s | 44 kB 00:00 2024-09-12T17:26:52.904 INFO:teuthology.orchestra.run.smithi107.stdout:(54/285): apache-commons-cli-1.4-17.el9.noarch. 472 kB/s | 71 kB 00:00 2024-09-12T17:26:52.920 INFO:teuthology.orchestra.run.smithi148.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 665 kB/s | 34 kB 00:00 2024-09-12T17:26:52.953 INFO:teuthology.orchestra.run.smithi148.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-12T17:26:52.954 INFO:teuthology.orchestra.run.smithi107.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 3.9 MB/s | 302 kB 00:00 2024-09-12T17:26:52.979 INFO:teuthology.orchestra.run.smithi148.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T17:26:52.988 INFO:teuthology.orchestra.run.smithi107.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 3.3 MB/s | 283 kB 00:00 2024-09-12T17:26:53.004 INFO:teuthology.orchestra.run.smithi148.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-09-12T17:26:53.054 INFO:teuthology.orchestra.run.smithi148.stdout:(137/285): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-12T17:26:53.079 INFO:teuthology.orchestra.run.smithi148.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-09-12T17:26:53.113 INFO:teuthology.orchestra.run.smithi148.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 3.5 MB/s | 206 kB 00:00 2024-09-12T17:26:53.139 INFO:teuthology.orchestra.run.smithi148.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-12T17:26:53.172 INFO:teuthology.orchestra.run.smithi148.stdout:(141/285): libtiff-4.4.0-13.el9.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2024-09-12T17:26:53.197 INFO:teuthology.orchestra.run.smithi148.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 607 kB/s | 36 kB 00:00 2024-09-12T17:26:53.397 INFO:teuthology.orchestra.run.smithi107.stdout:(57/285): ceph-test-19.3.0-4762.gbad475c1.el9.x 11 MB/s | 45 MB 00:04 2024-09-12T17:26:53.430 INFO:teuthology.orchestra.run.smithi107.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 196 kB/s | 87 kB 00:00 2024-09-12T17:26:53.455 INFO:teuthology.orchestra.run.smithi107.stdout:(59/285): apache-commons-lang3-3.12.0-6.el9.noa 1.1 MB/s | 559 kB 00:00 2024-09-12T17:26:53.497 INFO:teuthology.orchestra.run.smithi107.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 348 kB/s | 23 kB 00:00 2024-09-12T17:26:53.523 INFO:teuthology.orchestra.run.smithi107.stdout:(61/285): atk-2.36.0-5.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-12T17:26:53.548 INFO:teuthology.orchestra.run.smithi107.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 296 kB/s | 15 kB 00:00 2024-09-12T17:26:53.573 INFO:teuthology.orchestra.run.smithi148.stdout:(143/285): java-11-openjdk-headless-11.0.20.1.1 22 MB/s | 39 MB 00:01 2024-09-12T17:26:53.582 INFO:teuthology.orchestra.run.smithi107.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-12T17:26:53.598 INFO:teuthology.orchestra.run.smithi148.stdout:(144/285): libtracker-sparql-3.1.2-3.el9.x86_64 761 kB/s | 324 kB 00:00 2024-09-12T17:26:53.607 INFO:teuthology.orchestra.run.smithi107.stdout:(64/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 929 kB/s | 195 kB 00:00 2024-09-12T17:26:53.623 INFO:teuthology.orchestra.run.smithi148.stdout:(145/285): libvisual-0.4.0-34.el9.x86_64.rpm 338 kB/s | 144 kB 00:00 2024-09-12T17:26:53.632 INFO:teuthology.orchestra.run.smithi107.stdout:(65/285): cdi-api-2.0.2-6.el9.noarch.rpm 637 kB/s | 53 kB 00:00 2024-09-12T17:26:53.648 INFO:teuthology.orchestra.run.smithi148.stdout:(146/285): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 193 kB 00:00 2024-09-12T17:26:53.657 INFO:teuthology.orchestra.run.smithi107.stdout:(66/285): colord-libs-1.4.5-4.el9.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2024-09-12T17:26:53.674 INFO:teuthology.orchestra.run.smithi148.stdout:(147/285): libwayland-client-1.21.0-1.el9.x86_6 441 kB/s | 33 kB 00:00 2024-09-12T17:26:53.683 INFO:teuthology.orchestra.run.smithi107.stdout:(67/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 810 kB/s | 61 kB 00:00 2024-09-12T17:26:53.699 INFO:teuthology.orchestra.run.smithi148.stdout:(148/285): libwayland-cursor-1.21.0-1.el9.x86_6 258 kB/s | 19 kB 00:00 2024-09-12T17:26:53.699 INFO:teuthology.orchestra.run.smithi107.stdout:(68/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 420 kB/s | 28 kB 00:00 2024-09-12T17:26:53.724 INFO:teuthology.orchestra.run.smithi148.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 170 kB/s | 13 kB 00:00 2024-09-12T17:26:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:(69/285): dconf-0.40.0-6.el9.x86_64.rpm 1.6 MB/s | 113 kB 00:00 2024-09-12T17:26:53.750 INFO:teuthology.orchestra.run.smithi148.stdout:(150/285): libwayland-server-1.21.0-1.el9.x86_6 552 kB/s | 42 kB 00:00 2024-09-12T17:26:53.775 INFO:teuthology.orchestra.run.smithi148.stdout:(151/285): libwebp-1.2.0-8.el9.x86_64.rpm 3.6 MB/s | 277 kB 00:00 2024-09-12T17:26:53.800 INFO:teuthology.orchestra.run.smithi107.stdout:(70/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 10 MB/s | 781 kB 00:00 2024-09-12T17:26:53.801 INFO:teuthology.orchestra.run.smithi148.stdout:(152/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.7 MB/s | 133 kB 00:00 2024-09-12T17:26:53.817 INFO:teuthology.orchestra.run.smithi148.stdout:(153/285): libxshmfence-1.3-10.el9.x86_64.rpm 188 kB/s | 13 kB 00:00 2024-09-12T17:26:53.834 INFO:teuthology.orchestra.run.smithi107.stdout:(71/285): exempi-2.6.0-0.2.20211007gite23c213.e 3.4 MB/s | 525 kB 00:00 2024-09-12T17:26:53.835 INFO:teuthology.orchestra.run.smithi148.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 609 kB/s | 36 kB 00:00 2024-09-12T17:26:53.860 INFO:teuthology.orchestra.run.smithi148.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T17:26:53.867 INFO:teuthology.orchestra.run.smithi107.stdout:(72/285): exiv2-0.27.5-2.el9.x86_64.rpm 5.7 MB/s | 980 kB 00:00 2024-09-12T17:26:53.885 INFO:teuthology.orchestra.run.smithi148.stdout:(156/285): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-09-12T17:26:53.893 INFO:teuthology.orchestra.run.smithi107.stdout:(73/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.5 MB/s | 325 kB 00:00 2024-09-12T17:26:53.918 INFO:teuthology.orchestra.run.smithi148.stdout:(157/285): lua-posix-35.0-8.el9.x86_64.rpm 1.8 MB/s | 151 kB 00:00 2024-09-12T17:26:53.926 INFO:teuthology.orchestra.run.smithi107.stdout:(74/285): flac-libs-1.3.3-12.el9.x86_64.rpm 2.3 MB/s | 218 kB 00:00 2024-09-12T17:26:53.944 INFO:teuthology.orchestra.run.smithi148.stdout:(158/285): maven-3.6.3-15.el9.noarch.rpm 211 kB/s | 18 kB 00:00 2024-09-12T17:26:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:(75/285): flatpak-selinux-1.12.9-1.el9.noarch.r 323 kB/s | 22 kB 00:00 2024-09-12T17:26:53.977 INFO:teuthology.orchestra.run.smithi148.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 154 kB/s | 9.0 kB 00:00 2024-09-12T17:26:54.002 INFO:teuthology.orchestra.run.smithi107.stdout:(76/285): flatpak-session-helper-1.12.9-1.el9.x 972 kB/s | 73 kB 00:00 2024-09-12T17:26:54.003 INFO:teuthology.orchestra.run.smithi148.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 8.6 MB/s | 517 kB 00:00 2024-09-12T17:26:54.027 INFO:teuthology.orchestra.run.smithi107.stdout:(77/285): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-12T17:26:54.044 INFO:teuthology.orchestra.run.smithi148.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 2.2 MB/s | 151 kB 00:00 2024-09-12T17:26:54.069 INFO:teuthology.orchestra.run.smithi107.stdout:(78/285): flatpak-1.12.9-1.el9.x86_64.rpm 8.6 MB/s | 1.7 MB 00:00 2024-09-12T17:26:54.069 INFO:teuthology.orchestra.run.smithi148.stdout:(162/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.6 MB/s | 112 kB 00:00 2024-09-12T17:26:54.102 INFO:teuthology.orchestra.run.smithi107.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 241 kB/s | 18 kB 00:00 2024-09-12T17:26:54.111 INFO:teuthology.orchestra.run.smithi148.stdout:(163/285): maven-lib-3.6.3-15.el9.noarch.rpm 6.6 MB/s | 1.5 MB 00:00 2024-09-12T17:26:54.136 INFO:teuthology.orchestra.run.smithi107.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.3 MB/s | 89 kB 00:00 2024-09-12T17:26:54.137 INFO:teuthology.orchestra.run.smithi148.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 168 kB/s | 11 kB 00:00 2024-09-12T17:26:54.170 INFO:teuthology.orchestra.run.smithi107.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.8 MB/s | 124 kB 00:00 2024-09-12T17:26:54.170 INFO:teuthology.orchestra.run.smithi148.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-12T17:26:54.196 INFO:teuthology.orchestra.run.smithi148.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-12T17:26:54.220 INFO:teuthology.orchestra.run.smithi107.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 581 kB/s | 49 kB 00:00 2024-09-12T17:26:54.229 INFO:teuthology.orchestra.run.smithi148.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 619 kB/s | 36 kB 00:00 2024-09-12T17:26:54.245 INFO:teuthology.orchestra.run.smithi107.stdout:(83/285): google-guice-4.2.3-9.el9.noarch.rpm 6.2 MB/s | 473 kB 00:00 2024-09-12T17:26:54.255 INFO:teuthology.orchestra.run.smithi148.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 783 kB/s | 46 kB 00:00 2024-09-12T17:26:54.280 INFO:teuthology.orchestra.run.smithi148.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 645 kB/s | 32 kB 00:00 2024-09-12T17:26:54.304 INFO:teuthology.orchestra.run.smithi107.stdout:(84/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.9 MB/s | 3.0 MB 00:00 2024-09-12T17:26:54.305 INFO:teuthology.orchestra.run.smithi148.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-12T17:26:54.329 INFO:teuthology.orchestra.run.smithi107.stdout:(85/285): gsm-1.0.19-6.el9.x86_64.rpm 408 kB/s | 34 kB 00:00 2024-09-12T17:26:54.354 INFO:teuthology.orchestra.run.smithi107.stdout:(86/285): graphene-1.10.6-2.el9.x86_64.rpm 481 kB/s | 64 kB 00:00 2024-09-12T17:26:54.421 INFO:teuthology.orchestra.run.smithi107.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 496 kB/s | 33 kB 00:00 2024-09-12T17:26:54.422 INFO:teuthology.orchestra.run.smithi148.stdout:(171/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 23 MB/s | 8.8 MB 00:00 2024-09-12T17:26:54.447 INFO:teuthology.orchestra.run.smithi148.stdout:(172/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.1 MB/s | 163 kB 00:00 2024-09-12T17:26:54.463 INFO:teuthology.orchestra.run.smithi107.stdout:(88/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-12T17:26:54.481 INFO:teuthology.orchestra.run.smithi148.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2024-09-12T17:26:54.506 INFO:teuthology.orchestra.run.smithi148.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-12T17:26:54.507 INFO:teuthology.orchestra.run.smithi107.stdout:(89/285): gstreamer1-plugins-base-1.22.1-2.el9. 13 MB/s | 2.2 MB 00:00 2024-09-12T17:26:54.573 INFO:teuthology.orchestra.run.smithi148.stdout:(175/285): openblas-openmp-0.3.26-2.el9.x86_64. 17 MB/s | 4.9 MB 00:00 2024-09-12T17:26:54.590 INFO:teuthology.orchestra.run.smithi148.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 884 kB/s | 74 kB 00:00 2024-09-12T17:26:54.624 INFO:teuthology.orchestra.run.smithi148.stdout:(177/285): osinfo-db-20240701-2.el9.noarch.rpm 3.6 MB/s | 531 kB 00:00 2024-09-12T17:26:54.641 INFO:teuthology.orchestra.run.smithi107.stdout:(90/285): gtk3-3.24.31-5.el9.x86_64.rpm 22 MB/s | 4.9 MB 00:00 2024-09-12T17:26:54.649 INFO:teuthology.orchestra.run.smithi148.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 4.1 MB/s | 246 kB 00:00 2024-09-12T17:26:54.674 INFO:teuthology.orchestra.run.smithi107.stdout:(91/285): hicolor-icon-theme-0.17-13.el9.noarch 1.3 MB/s | 219 kB 00:00 2024-09-12T17:26:54.683 INFO:teuthology.orchestra.run.smithi148.stdout:(179/285): ostree-libs-2024.7-2.el9.x86_64.rpm 4.2 MB/s | 468 kB 00:00 2024-09-12T17:26:54.708 INFO:teuthology.orchestra.run.smithi148.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 972 kB/s | 57 kB 00:00 2024-09-12T17:26:54.725 INFO:teuthology.orchestra.run.smithi107.stdout:(92/285): guava-30.1-6.el9.noarch.rpm 8.8 MB/s | 2.3 MB 00:00 2024-09-12T17:26:54.733 INFO:teuthology.orchestra.run.smithi148.stdout:(181/285): pipewire-1.0.1-1.el9.x86_64.rpm 974 kB/s | 107 kB 00:00 2024-09-12T17:26:54.750 INFO:teuthology.orchestra.run.smithi148.stdout:(182/285): pipewire-jack-audio-connection-kit-1 136 kB/s | 9.1 kB 00:00 2024-09-12T17:26:54.758 INFO:teuthology.orchestra.run.smithi107.stdout:(93/285): httpcomponents-client-4.5.13-3.el9.no 5.5 MB/s | 657 kB 00:00 2024-09-12T17:26:54.775 INFO:teuthology.orchestra.run.smithi148.stdout:(183/285): pipewire-jack-audio-connection-kit-l 2.0 MB/s | 135 kB 00:00 2024-09-12T17:26:54.792 INFO:teuthology.orchestra.run.smithi107.stdout:(94/285): httpcomponents-core-4.4.13-7.el9.noar 5.3 MB/s | 632 kB 00:00 2024-09-12T17:26:54.809 INFO:teuthology.orchestra.run.smithi148.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.2 MB/s | 192 kB 00:00 2024-09-12T17:26:54.817 INFO:teuthology.orchestra.run.smithi107.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 770 kB/s | 45 kB 00:00 2024-09-12T17:26:54.834 INFO:teuthology.orchestra.run.smithi148.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 440 kB/s | 26 kB 00:00 2024-09-12T17:26:54.859 INFO:teuthology.orchestra.run.smithi107.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 1.6 MB/s | 110 kB 00:00 2024-09-12T17:26:54.860 INFO:teuthology.orchestra.run.smithi148.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-12T17:26:54.884 INFO:teuthology.orchestra.run.smithi107.stdout:(97/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 6.0 MB/s | 413 kB 00:00 2024-09-12T17:26:54.902 INFO:teuthology.orchestra.run.smithi148.stdout:(187/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 11 MB/s | 1.9 MB 00:00 2024-09-12T17:26:54.927 INFO:teuthology.orchestra.run.smithi148.stdout:(188/285): plexus-containers-component-annotati 200 kB/s | 18 kB 00:00 2024-09-12T17:26:54.943 INFO:teuthology.orchestra.run.smithi107.stdout:(98/285): iso-codes-4.6.0-3.el9.noarch.rpm 16 MB/s | 3.5 MB 00:00 2024-09-12T17:26:54.952 INFO:teuthology.orchestra.run.smithi148.stdout:(189/285): plexus-interpolation-1.26-11.el9.noa 865 kB/s | 80 kB 00:00 2024-09-12T17:26:54.978 INFO:teuthology.orchestra.run.smithi148.stdout:(190/285): plexus-sec-dispatcher-1.4-37.el9.noa 446 kB/s | 34 kB 00:00 2024-09-12T17:26:55.003 INFO:teuthology.orchestra.run.smithi148.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 254 kB 00:00 2024-09-12T17:26:55.012 INFO:teuthology.orchestra.run.smithi107.stdout:(99/285): java-11-openjdk-devel-11.0.20.1.1-2.e 22 MB/s | 3.3 MB 00:00 2024-09-12T17:26:55.035 INFO:teuthology.orchestra.run.smithi107.stdout:(100/285): javapackages-filesystem-6.0.0-4.el9. 142 kB/s | 13 kB 00:00 2024-09-12T17:26:55.036 INFO:teuthology.orchestra.run.smithi148.stdout:(192/285): poppler-21.01.0-21.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-09-12T17:26:55.062 INFO:teuthology.orchestra.run.smithi148.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.5 MB/s | 152 kB 00:00 2024-09-12T17:26:55.086 INFO:teuthology.orchestra.run.smithi107.stdout:(101/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 705 kB/s | 53 kB 00:00 2024-09-12T17:26:55.111 INFO:teuthology.orchestra.run.smithi107.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 319 kB/s | 24 kB 00:00 2024-09-12T17:26:55.112 INFO:teuthology.orchestra.run.smithi148.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 14 MB/s | 1.9 MB 00:00 2024-09-12T17:26:55.137 INFO:teuthology.orchestra.run.smithi148.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.1 MB/s | 83 kB 00:00 2024-09-12T17:26:55.153 INFO:teuthology.orchestra.run.smithi107.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 5.5 MB/s | 377 kB 00:00 2024-09-12T17:26:55.162 INFO:teuthology.orchestra.run.smithi148.stdout:(196/285): protobuf-3.14.0-13.el9.x86_64.rpm 8.0 MB/s | 1.0 MB 00:00 2024-09-12T17:26:55.186 INFO:teuthology.orchestra.run.smithi107.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 472 kB/s | 35 kB 00:00 2024-09-12T17:26:55.196 INFO:teuthology.orchestra.run.smithi148.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.9 MB/s | 679 kB 00:00 2024-09-12T17:26:55.221 INFO:teuthology.orchestra.run.smithi148.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-12T17:26:55.237 INFO:teuthology.orchestra.run.smithi107.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 2.0 MB/s | 168 kB 00:00 2024-09-12T17:26:55.255 INFO:teuthology.orchestra.run.smithi148.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 4.1 MB/s | 248 kB 00:00 2024-09-12T17:26:55.262 INFO:teuthology.orchestra.run.smithi107.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 147 kB/s | 11 kB 00:00 2024-09-12T17:26:55.280 INFO:teuthology.orchestra.run.smithi148.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 438 kB/s | 26 kB 00:00 2024-09-12T17:26:55.304 INFO:teuthology.orchestra.run.smithi107.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 363 kB/s | 24 kB 00:00 2024-09-12T17:26:55.314 INFO:teuthology.orchestra.run.smithi148.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 328 kB/s | 19 kB 00:00 2024-09-12T17:26:55.329 INFO:teuthology.orchestra.run.smithi107.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 459 kB/s | 31 kB 00:00 2024-09-12T17:26:55.339 INFO:teuthology.orchestra.run.smithi148.stdout:(202/285): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T17:26:55.371 INFO:teuthology.orchestra.run.smithi107.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 343 kB/s | 23 kB 00:00 2024-09-12T17:26:55.381 INFO:teuthology.orchestra.run.smithi148.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 521 kB/s | 35 kB 00:00 2024-09-12T17:26:55.396 INFO:teuthology.orchestra.run.smithi107.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 295 kB/s | 20 kB 00:00 2024-09-12T17:26:55.438 INFO:teuthology.orchestra.run.smithi107.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 591 kB/s | 40 kB 00:00 2024-09-12T17:26:55.439 INFO:teuthology.orchestra.run.smithi148.stdout:(204/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.2 MB/s | 250 kB 00:00 2024-09-12T17:26:55.480 INFO:teuthology.orchestra.run.smithi107.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 180 kB/s | 15 kB 00:00 2024-09-12T17:26:55.498 INFO:teuthology.orchestra.run.smithi148.stdout:(205/285): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-12T17:26:55.514 INFO:teuthology.orchestra.run.smithi107.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 377 kB/s | 28 kB 00:00 2024-09-12T17:26:55.548 INFO:teuthology.orchestra.run.smithi107.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 320 kB/s | 21 kB 00:00 2024-09-12T17:26:55.557 INFO:teuthology.orchestra.run.smithi148.stdout:(206/285): python3-packaging-20.9-5.el9.noarch. 1.3 MB/s | 77 kB 00:00 2024-09-12T17:26:55.573 INFO:teuthology.orchestra.run.smithi107.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 325 kB/s | 19 kB 00:00 2024-09-12T17:26:55.624 INFO:teuthology.orchestra.run.smithi107.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 250 kB/s | 19 kB 00:00 2024-09-12T17:26:55.632 INFO:teuthology.orchestra.run.smithi148.stdout:(207/285): python3-numpy-1.20.1-5.el9.x86_64.rp 17 MB/s | 5.1 MB 00:00 2024-09-12T17:26:55.657 INFO:teuthology.orchestra.run.smithi148.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 422 kB/s | 42 kB 00:00 2024-09-12T17:26:55.724 INFO:teuthology.orchestra.run.smithi148.stdout:(209/285): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-09-12T17:26:55.749 INFO:teuthology.orchestra.run.smithi148.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.7 MB/s | 159 kB 00:00 2024-09-12T17:26:55.774 INFO:teuthology.orchestra.run.smithi148.stdout:(211/285): python3-protobuf-3.14.0-13.el9.noarc 1.8 MB/s | 269 kB 00:00 2024-09-12T17:26:55.800 INFO:teuthology.orchestra.run.smithi148.stdout:(212/285): python3-pyasn1-modules-0.4.8-6.el9.n 3.6 MB/s | 279 kB 00:00 2024-09-12T17:26:55.825 INFO:teuthology.orchestra.run.smithi148.stdout:(213/285): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-12T17:26:55.851 INFO:teuthology.orchestra.run.smithi148.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 710 kB/s | 54 kB 00:00 2024-09-12T17:26:55.876 INFO:teuthology.orchestra.run.smithi148.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-09-12T17:26:55.935 INFO:teuthology.orchestra.run.smithi148.stdout:(216/285): qatlib-service-24.02.0-1.el9.x86_64. 614 kB/s | 36 kB 00:00 2024-09-12T17:26:55.960 INFO:teuthology.orchestra.run.smithi148.stdout:(217/285): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-12T17:26:55.982 INFO:teuthology.orchestra.run.smithi107.stdout:(117/285): java-11-openjdk-headless-11.0.20.1.1 36 MB/s | 39 MB 00:01 2024-09-12T17:26:55.985 INFO:teuthology.orchestra.run.smithi148.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-12T17:26:56.007 INFO:teuthology.orchestra.run.smithi107.stdout:(118/285): libasyncns-0.8-22.el9.x86_64.rpm 70 kB/s | 30 kB 00:00 2024-09-12T17:26:56.010 INFO:teuthology.orchestra.run.smithi148.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-12T17:26:56.033 INFO:teuthology.orchestra.run.smithi107.stdout:(119/285): libcanberra-0.30-27.el9.x86_64.rpm 211 kB/s | 86 kB 00:00 2024-09-12T17:26:56.052 INFO:teuthology.orchestra.run.smithi148.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 7.5 MB/s | 510 kB 00:00 2024-09-12T17:26:56.058 INFO:teuthology.orchestra.run.smithi107.stdout:(120/285): libcanberra-gtk3-0.30-27.el9.x86_64. 422 kB/s | 32 kB 00:00 2024-09-12T17:26:56.077 INFO:teuthology.orchestra.run.smithi148.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 1.0 MB/s | 69 kB 00:00 2024-09-12T17:26:56.083 INFO:teuthology.orchestra.run.smithi107.stdout:(121/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.1 MB/s | 161 kB 00:00 2024-09-12T17:26:56.117 INFO:teuthology.orchestra.run.smithi107.stdout:(122/285): libepoxy-1.5.5-4.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2024-09-12T17:26:56.119 INFO:teuthology.orchestra.run.smithi148.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-12T17:26:56.142 INFO:teuthology.orchestra.run.smithi107.stdout:(123/285): libexif-0.6.22-6.el9.x86_64.rpm 5.1 MB/s | 435 kB 00:00 2024-09-12T17:26:56.145 INFO:teuthology.orchestra.run.smithi148.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 5.6 MB/s | 383 kB 00:00 2024-09-12T17:26:56.168 INFO:teuthology.orchestra.run.smithi107.stdout:(124/285): libfontenc-1.1.3-17.el9.x86_64.rpm 370 kB/s | 31 kB 00:00 2024-09-12T17:26:56.178 INFO:teuthology.orchestra.run.smithi148.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 2.5 MB/s | 152 kB 00:00 2024-09-12T17:26:56.193 INFO:teuthology.orchestra.run.smithi107.stdout:(125/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2024-09-12T17:26:56.212 INFO:teuthology.orchestra.run.smithi148.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 8.1 MB/s | 555 kB 00:00 2024-09-12T17:26:56.218 INFO:teuthology.orchestra.run.smithi107.stdout:(126/285): libglvnd-1.3.4-1.el9.x86_64.rpm 1.7 MB/s | 135 kB 00:00 2024-09-12T17:26:56.235 INFO:teuthology.orchestra.run.smithi107.stdout:(127/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 546 kB/s | 37 kB 00:00 2024-09-12T17:26:56.262 INFO:teuthology.orchestra.run.smithi148.stdout:(226/285): tracker-miners-3.1.2-4.el9.x86_64.rp 11 MB/s | 944 kB 00:00 2024-09-12T17:26:56.269 INFO:teuthology.orchestra.run.smithi107.stdout:(128/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 142 kB 00:00 2024-09-12T17:26:56.288 INFO:teuthology.orchestra.run.smithi148.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 705 kB/s | 53 kB 00:00 2024-09-12T17:26:56.303 INFO:teuthology.orchestra.run.smithi107.stdout:(129/285): libgsf-1.14.47-5.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-09-12T17:26:56.321 INFO:teuthology.orchestra.run.smithi148.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-09-12T17:26:56.328 INFO:teuthology.orchestra.run.smithi107.stdout:(130/285): libgxps-0.3.2-3.el9.x86_64.rpm 854 kB/s | 79 kB 00:00 2024-09-12T17:26:56.346 INFO:teuthology.orchestra.run.smithi148.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 2.9 MB/s | 173 kB 00:00 2024-09-12T17:26:56.353 INFO:teuthology.orchestra.run.smithi107.stdout:(131/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 729 kB/s | 61 kB 00:00 2024-09-12T17:26:56.378 INFO:teuthology.orchestra.run.smithi107.stdout:(132/285): libldac-2.0.2.3-10.el9.x86_64.rpm 547 kB/s | 41 kB 00:00 2024-09-12T17:26:56.380 INFO:teuthology.orchestra.run.smithi148.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 5.1 MB/s | 306 kB 00:00 2024-09-12T17:26:56.397 INFO:teuthology.orchestra.run.smithi148.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T17:26:56.403 INFO:teuthology.orchestra.run.smithi107.stdout:(133/285): libnotify-0.7.9-8.el9.x86_64.rpm 577 kB/s | 44 kB 00:00 2024-09-12T17:26:56.429 INFO:teuthology.orchestra.run.smithi107.stdout:(134/285): libogg-1.3.4-6.el9.x86_64.rpm 444 kB/s | 34 kB 00:00 2024-09-12T17:26:56.439 INFO:teuthology.orchestra.run.smithi148.stdout:(232/285): wireplumber-libs-0.4.14-1.el9.x86_64 6.0 MB/s | 358 kB 00:00 2024-09-12T17:26:56.454 INFO:teuthology.orchestra.run.smithi107.stdout:(135/285): libosinfo-1.10.0-1.el9.x86_64.rpm 4.1 MB/s | 319 kB 00:00 2024-09-12T17:26:56.464 INFO:teuthology.orchestra.run.smithi148.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 634 kB/s | 42 kB 00:00 2024-09-12T17:26:56.479 INFO:teuthology.orchestra.run.smithi107.stdout:(136/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T17:26:56.498 INFO:teuthology.orchestra.run.smithi148.stdout:(234/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 6.4 MB/s | 385 kB 00:00 2024-09-12T17:26:56.522 INFO:teuthology.orchestra.run.smithi107.stdout:(137/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 491 kB/s | 45 kB 00:00 2024-09-12T17:26:56.523 INFO:teuthology.orchestra.run.smithi148.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.2 MB/s | 134 kB 00:00 2024-09-12T17:26:56.547 INFO:teuthology.orchestra.run.smithi107.stdout:(138/285): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-12T17:26:56.572 INFO:teuthology.orchestra.run.smithi107.stdout:(139/285): libsbc-1.4-9.el9.x86_64.rpm 486 kB/s | 45 kB 00:00 2024-09-12T17:26:56.597 INFO:teuthology.orchestra.run.smithi107.stdout:(140/285): libsndfile-1.0.31-8.el9.x86_64.rpm 2.7 MB/s | 206 kB 00:00 2024-09-12T17:26:56.623 INFO:teuthology.orchestra.run.smithi107.stdout:(141/285): libtheora-1.1.1-31.el9.x86_64.rpm 2.1 MB/s | 164 kB 00:00 2024-09-12T17:26:56.648 INFO:teuthology.orchestra.run.smithi107.stdout:(142/285): libtiff-4.4.0-13.el9.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2024-09-12T17:26:56.673 INFO:teuthology.orchestra.run.smithi107.stdout:(143/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 471 kB/s | 36 kB 00:00 2024-09-12T17:26:56.682 INFO:teuthology.orchestra.run.smithi148.stdout:(236/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-12T17:26:56.707 INFO:teuthology.orchestra.run.smithi107.stdout:(144/285): libtracker-sparql-3.1.2-3.el9.x86_64 3.8 MB/s | 324 kB 00:00 2024-09-12T17:26:56.708 INFO:teuthology.orchestra.run.smithi148.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 346 kB/s | 64 kB 00:00 2024-09-12T17:26:56.732 INFO:teuthology.orchestra.run.smithi107.stdout:(145/285): libvisual-0.4.0-34.el9.x86_64.rpm 1.7 MB/s | 144 kB 00:00 2024-09-12T17:26:56.749 INFO:teuthology.orchestra.run.smithi148.stdout:(238/285): xkeyboard-config-2.33-2.el9.noarch.r 3.3 MB/s | 859 kB 00:00 2024-09-12T17:26:56.758 INFO:teuthology.orchestra.run.smithi107.stdout:(146/285): libvorbis-1.3.7-5.el9.x86_64.rpm 2.2 MB/s | 193 kB 00:00 2024-09-12T17:26:56.774 INFO:teuthology.orchestra.run.smithi148.stdout:(239/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.4 MB/s | 505 kB 00:00 2024-09-12T17:26:56.783 INFO:teuthology.orchestra.run.smithi107.stdout:(147/285): libwayland-client-1.21.0-1.el9.x86_6 441 kB/s | 33 kB 00:00 2024-09-12T17:26:56.808 INFO:teuthology.orchestra.run.smithi107.stdout:(148/285): libwayland-cursor-1.21.0-1.el9.x86_6 257 kB/s | 19 kB 00:00 2024-09-12T17:26:56.824 INFO:teuthology.orchestra.run.smithi148.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T17:26:56.834 INFO:teuthology.orchestra.run.smithi107.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 170 kB/s | 13 kB 00:00 2024-09-12T17:26:56.850 INFO:teuthology.orchestra.run.smithi148.stdout:(241/285): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-12T17:26:56.880 INFO:teuthology.orchestra.run.smithi107.stdout:(150/285): libwebp-1.2.0-8.el9.x86_64.rpm 3.8 MB/s | 277 kB 00:00 2024-09-12T17:26:56.883 INFO:teuthology.orchestra.run.smithi148.stdout:(242/285): gperftools-libs-2.9.1-3.el9.x86_64.r 5.1 MB/s | 308 kB 00:00 2024-09-12T17:26:56.897 INFO:teuthology.orchestra.run.smithi107.stdout:(151/285): libwayland-server-1.21.0-1.el9.x86_6 368 kB/s | 42 kB 00:00 2024-09-12T17:26:56.908 INFO:teuthology.orchestra.run.smithi148.stdout:(243/285): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-12T17:26:56.922 INFO:teuthology.orchestra.run.smithi107.stdout:(152/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.5 MB/s | 133 kB 00:00 2024-09-12T17:26:56.934 INFO:teuthology.orchestra.run.smithi148.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T17:26:56.939 INFO:teuthology.orchestra.run.smithi107.stdout:(153/285): libxshmfence-1.3-10.el9.x86_64.rpm 215 kB/s | 13 kB 00:00 2024-09-12T17:26:56.956 INFO:teuthology.orchestra.run.smithi107.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 608 kB/s | 36 kB 00:00 2024-09-12T17:26:56.959 INFO:teuthology.orchestra.run.smithi148.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T17:26:56.976 INFO:teuthology.orchestra.run.smithi148.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 3.9 MB/s | 67 kB 00:00 2024-09-12T17:26:56.990 INFO:teuthology.orchestra.run.smithi107.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 292 kB 00:00 2024-09-12T17:26:57.002 INFO:teuthology.orchestra.run.smithi148.stdout:(247/285): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-12T17:26:57.015 INFO:teuthology.orchestra.run.smithi107.stdout:(156/285): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-12T17:26:57.040 INFO:teuthology.orchestra.run.smithi107.stdout:(157/285): lua-posix-35.0-8.el9.x86_64.rpm 1.8 MB/s | 151 kB 00:00 2024-09-12T17:26:57.043 INFO:teuthology.orchestra.run.smithi148.stdout:(248/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-12T17:26:57.065 INFO:teuthology.orchestra.run.smithi107.stdout:(158/285): maven-3.6.3-15.el9.noarch.rpm 234 kB/s | 18 kB 00:00 2024-09-12T17:26:57.085 INFO:teuthology.orchestra.run.smithi148.stdout:(249/285): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-09-12T17:26:57.108 INFO:teuthology.orchestra.run.smithi107.stdout:(159/285): maven-lib-3.6.3-15.el9.noarch.rpm 16 MB/s | 1.5 MB 00:00 2024-09-12T17:26:57.127 INFO:teuthology.orchestra.run.smithi148.stdout:(250/285): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-12T17:26:57.133 INFO:teuthology.orchestra.run.smithi107.stdout:(160/285): maven-openjdk11-3.6.3-15.el9.noarch. 98 kB/s | 9.0 kB 00:00 2024-09-12T17:26:57.152 INFO:teuthology.orchestra.run.smithi148.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-12T17:26:57.166 INFO:teuthology.orchestra.run.smithi107.stdout:(161/285): maven-resolver-1.6.1-10.el9.noarch.r 5.0 MB/s | 517 kB 00:00 2024-09-12T17:26:57.178 INFO:teuthology.orchestra.run.smithi148.stdout:(252/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 472 kB/s | 43 kB 00:00 2024-09-12T17:26:57.192 INFO:teuthology.orchestra.run.smithi107.stdout:(162/285): maven-shared-utils-3.3.4-3.el9.noarc 1.8 MB/s | 151 kB 00:00 2024-09-12T17:26:57.203 INFO:teuthology.orchestra.run.smithi148.stdout:(253/285): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-12T17:26:57.217 INFO:teuthology.orchestra.run.smithi107.stdout:(163/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.3 MB/s | 112 kB 00:00 2024-09-12T17:26:57.228 INFO:teuthology.orchestra.run.smithi148.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T17:26:57.261 INFO:teuthology.orchestra.run.smithi107.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 169 kB/s | 11 kB 00:00 2024-09-12T17:26:57.262 INFO:teuthology.orchestra.run.smithi148.stdout:(255/285): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T17:26:57.285 INFO:teuthology.orchestra.run.smithi107.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.0 MB/s | 139 kB 00:00 2024-09-12T17:26:57.287 INFO:teuthology.orchestra.run.smithi148.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T17:26:57.318 INFO:teuthology.orchestra.run.smithi107.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-12T17:26:57.321 INFO:teuthology.orchestra.run.smithi148.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T17:26:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 646 kB/s | 11 kB 00:00 2024-09-12T17:26:57.352 INFO:teuthology.orchestra.run.smithi107.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 541 kB/s | 36 kB 00:00 2024-09-12T17:26:57.355 INFO:teuthology.orchestra.run.smithi148.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-12T17:26:57.372 INFO:teuthology.orchestra.run.smithi148.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-12T17:26:57.385 INFO:teuthology.orchestra.run.smithi107.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 687 kB/s | 46 kB 00:00 2024-09-12T17:26:57.389 INFO:teuthology.orchestra.run.smithi148.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-12T17:26:57.405 INFO:teuthology.orchestra.run.smithi148.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-12T17:26:57.410 INFO:teuthology.orchestra.run.smithi107.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 551 kB/s | 32 kB 00:00 2024-09-12T17:26:57.436 INFO:teuthology.orchestra.run.smithi107.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 764 kB/s | 38 kB 00:00 2024-09-12T17:26:57.473 INFO:teuthology.orchestra.run.smithi148.stdout:(263/285): libarrow-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 4.4 MB 00:00 2024-09-12T17:26:57.495 INFO:teuthology.orchestra.run.smithi107.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-12T17:26:57.498 INFO:teuthology.orchestra.run.smithi148.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T17:26:57.523 INFO:teuthology.orchestra.run.smithi148.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T17:26:57.540 INFO:teuthology.orchestra.run.smithi148.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-12T17:26:57.553 INFO:teuthology.orchestra.run.smithi107.stdout:(172/285): opus-1.3.1-10.el9.x86_64.rpm 3.4 MB/s | 200 kB 00:00 2024-09-12T17:26:57.574 INFO:teuthology.orchestra.run.smithi148.stdout:(267/285): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T17:26:57.607 INFO:teuthology.orchestra.run.smithi148.stdout:(268/285): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-09-12T17:26:57.620 INFO:teuthology.orchestra.run.smithi107.stdout:(173/285): openblas-openmp-0.3.26-2.el9.x86_64. 24 MB/s | 4.9 MB 00:00 2024-09-12T17:26:57.632 INFO:teuthology.orchestra.run.smithi148.stdout:(269/285): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-12T17:26:57.646 INFO:teuthology.orchestra.run.smithi107.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 1.9 MB/s | 183 kB 00:00 2024-09-12T17:26:57.674 INFO:teuthology.orchestra.run.smithi148.stdout:(270/285): python3-grpcio-1.46.7-10.el9.x86_64. 4.9 MB/s | 2.0 MB 00:00 2024-09-12T17:26:57.696 INFO:teuthology.orchestra.run.smithi107.stdout:(175/285): osinfo-db-20240701-2.el9.noarch.rpm 6.9 MB/s | 531 kB 00:00 2024-09-12T17:26:57.700 INFO:teuthology.orchestra.run.smithi148.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 461 kB/s | 31 kB 00:00 2024-09-12T17:26:57.725 INFO:teuthology.orchestra.run.smithi148.stdout:(272/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 766 kB/s | 90 kB 00:00 2024-09-12T17:26:57.729 INFO:teuthology.orchestra.run.smithi107.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 883 kB/s | 74 kB 00:00 2024-09-12T17:26:57.750 INFO:teuthology.orchestra.run.smithi148.stdout:(273/285): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T17:26:57.775 INFO:teuthology.orchestra.run.smithi148.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-12T17:26:57.801 INFO:teuthology.orchestra.run.smithi148.stdout:(275/285): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-12T17:26:57.826 INFO:teuthology.orchestra.run.smithi148.stdout:(276/285): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-12T17:26:57.830 INFO:teuthology.orchestra.run.smithi107.stdout:(177/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 13 MB/s | 8.8 MB 00:00 2024-09-12T17:26:57.851 INFO:teuthology.orchestra.run.smithi148.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T17:26:57.855 INFO:teuthology.orchestra.run.smithi107.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 1.9 MB/s | 246 kB 00:00 2024-09-12T17:26:57.877 INFO:teuthology.orchestra.run.smithi148.stdout:(278/285): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-12T17:26:57.880 INFO:teuthology.orchestra.run.smithi107.stdout:(179/285): ostree-libs-2024.7-2.el9.x86_64.rpm 2.5 MB/s | 468 kB 00:00 2024-09-12T17:26:57.902 INFO:teuthology.orchestra.run.smithi148.stdout:(279/285): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T17:26:57.905 INFO:teuthology.orchestra.run.smithi107.stdout:(180/285): pipewire-1.0.1-1.el9.x86_64.rpm 1.4 MB/s | 107 kB 00:00 2024-09-12T17:26:57.927 INFO:teuthology.orchestra.run.smithi148.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T17:26:57.939 INFO:teuthology.orchestra.run.smithi107.stdout:(181/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 681 kB/s | 57 kB 00:00 2024-09-12T17:26:57.952 INFO:teuthology.orchestra.run.smithi148.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T17:26:57.964 INFO:teuthology.orchestra.run.smithi107.stdout:(182/285): pipewire-jack-audio-connection-kit-1 109 kB/s | 9.1 kB 00:00 2024-09-12T17:26:57.978 INFO:teuthology.orchestra.run.smithi148.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-12T17:26:57.990 INFO:teuthology.orchestra.run.smithi107.stdout:(183/285): pipewire-jack-audio-connection-kit-l 1.6 MB/s | 135 kB 00:00 2024-09-12T17:26:58.028 INFO:teuthology.orchestra.run.smithi148.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T17:26:58.032 INFO:teuthology.orchestra.run.smithi107.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.8 MB/s | 192 kB 00:00 2024-09-12T17:26:58.057 INFO:teuthology.orchestra.run.smithi107.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 385 kB/s | 26 kB 00:00 2024-09-12T17:26:58.082 INFO:teuthology.orchestra.run.smithi107.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-12T17:26:58.108 INFO:teuthology.orchestra.run.smithi107.stdout:(187/285): plexus-containers-component-annotati 365 kB/s | 18 kB 00:00 2024-09-12T17:26:58.141 INFO:teuthology.orchestra.run.smithi107.stdout:(188/285): plexus-interpolation-1.26-11.el9.noa 1.3 MB/s | 80 kB 00:00 2024-09-12T17:26:58.166 INFO:teuthology.orchestra.run.smithi107.stdout:(189/285): plexus-sec-dispatcher-1.4-37.el9.noa 574 kB/s | 34 kB 00:00 2024-09-12T17:26:58.234 INFO:teuthology.orchestra.run.smithi107.stdout:(190/285): plexus-utils-3.3.0-10.el9.noarch.rpm 2.7 MB/s | 254 kB 00:00 2024-09-12T17:26:58.261 INFO:teuthology.orchestra.run.smithi148.stdout:(284/285): librados2-19.3.0-4762.gbad475c1.el9. 11 MB/s | 3.5 MB 00:00 2024-09-12T17:26:58.301 INFO:teuthology.orchestra.run.smithi107.stdout:(191/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 5.3 MB/s | 1.9 MB 00:00 2024-09-12T17:26:58.335 INFO:teuthology.orchestra.run.smithi107.stdout:(192/285): poppler-21.01.0-21.el9.x86_64.rpm 6.3 MB/s | 1.1 MB 00:00 2024-09-12T17:26:58.378 INFO:teuthology.orchestra.run.smithi148.stdout:(285/285): librbd1-19.3.0-4762.gbad475c1.el9.x8 8.1 MB/s | 3.2 MB 00:00 2024-09-12T17:26:58.385 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:58.385 INFO:teuthology.orchestra.run.smithi148.stdout:Total 24 MB/s | 322 MB 00:13 2024-09-12T17:26:58.386 INFO:teuthology.orchestra.run.smithi107.stdout:(193/285): poppler-data-0.4.9-9.el9.noarch.rpm 12 MB/s | 1.9 MB 00:00 2024-09-12T17:26:58.410 INFO:teuthology.orchestra.run.smithi107.stdout:(194/285): poppler-glib-21.01.0-21.el9.x86_64.r 1.4 MB/s | 152 kB 00:00 2024-09-12T17:26:58.452 INFO:teuthology.orchestra.run.smithi107.stdout:(195/285): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-12T17:26:58.477 INFO:teuthology.orchestra.run.smithi107.stdout:(196/285): publicsuffix-list-20210518-3.el9.noa 898 kB/s | 83 kB 00:00 2024-09-12T17:26:58.544 INFO:teuthology.orchestra.run.smithi107.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 5.0 MB/s | 679 kB 00:00 2024-09-12T17:26:58.570 INFO:teuthology.orchestra.run.smithi107.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 2.6 MB/s | 245 kB 00:00 2024-09-12T17:26:58.620 INFO:teuthology.orchestra.run.smithi107.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 3.2 MB/s | 248 kB 00:00 2024-09-12T17:26:58.645 INFO:teuthology.orchestra.run.smithi107.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 340 kB/s | 26 kB 00:00 2024-09-12T17:26:58.671 INFO:teuthology.orchestra.run.smithi107.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 381 kB/s | 19 kB 00:00 2024-09-12T17:26:58.746 INFO:teuthology.orchestra.run.smithi107.stdout:(202/285): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-12T17:26:58.771 INFO:teuthology.orchestra.run.smithi107.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 347 kB/s | 35 kB 00:00 2024-09-12T17:26:58.796 INFO:teuthology.orchestra.run.smithi107.stdout:(204/285): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-12T17:26:58.855 INFO:teuthology.orchestra.run.smithi107.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 2.9 MB/s | 250 kB 00:00 2024-09-12T17:26:58.948 INFO:teuthology.orchestra.run.smithi107.stdout:(206/285): python3-numpy-1.20.1-5.el9.x86_64.rp 25 MB/s | 5.1 MB 00:00 2024-09-12T17:26:59.309 INFO:teuthology.orchestra.run.smithi107.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 659 kB/s | 77 kB 00:00 2024-09-12T17:26:59.309 INFO:teuthology.orchestra.run.smithi107.stdout:(208/285): python3-oauthlib-3.1.1-5.el9.noarch. 1.1 MB/s | 222 kB 00:00 2024-09-12T17:26:59.309 INFO:teuthology.orchestra.run.smithi107.stdout:(209/285): python3-prettytable-0.7.2-27.el9.noa 505 kB/s | 42 kB 00:00 2024-09-12T17:26:59.309 INFO:teuthology.orchestra.run.smithi107.stdout:(210/285): python3-protobuf-3.14.0-13.el9.noarc 2.9 MB/s | 269 kB 00:00 2024-09-12T17:26:59.309 INFO:teuthology.orchestra.run.smithi107.stdout:(211/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.7 MB/s | 159 kB 00:00 2024-09-12T17:26:59.309 INFO:teuthology.orchestra.run.smithi107.stdout:(212/285): python3-pyasn1-modules-0.4.8-6.el9.n 3.2 MB/s | 279 kB 00:00 2024-09-12T17:26:59.310 INFO:teuthology.orchestra.run.smithi107.stdout:(213/285): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-12T17:26:59.310 INFO:teuthology.orchestra.run.smithi107.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 711 kB/s | 54 kB 00:00 2024-09-12T17:26:59.310 INFO:teuthology.orchestra.run.smithi107.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 623 kB/s | 42 kB 00:00 2024-09-12T17:26:59.310 INFO:teuthology.orchestra.run.smithi107.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-09-12T17:26:59.310 INFO:teuthology.orchestra.run.smithi107.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 427 kB/s | 36 kB 00:00 2024-09-12T17:26:59.351 INFO:teuthology.orchestra.run.smithi107.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-12T17:26:59.376 INFO:teuthology.orchestra.run.smithi107.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 671 kB/s | 56 kB 00:00 2024-09-12T17:26:59.443 INFO:teuthology.orchestra.run.smithi107.stdout:(220/285): slf4j-1.7.30-13.el9.noarch.rpm 1.0 MB/s | 69 kB 00:00 2024-09-12T17:26:59.468 INFO:teuthology.orchestra.run.smithi107.stdout:(221/285): sisu-0.3.4-10.el9.noarch.rpm 4.3 MB/s | 510 kB 00:00 2024-09-12T17:26:59.627 INFO:teuthology.orchestra.run.smithi107.stdout:(222/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-12T17:26:59.652 INFO:teuthology.orchestra.run.smithi107.stdout:(223/285): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-12T17:26:59.686 INFO:teuthology.orchestra.run.smithi107.stdout:(224/285): sound-theme-freedesktop-0.8-17.el9.n 1.7 MB/s | 383 kB 00:00 2024-09-12T17:26:59.711 INFO:teuthology.orchestra.run.smithi107.stdout:(225/285): totem-pl-parser-3.26.6-2.el9.x86_64. 1.8 MB/s | 152 kB 00:00 2024-09-12T17:26:59.779 INFO:teuthology.orchestra.run.smithi107.stdout:(226/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 796 kB/s | 53 kB 00:00 2024-09-12T17:26:59.812 INFO:teuthology.orchestra.run.smithi107.stdout:(227/285): tracker-miners-3.1.2-4.el9.x86_64.rp 7.4 MB/s | 944 kB 00:00 2024-09-12T17:26:59.837 INFO:teuthology.orchestra.run.smithi107.stdout:(228/285): tracker-3.1.2-3.el9.x86_64.rpm 2.9 MB/s | 555 kB 00:00 2024-09-12T17:26:59.862 INFO:teuthology.orchestra.run.smithi107.stdout:(229/285): tzdata-java-2024a-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-12T17:26:59.888 INFO:teuthology.orchestra.run.smithi107.stdout:(230/285): upower-0.99.11-11.el9.x86_64.rpm 2.2 MB/s | 173 kB 00:00 2024-09-12T17:26:59.921 INFO:teuthology.orchestra.run.smithi107.stdout:(231/285): webrtc-audio-processing-0.3.1-8.el9. 3.6 MB/s | 306 kB 00:00 2024-09-12T17:26:59.946 INFO:teuthology.orchestra.run.smithi107.stdout:(232/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-09-12T17:26:59.972 INFO:teuthology.orchestra.run.smithi107.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 842 kB/s | 42 kB 00:00 2024-09-12T17:27:00.006 INFO:teuthology.orchestra.run.smithi107.stdout:(234/285): wireplumber-libs-0.4.14-1.el9.x86_64 3.0 MB/s | 358 kB 00:00 2024-09-12T17:27:00.039 INFO:teuthology.orchestra.run.smithi107.stdout:(235/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 4.1 MB/s | 385 kB 00:00 2024-09-12T17:27:00.065 INFO:teuthology.orchestra.run.smithi107.stdout:(236/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.4 MB/s | 134 kB 00:00 2024-09-12T17:27:00.098 INFO:teuthology.orchestra.run.smithi107.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-12T17:27:00.157 INFO:teuthology.orchestra.run.smithi107.stdout:(238/285): xkeyboard-config-2.33-2.el9.noarch.r 5.6 MB/s | 859 kB 00:00 2024-09-12T17:27:00.173 INFO:teuthology.orchestra.run.smithi107.stdout:(239/285): lua-devel-5.4.4-4.el9.x86_64.rpm 296 kB/s | 22 kB 00:00 2024-09-12T17:27:00.207 INFO:teuthology.orchestra.run.smithi107.stdout:(240/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 3.5 MB/s | 505 kB 00:00 2024-09-12T17:27:00.266 INFO:teuthology.orchestra.run.smithi107.stdout:(241/285): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-12T17:27:00.291 INFO:teuthology.orchestra.run.smithi107.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-12T17:27:00.317 INFO:teuthology.orchestra.run.smithi107.stdout:(243/285): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-12T17:27:00.342 INFO:teuthology.orchestra.run.smithi107.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T17:27:00.367 INFO:teuthology.orchestra.run.smithi107.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T17:27:00.401 INFO:teuthology.orchestra.run.smithi107.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-12T17:27:00.426 INFO:teuthology.orchestra.run.smithi107.stdout:(247/285): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-09-12T17:27:00.460 INFO:teuthology.orchestra.run.smithi107.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-12T17:27:00.518 INFO:teuthology.orchestra.run.smithi107.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 9.5 MB/s | 548 kB 00:00 2024-09-12T17:27:00.544 INFO:teuthology.orchestra.run.smithi107.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T17:27:00.569 INFO:teuthology.orchestra.run.smithi107.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T17:27:00.594 INFO:teuthology.orchestra.run.smithi107.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-12T17:27:00.712 INFO:teuthology.orchestra.run.smithi107.stdout:(253/285): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-09-12T17:27:00.754 INFO:teuthology.orchestra.run.smithi107.stdout:(254/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.5 MB/s | 839 kB 00:00 2024-09-12T17:27:00.787 INFO:teuthology.orchestra.run.smithi107.stdout:(255/285): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-12T17:27:00.812 INFO:teuthology.orchestra.run.smithi107.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T17:27:00.846 INFO:teuthology.orchestra.run.smithi107.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T17:27:00.871 INFO:teuthology.orchestra.run.smithi107.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-12T17:27:00.897 INFO:teuthology.orchestra.run.smithi107.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-12T17:27:00.922 INFO:teuthology.orchestra.run.smithi107.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-12T17:27:00.947 INFO:teuthology.orchestra.run.smithi107.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-12T17:27:00.973 INFO:teuthology.orchestra.run.smithi107.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-12T17:27:01.040 INFO:teuthology.orchestra.run.smithi107.stdout:(263/285): libarrow-9.0.0-11.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-09-12T17:27:01.065 INFO:teuthology.orchestra.run.smithi107.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T17:27:01.090 INFO:teuthology.orchestra.run.smithi107.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T17:27:01.141 INFO:teuthology.orchestra.run.smithi107.stdout:(266/285): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-09-12T17:27:01.166 INFO:teuthology.orchestra.run.smithi107.stdout:(267/285): python3-natsort-7.1.1-5.el9.noarch.r 768 kB/s | 58 kB 00:00 2024-09-12T17:27:01.191 INFO:teuthology.orchestra.run.smithi107.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-12T17:27:01.216 INFO:teuthology.orchestra.run.smithi107.stdout:(269/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T17:27:01.250 INFO:teuthology.orchestra.run.smithi107.stdout:(270/285): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-12T17:27:01.284 INFO:teuthology.orchestra.run.smithi107.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 457 kB/s | 31 kB 00:00 2024-09-12T17:27:01.309 INFO:teuthology.orchestra.run.smithi107.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T17:27:01.343 INFO:teuthology.orchestra.run.smithi107.stdout:(273/285): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-09-12T17:27:01.368 INFO:teuthology.orchestra.run.smithi107.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 611 kB/s | 36 kB 00:00 2024-09-12T17:27:01.402 INFO:teuthology.orchestra.run.smithi107.stdout:(275/285): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T17:27:01.427 INFO:teuthology.orchestra.run.smithi107.stdout:(276/285): python3-typing-extensions-4.12.2-2.e 888 kB/s | 74 kB 00:00 2024-09-12T17:27:01.452 INFO:teuthology.orchestra.run.smithi107.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T17:27:01.478 INFO:teuthology.orchestra.run.smithi107.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-12T17:27:01.495 INFO:teuthology.orchestra.run.smithi107.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2024-09-12T17:27:01.520 INFO:teuthology.orchestra.run.smithi107.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-12T17:27:01.555 INFO:teuthology.orchestra.run.smithi107.stdout:(281/285): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T17:27:01.578 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-12T17:27:01.579 INFO:teuthology.orchestra.run.smithi107.stdout:(282/285): s3cmd-2.4.0-1.el9.noarch.rpm 2.4 MB/s | 206 kB 00:00 2024-09-12T17:27:01.629 INFO:teuthology.orchestra.run.smithi107.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T17:27:01.762 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-12T17:27:01.762 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-12T17:27:01.888 INFO:teuthology.orchestra.run.smithi107.stdout:(284/285): librbd1-19.3.0-4762.gbad475c1.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-12T17:27:02.063 INFO:teuthology.orchestra.run.smithi107.stdout:(285/285): librados2-19.3.0-4762.gbad475c1.el9. 6.8 MB/s | 3.5 MB 00:00 2024-09-12T17:27:02.069 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:27:02.069 INFO:teuthology.orchestra.run.smithi107.stdout:Total 21 MB/s | 322 MB 00:15 2024-09-12T17:27:04.948 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-12T17:27:04.949 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-12T17:27:05.105 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-12T17:27:05.288 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-12T17:27:05.288 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-12T17:27:08.490 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-12T17:27:08.490 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-12T17:27:15.068 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T17:27:15.222 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T17:27:15.378 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-12T17:27:15.440 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T17:27:15.517 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T17:27:15.788 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T17:27:15.832 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T17:27:15.887 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T17:27:15.927 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T17:27:15.951 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T17:27:15.999 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T17:27:16.329 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T17:27:16.443 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:27:16.579 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:27:16.603 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:27:16.694 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:27:16.723 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:27:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T17:27:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T17:27:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T17:27:16.851 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T17:27:16.883 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T17:27:16.908 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T17:27:16.936 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T17:27:17.084 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T17:27:17.214 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T17:27:17.251 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T17:27:17.286 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T17:27:17.315 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:27:17.419 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:27:17.441 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:27:17.505 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:27:17.529 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T17:27:17.551 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:27:17.570 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:27:17.755 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:27:17.810 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:27:17.922 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T17:27:17.957 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T17:27:17.993 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T17:27:18.121 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T17:27:18.162 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T17:27:18.206 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T17:27:18.239 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T17:27:18.266 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T17:27:18.291 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T17:27:18.316 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T17:27:18.345 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T17:27:18.377 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T17:27:18.410 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T17:27:18.475 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T17:27:18.509 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:27:18.532 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T17:27:18.583 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:27:18.635 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T17:27:18.665 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T17:27:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T17:27:18.715 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T17:27:18.757 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T17:27:18.793 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T17:27:18.843 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-12T17:27:18.872 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T17:27:18.903 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 51/287 2024-09-12T17:27:18.924 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T17:27:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 52/287 2024-09-12T17:27:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 53/287 2024-09-12T17:27:19.008 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T17:27:19.066 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T17:27:19.204 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T17:27:19.269 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T17:27:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T17:27:19.346 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T17:27:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T17:27:19.445 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T17:27:19.477 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T17:27:19.543 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T17:27:19.819 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T17:27:19.886 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T17:27:19.906 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T17:27:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T17:27:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T17:27:20.012 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:27:20.055 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T17:27:20.092 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T17:27:20.120 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T17:27:20.178 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:27:20.193 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T17:27:20.223 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T17:27:20.257 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T17:27:20.279 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:27:20.291 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T17:27:20.330 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 68/287 2024-09-12T17:27:20.362 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T17:27:20.381 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:27:20.394 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T17:27:20.409 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:27:20.436 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T17:27:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T17:27:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T17:27:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:27:20.519 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T17:27:20.529 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T17:27:20.553 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T17:27:20.566 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T17:27:20.585 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T17:27:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T17:27:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T17:27:20.661 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T17:27:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T17:27:20.793 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T17:27:20.805 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T17:27:20.843 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T17:27:20.879 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T17:27:20.927 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T17:27:20.930 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T17:27:20.971 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T17:27:20.979 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T17:27:21.017 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T17:27:21.018 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T17:27:21.047 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:27:21.152 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:27:21.157 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T17:27:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:27:21.206 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T17:27:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:27:21.248 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T17:27:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T17:27:21.300 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:27:21.322 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:27:21.355 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T17:27:21.391 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T17:27:21.456 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T17:27:21.469 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:27:21.488 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/287 2024-09-12T17:27:21.500 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:27:21.513 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T17:27:21.590 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T17:27:21.636 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T17:27:21.681 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T17:27:21.717 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T17:27:21.728 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T17:27:21.774 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T17:27:21.790 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T17:27:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T17:27:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T17:27:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T17:27:21.935 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T17:27:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T17:27:21.989 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T17:27:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T17:27:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T17:27:22.034 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T17:27:22.056 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T17:27:22.064 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T17:27:22.089 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T17:27:22.094 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T17:27:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T17:27:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T17:27:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T17:27:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:27:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:27:22.179 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T17:27:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:27:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:27:22.269 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:27:22.322 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T17:27:22.353 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T17:27:22.368 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T17:27:22.407 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T17:27:22.442 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T17:27:22.452 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T17:27:22.486 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T17:27:22.496 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T17:27:22.537 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:27:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T17:27:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:27:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 51/287 2024-09-12T17:27:22.605 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T17:27:22.647 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 52/287 2024-09-12T17:27:22.689 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 53/287 2024-09-12T17:27:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T17:27:22.918 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T17:27:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T17:27:23.072 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:27:23.101 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:27:23.115 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:27:23.115 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T17:27:23.116 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:27:23.157 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T17:27:23.191 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T17:27:23.227 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T17:27:23.269 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T17:27:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T17:27:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T17:27:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T17:27:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T17:27:23.519 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T17:27:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T17:27:23.597 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T17:27:23.625 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T17:27:23.641 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T17:27:23.697 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T17:27:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T17:27:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T17:27:23.805 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T17:27:23.875 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T17:27:23.908 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T17:27:23.942 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T17:27:23.985 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T17:27:24.023 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 68/287 2024-09-12T17:27:24.056 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T17:27:24.089 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T17:27:24.130 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T17:27:24.188 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:27:24.223 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T17:27:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T17:27:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T17:27:24.408 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T17:27:24.414 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T17:27:24.471 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T17:27:24.481 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T17:27:24.505 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T17:27:24.520 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T17:27:24.556 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T17:27:24.604 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T17:27:24.607 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T17:27:24.649 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T17:27:24.662 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T17:27:24.691 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T17:27:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T17:27:24.857 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T17:27:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T17:27:24.901 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T17:27:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T17:27:24.944 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T17:27:25.004 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T17:27:25.053 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T17:27:25.093 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T17:27:25.134 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/287 2024-09-12T17:27:25.158 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T17:27:25.272 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T17:27:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T17:27:25.444 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T17:27:25.454 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T17:27:25.519 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T17:27:25.556 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T17:27:25.589 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T17:27:25.631 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T17:27:25.653 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T17:27:25.696 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T17:27:25.736 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T17:27:25.765 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T17:27:25.807 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T17:27:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T17:27:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:27:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T17:27:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:27:25.849 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T17:27:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:27:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T17:27:26.040 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T17:27:26.116 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T17:27:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T17:27:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:27:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:27:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T17:27:26.629 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T17:27:26.644 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:27:26.682 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:27:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:27:26.696 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T17:27:26.696 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:27:26.755 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T17:27:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T17:27:26.791 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T17:27:26.825 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T17:27:26.866 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T17:27:26.901 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T17:27:26.988 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T17:27:27.031 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T17:27:27.071 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T17:27:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T17:27:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T17:27:27.963 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T17:27:28.019 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T17:27:28.053 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T17:27:28.074 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T17:27:28.161 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T17:27:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T17:27:28.210 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T17:27:28.227 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T17:27:28.267 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T17:27:28.294 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T17:27:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:27:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:27:28.336 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T17:27:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:27:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T17:27:28.406 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T17:27:28.410 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T17:27:28.439 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T17:27:28.443 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T17:27:28.493 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T17:27:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T17:27:28.810 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:27:28.910 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:27:28.942 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 145/287 2024-09-12T17:27:28.973 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T17:27:29.004 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T17:27:29.005 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T17:27:29.067 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T17:27:29.068 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T17:27:29.110 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T17:27:29.114 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T17:27:29.136 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T17:27:29.156 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T17:27:29.180 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T17:27:29.189 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T17:27:29.209 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:27:29.394 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T17:27:29.429 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T17:27:29.467 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:27:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T17:27:29.519 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T17:27:29.547 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T17:27:29.572 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T17:27:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T17:27:29.714 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T17:27:29.715 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T17:27:29.715 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T17:27:29.715 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T17:27:29.758 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T17:27:29.788 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T17:27:29.836 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T17:27:29.871 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T17:27:30.188 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T17:27:30.304 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T17:27:30.338 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T17:27:30.474 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T17:27:30.537 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T17:27:30.561 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T17:27:30.590 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T17:27:30.671 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T17:27:30.716 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T17:27:30.746 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:27:30.766 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:27:30.800 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T17:27:30.835 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T17:27:30.875 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T17:27:30.898 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:27:31.606 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T17:27:31.691 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T17:27:31.752 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T17:27:31.785 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T17:27:31.812 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T17:27:31.842 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:27:31.854 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:27:31.854 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T17:27:31.854 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:27:31.905 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T17:27:31.938 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T17:27:31.966 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T17:27:32.298 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T17:27:32.338 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:27:32.438 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:27:32.470 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 145/287 2024-09-12T17:27:32.502 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T17:27:32.531 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T17:27:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T17:27:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T17:27:32.648 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T17:27:32.689 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T17:27:32.712 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:27:33.028 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:27:33.098 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T17:27:33.126 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T17:27:33.152 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T17:27:33.177 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T17:27:33.203 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T17:27:33.227 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T17:27:33.256 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T17:27:33.292 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T17:27:33.340 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T17:27:33.385 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T17:27:33.432 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T17:27:33.459 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T17:27:33.905 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T17:27:34.035 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T17:27:34.102 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T17:27:34.127 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T17:27:34.155 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T17:27:34.235 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T17:27:34.279 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T17:27:34.304 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:27:34.324 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:27:34.350 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T17:27:34.376 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T17:27:34.415 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T17:27:34.447 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:27:42.503 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:27:42.539 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T17:27:42.567 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T17:27:42.610 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T17:27:42.642 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T17:27:42.678 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T17:27:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T17:27:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:27:43.304 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:27:43.326 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 184/287 2024-09-12T17:27:45.684 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:27:45.716 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:27:45.865 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:27:45.908 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T17:27:45.937 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T17:27:45.984 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T17:27:46.019 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T17:27:46.056 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T17:27:46.279 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:27:46.319 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:27:46.405 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:27:46.406 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T17:27:46.406 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T17:27:46.406 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:27:46.437 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:27:46.614 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T17:27:46.661 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:27:46.741 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:27:46.771 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 184/287 2024-09-12T17:27:49.166 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:27:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:27:49.776 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:27:49.824 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:27:49.918 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:27:49.919 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T17:27:49.919 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T17:27:49.919 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:27:49.951 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:27:55.715 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:27:55.716 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2024-09-12T17:27:55.716 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2024-09-12T17:27:55.716 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2024-09-12T17:27:55.716 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2024-09-12T17:27:55.716 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2024-09-12T17:27:55.716 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2024-09-12T17:27:55.716 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2024-09-12T17:27:55.716 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:27:55.885 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:27:55.901 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:27:55.902 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:27:55.902 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T17:27:55.902 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:27:57.360 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:27:57.387 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:27:57.388 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:27:57.388 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T17:27:57.388 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:27:57.388 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:27:57.388 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:27:57.611 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:27:57.635 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:27:57.635 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:27:57.635 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T17:27:57.635 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:27:57.635 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:27:57.635 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:27:58.102 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:27:58.126 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:27:58.127 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:27:58.127 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T17:27:58.127 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:27:58.127 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:27:58.127 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:27:58.231 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T17:27:59.259 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:27:59.260 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-09-12T17:27:59.260 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-09-12T17:27:59.260 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-09-12T17:27:59.260 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-09-12T17:27:59.260 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-09-12T17:27:59.260 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-09-12T17:27:59.260 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-09-12T17:27:59.260 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:27:59.433 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:27:59.449 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:27:59.449 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:27:59.449 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T17:27:59.449 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:28:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:28:00.953 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:28:00.953 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T17:28:00.953 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:28:00.953 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:28:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T17:28:01.352 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T17:28:01.410 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T17:28:01.649 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T17:28:01.661 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:28:01.684 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:01.728 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T17:28:01.787 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T17:28:01.842 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T17:28:01.983 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T17:28:02.024 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T17:28:02.065 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T17:28:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T17:28:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:28:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T17:28:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T17:28:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T17:28:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T17:28:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T17:28:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T17:28:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T17:28:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T17:28:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T17:28:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T17:28:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T17:28:03.683 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T17:28:03.713 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T17:28:03.776 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T17:28:03.812 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T17:28:03.843 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T17:28:03.912 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T17:28:03.948 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T17:28:03.988 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T17:28:04.029 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T17:28:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T17:28:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T17:28:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T17:28:04.182 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T17:28:04.257 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T17:28:04.290 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T17:28:04.315 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T17:28:04.484 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T17:28:04.515 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T17:28:04.570 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T17:28:04.602 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T17:28:04.618 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T17:28:04.737 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T17:28:04.785 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T17:28:04.843 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T17:28:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T17:28:04.898 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:28:05.007 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:28:05.037 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T17:28:05.053 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:28:05.069 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T17:28:05.121 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T17:28:05.178 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T17:28:05.266 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T17:28:05.406 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T17:28:05.449 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T17:28:05.587 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:28:05.634 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:28:05.634 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T17:28:05.634 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T17:28:05.938 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T17:28:05.976 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T17:28:06.012 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T17:28:06.037 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T17:28:06.384 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T17:28:06.396 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:28:06.427 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:28:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:28:06.443 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:28:06.795 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:28:06.838 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T17:28:06.869 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T17:28:06.905 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T17:28:06.940 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T17:28:06.965 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:28:06.977 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T17:28:07.005 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T17:28:07.031 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T17:28:07.048 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:28:07.056 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T17:28:07.081 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T17:28:07.107 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T17:28:07.117 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:28:07.133 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T17:28:07.146 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:28:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T17:28:07.190 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T17:28:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T17:28:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T17:28:07.289 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T17:28:07.328 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T17:28:07.347 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T17:28:07.362 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T17:28:07.397 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T17:28:07.399 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T17:28:07.425 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:28:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T17:28:07.447 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:28:07.476 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:28:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T17:28:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T17:28:07.541 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:28:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T17:28:07.581 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:28:07.590 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:28:07.599 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T17:28:07.612 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:28:07.628 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:28:07.631 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T17:28:07.655 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T17:28:07.683 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T17:28:07.716 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T17:28:07.755 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T17:28:07.792 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T17:28:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T17:28:07.995 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T17:28:08.026 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T17:28:08.054 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T17:28:08.068 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:28:08.081 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T17:28:08.094 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:28:08.113 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T17:28:08.127 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 265/287 2024-09-12T17:28:08.196 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 266/287 2024-09-12T17:28:08.226 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:28:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T17:28:08.312 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T17:28:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T17:28:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:28:08.518 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:28:08.565 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:28:08.580 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:28:08.611 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T17:28:08.634 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T17:28:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:28:09.073 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:28:09.090 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:28:09.090 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T17:28:09.090 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:09.315 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T17:28:09.385 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T17:28:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T17:28:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T17:28:09.485 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T17:28:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:28:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:28:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:28:10.461 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:28:10.542 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:28:10.587 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:28:10.616 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:28:10.810 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T17:28:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T17:28:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:28:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:28:10.971 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:28:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:28:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:28:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:28:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:28:11.138 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:28:11.166 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T17:28:11.459 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:28:11.516 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:28:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:28:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:28:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 265/287 2024-09-12T17:28:11.763 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 266/287 2024-09-12T17:28:11.788 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:28:12.485 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:28:12.516 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:28:12.633 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:28:12.795 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 270/287 2024-09-12T17:28:12.827 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:28:12.850 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:28:12.850 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:28:12.850 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T17:28:12.850 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:28:12.851 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:28:12.851 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:12.902 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:28:12.914 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:28:12.936 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 273/287 2024-09-12T17:28:12.965 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T17:28:13.006 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T17:28:13.029 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:28:13.045 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:28:13.046 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T17:28:13.046 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:14.005 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:28:14.029 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:28:14.029 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:28:14.029 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T17:28:14.029 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:28:14.029 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:28:14.029 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:14.072 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:28:14.095 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:28:14.095 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:28:14.096 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T17:28:14.096 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:14.406 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:28:14.430 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:28:14.430 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:28:14.430 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T17:28:14.431 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:28:14.431 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:28:14.431 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:14.992 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:28:15.060 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:28:16.027 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:28:16.060 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:28:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:28:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 270/287 2024-09-12T17:28:16.378 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:28:16.402 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:28:16.403 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:28:16.403 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T17:28:16.403 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:28:16.403 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:28:16.403 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:16.454 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:28:16.465 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:28:16.489 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 273/287 2024-09-12T17:28:16.518 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T17:28:16.566 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T17:28:16.589 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:28:16.605 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:28:16.605 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T17:28:16.605 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:28:17.641 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:28:17.641 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:28:17.641 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T17:28:17.641 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:28:17.641 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:28:17.642 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:28:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:28:17.707 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:28:17.707 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T17:28:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:18.036 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:18.735 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 280/287 2024-09-12T17:28:18.775 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 281/287 2024-09-12T17:28:18.815 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 282/287 2024-09-12T17:28:18.920 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 283/287 2024-09-12T17:28:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:28:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T17:28:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:28:19.107 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:28:19.108 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:28:19.199 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:28:19.224 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T17:28:19.231 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T17:28:19.240 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T17:28:19.252 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T17:28:19.252 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:28:19.252 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:28:19.252 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:19.309 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:28:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:28:22.406 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 280/287 2024-09-12T17:28:22.447 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 281/287 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 282/287 2024-09-12T17:28:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 283/287 2024-09-12T17:28:22.638 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:28:22.670 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T17:28:22.670 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:28:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:28:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:28:22.862 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:28:22.881 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T17:28:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:28:28.750 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:28:28.750 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/287 2024-09-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2/287 2024-09-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 3/287 2024-09-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 4/287 2024-09-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 5/287 2024-09-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 6/287 2024-09-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 7/287 2024-09-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 8/287 2024-09-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 9/287 2024-09-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 13/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 14/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 15/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 16/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 17/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 18/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 19/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 20/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 21/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 22/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 25/287 2024-09-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 26/287 2024-09-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 27/287 2024-09-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 28/287 2024-09-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 29/287 2024-09-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 30/287 2024-09-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 31/287 2024-09-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 32/287 2024-09-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 33/287 2024-09-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 34/287 2024-09-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 35/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 36/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 243/287 2024-09-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T17:28:28.771 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T17:28:28.772 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:28:28.773 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T17:28:28.773 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 286/287 2024-09-12T17:28:32.110 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:28:32.111 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:32.111 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-09-12T17:28:32.111 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.111 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.111 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-12T17:28:32.111 INFO:teuthology.orchestra.run.smithi148.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T17:28:32.111 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T17:28:32.111 INFO:teuthology.orchestra.run.smithi148.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T17:28:32.111 INFO:teuthology.orchestra.run.smithi148.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T17:28:32.112 INFO:teuthology.orchestra.run.smithi148.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T17:28:32.112 INFO:teuthology.orchestra.run.smithi148.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T17:28:32.112 INFO:teuthology.orchestra.run.smithi148.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T17:28:32.112 INFO:teuthology.orchestra.run.smithi148.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T17:28:32.112 INFO:teuthology.orchestra.run.smithi148.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T17:28:32.112 INFO:teuthology.orchestra.run.smithi148.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T17:28:32.112 INFO:teuthology.orchestra.run.smithi148.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T17:28:32.112 INFO:teuthology.orchestra.run.smithi148.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T17:28:32.112 INFO:teuthology.orchestra.run.smithi148.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T17:28:32.112 INFO:teuthology.orchestra.run.smithi148.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T17:28:32.112 INFO:teuthology.orchestra.run.smithi148.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T17:28:32.113 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T17:28:32.113 INFO:teuthology.orchestra.run.smithi148.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T17:28:32.113 INFO:teuthology.orchestra.run.smithi148.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T17:28:32.113 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.113 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.113 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.113 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.113 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:32.113 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.113 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.113 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.113 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:32.114 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:32.114 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:32.114 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:32.114 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:32.114 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.114 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.114 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:32.114 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.114 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.114 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.114 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T17:28:32.115 INFO:teuthology.orchestra.run.smithi148.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T17:28:32.116 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T17:28:32.116 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T17:28:32.116 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T17:28:32.116 INFO:teuthology.orchestra.run.smithi148.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T17:28:32.116 INFO:teuthology.orchestra.run.smithi148.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T17:28:32.116 INFO:teuthology.orchestra.run.smithi148.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T17:28:32.116 INFO:teuthology.orchestra.run.smithi148.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T17:28:32.116 INFO:teuthology.orchestra.run.smithi148.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T17:28:32.116 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T17:28:32.116 INFO:teuthology.orchestra.run.smithi148.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T17:28:32.116 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T17:28:32.116 INFO:teuthology.orchestra.run.smithi148.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T17:28:32.117 INFO:teuthology.orchestra.run.smithi148.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T17:28:32.117 INFO:teuthology.orchestra.run.smithi148.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T17:28:32.117 INFO:teuthology.orchestra.run.smithi148.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T17:28:32.117 INFO:teuthology.orchestra.run.smithi148.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T17:28:32.117 INFO:teuthology.orchestra.run.smithi148.stdout: guava-30.1-6.el9.noarch 2024-09-12T17:28:32.117 INFO:teuthology.orchestra.run.smithi148.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T17:28:32.117 INFO:teuthology.orchestra.run.smithi148.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T17:28:32.117 INFO:teuthology.orchestra.run.smithi148.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T17:28:32.117 INFO:teuthology.orchestra.run.smithi148.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T17:28:32.117 INFO:teuthology.orchestra.run.smithi148.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T17:28:32.117 INFO:teuthology.orchestra.run.smithi148.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T17:28:32.117 INFO:teuthology.orchestra.run.smithi148.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:28:32.118 INFO:teuthology.orchestra.run.smithi148.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:28:32.118 INFO:teuthology.orchestra.run.smithi148.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:28:32.118 INFO:teuthology.orchestra.run.smithi148.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T17:28:32.118 INFO:teuthology.orchestra.run.smithi148.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T17:28:32.118 INFO:teuthology.orchestra.run.smithi148.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T17:28:32.118 INFO:teuthology.orchestra.run.smithi148.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T17:28:32.118 INFO:teuthology.orchestra.run.smithi148.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T17:28:32.118 INFO:teuthology.orchestra.run.smithi148.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T17:28:32.118 INFO:teuthology.orchestra.run.smithi148.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T17:28:32.118 INFO:teuthology.orchestra.run.smithi148.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T17:28:32.119 INFO:teuthology.orchestra.run.smithi148.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T17:28:32.119 INFO:teuthology.orchestra.run.smithi148.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T17:28:32.119 INFO:teuthology.orchestra.run.smithi148.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T17:28:32.119 INFO:teuthology.orchestra.run.smithi148.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T17:28:32.119 INFO:teuthology.orchestra.run.smithi148.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T17:28:32.119 INFO:teuthology.orchestra.run.smithi148.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T17:28:32.119 INFO:teuthology.orchestra.run.smithi148.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T17:28:32.119 INFO:teuthology.orchestra.run.smithi148.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T17:28:32.119 INFO:teuthology.orchestra.run.smithi148.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T17:28:32.120 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T17:28:32.120 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T17:28:32.120 INFO:teuthology.orchestra.run.smithi148.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T17:28:32.120 INFO:teuthology.orchestra.run.smithi148.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T17:28:32.120 INFO:teuthology.orchestra.run.smithi148.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T17:28:32.120 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.120 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.120 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.120 INFO:teuthology.orchestra.run.smithi148.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T17:28:32.121 INFO:teuthology.orchestra.run.smithi148.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T17:28:32.121 INFO:teuthology.orchestra.run.smithi148.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T17:28:32.121 INFO:teuthology.orchestra.run.smithi148.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T17:28:32.121 INFO:teuthology.orchestra.run.smithi148.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T17:28:32.121 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T17:28:32.121 INFO:teuthology.orchestra.run.smithi148.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T17:28:32.121 INFO:teuthology.orchestra.run.smithi148.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T17:28:32.121 INFO:teuthology.orchestra.run.smithi148.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T17:28:32.121 INFO:teuthology.orchestra.run.smithi148.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T17:28:32.121 INFO:teuthology.orchestra.run.smithi148.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T17:28:32.121 INFO:teuthology.orchestra.run.smithi148.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T17:28:32.121 INFO:teuthology.orchestra.run.smithi148.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T17:28:32.122 INFO:teuthology.orchestra.run.smithi148.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T17:28:32.122 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T17:28:32.122 INFO:teuthology.orchestra.run.smithi148.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T17:28:32.122 INFO:teuthology.orchestra.run.smithi148.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T17:28:32.122 INFO:teuthology.orchestra.run.smithi148.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T17:28:32.122 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T17:28:32.122 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T17:28:32.122 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T17:28:32.122 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.123 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.123 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T17:28:32.123 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.123 INFO:teuthology.orchestra.run.smithi148.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T17:28:32.123 INFO:teuthology.orchestra.run.smithi148.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T17:28:32.123 INFO:teuthology.orchestra.run.smithi148.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T17:28:32.123 INFO:teuthology.orchestra.run.smithi148.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T17:28:32.123 INFO:teuthology.orchestra.run.smithi148.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T17:28:32.123 INFO:teuthology.orchestra.run.smithi148.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T17:28:32.123 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T17:28:32.123 INFO:teuthology.orchestra.run.smithi148.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T17:28:32.123 INFO:teuthology.orchestra.run.smithi148.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T17:28:32.124 INFO:teuthology.orchestra.run.smithi148.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T17:28:32.124 INFO:teuthology.orchestra.run.smithi148.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T17:28:32.124 INFO:teuthology.orchestra.run.smithi148.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T17:28:32.124 INFO:teuthology.orchestra.run.smithi148.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T17:28:32.124 INFO:teuthology.orchestra.run.smithi148.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T17:28:32.124 INFO:teuthology.orchestra.run.smithi148.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T17:28:32.124 INFO:teuthology.orchestra.run.smithi148.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T17:28:32.124 INFO:teuthology.orchestra.run.smithi148.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T17:28:32.124 INFO:teuthology.orchestra.run.smithi148.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T17:28:32.124 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T17:28:32.124 INFO:teuthology.orchestra.run.smithi148.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T17:28:32.125 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T17:28:32.125 INFO:teuthology.orchestra.run.smithi148.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T17:28:32.125 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T17:28:32.125 INFO:teuthology.orchestra.run.smithi148.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T17:28:32.125 INFO:teuthology.orchestra.run.smithi148.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T17:28:32.125 INFO:teuthology.orchestra.run.smithi148.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T17:28:32.125 INFO:teuthology.orchestra.run.smithi148.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T17:28:32.125 INFO:teuthology.orchestra.run.smithi148.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T17:28:32.125 INFO:teuthology.orchestra.run.smithi148.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T17:28:32.125 INFO:teuthology.orchestra.run.smithi148.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T17:28:32.126 INFO:teuthology.orchestra.run.smithi148.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T17:28:32.126 INFO:teuthology.orchestra.run.smithi148.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T17:28:32.126 INFO:teuthology.orchestra.run.smithi148.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T17:28:32.126 INFO:teuthology.orchestra.run.smithi148.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T17:28:32.126 INFO:teuthology.orchestra.run.smithi148.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T17:28:32.126 INFO:teuthology.orchestra.run.smithi148.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T17:28:32.126 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T17:28:32.126 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T17:28:32.126 INFO:teuthology.orchestra.run.smithi148.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T17:28:32.126 INFO:teuthology.orchestra.run.smithi148.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T17:28:32.126 INFO:teuthology.orchestra.run.smithi148.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T17:28:32.127 INFO:teuthology.orchestra.run.smithi148.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T17:28:32.127 INFO:teuthology.orchestra.run.smithi148.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T17:28:32.127 INFO:teuthology.orchestra.run.smithi148.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T17:28:32.127 INFO:teuthology.orchestra.run.smithi148.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T17:28:32.127 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T17:28:32.127 INFO:teuthology.orchestra.run.smithi148.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T17:28:32.127 INFO:teuthology.orchestra.run.smithi148.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T17:28:32.127 INFO:teuthology.orchestra.run.smithi148.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T17:28:32.127 INFO:teuthology.orchestra.run.smithi148.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T17:28:32.127 INFO:teuthology.orchestra.run.smithi148.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T17:28:32.127 INFO:teuthology.orchestra.run.smithi148.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T17:28:32.127 INFO:teuthology.orchestra.run.smithi148.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T17:28:32.128 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T17:28:32.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T17:28:32.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T17:28:32.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T17:28:32.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T17:28:32.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T17:28:32.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T17:28:32.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T17:28:32.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T17:28:32.129 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T17:28:32.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T17:28:32.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T17:28:32.132 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T17:28:32.133 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T17:28:32.133 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T17:28:32.133 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T17:28:32.133 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T17:28:32.133 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T17:28:32.133 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T17:28:32.133 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T17:28:32.133 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T17:28:32.133 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T17:28:32.133 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T17:28:32.133 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.133 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T17:28:32.134 INFO:teuthology.orchestra.run.smithi148.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T17:28:32.135 INFO:teuthology.orchestra.run.smithi148.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T17:28:32.135 INFO:teuthology.orchestra.run.smithi148.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T17:28:32.135 INFO:teuthology.orchestra.run.smithi148.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T17:28:32.135 INFO:teuthology.orchestra.run.smithi148.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T17:28:32.135 INFO:teuthology.orchestra.run.smithi148.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T17:28:32.135 INFO:teuthology.orchestra.run.smithi148.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T17:28:32.135 INFO:teuthology.orchestra.run.smithi148.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T17:28:32.135 INFO:teuthology.orchestra.run.smithi148.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T17:28:32.135 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T17:28:32.136 INFO:teuthology.orchestra.run.smithi148.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T17:28:32.136 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:32.136 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-12T17:28:32.532 DEBUG:teuthology.parallel:result is None 2024-09-12T17:28:33.260 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:28:33.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/287 2024-09-12T17:28:33.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2/287 2024-09-12T17:28:33.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 3/287 2024-09-12T17:28:33.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 4/287 2024-09-12T17:28:33.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 5/287 2024-09-12T17:28:33.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 6/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 7/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 8/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 9/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 13/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 14/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 15/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 16/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 17/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 18/287 2024-09-12T17:28:33.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 19/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 20/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 21/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 22/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 25/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 26/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 27/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 28/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 29/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 30/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 31/287 2024-09-12T17:28:33.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 32/287 2024-09-12T17:28:33.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 33/287 2024-09-12T17:28:33.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 34/287 2024-09-12T17:28:33.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 35/287 2024-09-12T17:28:33.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 36/287 2024-09-12T17:28:33.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T17:28:33.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T17:28:33.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T17:28:33.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T17:28:33.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T17:28:33.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T17:28:33.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T17:28:33.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T17:28:33.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T17:28:33.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T17:28:33.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T17:28:33.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T17:28:33.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T17:28:33.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T17:28:33.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T17:28:33.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T17:28:33.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T17:28:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T17:28:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T17:28:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T17:28:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T17:28:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T17:28:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T17:28:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T17:28:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T17:28:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T17:28:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T17:28:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T17:28:33.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T17:28:33.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T17:28:33.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T17:28:33.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T17:28:33.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T17:28:33.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T17:28:33.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T17:28:33.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T17:28:33.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T17:28:33.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T17:28:33.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T17:28:33.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T17:28:33.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T17:28:33.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T17:28:33.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T17:28:33.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T17:28:33.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T17:28:33.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T17:28:33.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T17:28:33.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T17:28:33.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T17:28:33.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T17:28:33.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T17:28:33.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T17:28:33.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T17:28:33.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T17:28:33.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T17:28:33.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T17:28:33.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T17:28:33.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T17:28:33.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T17:28:33.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T17:28:33.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T17:28:33.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T17:28:33.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T17:28:33.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T17:28:33.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T17:28:33.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T17:28:33.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T17:28:33.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T17:28:33.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T17:28:33.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T17:28:33.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T17:28:33.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T17:28:33.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T17:28:33.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T17:28:33.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T17:28:33.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T17:28:33.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T17:28:33.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T17:28:33.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T17:28:33.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T17:28:33.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T17:28:33.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T17:28:33.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T17:28:33.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T17:28:33.277 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T17:28:33.277 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T17:28:33.277 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T17:28:33.277 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T17:28:33.277 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T17:28:33.277 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T17:28:33.277 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T17:28:33.277 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T17:28:33.277 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T17:28:33.277 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T17:28:33.277 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T17:28:33.277 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T17:28:33.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T17:28:33.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T17:28:33.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T17:28:33.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T17:28:33.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T17:28:33.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T17:28:33.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T17:28:33.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T17:28:33.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T17:28:33.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T17:28:33.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T17:28:33.278 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T17:28:33.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T17:28:33.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T17:28:33.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T17:28:33.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T17:28:33.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T17:28:33.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T17:28:33.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T17:28:33.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T17:28:33.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T17:28:33.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T17:28:33.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T17:28:33.279 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 243/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T17:28:33.280 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T17:28:33.281 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T17:28:33.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T17:28:33.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T17:28:33.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T17:28:33.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T17:28:33.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T17:28:33.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T17:28:33.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T17:28:33.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T17:28:33.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T17:28:33.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T17:28:33.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T17:28:33.282 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T17:28:33.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T17:28:33.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T17:28:33.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T17:28:33.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T17:28:33.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T17:28:33.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:28:33.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T17:28:33.283 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 286/287 2024-09-12T17:28:36.565 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:28:36.565 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:36.566 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-09-12T17:28:36.566 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.566 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.566 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-12T17:28:36.566 INFO:teuthology.orchestra.run.smithi107.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T17:28:36.566 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T17:28:36.567 INFO:teuthology.orchestra.run.smithi107.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T17:28:36.567 INFO:teuthology.orchestra.run.smithi107.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T17:28:36.567 INFO:teuthology.orchestra.run.smithi107.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T17:28:36.567 INFO:teuthology.orchestra.run.smithi107.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T17:28:36.567 INFO:teuthology.orchestra.run.smithi107.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T17:28:36.567 INFO:teuthology.orchestra.run.smithi107.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T17:28:36.567 INFO:teuthology.orchestra.run.smithi107.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T17:28:36.568 INFO:teuthology.orchestra.run.smithi107.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T17:28:36.568 INFO:teuthology.orchestra.run.smithi107.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T17:28:36.568 INFO:teuthology.orchestra.run.smithi107.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T17:28:36.568 INFO:teuthology.orchestra.run.smithi107.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T17:28:36.568 INFO:teuthology.orchestra.run.smithi107.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T17:28:36.568 INFO:teuthology.orchestra.run.smithi107.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T17:28:36.568 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T17:28:36.568 INFO:teuthology.orchestra.run.smithi107.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T17:28:36.568 INFO:teuthology.orchestra.run.smithi107.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T17:28:36.568 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.568 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:36.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:36.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:36.569 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:36.570 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:36.570 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:36.570 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.570 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.570 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:36.570 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.570 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.570 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.570 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:36.570 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:28:36.570 INFO:teuthology.orchestra.run.smithi107.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T17:28:36.570 INFO:teuthology.orchestra.run.smithi107.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T17:28:36.571 INFO:teuthology.orchestra.run.smithi107.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T17:28:36.571 INFO:teuthology.orchestra.run.smithi107.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T17:28:36.571 INFO:teuthology.orchestra.run.smithi107.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T17:28:36.571 INFO:teuthology.orchestra.run.smithi107.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T17:28:36.571 INFO:teuthology.orchestra.run.smithi107.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T17:28:36.571 INFO:teuthology.orchestra.run.smithi107.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T17:28:36.571 INFO:teuthology.orchestra.run.smithi107.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T17:28:36.571 INFO:teuthology.orchestra.run.smithi107.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T17:28:36.572 INFO:teuthology.orchestra.run.smithi107.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T17:28:36.572 INFO:teuthology.orchestra.run.smithi107.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T17:28:36.572 INFO:teuthology.orchestra.run.smithi107.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T17:28:36.572 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T17:28:36.572 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T17:28:36.572 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T17:28:36.572 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T17:28:36.572 INFO:teuthology.orchestra.run.smithi107.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T17:28:36.572 INFO:teuthology.orchestra.run.smithi107.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T17:28:36.572 INFO:teuthology.orchestra.run.smithi107.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T17:28:36.572 INFO:teuthology.orchestra.run.smithi107.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T17:28:36.573 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T17:28:36.573 INFO:teuthology.orchestra.run.smithi107.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T17:28:36.573 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T17:28:36.573 INFO:teuthology.orchestra.run.smithi107.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T17:28:36.573 INFO:teuthology.orchestra.run.smithi107.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T17:28:36.573 INFO:teuthology.orchestra.run.smithi107.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T17:28:36.573 INFO:teuthology.orchestra.run.smithi107.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T17:28:36.573 INFO:teuthology.orchestra.run.smithi107.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T17:28:36.574 INFO:teuthology.orchestra.run.smithi107.stdout: guava-30.1-6.el9.noarch 2024-09-12T17:28:36.574 INFO:teuthology.orchestra.run.smithi107.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T17:28:36.574 INFO:teuthology.orchestra.run.smithi107.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T17:28:36.574 INFO:teuthology.orchestra.run.smithi107.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T17:28:36.575 INFO:teuthology.orchestra.run.smithi107.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T17:28:36.575 INFO:teuthology.orchestra.run.smithi107.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T17:28:36.576 INFO:teuthology.orchestra.run.smithi107.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T17:28:36.576 INFO:teuthology.orchestra.run.smithi107.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:28:36.576 INFO:teuthology.orchestra.run.smithi107.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:28:36.576 INFO:teuthology.orchestra.run.smithi107.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:28:36.576 INFO:teuthology.orchestra.run.smithi107.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T17:28:36.576 INFO:teuthology.orchestra.run.smithi107.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T17:28:36.577 INFO:teuthology.orchestra.run.smithi107.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T17:28:36.577 INFO:teuthology.orchestra.run.smithi107.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T17:28:36.577 INFO:teuthology.orchestra.run.smithi107.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T17:28:36.577 INFO:teuthology.orchestra.run.smithi107.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T17:28:36.577 INFO:teuthology.orchestra.run.smithi107.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T17:28:36.577 INFO:teuthology.orchestra.run.smithi107.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T17:28:36.578 INFO:teuthology.orchestra.run.smithi107.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T17:28:36.579 INFO:teuthology.orchestra.run.smithi107.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T17:28:36.579 INFO:teuthology.orchestra.run.smithi107.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T17:28:36.580 INFO:teuthology.orchestra.run.smithi107.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T17:28:36.580 INFO:teuthology.orchestra.run.smithi107.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T17:28:36.580 INFO:teuthology.orchestra.run.smithi107.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T17:28:36.580 INFO:teuthology.orchestra.run.smithi107.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T17:28:36.580 INFO:teuthology.orchestra.run.smithi107.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T17:28:36.581 INFO:teuthology.orchestra.run.smithi107.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T17:28:36.581 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T17:28:36.581 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T17:28:36.581 INFO:teuthology.orchestra.run.smithi107.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T17:28:36.581 INFO:teuthology.orchestra.run.smithi107.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T17:28:36.581 INFO:teuthology.orchestra.run.smithi107.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T17:28:36.582 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.582 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.582 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.582 INFO:teuthology.orchestra.run.smithi107.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T17:28:36.582 INFO:teuthology.orchestra.run.smithi107.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T17:28:36.583 INFO:teuthology.orchestra.run.smithi107.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T17:28:36.583 INFO:teuthology.orchestra.run.smithi107.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T17:28:36.583 INFO:teuthology.orchestra.run.smithi107.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T17:28:36.583 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T17:28:36.583 INFO:teuthology.orchestra.run.smithi107.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T17:28:36.583 INFO:teuthology.orchestra.run.smithi107.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T17:28:36.584 INFO:teuthology.orchestra.run.smithi107.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T17:28:36.584 INFO:teuthology.orchestra.run.smithi107.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T17:28:36.584 INFO:teuthology.orchestra.run.smithi107.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T17:28:36.584 INFO:teuthology.orchestra.run.smithi107.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T17:28:36.584 INFO:teuthology.orchestra.run.smithi107.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T17:28:36.585 INFO:teuthology.orchestra.run.smithi107.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T17:28:36.585 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T17:28:36.585 INFO:teuthology.orchestra.run.smithi107.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T17:28:36.585 INFO:teuthology.orchestra.run.smithi107.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T17:28:36.585 INFO:teuthology.orchestra.run.smithi107.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T17:28:36.586 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T17:28:36.586 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T17:28:36.586 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T17:28:36.586 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.586 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.587 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T17:28:36.587 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.587 INFO:teuthology.orchestra.run.smithi107.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T17:28:36.587 INFO:teuthology.orchestra.run.smithi107.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T17:28:36.587 INFO:teuthology.orchestra.run.smithi107.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T17:28:36.587 INFO:teuthology.orchestra.run.smithi107.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T17:28:36.588 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T17:28:36.588 INFO:teuthology.orchestra.run.smithi107.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T17:28:36.588 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T17:28:36.588 INFO:teuthology.orchestra.run.smithi107.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T17:28:36.588 INFO:teuthology.orchestra.run.smithi107.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T17:28:36.588 INFO:teuthology.orchestra.run.smithi107.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T17:28:36.589 INFO:teuthology.orchestra.run.smithi107.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T17:28:36.589 INFO:teuthology.orchestra.run.smithi107.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T17:28:36.589 INFO:teuthology.orchestra.run.smithi107.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T17:28:36.589 INFO:teuthology.orchestra.run.smithi107.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T17:28:36.589 INFO:teuthology.orchestra.run.smithi107.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T17:28:36.590 INFO:teuthology.orchestra.run.smithi107.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T17:28:36.590 INFO:teuthology.orchestra.run.smithi107.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T17:28:36.590 INFO:teuthology.orchestra.run.smithi107.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T17:28:36.590 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T17:28:36.590 INFO:teuthology.orchestra.run.smithi107.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T17:28:36.590 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T17:28:36.591 INFO:teuthology.orchestra.run.smithi107.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T17:28:36.591 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T17:28:36.591 INFO:teuthology.orchestra.run.smithi107.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T17:28:36.591 INFO:teuthology.orchestra.run.smithi107.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T17:28:36.591 INFO:teuthology.orchestra.run.smithi107.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T17:28:36.591 INFO:teuthology.orchestra.run.smithi107.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T17:28:36.592 INFO:teuthology.orchestra.run.smithi107.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T17:28:36.592 INFO:teuthology.orchestra.run.smithi107.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T17:28:36.592 INFO:teuthology.orchestra.run.smithi107.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T17:28:36.592 INFO:teuthology.orchestra.run.smithi107.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T17:28:36.592 INFO:teuthology.orchestra.run.smithi107.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T17:28:36.592 INFO:teuthology.orchestra.run.smithi107.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T17:28:36.593 INFO:teuthology.orchestra.run.smithi107.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T17:28:36.593 INFO:teuthology.orchestra.run.smithi107.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T17:28:36.593 INFO:teuthology.orchestra.run.smithi107.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T17:28:36.593 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T17:28:36.593 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T17:28:36.593 INFO:teuthology.orchestra.run.smithi107.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T17:28:36.593 INFO:teuthology.orchestra.run.smithi107.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T17:28:36.594 INFO:teuthology.orchestra.run.smithi107.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T17:28:36.595 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T17:28:36.596 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T17:28:36.596 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T17:28:36.596 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.596 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.596 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.596 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T17:28:36.596 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T17:28:36.596 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T17:28:36.596 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T17:28:36.596 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T17:28:36.596 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T17:28:36.596 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T17:28:36.597 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T17:28:36.598 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T17:28:36.598 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T17:28:36.598 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T17:28:36.598 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T17:28:36.598 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T17:28:36.598 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T17:28:36.598 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T17:28:36.598 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T17:28:36.598 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T17:28:36.598 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T17:28:36.598 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T17:28:36.599 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T17:28:36.599 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T17:28:36.599 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T17:28:36.599 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T17:28:36.599 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T17:28:36.599 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T17:28:36.599 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.599 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.600 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T17:28:36.600 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T17:28:36.600 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T17:28:36.600 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.600 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T17:28:36.601 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T17:28:36.601 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T17:28:36.601 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T17:28:36.601 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T17:28:36.601 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T17:28:36.601 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T17:28:36.602 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T17:28:36.602 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T17:28:36.602 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T17:28:36.602 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T17:28:36.602 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T17:28:36.602 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T17:28:36.602 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T17:28:36.603 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.603 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.603 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:28:36.603 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T17:28:36.603 INFO:teuthology.orchestra.run.smithi107.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T17:28:36.603 INFO:teuthology.orchestra.run.smithi107.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T17:28:36.603 INFO:teuthology.orchestra.run.smithi107.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T17:28:36.604 INFO:teuthology.orchestra.run.smithi107.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T17:28:36.604 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T17:28:36.604 INFO:teuthology.orchestra.run.smithi107.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T17:28:36.604 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T17:28:36.604 INFO:teuthology.orchestra.run.smithi107.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T17:28:36.604 INFO:teuthology.orchestra.run.smithi107.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T17:28:36.604 INFO:teuthology.orchestra.run.smithi107.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T17:28:36.605 INFO:teuthology.orchestra.run.smithi107.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T17:28:36.605 INFO:teuthology.orchestra.run.smithi107.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T17:28:36.605 INFO:teuthology.orchestra.run.smithi107.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T17:28:36.605 INFO:teuthology.orchestra.run.smithi107.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T17:28:36.605 INFO:teuthology.orchestra.run.smithi107.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T17:28:36.605 INFO:teuthology.orchestra.run.smithi107.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T17:28:36.605 INFO:teuthology.orchestra.run.smithi107.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T17:28:36.606 INFO:teuthology.orchestra.run.smithi107.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T17:28:36.606 INFO:teuthology.orchestra.run.smithi107.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T17:28:36.606 INFO:teuthology.orchestra.run.smithi107.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T17:28:36.606 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T17:28:36.607 INFO:teuthology.orchestra.run.smithi107.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T17:28:36.607 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:36.607 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-12T17:28:37.005 DEBUG:teuthology.parallel:result is None 2024-09-12T17:28:37.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:28:37.156 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T17:28:37.224 INFO:teuthology.orchestra.run.smithi107.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T17:28:37.225 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T17:28:37.225 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T17:28:37.227 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:28:37.370 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T17:28:37.457 INFO:teuthology.orchestra.run.smithi148.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T17:28:37.457 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T17:28:37.457 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T17:28:37.459 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T17:28:37.459 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:28:37.459 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:28:37.501 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:28:37.501 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:28:37.546 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T17:28:37.547 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:28:37.547 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:28:37.586 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:28:37.665 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:28:37.666 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:28:37.709 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:28:37.790 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T17:28:37.790 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:28:37.790 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:28:37.829 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:28:37.908 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:28:37.908 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:28:37.947 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:28:38.025 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T17:28:38.025 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:28:38.026 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:28:38.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:28:38.142 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:28:38.142 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:28:38.181 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:28:38.261 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T17:28:38.354 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T17:28:38.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-09-12T17:28:38.357 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2024-09-12T17:28:38.395 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T17:28:38.396 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:28:38.437 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:28:38.475 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T17:28:38.475 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:28:38.515 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:28:38.589 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T17:28:38.589 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T17:28:38.589 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7902731', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/7Y8/FoCFwqVkeKNL1j+0j422pFSjWpBlMNOzLLfEjG6rQ81o2Oq7fPUUbOEajzVVJVQ1M2iE6SQKS96uOf58=', 'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKudc8UzzrEuTOa/mo+gPDEi4ce1f1sEz8PxIYT2lxpoJgxXECpl/iTFlkjOazqA7JpUXH9bRCAoXhaQj7VmNH4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T17:28:38.590 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:28:38.592 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:28:38.622 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:28:38.662 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:28:38.701 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:28:38.701 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:28:38.767 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:28:38.767 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-09-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-12 17:28:24.157171611 +0000 2024-09-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-12 17:26:04.696495117 +0000 2024-09-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-12 17:26:04.696495117 +0000 2024-09-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-12 17:26:04.696495117 +0000 2024-09-12T17:28:38.837 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:28:38.913 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-12T17:28:38.913 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-12T17:28:38.913 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.00026093 s, 2.0 MB/s 2024-09-12T17:28:38.914 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:28:38.984 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-09-12T17:28:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:28:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:39.054 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T17:28:39.054 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:39.054 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:28:39.054 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-12 17:28:24.158171594 +0000 2024-09-12T17:28:39.054 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-12 17:26:05.018490040 +0000 2024-09-12T17:28:39.055 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-12 17:26:05.018490040 +0000 2024-09-12T17:28:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-12 17:26:05.018490040 +0000 2024-09-12T17:28:39.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:28:39.132 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-12T17:28:39.132 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-12T17:28:39.132 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000209606 s, 2.4 MB/s 2024-09-12T17:28:39.133 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:28:39.205 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-09-12T17:28:39.274 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:28:39.274 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:39.274 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T17:28:39.274 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:39.274 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:28:39.274 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-12 17:28:24.158171594 +0000 2024-09-12T17:28:39.275 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-12 17:26:05.352484775 +0000 2024-09-12T17:28:39.275 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-12 17:26:05.352484775 +0000 2024-09-12T17:28:39.275 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-12 17:26:05.352484775 +0000 2024-09-12T17:28:39.275 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:28:39.352 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-12T17:28:39.352 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-12T17:28:39.352 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000220807 s, 2.3 MB/s 2024-09-12T17:28:39.353 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:28:39.423 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-09-12T17:28:39.492 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:28:39.492 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:39.492 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-12T17:28:39.492 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:39.492 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:28:39.493 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-09-12 17:28:24.158171594 +0000 2024-09-12T17:28:39.493 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-09-12 17:26:05.687479493 +0000 2024-09-12T17:28:39.493 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-09-12 17:26:05.687479493 +0000 2024-09-12T17:28:39.493 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-09-12 17:26:05.687479493 +0000 2024-09-12T17:28:39.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:28:39.573 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-09-12T17:28:39.574 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-09-12T17:28:39.574 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000231537 s, 2.2 MB/s 2024-09-12T17:28:39.575 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:28:39.644 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:39.645 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:28:39.645 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:28:39.679 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:28:39.680 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-09-12T17:28:39.753 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-12 17:28:20.431673327 +0000 2024-09-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-12 17:26:03.571366328 +0000 2024-09-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-12 17:26:03.571366328 +0000 2024-09-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-12 17:26:03.571366328 +0000 2024-09-12T17:28:39.754 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:28:39.835 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-12T17:28:39.835 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-12T17:28:39.835 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000191317 s, 2.7 MB/s 2024-09-12T17:28:39.836 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:28:39.908 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-09-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-12 17:28:20.432673302 +0000 2024-09-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-12 17:26:03.898358151 +0000 2024-09-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-12 17:26:03.898358151 +0000 2024-09-12T17:28:39.980 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-12 17:26:03.898358151 +0000 2024-09-12T17:28:39.980 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:28:40.057 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-12T17:28:40.057 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-12T17:28:40.057 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000221075 s, 2.3 MB/s 2024-09-12T17:28:40.058 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:28:40.128 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-09-12T17:28:40.198 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:28:40.198 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:40.198 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T17:28:40.198 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:40.198 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:28:40.198 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-12 17:28:20.432673302 +0000 2024-09-12T17:28:40.198 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-12 17:26:04.224350000 +0000 2024-09-12T17:28:40.198 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-12 17:26:04.224350000 +0000 2024-09-12T17:28:40.198 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-12 17:26:04.224350000 +0000 2024-09-12T17:28:40.199 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:28:40.274 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-12T17:28:40.275 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-12T17:28:40.275 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000286854 s, 1.8 MB/s 2024-09-12T17:28:40.276 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:28:40.346 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-09-12T17:28:40.418 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:28:40.419 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:40.419 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T17:28:40.419 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:40.419 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:28:40.419 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-12 17:28:20.433673278 +0000 2024-09-12T17:28:40.419 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-12 17:26:04.582341049 +0000 2024-09-12T17:28:40.419 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-12 17:26:04.582341049 +0000 2024-09-12T17:28:40.420 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-12 17:26:04.582341049 +0000 2024-09-12T17:28:40.420 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:28:40.496 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-12T17:28:40.496 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-12T17:28:40.497 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000192841 s, 2.7 MB/s 2024-09-12T17:28:40.499 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:28:40.570 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:40.570 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:28:40.570 INFO:tasks.ceph:Generating config... 2024-09-12T17:28:40.571 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T17:28:40.571 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T17:28:40.571 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T17:28:40.571 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T17:28:40.571 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T17:28:40.571 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:28:40.572 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:28:40.572 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-12T17:28:40.572 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-12T17:28:40.572 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-12T17:28:40.572 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-12T17:28:40.572 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-12T17:28:40.572 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T17:28:40.572 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T17:28:40.572 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T17:28:40.573 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T17:28:40.573 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T17:28:40.573 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T17:28:40.573 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T17:28:40.573 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T17:28:40.573 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T17:28:40.573 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T17:28:40.573 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T17:28:40.573 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-12T17:28:40.573 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T17:28:40.573 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T17:28:40.573 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T17:28:40.573 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T17:28:40.574 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T17:28:40.574 INFO:tasks.ceph:[mon] lockdep = True 2024-09-12T17:28:40.574 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T17:28:40.574 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T17:28:40.574 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T17:28:40.574 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T17:28:40.574 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T17:28:40.574 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T17:28:40.574 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T17:28:40.574 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T17:28:40.574 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T17:28:40.574 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T17:28:40.575 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T17:28:40.575 INFO:tasks.ceph:[osd] lockdep = True 2024-09-12T17:28:40.575 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T17:28:40.575 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T17:28:40.575 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T17:28:40.575 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T17:28:40.575 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T17:28:40.575 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T17:28:40.575 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T17:28:40.575 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T17:28:40.643 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T17:28:40.646 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T17:28:40.703 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:28:40.742 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.107'), ('mon.c', '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]'), ('mon.b', '172.21.15.148')] 2024-09-12T17:28:40.742 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790],172.21.15.148', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T17:28:40.743 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:28:40.743 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:28:40.812 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.107 --addv c '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]' --add b 172.21.15.148 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:40.913 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:40.913 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:40.913 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:40.913 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: generated fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:28:40.913 INFO:teuthology.orchestra.run.smithi107.stdout:setting min_mon_release = quincy 2024-09-12T17:28:40.914 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 0 2024-09-12T17:28:40.914 INFO:teuthology.orchestra.run.smithi107.stdout:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:28:40.914 INFO:teuthology.orchestra.run.smithi107.stdout:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:28:40.914 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:28:40.914 INFO:teuthology.orchestra.run.smithi107.stdout:min_mon_release 17 (quincy) 2024-09-12T17:28:40.914 INFO:teuthology.orchestra.run.smithi107.stdout:election_strategy: 1 2024-09-12T17:28:40.914 INFO:teuthology.orchestra.run.smithi107.stdout:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:28:40.914 INFO:teuthology.orchestra.run.smithi107.stdout:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:28:40.914 INFO:teuthology.orchestra.run.smithi107.stdout:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:28:40.914 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T17:28:40.915 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:28:40.943 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2daf3ce0-18c7-480c-9839-5cd2a9722806... 2024-09-12T17:28:40.944 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:28:40.986 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:28:41.040 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-09-12T17:28:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-09-12T17:28:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-09-12T17:28:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-09-12T17:28:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790],172.21.15.148" 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: mon client directed command retry = 5 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: ms inject socket failures = 5000 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: rgw override bucket index max shards = 1 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-09-12T17:28:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug trim objects = true 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2024-09-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = bitmap 2024-09-12T17:28:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-09-12T17:28:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-09-12T17:28:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-09-12T17:28:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-09-12T17:28:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-12T17:28:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: debug objclass = 20 2024-09-12T17:28:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-09-12T17:28:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-09-12T17:28:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: lockdep = True 2024-09-12T17:28:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:28:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: osd shutdown pgref assert = True 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:28:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: lockdep = True 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:28:41.050 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = True 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: debug rgw = 20 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: debug rgw notification = 20 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: rgw bucket counters cache = True 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: rgw crypt require ssl = False 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T17:28:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T17:28:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: rgw max chunk size = 4194304 2024-09-12T17:28:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: rgw obj stripe size = 6291456 2024-09-12T17:28:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:28:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: rgw s3 auth use sts = True 2024-09-12T17:28:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:28:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: rgw torrent flag = True 2024-09-12T17:28:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: rgw user counters cache = True 2024-09-12T17:28:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: setgroup = ceph 2024-09-12T17:28:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: setuser = ceph 2024-09-12T17:28:41.052 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-09-12T17:28:41.052 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-09-12T17:28:41.052 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-09-12T17:28:41.053 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2024-09-12T17:28:41.053 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2024-09-12T17:28:41.053 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:28:41.053 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2024-09-12T17:28:41.053 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.053 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2024-09-12T17:28:41.053 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.053 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2024-09-12T17:28:41.053 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.054 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.055 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790],172.21.15.148" 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: mon client directed command retry = 5 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject socket failures = 5000 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:28:41.056 INFO:teuthology.orchestra.run.smithi148.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: rgw override bucket index max shards = 1 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2024-09-12T17:28:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug trim objects = true 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: bdev async discard = True 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: bdev enable discard = True 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore allocator = bitmap 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 1/20 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 1/20 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-12T17:28:41.059 INFO:teuthology.orchestra.run.smithi148.stdout: debug objclass = 20 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 4/10 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout: lockdep = True 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout: osd shutdown pgref assert = True 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-12T17:28:41.060 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:28:41.061 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:28:41.062 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: lockdep = True 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = True 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: debug rgw = 20 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: debug rgw notification = 20 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: rgw bucket counters cache = True 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: rgw crypt require ssl = False 2024-09-12T17:28:41.063 INFO:teuthology.orchestra.run.smithi148.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:28:41.064 INFO:teuthology.orchestra.run.smithi148.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:28:41.064 INFO:teuthology.orchestra.run.smithi148.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:28:41.064 INFO:teuthology.orchestra.run.smithi148.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T17:28:41.064 INFO:teuthology.orchestra.run.smithi148.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T17:28:41.064 INFO:teuthology.orchestra.run.smithi148.stdout: rgw max chunk size = 4194304 2024-09-12T17:28:41.064 INFO:teuthology.orchestra.run.smithi148.stdout: rgw obj stripe size = 6291456 2024-09-12T17:28:41.064 INFO:teuthology.orchestra.run.smithi148.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:28:41.064 INFO:teuthology.orchestra.run.smithi148.stdout: rgw s3 auth use sts = True 2024-09-12T17:28:41.064 INFO:teuthology.orchestra.run.smithi148.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:28:41.064 INFO:teuthology.orchestra.run.smithi148.stdout: rgw torrent flag = True 2024-09-12T17:28:41.065 INFO:teuthology.orchestra.run.smithi148.stdout: rgw user counters cache = True 2024-09-12T17:28:41.065 INFO:teuthology.orchestra.run.smithi148.stdout: setgroup = ceph 2024-09-12T17:28:41.065 INFO:teuthology.orchestra.run.smithi148.stdout: setuser = ceph 2024-09-12T17:28:41.065 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2024-09-12T17:28:41.065 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2024-09-12T17:28:41.065 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2024-09-12T17:28:41.066 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T17:28:41.067 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T17:28:41.134 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T17:28:41.134 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:28:41.134 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T17:28:41.163 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:28:41.163 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T17:28:41.231 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T17:28:41.231 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:28:41.231 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:28:41.231 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:28:41.318 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:28:41.319 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:41.389 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T17:28:41.389 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:28:41.389 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:28:41.389 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:28:41.438 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:28:41.439 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:41.509 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T17:28:41.509 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T17:28:41.510 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:28:41.575 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:28:41.577 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:28:41.653 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:28:41.655 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T17:28:41.656 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T17:28:41.656 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T17:28:41.710 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T17:28:41.723 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T17:28:41.778 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T17:28:41.791 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T17:28:41.791 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:28:41.791 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T17:28:41.829 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:41.829 INFO:tasks.ceph:role: osd.0 2024-09-12T17:28:41.829 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T17:28:41.829 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:28:41.914 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:28:41.915 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:41.915 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:41.915 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:28:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:41.915 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:42.435 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-12T17:28:42.437 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-12T17:28:42.437 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T17:28:42.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T17:28:42.588 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T17:28:42.627 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:42.627 INFO:tasks.ceph:role: osd.1 2024-09-12T17:28:42.627 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T17:28:42.627 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:28:42.714 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:42.714 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:42.714 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:42.714 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:28:42.714 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:42.714 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:42.714 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:42.714 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:28:42.715 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:42.715 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:43.175 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-12T17:28:43.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-12T17:28:43.177 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T17:28:43.240 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T17:28:43.283 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T17:28:43.362 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:43.362 INFO:tasks.ceph:role: osd.2 2024-09-12T17:28:43.362 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T17:28:43.362 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:28:43.449 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:43.449 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:43.449 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:43.449 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:28:43.449 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:43.450 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:43.450 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:43.450 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:28:43.450 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:43.450 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:43.935 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-12T17:28:43.937 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-12T17:28:43.937 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T17:28:44.027 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T17:28:44.068 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T17:28:44.147 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:44.147 INFO:tasks.ceph:role: osd.3 2024-09-12T17:28:44.147 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T17:28:44.147 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:28:44.233 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:44.234 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:44.234 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:44.234 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:28:44.234 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:44.234 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:44.234 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:44.234 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:28:44.234 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:44.234 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:44.746 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-09-12T17:28:44.748 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-09-12T17:28:44.748 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T17:28:44.855 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T17:28:44.897 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:45.034+0000 7f0c7fc2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T17:28:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:45.034+0000 7f0c7fc2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T17:28:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:45.034+0000 7f0c7fc2c640 -1 bdev(0x55a866cc3800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T17:28:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:45.034+0000 7f0c7fc2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T17:28:48.682 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T17:28:48.725 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:48.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:48.826+0000 7f0ba73cc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T17:28:48.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:48.827+0000 7f0ba73cc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T17:28:48.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:48.827+0000 7f0ba73cc640 -1 bdev(0x562298043800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T17:28:48.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:48.827+0000 7f0ba73cc640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T17:28:51.734 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T17:28:51.778 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:51.879+0000 7f0563231640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T17:28:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:51.879+0000 7f0563231640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T17:28:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:51.879+0000 7f0563231640 -1 bdev(0x556852499800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T17:28:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:51.880+0000 7f0563231640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T17:28:54.807 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T17:28:54.847 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:54.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:54.947+0000 7fde7ca1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T17:28:54.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:54.947+0000 7fde7ca1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T17:28:54.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:54.947+0000 7fde7ca1e640 -1 bdev(0x55a682eeb800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T17:28:54.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:28:54.947+0000 7fde7ca1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T17:28:57.857 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T17:28:57.901 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T17:28:57.951 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:57.951 INFO:tasks.ceph:role: osd.4 2024-09-12T17:28:57.951 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T17:28:57.951 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:58.001 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:58.001 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:28:58.001 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:58.001 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:58.517 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-09-12T17:28:58.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-09-12T17:28:58.519 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T17:28:58.630 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T17:28:58.680 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T17:28:58.719 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:58.719 INFO:tasks.ceph:role: osd.5 2024-09-12T17:28:58.719 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T17:28:58.719 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:28:58.807 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:58.807 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:58.807 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:58.807 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:28:58.807 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:58.808 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:58.808 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:58.808 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:28:58.808 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:58.808 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:59.262 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-09-12T17:28:59.264 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-09-12T17:28:59.264 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T17:28:59.330 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T17:28:59.373 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T17:28:59.454 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:59.454 INFO:tasks.ceph:role: osd.6 2024-09-12T17:28:59.455 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T17:28:59.455 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:28:59.541 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:59.541 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:59.541 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:59.541 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:28:59.541 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:59.541 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:59.541 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:59.542 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:28:59.542 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:59.542 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:29:00.028 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-09-12T17:29:00.030 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-09-12T17:29:00.030 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T17:29:00.147 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T17:29:00.192 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T17:29:00.230 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:29:00.230 INFO:tasks.ceph:role: osd.7 2024-09-12T17:29:00.230 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T17:29:00.230 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:29:00.316 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:29:00.316 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:29:00.316 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:29:00.317 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:29:00.317 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:29:00.317 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:29:00.317 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:29:00.317 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:29:00.317 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:29:00.317 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:29:00.848 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-09-12T17:29:00.850 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-09-12T17:29:00.850 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T17:29:00.965 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T17:29:01.011 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:29:01.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:01.096+0000 7f29d4aef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T17:29:01.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:01.096+0000 7f29d4aef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T17:29:01.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:01.096+0000 7f29d4aef640 -1 bdev(0x5635730c9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T17:29:01.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:01.096+0000 7f29d4aef640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T17:29:04.752 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T17:29:04.797 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:29:04.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:04.899+0000 7f57f63c5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T17:29:04.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:04.899+0000 7f57f63c5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T17:29:04.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:04.899+0000 7f57f63c5640 -1 bdev(0x5647fdc6b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T17:29:04.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:04.899+0000 7f57f63c5640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T17:29:07.815 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T17:29:07.860 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:29:07.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:07.921+0000 7f5f92026640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T17:29:07.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:07.922+0000 7f5f92026640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T17:29:07.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:07.922+0000 7f5f92026640 -1 bdev(0x55e4aa5bb800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T17:29:07.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:07.922+0000 7f5f92026640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T17:29:11.330 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T17:29:11.373 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:29:11.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:11.473+0000 7f7e8d4fe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T17:29:11.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:11.474+0000 7f7e8d4fe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T17:29:11.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:11.474+0000 7f7e8d4fe640 -1 bdev(0x55e0358df800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T17:29:11.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T17:29:11.474+0000 7f7e8d4fe640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T17:29:14.385 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T17:29:14.425 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T17:29:14.425 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:29:14.425 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T17:29:14.471 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:29:14.471 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T17:29:14.554 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:29:14.554 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T17:29:14.636 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:29:14.636 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T17:29:14.716 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:29:14.716 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T17:29:14.798 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:29:14.798 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T17:29:14.838 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:29:14.839 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T17:29:14.920 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:29:14.920 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T17:29:14.999 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:29:14.999 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T17:29:15.077 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:29:15.077 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T17:29:15.156 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:29:15.156 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T17:29:15.186 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:29:15.186 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T17:29:15.225 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T17:29:15.225 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:29:15.228 DEBUG:teuthology.orchestra.run.smithi148:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:29:15.268 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2024-09-12T17:29:15.268 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDJJONmttFGIhAAo/tU/ZQtmDgK3YRHTsVzHA== 2024-09-12T17:29:15.269 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-09-12T17:29:15.269 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDNJONmBCAdAhAAWiAY4hppDAn+ebfW49v1ZA== 2024-09-12T17:29:15.269 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-09-12T17:29:15.269 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDQJONmh7lYMRAAjhQYYXF4DNluJT8OGudw2g== 2024-09-12T17:29:15.269 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-09-12T17:29:15.269 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDTJONmhLl+NBAAlV7D9zs+EG8xCqdZhoFLXQ== 2024-09-12T17:29:15.269 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-09-12T17:29:15.269 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDWJONmobyJOBAAFIhdH+LjpNy4+cfoNVe3jg== 2024-09-12T17:29:15.269 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-09-12T17:29:15.269 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDJJONmHanuJhAAq4S4SUwygdQ3tq2tI0Z6qA== 2024-09-12T17:29:15.270 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2024-09-12T17:29:15.270 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDdJONm8OPKBRAAz/r2xcLyIxSPy4bBprdgMA== 2024-09-12T17:29:15.270 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2024-09-12T17:29:15.270 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDgJONmaUemNRAA9zg2QfRzXosDuTF2thtv0g== 2024-09-12T17:29:15.270 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2024-09-12T17:29:15.270 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDjJONmHNIANxAA3+v86Bv45TQ4X2WR3YyxPA== 2024-09-12T17:29:15.270 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2024-09-12T17:29:15.270 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDnJONm2fpLHBAAASBpwqgM+LBGTcyk9MeaRA== 2024-09-12T17:29:15.270 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-09-12T17:29:15.271 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDJJONmiO9aKhAAy+Rcd2ZAF94btroP36ndEA== 2024-09-12T17:29:15.271 INFO:teuthology.orchestra.run.smithi107.stdout:[client.1] 2024-09-12T17:29:15.271 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDJJONm03pdLhAA/zksOLkLPz39LaipbisQYQ== 2024-09-12T17:29:15.302 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.y] 2024-09-12T17:29:15.302 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDJJONmttFGIhAAo/tU/ZQtmDgK3YRHTsVzHA== 2024-09-12T17:29:15.302 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.0] 2024-09-12T17:29:15.302 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDNJONmBCAdAhAAWiAY4hppDAn+ebfW49v1ZA== 2024-09-12T17:29:15.302 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.1] 2024-09-12T17:29:15.302 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDQJONmh7lYMRAAjhQYYXF4DNluJT8OGudw2g== 2024-09-12T17:29:15.302 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.2] 2024-09-12T17:29:15.302 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDTJONmhLl+NBAAlV7D9zs+EG8xCqdZhoFLXQ== 2024-09-12T17:29:15.302 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.3] 2024-09-12T17:29:15.303 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDWJONmobyJOBAAFIhdH+LjpNy4+cfoNVe3jg== 2024-09-12T17:29:15.303 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.x] 2024-09-12T17:29:15.303 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDJJONmHanuJhAAq4S4SUwygdQ3tq2tI0Z6qA== 2024-09-12T17:29:15.303 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.4] 2024-09-12T17:29:15.303 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDdJONm8OPKBRAAz/r2xcLyIxSPy4bBprdgMA== 2024-09-12T17:29:15.303 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.5] 2024-09-12T17:29:15.303 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDgJONmaUemNRAA9zg2QfRzXosDuTF2thtv0g== 2024-09-12T17:29:15.303 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.6] 2024-09-12T17:29:15.303 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDjJONmHNIANxAA3+v86Bv45TQ4X2WR3YyxPA== 2024-09-12T17:29:15.303 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.7] 2024-09-12T17:29:15.303 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDnJONm2fpLHBAAASBpwqgM+LBGTcyk9MeaRA== 2024-09-12T17:29:15.303 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2024-09-12T17:29:15.304 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDJJONmiO9aKhAAy+Rcd2ZAF94btroP36ndEA== 2024-09-12T17:29:15.304 INFO:teuthology.orchestra.run.smithi148.stdout:[client.1] 2024-09-12T17:29:15.304 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDJJONm03pdLhAA/zksOLkLPz39LaipbisQYQ== 2024-09-12T17:29:15.305 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:29:15.314 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:29:15.409 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.412 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.477 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.479 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.544 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.546 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.610 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.613 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:29:15.680 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:29:15.744 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.746 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.813 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.815 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.879 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.882 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.946 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:15.948 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:16.012 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:29:16.015 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:29:16.082 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:29:16.084 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:29:16.152 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T17:29:16.153 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T17:29:16.192 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:29:16.301 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T17:29:16.340 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T17:29:16.418 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:29:16.527 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T17:29:16.565 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T17:29:16.605 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:29:16.715 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T17:29:16.754 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:29:16.757 DEBUG:teuthology.orchestra.run.smithi148:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:29:16.822 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T17:29:16.823 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T17:29:16.823 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T17:29:16.826 INFO:tasks.ceph.mon.a:Started 2024-09-12T17:29:16.826 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T17:29:16.826 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T17:29:16.828 INFO:tasks.ceph.mon.c:Started 2024-09-12T17:29:16.828 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T17:29:16.828 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T17:29:16.865 INFO:tasks.ceph.mon.b:Started 2024-09-12T17:29:16.866 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T17:29:16.866 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T17:29:16.866 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T17:29:16.868 INFO:tasks.ceph.mgr.y:Started 2024-09-12T17:29:16.868 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T17:29:16.868 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T17:29:16.870 INFO:tasks.ceph.mgr.x:Started 2024-09-12T17:29:16.870 DEBUG:tasks.ceph:set 0 configs 2024-09-12T17:29:16.871 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T17:29:16.871 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T17:29:22.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:22.374+0000 7f3374fda640 0 --2- 172.21.15.107:0/2291252980 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3360003aa0 0x7f33700afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:29:22.447 INFO:teuthology.orchestra.run.smithi107.stderr:adjusted tunables profile to default 2024-09-12T17:29:22.458 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T17:29:22.458 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T17:29:22.459 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:29:22.459 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T17:29:22.497 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:29:22.497 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T17:29:22.575 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:29:22.576 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T17:29:22.654 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:29:22.654 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T17:29:22.733 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:29:22.733 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T17:29:22.774 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:29:22.775 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T17:29:22.854 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:29:22.854 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T17:29:22.934 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T17:29:22.934 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T17:29:23.012 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 1b2dec4b-cd90-4710-a263-5068d2e36152 0 2024-09-12T17:29:23.253 INFO:teuthology.orchestra.run.smithi148.stdout:0 2024-09-12T17:29:23.265 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new ba046ff3-6ade-435c-8f5d-9408f064cdc3 1 2024-09-12T17:29:23.466 INFO:teuthology.orchestra.run.smithi148.stdout:1 2024-09-12T17:29:23.477 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 5584d09f-df0b-4dcc-974f-feed64c92e5c 2 2024-09-12T17:29:23.676 INFO:teuthology.orchestra.run.smithi148.stdout:2 2024-09-12T17:29:23.687 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 62030820-39f3-41fb-9eee-32a712bd5583 3 2024-09-12T17:29:23.888 INFO:teuthology.orchestra.run.smithi148.stdout:3 2024-09-12T17:29:23.899 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new f4e12c76-7b48-417f-9008-e761665ea4e6 4 2024-09-12T17:29:24.099 INFO:teuthology.orchestra.run.smithi148.stdout:4 2024-09-12T17:29:24.110 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new ff4b02f8-504d-49a0-a7d6-15d2ea28c0e8 5 2024-09-12T17:29:24.305 INFO:teuthology.orchestra.run.smithi148.stdout:5 2024-09-12T17:29:24.316 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 3a6b4985-a112-4e19-b2f4-52b8c022b17e 6 2024-09-12T17:29:24.513 INFO:teuthology.orchestra.run.smithi148.stdout:6 2024-09-12T17:29:24.524 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new ccbe261e-8c61-4663-a1da-5f946f573e94 7 2024-09-12T17:29:24.721 INFO:teuthology.orchestra.run.smithi148.stdout:7 2024-09-12T17:29:24.732 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T17:29:24.733 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T17:29:24.735 INFO:tasks.ceph.osd.0:Started 2024-09-12T17:29:24.735 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T17:29:24.735 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T17:29:24.737 INFO:tasks.ceph.osd.1:Started 2024-09-12T17:29:24.737 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T17:29:24.738 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T17:29:24.740 INFO:tasks.ceph.osd.2:Started 2024-09-12T17:29:24.740 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T17:29:24.740 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T17:29:24.743 INFO:tasks.ceph.osd.3:Started 2024-09-12T17:29:24.743 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T17:29:24.743 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T17:29:24.746 INFO:tasks.ceph.osd.4:Started 2024-09-12T17:29:24.746 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T17:29:24.746 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T17:29:24.748 INFO:tasks.ceph.osd.5:Started 2024-09-12T17:29:24.749 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T17:29:24.749 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T17:29:24.753 INFO:tasks.ceph.osd.6:Started 2024-09-12T17:29:24.753 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T17:29:24.753 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T17:29:24.756 INFO:tasks.ceph.osd.7:Started 2024-09-12T17:29:24.756 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:29:24.961 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:29:24.962 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":10,"fsid":"2daf3ce0-18c7-480c-9839-5cd2a9722806","created":"2024-09-12T17:29:22.150626+0000","modified":"2024-09-12T17:29:24.719113+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:29:24.719113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1b2dec4b-cd90-4710-a263-5068d2e36152","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ba046ff3-6ade-435c-8f5d-9408f064cdc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5584d09f-df0b-4dcc-974f-feed64c92e5c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"62030820-39f3-41fb-9eee-32a712bd5583","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f4e12c76-7b48-417f-9008-e761665ea4e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ff4b02f8-504d-49a0-a7d6-15d2ea28c0e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3a6b4985-a112-4e19-b2f4-52b8c022b17e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ccbe261e-8c61-4663-a1da-5f946f573e94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:29:24.972 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T17:29:24.972 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T17:29:25.779 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:29:25.951 INFO:teuthology.misc.health.smithi107.stdout: 2024-09-12T17:29:25.951 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":10,"fsid":"2daf3ce0-18c7-480c-9839-5cd2a9722806","created":"2024-09-12T17:29:22.150626+0000","modified":"2024-09-12T17:29:24.719113+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:29:24.719113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1b2dec4b-cd90-4710-a263-5068d2e36152","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ba046ff3-6ade-435c-8f5d-9408f064cdc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5584d09f-df0b-4dcc-974f-feed64c92e5c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"62030820-39f3-41fb-9eee-32a712bd5583","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f4e12c76-7b48-417f-9008-e761665ea4e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ff4b02f8-504d-49a0-a7d6-15d2ea28c0e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3a6b4985-a112-4e19-b2f4-52b8c022b17e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ccbe261e-8c61-4663-a1da-5f946f573e94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:29:25.959 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T17:29:25.958+0000 7fc7f3d89640 -1 Falling back to public interface 2024-09-12T17:29:25.961 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:29:26.068 INFO:tasks.ceph.osd.5.smithi148.stderr:2024-09-12T17:29:26.066+0000 7fcd575b2640 -1 Falling back to public interface 2024-09-12T17:29:26.506 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-09-12T17:29:26.504+0000 7f0682040640 -1 Falling back to public interface 2024-09-12T17:29:26.518 INFO:tasks.ceph.osd.6.smithi148.stderr:2024-09-12T17:29:26.516+0000 7f348dd43640 -1 Falling back to public interface 2024-09-12T17:29:26.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-09-12T17:29:26.525+0000 7fdd64c0d640 -1 Falling back to public interface 2024-09-12T17:29:26.543 INFO:tasks.ceph.osd.7.smithi148.stderr:2024-09-12T17:29:26.541+0000 7fdedfc0c640 -1 Falling back to public interface 2024-09-12T17:29:26.545 INFO:tasks.ceph.osd.4.smithi148.stderr:2024-09-12T17:29:26.544+0000 7fa88fd19640 -1 Falling back to public interface 2024-09-12T17:29:26.745 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-09-12T17:29:26.743+0000 7f41db433640 -1 Falling back to public interface 2024-09-12T17:29:27.453 INFO:tasks.ceph.mgr.x.smithi148.stderr:2024-09-12T17:29:27.451+0000 7f8cfce86640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T17:29:27.453 INFO:tasks.ceph.mgr.x.smithi148.stderr:2024-09-12T17:29:27.451+0000 7f8cfce86640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T17:29:29.599 INFO:tasks.ceph.osd.5.smithi148.stderr:2024-09-12T17:29:29.597+0000 7fcd575b2640 -1 osd.5 0 log_to_monitors true 2024-09-12T17:29:29.789 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T17:29:29.787+0000 7fc7f3d89640 -1 osd.0 0 log_to_monitors true 2024-09-12T17:29:30.019 INFO:tasks.ceph.osd.6.smithi148.stderr:2024-09-12T17:29:30.017+0000 7f348dd43640 -1 osd.6 0 log_to_monitors true 2024-09-12T17:29:30.281 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-09-12T17:29:30.280+0000 7f0682040640 -1 osd.3 0 log_to_monitors true 2024-09-12T17:29:30.357 INFO:tasks.ceph.osd.4.smithi148.stderr:2024-09-12T17:29:30.355+0000 7fa88fd19640 -1 osd.4 0 log_to_monitors true 2024-09-12T17:29:30.501 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-09-12T17:29:30.499+0000 7f41db433640 -1 osd.2 0 log_to_monitors true 2024-09-12T17:29:30.580 INFO:tasks.ceph.osd.7.smithi148.stderr:2024-09-12T17:29:30.578+0000 7fdedfc0c640 -1 osd.7 0 log_to_monitors true 2024-09-12T17:29:30.827 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-09-12T17:29:30.826+0000 7fdd64c0d640 -1 osd.1 0 log_to_monitors true 2024-09-12T17:29:32.768 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:29:32.881 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T17:29:32.879+0000 7fc7f0531640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:29:32.891 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-09-12T17:29:32.890+0000 7f067e7e8640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T17:29:32.903 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T17:29:32.902+0000 7fc7e7b3c640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:32.925 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-09-12T17:29:32.924+0000 7f0675df3640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:33.133 INFO:teuthology.misc.health.smithi107.stdout: 2024-09-12T17:29:33.133 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":13,"fsid":"2daf3ce0-18c7-480c-9839-5cd2a9722806","created":"2024-09-12T17:29:22.150626+0000","modified":"2024-09-12T17:29:32.460278+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:29:24.719113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1b2dec4b-cd90-4710-a263-5068d2e36152","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ba046ff3-6ade-435c-8f5d-9408f064cdc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5584d09f-df0b-4dcc-974f-feed64c92e5c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"62030820-39f3-41fb-9eee-32a712bd5583","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f4e12c76-7b48-417f-9008-e761665ea4e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ff4b02f8-504d-49a0-a7d6-15d2ea28c0e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3a6b4985-a112-4e19-b2f4-52b8c022b17e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ccbe261e-8c61-4663-a1da-5f946f573e94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:29:33.145 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:29:33.271 INFO:tasks.ceph.osd.6.smithi148.stderr:2024-09-12T17:29:33.270+0000 7f3489cd7640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T17:29:33.287 INFO:tasks.ceph.osd.6.smithi148.stderr:2024-09-12T17:29:33.285+0000 7f3481af6640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:33.291 INFO:tasks.ceph.osd.4.smithi148.stderr:2024-09-12T17:29:33.290+0000 7fa88bcad640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T17:29:33.304 INFO:tasks.ceph.osd.4.smithi148.stderr:2024-09-12T17:29:33.303+0000 7fa883acc640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:33.334 INFO:tasks.ceph.osd.5.smithi148.stderr:2024-09-12T17:29:33.332+0000 7fcd53546640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T17:29:33.346 INFO:tasks.ceph.osd.5.smithi148.stderr:2024-09-12T17:29:33.345+0000 7fcd4b365640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:33.572 INFO:tasks.ceph.osd.7.smithi148.stderr:2024-09-12T17:29:33.571+0000 7fdedb523640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T17:29:33.586 INFO:tasks.ceph.osd.7.smithi148.stderr:2024-09-12T17:29:33.585+0000 7fded3342640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:33.772 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-09-12T17:29:33.771+0000 7f41d7bdb640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T17:29:33.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-09-12T17:29:33.781+0000 7fdd60621640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T17:29:33.786 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-09-12T17:29:33.785+0000 7f41cf1e6640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:33.796 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-09-12T17:29:33.796+0000 7fdd58440640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:39.952 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:29:40.253 INFO:teuthology.misc.health.smithi107.stdout: 2024-09-12T17:29:40.253 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":17,"fsid":"2daf3ce0-18c7-480c-9839-5cd2a9722806","created":"2024-09-12T17:29:22.150626+0000","modified":"2024-09-12T17:29:36.903782+0000","last_up_change":"2024-09-12T17:29:33.895471+0000","last_in_change":"2024-09-12T17:29:24.719113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:29:34.460317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b2dec4b-cd90-4710-a263-5068d2e36152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6801","nonce":3240254390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6803","nonce":3240254390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6807","nonce":3240254390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6805","nonce":3240254390}]},"public_addr":"172.21.15.107:6801/3240254390","cluster_addr":"172.21.15.107:6803/3240254390","heartbeat_back_addr":"172.21.15.107:6807/3240254390","heartbeat_front_addr":"172.21.15.107:6805/3240254390","state":["exists","up"]},{"osd":1,"uuid":"ba046ff3-6ade-435c-8f5d-9408f064cdc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6817","nonce":1403347761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6819","nonce":1403347761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6823","nonce":1403347761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6821","nonce":1403347761}]},"public_addr":"172.21.15.107:6817/1403347761","cluster_addr":"172.21.15.107:6819/1403347761","heartbeat_back_addr":"172.21.15.107:6823/1403347761","heartbeat_front_addr":"172.21.15.107:6821/1403347761","state":["exists","up"]},{"osd":2,"uuid":"5584d09f-df0b-4dcc-974f-feed64c92e5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6825","nonce":1525535229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6827","nonce":1525535229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6831","nonce":1525535229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6829","nonce":1525535229}]},"public_addr":"172.21.15.107:6825/1525535229","cluster_addr":"172.21.15.107:6827/1525535229","heartbeat_back_addr":"172.21.15.107:6831/1525535229","heartbeat_front_addr":"172.21.15.107:6829/1525535229","state":["exists","up"]},{"osd":3,"uuid":"62030820-39f3-41fb-9eee-32a712bd5583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6809","nonce":3471033075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6811","nonce":3471033075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6815","nonce":3471033075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6813","nonce":3471033075}]},"public_addr":"172.21.15.107:6809/3471033075","cluster_addr":"172.21.15.107:6811/3471033075","heartbeat_back_addr":"172.21.15.107:6815/3471033075","heartbeat_front_addr":"172.21.15.107:6813/3471033075","state":["exists","up"]},{"osd":4,"uuid":"f4e12c76-7b48-417f-9008-e761665ea4e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6827","nonce":3050464724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6829","nonce":3050464724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6833","nonce":3050464724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6831","nonce":3050464724}]},"public_addr":"172.21.15.148:6827/3050464724","cluster_addr":"172.21.15.148:6829/3050464724","heartbeat_back_addr":"172.21.15.148:6833/3050464724","heartbeat_front_addr":"172.21.15.148:6831/3050464724","state":["exists","up"]},{"osd":5,"uuid":"ff4b02f8-504d-49a0-a7d6-15d2ea28c0e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6801","nonce":18671776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6803","nonce":18671776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6807","nonce":18671776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6805","nonce":18671776}]},"public_addr":"172.21.15.148:6801/18671776","cluster_addr":"172.21.15.148:6803/18671776","heartbeat_back_addr":"172.21.15.148:6807/18671776","heartbeat_front_addr":"172.21.15.148:6805/18671776","state":["exists","up"]},{"osd":6,"uuid":"3a6b4985-a112-4e19-b2f4-52b8c022b17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6811","nonce":1396481160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6813","nonce":1396481160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6817","nonce":1396481160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6815","nonce":1396481160}]},"public_addr":"172.21.15.148:6811/1396481160","cluster_addr":"172.21.15.148:6813/1396481160","heartbeat_back_addr":"172.21.15.148:6817/1396481160","heartbeat_front_addr":"172.21.15.148:6815/1396481160","state":["exists","up"]},{"osd":7,"uuid":"ccbe261e-8c61-4663-a1da-5f946f573e94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6819","nonce":357097900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6821","nonce":357097900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6825","nonce":357097900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6823","nonce":357097900}]},"public_addr":"172.21.15.148:6819/357097900","cluster_addr":"172.21.15.148:6821/357097900","heartbeat_back_addr":"172.21.15.148:6825/357097900","heartbeat_front_addr":"172.21.15.148:6823/357097900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:30.807179+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.834326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.471666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.296209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.311282+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:30.638501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.052514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.582204+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:29:40.264 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T17:29:40.264 INFO:tasks.ceph:Creating RBD pool 2024-09-12T17:29:40.265 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T17:29:40.951 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'rbd' created 2024-09-12T17:29:40.965 DEBUG:teuthology.orchestra.run.smithi107:> rbd --cluster ceph pool init rbd 2024-09-12T17:29:41.027 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:41.027 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:43.986 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:29:43.987 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:29:43.987 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:29:44.294 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:29:44.306 INFO:teuthology.orchestra.run.smithi107.stdout:[{"version":9,"timestamp":"2024-09-12T17:29:33.783080+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"6552.044086"}]}] 2024-09-12T17:29:44.307 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T17:29:44.307 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:29:44.307 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:29:44.307 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:29:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:29:44.667 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":5,"flags":0,"active_gid":4114,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":4088825946},{"type":"v1","addr":"172.21.15.148:6809","nonce":4088825946}]},"active_addr":"172.21.15.148:6809/4088825946","active_change":"2024-09-12T17:29:26.437672+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4098,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":166236842}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":3256587498}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":709513959}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":3208736784}]}]} 2024-09-12T17:29:44.672 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:29:44.672 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:29:44.672 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:29:44.971 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:29:44.971 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"2daf3ce0-18c7-480c-9839-5cd2a9722806","created":"2024-09-12T17:29:22.150626+0000","modified":"2024-09-12T17:29:43.963077+0000","last_up_change":"2024-09-12T17:29:33.895471+0000","last_in_change":"2024-09-12T17:29:24.719113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:29:34.460317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:29:40.565279+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b2dec4b-cd90-4710-a263-5068d2e36152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6801","nonce":3240254390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6803","nonce":3240254390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6807","nonce":3240254390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6805","nonce":3240254390}]},"public_addr":"172.21.15.107:6801/3240254390","cluster_addr":"172.21.15.107:6803/3240254390","heartbeat_back_addr":"172.21.15.107:6807/3240254390","heartbeat_front_addr":"172.21.15.107:6805/3240254390","state":["exists","up"]},{"osd":1,"uuid":"ba046ff3-6ade-435c-8f5d-9408f064cdc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6817","nonce":1403347761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6819","nonce":1403347761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6823","nonce":1403347761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6821","nonce":1403347761}]},"public_addr":"172.21.15.107:6817/1403347761","cluster_addr":"172.21.15.107:6819/1403347761","heartbeat_back_addr":"172.21.15.107:6823/1403347761","heartbeat_front_addr":"172.21.15.107:6821/1403347761","state":["exists","up"]},{"osd":2,"uuid":"5584d09f-df0b-4dcc-974f-feed64c92e5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6825","nonce":1525535229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6827","nonce":1525535229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6831","nonce":1525535229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6829","nonce":1525535229}]},"public_addr":"172.21.15.107:6825/1525535229","cluster_addr":"172.21.15.107:6827/1525535229","heartbeat_back_addr":"172.21.15.107:6831/1525535229","heartbeat_front_addr":"172.21.15.107:6829/1525535229","state":["exists","up"]},{"osd":3,"uuid":"62030820-39f3-41fb-9eee-32a712bd5583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6809","nonce":3471033075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6811","nonce":3471033075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6815","nonce":3471033075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6813","nonce":3471033075}]},"public_addr":"172.21.15.107:6809/3471033075","cluster_addr":"172.21.15.107:6811/3471033075","heartbeat_back_addr":"172.21.15.107:6815/3471033075","heartbeat_front_addr":"172.21.15.107:6813/3471033075","state":["exists","up"]},{"osd":4,"uuid":"f4e12c76-7b48-417f-9008-e761665ea4e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6827","nonce":3050464724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6829","nonce":3050464724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6833","nonce":3050464724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6831","nonce":3050464724}]},"public_addr":"172.21.15.148:6827/3050464724","cluster_addr":"172.21.15.148:6829/3050464724","heartbeat_back_addr":"172.21.15.148:6833/3050464724","heartbeat_front_addr":"172.21.15.148:6831/3050464724","state":["exists","up"]},{"osd":5,"uuid":"ff4b02f8-504d-49a0-a7d6-15d2ea28c0e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6801","nonce":18671776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6803","nonce":18671776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6807","nonce":18671776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6805","nonce":18671776}]},"public_addr":"172.21.15.148:6801/18671776","cluster_addr":"172.21.15.148:6803/18671776","heartbeat_back_addr":"172.21.15.148:6807/18671776","heartbeat_front_addr":"172.21.15.148:6805/18671776","state":["exists","up"]},{"osd":6,"uuid":"3a6b4985-a112-4e19-b2f4-52b8c022b17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6811","nonce":1396481160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6813","nonce":1396481160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6817","nonce":1396481160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6815","nonce":1396481160}]},"public_addr":"172.21.15.148:6811/1396481160","cluster_addr":"172.21.15.148:6813/1396481160","heartbeat_back_addr":"172.21.15.148:6817/1396481160","heartbeat_front_addr":"172.21.15.148:6815/1396481160","state":["exists","up"]},{"osd":7,"uuid":"ccbe261e-8c61-4663-a1da-5f946f573e94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6819","nonce":357097900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6821","nonce":357097900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6825","nonce":357097900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6823","nonce":357097900}]},"public_addr":"172.21.15.148:6819/357097900","cluster_addr":"172.21.15.148:6821/357097900","heartbeat_back_addr":"172.21.15.148:6825/357097900","heartbeat_front_addr":"172.21.15.148:6823/357097900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:30.807179+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.834326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.471666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.296209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.311282+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:30.638501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.052514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.582204+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:29:44.984 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:29:44.985 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:29:45.282 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:29:45.282 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":21,"fsid":"2daf3ce0-18c7-480c-9839-5cd2a9722806","created":"2024-09-12T17:29:22.150626+0000","modified":"2024-09-12T17:29:43.963077+0000","last_up_change":"2024-09-12T17:29:33.895471+0000","last_in_change":"2024-09-12T17:29:24.719113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:29:34.460317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:29:40.565279+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b2dec4b-cd90-4710-a263-5068d2e36152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6801","nonce":3240254390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6803","nonce":3240254390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6807","nonce":3240254390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6805","nonce":3240254390}]},"public_addr":"172.21.15.107:6801/3240254390","cluster_addr":"172.21.15.107:6803/3240254390","heartbeat_back_addr":"172.21.15.107:6807/3240254390","heartbeat_front_addr":"172.21.15.107:6805/3240254390","state":["exists","up"]},{"osd":1,"uuid":"ba046ff3-6ade-435c-8f5d-9408f064cdc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6817","nonce":1403347761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6819","nonce":1403347761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6823","nonce":1403347761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6821","nonce":1403347761}]},"public_addr":"172.21.15.107:6817/1403347761","cluster_addr":"172.21.15.107:6819/1403347761","heartbeat_back_addr":"172.21.15.107:6823/1403347761","heartbeat_front_addr":"172.21.15.107:6821/1403347761","state":["exists","up"]},{"osd":2,"uuid":"5584d09f-df0b-4dcc-974f-feed64c92e5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6825","nonce":1525535229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6827","nonce":1525535229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6831","nonce":1525535229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6829","nonce":1525535229}]},"public_addr":"172.21.15.107:6825/1525535229","cluster_addr":"172.21.15.107:6827/1525535229","heartbeat_back_addr":"172.21.15.107:6831/1525535229","heartbeat_front_addr":"172.21.15.107:6829/1525535229","state":["exists","up"]},{"osd":3,"uuid":"62030820-39f3-41fb-9eee-32a712bd5583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6809","nonce":3471033075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6811","nonce":3471033075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6815","nonce":3471033075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6813","nonce":3471033075}]},"public_addr":"172.21.15.107:6809/3471033075","cluster_addr":"172.21.15.107:6811/3471033075","heartbeat_back_addr":"172.21.15.107:6815/3471033075","heartbeat_front_addr":"172.21.15.107:6813/3471033075","state":["exists","up"]},{"osd":4,"uuid":"f4e12c76-7b48-417f-9008-e761665ea4e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6827","nonce":3050464724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6829","nonce":3050464724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6833","nonce":3050464724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6831","nonce":3050464724}]},"public_addr":"172.21.15.148:6827/3050464724","cluster_addr":"172.21.15.148:6829/3050464724","heartbeat_back_addr":"172.21.15.148:6833/3050464724","heartbeat_front_addr":"172.21.15.148:6831/3050464724","state":["exists","up"]},{"osd":5,"uuid":"ff4b02f8-504d-49a0-a7d6-15d2ea28c0e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6801","nonce":18671776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6803","nonce":18671776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6807","nonce":18671776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6805","nonce":18671776}]},"public_addr":"172.21.15.148:6801/18671776","cluster_addr":"172.21.15.148:6803/18671776","heartbeat_back_addr":"172.21.15.148:6807/18671776","heartbeat_front_addr":"172.21.15.148:6805/18671776","state":["exists","up"]},{"osd":6,"uuid":"3a6b4985-a112-4e19-b2f4-52b8c022b17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6811","nonce":1396481160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6813","nonce":1396481160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6817","nonce":1396481160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6815","nonce":1396481160}]},"public_addr":"172.21.15.148:6811/1396481160","cluster_addr":"172.21.15.148:6813/1396481160","heartbeat_back_addr":"172.21.15.148:6817/1396481160","heartbeat_front_addr":"172.21.15.148:6815/1396481160","state":["exists","up"]},{"osd":7,"uuid":"ccbe261e-8c61-4663-a1da-5f946f573e94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6819","nonce":357097900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6821","nonce":357097900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6825","nonce":357097900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6823","nonce":357097900}]},"public_addr":"172.21.15.148:6819/357097900","cluster_addr":"172.21.15.148:6821/357097900","heartbeat_back_addr":"172.21.15.148:6825/357097900","heartbeat_front_addr":"172.21.15.148:6823/357097900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:30.807179+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.834326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.471666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.296209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.311282+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:30.638501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.052514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.582204+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:29:45.296 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:29:45.296 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:29:45.301 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:29:45.301 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:29:45.301 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T17:29:45.302 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T17:29:45.302 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T17:29:45.302 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi107.stdout:60129542149 2024-09-12T17:29:45.539 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi107.stdout:60129542150 2024-09-12T17:29:45.545 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:29:45.551 INFO:teuthology.orchestra.run.smithi107.stdout:60129542150 2024-09-12T17:29:45.552 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:29:45.559 INFO:teuthology.orchestra.run.smithi107.stdout:60129542151 2024-09-12T17:29:45.559 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:29:45.563 INFO:teuthology.orchestra.run.smithi107.stdout:60129542150 2024-09-12T17:29:45.563 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:29:45.564 INFO:teuthology.orchestra.run.smithi107.stdout:60129542150 2024-09-12T17:29:45.565 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:29:45.566 INFO:teuthology.orchestra.run.smithi107.stdout:60129542150 2024-09-12T17:29:45.566 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:29:45.756 INFO:teuthology.orchestra.run.smithi107.stdout:60129542150 2024-09-12T17:29:45.756 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:29:46.106 INFO:teuthology.orchestra.run.smithi107.stdout:60129542147 2024-09-12T17:29:46.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.3 2024-09-12T17:29:46.137 INFO:teuthology.orchestra.run.smithi107.stdout:60129542148 2024-09-12T17:29:46.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.6 2024-09-12T17:29:46.169 INFO:teuthology.orchestra.run.smithi107.stdout:60129542148 2024-09-12T17:29:46.170 INFO:teuthology.orchestra.run.smithi107.stdout:60129542148 2024-09-12T17:29:46.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.2 2024-09-12T17:29:46.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.0 2024-09-12T17:29:46.188 INFO:teuthology.orchestra.run.smithi107.stdout:60129542148 2024-09-12T17:29:46.196 INFO:teuthology.orchestra.run.smithi107.stdout:60129542149 2024-09-12T17:29:46.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.5 2024-09-12T17:29:46.205 INFO:teuthology.orchestra.run.smithi107.stdout:60129542148 2024-09-12T17:29:46.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.4 2024-09-12T17:29:46.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.7 2024-09-12T17:29:46.247 INFO:teuthology.orchestra.run.smithi107.stdout:60129542148 2024-09-12T17:29:46.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.1 2024-09-12T17:29:47.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:29:47.157 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:29:47.184 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:29:47.189 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:29:47.205 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:29:47.214 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:29:47.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:29:47.261 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:29:47.690 INFO:teuthology.orchestra.run.smithi107.stdout:60129542149 2024-09-12T17:29:47.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-12T17:29:47.710 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:47.761 INFO:teuthology.orchestra.run.smithi107.stdout:60129542150 2024-09-12T17:29:47.771 INFO:teuthology.orchestra.run.smithi107.stdout:60129542150 2024-09-12T17:29:47.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-09-12T17:29:47.781 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:47.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-12T17:29:47.785 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:47.806 INFO:teuthology.orchestra.run.smithi107.stdout:60129542150 2024-09-12T17:29:47.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2024-09-12T17:29:47.819 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:47.839 INFO:teuthology.orchestra.run.smithi107.stdout:60129542151 2024-09-12T17:29:47.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2024-09-12T17:29:47.857 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:47.857 INFO:teuthology.orchestra.run.smithi107.stdout:60129542150 2024-09-12T17:29:47.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-09-12T17:29:47.871 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:47.879 INFO:teuthology.orchestra.run.smithi107.stdout:60129542150 2024-09-12T17:29:47.881 INFO:teuthology.orchestra.run.smithi107.stdout:60129542150 2024-09-12T17:29:47.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-09-12T17:29:47.894 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:47.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-12T17:29:47.895 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:47.895 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:29:47.895 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-09-12T17:29:48.242 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-12T17:29:46.446535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219108,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755612,"statfs":{"total":773094113280,"available":772869746688,"internally_reserved":0,"allocated":2899968,"data_stored":1757182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.493911"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.986874+0000","last_change":"2024-09-12T17:29:43.986874+0000","last_active":"2024-09-12T17:29:43.986874+0000","last_peered":"2024-09-12T17:29:43.986874+0000","last_clean":"2024-09-12T17:29:43.986874+0000","last_became_active":"2024-09-12T17:29:41.961477+0000","last_became_peered":"2024-09-12T17:29:41.961477+0000","last_unstale":"2024-09-12T17:29:43.986874+0000","last_undegraded":"2024-09-12T17:29:43.986874+0000","last_fullsized":"2024-09-12T17:29:43.986874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:09.932105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041855800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.966900+0000","last_change":"2024-09-12T17:29:43.966900+0000","last_active":"2024-09-12T17:29:43.966900+0000","last_peered":"2024-09-12T17:29:43.966900+0000","last_clean":"2024-09-12T17:29:43.966900+0000","last_became_active":"2024-09-12T17:29:41.961194+0000","last_became_peered":"2024-09-12T17:29:41.961194+0000","last_unstale":"2024-09-12T17:29:43.966900+0000","last_undegraded":"2024-09-12T17:29:43.966900+0000","last_fullsized":"2024-09-12T17:29:43.966900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:52.853132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049442699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.985392+0000","last_change":"2024-09-12T17:29:43.985392+0000","last_active":"2024-09-12T17:29:43.985392+0000","last_peered":"2024-09-12T17:29:43.985392+0000","last_clean":"2024-09-12T17:29:43.985392+0000","last_became_active":"2024-09-12T17:29:42.064736+0000","last_became_peered":"2024-09-12T17:29:42.064736+0000","last_unstale":"2024-09-12T17:29:43.985392+0000","last_undegraded":"2024-09-12T17:29:43.985392+0000","last_fullsized":"2024-09-12T17:29:43.985392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:58.936927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045118300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.966855+0000","last_change":"2024-09-12T17:29:43.966855+0000","last_active":"2024-09-12T17:29:43.966855+0000","last_peered":"2024-09-12T17:29:43.966855+0000","last_clean":"2024-09-12T17:29:43.966855+0000","last_became_active":"2024-09-12T17:29:42.064741+0000","last_became_peered":"2024-09-12T17:29:42.064741+0000","last_unstale":"2024-09-12T17:29:43.966855+0000","last_undegraded":"2024-09-12T17:29:43.966855+0000","last_fullsized":"2024-09-12T17:29:43.966855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:56.698152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043924099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.980608+0000","last_change":"2024-09-12T17:29:43.975620+0000","last_active":"2024-09-12T17:29:43.980608+0000","last_peered":"2024-09-12T17:29:43.980608+0000","last_clean":"2024-09-12T17:29:43.980608+0000","last_became_active":"2024-09-12T17:29:41.961122+0000","last_became_peered":"2024-09-12T17:29:41.961122+0000","last_unstale":"2024-09-12T17:29:43.980608+0000","last_undegraded":"2024-09-12T17:29:43.980608+0000","last_fullsized":"2024-09-12T17:29:43.980608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.143106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095277999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:44.204001+0000","last_change":"2024-09-12T17:29:44.204001+0000","last_active":"2024-09-12T17:29:44.204001+0000","last_peered":"2024-09-12T17:29:44.204001+0000","last_clean":"2024-09-12T17:29:44.204001+0000","last_became_active":"2024-09-12T17:29:42.064972+0000","last_became_peered":"2024-09-12T17:29:42.064972+0000","last_unstale":"2024-09-12T17:29:44.204001+0000","last_undegraded":"2024-09-12T17:29:44.204001+0000","last_fullsized":"2024-09-12T17:29:44.204001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.574136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047741400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.985359+0000","last_change":"2024-09-12T17:29:43.985359+0000","last_active":"2024-09-12T17:29:43.985359+0000","last_peered":"2024-09-12T17:29:43.985359+0000","last_clean":"2024-09-12T17:29:43.985359+0000","last_became_active":"2024-09-12T17:29:41.963499+0000","last_became_peered":"2024-09-12T17:29:41.963499+0000","last_unstale":"2024-09-12T17:29:43.985359+0000","last_undegraded":"2024-09-12T17:29:43.985359+0000","last_fullsized":"2024-09-12T17:29:43.985359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:34.267982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470655,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.975243+0000","last_change":"2024-09-12T17:29:43.975243+0000","last_active":"2024-09-12T17:29:43.975243+0000","last_peered":"2024-09-12T17:29:43.975243+0000","last_clean":"2024-09-12T17:29:43.975243+0000","last_became_active":"2024-09-12T17:29:41.963643+0000","last_became_peered":"2024-09-12T17:29:41.963643+0000","last_unstale":"2024-09-12T17:29:43.975243+0000","last_undegraded":"2024-09-12T17:29:43.975243+0000","last_fullsized":"2024-09-12T17:29:43.975243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:57.226626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056994999999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.985271+0000","last_change":"2024-09-12T17:29:36.164552+0000","last_active":"2024-09-12T17:29:43.985271+0000","last_peered":"2024-09-12T17:29:43.985271+0000","last_clean":"2024-09-12T17:29:43.985271+0000","last_became_active":"2024-09-12T17:29:36.163604+0000","last_became_peered":"2024-09-12T17:29:36.163604+0000","last_unstale":"2024-09-12T17:29:43.985271+0000","last_undegraded":"2024-09-12T17:29:43.985271+0000","last_fullsized":"2024-09-12T17:29:43.985271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.896766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.896766+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.896766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:35.293197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":217088,"data_stored":72070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":662419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:29:48.243 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:29:48.539 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:29:48.539 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-09-12T17:29:48.551 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T17:29:48.447050+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219108,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755612,"statfs":{"total":773094113280,"available":772869746688,"internally_reserved":0,"allocated":2899968,"data_stored":1757182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.492777"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.986874+0000","last_change":"2024-09-12T17:29:43.986874+0000","last_active":"2024-09-12T17:29:43.986874+0000","last_peered":"2024-09-12T17:29:43.986874+0000","last_clean":"2024-09-12T17:29:43.986874+0000","last_became_active":"2024-09-12T17:29:41.961477+0000","last_became_peered":"2024-09-12T17:29:41.961477+0000","last_unstale":"2024-09-12T17:29:43.986874+0000","last_undegraded":"2024-09-12T17:29:43.986874+0000","last_fullsized":"2024-09-12T17:29:43.986874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:09.932105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041855800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.966900+0000","last_change":"2024-09-12T17:29:43.966900+0000","last_active":"2024-09-12T17:29:43.966900+0000","last_peered":"2024-09-12T17:29:43.966900+0000","last_clean":"2024-09-12T17:29:43.966900+0000","last_became_active":"2024-09-12T17:29:41.961194+0000","last_became_peered":"2024-09-12T17:29:41.961194+0000","last_unstale":"2024-09-12T17:29:43.966900+0000","last_undegraded":"2024-09-12T17:29:43.966900+0000","last_fullsized":"2024-09-12T17:29:43.966900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:52.853132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049442699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.985392+0000","last_change":"2024-09-12T17:29:43.985392+0000","last_active":"2024-09-12T17:29:43.985392+0000","last_peered":"2024-09-12T17:29:43.985392+0000","last_clean":"2024-09-12T17:29:43.985392+0000","last_became_active":"2024-09-12T17:29:42.064736+0000","last_became_peered":"2024-09-12T17:29:42.064736+0000","last_unstale":"2024-09-12T17:29:43.985392+0000","last_undegraded":"2024-09-12T17:29:43.985392+0000","last_fullsized":"2024-09-12T17:29:43.985392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:58.936927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045118300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.966855+0000","last_change":"2024-09-12T17:29:43.966855+0000","last_active":"2024-09-12T17:29:43.966855+0000","last_peered":"2024-09-12T17:29:43.966855+0000","last_clean":"2024-09-12T17:29:43.966855+0000","last_became_active":"2024-09-12T17:29:42.064741+0000","last_became_peered":"2024-09-12T17:29:42.064741+0000","last_unstale":"2024-09-12T17:29:43.966855+0000","last_undegraded":"2024-09-12T17:29:43.966855+0000","last_fullsized":"2024-09-12T17:29:43.966855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:56.698152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043924099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.980608+0000","last_change":"2024-09-12T17:29:43.975620+0000","last_active":"2024-09-12T17:29:43.980608+0000","last_peered":"2024-09-12T17:29:43.980608+0000","last_clean":"2024-09-12T17:29:43.980608+0000","last_became_active":"2024-09-12T17:29:41.961122+0000","last_became_peered":"2024-09-12T17:29:41.961122+0000","last_unstale":"2024-09-12T17:29:43.980608+0000","last_undegraded":"2024-09-12T17:29:43.980608+0000","last_fullsized":"2024-09-12T17:29:43.980608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.143106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095277999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:44.204001+0000","last_change":"2024-09-12T17:29:44.204001+0000","last_active":"2024-09-12T17:29:44.204001+0000","last_peered":"2024-09-12T17:29:44.204001+0000","last_clean":"2024-09-12T17:29:44.204001+0000","last_became_active":"2024-09-12T17:29:42.064972+0000","last_became_peered":"2024-09-12T17:29:42.064972+0000","last_unstale":"2024-09-12T17:29:44.204001+0000","last_undegraded":"2024-09-12T17:29:44.204001+0000","last_fullsized":"2024-09-12T17:29:44.204001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.574136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047741400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.985359+0000","last_change":"2024-09-12T17:29:43.985359+0000","last_active":"2024-09-12T17:29:43.985359+0000","last_peered":"2024-09-12T17:29:43.985359+0000","last_clean":"2024-09-12T17:29:43.985359+0000","last_became_active":"2024-09-12T17:29:41.963499+0000","last_became_peered":"2024-09-12T17:29:41.963499+0000","last_unstale":"2024-09-12T17:29:43.985359+0000","last_undegraded":"2024-09-12T17:29:43.985359+0000","last_fullsized":"2024-09-12T17:29:43.985359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:34.267982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470655,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.975243+0000","last_change":"2024-09-12T17:29:43.975243+0000","last_active":"2024-09-12T17:29:43.975243+0000","last_peered":"2024-09-12T17:29:43.975243+0000","last_clean":"2024-09-12T17:29:43.975243+0000","last_became_active":"2024-09-12T17:29:41.963643+0000","last_became_peered":"2024-09-12T17:29:41.963643+0000","last_unstale":"2024-09-12T17:29:43.975243+0000","last_undegraded":"2024-09-12T17:29:43.975243+0000","last_fullsized":"2024-09-12T17:29:43.975243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:57.226626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056994999999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:29:43.985271+0000","last_change":"2024-09-12T17:29:36.164552+0000","last_active":"2024-09-12T17:29:43.985271+0000","last_peered":"2024-09-12T17:29:43.985271+0000","last_clean":"2024-09-12T17:29:43.985271+0000","last_became_active":"2024-09-12T17:29:36.163604+0000","last_became_peered":"2024-09-12T17:29:36.163604+0000","last_unstale":"2024-09-12T17:29:43.985271+0000","last_undegraded":"2024-09-12T17:29:43.985271+0000","last_fullsized":"2024-09-12T17:29:43.985271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.896766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.896766+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.896766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:35.293197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":217088,"data_stored":72070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":662419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:29:48.552 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:29:48.553 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:29:48.553 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:29:48.553 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:29:48.886 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:29:48.886 INFO:teuthology.orchestra.run.smithi107.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:29:48.899 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:29:48.899 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T17:29:48.912 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:29:48.950 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T17:29:48.951 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:29:48.951 INFO:tasks.rgw:Creating data pools 2024-09-12T17:29:48.951 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:29:48.951 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-12T17:29:50.012 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T17:29:51.928 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:29:51.953 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:29:52.929 INFO:teuthology.orchestra.run.smithi107.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:29:52.960 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:29:53.931 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:29:53.951 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:29:54.937 INFO:teuthology.orchestra.run.smithi107.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:29:54.967 DEBUG:tasks.rgw:Pools created 2024-09-12T17:29:54.967 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T17:29:54.967 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:29:54.968 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:29:54.968 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:29:55.066 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:55.066 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:56.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.983+0000 7fdedaa2b640 0 -- 172.21.15.107:0/756694819 >> [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] conn(0x7fddb0076380 msgr2=0x7fddb0078840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:56.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.988+0000 7fdede53d800 20 rados->read ofs=0 len=0 2024-09-12T17:29:56.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.989+0000 7fdeda22a640 0 -- 172.21.15.107:0/921277424 >> [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] conn(0x7fdda0076470 msgr2=0x7fdda0078930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:56.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.990+0000 7fdede53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:56.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.990+0000 7fdede53d800 20 realm 2024-09-12T17:29:56.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.990+0000 7fdede53d800 20 rados->read ofs=0 len=0 2024-09-12T17:29:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.990+0000 7fdede53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.990+0000 7fdede53d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.990+0000 7fdede53d800 20 rados->read ofs=0 len=0 2024-09-12T17:29:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.990+0000 7fdede53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.990+0000 7fdede53d800 20 rados->read ofs=0 len=0 2024-09-12T17:29:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.991+0000 7fdede53d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.991+0000 7fdede53d800 20 rados->read ofs=0 len=0 2024-09-12T17:29:56.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.992+0000 7fdede53d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:56.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:56.992+0000 7fdede53d800 20 searching for the correct realm 2024-09-12T17:29:57.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.004+0000 7fdede53d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:57.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.004+0000 7fdede53d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:57.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.004+0000 7fdede53d800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:29:57.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.004+0000 7fdede53d800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:29:57.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.004+0000 7fdede53d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:57.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.004+0000 7fdede53d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:57.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.004+0000 7fdede53d800 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.004+0000 7fdede53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:57.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.004+0000 7fdede53d800 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.005+0000 7fdede53d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:57.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.005+0000 7fdede53d800 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.006+0000 7fdede53d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.006+0000 7fdede53d800 20 zone default found 2024-09-12T17:29:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.006+0000 7fdede53d800 4 Realm: () 2024-09-12T17:29:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.006+0000 7fdede53d800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:29:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.006+0000 7fdede53d800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:29:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.006+0000 7fdede53d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.006+0000 7fdede53d800 20 zonegroup default 2024-09-12T17:29:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.006+0000 7fdede53d800 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.007+0000 7fdede53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:57.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:57.007+0000 7fdede53d800 20 rados->read ofs=0 len=0 2024-09-12T17:29:58.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:58.954+0000 7fdede53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:58.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:58.954+0000 7fdede53d800 20 rados->read ofs=0 len=0 2024-09-12T17:29:58.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:58.955+0000 7fdede53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:58.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:58.955+0000 7fdede53d800 20 started sync module instance, tier type = 2024-09-12T17:29:58.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:29:58.955+0000 7fdede53d800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:30:00.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.986+0000 7fdede53d800 20 add_watcher() i=0 2024-09-12T17:30:00.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.986+0000 7fdede53d800 20 add_watcher() i=1 2024-09-12T17:30:00.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.986+0000 7fdede53d800 20 add_watcher() i=2 2024-09-12T17:30:00.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.986+0000 7fdede53d800 20 add_watcher() i=3 2024-09-12T17:30:00.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.986+0000 7fdede53d800 20 add_watcher() i=4 2024-09-12T17:30:00.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.986+0000 7fdede53d800 20 add_watcher() i=5 2024-09-12T17:30:00.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.986+0000 7fdede53d800 20 add_watcher() i=6 2024-09-12T17:30:00.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.987+0000 7fdede53d800 20 add_watcher() i=7 2024-09-12T17:30:00.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.987+0000 7fdede53d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:00.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.987+0000 7fdede53d800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T17:30:00.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.988+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T17:30:00.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.988+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.988+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T17:30:00.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.988+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T17:30:00.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.988+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.988+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T17:30:00.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.988+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T17:30:00.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.988+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.990 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.989+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T17:30:00.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.989+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T17:30:00.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.989+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.989+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T17:30:00.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.989+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T17:30:00.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.989+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.989+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T17:30:00.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.989+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T17:30:00.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.989+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.989+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T17:30:00.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.989+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T17:30:00.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.989+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.990+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T17:30:00.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.990+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T17:30:00.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.990+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.990+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T17:30:00.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.990+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T17:30:00.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.990+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.990+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T17:30:00.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.990+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T17:30:00.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.990+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.990+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T17:30:00.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.990+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T17:30:00.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.990+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.991+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T17:30:00.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.991+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T17:30:00.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.991+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.991+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T17:30:00.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.991+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T17:30:00.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.991+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.991+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T17:30:00.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.991+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T17:30:00.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.991+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.991+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T17:30:00.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.991+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T17:30:00.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.991+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.992+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.992+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.992+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.992+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.992+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.992+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.992+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.992+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.992+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.993+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.993+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.993+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.993+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T17:30:00.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.993+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T17:30:00.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.993+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.993+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T17:30:00.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.993+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T17:30:00.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.993+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.994+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T17:30:00.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.994+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T17:30:00.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.994+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.994+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T17:30:00.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.994+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T17:30:00.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.994+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.994+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T17:30:00.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.994+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T17:30:00.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.994+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.994+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T17:30:00.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.994+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T17:30:00.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.994+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.995+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.995+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.995+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.995+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.995+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.995+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.995+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.995+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.995+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.995+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.995+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.995+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.996+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T17:30:01.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.996+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.996+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.996+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.996+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.996+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.996+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.996+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.996+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.997+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.997+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.997+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.997+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.997+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T17:30:01.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.997+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.997+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T17:30:01.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.997+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T17:30:01.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.997+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.997+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T17:30:01.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.997+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T17:30:01.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.997+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.998+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T17:30:01.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.998+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T17:30:01.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.998+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.998+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T17:30:01.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.998+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T17:30:01.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.998+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.998+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T17:30:01.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.998+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T17:30:01.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.998+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.999+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T17:30:01.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.999+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T17:30:01.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.999+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.999+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T17:30:01.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.999+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T17:30:01.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.999+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.999+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.999+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:00.999+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.000+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.000+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.000+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.000+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.000+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.000+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.000+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.000+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.000+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.000+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.000+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T17:30:01.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.000+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T17:30:01.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T17:30:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.001+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.002+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T17:30:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.002+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T17:30:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.002+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.002+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T17:30:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.002+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T17:30:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.002+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.002+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T17:30:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.002+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T17:30:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.002+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.002+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T17:30:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.002+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.002+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.003+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.003+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.003+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.003+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.003+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.003+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.003+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.003+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.003+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.003+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.003+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.003+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T17:30:01.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T17:30:01.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T17:30:01.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T17:30:01.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T17:30:01.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T17:30:01.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.004+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.005+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.005+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.005+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.005+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.005+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.005+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.005+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T17:30:01.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.005+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.005+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.005+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.005+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.005+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.006+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.006+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.006+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.006+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.006+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.006+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.006+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.006+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T17:30:01.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.006+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.007+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.008+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.008+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.008+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.008+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.008+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.008+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.008+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.008+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.008+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.008+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T17:30:01.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.008+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.008+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.009+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.009+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.009+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.009+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.009+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.009+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.009+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.009+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.009+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.009+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.009+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T17:30:01.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.009+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.010+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.010+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.010+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.010+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.010+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.010+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.010+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.010+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.010+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.010+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.010+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.010+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.011+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T17:30:01.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.011+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.011+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.011+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.011+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.011+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.011+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.011+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.011+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.011+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.011+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.011+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.012+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.012+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T17:30:01.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.012+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.012+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T17:30:01.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.012+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T17:30:01.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.012+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.012+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T17:30:01.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.012+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.012+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T17:30:01.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.013+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.014+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.014+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.014+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.014+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.014+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.014+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.014+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.014+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.014+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T17:30:01.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.015+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.016+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.016+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.016+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.016+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.016+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.016+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.016+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.016+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.016+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.016+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.016+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.016+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.017+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.017+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.017+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.017+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.017+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.017+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.017+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.017+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.017+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.017+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.017+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.017+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T17:30:01.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.018+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.019+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.019+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.019+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.019+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.019+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.019+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T17:30:01.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T17:30:01.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T17:30:01.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.020+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T17:30:01.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.021+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T17:30:01.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.021+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.021+0000 7fdede53d800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T17:30:01.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.021+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T17:30:01.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.022+0000 7fdede53d800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:01.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.026+0000 7fdd8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:01.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.026+0000 7fdede53d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:01.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:01.026+0000 7fdede53d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.952+0000 7fdede53d800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T17:30:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.952+0000 7fdede53d800 5 note: GC not initialized 2024-09-12T17:30:03.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.952+0000 7fdcf77fe640 20 reqs_thread_entry: start 2024-09-12T17:30:03.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.952+0000 7fdede53d800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:03.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.952+0000 7fdede53d800 20 Filter name: none 2024-09-12T17:30:03.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.952+0000 7fdcf57fa640 20 reqs_thread_entry: start 2024-09-12T17:30:03.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.981+0000 7fdd8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:03.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.984+0000 7fdede53d800 20 remove_watcher() i=0 2024-09-12T17:30:03.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.984+0000 7fdede53d800 2 removed watcher, disabling cache 2024-09-12T17:30:03.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.986+0000 7fdede53d800 20 remove_watcher() i=1 2024-09-12T17:30:03.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.987+0000 7fdede53d800 20 remove_watcher() i=2 2024-09-12T17:30:03.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.991+0000 7fdede53d800 20 remove_watcher() i=3 2024-09-12T17:30:03.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.992+0000 7fdede53d800 20 remove_watcher() i=4 2024-09-12T17:30:03.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.993+0000 7fdede53d800 20 remove_watcher() i=5 2024-09-12T17:30:03.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.995+0000 7fdede53d800 20 remove_watcher() i=6 2024-09-12T17:30:03.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:03.996+0000 7fdede53d800 20 remove_watcher() i=7 2024-09-12T17:30:04.011 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2024-09-12T17:30:04.011 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:30:04.012 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:30:04.012 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:30:04.012 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T17:30:04.078 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:04.078 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:04.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.102+0000 7f91c6f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:04.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.102+0000 7f91c6f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:04.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.106+0000 7f9012ffd640 20 reqs_thread_entry: start 2024-09-12T17:30:04.124 INFO:teuthology.orchestra.run.smithi107.stdout:{"id":"35ed0db6-4f54-4e96-b306-71079c84e007","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:30:04.124 DEBUG:tasks.util.rgw: json result: {'id': '35ed0db6-4f54-4e96-b306-71079c84e007', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:30:04.125 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-12T17:30:04.125 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p /tmp/rgw_datacache 2024-09-12T17:30:04.155 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-12T17:30:04.234 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:30:04.234 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:30:04.234 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:30:04.331 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:04.331 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:04.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.362+0000 7f067ea17800 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.364+0000 7f067ea17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.364+0000 7f067ea17800 20 realm 2024-09-12T17:30:04.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.364+0000 7f067ea17800 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.364+0000 7f067ea17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.364+0000 7f067ea17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:04.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.364+0000 7f067ea17800 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.364+0000 7f067ea17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.364+0000 7f067ea17800 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.365+0000 7f067ea17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:04.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.365+0000 7f067ea17800 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.366+0000 7f067ea17800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:30:04.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.366+0000 7f067ea17800 20 searching for the correct realm 2024-09-12T17:30:04.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.369+0000 7f067a1e7640 0 -- 172.21.15.107:0/3457608363 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f0674025040 msgr2=0x7f0674025930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:04.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.372+0000 7f067a1e7640 0 -- 172.21.15.107:0/3457608363 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f066409e130 msgr2=0x7f06640972f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:04.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.579+0000 7f067ea17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:04.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.579+0000 7f067ea17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:04.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.579+0000 7f067ea17800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:30:04.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.579+0000 7f067ea17800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:30:04.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.579+0000 7f067ea17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:04.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.579+0000 7f067ea17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:04.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.579+0000 7f067ea17800 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.579+0000 7f067ea17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.579+0000 7f067ea17800 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.580+0000 7f067ea17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.580+0000 7f067ea17800 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.580+0000 7f067ea17800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.580+0000 7f067ea17800 20 zone default found 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.580+0000 7f067ea17800 4 Realm: () 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.580+0000 7f067ea17800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.580+0000 7f067ea17800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.580+0000 7f067ea17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.580+0000 7f067ea17800 20 zonegroup default 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.580+0000 7f067ea17800 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.581+0000 7f067ea17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.581+0000 7f067ea17800 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.581+0000 7f067ea17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.581+0000 7f067ea17800 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.581+0000 7f067ea17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.581+0000 7f067ea17800 20 started sync module instance, tier type = 2024-09-12T17:30:04.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.581+0000 7f067ea17800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:30:04.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.596+0000 7f067ea17800 20 add_watcher() i=0 2024-09-12T17:30:04.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.596+0000 7f067ea17800 20 add_watcher() i=1 2024-09-12T17:30:04.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.596+0000 7f067ea17800 20 add_watcher() i=2 2024-09-12T17:30:04.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.596+0000 7f067ea17800 20 add_watcher() i=3 2024-09-12T17:30:04.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.596+0000 7f067ea17800 20 add_watcher() i=4 2024-09-12T17:30:04.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.596+0000 7f067ea17800 20 add_watcher() i=5 2024-09-12T17:30:04.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.596+0000 7f067ea17800 20 add_watcher() i=6 2024-09-12T17:30:04.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.597+0000 7f067ea17800 20 add_watcher() i=7 2024-09-12T17:30:04.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.597+0000 7f067ea17800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:04.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.599+0000 7f0530fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:04.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.600+0000 7f067ea17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:04.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.600+0000 7f067ea17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:04.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.600+0000 7f067ea17800 5 note: GC not initialized 2024-09-12T17:30:04.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.600+0000 7f04ab7fe640 20 reqs_thread_entry: start 2024-09-12T17:30:04.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.600+0000 7f067ea17800 20 init_complete bucket index max shards: 1 2024-09-12T17:30:04.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.600+0000 7f067ea17800 20 Filter name: none 2024-09-12T17:30:04.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.600+0000 7f04a97fa640 20 reqs_thread_entry: start 2024-09-12T17:30:04.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.610+0000 7f0530fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:04.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.612+0000 7f067ea17800 20 remove_watcher() i=0 2024-09-12T17:30:04.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.612+0000 7f067ea17800 2 removed watcher, disabling cache 2024-09-12T17:30:04.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.615+0000 7f067ea17800 20 remove_watcher() i=1 2024-09-12T17:30:04.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.616+0000 7f067ea17800 20 remove_watcher() i=2 2024-09-12T17:30:04.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.619+0000 7f067ea17800 20 remove_watcher() i=3 2024-09-12T17:30:04.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.620+0000 7f067ea17800 20 remove_watcher() i=4 2024-09-12T17:30:04.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.621+0000 7f067ea17800 20 remove_watcher() i=5 2024-09-12T17:30:04.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.623+0000 7f067ea17800 20 remove_watcher() i=6 2024-09-12T17:30:04.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.624+0000 7f067ea17800 20 remove_watcher() i=7 2024-09-12T17:30:04.635 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2024-09-12T17:30:04.635 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:30:04.636 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T17:30:04.636 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:30:04.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:30:04.636 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T17:30:04.698 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:04.698 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:04.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.721+0000 7f29e1a19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:04.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.721+0000 7f29e1a19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:04.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.725+0000 7f281b7fe640 20 reqs_thread_entry: start 2024-09-12T17:30:04.742 INFO:teuthology.orchestra.run.smithi107.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T17:30:04.742 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T17:30:04.742 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:30:04.742 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:30:04.743 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T17:30:04.807 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:04.807 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:04.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.830+0000 7f725ba15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:04.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.830+0000 7f725ba15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:04.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.834+0000 7f70cdffb640 20 reqs_thread_entry: start 2024-09-12T17:30:04.851 INFO:teuthology.orchestra.run.smithi107.stdout:{"id":"35ed0db6-4f54-4e96-b306-71079c84e007","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:30:04.851 DEBUG:tasks.util.rgw: json result: {'id': '35ed0db6-4f54-4e96-b306-71079c84e007', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:30:04.852 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T17:30:04.852 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:30:04.852 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:30:04.852 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T17:30:04.914 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:04.914 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:04.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.937+0000 7fad8db2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:04.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.937+0000 7fad8db2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:04.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:04.941+0000 7fabc77fe640 20 reqs_thread_entry: start 2024-09-12T17:30:04.957 INFO:teuthology.orchestra.run.smithi107.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T17:30:04.958 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T17:30:04.958 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:30:04.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:30:04.958 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T17:30:05.023 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:05.023 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:05.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:05.046+0000 7f40936bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:05.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:05.046+0000 7f40936bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:05.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:30:05.049+0000 7f3ecf7fe640 20 reqs_thread_entry: start 2024-09-12T17:30:05.066 INFO:teuthology.orchestra.run.smithi107.stdout:{"id":"35ed0db6-4f54-4e96-b306-71079c84e007","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:30:05.067 DEBUG:tasks.util.rgw: json result: {'id': '35ed0db6-4f54-4e96-b306-71079c84e007', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:30:05.067 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:30:05.067 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T17:30:05.067 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:30:05.067 DEBUG:teuthology.orchestra.run.smithi107:> sudo echo -n http://smithi107.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:30:05.107 INFO:teuthology.orchestra.run.smithi107.stdout:http://smithi107.front.sepia.ceph.com:80 2024-09-12T17:30:05.107 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:30:05.185 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:30:05.185 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:30:05.228 INFO:tasks.rgw.client.0:Started 2024-09-12T17:30:05.228 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi107.front.sepia.ceph.com:80/ 2024-09-12T17:30:05.228 DEBUG:teuthology.orchestra.run.smithi107:> curl http://smithi107.front.sepia.ceph.com:80/ 2024-09-12T17:30:05.273 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:30:05.275 INFO:teuthology.orchestra.run.smithi107.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:30:05.275 INFO:teuthology.orchestra.run.smithi107.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:30:05.275 INFO:teuthology.orchestra.run.smithi107.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:30:05.275 INFO:teuthology.orchestra.run.smithi107.stderr:curl: (7) Failed to connect to smithi107.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:30:06.276 DEBUG:teuthology.orchestra.run.smithi107:> curl http://smithi107.front.sepia.ceph.com:80/ 2024-09-12T17:30:06.310 INFO:teuthology.orchestra.run.smithi107.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:30:06.310 INFO:teuthology.orchestra.run.smithi107.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:30:06.311 INFO:teuthology.orchestra.run.smithi107.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-09-12T17:30:06.312 INFO:teuthology.orchestra.run.smithi107.stdout:anonymous 2024-09-12T17:30:06.312 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T17:30:06.326 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T17:30:06.326 DEBUG:teuthology.orchestra.run.smithi107:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T17:30:08.588 DEBUG:teuthology.orchestra.run.smithi107:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T17:30:09.109 INFO:teuthology.orchestra.run.smithi107.stdout:Collecting tox==3.15.0 2024-09-12T17:30:09.160 INFO:teuthology.orchestra.run.smithi107.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T17:30:09.300 INFO:teuthology.orchestra.run.smithi107.stdout:Collecting six<2,>=1.14.0 2024-09-12T17:30:09.315 INFO:teuthology.orchestra.run.smithi107.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:30:09.575 INFO:teuthology.orchestra.run.smithi107.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T17:30:09.590 INFO:teuthology.orchestra.run.smithi107.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T17:30:09.870 INFO:teuthology.orchestra.run.smithi107.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T17:30:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T17:30:09.983 INFO:teuthology.orchestra.run.smithi107.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T17:30:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T17:30:10.089 INFO:teuthology.orchestra.run.smithi107.stdout:Collecting py<2,>=1.4.17 2024-09-12T17:30:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T17:30:10.214 INFO:teuthology.orchestra.run.smithi107.stdout:Collecting packaging>=14 2024-09-12T17:30:10.230 INFO:teuthology.orchestra.run.smithi107.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T17:30:10.305 INFO:teuthology.orchestra.run.smithi107.stdout:Collecting toml>=0.9.4 2024-09-12T17:30:10.320 INFO:teuthology.orchestra.run.smithi107.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T17:30:10.443 INFO:teuthology.orchestra.run.smithi107.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T17:30:10.458 INFO:teuthology.orchestra.run.smithi107.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T17:30:10.574 INFO:teuthology.orchestra.run.smithi107.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T17:30:10.589 INFO:teuthology.orchestra.run.smithi107.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T17:30:10.932 INFO:teuthology.orchestra.run.smithi107.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T17:30:11.767 INFO:teuthology.orchestra.run.smithi107.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T17:30:11.965 INFO:teuthology.orchestra.run.smithi107.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T17:30:11.965 INFO:teuthology.orchestra.run.smithi107.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T17:30:12.027 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:30:12.041 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:30:12.042 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:30:12.042 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:30:12.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:30:12.071 INFO:teuthology.orchestra.run.smithi107.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:30:12.072 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:30:12.142 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:30:12.142 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:30:12.211 INFO:tasks.workunit:timeout=3h 2024-09-12T17:30:12.211 INFO:tasks.workunit:cleanup=True 2024-09-12T17:30:12.211 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:30:12.281 INFO:tasks.workunit.client.0.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:31:19.431 INFO:tasks.workunit.client.0.smithi107.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:31:19.431 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:31:19.431 INFO:tasks.workunit.client.0.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:31:19.432 INFO:tasks.workunit.client.0.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:31:19.432 INFO:tasks.workunit.client.0.smithi107.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:31:19.432 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:31:19.432 INFO:tasks.workunit.client.0.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:31:19.432 INFO:tasks.workunit.client.0.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:31:19.432 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:31:19.432 INFO:tasks.workunit.client.0.smithi107.stderr: git switch -c 2024-09-12T17:31:19.432 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:31:19.432 INFO:tasks.workunit.client.0.smithi107.stderr:Or undo this operation with: 2024-09-12T17:31:19.432 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:31:19.432 INFO:tasks.workunit.client.0.smithi107.stderr: git switch - 2024-09-12T17:31:19.432 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:31:19.433 INFO:tasks.workunit.client.0.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:31:19.433 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:31:19.433 INFO:tasks.workunit.client.0.smithi107.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:31:19.435 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:31:19.518 INFO:tasks.workunit.client.0.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:31:19.520 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:31:19.520 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:31:20.105 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:31:20.176 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:31:20.215 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:31:20.216 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:31:20.216 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:31:20.254 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:31:20.257 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:31:20.257 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:31:20.326 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-12T17:31:20.327 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-12T17:31:20.328 DEBUG:teuthology.orchestra.run.smithi107:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T17:31:20.400 INFO:tasks.workunit.client.0.smithi107.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T17:31:20.401 INFO:tasks.workunit.client.0.smithi107.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:31:20.401 INFO:tasks.workunit.client.0.smithi107.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:31:22.642 INFO:tasks.workunit.client.0.smithi107.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:31:22.642 INFO:tasks.workunit.client.0.smithi107.stderr:++ deactivate nondestructive 2024-09-12T17:31:22.642 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T17:31:22.642 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T17:31:22.643 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:31:22.643 INFO:tasks.workunit.client.0.smithi107.stderr:++ hash -r 2024-09-12T17:31:22.643 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T17:31:22.643 INFO:tasks.workunit.client.0.smithi107.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:31:22.643 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:31:22.643 INFO:tasks.workunit.client.0.smithi107.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:31:22.644 INFO:tasks.workunit.client.0.smithi107.stderr:++ export VIRTUAL_ENV 2024-09-12T17:31:22.644 INFO:tasks.workunit.client.0.smithi107.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:31:22.644 INFO:tasks.workunit.client.0.smithi107.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:31:22.644 INFO:tasks.workunit.client.0.smithi107.stderr:++ export PATH 2024-09-12T17:31:22.644 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T17:31:22.644 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -z '' ']' 2024-09-12T17:31:22.645 INFO:tasks.workunit.client.0.smithi107.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:31:22.645 INFO:tasks.workunit.client.0.smithi107.stderr:++ PS1='(rgw) ' 2024-09-12T17:31:22.645 INFO:tasks.workunit.client.0.smithi107.stderr:++ export PS1 2024-09-12T17:31:22.645 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:31:22.645 INFO:tasks.workunit.client.0.smithi107.stderr:++ hash -r 2024-09-12T17:31:22.645 INFO:tasks.workunit.client.0.smithi107.stderr:+ pip install pip --upgrade 2024-09-12T17:31:22.865 INFO:tasks.workunit.client.0.smithi107.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:31:23.053 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting pip 2024-09-12T17:31:23.116 INFO:tasks.workunit.client.0.smithi107.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:31:23.273 INFO:tasks.workunit.client.0.smithi107.stdout:Installing collected packages: pip 2024-09-12T17:31:23.273 INFO:tasks.workunit.client.0.smithi107.stdout: Attempting uninstall: pip 2024-09-12T17:31:23.273 INFO:tasks.workunit.client.0.smithi107.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:31:23.431 INFO:tasks.workunit.client.0.smithi107.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:31:23.436 INFO:tasks.workunit.client.0.smithi107.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:31:24.158 INFO:tasks.workunit.client.0.smithi107.stdout:Successfully installed pip-24.2 2024-09-12T17:31:24.387 INFO:tasks.workunit.client.0.smithi107.stderr:+ pip install configobj 2024-09-12T17:31:24.764 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting configobj 2024-09-12T17:31:24.805 INFO:tasks.workunit.client.0.smithi107.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-12T17:31:24.929 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting six (from configobj) 2024-09-12T17:31:24.943 INFO:tasks.workunit.client.0.smithi107.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:31:25.006 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-12T17:31:25.080 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:31:25.135 INFO:tasks.workunit.client.0.smithi107.stdout:Installing collected packages: six, configobj 2024-09-12T17:31:25.253 INFO:tasks.workunit.client.0.smithi107.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-12T17:31:25.298 INFO:tasks.workunit.client.0.smithi107.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-12T17:31:25.330 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-12T17:31:25.330 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-12T17:31:25.331 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:command succeeded 2024-09-12T17:31:25.332 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-12T17:31:25.332 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:31:25.332 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-12T17:31:25.378 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:command succeeded 2024-09-12T17:31:25.378 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 44372/radosgw \ntcp6 0 0 :::80 :::* LISTEN 44372/radosgw \n' 2024-09-12T17:31:25.378 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:radosgw port: 80 2024-09-12T17:31:25.378 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-12T17:31:25.379 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-12T17:31:25.401 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:command succeeded 2024-09-12T17:31:25.402 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:b'' 2024-09-12T17:31:25.402 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-12T17:31:25.741 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:command succeeded 2024-09-12T17:31:25.741 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-12T17:31:25.712324Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-12T17:31:25.712314Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-12T17:31:25.741 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:Creating s3cmd config... 2024-09-12T17:31:25.741 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:proto for s3cmd config is http 2024-09-12T17:31:25.741 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:s3cmd config written 2024-09-12T17:31:25.741 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-12T17:31:25.888 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:command succeeded 2024-09-12T17:31:25.889 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-12T17:31:25.889 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-12T17:31:26.123 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:command succeeded 2024-09-12T17:31:26.123 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 0.1 seconds, 72.01 MB/s) [1 of 1]\n" 2024-09-12T17:31:26.123 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-12T17:31:26.291 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:command succeeded 2024-09-12T17:31:26.292 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.0 seconds, 176.66 MB/s)\n" 2024-09-12T17:31:26.292 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-12T17:31:26.418 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:command succeeded 2024-09-12T17:31:26.419 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7368844,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "lz4",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4210766\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4210766,\n "len": 3158078\n }\n ]\n },\n "etag": "ebba72f3090f556df82042471f5c6262",\n "tag": "35ed0db6-4f54-4e96-b306-71079c84e007.4596.10150637883789372873",\n "manifest": {\n "objs": [],\n "obj_size": 7368844,\n "explicit_objs": false,\n "head_size": 4194304,\n "max_head_size": 4194304,\n "prefix": ".PeLD7zdlycP_At7771jsPpEcTUrPkPM_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 4194304,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "35ed0db6-4f54-4e96-b306-71079c84e007.4596.1",\n "bucket_id": "35ed0db6-4f54-4e96-b306-71079c84e007.4596.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4194304,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "35ed0db6-4f54-4e96-b306-71079c84e007.4596.1",\n "bucket_id": "35ed0db6-4f54-4e96-b306-71079c84e007.4596.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": "7M.dat",\n "instance": "",\n "ns": ""\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 4194304,\n "stripe_ofs": 4194304,\n "ofs": 7368844,\n "stripe_size": 3174540,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "35ed0db6-4f54-4e96-b306-71079c84e007.4596.1",\n "bucket_id": "35ed0db6-4f54-4e96-b306-71079c84e007.4596.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".PeLD7zdlycP_At7771jsPpEcTUrPkPM_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-12T17:31:26.091990Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "35ed0db6-4f54-4e96-b306-71079c84e007.4596.10150637883789372873",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726162285/ctime:1726162285/gid:1333/gname:ubuntu/md5:ebba72f3090f556df82042471f5c6262/mode:33188/mtime:1726162285/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-12T17:31:26.419 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:Cached object name is: .PeLD7zdlycP_At7771jsPpEcTUrPkPM_ 2024-09-12T17:31:26.419 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-12T17:31:26.431 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:command succeeded 2024-09-12T17:31:26.431 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:b'0\n' 2024-09-12T17:31:26.431 INFO:tasks.workunit.client.0.smithi107.stderr:DEBUG:root:Check cache dir content: 0 2024-09-12T17:31:26.431 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-12T17:31:26.432 INFO:tasks.workunit.client.0.smithi107.stderr:INFO:root:Completed Datacache tests 2024-09-12T17:31:26.437 INFO:tasks.workunit.client.0.smithi107.stderr:+ deactivate 2024-09-12T17:31:26.437 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:31:26.437 INFO:tasks.workunit.client.0.smithi107.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:31:26.437 INFO:tasks.workunit.client.0.smithi107.stderr:+ export PATH 2024-09-12T17:31:26.437 INFO:tasks.workunit.client.0.smithi107.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:31:26.438 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n '' ']' 2024-09-12T17:31:26.438 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:31:26.438 INFO:tasks.workunit.client.0.smithi107.stderr:+ hash -r 2024-09-12T17:31:26.438 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n '' ']' 2024-09-12T17:31:26.438 INFO:tasks.workunit.client.0.smithi107.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:31:26.438 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:31:26.438 INFO:tasks.workunit.client.0.smithi107.stderr:+ unset -f deactivate 2024-09-12T17:31:26.438 INFO:tasks.workunit.client.0.smithi107.stderr:+ echo OK. 2024-09-12T17:31:26.439 INFO:tasks.workunit.client.0.smithi107.stdout:OK. 2024-09-12T17:31:26.439 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:31:26.439 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:31:26.522 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-12T17:31:26.522 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:31:26.841 DEBUG:teuthology.parallel:result is None 2024-09-12T17:31:26.841 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:31:26.881 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:31:26.881 DEBUG:teuthology.orchestra.run.smithi107:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:31:26.954 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:31:26.954 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:31:26.964 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:31:26.964 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:31:26.964 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:31:27.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:31:27.023 INFO:teuthology.orchestra.run.smithi107.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:31:27.024 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:31:27.096 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:31:27.097 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:31:27.164 INFO:tasks.workunit:timeout=3h 2024-09-12T17:31:27.164 INFO:tasks.workunit:cleanup=True 2024-09-12T17:31:27.165 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:31:27.234 INFO:tasks.workunit.client.0.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:32:25.875 INFO:tasks.workunit.client.0.smithi107.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:32:25.875 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:25.875 INFO:tasks.workunit.client.0.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:32:25.875 INFO:tasks.workunit.client.0.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:32:25.875 INFO:tasks.workunit.client.0.smithi107.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:32:25.875 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:25.876 INFO:tasks.workunit.client.0.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:32:25.876 INFO:tasks.workunit.client.0.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:32:25.876 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:25.876 INFO:tasks.workunit.client.0.smithi107.stderr: git switch -c 2024-09-12T17:32:25.876 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:25.876 INFO:tasks.workunit.client.0.smithi107.stderr:Or undo this operation with: 2024-09-12T17:32:25.876 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:25.876 INFO:tasks.workunit.client.0.smithi107.stderr: git switch - 2024-09-12T17:32:25.876 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:25.876 INFO:tasks.workunit.client.0.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:32:25.876 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:25.876 INFO:tasks.workunit.client.0.smithi107.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:32:25.879 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:32:25.948 INFO:tasks.workunit.client.0.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:32:25.950 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:32:25.950 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:32:25.998 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:32:26.046 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:32:26.085 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:32:26.086 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:32:26.086 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:32:26.125 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:32:26.128 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:32:26.128 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:32:26.198 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T17:32:26.199 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T17:32:26.199 DEBUG:teuthology.orchestra.run.smithi107:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:32:26.270 INFO:tasks.workunit.client.0.smithi107.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:32:26.271 INFO:tasks.workunit.client.0.smithi107.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:32:26.271 INFO:tasks.workunit.client.0.smithi107.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:32:28.750 INFO:tasks.workunit.client.0.smithi107.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ deactivate nondestructive 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ hash -r 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ export VIRTUAL_ENV 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ export PATH 2024-09-12T17:32:28.751 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -z '' ']' 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi107.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi107.stderr:++ PS1='(rgw) ' 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi107.stderr:++ export PS1 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi107.stderr:++ hash -r 2024-09-12T17:32:28.752 INFO:tasks.workunit.client.0.smithi107.stderr:+ pip install pip --upgrade 2024-09-12T17:32:28.979 INFO:tasks.workunit.client.0.smithi107.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:32:29.161 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting pip 2024-09-12T17:32:29.166 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:32:29.211 INFO:tasks.workunit.client.0.smithi107.stdout:Installing collected packages: pip 2024-09-12T17:32:29.211 INFO:tasks.workunit.client.0.smithi107.stdout: Attempting uninstall: pip 2024-09-12T17:32:29.211 INFO:tasks.workunit.client.0.smithi107.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:32:29.365 INFO:tasks.workunit.client.0.smithi107.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:32:29.370 INFO:tasks.workunit.client.0.smithi107.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:32:30.103 INFO:tasks.workunit.client.0.smithi107.stdout:Successfully installed pip-24.2 2024-09-12T17:32:30.151 INFO:tasks.workunit.client.0.smithi107.stderr:+ pip install boto3 2024-09-12T17:32:30.984 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting boto3 2024-09-12T17:32:31.041 INFO:tasks.workunit.client.0.smithi107.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:32:31.657 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:32:31.854 INFO:tasks.workunit.client.0.smithi107.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:32:31.855 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:32:31.855 INFO:tasks.workunit.client.0.smithi107.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:32:31.922 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:32:31.937 INFO:tasks.workunit.client.0.smithi107.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:32:32.049 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:32:32.065 INFO:tasks.workunit.client.0.smithi107.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:32:32.220 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:32:32.234 INFO:tasks.workunit.client.0.smithi107.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:32:32.438 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:32:32.439 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:32:32.457 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:32:32.539 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:32:32.753 INFO:tasks.workunit.client.0.smithi107.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 61.5 MB/s eta 0:00:00 2024-09-12T17:32:32.768 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:32:32.831 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:32:32.899 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:32:32.966 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:32:33.020 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:32:33.095 INFO:tasks.workunit.client.0.smithi107.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:32:34.106 INFO:tasks.workunit.client.0.smithi107.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:32:34.224 INFO:tasks.workunit.client.0.smithi107.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T17:32:34.369 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T17:32:34.394 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:34.395 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:34.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.429+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.431+0000 7f3e77c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:34.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.431+0000 7f3e77c40800 20 realm 2024-09-12T17:32:34.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.431+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.431+0000 7f3e77c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:34.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.431+0000 7f3e77c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:34.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.431+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.431+0000 7f3e77c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:34.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.431+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.432+0000 7f3e77c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:34.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.432+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.433+0000 7f3e77c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:34.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.433+0000 7f3e77c40800 20 searching for the correct realm 2024-09-12T17:32:34.439 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.437+0000 7f3e75f2b640 0 -- 172.21.15.107:0/1117134471 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7f3e60018040 msgr2=0x7f3e6007c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:34.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.644+0000 7f3e7572a640 0 -- 172.21.15.107:0/1117134471 >> [v2:172.21.15.148:6800/18671776,v1:172.21.15.148:6801/18671776] conn(0x5614bdd57da0 msgr2=0x5614bdd5a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:34.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.646+0000 7f3e77c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:34.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.646+0000 7f3e77c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:34.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.646+0000 7f3e77c40800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:34.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.646+0000 7f3e77c40800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:34.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.646+0000 7f3e77c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:34.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.646+0000 7f3e77c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:34.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:34.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:34.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:34.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 20 zone default found 2024-09-12T17:32:34.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 4 Realm: () 2024-09-12T17:32:34.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:34.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:34.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:34.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 20 zonegroup default 2024-09-12T17:32:34.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.647+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.648+0000 7f3e77c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:34.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.648+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.648+0000 7f3e77c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:34.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.648+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.648+0000 7f3e77c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:34.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.648+0000 7f3e77c40800 20 started sync module instance, tier type = 2024-09-12T17:32:34.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.648+0000 7f3e77c40800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:34.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.666+0000 7f3e77c40800 20 add_watcher() i=0 2024-09-12T17:32:34.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.666+0000 7f3e77c40800 20 add_watcher() i=1 2024-09-12T17:32:34.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.666+0000 7f3e77c40800 20 add_watcher() i=2 2024-09-12T17:32:34.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.666+0000 7f3e77c40800 20 add_watcher() i=3 2024-09-12T17:32:34.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.666+0000 7f3e77c40800 20 add_watcher() i=4 2024-09-12T17:32:34.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.666+0000 7f3e77c40800 20 add_watcher() i=5 2024-09-12T17:32:34.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.666+0000 7f3e77c40800 20 add_watcher() i=6 2024-09-12T17:32:34.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.669+0000 7f3e77c40800 20 add_watcher() i=7 2024-09-12T17:32:34.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.669+0000 7f3e77c40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:34.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.671+0000 7f3d2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:34.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.671+0000 7f3e77c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:34.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.671+0000 7f3e77c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:34.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.671+0000 7f3e77c40800 5 note: GC not initialized 2024-09-12T17:32:34.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.671+0000 7f3d2afe5640 20 reqs_thread_entry: start 2024-09-12T17:32:34.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.671+0000 7f3e77c40800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:34.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.671+0000 7f3e77c40800 20 Filter name: none 2024-09-12T17:32:34.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3d28fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:34.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3e77c40800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T17:32:34.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3e77c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:34.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3e77c40800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T17:32:34.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3e77c40800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:32:34.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3e77c40800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T17:32:34.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3e77c40800 20 rados->read ofs=0 len=0 2024-09-12T17:32:34.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3e77c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:34.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3e77c40800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T17:32:34.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3e77c40800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:32:34.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3e77c40800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:32:34.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.672+0000 7f3e77c40800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:32:34.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.674+0000 7f3e77c40800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:32:34.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.674+0000 7f3e77c40800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:32:34.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.674+0000 7f3e77c40800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T17:32:34.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.674+0000 7f3d58ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691841 cookie 94647084270336 notifier 4644 bl.length()=593 2024-09-12T17:32:34.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.674+0000 7f3d58ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:32:34.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.674+0000 7f3d58ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:32:34.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.677+0000 7f3e77c40800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:32:34.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.677+0000 7f3e77c40800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:32:34.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.677+0000 7f3e77c40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T17:32:34.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.677+0000 7f3d58ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691841 cookie 94647084227744 notifier 4644 bl.length()=186 2024-09-12T17:32:34.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.677+0000 7f3d58ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:32:34.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.677+0000 7f3d58ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:32:34.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.678+0000 7f3d2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:34.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.680+0000 7f3e77c40800 20 remove_watcher() i=0 2024-09-12T17:32:34.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.680+0000 7f3e77c40800 2 removed watcher, disabling cache 2024-09-12T17:32:34.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.682+0000 7f3e77c40800 20 remove_watcher() i=1 2024-09-12T17:32:34.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.683+0000 7f3e77c40800 20 remove_watcher() i=2 2024-09-12T17:32:34.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.684+0000 7f3e77c40800 20 remove_watcher() i=3 2024-09-12T17:32:34.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.686+0000 7f3e77c40800 20 remove_watcher() i=4 2024-09-12T17:32:34.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.687+0000 7f3e77c40800 20 remove_watcher() i=5 2024-09-12T17:32:34.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.688+0000 7f3e77c40800 20 remove_watcher() i=6 2024-09-12T17:32:34.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:34.689+0000 7f3e77c40800 20 remove_watcher() i=7 2024-09-12T17:32:35.007 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T17:32:35.007 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:35.008 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:32:35.037 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:35.037 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:35.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.072+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.074+0000 7f5c29b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.074+0000 7f5c29b19800 20 realm 2024-09-12T17:32:35.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.074+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.074+0000 7f5c29b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.074+0000 7f5c29b19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:35.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.074+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.074+0000 7f5c29b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.074+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.075+0000 7f5c29b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:35.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.075+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.076+0000 7f5c29b19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:35.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.076+0000 7f5c29b19800 20 searching for the correct realm 2024-09-12T17:32:35.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.077+0000 7f5c27603640 0 -- 172.21.15.107:0/1077000694 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f5c20065cb0 msgr2=0x7f5c20064720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:35.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.080+0000 7f5c27603640 0 -- 172.21.15.107:0/1077000694 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f5af008bb70 msgr2=0x7f5af008df60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:35.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.085+0000 7f5c29b19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:35.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.085+0000 7f5c29b19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:35.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.085+0000 7f5c29b19800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:35.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.085+0000 7f5c29b19800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:35.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.085+0000 7f5c29b19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:35.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.085+0000 7f5c29b19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:35.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.085+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.085+0000 7f5c29b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:35.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:35.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 20 zone default found 2024-09-12T17:32:35.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 4 Realm: () 2024-09-12T17:32:35.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:35.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:35.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:35.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 20 zonegroup default 2024-09-12T17:32:35.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.086+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.087+0000 7f5c29b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.087+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.087+0000 7f5c29b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.087+0000 7f5c29b19800 20 started sync module instance, tier type = 2024-09-12T17:32:35.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.087+0000 7f5c29b19800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.098+0000 7f5c29b19800 20 add_watcher() i=0 2024-09-12T17:32:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.098+0000 7f5c29b19800 20 add_watcher() i=1 2024-09-12T17:32:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.098+0000 7f5c29b19800 20 add_watcher() i=2 2024-09-12T17:32:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.098+0000 7f5c29b19800 20 add_watcher() i=3 2024-09-12T17:32:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.098+0000 7f5c29b19800 20 add_watcher() i=4 2024-09-12T17:32:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.098+0000 7f5c29b19800 20 add_watcher() i=5 2024-09-12T17:32:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.098+0000 7f5c29b19800 20 add_watcher() i=6 2024-09-12T17:32:35.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.099+0000 7f5c29b19800 20 add_watcher() i=7 2024-09-12T17:32:35.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.099+0000 7f5c29b19800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:35.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.100+0000 7f5addfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:35.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.101+0000 7f5c29b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:35.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.101+0000 7f5c29b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:35.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.101+0000 7f5c29b19800 5 note: GC not initialized 2024-09-12T17:32:35.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.101+0000 7f5adcfe1640 20 reqs_thread_entry: start 2024-09-12T17:32:35.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.101+0000 7f5c29b19800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:35.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.101+0000 7f5c29b19800 20 Filter name: none 2024-09-12T17:32:35.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.101+0000 7f5a567fc640 20 reqs_thread_entry: start 2024-09-12T17:32:35.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.101+0000 7f5c29b19800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:35.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.101+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.102+0000 7f5c29b19800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:35.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.102+0000 7f5c29b19800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:35.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.102+0000 7f5c29b19800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:35.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.102+0000 7f5c29b19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 : miss 2024-09-12T17:32:35.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.102+0000 7f5c29b19800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.102+0000 7f5c29b19800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:35.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.102+0000 7f5c29b19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 info.flags=0x17 2024-09-12T17:32:35.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.102+0000 7f5c29b19800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 to cache LRU end 2024-09-12T17:32:35.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.102+0000 7f5c29b19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:35.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.102+0000 7f5c29b19800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:35.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.102+0000 7f5c29b19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 2024-09-12T17:32:35.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.102+0000 7f5c29b19800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:35.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.106+0000 7f5addfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:35.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.108+0000 7f5c29b19800 20 remove_watcher() i=0 2024-09-12T17:32:35.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.108+0000 7f5c29b19800 2 removed watcher, disabling cache 2024-09-12T17:32:35.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.109+0000 7f5c29b19800 20 remove_watcher() i=1 2024-09-12T17:32:35.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.115+0000 7f5c29b19800 20 remove_watcher() i=2 2024-09-12T17:32:35.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.116+0000 7f5c29b19800 20 remove_watcher() i=3 2024-09-12T17:32:35.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.117+0000 7f5c29b19800 20 remove_watcher() i=4 2024-09-12T17:32:35.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.118+0000 7f5c29b19800 20 remove_watcher() i=5 2024-09-12T17:32:35.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.119+0000 7f5c29b19800 20 remove_watcher() i=6 2024-09-12T17:32:35.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.120+0000 7f5c29b19800 20 remove_watcher() i=7 2024-09-12T17:32:35.134 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:32:35.163 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:35.163 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:35.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.198+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.200+0000 7f04d0d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.200+0000 7f04d0d46800 20 realm 2024-09-12T17:32:35.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.200+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.200+0000 7f04d0d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.200+0000 7f04d0d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:35.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.200+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.200+0000 7f04d0d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.200+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.201+0000 7f04d0d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:35.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.201+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.201+0000 7f04d0d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:35.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.201+0000 7f04d0d46800 20 searching for the correct realm 2024-09-12T17:32:35.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.204+0000 7f04cf038640 0 -- 172.21.15.107:0/398890183 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x565547a271a0 msgr2=0x565547a29660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:35.208 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.207+0000 7f04ce837640 0 -- 172.21.15.107:0/398890183 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f04b8010b90 msgr2=0x7f04b800f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:35.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.211+0000 7f04d0d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:35.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.211+0000 7f04d0d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:35.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.211+0000 7f04d0d46800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:35.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.211+0000 7f04d0d46800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:35.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.211+0000 7f04d0d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:35.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.211+0000 7f04d0d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:35.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:35.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:35.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 20 zone default found 2024-09-12T17:32:35.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 4 Realm: () 2024-09-12T17:32:35.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:35.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:35.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:35.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 20 zonegroup default 2024-09-12T17:32:35.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.212+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.213+0000 7f04d0d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.213+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.213+0000 7f04d0d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.213+0000 7f04d0d46800 20 started sync module instance, tier type = 2024-09-12T17:32:35.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.213+0000 7f04d0d46800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:35.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.230+0000 7f04d0d46800 20 add_watcher() i=0 2024-09-12T17:32:35.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.230+0000 7f04d0d46800 20 add_watcher() i=1 2024-09-12T17:32:35.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.230+0000 7f04d0d46800 20 add_watcher() i=2 2024-09-12T17:32:35.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.230+0000 7f04d0d46800 20 add_watcher() i=3 2024-09-12T17:32:35.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.230+0000 7f04d0d46800 20 add_watcher() i=4 2024-09-12T17:32:35.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.230+0000 7f04d0d46800 20 add_watcher() i=5 2024-09-12T17:32:35.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.230+0000 7f04d0d46800 20 add_watcher() i=6 2024-09-12T17:32:35.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.233+0000 7f04d0d46800 20 add_watcher() i=7 2024-09-12T17:32:35.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.233+0000 7f04d0d46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:35.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.236+0000 7f03857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:35.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.237+0000 7f04d0d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:35.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.237+0000 7f04d0d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:35.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.237+0000 7f04d0d46800 5 note: GC not initialized 2024-09-12T17:32:35.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.237+0000 7f02fffff640 20 reqs_thread_entry: start 2024-09-12T17:32:35.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.237+0000 7f04d0d46800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:35.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.237+0000 7f04d0d46800 20 Filter name: none 2024-09-12T17:32:35.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.237+0000 7f02fdffb640 20 reqs_thread_entry: start 2024-09-12T17:32:35.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.237+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.237+0000 7f04d0d46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:35.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.237+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.238+0000 7f04d0d46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:35.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.238+0000 7f04d0d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:35.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.238+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.238+0000 7f04d0d46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:35.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.238+0000 7f04d0d46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.239+0000 7f04d0d46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:35.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.239+0000 7f04d0d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:35.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.240+0000 7f03857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:35.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.245+0000 7f04d0d46800 20 remove_watcher() i=0 2024-09-12T17:32:35.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.245+0000 7f04d0d46800 2 removed watcher, disabling cache 2024-09-12T17:32:35.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.245+0000 7f04d0d46800 20 remove_watcher() i=1 2024-09-12T17:32:35.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.249+0000 7f04d0d46800 20 remove_watcher() i=2 2024-09-12T17:32:35.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.250+0000 7f04d0d46800 20 remove_watcher() i=3 2024-09-12T17:32:35.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.251+0000 7f04d0d46800 20 remove_watcher() i=4 2024-09-12T17:32:35.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.252+0000 7f04d0d46800 20 remove_watcher() i=5 2024-09-12T17:32:35.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.254+0000 7f04d0d46800 20 remove_watcher() i=6 2024-09-12T17:32:35.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.255+0000 7f04d0d46800 20 remove_watcher() i=7 2024-09-12T17:32:35.266 INFO:tasks.workunit.client.0.smithi107.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 101, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T17:32:35.266 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T17:32:35.266 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:35.267 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:32:35.300 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:35.301 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:35.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.335+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.336+0000 7f6ed7a32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.336+0000 7f6ed7a32800 20 realm 2024-09-12T17:32:35.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.336+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.336+0000 7f6ed7a32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.336+0000 7f6ed7a32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:35.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.336+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.336+0000 7f6ed7a32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.336+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.337+0000 7f6ed7a32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:35.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.337+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.338+0000 7f6ed7a32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:35.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.338+0000 7f6ed7a32800 20 searching for the correct realm 2024-09-12T17:32:35.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.340+0000 7f6ed2552640 0 -- 172.21.15.107:0/3812728176 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f6ec807a040 msgr2=0x7f6ec8096400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:35.344 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.343+0000 7f6ed2d53640 0 -- 172.21.15.107:0/3812728176 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f6ec8061910 msgr2=0x7f6ec8086440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:35.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:35.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:35.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:35.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:35.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:35.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:35.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:35.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 zone default found 2024-09-12T17:32:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 4 Realm: () 2024-09-12T17:32:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 zonegroup default 2024-09-12T17:32:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.549+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.550+0000 7f6ed7a32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.550+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.550+0000 7f6ed7a32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.550+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.550+0000 7f6ed7a32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.550+0000 7f6ed7a32800 20 started sync module instance, tier type = 2024-09-12T17:32:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.550+0000 7f6ed7a32800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:35.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.566+0000 7f6ed7a32800 20 add_watcher() i=0 2024-09-12T17:32:35.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.566+0000 7f6ed7a32800 20 add_watcher() i=1 2024-09-12T17:32:35.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.566+0000 7f6ed7a32800 20 add_watcher() i=2 2024-09-12T17:32:35.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.566+0000 7f6ed7a32800 20 add_watcher() i=3 2024-09-12T17:32:35.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.566+0000 7f6ed7a32800 20 add_watcher() i=4 2024-09-12T17:32:35.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.566+0000 7f6ed7a32800 20 add_watcher() i=5 2024-09-12T17:32:35.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.566+0000 7f6ed7a32800 20 add_watcher() i=6 2024-09-12T17:32:35.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.567+0000 7f6ed7a32800 20 add_watcher() i=7 2024-09-12T17:32:35.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.567+0000 7f6ed7a32800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:35.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.568+0000 7f6d897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:35.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.569+0000 7f6ed7a32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:35.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.569+0000 7f6ed7a32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:35.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.569+0000 7f6ed7a32800 5 note: GC not initialized 2024-09-12T17:32:35.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.569+0000 7f6d03fff640 20 reqs_thread_entry: start 2024-09-12T17:32:35.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.569+0000 7f6ed7a32800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:35.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.569+0000 7f6ed7a32800 20 Filter name: none 2024-09-12T17:32:35.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.569+0000 7f6d01ffb640 20 reqs_thread_entry: start 2024-09-12T17:32:35.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.569+0000 7f6ed7a32800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:35.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.569+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.570+0000 7f6ed7a32800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:35.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.570+0000 7f6ed7a32800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:35.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.570+0000 7f6ed7a32800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:35.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.570+0000 7f6ed7a32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 : miss 2024-09-12T17:32:35.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.570+0000 7f6ed7a32800 20 rados->read ofs=0 len=0 2024-09-12T17:32:35.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.570+0000 7f6ed7a32800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:35.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.570+0000 7f6ed7a32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 info.flags=0x17 2024-09-12T17:32:35.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.570+0000 7f6ed7a32800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 to cache LRU end 2024-09-12T17:32:35.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.570+0000 7f6ed7a32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:35.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.570+0000 7f6ed7a32800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:35.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.570+0000 7f6ed7a32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 2024-09-12T17:32:35.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.570+0000 7f6ed7a32800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:35.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.571+0000 7f6ed7a32800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:32:35.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.571+0000 7f6ed7a32800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:32:35.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.572+0000 7f6d897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:35.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.574+0000 7f6ed7a32800 20 remove_watcher() i=0 2024-09-12T17:32:35.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.574+0000 7f6ed7a32800 2 removed watcher, disabling cache 2024-09-12T17:32:35.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.575+0000 7f6ed7a32800 20 remove_watcher() i=1 2024-09-12T17:32:35.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.576+0000 7f6ed7a32800 20 remove_watcher() i=2 2024-09-12T17:32:35.578 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.577+0000 7f6ed7a32800 20 remove_watcher() i=3 2024-09-12T17:32:35.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.581+0000 7f6ed7a32800 20 remove_watcher() i=4 2024-09-12T17:32:35.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.582+0000 7f6ed7a32800 20 remove_watcher() i=5 2024-09-12T17:32:35.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.583+0000 7f6ed7a32800 20 remove_watcher() i=6 2024-09-12T17:32:35.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:35.584+0000 7f6ed7a32800 20 remove_watcher() i=7 2024-09-12T17:32:35.597 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:32:35.983 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:32:37.429 INFO:tasks.workunit.client.0.smithi107.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:37.430 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:32:37.465 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:37.465 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:37.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.502+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.504+0000 7f302c220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:37.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.504+0000 7f302c220800 20 realm 2024-09-12T17:32:37.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.504+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.504+0000 7f302c220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:37.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.504+0000 7f302c220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:37.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.504+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.504+0000 7f302c220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:37.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.504+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.505+0000 7f302c220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:37.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.505+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.506+0000 7f302c220800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:37.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.506+0000 7f302c220800 20 searching for the correct realm 2024-09-12T17:32:37.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.508+0000 7f3029d0a640 0 -- 172.21.15.107:0/2323246505 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f3024060880 msgr2=0x7f302405f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:37.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.512+0000 7f3029d0a640 0 -- 172.21.15.107:0/2323246505 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f30140ab170 msgr2=0x7f30140c1790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:37.723 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.718+0000 7f302c220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:37.723 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.718+0000 7f302c220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:37.723 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.718+0000 7f302c220800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:37.723 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.718+0000 7f302c220800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:37.723 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.718+0000 7f302c220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:37.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.718+0000 7f302c220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:37.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.718+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.719+0000 7f302c220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:37.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.719+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.719+0000 7f302c220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:37.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.719+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.719+0000 7f302c220800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:37.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.719+0000 7f302c220800 20 zone default found 2024-09-12T17:32:37.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.719+0000 7f302c220800 4 Realm: () 2024-09-12T17:32:37.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.719+0000 7f302c220800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:37.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.719+0000 7f302c220800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:37.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.719+0000 7f302c220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:37.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.719+0000 7f302c220800 20 zonegroup default 2024-09-12T17:32:37.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.719+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.720+0000 7f302c220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:37.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.720+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.720+0000 7f302c220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:37.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.720+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.720+0000 7f302c220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:37.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.720+0000 7f302c220800 20 started sync module instance, tier type = 2024-09-12T17:32:37.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.720+0000 7f302c220800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:37.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.737+0000 7f302c220800 20 add_watcher() i=0 2024-09-12T17:32:37.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.737+0000 7f302c220800 20 add_watcher() i=1 2024-09-12T17:32:37.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.737+0000 7f302c220800 20 add_watcher() i=2 2024-09-12T17:32:37.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.737+0000 7f302c220800 20 add_watcher() i=3 2024-09-12T17:32:37.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.737+0000 7f302c220800 20 add_watcher() i=4 2024-09-12T17:32:37.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.737+0000 7f302c220800 20 add_watcher() i=5 2024-09-12T17:32:37.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.737+0000 7f302c220800 20 add_watcher() i=6 2024-09-12T17:32:37.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.739+0000 7f302c220800 20 add_watcher() i=7 2024-09-12T17:32:37.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.739+0000 7f302c220800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:37.743 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.742+0000 7f2edb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:37.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.742+0000 7f302c220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:37.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.742+0000 7f302c220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:37.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.742+0000 7f302c220800 5 note: GC not initialized 2024-09-12T17:32:37.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.742+0000 7f2eda7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:37.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.743+0000 7f302c220800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:37.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.743+0000 7f302c220800 20 Filter name: none 2024-09-12T17:32:37.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.743+0000 7f2e4bfff640 20 reqs_thread_entry: start 2024-09-12T17:32:37.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.743+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.743+0000 7f302c220800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:37.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.743+0000 7f302c220800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.744+0000 7f302c220800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:37.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.744+0000 7f302c220800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:37.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.744+0000 7f302c220800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:32:37.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.744+0000 7f302c220800 20 INFO: main: starting shard=0 2024-09-12T17:32:37.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.744+0000 7f302c220800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:37.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.745+0000 7f302c220800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:32:37.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.745+0000 7f302c220800 20 INFO: main: done 2024-09-12T17:32:37.747 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.746+0000 7f2edb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:37.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.748+0000 7f302c220800 20 remove_watcher() i=0 2024-09-12T17:32:37.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.748+0000 7f302c220800 2 removed watcher, disabling cache 2024-09-12T17:32:37.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.749+0000 7f302c220800 20 remove_watcher() i=1 2024-09-12T17:32:37.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.750+0000 7f302c220800 20 remove_watcher() i=2 2024-09-12T17:32:37.752 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.751+0000 7f302c220800 20 remove_watcher() i=3 2024-09-12T17:32:37.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.752+0000 7f302c220800 20 remove_watcher() i=4 2024-09-12T17:32:37.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.753+0000 7f302c220800 20 remove_watcher() i=5 2024-09-12T17:32:37.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.755+0000 7f302c220800 20 remove_watcher() i=6 2024-09-12T17:32:37.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.756+0000 7f302c220800 20 remove_watcher() i=7 2024-09-12T17:32:37.823 INFO:tasks.workunit.client.0.smithi107.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:37.824 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:32:37.854 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:37.854 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:37.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.889+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.891+0000 7f330f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:37.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.891+0000 7f330f525800 20 realm 2024-09-12T17:32:37.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.891+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.891+0000 7f330f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:37.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.891+0000 7f330f525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:37.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.891+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.891+0000 7f330f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:37.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.891+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.892+0000 7f330f525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:37.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.892+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:37.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.892+0000 7f330f525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:37.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.892+0000 7f330f525800 20 searching for the correct realm 2024-09-12T17:32:37.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:37.894+0000 7f330b1b5640 0 -- 172.21.15.107:0/3902100420 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f3304025040 msgr2=0x7f3304025420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:38.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.099+0000 7f33029b4640 0 -- 172.21.15.107:0/3902100420 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x55d680fd7fa0 msgr2=0x55d680fda390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:38.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.105+0000 7f330f525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:38.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.105+0000 7f330f525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:38.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.105+0000 7f330f525800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:38.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.105+0000 7f330f525800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:38.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.105+0000 7f330f525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:38.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.105+0000 7f330f525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:38.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.105+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.105+0000 7f330f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.105+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.106+0000 7f330f525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:38.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.106+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.106+0000 7f330f525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:38.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.106+0000 7f330f525800 20 zone default found 2024-09-12T17:32:38.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.106+0000 7f330f525800 4 Realm: () 2024-09-12T17:32:38.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.106+0000 7f330f525800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:38.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.106+0000 7f330f525800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:38.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.106+0000 7f330f525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:38.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.106+0000 7f330f525800 20 zonegroup default 2024-09-12T17:32:38.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.106+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.106+0000 7f330f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.106+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.107+0000 7f330f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.107+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.107+0000 7f330f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.107+0000 7f330f525800 20 started sync module instance, tier type = 2024-09-12T17:32:38.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.107+0000 7f330f525800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:38.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.124+0000 7f330f525800 20 add_watcher() i=0 2024-09-12T17:32:38.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.124+0000 7f330f525800 20 add_watcher() i=1 2024-09-12T17:32:38.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.124+0000 7f330f525800 20 add_watcher() i=2 2024-09-12T17:32:38.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.124+0000 7f330f525800 20 add_watcher() i=3 2024-09-12T17:32:38.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.124+0000 7f330f525800 20 add_watcher() i=4 2024-09-12T17:32:38.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.124+0000 7f330f525800 20 add_watcher() i=5 2024-09-12T17:32:38.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.127+0000 7f330f525800 20 add_watcher() i=6 2024-09-12T17:32:38.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.127+0000 7f330f525800 20 add_watcher() i=7 2024-09-12T17:32:38.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.127+0000 7f330f525800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:38.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.128+0000 7f31c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:38.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.129+0000 7f330f525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:38.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.129+0000 7f330f525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:38.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.129+0000 7f330f525800 5 note: GC not initialized 2024-09-12T17:32:38.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.129+0000 7f31c0fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:38.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.129+0000 7f330f525800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:38.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.129+0000 7f330f525800 20 Filter name: none 2024-09-12T17:32:38.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.129+0000 7f313a7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:38.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.129+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.129+0000 7f330f525800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:38.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.130+0000 7f330f525800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.130+0000 7f330f525800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:38.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.130+0000 7f330f525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:38.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.130+0000 7f330f525800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:32:38.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.130+0000 7f330f525800 20 INFO: main: starting shard=0 2024-09-12T17:32:38.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.130+0000 7f330f525800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:38.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.131+0000 7f330f525800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:32:38.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.131+0000 7f330f525800 20 INFO: main: done 2024-09-12T17:32:38.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.132+0000 7f31c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:38.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.134+0000 7f330f525800 20 remove_watcher() i=0 2024-09-12T17:32:38.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.134+0000 7f330f525800 2 removed watcher, disabling cache 2024-09-12T17:32:38.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.135+0000 7f330f525800 20 remove_watcher() i=1 2024-09-12T17:32:38.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.136+0000 7f330f525800 20 remove_watcher() i=2 2024-09-12T17:32:38.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.137+0000 7f330f525800 20 remove_watcher() i=3 2024-09-12T17:32:38.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.139+0000 7f330f525800 20 remove_watcher() i=4 2024-09-12T17:32:38.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.140+0000 7f330f525800 20 remove_watcher() i=5 2024-09-12T17:32:38.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.142+0000 7f330f525800 20 remove_watcher() i=6 2024-09-12T17:32:38.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.143+0000 7f330f525800 20 remove_watcher() i=7 2024-09-12T17:32:38.414 INFO:tasks.workunit.client.0.smithi107.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:38.417 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:32:38.449 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:38.449 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:38.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.484+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.486+0000 7f4a7c040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.486+0000 7f4a7c040800 20 realm 2024-09-12T17:32:38.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.486+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.486+0000 7f4a7c040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.486+0000 7f4a7c040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:38.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.486+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.486+0000 7f4a7c040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.486+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.487+0000 7f4a7c040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:38.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.487+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.488+0000 7f4a7c040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:38.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.488+0000 7f4a7c040800 20 searching for the correct realm 2024-09-12T17:32:38.492 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.491+0000 7f4a7a32b640 0 -- 172.21.15.107:0/1002185885 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x561e557db470 msgr2=0x561e557dd860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:38.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.495+0000 7f4a79b2a640 0 -- 172.21.15.107:0/1002185885 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f4a640c4040 msgr2=0x7f4a640638b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:38.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.499+0000 7f4a7c040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:38.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.499+0000 7f4a7c040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:38.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.499+0000 7f4a7c040800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:38.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.499+0000 7f4a7c040800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:38.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.499+0000 7f4a7c040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:38.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.499+0000 7f4a7c040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:38.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.499+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:38.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:38.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 20 zone default found 2024-09-12T17:32:38.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 4 Realm: () 2024-09-12T17:32:38.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:38.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:38.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:38.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 20 zonegroup default 2024-09-12T17:32:38.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.500+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.501+0000 7f4a7c040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.501+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.501+0000 7f4a7c040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.501+0000 7f4a7c040800 20 started sync module instance, tier type = 2024-09-12T17:32:38.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.501+0000 7f4a7c040800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:38.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.514+0000 7f4a7c040800 20 add_watcher() i=0 2024-09-12T17:32:38.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.514+0000 7f4a7c040800 20 add_watcher() i=1 2024-09-12T17:32:38.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.514+0000 7f4a7c040800 20 add_watcher() i=2 2024-09-12T17:32:38.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.514+0000 7f4a7c040800 20 add_watcher() i=3 2024-09-12T17:32:38.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.514+0000 7f4a7c040800 20 add_watcher() i=4 2024-09-12T17:32:38.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.514+0000 7f4a7c040800 20 add_watcher() i=5 2024-09-12T17:32:38.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.514+0000 7f4a7c040800 20 add_watcher() i=6 2024-09-12T17:32:38.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.517+0000 7f4a7c040800 20 add_watcher() i=7 2024-09-12T17:32:38.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.517+0000 7f4a7c040800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:38.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.520+0000 7f492b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:38.522 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.521+0000 7f4a7c040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:38.522 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.521+0000 7f4a7c040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:38.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.521+0000 7f4a7c040800 5 note: GC not initialized 2024-09-12T17:32:38.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.521+0000 7f492a7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:38.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.521+0000 7f4a7c040800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:38.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.521+0000 7f4a7c040800 20 Filter name: none 2024-09-12T17:32:38.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.521+0000 7f489bfff640 20 reqs_thread_entry: start 2024-09-12T17:32:38.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.521+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.521+0000 7f4a7c040800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:38.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.521+0000 7f4a7c040800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.522+0000 7f4a7c040800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:38.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.522+0000 7f4a7c040800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:38.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.522+0000 7f4a7c040800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:32:38.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.522+0000 7f4a7c040800 20 INFO: main: starting shard=0 2024-09-12T17:32:38.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.522+0000 7f4a7c040800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:38.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.523+0000 7f4a7c040800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:32:38.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.523+0000 7f4a7c040800 20 INFO: main: done 2024-09-12T17:32:38.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.524+0000 7f492b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:38.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.526+0000 7f4a7c040800 20 remove_watcher() i=0 2024-09-12T17:32:38.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.526+0000 7f4a7c040800 2 removed watcher, disabling cache 2024-09-12T17:32:38.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.528+0000 7f4a7c040800 20 remove_watcher() i=1 2024-09-12T17:32:38.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.529+0000 7f4a7c040800 20 remove_watcher() i=2 2024-09-12T17:32:38.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.531+0000 7f4a7c040800 20 remove_watcher() i=3 2024-09-12T17:32:38.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.532+0000 7f4a7c040800 20 remove_watcher() i=4 2024-09-12T17:32:38.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.533+0000 7f4a7c040800 20 remove_watcher() i=5 2024-09-12T17:32:38.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.534+0000 7f4a7c040800 20 remove_watcher() i=6 2024-09-12T17:32:38.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.535+0000 7f4a7c040800 20 remove_watcher() i=7 2024-09-12T17:32:38.601 INFO:tasks.workunit.client.0.smithi107.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:38.603 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:32:38.635 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:38.635 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:38.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.669+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.671+0000 7fc604d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.671+0000 7fc604d2a800 20 realm 2024-09-12T17:32:38.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.671+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.671+0000 7fc604d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.671+0000 7fc604d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:38.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.671+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.671+0000 7fc604d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.671+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.672+0000 7fc604d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:38.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.672+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.673+0000 7fc604d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:38.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.673+0000 7fc604d2a800 20 searching for the correct realm 2024-09-12T17:32:38.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.676+0000 7fc5fbfff640 0 -- 172.21.15.107:0/3741610450 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x55a8b7aa2220 msgr2=0x55a8b7aa4610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:38.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.680+0000 7fc5fbfff640 0 -- 172.21.15.107:0/3741610450 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fc5ec0acc20 msgr2=0x7fc5ec056a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:38.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:38.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:38.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:38.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:38.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:38.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:38.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:38.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:38.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 zone default found 2024-09-12T17:32:38.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 4 Realm: () 2024-09-12T17:32:38.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:38.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:38.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:38.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 zonegroup default 2024-09-12T17:32:38.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.684+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.685+0000 7fc604d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.685+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.685+0000 7fc604d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.685+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.685+0000 7fc604d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.685+0000 7fc604d2a800 20 started sync module instance, tier type = 2024-09-12T17:32:38.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.685+0000 7fc604d2a800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:38.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.700+0000 7fc604d2a800 20 add_watcher() i=0 2024-09-12T17:32:38.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.700+0000 7fc604d2a800 20 add_watcher() i=1 2024-09-12T17:32:38.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.700+0000 7fc604d2a800 20 add_watcher() i=2 2024-09-12T17:32:38.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.700+0000 7fc604d2a800 20 add_watcher() i=3 2024-09-12T17:32:38.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.700+0000 7fc604d2a800 20 add_watcher() i=4 2024-09-12T17:32:38.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.700+0000 7fc604d2a800 20 add_watcher() i=5 2024-09-12T17:32:38.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.700+0000 7fc604d2a800 20 add_watcher() i=6 2024-09-12T17:32:38.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.701+0000 7fc604d2a800 20 add_watcher() i=7 2024-09-12T17:32:38.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.701+0000 7fc604d2a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:38.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.703+0000 7fc4b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:38.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.703+0000 7fc604d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:38.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.703+0000 7fc604d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:38.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.703+0000 7fc604d2a800 5 note: GC not initialized 2024-09-12T17:32:38.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.704+0000 7fc4b5fe3640 20 reqs_thread_entry: start 2024-09-12T17:32:38.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.704+0000 7fc604d2a800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:38.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.704+0000 7fc604d2a800 20 Filter name: none 2024-09-12T17:32:38.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.704+0000 7fc4277fe640 20 reqs_thread_entry: start 2024-09-12T17:32:38.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.704+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.704+0000 7fc604d2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:38.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.704+0000 7fc604d2a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.705+0000 7fc604d2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:38.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.705+0000 7fc604d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:38.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.705+0000 7fc604d2a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:32:38.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.705+0000 7fc604d2a800 20 INFO: main: starting shard=0 2024-09-12T17:32:38.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.705+0000 7fc604d2a800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:38.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.706+0000 7fc604d2a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:32:38.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.706+0000 7fc604d2a800 20 INFO: main: done 2024-09-12T17:32:38.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.706+0000 7fc4b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:38.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.709+0000 7fc604d2a800 20 remove_watcher() i=0 2024-09-12T17:32:38.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.709+0000 7fc604d2a800 2 removed watcher, disabling cache 2024-09-12T17:32:38.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.710+0000 7fc604d2a800 20 remove_watcher() i=1 2024-09-12T17:32:38.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.711+0000 7fc604d2a800 20 remove_watcher() i=2 2024-09-12T17:32:38.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.712+0000 7fc604d2a800 20 remove_watcher() i=3 2024-09-12T17:32:38.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.713+0000 7fc604d2a800 20 remove_watcher() i=4 2024-09-12T17:32:38.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.714+0000 7fc604d2a800 20 remove_watcher() i=5 2024-09-12T17:32:38.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.717+0000 7fc604d2a800 20 remove_watcher() i=6 2024-09-12T17:32:38.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:38.718+0000 7fc604d2a800 20 remove_watcher() i=7 2024-09-12T17:32:38.734 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:32:39.123 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:32:39.506 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T17:32:39.506 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:39.508 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:32:39.540 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:39.540 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:39.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.579+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.581+0000 7f2c2b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.581+0000 7f2c2b146800 20 realm 2024-09-12T17:32:39.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.581+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.581+0000 7f2c2b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.581+0000 7f2c2b146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:39.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.581+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.581+0000 7f2c2b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.581+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.582+0000 7f2c2b146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:39.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.582+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.582+0000 7f2c2b146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:39.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.583+0000 7f2c2b146800 20 searching for the correct realm 2024-09-12T17:32:39.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.584+0000 7f2c28c37640 0 -- 172.21.15.107:0/2447802979 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f2c24038060 msgr2=0x7f2c24064940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:39.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.588+0000 7f2c28c37640 0 -- 172.21.15.107:0/2447802979 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f2af40840c0 msgr2=0x7f2af40864f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:39.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.593+0000 7f2c2b146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:39.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.593+0000 7f2c2b146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:39.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.593+0000 7f2c2b146800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:39.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.593+0000 7f2c2b146800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:39.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.593+0000 7f2c2b146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:39.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.593+0000 7f2c2b146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:39.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.593+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.593+0000 7f2c2b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.593+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:39.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:39.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 20 zone default found 2024-09-12T17:32:39.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 4 Realm: () 2024-09-12T17:32:39.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:39.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:39.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:39.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 20 zonegroup default 2024-09-12T17:32:39.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.594+0000 7f2c2b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.595+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.595+0000 7f2c2b146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.595+0000 7f2c2b146800 20 started sync module instance, tier type = 2024-09-12T17:32:39.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.595+0000 7f2c2b146800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:39.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.609+0000 7f2c2b146800 20 add_watcher() i=0 2024-09-12T17:32:39.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.609+0000 7f2c2b146800 20 add_watcher() i=1 2024-09-12T17:32:39.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.609+0000 7f2c2b146800 20 add_watcher() i=2 2024-09-12T17:32:39.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.609+0000 7f2c2b146800 20 add_watcher() i=3 2024-09-12T17:32:39.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.609+0000 7f2c2b146800 20 add_watcher() i=4 2024-09-12T17:32:39.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.609+0000 7f2c2b146800 20 add_watcher() i=5 2024-09-12T17:32:39.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.610+0000 7f2c2b146800 20 add_watcher() i=6 2024-09-12T17:32:39.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.610+0000 7f2c2b146800 20 add_watcher() i=7 2024-09-12T17:32:39.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.610+0000 7f2c2b146800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:39.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.612+0000 7f2adefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:39.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.613+0000 7f2c2b146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:39.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.613+0000 7f2c2b146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:39.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.613+0000 7f2c2b146800 5 note: GC not initialized 2024-09-12T17:32:39.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.613+0000 7f2addfe3640 20 reqs_thread_entry: start 2024-09-12T17:32:39.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.613+0000 7f2c2b146800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:39.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.613+0000 7f2c2b146800 20 Filter name: none 2024-09-12T17:32:39.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.613+0000 7f2a4f7fe640 20 reqs_thread_entry: start 2024-09-12T17:32:39.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.613+0000 7f2c2b146800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:39.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.613+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.614+0000 7f2c2b146800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:39.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.614+0000 7f2c2b146800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:39.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.614+0000 7f2c2b146800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:39.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.614+0000 7f2c2b146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 : miss 2024-09-12T17:32:39.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.614+0000 7f2c2b146800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.614+0000 7f2c2b146800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:39.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.614+0000 7f2c2b146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 info.flags=0x17 2024-09-12T17:32:39.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.614+0000 7f2c2b146800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 to cache LRU end 2024-09-12T17:32:39.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.614+0000 7f2c2b146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:39.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.614+0000 7f2c2b146800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:39.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.614+0000 7f2c2b146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 2024-09-12T17:32:39.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.614+0000 7f2c2b146800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:39.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.616+0000 7f2c2b146800 1 NOTICE: finished shard 0 (4 entries found) 2024-09-12T17:32:39.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.616+0000 7f2c2b146800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T17:32:39.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.617+0000 7f2adefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:39.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.620+0000 7f2c2b146800 20 remove_watcher() i=0 2024-09-12T17:32:39.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.620+0000 7f2c2b146800 2 removed watcher, disabling cache 2024-09-12T17:32:39.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.621+0000 7f2c2b146800 20 remove_watcher() i=1 2024-09-12T17:32:39.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.622+0000 7f2c2b146800 20 remove_watcher() i=2 2024-09-12T17:32:39.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.624+0000 7f2c2b146800 20 remove_watcher() i=3 2024-09-12T17:32:39.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.625+0000 7f2c2b146800 20 remove_watcher() i=4 2024-09-12T17:32:39.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.626+0000 7f2c2b146800 20 remove_watcher() i=5 2024-09-12T17:32:39.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.627+0000 7f2c2b146800 20 remove_watcher() i=6 2024-09-12T17:32:39.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.628+0000 7f2c2b146800 20 remove_watcher() i=7 2024-09-12T17:32:39.639 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: unlinked entries are not listable 2024-09-12T17:32:39.639 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:39.647 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T17:32:39.647 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:39.735 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T17:32:39.735 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:39.736 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:32:39.771 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:39.772 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:39.808 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.806+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.808+0000 7f2f2470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.808+0000 7f2f2470c800 20 realm 2024-09-12T17:32:39.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.808+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.808+0000 7f2f2470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.808+0000 7f2f2470c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:39.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.808+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.808+0000 7f2f2470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.808+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.809+0000 7f2f2470c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:39.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.809+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.810+0000 7f2f2470c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:39.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.810+0000 7f2f2470c800 20 searching for the correct realm 2024-09-12T17:32:39.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:39.812+0000 7f2f219f5640 0 -- 172.21.15.107:0/3102355181 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f2f18065070 msgr2=0x7f2f180a9e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:40.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.018+0000 7f2f221f6640 0 -- 172.21.15.107:0/3102355181 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f2f180b3f50 msgr2=0x7f2f180a9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:40.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.225+0000 7f2f2470c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:40.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.225+0000 7f2f2470c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:40.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.225+0000 7f2f2470c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:40.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.225+0000 7f2f2470c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:40.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.225+0000 7f2f2470c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:40.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.225+0000 7f2f2470c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:40.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.225+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.225+0000 7f2f2470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.225+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.226+0000 7f2f2470c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:40.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.226+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.226+0000 7f2f2470c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:40.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.226+0000 7f2f2470c800 20 zone default found 2024-09-12T17:32:40.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.226+0000 7f2f2470c800 4 Realm: () 2024-09-12T17:32:40.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.226+0000 7f2f2470c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:40.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.226+0000 7f2f2470c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:40.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.226+0000 7f2f2470c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:40.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.226+0000 7f2f2470c800 20 zonegroup default 2024-09-12T17:32:40.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.226+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.226+0000 7f2f2470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.226+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.227+0000 7f2f2470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.227+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.227+0000 7f2f2470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.227+0000 7f2f2470c800 20 started sync module instance, tier type = 2024-09-12T17:32:40.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.227+0000 7f2f2470c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:40.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.241+0000 7f2f2470c800 20 add_watcher() i=0 2024-09-12T17:32:40.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.241+0000 7f2f2470c800 20 add_watcher() i=1 2024-09-12T17:32:40.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.241+0000 7f2f2470c800 20 add_watcher() i=2 2024-09-12T17:32:40.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.241+0000 7f2f2470c800 20 add_watcher() i=3 2024-09-12T17:32:40.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.241+0000 7f2f2470c800 20 add_watcher() i=4 2024-09-12T17:32:40.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.241+0000 7f2f2470c800 20 add_watcher() i=5 2024-09-12T17:32:40.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.241+0000 7f2f2470c800 20 add_watcher() i=6 2024-09-12T17:32:40.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.242+0000 7f2f2470c800 20 add_watcher() i=7 2024-09-12T17:32:40.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.242+0000 7f2f2470c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:40.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.244+0000 7f2dd8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:40.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.245+0000 7f2f2470c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:40.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.245+0000 7f2f2470c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:40.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.245+0000 7f2f2470c800 5 note: GC not initialized 2024-09-12T17:32:40.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.245+0000 7f2d537fe640 20 reqs_thread_entry: start 2024-09-12T17:32:40.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.245+0000 7f2f2470c800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:40.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.245+0000 7f2f2470c800 20 Filter name: none 2024-09-12T17:32:40.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.245+0000 7f2d517fa640 20 reqs_thread_entry: start 2024-09-12T17:32:40.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.245+0000 7f2f2470c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:40.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.245+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.246+0000 7f2f2470c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.246+0000 7f2f2470c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.246+0000 7f2f2470c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.246+0000 7f2f2470c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 : miss 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.246+0000 7f2f2470c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.246+0000 7f2f2470c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.246+0000 7f2f2470c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 info.flags=0x17 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.246+0000 7f2f2470c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 to cache LRU end 2024-09-12T17:32:40.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.246+0000 7f2f2470c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:40.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.246+0000 7f2f2470c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:40.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.246+0000 7f2f2470c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 2024-09-12T17:32:40.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.246+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.247+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.248+0000 7f2f2470c800 20 get_obj_state: octx=0x55b4ae0569d0 obj=check-bucket:c state=0x55b4ae2f8b28 s->prefetch_data=0 2024-09-12T17:32:40.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.248+0000 7f2f2470c800 20 get_obj_state: setting s->obj_tag to xy4feo900ra4fwl16gs0ymgl9l6wp5nv 2024-09-12T17:32:40.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.248+0000 7f2f2470c800 20 get_obj_state_impl: setting s->olh_tag to pth1nqs3fb2o4taqc077c04q5wd2l177 2024-09-12T17:32:40.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.248+0000 7f2f2470c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pth1nqs3fb2o4taqc077c04q5wd2l177 2024-09-12T17:32:40.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.250+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.251+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.252+0000 7f2f2470c800 20 olh_log_entry: epoch=3 op=3 key=c[F7oIk6DUsot2Z6nfVTMbF.8qDM97k6N] 2024-09-12T17:32:40.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.252+0000 7f2f2470c800 20 get_obj_state: octx=0x55b4ae0569d0 obj=check-bucket:_:F7oIk6DUsot2Z6nfVTMbF.8qDM97k6N_c state=0x55b4ae3345e8 s->prefetch_data=0 2024-09-12T17:32:40.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.252+0000 7f2f2470c800 10 manifest: total_size = 22 2024-09-12T17:32:40.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.252+0000 7f2f2470c800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16723408083118749097 2024-09-12T17:32:40.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.252+0000 7f2f2470c800 20 get_obj_state: octx=0x55b4ae0569d0 obj=check-bucket:_:F7oIk6DUsot2Z6nfVTMbF.8qDM97k6N_c state=0x55b4ae3345e8 s->prefetch_data=0 2024-09-12T17:32:40.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.252+0000 7f2f2470c800 20 prepare_atomic_modification: state is not atomic. state=0x55b4ae3345e8 2024-09-12T17:32:40.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.252+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.257+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.257+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.259+0000 7f2e057fa640 20 handle_completion(): completion ok for obj=c[F7oIk6DUsot2Z6nfVTMbF.8qDM97k6N] 2024-09-12T17:32:40.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.262+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.262+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.262+0000 7f2f2470c800 20 get_obj_state: octx=0x55b4ae0569d0 obj=check-bucket:d state=0x55b4ae2f6fa8 s->prefetch_data=0 2024-09-12T17:32:40.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.263+0000 7f2f2470c800 20 get_obj_state: setting s->obj_tag to q60h4ac0xkf1khrh0z3nxdz52m7awfki 2024-09-12T17:32:40.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.263+0000 7f2f2470c800 20 get_obj_state_impl: setting s->olh_tag to 2rp85jd52xrcyv1gcqulisf7v4nql1gv 2024-09-12T17:32:40.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.263+0000 7f2f2470c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2rp85jd52xrcyv1gcqulisf7v4nql1gv 2024-09-12T17:32:40.266 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.265+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.270+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.270+0000 7f2f2470c800 20 olh_log_entry: epoch=3 op=3 key=d[tEbIpZqK.NgTMbrdrI7Ww-1M..fDc9V] 2024-09-12T17:32:40.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.270+0000 7f2f2470c800 20 get_obj_state: octx=0x55b4ae0569d0 obj=check-bucket:_:tEbIpZqK.NgTMbrdrI7Ww-1M..fDc9V_d state=0x55b4ae3345e8 s->prefetch_data=0 2024-09-12T17:32:40.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.271+0000 7f2f2470c800 10 manifest: total_size = 22 2024-09-12T17:32:40.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.271+0000 7f2f2470c800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.5375103595936753416 2024-09-12T17:32:40.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.271+0000 7f2f2470c800 20 get_obj_state: octx=0x55b4ae0569d0 obj=check-bucket:_:tEbIpZqK.NgTMbrdrI7Ww-1M..fDc9V_d state=0x55b4ae3345e8 s->prefetch_data=0 2024-09-12T17:32:40.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.271+0000 7f2f2470c800 20 prepare_atomic_modification: state is not atomic. state=0x55b4ae3345e8 2024-09-12T17:32:40.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.271+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.278+0000 7f2e057fa640 20 handle_completion(): completion ok for obj=d[tEbIpZqK.NgTMbrdrI7Ww-1M..fDc9V] 2024-09-12T17:32:40.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.278+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.278+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.281+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.281+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.282+0000 7f2f2470c800 20 get_obj_state: octx=0x55b4ae2f7d50 obj=check-bucket:e state=0x55b4ae2f6fa8 s->prefetch_data=0 2024-09-12T17:32:40.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.282+0000 7f2f2470c800 20 get_obj_state: setting s->obj_tag to fi36wlykm2fljm942zepaf4wmrbo364p 2024-09-12T17:32:40.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.282+0000 7f2f2470c800 20 get_obj_state_impl: setting s->olh_tag to ncgk6xxveb75dbng0v2uqc3cuf7v1jil 2024-09-12T17:32:40.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.282+0000 7f2f2470c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ncgk6xxveb75dbng0v2uqc3cuf7v1jil 2024-09-12T17:32:40.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.284+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.285+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.286+0000 7f2f2470c800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:32:40.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.286+0000 7f2f2470c800 20 olh_log_entry: epoch=2 op=3 key=e[i4D3YAEwVUtj--uyHUqKyXx2fXFAhkp] 2024-09-12T17:32:40.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.286+0000 7f2f2470c800 20 get_obj_state: octx=0x55b4ae2f7d50 obj=check-bucket:_:i4D3YAEwVUtj--uyHUqKyXx2fXFAhkp_e state=0x55b4ae3345e8 s->prefetch_data=0 2024-09-12T17:32:40.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.286+0000 7f2f2470c800 10 manifest: total_size = 12 2024-09-12T17:32:40.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.286+0000 7f2f2470c800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.3957802105260212597 2024-09-12T17:32:40.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.286+0000 7f2f2470c800 20 get_obj_state: octx=0x55b4ae2f7d50 obj=check-bucket:_:i4D3YAEwVUtj--uyHUqKyXx2fXFAhkp_e state=0x55b4ae3345e8 s->prefetch_data=0 2024-09-12T17:32:40.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.286+0000 7f2f2470c800 20 prepare_atomic_modification: state is not atomic. state=0x55b4ae3345e8 2024-09-12T17:32:40.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.286+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.291+0000 7f2e05ffb640 20 handle_completion(): completion ok for obj=e[i4D3YAEwVUtj--uyHUqKyXx2fXFAhkp] 2024-09-12T17:32:40.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.291+0000 7f2f2470c800 20 get_obj_state: octx=0x55b4ae2f7d50 obj=check-bucket:e state=0x55b4ae2f6fa8 s->prefetch_data=0 2024-09-12T17:32:40.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.291+0000 7f2f2470c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ncgk6xxveb75dbng0v2uqc3cuf7v1jil 2024-09-12T17:32:40.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.296+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.297+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.298+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.298+0000 7f2f2470c800 20 get_obj_state: octx=0x7f2f1804e7a0 obj=check-bucket:f state=0x55b4ae2f6fa8 s->prefetch_data=0 2024-09-12T17:32:40.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.298+0000 7f2f2470c800 20 get_obj_state: setting s->obj_tag to 6lq14cbu0auhlmdjvd1q31vyvrdw1um8 2024-09-12T17:32:40.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.298+0000 7f2f2470c800 20 get_obj_state_impl: setting s->olh_tag to awde91iuqy1esz1g7axwd1vk877mwm0q 2024-09-12T17:32:40.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.298+0000 7f2f2470c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=awde91iuqy1esz1g7axwd1vk877mwm0q 2024-09-12T17:32:40.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.301+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.302+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.303+0000 7f2f2470c800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:32:40.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.303+0000 7f2f2470c800 20 olh_log_entry: epoch=2 op=3 key=f[1CHPv6rxX-2vaUis-lGW-Ky9dzeitnf] 2024-09-12T17:32:40.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.303+0000 7f2f2470c800 20 get_obj_state: octx=0x7f2f1804e7a0 obj=check-bucket:_:1CHPv6rxX-2vaUis-lGW-Ky9dzeitnf_f state=0x55b4ae33eab8 s->prefetch_data=0 2024-09-12T17:32:40.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.303+0000 7f2f2470c800 10 manifest: total_size = 12 2024-09-12T17:32:40.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.303+0000 7f2f2470c800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7493892361002502247 2024-09-12T17:32:40.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.303+0000 7f2f2470c800 20 get_obj_state: octx=0x7f2f1804e7a0 obj=check-bucket:_:1CHPv6rxX-2vaUis-lGW-Ky9dzeitnf_f state=0x55b4ae33eab8 s->prefetch_data=0 2024-09-12T17:32:40.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.303+0000 7f2f2470c800 20 prepare_atomic_modification: state is not atomic. state=0x55b4ae33eab8 2024-09-12T17:32:40.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.303+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.307+0000 7f2f2470c800 20 get_obj_state: octx=0x7f2f1804e7a0 obj=check-bucket:f state=0x55b4ae2f6fa8 s->prefetch_data=0 2024-09-12T17:32:40.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.307+0000 7f2f2470c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=awde91iuqy1esz1g7axwd1vk877mwm0q 2024-09-12T17:32:40.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.307+0000 7f2e05ffb640 20 handle_completion(): completion ok for obj=f[1CHPv6rxX-2vaUis-lGW-Ky9dzeitnf] 2024-09-12T17:32:40.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.317+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.318+0000 7f2f2470c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.318+0000 7f2f2470c800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T17:32:40.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.318+0000 7f2f2470c800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:32:40.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.319+0000 7f2dd8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:40.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.322+0000 7f2f2470c800 20 remove_watcher() i=0 2024-09-12T17:32:40.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.322+0000 7f2f2470c800 2 removed watcher, disabling cache 2024-09-12T17:32:40.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.323+0000 7f2f2470c800 20 remove_watcher() i=1 2024-09-12T17:32:40.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.324+0000 7f2f2470c800 20 remove_watcher() i=2 2024-09-12T17:32:40.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.325+0000 7f2f2470c800 20 remove_watcher() i=3 2024-09-12T17:32:40.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.326+0000 7f2f2470c800 20 remove_watcher() i=4 2024-09-12T17:32:40.328 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.327+0000 7f2f2470c800 20 remove_watcher() i=5 2024-09-12T17:32:40.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.328+0000 7f2f2470c800 20 remove_watcher() i=6 2024-09-12T17:32:40.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.329+0000 7f2f2470c800 20 remove_watcher() i=7 2024-09-12T17:32:40.352 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T17:32:40.352 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:40.407 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T17:32:40.408 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:40.409 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:32:40.441 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:40.441 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:40.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.476+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.478+0000 7f1990139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.478+0000 7f1990139800 20 realm 2024-09-12T17:32:40.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.478+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.478+0000 7f1990139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.478+0000 7f1990139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:40.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.478+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.478+0000 7f1990139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.478+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.479+0000 7f1990139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:40.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.479+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.479+0000 7f1990139800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:40.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.479+0000 7f1990139800 20 searching for the correct realm 2024-09-12T17:32:40.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.483+0000 7f1983fff640 0 -- 172.21.15.107:0/1601682364 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f1974093070 msgr2=0x7f19740941b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:40.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.486+0000 7f198c5c8640 0 -- 172.21.15.107:0/1601682364 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7f197408a810 msgr2=0x7f1974058050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:40.492 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.489+0000 7f1990139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:40.492 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.489+0000 7f1990139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:40.492 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.489+0000 7f1990139800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:40.492 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.489+0000 7f1990139800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.489+0000 7f1990139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.489+0000 7f1990139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.489+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.489+0000 7f1990139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.489+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 20 zone default found 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 4 Realm: () 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:40.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:40.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 20 zonegroup default 2024-09-12T17:32:40.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.490+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.491+0000 7f1990139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.491+0000 7f1990139800 20 started sync module instance, tier type = 2024-09-12T17:32:40.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.491+0000 7f1990139800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:40.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.506+0000 7f1990139800 20 add_watcher() i=0 2024-09-12T17:32:40.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.506+0000 7f1990139800 20 add_watcher() i=1 2024-09-12T17:32:40.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.506+0000 7f1990139800 20 add_watcher() i=2 2024-09-12T17:32:40.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.506+0000 7f1990139800 20 add_watcher() i=3 2024-09-12T17:32:40.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.506+0000 7f1990139800 20 add_watcher() i=4 2024-09-12T17:32:40.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.506+0000 7f1990139800 20 add_watcher() i=5 2024-09-12T17:32:40.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.506+0000 7f1990139800 20 add_watcher() i=6 2024-09-12T17:32:40.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.508+0000 7f1990139800 20 add_watcher() i=7 2024-09-12T17:32:40.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.508+0000 7f1990139800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:40.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.511+0000 7f1841fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:40.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.512+0000 7f1990139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:40.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.512+0000 7f1990139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:40.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.512+0000 7f1990139800 5 note: GC not initialized 2024-09-12T17:32:40.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.512+0000 7f1840fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:40.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.512+0000 7f1990139800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:40.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.512+0000 7f1990139800 20 Filter name: none 2024-09-12T17:32:40.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.512+0000 7f17ba7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:40.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.512+0000 7f1990139800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:40.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.512+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.513+0000 7f1990139800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:40.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.513+0000 7f1990139800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:40.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.513+0000 7f1990139800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:40.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.513+0000 7f1990139800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 : miss 2024-09-12T17:32:40.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.513+0000 7f1990139800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.513+0000 7f1990139800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:40.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.513+0000 7f1990139800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 info.flags=0x17 2024-09-12T17:32:40.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.513+0000 7f1990139800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 to cache LRU end 2024-09-12T17:32:40.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.513+0000 7f1990139800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:40.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.513+0000 7f1990139800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:40.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.513+0000 7f1990139800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 2024-09-12T17:32:40.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.514+0000 7f1990139800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.514+0000 7f1990139800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:32:40.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.514+0000 7f1990139800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:32:40.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.515+0000 7f1841fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:40.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.519+0000 7f1990139800 20 remove_watcher() i=0 2024-09-12T17:32:40.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.519+0000 7f1990139800 2 removed watcher, disabling cache 2024-09-12T17:32:40.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.520+0000 7f1990139800 20 remove_watcher() i=1 2024-09-12T17:32:40.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.522+0000 7f1990139800 20 remove_watcher() i=2 2024-09-12T17:32:40.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.523+0000 7f1990139800 20 remove_watcher() i=3 2024-09-12T17:32:40.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.525+0000 7f1990139800 20 remove_watcher() i=4 2024-09-12T17:32:40.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.526+0000 7f1990139800 20 remove_watcher() i=5 2024-09-12T17:32:40.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.527+0000 7f1990139800 20 remove_watcher() i=6 2024-09-12T17:32:40.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.528+0000 7f1990139800 20 remove_watcher() i=7 2024-09-12T17:32:40.584 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:32:40.613 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:40.613 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:40.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.648+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.650+0000 7feba3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.650+0000 7feba3b23800 20 realm 2024-09-12T17:32:40.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.650+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.650+0000 7feba3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.650+0000 7feba3b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:40.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.650+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.650+0000 7feba3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.650+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.651+0000 7feba3b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:40.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.651+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.652+0000 7feba3b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:40.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.652+0000 7feba3b23800 20 searching for the correct realm 2024-09-12T17:32:40.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.654+0000 7feb9f012640 0 -- 172.21.15.107:0/3173461758 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7feb94034060 msgr2=0x7feb94066850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:40.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.657+0000 7feb9f813640 0 -- 172.21.15.107:0/3173461758 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7feb940708d0 msgr2=0x7feb940899a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:40.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.862+0000 7feba3b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:40.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.862+0000 7feba3b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:40.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.862+0000 7feba3b23800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:40.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.862+0000 7feba3b23800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:40.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.862+0000 7feba3b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:40.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.862+0000 7feba3b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:40.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.862+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 20 zone default found 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 4 Realm: () 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 20 zonegroup default 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.863+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.864+0000 7feba3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.864+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.864+0000 7feba3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.864+0000 7feba3b23800 20 started sync module instance, tier type = 2024-09-12T17:32:40.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.864+0000 7feba3b23800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:40.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.880+0000 7feba3b23800 20 add_watcher() i=0 2024-09-12T17:32:40.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.880+0000 7feba3b23800 20 add_watcher() i=1 2024-09-12T17:32:40.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.880+0000 7feba3b23800 20 add_watcher() i=2 2024-09-12T17:32:40.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.880+0000 7feba3b23800 20 add_watcher() i=3 2024-09-12T17:32:40.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.880+0000 7feba3b23800 20 add_watcher() i=4 2024-09-12T17:32:40.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.880+0000 7feba3b23800 20 add_watcher() i=5 2024-09-12T17:32:40.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.880+0000 7feba3b23800 20 add_watcher() i=6 2024-09-12T17:32:40.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.883+0000 7feba3b23800 20 add_watcher() i=7 2024-09-12T17:32:40.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.883+0000 7feba3b23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:40.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.885+0000 7fea55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:40.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.885+0000 7feba3b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:40.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.885+0000 7feba3b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:40.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.885+0000 7feba3b23800 5 note: GC not initialized 2024-09-12T17:32:40.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.885+0000 7fea54fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:40.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.885+0000 7feba3b23800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:40.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.886+0000 7feba3b23800 20 Filter name: none 2024-09-12T17:32:40.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.886+0000 7fe9ce7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:40.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.886+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.886+0000 7feba3b23800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:40.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.886+0000 7feba3b23800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.886+0000 7feba3b23800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:40.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.886+0000 7feba3b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:40.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.886+0000 7feba3b23800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:32:40.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.886+0000 7feba3b23800 20 INFO: main: starting shard=0 2024-09-12T17:32:40.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.886+0000 7feba3b23800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:40.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.887+0000 7feba3b23800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:32:40.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.887+0000 7feba3b23800 20 INFO: main: done 2024-09-12T17:32:40.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.888+0000 7fea55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:40.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.890+0000 7feba3b23800 20 remove_watcher() i=0 2024-09-12T17:32:40.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.890+0000 7feba3b23800 2 removed watcher, disabling cache 2024-09-12T17:32:40.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.891+0000 7feba3b23800 20 remove_watcher() i=1 2024-09-12T17:32:40.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.892+0000 7feba3b23800 20 remove_watcher() i=2 2024-09-12T17:32:40.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.893+0000 7feba3b23800 20 remove_watcher() i=3 2024-09-12T17:32:40.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.894+0000 7feba3b23800 20 remove_watcher() i=4 2024-09-12T17:32:40.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.895+0000 7feba3b23800 20 remove_watcher() i=5 2024-09-12T17:32:40.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.895+0000 7feba3b23800 20 remove_watcher() i=6 2024-09-12T17:32:40.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.896+0000 7feba3b23800 20 remove_watcher() i=7 2024-09-12T17:32:40.909 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:32:40.940 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:40.940 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:40.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.979+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.980+0000 7f761e730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.980+0000 7f761e730800 20 realm 2024-09-12T17:32:40.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.980+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.981+0000 7f761e730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.981+0000 7f761e730800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:40.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.981+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.981+0000 7f761e730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.981+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.981+0000 7f761e730800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:40.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.982+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.982+0000 7f761e730800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:40.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.982+0000 7f761e730800 20 searching for the correct realm 2024-09-12T17:32:40.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.985+0000 7f761acb1640 0 -- 172.21.15.107:0/3968303356 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55dc1f0033c0 msgr2=0x55dc1f005860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:40.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.988+0000 7f761a4b0640 0 -- 172.21.15.107:0/3968303356 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f7604067030 msgr2=0x7f760409c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:40.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.992+0000 7f761e730800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:40.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.992+0000 7f761e730800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:40.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.992+0000 7f761e730800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:40.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.992+0000 7f761e730800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:40.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.992+0000 7f761e730800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:40.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.992+0000 7f761e730800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:40.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.992+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.992+0000 7f761e730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.992+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.992+0000 7f761e730800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:40.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.992+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:40.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 20 zone default found 2024-09-12T17:32:40.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 4 Realm: () 2024-09-12T17:32:40.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:40.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:40.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:40.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 20 zonegroup default 2024-09-12T17:32:40.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 20 started sync module instance, tier type = 2024-09-12T17:32:40.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:40.993+0000 7f761e730800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:41.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.008+0000 7f761e730800 20 add_watcher() i=0 2024-09-12T17:32:41.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.008+0000 7f761e730800 20 add_watcher() i=1 2024-09-12T17:32:41.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.008+0000 7f761e730800 20 add_watcher() i=2 2024-09-12T17:32:41.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.008+0000 7f761e730800 20 add_watcher() i=3 2024-09-12T17:32:41.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.008+0000 7f761e730800 20 add_watcher() i=4 2024-09-12T17:32:41.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.008+0000 7f761e730800 20 add_watcher() i=5 2024-09-12T17:32:41.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.009+0000 7f761e730800 20 add_watcher() i=6 2024-09-12T17:32:41.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.009+0000 7f761e730800 20 add_watcher() i=7 2024-09-12T17:32:41.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.009+0000 7f761e730800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:41.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.011+0000 7f74d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.011+0000 7f761e730800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:41.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.011+0000 7f761e730800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:41.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.011+0000 7f761e730800 5 note: GC not initialized 2024-09-12T17:32:41.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.011+0000 7f744b7fe640 20 reqs_thread_entry: start 2024-09-12T17:32:41.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.012+0000 7f761e730800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:41.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.012+0000 7f761e730800 20 Filter name: none 2024-09-12T17:32:41.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.012+0000 7f74497fa640 20 reqs_thread_entry: start 2024-09-12T17:32:41.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.012+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.012+0000 7f761e730800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:41.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.012+0000 7f761e730800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.013+0000 7f761e730800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:41.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.013+0000 7f761e730800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:41.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.013+0000 7f761e730800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:32:41.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.013+0000 7f761e730800 20 INFO: main: starting shard=0 2024-09-12T17:32:41.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.013+0000 7f761e730800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:41.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.013+0000 7f761e730800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:32:41.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.013+0000 7f761e730800 20 INFO: main: done 2024-09-12T17:32:41.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.014+0000 7f74d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.016+0000 7f761e730800 20 remove_watcher() i=0 2024-09-12T17:32:41.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.016+0000 7f761e730800 2 removed watcher, disabling cache 2024-09-12T17:32:41.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.017+0000 7f761e730800 20 remove_watcher() i=1 2024-09-12T17:32:41.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.019+0000 7f761e730800 20 remove_watcher() i=2 2024-09-12T17:32:41.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.020+0000 7f761e730800 20 remove_watcher() i=3 2024-09-12T17:32:41.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.021+0000 7f761e730800 20 remove_watcher() i=4 2024-09-12T17:32:41.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.022+0000 7f761e730800 20 remove_watcher() i=5 2024-09-12T17:32:41.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.023+0000 7f761e730800 20 remove_watcher() i=6 2024-09-12T17:32:41.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.024+0000 7f761e730800 20 remove_watcher() i=7 2024-09-12T17:32:41.036 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T17:32:41.036 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:41.037 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:32:41.068 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:41.068 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:41.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.102+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.104+0000 7fb33252b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.104+0000 7fb33252b800 20 realm 2024-09-12T17:32:41.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.104+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.104+0000 7fb33252b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.104+0000 7fb33252b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:41.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.104+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.104+0000 7fb33252b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.104+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.105+0000 7fb33252b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.105+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.105+0000 7fb33252b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:41.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.106+0000 7fb33252b800 20 searching for the correct realm 2024-09-12T17:32:41.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.109+0000 7fb32ea74640 0 -- 172.21.15.107:0/3263125576 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x55ddf8336c70 msgr2=0x55ddf8339100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:41.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.112+0000 7fb327fff640 0 -- 172.21.15.107:0/3263125576 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fb318076410 msgr2=0x7fb31806e560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:41.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.115+0000 7fb33252b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:41.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.115+0000 7fb33252b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.115+0000 7fb33252b800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.115+0000 7fb33252b800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.115+0000 7fb33252b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.115+0000 7fb33252b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.115+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.115+0000 7fb33252b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.115+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.115+0000 7fb33252b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 20 zone default found 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 4 Realm: () 2024-09-12T17:32:41.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:41.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:41.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:41.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 20 zonegroup default 2024-09-12T17:32:41.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.116+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.117+0000 7fb33252b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.117+0000 7fb33252b800 20 started sync module instance, tier type = 2024-09-12T17:32:41.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.117+0000 7fb33252b800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:41.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.131+0000 7fb33252b800 20 add_watcher() i=0 2024-09-12T17:32:41.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.131+0000 7fb33252b800 20 add_watcher() i=1 2024-09-12T17:32:41.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.131+0000 7fb33252b800 20 add_watcher() i=2 2024-09-12T17:32:41.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.131+0000 7fb33252b800 20 add_watcher() i=3 2024-09-12T17:32:41.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.131+0000 7fb33252b800 20 add_watcher() i=4 2024-09-12T17:32:41.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.131+0000 7fb33252b800 20 add_watcher() i=5 2024-09-12T17:32:41.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.131+0000 7fb33252b800 20 add_watcher() i=6 2024-09-12T17:32:41.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.132+0000 7fb33252b800 20 add_watcher() i=7 2024-09-12T17:32:41.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.132+0000 7fb33252b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:41.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.134+0000 7fb1e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.134+0000 7fb33252b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:41.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.134+0000 7fb33252b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:41.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.134+0000 7fb33252b800 5 note: GC not initialized 2024-09-12T17:32:41.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.134+0000 7fb15f7fe640 20 reqs_thread_entry: start 2024-09-12T17:32:41.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.135+0000 7fb33252b800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:41.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.135+0000 7fb33252b800 20 Filter name: none 2024-09-12T17:32:41.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.135+0000 7fb15d7fa640 20 reqs_thread_entry: start 2024-09-12T17:32:41.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.135+0000 7fb33252b800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:41.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.135+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.135+0000 7fb33252b800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:41.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.135+0000 7fb33252b800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:41.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.135+0000 7fb33252b800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:41.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.135+0000 7fb33252b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 : miss 2024-09-12T17:32:41.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.135+0000 7fb33252b800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.136+0000 7fb33252b800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:41.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.136+0000 7fb33252b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 info.flags=0x17 2024-09-12T17:32:41.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.136+0000 7fb33252b800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 to cache LRU end 2024-09-12T17:32:41.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.136+0000 7fb33252b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:41.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.136+0000 7fb33252b800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:41.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.136+0000 7fb33252b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 2024-09-12T17:32:41.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.136+0000 7fb33252b800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:41.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.136+0000 7fb33252b800 1 NOTICE: finished shard 0 (2 entries found) 2024-09-12T17:32:41.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.136+0000 7fb33252b800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T17:32:41.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.137+0000 7fb1e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.140+0000 7fb33252b800 20 remove_watcher() i=0 2024-09-12T17:32:41.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.140+0000 7fb33252b800 2 removed watcher, disabling cache 2024-09-12T17:32:41.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.141+0000 7fb33252b800 20 remove_watcher() i=1 2024-09-12T17:32:41.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.142+0000 7fb33252b800 20 remove_watcher() i=2 2024-09-12T17:32:41.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.144+0000 7fb33252b800 20 remove_watcher() i=3 2024-09-12T17:32:41.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.145+0000 7fb33252b800 20 remove_watcher() i=4 2024-09-12T17:32:41.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.146+0000 7fb33252b800 20 remove_watcher() i=5 2024-09-12T17:32:41.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.147+0000 7fb33252b800 20 remove_watcher() i=6 2024-09-12T17:32:41.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.148+0000 7fb33252b800 20 remove_watcher() i=7 2024-09-12T17:32:41.159 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T17:32:41.159 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:41.160 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:32:41.193 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:41.193 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:41.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.228+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.229+0000 7f06ce33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.229+0000 7f06ce33d800 20 realm 2024-09-12T17:32:41.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.229+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.230+0000 7f06ce33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.230+0000 7f06ce33d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:41.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.230+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.230+0000 7f06ce33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.230+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.231+0000 7f06ce33d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.231+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.231+0000 7f06ce33d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:41.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.231+0000 7f06ce33d800 20 searching for the correct realm 2024-09-12T17:32:41.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.234+0000 7f06c1829640 0 -- 172.21.15.107:0/703399611 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f06b4035030 msgr2=0x7f06b4041460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:41.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.237+0000 7f06ca82b640 0 -- 172.21.15.107:0/703399611 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7f06b4029070 msgr2=0x7f06b40408d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:41.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.241+0000 7f06ce33d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:41.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.241+0000 7f06ce33d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:41.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.241+0000 7f06ce33d800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:41.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.241+0000 7f06ce33d800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:41.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.241+0000 7f06ce33d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:41.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.241+0000 7f06ce33d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:41.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.241+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.241+0000 7f06ce33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.241+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 20 zone default found 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 4 Realm: () 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 20 zonegroup default 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.242+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.243+0000 7f06ce33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.243+0000 7f06ce33d800 20 started sync module instance, tier type = 2024-09-12T17:32:41.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.243+0000 7f06ce33d800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:41.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.253+0000 7f06ce33d800 20 add_watcher() i=0 2024-09-12T17:32:41.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.253+0000 7f06ce33d800 20 add_watcher() i=1 2024-09-12T17:32:41.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.253+0000 7f06ce33d800 20 add_watcher() i=2 2024-09-12T17:32:41.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.253+0000 7f06ce33d800 20 add_watcher() i=3 2024-09-12T17:32:41.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.253+0000 7f06ce33d800 20 add_watcher() i=4 2024-09-12T17:32:41.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.253+0000 7f06ce33d800 20 add_watcher() i=5 2024-09-12T17:32:41.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.253+0000 7f06ce33d800 20 add_watcher() i=6 2024-09-12T17:32:41.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.254+0000 7f06ce33d800 20 add_watcher() i=7 2024-09-12T17:32:41.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.254+0000 7f06ce33d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:41.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.256+0000 7f0580fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.256+0000 7f06ce33d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.256+0000 7f06ce33d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.256+0000 7f06ce33d800 5 note: GC not initialized 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.257+0000 7f04fb7fe640 20 reqs_thread_entry: start 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.257+0000 7f06ce33d800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.257+0000 7f06ce33d800 20 Filter name: none 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.257+0000 7f04f97fa640 20 reqs_thread_entry: start 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.257+0000 7f06ce33d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.257+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.257+0000 7f06ce33d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.257+0000 7f06ce33d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.257+0000 7f06ce33d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.257+0000 7f06ce33d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 : miss 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.257+0000 7f06ce33d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.258+0000 7f06ce33d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.258+0000 7f06ce33d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 info.flags=0x17 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.258+0000 7f06ce33d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 to cache LRU end 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.258+0000 7f06ce33d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.258+0000 7f06ce33d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.258+0000 7f06ce33d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 2024-09-12T17:32:41.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.258+0000 7f06ce33d800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:41.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.259+0000 7f06ce33d800 20 get_obj_state: octx=0x558936e189c0 obj=check-bucket:c state=0x5589370c0f78 s->prefetch_data=0 2024-09-12T17:32:41.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.259+0000 7f06ce33d800 20 get_obj_state: setting s->obj_tag to xy4feo900ra4fwl16gs0ymgl9l6wp5nv 2024-09-12T17:32:41.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.259+0000 7f06ce33d800 20 get_obj_state_impl: setting s->olh_tag to pth1nqs3fb2o4taqc077c04q5wd2l177 2024-09-12T17:32:41.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.259+0000 7f06ce33d800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:41.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.260+0000 7f06ce33d800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T17:32:41.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.260+0000 7f06ce33d800 20 olh_log_entry: epoch=4 op=3 key=c[tI3Xll8QQ.b6Xb2KKpjTJ2JHxSdkRws] 2024-09-12T17:32:41.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.260+0000 7f06ce33d800 20 get_obj_state: octx=0x5589370f60b0 obj=check-bucket:_:tI3Xll8QQ.b6Xb2KKpjTJ2JHxSdkRws_c state=0x5589370bb348 s->prefetch_data=0 2024-09-12T17:32:41.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.261+0000 7f06ce33d800 20 get_obj_state: octx=0x5589370f60b0 obj=check-bucket:c state=0x5589370f6a98 s->prefetch_data=0 2024-09-12T17:32:41.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.262+0000 7f06ce33d800 20 get_obj_state: setting s->obj_tag to xy4feo900ra4fwl16gs0ymgl9l6wp5nv 2024-09-12T17:32:41.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.262+0000 7f06ce33d800 20 get_obj_state_impl: setting s->olh_tag to pth1nqs3fb2o4taqc077c04q5wd2l177 2024-09-12T17:32:41.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.262+0000 7f06ce33d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pth1nqs3fb2o4taqc077c04q5wd2l177 2024-09-12T17:32:41.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.264+0000 7f06ce33d800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:41.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.266+0000 7f06ce33d800 20 get_obj_state: octx=0x558936e189c0 obj=check-bucket:d state=0x5589370c0f78 s->prefetch_data=0 2024-09-12T17:32:41.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.266+0000 7f06ce33d800 20 get_obj_state: setting s->obj_tag to q60h4ac0xkf1khrh0z3nxdz52m7awfki 2024-09-12T17:32:41.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.266+0000 7f06ce33d800 20 get_obj_state_impl: setting s->olh_tag to 2rp85jd52xrcyv1gcqulisf7v4nql1gv 2024-09-12T17:32:41.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.266+0000 7f06ce33d800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:41.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.267+0000 7f06ce33d800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T17:32:41.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.267+0000 7f06ce33d800 20 olh_log_entry: epoch=4 op=3 key=d[pqlg2gDL.uCbL7IXWy5BHWQxOCaappq] 2024-09-12T17:32:41.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.267+0000 7f06ce33d800 20 get_obj_state: octx=0x5589370f60b0 obj=check-bucket:_:pqlg2gDL.uCbL7IXWy5BHWQxOCaappq_d state=0x5589370f9f28 s->prefetch_data=0 2024-09-12T17:32:41.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.269+0000 7f06ce33d800 20 get_obj_state: octx=0x5589370f60b0 obj=check-bucket:d state=0x5589370ba338 s->prefetch_data=0 2024-09-12T17:32:41.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.269+0000 7f06ce33d800 20 get_obj_state: setting s->obj_tag to q60h4ac0xkf1khrh0z3nxdz52m7awfki 2024-09-12T17:32:41.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.269+0000 7f06ce33d800 20 get_obj_state_impl: setting s->olh_tag to 2rp85jd52xrcyv1gcqulisf7v4nql1gv 2024-09-12T17:32:41.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.269+0000 7f06ce33d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2rp85jd52xrcyv1gcqulisf7v4nql1gv 2024-09-12T17:32:41.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.273+0000 7f06ce33d800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:41.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.275+0000 7f06ce33d800 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-12T17:32:41.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.275+0000 7f06ce33d800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T17:32:41.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.275+0000 7f0580fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.277+0000 7f06ce33d800 20 remove_watcher() i=0 2024-09-12T17:32:41.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.277+0000 7f06ce33d800 2 removed watcher, disabling cache 2024-09-12T17:32:41.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.278+0000 7f06ce33d800 20 remove_watcher() i=1 2024-09-12T17:32:41.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.280+0000 7f06ce33d800 20 remove_watcher() i=2 2024-09-12T17:32:41.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.281+0000 7f06ce33d800 20 remove_watcher() i=3 2024-09-12T17:32:41.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.282+0000 7f06ce33d800 20 remove_watcher() i=4 2024-09-12T17:32:41.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.283+0000 7f06ce33d800 20 remove_watcher() i=5 2024-09-12T17:32:41.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.284+0000 7f06ce33d800 20 remove_watcher() i=6 2024-09-12T17:32:41.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.285+0000 7f06ce33d800 20 remove_watcher() i=7 2024-09-12T17:32:41.298 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:32:41.328 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:41.328 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:41.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.362+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.364+0000 7feb78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.364+0000 7feb78b46800 20 realm 2024-09-12T17:32:41.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.364+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.364+0000 7feb78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.364+0000 7feb78b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:41.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.364+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.364+0000 7feb78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.364+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.365+0000 7feb78b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.365+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.365+0000 7feb78b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:41.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.365+0000 7feb78b46800 20 searching for the correct realm 2024-09-12T17:32:41.370 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.369+0000 7feb75e36640 0 -- 172.21.15.107:0/2742206595 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7feb6c062910 msgr2=0x7feb6c0773f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:41.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.372+0000 7feb76e38640 0 -- 172.21.15.107:0/2742206595 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7feb6c088040 msgr2=0x7feb6c0878c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:41.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.375+0000 7feb78b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:41.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.375+0000 7feb78b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:41.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.375+0000 7feb78b46800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:41.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.375+0000 7feb78b46800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:41.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.375+0000 7feb78b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:41.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.375+0000 7feb78b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:41.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.375+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.375+0000 7feb78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.375+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.375+0000 7feb78b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.375+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.376+0000 7feb78b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.376+0000 7feb78b46800 20 zone default found 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.376+0000 7feb78b46800 4 Realm: () 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.376+0000 7feb78b46800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.376+0000 7feb78b46800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.376+0000 7feb78b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.376+0000 7feb78b46800 20 zonegroup default 2024-09-12T17:32:41.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.376+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.376+0000 7feb78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.376+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.376+0000 7feb78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.376+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.377+0000 7feb78b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.377+0000 7feb78b46800 20 started sync module instance, tier type = 2024-09-12T17:32:41.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.377+0000 7feb78b46800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:41.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.390+0000 7feb78b46800 20 add_watcher() i=0 2024-09-12T17:32:41.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.390+0000 7feb78b46800 20 add_watcher() i=1 2024-09-12T17:32:41.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.390+0000 7feb78b46800 20 add_watcher() i=2 2024-09-12T17:32:41.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.390+0000 7feb78b46800 20 add_watcher() i=3 2024-09-12T17:32:41.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.390+0000 7feb78b46800 20 add_watcher() i=4 2024-09-12T17:32:41.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.390+0000 7feb78b46800 20 add_watcher() i=5 2024-09-12T17:32:41.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.390+0000 7feb78b46800 20 add_watcher() i=6 2024-09-12T17:32:41.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.393+0000 7feb78b46800 20 add_watcher() i=7 2024-09-12T17:32:41.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.393+0000 7feb78b46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:41.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.394+0000 7fea2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.395+0000 7feb78b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:41.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.395+0000 7feb78b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:41.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.395+0000 7feb78b46800 5 note: GC not initialized 2024-09-12T17:32:41.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.395+0000 7fe9a77fe640 20 reqs_thread_entry: start 2024-09-12T17:32:41.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.395+0000 7feb78b46800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:41.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.395+0000 7feb78b46800 20 Filter name: none 2024-09-12T17:32:41.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.395+0000 7fe9a57fa640 20 reqs_thread_entry: start 2024-09-12T17:32:41.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.395+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.396+0000 7feb78b46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:41.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.396+0000 7feb78b46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.396+0000 7feb78b46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:41.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.396+0000 7feb78b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:41.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.396+0000 7feb78b46800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:32:41.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.396+0000 7feb78b46800 20 INFO: main: starting shard=0 2024-09-12T17:32:41.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.396+0000 7feb78b46800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:41.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.397+0000 7feb78b46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:41.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.397+0000 7feb78b46800 20 INFO: main: done 2024-09-12T17:32:41.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.397+0000 7fea2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.399+0000 7feb78b46800 20 remove_watcher() i=0 2024-09-12T17:32:41.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.399+0000 7feb78b46800 2 removed watcher, disabling cache 2024-09-12T17:32:41.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.400+0000 7feb78b46800 20 remove_watcher() i=1 2024-09-12T17:32:41.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.401+0000 7feb78b46800 20 remove_watcher() i=2 2024-09-12T17:32:41.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.402+0000 7feb78b46800 20 remove_watcher() i=3 2024-09-12T17:32:41.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.403+0000 7feb78b46800 20 remove_watcher() i=4 2024-09-12T17:32:41.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.404+0000 7feb78b46800 20 remove_watcher() i=5 2024-09-12T17:32:41.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.405+0000 7feb78b46800 20 remove_watcher() i=6 2024-09-12T17:32:41.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.406+0000 7feb78b46800 20 remove_watcher() i=7 2024-09-12T17:32:41.418 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:32:41.449 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:41.449 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:41.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.485+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.486+0000 7f5725a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.486+0000 7f5725a12800 20 realm 2024-09-12T17:32:41.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.486+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.486+0000 7f5725a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.486+0000 7f5725a12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:41.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.486+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.487+0000 7f5725a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.487+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.487+0000 7f5725a12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.487+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.488+0000 7f5725a12800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:41.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.488+0000 7f5725a12800 20 searching for the correct realm 2024-09-12T17:32:41.492 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.491+0000 7f57218cc640 0 -- 172.21.15.107:0/228548375 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x5627c2265230 msgr2=0x5627c22676f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:41.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.494+0000 7f57210cb640 0 -- 172.21.15.107:0/228548375 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f570c0988c0 msgr2=0x7f570c00d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:41.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.497+0000 7f5725a12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:41.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.497+0000 7f5725a12800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:41.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.497+0000 7f5725a12800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:41.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.497+0000 7f5725a12800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:41.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.497+0000 7f5725a12800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:41.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.497+0000 7f5725a12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:41.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.497+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.498+0000 7f5725a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.498+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.498+0000 7f5725a12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.498+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:41.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 20 zone default found 2024-09-12T17:32:41.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 4 Realm: () 2024-09-12T17:32:41.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:41.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:41.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:41.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 20 zonegroup default 2024-09-12T17:32:41.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 20 started sync module instance, tier type = 2024-09-12T17:32:41.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.499+0000 7f5725a12800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:41.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.508+0000 7f5725a12800 20 add_watcher() i=0 2024-09-12T17:32:41.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.508+0000 7f5725a12800 20 add_watcher() i=1 2024-09-12T17:32:41.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.508+0000 7f5725a12800 20 add_watcher() i=2 2024-09-12T17:32:41.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.508+0000 7f5725a12800 20 add_watcher() i=3 2024-09-12T17:32:41.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.508+0000 7f5725a12800 20 add_watcher() i=4 2024-09-12T17:32:41.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.508+0000 7f5725a12800 20 add_watcher() i=5 2024-09-12T17:32:41.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.508+0000 7f5725a12800 20 add_watcher() i=6 2024-09-12T17:32:41.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.509+0000 7f5725a12800 20 add_watcher() i=7 2024-09-12T17:32:41.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.509+0000 7f5725a12800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:41.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.510+0000 7f55d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.511+0000 7f5725a12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:41.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.511+0000 7f5725a12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:41.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.511+0000 7f5725a12800 5 note: GC not initialized 2024-09-12T17:32:41.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.511+0000 7f55d67e4640 20 reqs_thread_entry: start 2024-09-12T17:32:41.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.511+0000 7f5725a12800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:41.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.511+0000 7f5725a12800 20 Filter name: none 2024-09-12T17:32:41.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.511+0000 7f5547fff640 20 reqs_thread_entry: start 2024-09-12T17:32:41.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.511+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.512+0000 7f5725a12800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:41.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.512+0000 7f5725a12800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.512+0000 7f5725a12800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:41.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.512+0000 7f5725a12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:41.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.512+0000 7f5725a12800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:32:41.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.512+0000 7f5725a12800 20 INFO: main: starting shard=0 2024-09-12T17:32:41.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.512+0000 7f5725a12800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:41.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.513+0000 7f5725a12800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:41.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.513+0000 7f5725a12800 20 INFO: main: done 2024-09-12T17:32:41.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.513+0000 7f55d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.516+0000 7f5725a12800 20 remove_watcher() i=0 2024-09-12T17:32:41.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.516+0000 7f5725a12800 2 removed watcher, disabling cache 2024-09-12T17:32:41.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.517+0000 7f5725a12800 20 remove_watcher() i=1 2024-09-12T17:32:41.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.518+0000 7f5725a12800 20 remove_watcher() i=2 2024-09-12T17:32:41.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.519+0000 7f5725a12800 20 remove_watcher() i=3 2024-09-12T17:32:41.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.520+0000 7f5725a12800 20 remove_watcher() i=4 2024-09-12T17:32:41.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.521+0000 7f5725a12800 20 remove_watcher() i=5 2024-09-12T17:32:41.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.522+0000 7f5725a12800 20 remove_watcher() i=6 2024-09-12T17:32:41.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.523+0000 7f5725a12800 20 remove_watcher() i=7 2024-09-12T17:32:41.534 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T17:32:41.535 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:41.536 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:32:41.567 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:41.567 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:41.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.602+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.603+0000 7fd782324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.603+0000 7fd782324800 20 realm 2024-09-12T17:32:41.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.603+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.604+0000 7fd782324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.604+0000 7fd782324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:41.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.604+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.604+0000 7fd782324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.604+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.605+0000 7fd782324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.605+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.605+0000 7fd782324800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:41.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.605+0000 7fd782324800 20 searching for the correct realm 2024-09-12T17:32:41.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.608+0000 7fd77e757640 0 -- 172.21.15.107:0/2903209719 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x563ae783fbf0 msgr2=0x563ae78420b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:41.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.611+0000 7fd77df56640 0 -- 172.21.15.107:0/2903209719 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fd7680a4420 msgr2=0x7fd7680a48a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:41.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.615+0000 7fd782324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.615+0000 7fd782324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.615+0000 7fd782324800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.615+0000 7fd782324800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.615+0000 7fd782324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.615+0000 7fd782324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.615+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 20 zone default found 2024-09-12T17:32:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 4 Realm: () 2024-09-12T17:32:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 20 zonegroup default 2024-09-12T17:32:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.616+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.617+0000 7fd782324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.617+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.617+0000 7fd782324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.617+0000 7fd782324800 20 started sync module instance, tier type = 2024-09-12T17:32:41.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.617+0000 7fd782324800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:41.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.627+0000 7fd782324800 20 add_watcher() i=0 2024-09-12T17:32:41.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.627+0000 7fd782324800 20 add_watcher() i=1 2024-09-12T17:32:41.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.627+0000 7fd782324800 20 add_watcher() i=2 2024-09-12T17:32:41.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.627+0000 7fd782324800 20 add_watcher() i=3 2024-09-12T17:32:41.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.627+0000 7fd782324800 20 add_watcher() i=4 2024-09-12T17:32:41.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.627+0000 7fd782324800 20 add_watcher() i=5 2024-09-12T17:32:41.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.627+0000 7fd782324800 20 add_watcher() i=6 2024-09-12T17:32:41.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.627+0000 7fd782324800 20 add_watcher() i=7 2024-09-12T17:32:41.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.627+0000 7fd782324800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:41.630 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.629+0000 7fd62f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.629+0000 7fd782324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:41.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.629+0000 7fd782324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:41.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.629+0000 7fd782324800 5 note: GC not initialized 2024-09-12T17:32:41.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.629+0000 7fd62e7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:41.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.630+0000 7fd782324800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:41.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.630+0000 7fd782324800 20 Filter name: none 2024-09-12T17:32:41.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.630+0000 7fd59ffff640 20 reqs_thread_entry: start 2024-09-12T17:32:41.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.630+0000 7fd782324800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:41.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.630+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.630+0000 7fd782324800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:41.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.630+0000 7fd782324800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:41.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.630+0000 7fd782324800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:41.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.630+0000 7fd782324800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 : miss 2024-09-12T17:32:41.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.630+0000 7fd782324800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.631+0000 7fd782324800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:41.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.631+0000 7fd782324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 info.flags=0x17 2024-09-12T17:32:41.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.631+0000 7fd782324800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 to cache LRU end 2024-09-12T17:32:41.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.631+0000 7fd782324800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:41.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.631+0000 7fd782324800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:41.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.631+0000 7fd782324800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 2024-09-12T17:32:41.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.631+0000 7fd782324800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:41.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.631+0000 7fd782324800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:32:41.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.631+0000 7fd782324800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:32:41.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.632+0000 7fd62f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.635+0000 7fd782324800 20 remove_watcher() i=0 2024-09-12T17:32:41.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.635+0000 7fd782324800 2 removed watcher, disabling cache 2024-09-12T17:32:41.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.636+0000 7fd782324800 20 remove_watcher() i=1 2024-09-12T17:32:41.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.637+0000 7fd782324800 20 remove_watcher() i=2 2024-09-12T17:32:41.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.638+0000 7fd782324800 20 remove_watcher() i=3 2024-09-12T17:32:41.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.639+0000 7fd782324800 20 remove_watcher() i=4 2024-09-12T17:32:41.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.640+0000 7fd782324800 20 remove_watcher() i=5 2024-09-12T17:32:41.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.641+0000 7fd782324800 20 remove_watcher() i=6 2024-09-12T17:32:41.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:41.641+0000 7fd782324800 20 remove_watcher() i=7 2024-09-12T17:32:41.653 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T17:32:41.654 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:41.705 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T17:32:41.706 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:32:41.922 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:32:42.311 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:32:43.752 INFO:tasks.workunit.client.0.smithi107.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:43.754 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:32:43.787 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:43.787 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:43.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.824+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.826+0000 7f0bfaf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.826+0000 7f0bfaf28800 20 realm 2024-09-12T17:32:43.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.826+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.826+0000 7f0bfaf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.826+0000 7f0bfaf28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:43.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.826+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.826+0000 7f0bfaf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.826+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.827+0000 7f0bfaf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:43.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.827+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.828+0000 7f0bfaf28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:43.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.828+0000 7f0bfaf28800 20 searching for the correct realm 2024-09-12T17:32:43.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.831+0000 7f0bf744c640 0 -- 172.21.15.107:0/3177874821 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x55eebfdddb30 msgr2=0x55eebfddff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:43.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.835+0000 7f0bf6c4b640 0 -- 172.21.15.107:0/3177874821 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f0bec04c1d0 msgr2=0x7f0bec048980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:43.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.839+0000 7f0bfaf28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:43.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.839+0000 7f0bfaf28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:43.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.839+0000 7f0bfaf28800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:43.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.839+0000 7f0bfaf28800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:43.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.839+0000 7f0bfaf28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:43.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.839+0000 7f0bfaf28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:43.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.839+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.840+0000 7f0bfaf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.840+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.840+0000 7f0bfaf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:43.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.840+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.840+0000 7f0bfaf28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:43.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.840+0000 7f0bfaf28800 20 zone default found 2024-09-12T17:32:43.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.840+0000 7f0bfaf28800 4 Realm: () 2024-09-12T17:32:43.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.840+0000 7f0bfaf28800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:43.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.840+0000 7f0bfaf28800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:43.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.840+0000 7f0bfaf28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:43.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.840+0000 7f0bfaf28800 20 zonegroup default 2024-09-12T17:32:43.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.840+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.841+0000 7f0bfaf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.841+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.841+0000 7f0bfaf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.841+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.841+0000 7f0bfaf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.841+0000 7f0bfaf28800 20 started sync module instance, tier type = 2024-09-12T17:32:43.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.841+0000 7f0bfaf28800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:43.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.851+0000 7f0bfaf28800 20 add_watcher() i=0 2024-09-12T17:32:43.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.851+0000 7f0bfaf28800 20 add_watcher() i=1 2024-09-12T17:32:43.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.851+0000 7f0bfaf28800 20 add_watcher() i=2 2024-09-12T17:32:43.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.851+0000 7f0bfaf28800 20 add_watcher() i=3 2024-09-12T17:32:43.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.851+0000 7f0bfaf28800 20 add_watcher() i=4 2024-09-12T17:32:43.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.851+0000 7f0bfaf28800 20 add_watcher() i=5 2024-09-12T17:32:43.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.851+0000 7f0bfaf28800 20 add_watcher() i=6 2024-09-12T17:32:43.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.852+0000 7f0bfaf28800 20 add_watcher() i=7 2024-09-12T17:32:43.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.852+0000 7f0bfaf28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:43.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.854+0000 7f0aad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:43.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.855+0000 7f0bfaf28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:43.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.855+0000 7f0bfaf28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:43.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.855+0000 7f0bfaf28800 5 note: GC not initialized 2024-09-12T17:32:43.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.855+0000 7f0a27fff640 20 reqs_thread_entry: start 2024-09-12T17:32:43.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.855+0000 7f0bfaf28800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:43.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.855+0000 7f0bfaf28800 20 Filter name: none 2024-09-12T17:32:43.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.855+0000 7f0a25ffb640 20 reqs_thread_entry: start 2024-09-12T17:32:43.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.855+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.856+0000 7f0bfaf28800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:43.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.856+0000 7f0bfaf28800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.856+0000 7f0bfaf28800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:43.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.856+0000 7f0bfaf28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:43.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.856+0000 7f0bfaf28800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:32:43.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.856+0000 7f0bfaf28800 20 INFO: main: starting shard=0 2024-09-12T17:32:43.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.856+0000 7f0bfaf28800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:43.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.857+0000 7f0bfaf28800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:32:43.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.857+0000 7f0bfaf28800 20 INFO: main: done 2024-09-12T17:32:43.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.858+0000 7f0aad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:43.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.860+0000 7f0bfaf28800 20 remove_watcher() i=0 2024-09-12T17:32:43.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.860+0000 7f0bfaf28800 2 removed watcher, disabling cache 2024-09-12T17:32:43.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.861+0000 7f0bfaf28800 20 remove_watcher() i=1 2024-09-12T17:32:43.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.862+0000 7f0bfaf28800 20 remove_watcher() i=2 2024-09-12T17:32:43.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.864+0000 7f0bfaf28800 20 remove_watcher() i=3 2024-09-12T17:32:43.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.865+0000 7f0bfaf28800 20 remove_watcher() i=4 2024-09-12T17:32:43.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.866+0000 7f0bfaf28800 20 remove_watcher() i=5 2024-09-12T17:32:43.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.868+0000 7f0bfaf28800 20 remove_watcher() i=6 2024-09-12T17:32:43.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:43.868+0000 7f0bfaf28800 20 remove_watcher() i=7 2024-09-12T17:32:43.937 INFO:tasks.workunit.client.0.smithi107.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:43.939 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:32:43.969 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:43.969 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:44.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.003+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.005+0000 7fb4fc52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.005+0000 7fb4fc52f800 20 realm 2024-09-12T17:32:44.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.005+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.005+0000 7fb4fc52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.005+0000 7fb4fc52f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:44.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.005+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.006+0000 7fb4fc52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.006+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.007+0000 7fb4fc52f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:44.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.007+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.007+0000 7fb4fc52f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:44.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.007+0000 7fb4fc52f800 20 searching for the correct realm 2024-09-12T17:32:44.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.011+0000 7fb4f8a1b640 0 -- 172.21.15.107:0/805690548 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x562f405d5360 msgr2=0x562f405d77f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:44.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.014+0000 7fb4f821a640 0 -- 172.21.15.107:0/805690548 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fb4e0008420 msgr2=0x7fb4e00088a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:44.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.018+0000 7fb4fc52f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:44.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.018+0000 7fb4fc52f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:44.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.018+0000 7fb4fc52f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:44.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.018+0000 7fb4fc52f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:44.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.018+0000 7fb4fc52f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:44.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.018+0000 7fb4fc52f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.018+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.018+0000 7fb4fc52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.018+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.018+0000 7fb4fc52f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.018+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.019+0000 7fb4fc52f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.019+0000 7fb4fc52f800 20 zone default found 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.019+0000 7fb4fc52f800 4 Realm: () 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.019+0000 7fb4fc52f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.019+0000 7fb4fc52f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.019+0000 7fb4fc52f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.019+0000 7fb4fc52f800 20 zonegroup default 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.019+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.019+0000 7fb4fc52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.019+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.019+0000 7fb4fc52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.019+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.020+0000 7fb4fc52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.020+0000 7fb4fc52f800 20 started sync module instance, tier type = 2024-09-12T17:32:44.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.020+0000 7fb4fc52f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:44.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.032+0000 7fb4fc52f800 20 add_watcher() i=0 2024-09-12T17:32:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.032+0000 7fb4fc52f800 20 add_watcher() i=1 2024-09-12T17:32:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.032+0000 7fb4fc52f800 20 add_watcher() i=2 2024-09-12T17:32:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.032+0000 7fb4fc52f800 20 add_watcher() i=3 2024-09-12T17:32:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.032+0000 7fb4fc52f800 20 add_watcher() i=4 2024-09-12T17:32:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.032+0000 7fb4fc52f800 20 add_watcher() i=5 2024-09-12T17:32:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.032+0000 7fb4fc52f800 20 add_watcher() i=6 2024-09-12T17:32:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.033+0000 7fb4fc52f800 20 add_watcher() i=7 2024-09-12T17:32:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.033+0000 7fb4fc52f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:44.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.034+0000 7fb3aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:44.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.035+0000 7fb4fc52f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:44.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.035+0000 7fb4fc52f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:44.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.035+0000 7fb4fc52f800 5 note: GC not initialized 2024-09-12T17:32:44.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.035+0000 7fb3adfdb640 20 reqs_thread_entry: start 2024-09-12T17:32:44.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.035+0000 7fb4fc52f800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:44.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.035+0000 7fb4fc52f800 20 Filter name: none 2024-09-12T17:32:44.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.035+0000 7fb31f7fe640 20 reqs_thread_entry: start 2024-09-12T17:32:44.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.035+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.036+0000 7fb4fc52f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:44.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.036+0000 7fb4fc52f800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.036+0000 7fb4fc52f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:44.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.037+0000 7fb4fc52f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:44.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.037+0000 7fb4fc52f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:32:44.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.037+0000 7fb4fc52f800 20 INFO: main: starting shard=0 2024-09-12T17:32:44.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.037+0000 7fb4fc52f800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:44.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.037+0000 7fb4fc52f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:32:44.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.037+0000 7fb4fc52f800 20 INFO: main: done 2024-09-12T17:32:44.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.038+0000 7fb3aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:44.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.040+0000 7fb4fc52f800 20 remove_watcher() i=0 2024-09-12T17:32:44.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.040+0000 7fb4fc52f800 2 removed watcher, disabling cache 2024-09-12T17:32:44.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.042+0000 7fb4fc52f800 20 remove_watcher() i=1 2024-09-12T17:32:44.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.043+0000 7fb4fc52f800 20 remove_watcher() i=2 2024-09-12T17:32:44.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.045+0000 7fb4fc52f800 20 remove_watcher() i=3 2024-09-12T17:32:44.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.046+0000 7fb4fc52f800 20 remove_watcher() i=4 2024-09-12T17:32:44.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.047+0000 7fb4fc52f800 20 remove_watcher() i=5 2024-09-12T17:32:44.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.048+0000 7fb4fc52f800 20 remove_watcher() i=6 2024-09-12T17:32:44.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.049+0000 7fb4fc52f800 20 remove_watcher() i=7 2024-09-12T17:32:44.118 INFO:tasks.workunit.client.0.smithi107.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:44.119 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:32:44.152 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:44.152 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:44.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.187+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.188+0000 7faf8c811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.188+0000 7faf8c811800 20 realm 2024-09-12T17:32:44.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.188+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.188+0000 7faf8c811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.188+0000 7faf8c811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:44.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.188+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.189+0000 7faf8c811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.189+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.189+0000 7faf8c811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:44.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.189+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.190+0000 7faf8c811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:44.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.190+0000 7faf8c811800 20 searching for the correct realm 2024-09-12T17:32:44.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.193+0000 7faf87f48640 0 -- 172.21.15.107:0/2745358892 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7faf7800e040 msgr2=0x7faf78083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:44.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.197+0000 7faf87f48640 0 -- 172.21.15.107:0/2745358892 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7faf70008430 msgr2=0x7faf70008890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:44.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.404+0000 7faf8c811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:44.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.404+0000 7faf8c811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:44.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.404+0000 7faf8c811800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:44.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.404+0000 7faf8c811800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:44.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.404+0000 7faf8c811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:44.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.404+0000 7faf8c811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:44.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.404+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.404+0000 7faf8c811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.404+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.405+0000 7faf8c811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.405+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.405+0000 7faf8c811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.405+0000 7faf8c811800 20 zone default found 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.405+0000 7faf8c811800 4 Realm: () 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.405+0000 7faf8c811800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.405+0000 7faf8c811800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.405+0000 7faf8c811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.405+0000 7faf8c811800 20 zonegroup default 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.405+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.405+0000 7faf8c811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.405+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.406+0000 7faf8c811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.406+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.406+0000 7faf8c811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.406+0000 7faf8c811800 20 started sync module instance, tier type = 2024-09-12T17:32:44.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.406+0000 7faf8c811800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:44.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.420+0000 7faf8c811800 20 add_watcher() i=0 2024-09-12T17:32:44.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.420+0000 7faf8c811800 20 add_watcher() i=1 2024-09-12T17:32:44.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.420+0000 7faf8c811800 20 add_watcher() i=2 2024-09-12T17:32:44.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.420+0000 7faf8c811800 20 add_watcher() i=3 2024-09-12T17:32:44.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.420+0000 7faf8c811800 20 add_watcher() i=4 2024-09-12T17:32:44.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.420+0000 7faf8c811800 20 add_watcher() i=5 2024-09-12T17:32:44.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.420+0000 7faf8c811800 20 add_watcher() i=6 2024-09-12T17:32:44.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.423+0000 7faf8c811800 20 add_watcher() i=7 2024-09-12T17:32:44.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.423+0000 7faf8c811800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:44.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.424+0000 7fae3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:44.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.425+0000 7faf8c811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:44.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.425+0000 7faf8c811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:44.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.425+0000 7faf8c811800 5 note: GC not initialized 2024-09-12T17:32:44.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.425+0000 7fae3cfe1640 20 reqs_thread_entry: start 2024-09-12T17:32:44.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.425+0000 7faf8c811800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:44.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.425+0000 7faf8c811800 20 Filter name: none 2024-09-12T17:32:44.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.425+0000 7fadb67fc640 20 reqs_thread_entry: start 2024-09-12T17:32:44.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.425+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.425+0000 7faf8c811800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:44.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.426+0000 7faf8c811800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.426+0000 7faf8c811800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:44.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.426+0000 7faf8c811800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:44.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.426+0000 7faf8c811800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:32:44.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.426+0000 7faf8c811800 20 INFO: main: starting shard=0 2024-09-12T17:32:44.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.426+0000 7faf8c811800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:44.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.427+0000 7faf8c811800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:32:44.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.427+0000 7faf8c811800 20 INFO: main: done 2024-09-12T17:32:44.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.428+0000 7fae3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:44.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.430+0000 7faf8c811800 20 remove_watcher() i=0 2024-09-12T17:32:44.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.430+0000 7faf8c811800 2 removed watcher, disabling cache 2024-09-12T17:32:44.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.432+0000 7faf8c811800 20 remove_watcher() i=1 2024-09-12T17:32:44.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.433+0000 7faf8c811800 20 remove_watcher() i=2 2024-09-12T17:32:44.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.434+0000 7faf8c811800 20 remove_watcher() i=3 2024-09-12T17:32:44.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.435+0000 7faf8c811800 20 remove_watcher() i=4 2024-09-12T17:32:44.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.436+0000 7faf8c811800 20 remove_watcher() i=5 2024-09-12T17:32:44.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.439+0000 7faf8c811800 20 remove_watcher() i=6 2024-09-12T17:32:44.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.440+0000 7faf8c811800 20 remove_watcher() i=7 2024-09-12T17:32:44.505 INFO:tasks.workunit.client.0.smithi107.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:44.507 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:32:44.537 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:44.537 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:44.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.571+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.574 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.573+0000 7fe1ce723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.573+0000 7fe1ce723800 20 realm 2024-09-12T17:32:44.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.573+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.573+0000 7fe1ce723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.573+0000 7fe1ce723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:44.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.573+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.573+0000 7fe1ce723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.573+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.574+0000 7fe1ce723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:44.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.574+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.575+0000 7fe1ce723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:44.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.575+0000 7fe1ce723800 20 searching for the correct realm 2024-09-12T17:32:44.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.578+0000 7fe1c9c12640 0 -- 172.21.15.107:0/2241098478 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fe1b400e040 msgr2=0x7fe1b401f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:44.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.581+0000 7fe1ca413640 0 -- 172.21.15.107:0/2241098478 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fe1b4030b90 msgr2=0x7fe1b4041400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:44.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.788+0000 7fe1ce723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:44.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.788+0000 7fe1ce723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:44.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.788+0000 7fe1ce723800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:44.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.788+0000 7fe1ce723800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:44.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.788+0000 7fe1ce723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.788+0000 7fe1ce723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.788+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.788+0000 7fe1ce723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.788+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.788+0000 7fe1ce723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.788+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.789+0000 7fe1ce723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.789+0000 7fe1ce723800 20 zone default found 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.789+0000 7fe1ce723800 4 Realm: () 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.789+0000 7fe1ce723800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.789+0000 7fe1ce723800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.789+0000 7fe1ce723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.789+0000 7fe1ce723800 20 zonegroup default 2024-09-12T17:32:44.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.789+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.789+0000 7fe1ce723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.789+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.789+0000 7fe1ce723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.789+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.790+0000 7fe1ce723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.790+0000 7fe1ce723800 20 started sync module instance, tier type = 2024-09-12T17:32:44.793 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.790+0000 7fe1ce723800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:44.804 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.803+0000 7fe1ce723800 20 add_watcher() i=0 2024-09-12T17:32:44.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.803+0000 7fe1ce723800 20 add_watcher() i=1 2024-09-12T17:32:44.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.803+0000 7fe1ce723800 20 add_watcher() i=2 2024-09-12T17:32:44.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.803+0000 7fe1ce723800 20 add_watcher() i=3 2024-09-12T17:32:44.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.803+0000 7fe1ce723800 20 add_watcher() i=4 2024-09-12T17:32:44.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.803+0000 7fe1ce723800 20 add_watcher() i=5 2024-09-12T17:32:44.807 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.806+0000 7fe1ce723800 20 add_watcher() i=6 2024-09-12T17:32:44.807 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.806+0000 7fe1ce723800 20 add_watcher() i=7 2024-09-12T17:32:44.807 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.806+0000 7fe1ce723800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:44.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.808+0000 7fe080fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:44.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.808+0000 7fe1ce723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:44.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.808+0000 7fe1ce723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:44.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.808+0000 7fe1ce723800 5 note: GC not initialized 2024-09-12T17:32:44.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.808+0000 7fdffb7fe640 20 reqs_thread_entry: start 2024-09-12T17:32:44.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.809+0000 7fe1ce723800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:44.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.809+0000 7fe1ce723800 20 Filter name: none 2024-09-12T17:32:44.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.809+0000 7fdff97fa640 20 reqs_thread_entry: start 2024-09-12T17:32:44.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.809+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.809+0000 7fe1ce723800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:44.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.809+0000 7fe1ce723800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.810+0000 7fe1ce723800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:44.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.810+0000 7fe1ce723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:44.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.810+0000 7fe1ce723800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:32:44.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.810+0000 7fe1ce723800 20 INFO: main: starting shard=0 2024-09-12T17:32:44.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.810+0000 7fe1ce723800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:44.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.810+0000 7fe1ce723800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:32:44.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.810+0000 7fe1ce723800 20 INFO: main: done 2024-09-12T17:32:44.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.811+0000 7fe080fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:44.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.813+0000 7fe1ce723800 20 remove_watcher() i=0 2024-09-12T17:32:44.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.813+0000 7fe1ce723800 2 removed watcher, disabling cache 2024-09-12T17:32:44.816 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.815+0000 7fe1ce723800 20 remove_watcher() i=1 2024-09-12T17:32:44.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.816+0000 7fe1ce723800 20 remove_watcher() i=2 2024-09-12T17:32:44.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.818+0000 7fe1ce723800 20 remove_watcher() i=3 2024-09-12T17:32:44.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.819+0000 7fe1ce723800 20 remove_watcher() i=4 2024-09-12T17:32:44.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.820+0000 7fe1ce723800 20 remove_watcher() i=5 2024-09-12T17:32:44.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.821+0000 7fe1ce723800 20 remove_watcher() i=6 2024-09-12T17:32:44.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:44.822+0000 7fe1ce723800 20 remove_watcher() i=7 2024-09-12T17:32:44.840 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:32:45.232 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:32:45.621 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:32:45.650 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:45.650 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:45.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.685+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.686+0000 7fb28332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.686+0000 7fb28332c800 20 realm 2024-09-12T17:32:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.686+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.687+0000 7fb28332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.687+0000 7fb28332c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.687+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.687+0000 7fb28332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.687+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.688+0000 7fb28332c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:45.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.688+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.688+0000 7fb28332c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:45.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.688+0000 7fb28332c800 20 searching for the correct realm 2024-09-12T17:32:45.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.693+0000 7fb27f762640 0 -- 172.21.15.107:0/634198899 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7fb268075ee0 msgr2=0x7fb268083970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:45.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.899+0000 7fb27ef61640 0 -- 172.21.15.107:0/634198899 >> [v2:172.21.15.148:6800/18671776,v1:172.21.15.148:6801/18671776] conn(0x55e109ef18c0 msgr2=0x55e109ef3cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:45.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.901+0000 7fb28332c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:45.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.901+0000 7fb28332c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:45.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.901+0000 7fb28332c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:45.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.901+0000 7fb28332c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:45.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.901+0000 7fb28332c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:45.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.901+0000 7fb28332c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:45.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.901+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.902+0000 7fb28332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.902+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.902+0000 7fb28332c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:45.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.902+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.902+0000 7fb28332c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:45.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.902+0000 7fb28332c800 20 zone default found 2024-09-12T17:32:45.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.902+0000 7fb28332c800 4 Realm: () 2024-09-12T17:32:45.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.902+0000 7fb28332c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:45.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.902+0000 7fb28332c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:45.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.902+0000 7fb28332c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:45.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.902+0000 7fb28332c800 20 zonegroup default 2024-09-12T17:32:45.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.902+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.903+0000 7fb28332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.903+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.903+0000 7fb28332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.903+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.903+0000 7fb28332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.903+0000 7fb28332c800 20 started sync module instance, tier type = 2024-09-12T17:32:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.903+0000 7fb28332c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:45.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.918+0000 7fb28332c800 20 add_watcher() i=0 2024-09-12T17:32:45.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.918+0000 7fb28332c800 20 add_watcher() i=1 2024-09-12T17:32:45.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.918+0000 7fb28332c800 20 add_watcher() i=2 2024-09-12T17:32:45.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.918+0000 7fb28332c800 20 add_watcher() i=3 2024-09-12T17:32:45.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.918+0000 7fb28332c800 20 add_watcher() i=4 2024-09-12T17:32:45.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.918+0000 7fb28332c800 20 add_watcher() i=5 2024-09-12T17:32:45.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.920+0000 7fb28332c800 20 add_watcher() i=6 2024-09-12T17:32:45.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.920+0000 7fb28332c800 20 add_watcher() i=7 2024-09-12T17:32:45.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.920+0000 7fb28332c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:45.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.922+0000 7fb1357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:45.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.922+0000 7fb28332c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:45.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.922+0000 7fb28332c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:45.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.922+0000 7fb28332c800 5 note: GC not initialized 2024-09-12T17:32:45.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.922+0000 7fb0affff640 20 reqs_thread_entry: start 2024-09-12T17:32:45.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.922+0000 7fb28332c800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:45.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.922+0000 7fb28332c800 20 Filter name: none 2024-09-12T17:32:45.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.923+0000 7fb0adffb640 20 reqs_thread_entry: start 2024-09-12T17:32:45.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.923+0000 7fb28332c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:45.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.923+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.923+0000 7fb28332c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:45.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.923+0000 7fb28332c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:45.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.923+0000 7fb28332c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:45.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.923+0000 7fb28332c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 : miss 2024-09-12T17:32:45.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.923+0000 7fb28332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.924+0000 7fb28332c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:45.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.924+0000 7fb28332c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 info.flags=0x17 2024-09-12T17:32:45.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.924+0000 7fb28332c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 to cache LRU end 2024-09-12T17:32:45.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.924+0000 7fb28332c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:45.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.924+0000 7fb28332c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:45.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.924+0000 7fb28332c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 2024-09-12T17:32:45.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.924+0000 7fb28332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:45.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.928+0000 7fb1357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:45.932 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.931+0000 7fb28332c800 20 remove_watcher() i=0 2024-09-12T17:32:45.932 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.931+0000 7fb28332c800 2 removed watcher, disabling cache 2024-09-12T17:32:45.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.932+0000 7fb28332c800 20 remove_watcher() i=1 2024-09-12T17:32:45.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.933+0000 7fb28332c800 20 remove_watcher() i=2 2024-09-12T17:32:45.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.935+0000 7fb28332c800 20 remove_watcher() i=3 2024-09-12T17:32:45.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.936+0000 7fb28332c800 20 remove_watcher() i=4 2024-09-12T17:32:45.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.939+0000 7fb28332c800 20 remove_watcher() i=5 2024-09-12T17:32:45.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.940+0000 7fb28332c800 20 remove_watcher() i=6 2024-09-12T17:32:45.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:45.941+0000 7fb28332c800 20 remove_watcher() i=7 2024-09-12T17:32:45.954 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:32:45.989 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:45.989 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:46.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.025+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.026+0000 7f96e332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.026+0000 7f96e332c800 20 realm 2024-09-12T17:32:46.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.026+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.026+0000 7f96e332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.026+0000 7f96e332c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:46.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.026+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.026+0000 7f96e332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.026+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.027+0000 7f96e332c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:46.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.027+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.028+0000 7f96e332c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:46.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.028+0000 7f96e332c800 20 searching for the correct realm 2024-09-12T17:32:46.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.031+0000 7f96df850640 0 -- 172.21.15.107:0/2008081403 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x555eb8c7f6f0 msgr2=0x555eb8c81b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:46.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.035+0000 7f96df04f640 0 -- 172.21.15.107:0/2008081403 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f96c800a3b0 msgr2=0x7f96c800a830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:46.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.039+0000 7f96e332c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:46.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.039+0000 7f96e332c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:46.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.039+0000 7f96e332c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:46.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.039+0000 7f96e332c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:46.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.039+0000 7f96e332c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:46.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.039+0000 7f96e332c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:46.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.039+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.039+0000 7f96e332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.039+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.039+0000 7f96e332c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:46.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.039+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.039+0000 7f96e332c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:46.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.040+0000 7f96e332c800 20 zone default found 2024-09-12T17:32:46.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.040+0000 7f96e332c800 4 Realm: () 2024-09-12T17:32:46.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.040+0000 7f96e332c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:46.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.040+0000 7f96e332c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:46.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.040+0000 7f96e332c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:46.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.040+0000 7f96e332c800 20 zonegroup default 2024-09-12T17:32:46.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.040+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.040+0000 7f96e332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.040+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.040+0000 7f96e332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.040+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.040+0000 7f96e332c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.041+0000 7f96e332c800 20 started sync module instance, tier type = 2024-09-12T17:32:46.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.041+0000 7f96e332c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:46.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.057+0000 7f96e332c800 20 add_watcher() i=0 2024-09-12T17:32:46.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.057+0000 7f96e332c800 20 add_watcher() i=1 2024-09-12T17:32:46.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.057+0000 7f96e332c800 20 add_watcher() i=2 2024-09-12T17:32:46.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.057+0000 7f96e332c800 20 add_watcher() i=3 2024-09-12T17:32:46.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.057+0000 7f96e332c800 20 add_watcher() i=4 2024-09-12T17:32:46.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.057+0000 7f96e332c800 20 add_watcher() i=5 2024-09-12T17:32:46.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.057+0000 7f96e332c800 20 add_watcher() i=6 2024-09-12T17:32:46.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.057+0000 7f96e332c800 20 add_watcher() i=7 2024-09-12T17:32:46.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.058+0000 7f96e332c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:46.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.059+0000 7f9595fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:46.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.060+0000 7f96e332c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:46.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.060+0000 7f96e332c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:46.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.060+0000 7f96e332c800 5 note: GC not initialized 2024-09-12T17:32:46.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.060+0000 7f9594fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:46.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.060+0000 7f96e332c800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:46.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.060+0000 7f96e332c800 20 Filter name: none 2024-09-12T17:32:46.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.060+0000 7f950e7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:46.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.060+0000 7f96e332c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:46.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.060+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.061+0000 7f96e332c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:46.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.061+0000 7f96e332c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:46.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.061+0000 7f96e332c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:46.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.061+0000 7f96e332c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 : miss 2024-09-12T17:32:46.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.061+0000 7f96e332c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.061+0000 7f96e332c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:46.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.061+0000 7f96e332c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 info.flags=0x17 2024-09-12T17:32:46.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.061+0000 7f96e332c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 to cache LRU end 2024-09-12T17:32:46.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.061+0000 7f96e332c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:46.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.061+0000 7f96e332c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:46.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.061+0000 7f96e332c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.2 2024-09-12T17:32:46.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.061+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.063+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.063+0000 7f96e332c800 20 get_obj_state: octx=0x555eb8a1d9d0 obj=check-bucket:c state=0x555eb8cbdb18 s->prefetch_data=0 2024-09-12T17:32:46.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.063+0000 7f96e332c800 20 get_obj_state: setting s->obj_tag to 9mqxfp8suhoztcsprgfqvsqs2sidbt6z 2024-09-12T17:32:46.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.064+0000 7f96e332c800 20 get_obj_state_impl: setting s->olh_tag to rclyv5uccu6qzs8mviqha2pjttonykty 2024-09-12T17:32:46.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.064+0000 7f96e332c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rclyv5uccu6qzs8mviqha2pjttonykty 2024-09-12T17:32:46.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.066+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.070+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.071+0000 7f96e332c800 20 olh_log_entry: epoch=3 op=3 key=c[jTw6KS3C89BrdMQv-0Vy6L313MMbGlc] 2024-09-12T17:32:46.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.071+0000 7f96e332c800 20 get_obj_state: octx=0x555eb8a1d9d0 obj=check-bucket:_:jTw6KS3C89BrdMQv-0Vy6L313MMbGlc_c state=0x555eb8cf95d8 s->prefetch_data=0 2024-09-12T17:32:46.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.071+0000 7f96e332c800 10 manifest: total_size = 12 2024-09-12T17:32:46.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.071+0000 7f96e332c800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.15269704316556204599 2024-09-12T17:32:46.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.071+0000 7f96e332c800 20 get_obj_state: octx=0x555eb8a1d9d0 obj=check-bucket:_:jTw6KS3C89BrdMQv-0Vy6L313MMbGlc_c state=0x555eb8cf95d8 s->prefetch_data=0 2024-09-12T17:32:46.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.071+0000 7f96e332c800 20 prepare_atomic_modification: state is not atomic. state=0x555eb8cf95d8 2024-09-12T17:32:46.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.071+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.079+0000 7f95c2ffd640 20 handle_completion(): completion ok for obj=c[jTw6KS3C89BrdMQv-0Vy6L313MMbGlc] 2024-09-12T17:32:46.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.079+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.079+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.082+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.082+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.083+0000 7f96e332c800 20 get_obj_state: octx=0x555eb8a1d9d0 obj=check-bucket:d state=0x555eb8cbc7e8 s->prefetch_data=0 2024-09-12T17:32:46.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.083+0000 7f96e332c800 20 get_obj_state: setting s->obj_tag to 7nsfs197q274nkc5kf0uqq2fp0z9wwx5 2024-09-12T17:32:46.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.083+0000 7f96e332c800 20 get_obj_state_impl: setting s->olh_tag to 061xkn0ed6ukqkmm2vb5pcfg06hvo54a 2024-09-12T17:32:46.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.083+0000 7f96e332c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=061xkn0ed6ukqkmm2vb5pcfg06hvo54a 2024-09-12T17:32:46.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.085+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.086+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.087+0000 7f96e332c800 20 olh_log_entry: epoch=3 op=3 key=d[BiuxUJafMTxJahmJfr1imwg1sSzo43O] 2024-09-12T17:32:46.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.087+0000 7f96e332c800 20 get_obj_state: octx=0x555eb8a1d9d0 obj=check-bucket:_:BiuxUJafMTxJahmJfr1imwg1sSzo43O_d state=0x555eb8cbfb38 s->prefetch_data=0 2024-09-12T17:32:46.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.087+0000 7f96e332c800 10 manifest: total_size = 11 2024-09-12T17:32:46.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.087+0000 7f96e332c800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.580008046434114424 2024-09-12T17:32:46.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.087+0000 7f96e332c800 20 get_obj_state: octx=0x555eb8a1d9d0 obj=check-bucket:_:BiuxUJafMTxJahmJfr1imwg1sSzo43O_d state=0x555eb8cbfb38 s->prefetch_data=0 2024-09-12T17:32:46.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.087+0000 7f96e332c800 20 prepare_atomic_modification: state is not atomic. state=0x555eb8cbfb38 2024-09-12T17:32:46.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.087+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.095+0000 7f95c2ffd640 20 handle_completion(): completion ok for obj=d[BiuxUJafMTxJahmJfr1imwg1sSzo43O] 2024-09-12T17:32:46.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.096+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.096+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.098+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.098+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.099+0000 7f96e332c800 20 get_obj_state: octx=0x7f96d8005ea0 obj=check-bucket:e state=0x555eb8cbc7e8 s->prefetch_data=0 2024-09-12T17:32:46.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.099+0000 7f96e332c800 20 get_obj_state: setting s->obj_tag to vfgwmm7ani70i8m6errzabv0rbvzys5v 2024-09-12T17:32:46.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.099+0000 7f96e332c800 20 get_obj_state_impl: setting s->olh_tag to wq5wdpetf3wlp4vofjwz18oyxldsqy05 2024-09-12T17:32:46.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.099+0000 7f96e332c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wq5wdpetf3wlp4vofjwz18oyxldsqy05 2024-09-12T17:32:46.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.100+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.102+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.102+0000 7f96e332c800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:32:46.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.102+0000 7f96e332c800 20 olh_log_entry: epoch=2 op=3 key=e[1wFsXNYIG9xHfVc4udHxDX83Fov7UAR] 2024-09-12T17:32:46.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.102+0000 7f96e332c800 20 get_obj_state: octx=0x7f96d8005ea0 obj=check-bucket:_:1wFsXNYIG9xHfVc4udHxDX83Fov7UAR_e state=0x555eb8cbfb38 s->prefetch_data=0 2024-09-12T17:32:46.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.102+0000 7f96e332c800 10 manifest: total_size = 22 2024-09-12T17:32:46.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.102+0000 7f96e332c800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16113645464416303493 2024-09-12T17:32:46.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.102+0000 7f96e332c800 20 get_obj_state: octx=0x7f96d8005ea0 obj=check-bucket:_:1wFsXNYIG9xHfVc4udHxDX83Fov7UAR_e state=0x555eb8cbfb38 s->prefetch_data=0 2024-09-12T17:32:46.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.102+0000 7f96e332c800 20 prepare_atomic_modification: state is not atomic. state=0x555eb8cbfb38 2024-09-12T17:32:46.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.102+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.107+0000 7f95c27fc640 20 handle_completion(): completion ok for obj=e[1wFsXNYIG9xHfVc4udHxDX83Fov7UAR] 2024-09-12T17:32:46.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.108+0000 7f96e332c800 20 get_obj_state: octx=0x7f96d8005ea0 obj=check-bucket:e state=0x555eb8cbc7e8 s->prefetch_data=0 2024-09-12T17:32:46.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.108+0000 7f96e332c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wq5wdpetf3wlp4vofjwz18oyxldsqy05 2024-09-12T17:32:46.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.118+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.120+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.120+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.120+0000 7f96e332c800 20 get_obj_state: octx=0x7f96d8005ea0 obj=check-bucket:f state=0x555eb8d041b8 s->prefetch_data=0 2024-09-12T17:32:46.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.121+0000 7f96e332c800 20 get_obj_state: setting s->obj_tag to k0hfh7c8z70xnj4rcslioos0m6tzmhrk 2024-09-12T17:32:46.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.121+0000 7f96e332c800 20 get_obj_state_impl: setting s->olh_tag to 7wlh4vybndufctnl5uhyads10r9w1lew 2024-09-12T17:32:46.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.121+0000 7f96e332c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7wlh4vybndufctnl5uhyads10r9w1lew 2024-09-12T17:32:46.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.123+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.124+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.125+0000 7f96e332c800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:32:46.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.125+0000 7f96e332c800 20 olh_log_entry: epoch=2 op=3 key=f[wIkX7ymbm5F0w6YoluVEW0c-sSC.K-L] 2024-09-12T17:32:46.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.125+0000 7f96e332c800 20 get_obj_state: octx=0x7f96d8005ea0 obj=check-bucket:_:wIkX7ymbm5F0w6YoluVEW0c-sSC.K-L_f state=0x555eb8cfabb8 s->prefetch_data=0 2024-09-12T17:32:46.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.125+0000 7f96e332c800 10 manifest: total_size = 22 2024-09-12T17:32:46.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.125+0000 7f96e332c800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.4008977582228459475 2024-09-12T17:32:46.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.125+0000 7f96e332c800 20 get_obj_state: octx=0x7f96d8005ea0 obj=check-bucket:_:wIkX7ymbm5F0w6YoluVEW0c-sSC.K-L_f state=0x555eb8cfabb8 s->prefetch_data=0 2024-09-12T17:32:46.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.125+0000 7f96e332c800 20 prepare_atomic_modification: state is not atomic. state=0x555eb8cfabb8 2024-09-12T17:32:46.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.125+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.129+0000 7f96e332c800 20 get_obj_state: octx=0x7f96d8005ea0 obj=check-bucket:f state=0x555eb8d041b8 s->prefetch_data=0 2024-09-12T17:32:46.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.129+0000 7f96e332c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7wlh4vybndufctnl5uhyads10r9w1lew 2024-09-12T17:32:46.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.129+0000 7f95c27fc640 20 handle_completion(): completion ok for obj=f[wIkX7ymbm5F0w6YoluVEW0c-sSC.K-L] 2024-09-12T17:32:46.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.140+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.140+0000 7f96e332c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.2.0 2024-09-12T17:32:46.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.141+0000 7f96e332c800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T17:32:46.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.141+0000 7f96e332c800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:32:46.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.141+0000 7f9595fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:46.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.144+0000 7f96e332c800 20 remove_watcher() i=0 2024-09-12T17:32:46.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.144+0000 7f96e332c800 2 removed watcher, disabling cache 2024-09-12T17:32:46.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.145+0000 7f96e332c800 20 remove_watcher() i=1 2024-09-12T17:32:46.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.146+0000 7f96e332c800 20 remove_watcher() i=2 2024-09-12T17:32:46.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.147+0000 7f96e332c800 20 remove_watcher() i=3 2024-09-12T17:32:46.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.148+0000 7f96e332c800 20 remove_watcher() i=4 2024-09-12T17:32:46.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.149+0000 7f96e332c800 20 remove_watcher() i=5 2024-09-12T17:32:46.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.151+0000 7f96e332c800 20 remove_watcher() i=6 2024-09-12T17:32:46.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.152+0000 7f96e332c800 20 remove_watcher() i=7 2024-09-12T17:32:46.250 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:32:46.277 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:46.278 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:46.313 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.312+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.313+0000 7fc03ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.313+0000 7fc03ea20800 20 realm 2024-09-12T17:32:46.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.313+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.313+0000 7fc03ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.313+0000 7fc03ea20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:46.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.313+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.314+0000 7fc03ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.314+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.314+0000 7fc03ea20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:46.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.314+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.315+0000 7fc03ea20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:46.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.315+0000 7fc03ea20800 20 searching for the correct realm 2024-09-12T17:32:46.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.318+0000 7fc03cd0b640 0 -- 172.21.15.107:0/4044472580 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5626a7b4b040 msgr2=0x5626a7b4d500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:46.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.321+0000 7fc03c50a640 0 -- 172.21.15.107:0/4044472580 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc0240d3330 msgr2=0x7fc0240a2d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:46.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.325+0000 7fc03ea20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:46.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.325+0000 7fc03ea20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:46.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.325+0000 7fc03ea20800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:32:46.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.325+0000 7fc03ea20800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:32:46.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.325+0000 7fc03ea20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:46.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.325+0000 7fc03ea20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:46.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.325+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.328 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.325+0000 7fc03ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.328 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.325+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:46.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:46.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 20 zone default found 2024-09-12T17:32:46.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 4 Realm: () 2024-09-12T17:32:46.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:32:46.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:32:46.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:46.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 20 zonegroup default 2024-09-12T17:32:46.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.326+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.327+0000 7fc03ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.327+0000 7fc03ea20800 20 started sync module instance, tier type = 2024-09-12T17:32:46.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.327+0000 7fc03ea20800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:32:46.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.343+0000 7fc03ea20800 20 add_watcher() i=0 2024-09-12T17:32:46.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.343+0000 7fc03ea20800 20 add_watcher() i=1 2024-09-12T17:32:46.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.343+0000 7fc03ea20800 20 add_watcher() i=2 2024-09-12T17:32:46.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.343+0000 7fc03ea20800 20 add_watcher() i=3 2024-09-12T17:32:46.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.343+0000 7fc03ea20800 20 add_watcher() i=4 2024-09-12T17:32:46.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.343+0000 7fc03ea20800 20 add_watcher() i=5 2024-09-12T17:32:46.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.343+0000 7fc03ea20800 20 add_watcher() i=6 2024-09-12T17:32:46.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.344+0000 7fc03ea20800 20 add_watcher() i=7 2024-09-12T17:32:46.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.344+0000 7fc03ea20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:46.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.346+0000 7fbef2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.346+0000 7fc03ea20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.346+0000 7fc03ea20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.346+0000 7fc03ea20800 5 note: GC not initialized 2024-09-12T17:32:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.346+0000 7fbef1fdb640 20 reqs_thread_entry: start 2024-09-12T17:32:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.346+0000 7fc03ea20800 20 init_complete bucket index max shards: 1 2024-09-12T17:32:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.347+0000 7fc03ea20800 20 Filter name: none 2024-09-12T17:32:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.347+0000 7fbe637fe640 20 reqs_thread_entry: start 2024-09-12T17:32:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.347+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.347+0000 7fc03ea20800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:46.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.347+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.348+0000 7fc03ea20800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:46.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.348+0000 7fc03ea20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:46.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.348+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.348+0000 7fc03ea20800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:46.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.348+0000 7fc03ea20800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.348+0000 7fc03ea20800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:46.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.348+0000 7fc03ea20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:46.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.350+0000 7fbef2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:46.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.352+0000 7fc03ea20800 20 remove_watcher() i=0 2024-09-12T17:32:46.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.352+0000 7fc03ea20800 2 removed watcher, disabling cache 2024-09-12T17:32:46.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.353+0000 7fc03ea20800 20 remove_watcher() i=1 2024-09-12T17:32:46.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.354+0000 7fc03ea20800 20 remove_watcher() i=2 2024-09-12T17:32:46.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.356+0000 7fc03ea20800 20 remove_watcher() i=3 2024-09-12T17:32:46.358 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.357+0000 7fc03ea20800 20 remove_watcher() i=4 2024-09-12T17:32:46.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.358+0000 7fc03ea20800 20 remove_watcher() i=5 2024-09-12T17:32:46.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.359+0000 7fc03ea20800 20 remove_watcher() i=6 2024-09-12T17:32:46.361 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:32:46.360+0000 7fc03ea20800 20 remove_watcher() i=7 2024-09-12T17:32:46.371 INFO:tasks.workunit.client.0.smithi107.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:32:46.371 INFO:tasks.workunit.client.0.smithi107.stderr:Deleting bucket check-bucket 2024-09-12T17:32:46.391 INFO:tasks.workunit.client.0.smithi107.stderr:Completed bucket check tests 2024-09-12T17:32:46.392 INFO:tasks.workunit.client.0.smithi107.stdout:connected to http://localhost:80 2024-09-12T17:32:46.450 INFO:tasks.workunit.client.0.smithi107.stderr:+ deactivate 2024-09-12T17:32:46.450 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:32:46.450 INFO:tasks.workunit.client.0.smithi107.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:32:46.450 INFO:tasks.workunit.client.0.smithi107.stderr:+ export PATH 2024-09-12T17:32:46.450 INFO:tasks.workunit.client.0.smithi107.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:32:46.450 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n '' ']' 2024-09-12T17:32:46.450 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:32:46.450 INFO:tasks.workunit.client.0.smithi107.stderr:+ hash -r 2024-09-12T17:32:46.450 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n '' ']' 2024-09-12T17:32:46.451 INFO:tasks.workunit.client.0.smithi107.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:32:46.451 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:32:46.451 INFO:tasks.workunit.client.0.smithi107.stderr:+ unset -f deactivate 2024-09-12T17:32:46.451 INFO:tasks.workunit.client.0.smithi107.stderr:+ echo OK. 2024-09-12T17:32:46.452 INFO:tasks.workunit.client.0.smithi107.stdout:OK. 2024-09-12T17:32:46.452 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:32:46.452 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:32:46.531 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T17:32:46.531 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:32:46.884 DEBUG:teuthology.parallel:result is None 2024-09-12T17:32:46.885 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:32:46.923 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:32:46.923 DEBUG:teuthology.orchestra.run.smithi107:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:32:46.992 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:32:46.992 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:32:47.002 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:32:47.002 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:32:47.002 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:32:47.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:32:47.061 INFO:teuthology.orchestra.run.smithi107.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:32:47.061 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:32:47.130 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:32:47.130 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:32:47.199 INFO:tasks.workunit:timeout=3h 2024-09-12T17:32:47.199 INFO:tasks.workunit:cleanup=True 2024-09-12T17:32:47.200 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:32:47.269 INFO:tasks.workunit.client.0.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:33:46.417 INFO:tasks.workunit.client.0.smithi107.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:33:46.418 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:33:46.418 INFO:tasks.workunit.client.0.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:33:46.418 INFO:tasks.workunit.client.0.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:33:46.418 INFO:tasks.workunit.client.0.smithi107.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:33:46.418 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:33:46.418 INFO:tasks.workunit.client.0.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:33:46.418 INFO:tasks.workunit.client.0.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:33:46.418 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:33:46.418 INFO:tasks.workunit.client.0.smithi107.stderr: git switch -c 2024-09-12T17:33:46.418 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:33:46.418 INFO:tasks.workunit.client.0.smithi107.stderr:Or undo this operation with: 2024-09-12T17:33:46.419 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:33:46.419 INFO:tasks.workunit.client.0.smithi107.stderr: git switch - 2024-09-12T17:33:46.419 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:33:46.419 INFO:tasks.workunit.client.0.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:33:46.419 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:33:46.419 INFO:tasks.workunit.client.0.smithi107.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:33:46.423 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:33:46.491 INFO:tasks.workunit.client.0.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:33:46.493 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:33:46.493 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:33:46.541 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:33:46.589 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:33:46.628 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:33:46.630 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:33:46.630 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:33:46.669 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:33:46.672 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:33:46.672 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:33:46.741 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T17:33:46.742 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T17:33:46.742 DEBUG:teuthology.orchestra.run.smithi107:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T17:33:46.825 INFO:tasks.workunit.client.0.smithi107.stdout:Running main() from gmock_main.cc 2024-09-12T17:33:46.825 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:33:46.825 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:33:46.825 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 11 tests from ClsLock 2024-09-12T17:33:46.825 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T17:33:48.704 INFO:tasks.workunit.client.0.smithi107.stdout:lock: mylock 2024-09-12T17:33:48.704 INFO:tasks.workunit.client.0.smithi107.stdout: lock_type: exclusive 2024-09-12T17:33:48.704 INFO:tasks.workunit.client.0.smithi107.stdout: tag: 2024-09-12T17:33:48.704 INFO:tasks.workunit.client.0.smithi107.stdout: lockers: 2024-09-12T17:33:48.704 INFO:tasks.workunit.client.0.smithi107.stdout: client.5130 expiration=2024-09-12T17:35:48.695750+0000 addr=v1:172.21.15.107:0/2765566644 cookie= 2024-09-12T17:33:48.712 INFO:tasks.workunit.client.0.smithi107.stdout:lock: mylock 2024-09-12T17:33:48.712 INFO:tasks.workunit.client.0.smithi107.stdout: lock_type: shared 2024-09-12T17:33:48.712 INFO:tasks.workunit.client.0.smithi107.stdout: tag: 2024-09-12T17:33:48.712 INFO:tasks.workunit.client.0.smithi107.stdout: lockers: 2024-09-12T17:33:48.712 INFO:tasks.workunit.client.0.smithi107.stdout: client.4994 expiration=0.000000 addr=v1:172.21.15.107:0/3843047622 cookie= 2024-09-12T17:33:48.712 INFO:tasks.workunit.client.0.smithi107.stdout: client.5130 expiration=2024-09-12T17:35:48.709231+0000 addr=v1:172.21.15.107:0/2765566644 cookie= 2024-09-12T17:33:48.713 INFO:tasks.workunit.client.0.smithi107.stdout:lock: mylock 2024-09-12T17:33:48.713 INFO:tasks.workunit.client.0.smithi107.stdout: lock_type: shared 2024-09-12T17:33:48.713 INFO:tasks.workunit.client.0.smithi107.stdout: tag: 2024-09-12T17:33:48.713 INFO:tasks.workunit.client.0.smithi107.stdout: lockers: 2024-09-12T17:33:48.713 INFO:tasks.workunit.client.0.smithi107.stdout: client.4994 expiration=0.000000 addr=v1:172.21.15.107:0/3843047622 cookie= 2024-09-12T17:33:49.672 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsLock.TestMultiLocking (2847 ms) 2024-09-12T17:33:49.672 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T17:33:51.724 INFO:tasks.workunit.client.0.smithi107.stdout:lock: mylock 2024-09-12T17:33:51.725 INFO:tasks.workunit.client.0.smithi107.stdout: lock_type: shared 2024-09-12T17:33:51.725 INFO:tasks.workunit.client.0.smithi107.stdout: tag: 2024-09-12T17:33:51.725 INFO:tasks.workunit.client.0.smithi107.stdout: lockers: 2024-09-12T17:33:51.725 INFO:tasks.workunit.client.0.smithi107.stdout: client.5145 expiration=0.000000 addr=v1:172.21.15.107:0/2561857936 cookie= 2024-09-12T17:33:51.727 INFO:tasks.workunit.client.0.smithi107.stdout:lock: mylock 2024-09-12T17:33:51.727 INFO:tasks.workunit.client.0.smithi107.stdout: lock_type: exclusive 2024-09-12T17:33:51.727 INFO:tasks.workunit.client.0.smithi107.stdout: tag: new_tag 2024-09-12T17:33:51.727 INFO:tasks.workunit.client.0.smithi107.stdout: lockers: 2024-09-12T17:33:51.727 INFO:tasks.workunit.client.0.smithi107.stdout: client.4997 expiration=0.000000 addr=v1:172.21.15.107:0/1782144162 cookie= 2024-09-12T17:33:52.698 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsLock.TestMeta (3025 ms) 2024-09-12T17:33:52.698 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T17:33:54.717 INFO:tasks.workunit.client.0.smithi107.stdout:lock: mylock 2024-09-12T17:33:54.717 INFO:tasks.workunit.client.0.smithi107.stdout: lock_type: exclusive 2024-09-12T17:33:54.717 INFO:tasks.workunit.client.0.smithi107.stdout: tag: 2024-09-12T17:33:54.717 INFO:tasks.workunit.client.0.smithi107.stdout: lockers: 2024-09-12T17:33:54.719 INFO:tasks.workunit.client.0.smithi107.stdout:lock: mylock 2024-09-12T17:33:54.720 INFO:tasks.workunit.client.0.smithi107.stdout: lock_type: shared 2024-09-12T17:33:54.720 INFO:tasks.workunit.client.0.smithi107.stdout: tag: 2024-09-12T17:33:54.720 INFO:tasks.workunit.client.0.smithi107.stdout: lockers: 2024-09-12T17:33:54.720 INFO:tasks.workunit.client.0.smithi107.stdout: client.5009 expiration=0.000000 addr=v1:172.21.15.107:0/191753875 cookie= 2024-09-12T17:33:54.720 INFO:tasks.workunit.client.0.smithi107.stdout: client.5009 expiration=0.000000 addr=v1:172.21.15.107:0/191753875 cookie=new cookie 2024-09-12T17:33:55.706 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsLock.TestCookie (3009 ms) 2024-09-12T17:33:55.706 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T17:33:58.735 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsLock.TestMultipleLocks (3028 ms) 2024-09-12T17:33:58.735 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T17:34:06.777 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsLock.TestLockDuration (8042 ms) 2024-09-12T17:34:06.777 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T17:34:09.794 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsLock.TestAssertLocked (3018 ms) 2024-09-12T17:34:09.794 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T17:34:12.810 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsLock.TestSetCookie (3016 ms) 2024-09-12T17:34:12.811 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T17:34:33.865 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsLock.TestRenew (21052 ms) 2024-09-12T17:34:33.865 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T17:34:40.909 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7046 ms) 2024-09-12T17:34:40.909 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T17:34:48.939 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8031 ms) 2024-09-12T17:34:48.940 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T17:34:56.981 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8041 ms) 2024-09-12T17:34:56.981 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 11 tests from ClsLock (70155 ms total) 2024-09-12T17:34:56.981 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:34:56.981 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:34:56.981 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 11 tests from 1 test suite ran. (70155 ms total) 2024-09-12T17:34:56.981 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 11 tests. 2024-09-12T17:34:56.984 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:34:56.984 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:34:57.027 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T17:34:57.028 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T17:34:57.028 DEBUG:teuthology.orchestra.run.smithi107:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T17:34:57.115 INFO:tasks.workunit.client.0.smithi107.stdout:Running main() from gmock_main.cc 2024-09-12T17:34:57.116 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:34:57.116 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:34:57.116 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 4 tests from cls_log 2024-09-12T17:34:57.116 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T17:35:00.006 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_log.test_log_add_same_time (2890 ms) 2024-09-12T17:35:00.006 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T17:35:03.027 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_log.test_log_add_different_time (3022 ms) 2024-09-12T17:35:03.028 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T17:35:06.037 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_log.trim_by_time (3008 ms) 2024-09-12T17:35:06.038 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T17:35:09.064 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_log.trim_by_marker (3027 ms) 2024-09-12T17:35:09.064 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 4 tests from cls_log (11947 ms total) 2024-09-12T17:35:09.064 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:35:09.065 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:35:09.065 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 4 tests from 1 test suite ran. (11947 ms total) 2024-09-12T17:35:09.065 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 4 tests. 2024-09-12T17:35:09.066 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:35:09.066 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:35:09.109 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T17:35:09.111 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T17:35:09.111 DEBUG:teuthology.orchestra.run.smithi107:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T17:35:09.198 INFO:tasks.workunit.client.0.smithi107.stdout:Running main() from gmock_main.cc 2024-09-12T17:35:09.199 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:35:09.199 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:35:09.199 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 10 tests from cls_refcount 2024-09-12T17:35:09.199 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T17:35:12.124 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_refcount.test_implicit (2925 ms) 2024-09-12T17:35:12.124 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T17:35:15.150 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3027 ms) 2024-09-12T17:35:15.150 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T17:35:23.274 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_refcount.test_put_snap (8119 ms) 2024-09-12T17:35:23.274 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T17:35:26.290 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_refcount.test_explicit (3020 ms) 2024-09-12T17:35:26.290 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_refcount.set 2024-09-12T17:35:29.314 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_refcount.set (3025 ms) 2024-09-12T17:35:29.314 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T17:35:36.339 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_refcount.test_implicit_ec (7024 ms) 2024-09-12T17:35:36.339 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T17:35:43.394 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7055 ms) 2024-09-12T17:35:43.394 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T17:35:55.527 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_refcount.test_put_snap_ec (12134 ms) 2024-09-12T17:35:55.527 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T17:36:02.539 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_refcount.test_explicit_ec (7012 ms) 2024-09-12T17:36:02.539 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T17:36:09.610 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_refcount.set_ec (7070 ms) 2024-09-12T17:36:09.610 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 10 tests from cls_refcount (60411 ms total) 2024-09-12T17:36:09.610 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:36:09.610 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:36:09.610 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 10 tests from 1 test suite ran. (60411 ms total) 2024-09-12T17:36:09.610 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 10 tests. 2024-09-12T17:36:09.612 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:36:09.613 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:36:09.655 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T17:36:09.656 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T17:36:09.656 DEBUG:teuthology.orchestra.run.smithi107:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T17:36:09.740 INFO:tasks.workunit.client.0.smithi107.stdout:Running main() from gmock_main.cc 2024-09-12T17:36:09.740 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-12T17:36:09.740 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:36:09.740 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 18 tests from cls_rgw 2024-09-12T17:36:11.622 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T17:36:11.670 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.index_basic (48 ms) 2024-09-12T17:36:11.670 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T17:36:11.702 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (32 ms) 2024-09-12T17:36:11.702 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T17:36:11.747 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.index_remove_object (45 ms) 2024-09-12T17:36:11.748 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T17:36:13.237 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.index_suggest (1490 ms) 2024-09-12T17:36:13.237 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T17:36:13.244 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-09-12T17:36:13.244 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T17:36:13.276 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.index_list (31 ms) 2024-09-12T17:36:13.276 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T17:36:32.658 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.index_list_delimited (19383 ms) 2024-09-12T17:36:32.659 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T17:36:32.734 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.bi_list (75 ms) 2024-09-12T17:36:32.734 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T17:36:32.743 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-09-12T17:36:32.743 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T17:36:32.753 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.gc_list (10 ms) 2024-09-12T17:36:32.753 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T17:36:40.699 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.gc_defer (7945 ms) 2024-09-12T17:36:40.699 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T17:36:40.773 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.usage_basic (74 ms) 2024-09-12T17:36:40.773 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T17:36:40.774 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2024-09-12T17:36:40.774 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T17:36:40.867 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.usage_clear (93 ms) 2024-09-12T17:36:40.867 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T17:36:40.908 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.bi_log_trim (41 ms) 2024-09-12T17:36:40.908 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T17:36:40.921 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.index_racing_removes (13 ms) 2024-09-12T17:36:40.921 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T17:36:40.938 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.reshardlog_list (17 ms) 2024-09-12T17:36:40.938 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T17:36:40.949 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw.reshardlog_num (9 ms) 2024-09-12T17:36:41.701 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 18 tests from cls_rgw (29325 ms total) 2024-09-12T17:36:41.701 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:36:41.701 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:36:41.701 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 18 tests from 1 test suite ran. (31960 ms total) 2024-09-12T17:36:41.701 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 18 tests. 2024-09-12T17:36:41.704 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:36:41.704 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:36:41.745 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T17:36:41.747 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T17:36:41.747 DEBUG:teuthology.orchestra.run.smithi107:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T17:36:41.832 INFO:tasks.workunit.client.0.smithi107.stdout:Running main() from gmock_main.cc 2024-09-12T17:36:41.832 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:36:41.832 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:36:41.832 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T17:36:41.832 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T17:36:43.723 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw_gc.init (1891 ms) 2024-09-12T17:36:43.723 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T17:36:43.750 INFO:tasks.workunit.client.0.smithi107.stderr:[ ] list info tag = chain-0 2024-09-12T17:36:43.751 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (28 ms) 2024-09-12T17:36:43.751 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T17:36:43.761 INFO:tasks.workunit.client.0.smithi107.stderr:[ ] next_marker is: = 0/4263 2024-09-12T17:36:43.761 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (11 ms) 2024-09-12T17:36:43.762 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T17:36:43.770 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-09-12T17:36:43.770 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T17:36:43.781 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (11 ms) 2024-09-12T17:36:43.781 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T17:36:43.854 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (72 ms) 2024-09-12T17:36:43.854 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T17:36:43.861 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (8 ms) 2024-09-12T17:36:43.861 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T17:36:43.871 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (10 ms) 2024-09-12T17:36:43.872 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T17:36:44.734 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw_gc.finalize (863 ms) 2024-09-12T17:36:44.734 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 9 tests from cls_rgw_gc (2903 ms total) 2024-09-12T17:36:44.735 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:36:44.735 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:36:44.735 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 9 tests from 1 test suite ran. (2903 ms total) 2024-09-12T17:36:44.735 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 9 tests. 2024-09-12T17:36:44.737 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:36:44.737 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:36:44.781 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T17:36:44.783 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T17:36:44.783 DEBUG:teuthology.orchestra.run.smithi107:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T17:36:44.840 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:44.841 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:44.841 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T17:36:44.841 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:36:46.743 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T17:36:46.743 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T17:36:46.752 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.751+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=TFJLUJP9KE0W type=del size=792447 2024-09-12T17:36:46.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.753+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=K01H2IVKPUGB type=del size=43883 2024-09-12T17:36:46.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.754+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=QG05A0UADOWO type=del size=2452055 2024-09-12T17:36:46.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.756+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=3JT7I2ND86T6 type=del size=4021960 2024-09-12T17:36:46.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.758+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~MV23KM8Z645V.0 size=832067 2024-09-12T17:36:46.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.758+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=MV23KM8Z645V tag=YG8W5WSUBI58 type=write size=1880643 2024-09-12T17:36:46.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.760+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~ENEPOTNQSRCI.0 size=784224 2024-09-12T17:36:46.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.760+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=ENEPOTNQSRCI tag=0QYI4TB717F8 type=write size=1832800 2024-09-12T17:36:46.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.762+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=FB323G2PVF7Z type=del size=1663210 2024-09-12T17:36:46.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.763+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=NAX8YPE2ZUOY type=del size=921245 2024-09-12T17:36:46.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.764+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=XZONVLD2VQ1Z type=write size=957740 2024-09-12T17:36:46.767 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.766+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=F4RUKA1X2FG2 type=del size=698753 2024-09-12T17:36:46.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.767+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=2OS11B6SMBKG type=del size=3607817 2024-09-12T17:36:46.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.768+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=BVU9QFR92WQG type=write size=627586 2024-09-12T17:36:46.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.770+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=S6KZBBHY725M type=del size=4036396 2024-09-12T17:36:46.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.773+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~9ROJ85JCDYFO.0 size=1048576 2024-09-12T17:36:46.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.774+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~9ROJ85JCDYFO.1 size=235670 2024-09-12T17:36:46.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.774+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=9ROJ85JCDYFO tag=BQJY2QIWDFLB type=write size=2332822 2024-09-12T17:36:46.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.776+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~LD0ZJL7S1T25.0 size=593783 2024-09-12T17:36:46.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.776+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=LD0ZJL7S1T25 tag=NRXZZ9VCU6VO type=write size=1642359 2024-09-12T17:36:46.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.777+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=S9QEPY60R0M4 type=del size=2845655 2024-09-12T17:36:46.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.778+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=TFJLUJP9KE0W type=del 2024-09-12T17:36:46.781 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.780+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=FKZWRGUAOEIL type=del size=2783352 2024-09-12T17:36:46.782 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.781+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=K01H2IVKPUGB type=del 2024-09-12T17:36:46.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.785+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~PU648TW2ETZC.0 size=1048576 2024-09-12T17:36:46.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.786+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~PU648TW2ETZC.1 size=1048576 2024-09-12T17:36:46.788 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.787+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~PU648TW2ETZC.2 size=484294 2024-09-12T17:36:46.788 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.787+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=PU648TW2ETZC tag=DHRPNV4KB1VT type=write size=3630022 2024-09-12T17:36:46.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.788+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=QG05A0UADOWO type=del 2024-09-12T17:36:46.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.789+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=WISNVL276SF7 type=del size=2302794 2024-09-12T17:36:46.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.790+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=3JT7I2ND86T6 type=del 2024-09-12T17:36:46.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.793+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~3U9IXHJVIAJN.0 size=1048576 2024-09-12T17:36:46.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.794+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~3U9IXHJVIAJN.1 size=618637 2024-09-12T17:36:46.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.794+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=3U9IXHJVIAJN tag=D52AEG5S4W31 type=write size=2715789 2024-09-12T17:36:46.796 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.795+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~MV23KM8Z645V.0 size=832067 2024-09-12T17:36:46.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.797+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=MV23KM8Z645V tag=YG8W5WSUBI58 type=write size=1880643 2024-09-12T17:36:46.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.799+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~TK8TVD22KQAR.0 size=1048576 2024-09-12T17:36:46.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.801+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~TK8TVD22KQAR.1 size=1048576 2024-09-12T17:36:46.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.802+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~TK8TVD22KQAR.2 size=460194 2024-09-12T17:36:46.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.802+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=TK8TVD22KQAR tag=8U08GSUIMTJG type=write size=3605922 2024-09-12T17:36:46.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.802+0000 7fa80ca76780 1 < canceled part key=_multipart_BLGMV3S9AY24.2~ENEPOTNQSRCI.0 size=784224 2024-09-12T17:36:46.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.804+0000 7fa80ca76780 1 < canceled multipart upload key=BLGMV3S9AY24 upload=ENEPOTNQSRCI tag=0QYI4TB717F8 type=write size=1832800 2024-09-12T17:36:46.808 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.806+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~I2D1TE9EV0P5.0 size=1048576 2024-09-12T17:36:46.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.807+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~I2D1TE9EV0P5.1 size=1048576 2024-09-12T17:36:46.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.808+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~I2D1TE9EV0P5.2 size=614711 2024-09-12T17:36:46.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.809+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=I2D1TE9EV0P5 tag=KVFQ6EH7GH24 type=write size=3760439 2024-09-12T17:36:46.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.810+0000 7fa80ca76780 1 < canceled operation key=AKE8O7Q277HX tag=FB323G2PVF7Z type=del size=1663210 2024-09-12T17:36:46.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.811+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=SMMNMZNMWK89 type=del size=2354130 2024-09-12T17:36:46.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.812+0000 7fa80ca76780 1 < completed delete operation key=0X3LGXL2QFRN tag=NAX8YPE2ZUOY type=del 2024-09-12T17:36:46.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.814+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=KDXKPBA94AJE type=del size=2053134 2024-09-12T17:36:46.816 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.815+0000 7fa80ca76780 1 < canceled operation key=Z81704G91EPL tag=XZONVLD2VQ1Z type=write size=957740 2024-09-12T17:36:46.818 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.817+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~DDFPENXNJ7E3.0 size=383923 2024-09-12T17:36:46.818 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.817+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=DDFPENXNJ7E3 tag=SHUZ6KQ5W5ZM type=write size=1432499 2024-09-12T17:36:46.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.818+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=F4RUKA1X2FG2 type=del 2024-09-12T17:36:46.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.820+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~QHJ33RUZW35N.0 size=587586 2024-09-12T17:36:46.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.820+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=QHJ33RUZW35N tag=VSP1KO5ADVBN type=write size=1636162 2024-09-12T17:36:46.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.822+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=2OS11B6SMBKG type=del 2024-09-12T17:36:46.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.824+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~L2L99W76C9SQ.0 size=282324 2024-09-12T17:36:46.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.824+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=L2L99W76C9SQ tag=CCE37CB3EB5L type=write size=1330900 2024-09-12T17:36:46.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.826+0000 7fa80ca76780 1 < completed write operation key=0X3LGXL2QFRN tag=BVU9QFR92WQG type=write size=627586 2024-09-12T17:36:46.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.827+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=JPC5LXP7R37L type=del size=1964466 2024-09-12T17:36:46.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.828+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=S6KZBBHY725M type=del 2024-09-12T17:36:46.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.829+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=M050Y8KXYQIN type=del size=3920017 2024-09-12T17:36:46.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.831+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~9ROJ85JCDYFO.0 size=1048576 2024-09-12T17:36:46.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.832+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~9ROJ85JCDYFO.1 size=235670 2024-09-12T17:36:46.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.834+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=9ROJ85JCDYFO tag=BQJY2QIWDFLB type=write size=2332822 2024-09-12T17:36:46.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.836+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~QLVXA8PZT9HZ.0 size=1048576 2024-09-12T17:36:46.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.837+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~QLVXA8PZT9HZ.1 size=984868 2024-09-12T17:36:46.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.837+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=QLVXA8PZT9HZ tag=Q1OMPWW8QM2Z type=write size=3082020 2024-09-12T17:36:46.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.838+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~LD0ZJL7S1T25.0 size=593783 2024-09-12T17:36:46.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.840+0000 7fa80ca76780 1 < completed multipart upload key=07LPSZT2RKCC upload=LD0ZJL7S1T25 tag=NRXZZ9VCU6VO type=write size=1642359 2024-09-12T17:36:46.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.841+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=2LNL8SG5B3I0 type=del size=1375598 2024-09-12T17:36:46.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.842+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=S9QEPY60R0M4 type=del 2024-09-12T17:36:46.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.844+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~8JIK6HVIPCYT.0 size=373804 2024-09-12T17:36:46.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.844+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=8JIK6HVIPCYT tag=6IGR45TK5IG3 type=write size=1422380 2024-09-12T17:36:46.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.845+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=FKZWRGUAOEIL type=del 2024-09-12T17:36:46.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.848+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~RB31RIGH0MWK.0 size=1048576 2024-09-12T17:36:46.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.849+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~RB31RIGH0MWK.1 size=1048576 2024-09-12T17:36:46.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.849+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~RB31RIGH0MWK.2 size=841522 2024-09-12T17:36:46.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.849+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=RB31RIGH0MWK tag=XYYNBL0JI80Y type=write size=3987250 2024-09-12T17:36:46.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.851+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~PU648TW2ETZC.0 size=1048576 2024-09-12T17:36:46.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.852+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~PU648TW2ETZC.1 size=1048576 2024-09-12T17:36:46.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.853+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~PU648TW2ETZC.2 size=484294 2024-09-12T17:36:46.856 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.855+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=PU648TW2ETZC tag=DHRPNV4KB1VT type=write size=3630022 2024-09-12T17:36:46.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.856+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=62F5IL34C8VS type=del size=307272 2024-09-12T17:36:46.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.857+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=WISNVL276SF7 type=del 2024-09-12T17:36:46.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.858+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=QSKT1M0L5XRG type=del size=2404993 2024-09-12T17:36:46.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.859+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~3U9IXHJVIAJN.0 size=1048576 2024-09-12T17:36:46.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.860+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~3U9IXHJVIAJN.1 size=618637 2024-09-12T17:36:46.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.862+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=3U9IXHJVIAJN tag=D52AEG5S4W31 type=write size=2715789 2024-09-12T17:36:46.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.863+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=K11TTWXX41HB type=del size=3327196 2024-09-12T17:36:46.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.864+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~TK8TVD22KQAR.0 size=1048576 2024-09-12T17:36:46.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.865+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~TK8TVD22KQAR.1 size=1048576 2024-09-12T17:36:46.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.866+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~TK8TVD22KQAR.2 size=460194 2024-09-12T17:36:46.871 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.870+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=TK8TVD22KQAR tag=8U08GSUIMTJG type=write size=3605922 2024-09-12T17:36:46.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.871+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=RE89COHM9K5N type=del size=131183 2024-09-12T17:36:46.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.872+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~I2D1TE9EV0P5.0 size=1048576 2024-09-12T17:36:46.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.872+0000 7fa80ca76780 1 < canceled part key=_multipart_0J6RTRJWZP1T.2~I2D1TE9EV0P5.1 size=1048576 2024-09-12T17:36:46.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.873+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~I2D1TE9EV0P5.2 size=614711 2024-09-12T17:36:46.876 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.875+0000 7fa80ca76780 1 < canceled multipart upload key=0J6RTRJWZP1T upload=I2D1TE9EV0P5 tag=KVFQ6EH7GH24 type=write size=3760439 2024-09-12T17:36:46.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.876+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=AKH25HEDAUYZ type=del size=2762389 2024-09-12T17:36:46.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.877+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=SMMNMZNMWK89 type=del 2024-09-12T17:36:46.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.878+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=V64SDG47WYE1 type=del size=3303446 2024-09-12T17:36:46.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.880+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=KDXKPBA94AJE type=del 2024-09-12T17:36:46.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.883+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=XLJKZN7BXUPY type=write size=434534 2024-09-12T17:36:46.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.884+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~DDFPENXNJ7E3.0 size=383923 2024-09-12T17:36:46.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.886+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=DDFPENXNJ7E3 tag=SHUZ6KQ5W5ZM type=write size=1432499 2024-09-12T17:36:46.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.888+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=A3ZWLA14Z4KX type=del size=2560920 2024-09-12T17:36:46.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.889+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~QHJ33RUZW35N.0 size=587586 2024-09-12T17:36:46.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.891+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=QHJ33RUZW35N tag=VSP1KO5ADVBN type=write size=1636162 2024-09-12T17:36:46.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.892+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=VJUZFT3KBP7W type=del size=3644165 2024-09-12T17:36:46.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.892+0000 7fa80ca76780 1 < canceled part key=_multipart_R871XU2TDWID.2~L2L99W76C9SQ.0 size=282324 2024-09-12T17:36:46.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.894+0000 7fa80ca76780 1 < canceled multipart upload key=R871XU2TDWID upload=L2L99W76C9SQ tag=CCE37CB3EB5L type=write size=1330900 2024-09-12T17:36:46.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.895+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=HBWCXR4P0XWS type=write size=219801 2024-09-12T17:36:46.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.896+0000 7fa80ca76780 1 < canceled operation key=OJPZAWR5BLBN tag=JPC5LXP7R37L type=del size=1964466 2024-09-12T17:36:46.899 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.898+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~G4JYPRX2JZGI.0 size=1048576 2024-09-12T17:36:46.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.899+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~G4JYPRX2JZGI.1 size=143005 2024-09-12T17:36:46.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.899+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=G4JYPRX2JZGI tag=5AFCFGPQ1ZLY type=write size=2240157 2024-09-12T17:36:46.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.900+0000 7fa80ca76780 1 < canceled operation key=07LPSZT2RKCC tag=M050Y8KXYQIN type=del size=3920017 2024-09-12T17:36:46.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.902+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=CIYI7PTM0G67 type=del size=604026 2024-09-12T17:36:46.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.903+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~QLVXA8PZT9HZ.0 size=1048576 2024-09-12T17:36:46.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.904+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~QLVXA8PZT9HZ.1 size=984868 2024-09-12T17:36:46.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.906+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=QLVXA8PZT9HZ tag=Q1OMPWW8QM2Z type=write size=3082020 2024-09-12T17:36:46.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.907+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=YAG3C0X0H4A8 type=write size=627756 2024-09-12T17:36:46.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.908+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=2LNL8SG5B3I0 type=del 2024-09-12T17:36:46.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.910+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~R4R0NURWN407.0 size=95497 2024-09-12T17:36:46.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.910+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=R4R0NURWN407 tag=9CC6XDL8U0CZ type=write size=1144073 2024-09-12T17:36:46.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.911+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~8JIK6HVIPCYT.0 size=373804 2024-09-12T17:36:46.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.913+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=8JIK6HVIPCYT tag=6IGR45TK5IG3 type=write size=1422380 2024-09-12T17:36:46.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.915+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~P44J6AR96S1U.0 size=1048576 2024-09-12T17:36:46.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.916+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~P44J6AR96S1U.1 size=1048576 2024-09-12T17:36:46.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.917+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~P44J6AR96S1U.2 size=269936 2024-09-12T17:36:46.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.917+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=P44J6AR96S1U tag=XAHOWQU8YSJ5 type=write size=3415664 2024-09-12T17:36:46.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.918+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~RB31RIGH0MWK.0 size=1048576 2024-09-12T17:36:46.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.919+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~RB31RIGH0MWK.1 size=1048576 2024-09-12T17:36:46.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.920+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~RB31RIGH0MWK.2 size=841522 2024-09-12T17:36:46.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.922+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=RB31RIGH0MWK tag=XYYNBL0JI80Y type=write size=3987250 2024-09-12T17:36:46.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.924+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~R97E7R1UW3WM.0 size=492969 2024-09-12T17:36:46.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.924+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=R97E7R1UW3WM tag=B0HI196J0U0L type=write size=1541545 2024-09-12T17:36:46.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.925+0000 7fa80ca76780 1 < canceled operation key=DYZIHCBF3D8U tag=62F5IL34C8VS type=del size=307272 2024-09-12T17:36:46.928 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.927+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=1WML5MMJ429N type=del size=1593751 2024-09-12T17:36:46.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.928+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=QSKT1M0L5XRG type=del 2024-09-12T17:36:46.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.929+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=L2RAQPDTOS18 type=write size=928213 2024-09-12T17:36:46.932 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.931+0000 7fa80ca76780 1 < suggested update operation key=H87S6AI6JT6D tag=K11TTWXX41HB type=del size=3327196 2024-09-12T17:36:46.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.933+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~JMV7BQCLAEJ1.0 size=1048576 2024-09-12T17:36:46.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.934+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~JMV7BQCLAEJ1.1 size=1048576 2024-09-12T17:36:46.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.935+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~JMV7BQCLAEJ1.2 size=825059 2024-09-12T17:36:46.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.935+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=JMV7BQCLAEJ1 tag=V3JBZEQBBA9Z type=write size=3970787 2024-09-12T17:36:46.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.937+0000 7fa80ca76780 1 < suggested remove operation key=5CAG55DQEF3Y tag=RE89COHM9K5N type=del 2024-09-12T17:36:46.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.939+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=9NAZFT19XP3Z type=del size=130825 2024-09-12T17:36:46.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.941+0000 7fa80ca76780 1 < suggested remove operation key=BLGMV3S9AY24 tag=AKH25HEDAUYZ type=del 2024-09-12T17:36:46.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.942+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=O883BLZQEIX0 type=del size=1678157 2024-09-12T17:36:46.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.943+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=V64SDG47WYE1 type=del 2024-09-12T17:36:46.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.945+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~DPR23JR21NIQ.0 size=1048576 2024-09-12T17:36:46.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.946+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~DPR23JR21NIQ.1 size=1048576 2024-09-12T17:36:46.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.947+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~DPR23JR21NIQ.2 size=431641 2024-09-12T17:36:46.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.947+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=DPR23JR21NIQ tag=9H9KQYIXOKK8 type=write size=3577369 2024-09-12T17:36:46.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.949+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=XLJKZN7BXUPY type=write size=434534 2024-09-12T17:36:46.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.950+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=46094XTORI3S type=del size=3673288 2024-09-12T17:36:46.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.951+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=A3ZWLA14Z4KX type=del 2024-09-12T17:36:46.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.952+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=U811GXU0NONJ type=write size=435521 2024-09-12T17:36:46.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.953+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=VJUZFT3KBP7W type=del 2024-09-12T17:36:46.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.955+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~VVCX5M3SRVXH.0 size=1048576 2024-09-12T17:36:46.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.956+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~VVCX5M3SRVXH.1 size=552159 2024-09-12T17:36:46.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.956+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=VVCX5M3SRVXH tag=0YG6C77PBUTG type=write size=2649311 2024-09-12T17:36:46.960 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.959+0000 7fa80ca76780 1 < completed write operation key=Z81704G91EPL tag=HBWCXR4P0XWS type=write size=219801 2024-09-12T17:36:46.961 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.960+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=DOS2ESCLQZ8U type=del size=2982934 2024-09-12T17:36:46.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.961+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~G4JYPRX2JZGI.0 size=1048576 2024-09-12T17:36:46.963 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.962+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~G4JYPRX2JZGI.1 size=143005 2024-09-12T17:36:46.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.964+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=G4JYPRX2JZGI tag=5AFCFGPQ1ZLY type=write size=2240157 2024-09-12T17:36:46.968 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.967+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~IF020ZT8QGHU.0 size=1048576 2024-09-12T17:36:46.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.967+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~IF020ZT8QGHU.1 size=1048576 2024-09-12T17:36:46.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.968+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~IF020ZT8QGHU.2 size=201842 2024-09-12T17:36:46.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.968+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=IF020ZT8QGHU tag=VX3NSODCI39Y type=write size=3347570 2024-09-12T17:36:46.971 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.970+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=CIYI7PTM0G67 type=del 2024-09-12T17:36:46.973 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.972+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~24HCS27LP2F6.0 size=1048576 2024-09-12T17:36:46.974 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.973+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~24HCS27LP2F6.1 size=1048576 2024-09-12T17:36:46.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.974+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~24HCS27LP2F6.2 size=96097 2024-09-12T17:36:46.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.974+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=24HCS27LP2F6 tag=1ZKLVGEY3VBC type=write size=3241825 2024-09-12T17:36:46.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.975+0000 7fa80ca76780 1 < completed write operation key=DYZIHCBF3D8U tag=YAG3C0X0H4A8 type=write size=627756 2024-09-12T17:36:46.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.976+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=F2O53BXZCK8Y type=del size=1533515 2024-09-12T17:36:46.978 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.977+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~R4R0NURWN407.0 size=95497 2024-09-12T17:36:46.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.979+0000 7fa80ca76780 1 < completed multipart upload key=07LPSZT2RKCC upload=R4R0NURWN407 tag=9CC6XDL8U0CZ type=write size=1144073 2024-09-12T17:36:46.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.981+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~GCYC17L9FV5Q.0 size=1041193 2024-09-12T17:36:46.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.981+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=GCYC17L9FV5Q tag=6RTGEQ9H41PH type=write size=2089769 2024-09-12T17:36:46.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.982+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~P44J6AR96S1U.0 size=1048576 2024-09-12T17:36:46.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.983+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~P44J6AR96S1U.1 size=1048576 2024-09-12T17:36:46.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.984+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~P44J6AR96S1U.2 size=269936 2024-09-12T17:36:46.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.986+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=P44J6AR96S1U tag=XAHOWQU8YSJ5 type=write size=3415664 2024-09-12T17:36:46.988 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.987+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=C4M1YLU07TYO type=del size=2370898 2024-09-12T17:36:46.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.988+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~R97E7R1UW3WM.0 size=492969 2024-09-12T17:36:46.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.991+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=R97E7R1UW3WM tag=B0HI196J0U0L type=write size=1541545 2024-09-12T17:36:46.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.992+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=L3BGV15LQOEC type=del size=1487768 2024-09-12T17:36:46.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.993+0000 7fa80ca76780 -1 < failed to complete operation key=5CAG55DQEF3Y tag=1WML5MMJ429N type=del size=1593751: (22) Invalid argument 2024-09-12T17:36:46.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.994+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=2EJ71XUGHM8V type=write size=548005 2024-09-12T17:36:46.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.995+0000 7fa80ca76780 1 < completed write operation key=VDD4PDR1GLWQ tag=L2RAQPDTOS18 type=write size=928213 2024-09-12T17:36:46.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.996+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=9KMHGRLAXABR type=del size=533429 2024-09-12T17:36:46.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.998+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~JMV7BQCLAEJ1.0 size=1048576 2024-09-12T17:36:46.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.998+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~JMV7BQCLAEJ1.1 size=1048576 2024-09-12T17:36:47.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:46.999+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~JMV7BQCLAEJ1.2 size=825059 2024-09-12T17:36:47.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.001+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=JMV7BQCLAEJ1 tag=V3JBZEQBBA9Z type=write size=3970787 2024-09-12T17:36:47.003 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.002+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=VEA6BK9246EW type=del size=4173566 2024-09-12T17:36:47.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.004+0000 7fa80ca76780 1 < suggested remove operation key=R02234GEWV6B tag=9NAZFT19XP3Z type=del 2024-09-12T17:36:47.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.005+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=YN678UO38078 type=write size=197700 2024-09-12T17:36:47.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.006+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=O883BLZQEIX0 type=del 2024-09-12T17:36:47.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.007+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=D91CZ3FDN5SY type=del size=2167682 2024-09-12T17:36:47.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.009+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~DPR23JR21NIQ.0 size=1048576 2024-09-12T17:36:47.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.010+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~DPR23JR21NIQ.1 size=1048576 2024-09-12T17:36:47.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.010+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~DPR23JR21NIQ.2 size=431641 2024-09-12T17:36:47.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.012+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=DPR23JR21NIQ tag=9H9KQYIXOKK8 type=write size=3577369 2024-09-12T17:36:47.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.014+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~4S1O79UT48FC.0 size=1048576 2024-09-12T17:36:47.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.015+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~4S1O79UT48FC.1 size=941583 2024-09-12T17:36:47.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.015+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=4S1O79UT48FC tag=E6YUI9HU51T7 type=write size=3038735 2024-09-12T17:36:47.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.016+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=46094XTORI3S type=del 2024-09-12T17:36:47.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.017+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=CL3HXXS533H1 type=del size=2656031 2024-09-12T17:36:47.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.019+0000 7fa80ca76780 1 < suggested update operation key=VC1X03K12V80 tag=U811GXU0NONJ type=write size=435521 2024-09-12T17:36:47.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.021+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~V61I1IFFDF2F.0 size=1048576 2024-09-12T17:36:47.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.022+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~V61I1IFFDF2F.1 size=996788 2024-09-12T17:36:47.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.022+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=V61I1IFFDF2F tag=BKTTMNE6AGU1 type=write size=3093940 2024-09-12T17:36:47.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.023+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~VVCX5M3SRVXH.0 size=1048576 2024-09-12T17:36:47.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.024+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~VVCX5M3SRVXH.1 size=552159 2024-09-12T17:36:47.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.026+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=VVCX5M3SRVXH tag=0YG6C77PBUTG type=write size=2649311 2024-09-12T17:36:47.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.027+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=NTE0LFT8ZW8D type=del size=2493388 2024-09-12T17:36:47.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.028+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=DOS2ESCLQZ8U type=del 2024-09-12T17:36:47.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.030+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~COC8X3RLCX4M.0 size=1048576 2024-09-12T17:36:47.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.031+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~COC8X3RLCX4M.1 size=1048576 2024-09-12T17:36:47.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.032+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~COC8X3RLCX4M.2 size=925929 2024-09-12T17:36:47.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.032+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=COC8X3RLCX4M tag=L4BBHODPBKHO type=write size=4071657 2024-09-12T17:36:47.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.033+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~IF020ZT8QGHU.0 size=1048576 2024-09-12T17:36:47.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.034+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~IF020ZT8QGHU.1 size=1048576 2024-09-12T17:36:47.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.034+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~IF020ZT8QGHU.2 size=201842 2024-09-12T17:36:47.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.036+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=IF020ZT8QGHU tag=VX3NSODCI39Y type=write size=3347570 2024-09-12T17:36:47.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.037+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=M9EGJ9WJ9H2P type=del size=2023307 2024-09-12T17:36:47.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.039+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~24HCS27LP2F6.0 size=1048576 2024-09-12T17:36:47.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.041+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~24HCS27LP2F6.1 size=1048576 2024-09-12T17:36:47.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.042+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~24HCS27LP2F6.2 size=96097 2024-09-12T17:36:47.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.044+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=24HCS27LP2F6 tag=1ZKLVGEY3VBC type=write size=3241825 2024-09-12T17:36:47.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.045+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=QCF3Z660OSHH type=del size=4111967 2024-09-12T17:36:47.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.046+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=F2O53BXZCK8Y type=del 2024-09-12T17:36:47.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.047+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=5Q23BPXF1050 type=del size=41556 2024-09-12T17:36:47.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.048+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~GCYC17L9FV5Q.0 size=1041193 2024-09-12T17:36:47.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.050+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=GCYC17L9FV5Q tag=6RTGEQ9H41PH type=write size=2089769 2024-09-12T17:36:47.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.051+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=59XAT63LTRUS type=write size=451700 2024-09-12T17:36:47.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.053+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=C4M1YLU07TYO type=del 2024-09-12T17:36:47.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.055+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~Y7UZ0PG3W7FC.0 size=1048576 2024-09-12T17:36:47.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.055+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~Y7UZ0PG3W7FC.1 size=1048576 2024-09-12T17:36:47.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.056+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~Y7UZ0PG3W7FC.2 size=553883 2024-09-12T17:36:47.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.056+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=Y7UZ0PG3W7FC tag=CJEJQAV57S0U type=write size=3699611 2024-09-12T17:36:47.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.057+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=L3BGV15LQOEC type=del 2024-09-12T17:36:47.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.059+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=IJ1EVAQFGNDB type=del size=4164921 2024-09-12T17:36:47.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.060+0000 7fa80ca76780 1 < completed write operation key=LU7PDGWTAK63 tag=2EJ71XUGHM8V type=write size=548005 2024-09-12T17:36:47.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.061+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=T9R2Y7BL1T68 type=write size=215403 2024-09-12T17:36:47.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.063+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=9KMHGRLAXABR type=del 2024-09-12T17:36:47.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.064+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=OLTPN7T8K804 type=write size=694567 2024-09-12T17:36:47.066 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.065+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=VEA6BK9246EW type=del 2024-09-12T17:36:47.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.067+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~2WD60663GRZA.0 size=1048576 2024-09-12T17:36:47.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.068+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~2WD60663GRZA.1 size=1048576 2024-09-12T17:36:47.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.069+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~2WD60663GRZA.2 size=838282 2024-09-12T17:36:47.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.069+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=2WD60663GRZA tag=8FPJARRS3KDC type=write size=3984010 2024-09-12T17:36:47.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.072+0000 7fa80ca76780 1 < suggested update operation key=DYZIHCBF3D8U tag=YN678UO38078 type=write size=197700 2024-09-12T17:36:47.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.073+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=9PJR5Y2U1TQY type=del size=3897349 2024-09-12T17:36:47.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.074+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=D91CZ3FDN5SY type=del 2024-09-12T17:36:47.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.075+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=QG6E20DS6BZ5 type=del size=3461566 2024-09-12T17:36:47.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.076+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~4S1O79UT48FC.0 size=1048576 2024-09-12T17:36:47.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.078+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~4S1O79UT48FC.1 size=941583 2024-09-12T17:36:47.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.080+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=4S1O79UT48FC tag=E6YUI9HU51T7 type=write size=3038735 2024-09-12T17:36:47.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.081+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=ZMLACAMCXCMJ type=del size=2446599 2024-09-12T17:36:47.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.082+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=CL3HXXS533H1 type=del 2024-09-12T17:36:47.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.085+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~QDEHT7FE0PYF.0 size=1012255 2024-09-12T17:36:47.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.085+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=QDEHT7FE0PYF tag=9GP9UI73QI89 type=write size=2060831 2024-09-12T17:36:47.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.086+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~V61I1IFFDF2F.0 size=1048576 2024-09-12T17:36:47.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.087+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~V61I1IFFDF2F.1 size=996788 2024-09-12T17:36:47.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.089+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=V61I1IFFDF2F tag=BKTTMNE6AGU1 type=write size=3093940 2024-09-12T17:36:47.091 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.090+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=K2HSJLK55MWN type=del size=1989591 2024-09-12T17:36:47.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.091+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=NTE0LFT8ZW8D type=del 2024-09-12T17:36:47.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.093+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=HYQZASIS55GH type=del size=2805682 2024-09-12T17:36:47.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.094+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~COC8X3RLCX4M.0 size=1048576 2024-09-12T17:36:47.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.095+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~COC8X3RLCX4M.1 size=1048576 2024-09-12T17:36:47.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.096+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~COC8X3RLCX4M.2 size=925929 2024-09-12T17:36:47.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.099+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=COC8X3RLCX4M tag=L4BBHODPBKHO type=write size=4071657 2024-09-12T17:36:47.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.100+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=UIFYJ5866XP2 type=del size=341259 2024-09-12T17:36:47.102 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.101+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=M9EGJ9WJ9H2P type=del 2024-09-12T17:36:47.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.103+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=NUVR0IGYYP1O type=del size=1205873 2024-09-12T17:36:47.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.104+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=QCF3Z660OSHH type=del 2024-09-12T17:36:47.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.105+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=YBUPV76P6AD5 type=write size=288902 2024-09-12T17:36:47.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.106+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=5Q23BPXF1050 type=del 2024-09-12T17:36:47.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.108+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=C9ZG70LO3R3R type=del size=923503 2024-09-12T17:36:47.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.109+0000 7fa80ca76780 1 < completed write operation key=07LPSZT2RKCC tag=59XAT63LTRUS type=write size=451700 2024-09-12T17:36:47.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.111+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~HD0P7D0CDA0P.0 size=956088 2024-09-12T17:36:47.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.111+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=HD0P7D0CDA0P tag=3X20JRAJ1Y4M type=write size=2004664 2024-09-12T17:36:47.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.112+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~Y7UZ0PG3W7FC.0 size=1048576 2024-09-12T17:36:47.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.113+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~Y7UZ0PG3W7FC.1 size=1048576 2024-09-12T17:36:47.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.114+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~Y7UZ0PG3W7FC.2 size=553883 2024-09-12T17:36:47.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.116+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=Y7UZ0PG3W7FC tag=CJEJQAV57S0U type=write size=3699611 2024-09-12T17:36:47.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.118+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=3RD2EGDZ57Y2 type=write size=365284 2024-09-12T17:36:47.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.119+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=IJ1EVAQFGNDB type=del 2024-09-12T17:36:47.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.121+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~FE2OE6V0L0W1.0 size=1048576 2024-09-12T17:36:47.123 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.122+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~FE2OE6V0L0W1.1 size=1048576 2024-09-12T17:36:47.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.124+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~FE2OE6V0L0W1.2 size=928329 2024-09-12T17:36:47.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.124+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=FE2OE6V0L0W1 tag=4NG4RKMIFPPY type=write size=4074057 2024-09-12T17:36:47.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.126+0000 7fa80ca76780 1 < suggested remove operation key=8Z3EPQHMA6M5 tag=T9R2Y7BL1T68 type=write 2024-09-12T17:36:47.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.128+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~3INRPIRHFV0O.0 size=372744 2024-09-12T17:36:47.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.128+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=3INRPIRHFV0O tag=YAFHIGG1I193 type=write size=1421320 2024-09-12T17:36:47.131 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.130+0000 7fa80ca76780 1 < suggested remove operation key=EDRL3T2I9AOO tag=OLTPN7T8K804 type=write 2024-09-12T17:36:47.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.133+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~923IXGRX9A2J.0 size=1048576 2024-09-12T17:36:47.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.133+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~923IXGRX9A2J.1 size=171057 2024-09-12T17:36:47.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.133+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=923IXGRX9A2J tag=6M6PE3X4H5Z3 type=write size=2268209 2024-09-12T17:36:47.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.135+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~2WD60663GRZA.0 size=1048576 2024-09-12T17:36:47.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.136+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~2WD60663GRZA.1 size=1048576 2024-09-12T17:36:47.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.136+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~2WD60663GRZA.2 size=838282 2024-09-12T17:36:47.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.138+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=2WD60663GRZA tag=8FPJARRS3KDC type=write size=3984010 2024-09-12T17:36:47.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.141+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~56IO66GK8GIF.0 size=1048576 2024-09-12T17:36:47.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.142+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~56IO66GK8GIF.1 size=737543 2024-09-12T17:36:47.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.142+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=56IO66GK8GIF tag=792GRXP6BH8P type=write size=2834695 2024-09-12T17:36:47.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.143+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=9PJR5Y2U1TQY type=del 2024-09-12T17:36:47.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.145+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~HY7TW3KETAH9.0 size=1048576 2024-09-12T17:36:47.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.146+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~HY7TW3KETAH9.1 size=1048576 2024-09-12T17:36:47.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.147+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~HY7TW3KETAH9.2 size=795415 2024-09-12T17:36:47.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.148+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=HY7TW3KETAH9 tag=V8JDCX0SV4LF type=write size=3941143 2024-09-12T17:36:47.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.149+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=QG6E20DS6BZ5 type=del 2024-09-12T17:36:47.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.151+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~JELOWAQ0Q5WJ.0 size=871146 2024-09-12T17:36:47.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.151+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=JELOWAQ0Q5WJ tag=JKKXDBF08P8T type=write size=1919722 2024-09-12T17:36:47.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.153+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=ZMLACAMCXCMJ type=del 2024-09-12T17:36:47.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.154+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=HQ8DPFJW8NTP type=del size=2654335 2024-09-12T17:36:47.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.155+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~QDEHT7FE0PYF.0 size=1012255 2024-09-12T17:36:47.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.157+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=QDEHT7FE0PYF tag=9GP9UI73QI89 type=write size=2060831 2024-09-12T17:36:47.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.159+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=IQ29W6AEA6BL type=del size=373649 2024-09-12T17:36:47.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.160+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=K2HSJLK55MWN type=del 2024-09-12T17:36:47.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.162+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=HLY7ZEX36PG1 type=del size=3178477 2024-09-12T17:36:47.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.163+0000 7fa80ca76780 -1 < failed to complete operation key=8Z3EPQHMA6M5 tag=HYQZASIS55GH type=del size=2805682: (22) Invalid argument 2024-09-12T17:36:47.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.164+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=N0318BHGC04B type=del size=2896269 2024-09-12T17:36:47.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.166+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=UIFYJ5866XP2 type=del 2024-09-12T17:36:47.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.168+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~2RBGM8W1EJ10.0 size=1048576 2024-09-12T17:36:47.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.169+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~2RBGM8W1EJ10.1 size=1048576 2024-09-12T17:36:47.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.170+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~2RBGM8W1EJ10.2 size=287576 2024-09-12T17:36:47.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.170+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=2RBGM8W1EJ10 tag=DW7ODEPZC8YN type=write size=3433304 2024-09-12T17:36:47.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.171+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=NUVR0IGYYP1O type=del 2024-09-12T17:36:47.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.174+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~6JH1TM1035E1.0 size=242175 2024-09-12T17:36:47.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.174+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=6JH1TM1035E1 tag=QJCUDVZQTAFP type=write size=1290751 2024-09-12T17:36:47.176 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.175+0000 7fa80ca76780 1 < canceled operation key=VC1X03K12V80 tag=YBUPV76P6AD5 type=write size=288902 2024-09-12T17:36:47.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.176+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=2WG7MAZA9NIS type=write size=502107 2024-09-12T17:36:47.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.178+0000 7fa80ca76780 1 < canceled operation key=R871XU2TDWID tag=C9ZG70LO3R3R type=del size=923503 2024-09-12T17:36:47.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.179+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=2LNWUVGVU2FU type=write size=796107 2024-09-12T17:36:47.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.180+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~HD0P7D0CDA0P.0 size=956088 2024-09-12T17:36:47.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.182+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=HD0P7D0CDA0P tag=3X20JRAJ1Y4M type=write size=2004664 2024-09-12T17:36:47.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.184+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~UNASUSKTZAV2.0 size=671133 2024-09-12T17:36:47.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.184+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=UNASUSKTZAV2 tag=II8L4JWP8E3M type=write size=1719709 2024-09-12T17:36:47.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.186+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=3RD2EGDZ57Y2 type=write size=365284 2024-09-12T17:36:47.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.188+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~ZNVTLDJ9XB8F.0 size=1048576 2024-09-12T17:36:47.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.189+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~ZNVTLDJ9XB8F.1 size=765911 2024-09-12T17:36:47.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.189+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=ZNVTLDJ9XB8F tag=1IF2X4O16L61 type=write size=2863063 2024-09-12T17:36:47.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.190+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~FE2OE6V0L0W1.0 size=1048576 2024-09-12T17:36:47.192 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.191+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~FE2OE6V0L0W1.1 size=1048576 2024-09-12T17:36:47.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.192+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~FE2OE6V0L0W1.2 size=928329 2024-09-12T17:36:47.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.194+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=FE2OE6V0L0W1 tag=4NG4RKMIFPPY type=write size=4074057 2024-09-12T17:36:47.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.196+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=WUBUPAZMK9F6 type=del size=1860430 2024-09-12T17:36:47.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.197+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~3INRPIRHFV0O.0 size=372744 2024-09-12T17:36:47.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.199+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=3INRPIRHFV0O tag=YAFHIGG1I193 type=write size=1421320 2024-09-12T17:36:47.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.201+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~SON07JWPW2JW.0 size=1048576 2024-09-12T17:36:47.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.202+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~SON07JWPW2JW.1 size=1048576 2024-09-12T17:36:47.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.204+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~SON07JWPW2JW.2 size=843838 2024-09-12T17:36:47.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.204+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=SON07JWPW2JW tag=MRSHNKY9WESR type=write size=3989566 2024-09-12T17:36:47.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.205+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~923IXGRX9A2J.0 size=1048576 2024-09-12T17:36:47.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.206+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~923IXGRX9A2J.1 size=171057 2024-09-12T17:36:47.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.208+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=923IXGRX9A2J tag=6M6PE3X4H5Z3 type=write size=2268209 2024-09-12T17:36:47.210 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.209+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=SY0BIF0LE0HI type=write size=332312 2024-09-12T17:36:47.210 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.209+0000 7fa80ca76780 1 < canceled part key=_multipart_MSZUYX441Y66.2~56IO66GK8GIF.0 size=1048576 2024-09-12T17:36:47.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.210+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~56IO66GK8GIF.1 size=737543 2024-09-12T17:36:47.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.212+0000 7fa80ca76780 1 < canceled multipart upload key=MSZUYX441Y66 upload=56IO66GK8GIF tag=792GRXP6BH8P type=write size=2834695 2024-09-12T17:36:47.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.213+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=G2D6UTQ7IBBG type=del size=1587172 2024-09-12T17:36:47.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.215+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~HY7TW3KETAH9.0 size=1048576 2024-09-12T17:36:47.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.216+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~HY7TW3KETAH9.1 size=1048576 2024-09-12T17:36:47.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.217+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~HY7TW3KETAH9.2 size=795415 2024-09-12T17:36:47.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.219+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=HY7TW3KETAH9 tag=V8JDCX0SV4LF type=write size=3941143 2024-09-12T17:36:47.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.221+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=OZH7JHX46TUO type=write size=96814 2024-09-12T17:36:47.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.222+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~JELOWAQ0Q5WJ.0 size=871146 2024-09-12T17:36:47.225 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.224+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=JELOWAQ0Q5WJ tag=JKKXDBF08P8T type=write size=1919722 2024-09-12T17:36:47.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.226+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~W1Q8RPHKHZHD.0 size=223829 2024-09-12T17:36:47.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.226+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=W1Q8RPHKHZHD tag=2ZWYDDS0E63W type=write size=1272405 2024-09-12T17:36:47.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.227+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=HQ8DPFJW8NTP type=del 2024-09-12T17:36:47.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.229+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~TGYJXYBBVOBG.0 size=1048576 2024-09-12T17:36:47.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.230+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~TGYJXYBBVOBG.1 size=1048576 2024-09-12T17:36:47.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.231+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~TGYJXYBBVOBG.2 size=286192 2024-09-12T17:36:47.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.231+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=TGYJXYBBVOBG tag=WU00W7PHQ2BV type=write size=3431920 2024-09-12T17:36:47.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.233+0000 7fa80ca76780 1 < suggested update operation key=7QHTQ6VHZ34P tag=IQ29W6AEA6BL type=del size=373649 2024-09-12T17:36:47.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.234+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=1LYBLIP9HLXF type=write size=824584 2024-09-12T17:36:47.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.235+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=HLY7ZEX36PG1 type=del 2024-09-12T17:36:47.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.237+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=404SD0DEWJXV type=del size=3891576 2024-09-12T17:36:47.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.238+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=N0318BHGC04B type=del 2024-09-12T17:36:47.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.242+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~RO8APE2D3145.0 size=1048576 2024-09-12T17:36:47.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.243+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~RO8APE2D3145.1 size=348046 2024-09-12T17:36:47.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.243+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=RO8APE2D3145 tag=CNTOSA436DFG type=write size=2445198 2024-09-12T17:36:47.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.243+0000 7fa80ca76780 1 < canceled part key=_multipart_2AGKLZ3PQ2FD.2~2RBGM8W1EJ10.0 size=1048576 2024-09-12T17:36:47.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.244+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~2RBGM8W1EJ10.1 size=1048576 2024-09-12T17:36:47.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.245+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~2RBGM8W1EJ10.2 size=287576 2024-09-12T17:36:47.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.247+0000 7fa80ca76780 1 < canceled multipart upload key=2AGKLZ3PQ2FD upload=2RBGM8W1EJ10 tag=DW7ODEPZC8YN type=write size=3433304 2024-09-12T17:36:47.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.249+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~HSBOONE4FO7N.0 size=560214 2024-09-12T17:36:47.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.249+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=HSBOONE4FO7N tag=RYRFZC8LC0ZA type=write size=1608790 2024-09-12T17:36:47.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.251+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~6JH1TM1035E1.0 size=242175 2024-09-12T17:36:47.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.253+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=6JH1TM1035E1 tag=QJCUDVZQTAFP type=write size=1290751 2024-09-12T17:36:47.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.254+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=POF3P9BGTGIL type=del size=361175 2024-09-12T17:36:47.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.255+0000 7fa80ca76780 1 < completed write operation key=DYZIHCBF3D8U tag=2WG7MAZA9NIS type=write size=502107 2024-09-12T17:36:47.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.256+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=LODOCI2XTT0A type=del size=1593339 2024-09-12T17:36:47.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.258+0000 7fa80ca76780 1 < suggested update operation key=VC1X03K12V80 tag=2LNWUVGVU2FU type=write size=796107 2024-09-12T17:36:47.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.262+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~9ZH1SWM0P69S.0 size=1048576 2024-09-12T17:36:47.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.263+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~9ZH1SWM0P69S.1 size=1048576 2024-09-12T17:36:47.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.264+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~9ZH1SWM0P69S.2 size=612346 2024-09-12T17:36:47.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.264+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=9ZH1SWM0P69S tag=04O431NMJQ84 type=write size=3758074 2024-09-12T17:36:47.266 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.265+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~UNASUSKTZAV2.0 size=671133 2024-09-12T17:36:47.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.267+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=UNASUSKTZAV2 tag=II8L4JWP8E3M type=write size=1719709 2024-09-12T17:36:47.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.269+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~0DZB0S0C86IQ.0 size=1048576 2024-09-12T17:36:47.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.270+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~0DZB0S0C86IQ.1 size=666372 2024-09-12T17:36:47.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.270+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=0DZB0S0C86IQ tag=BDUB58GRM12N type=write size=2763524 2024-09-12T17:36:47.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.270+0000 7fa80ca76780 1 < canceled part key=_multipart_VC1X03K12V80.2~ZNVTLDJ9XB8F.0 size=1048576 2024-09-12T17:36:47.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.271+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~ZNVTLDJ9XB8F.1 size=765911 2024-09-12T17:36:47.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.273+0000 7fa80ca76780 1 < canceled multipart upload key=VC1X03K12V80 upload=ZNVTLDJ9XB8F tag=1IF2X4O16L61 type=write size=2863063 2024-09-12T17:36:47.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.275+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~QNPXWO9FJRVC.0 size=133897 2024-09-12T17:36:47.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.275+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=QNPXWO9FJRVC tag=PZWHHO51CKVI type=write size=1182473 2024-09-12T17:36:47.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.276+0000 7fa80ca76780 1 < canceled operation key=R02234GEWV6B tag=WUBUPAZMK9F6 type=del size=1860430 2024-09-12T17:36:47.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.277+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=2Z9JAGMY1PSK type=del size=2420041 2024-09-12T17:36:47.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.279+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~SON07JWPW2JW.0 size=1048576 2024-09-12T17:36:47.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.280+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~SON07JWPW2JW.1 size=1048576 2024-09-12T17:36:47.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.281+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~SON07JWPW2JW.2 size=843838 2024-09-12T17:36:47.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.282+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=SON07JWPW2JW tag=MRSHNKY9WESR type=write size=3989566 2024-09-12T17:36:47.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.284+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=04YWJS9PCCPX type=del size=2225254 2024-09-12T17:36:47.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.285+0000 7fa80ca76780 1 < completed write operation key=8Z3EPQHMA6M5 tag=SY0BIF0LE0HI type=write size=332312 2024-09-12T17:36:47.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.286+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=MB089C7209FO type=del size=47539 2024-09-12T17:36:47.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.288+0000 7fa80ca76780 1 < suggested update operation key=RC1IX4DQREEP tag=G2D6UTQ7IBBG type=del size=1587172 2024-09-12T17:36:47.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.289+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=7ED58VBZTO6K type=del size=339211 2024-09-12T17:36:47.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.291+0000 7fa80ca76780 1 < completed write operation key=94801LE91HZ9 tag=OZH7JHX46TUO type=write size=96814 2024-09-12T17:36:47.294 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.293+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~E5GEL6DRV9EP.0 size=1048576 2024-09-12T17:36:47.295 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.294+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~E5GEL6DRV9EP.1 size=549159 2024-09-12T17:36:47.295 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.294+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=E5GEL6DRV9EP tag=Q1W41YJSZOHJ type=write size=2646311 2024-09-12T17:36:47.296 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.295+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~W1Q8RPHKHZHD.0 size=223829 2024-09-12T17:36:47.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.297+0000 7fa80ca76780 1 < completed multipart upload key=U8O04HYQZRJC upload=W1Q8RPHKHZHD tag=2ZWYDDS0E63W type=write size=1272405 2024-09-12T17:36:47.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.298+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=1YAI3MWX0Q60 type=del size=715285 2024-09-12T17:36:47.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.299+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~TGYJXYBBVOBG.0 size=1048576 2024-09-12T17:36:47.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.299+0000 7fa80ca76780 1 < canceled part key=_multipart_AKE8O7Q277HX.2~TGYJXYBBVOBG.1 size=1048576 2024-09-12T17:36:47.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.300+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~TGYJXYBBVOBG.2 size=286192 2024-09-12T17:36:47.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.302+0000 7fa80ca76780 1 < canceled multipart upload key=AKE8O7Q277HX upload=TGYJXYBBVOBG tag=WU00W7PHQ2BV type=write size=3431920 2024-09-12T17:36:47.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.303+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=DLBLMO4ODRTN type=del size=785895 2024-09-12T17:36:47.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.304+0000 7fa80ca76780 1 < canceled operation key=0J6RTRJWZP1T tag=1LYBLIP9HLXF type=write size=824584 2024-09-12T17:36:47.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.307+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~5K06HMIR7D9P.0 size=1048576 2024-09-12T17:36:47.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.308+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~5K06HMIR7D9P.1 size=231511 2024-09-12T17:36:47.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.308+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=5K06HMIR7D9P tag=L69AS1RGXQVL type=write size=2328663 2024-09-12T17:36:47.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.309+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=404SD0DEWJXV type=del 2024-09-12T17:36:47.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.311+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~LH17FVOIVJ3G.0 size=329974 2024-09-12T17:36:47.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.311+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=LH17FVOIVJ3G tag=29E3JXD160H4 type=write size=1378550 2024-09-12T17:36:47.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.313+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~RO8APE2D3145.0 size=1048576 2024-09-12T17:36:47.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.314+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~RO8APE2D3145.1 size=348046 2024-09-12T17:36:47.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.316+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=RO8APE2D3145 tag=CNTOSA436DFG type=write size=2445198 2024-09-12T17:36:47.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.317+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=9VIZUXOGBMCD type=write size=383497 2024-09-12T17:36:47.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.318+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~HSBOONE4FO7N.0 size=560214 2024-09-12T17:36:47.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.322+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=HSBOONE4FO7N tag=RYRFZC8LC0ZA type=write size=1608790 2024-09-12T17:36:47.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.324+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~DY5YVW8K43DP.0 size=1048576 2024-09-12T17:36:47.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.325+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~DY5YVW8K43DP.1 size=1048576 2024-09-12T17:36:47.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.326+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~DY5YVW8K43DP.2 size=216281 2024-09-12T17:36:47.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.326+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=DY5YVW8K43DP tag=F4DP6MSEZXU5 type=write size=3362009 2024-09-12T17:36:47.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.327+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=POF3P9BGTGIL type=del 2024-09-12T17:36:47.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.330+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=CLWOOPDOTGZS type=write size=77182 2024-09-12T17:36:47.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.331+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=LODOCI2XTT0A type=del 2024-09-12T17:36:47.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.333+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~6925ROI0K9D5.0 size=1048576 2024-09-12T17:36:47.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.334+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~6925ROI0K9D5.1 size=1048576 2024-09-12T17:36:47.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.335+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~6925ROI0K9D5.2 size=611891 2024-09-12T17:36:47.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.335+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=6925ROI0K9D5 tag=GOHAKCX45OLX type=write size=3757619 2024-09-12T17:36:47.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.336+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~9ZH1SWM0P69S.0 size=1048576 2024-09-12T17:36:47.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.337+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~9ZH1SWM0P69S.1 size=1048576 2024-09-12T17:36:47.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.338+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~9ZH1SWM0P69S.2 size=612346 2024-09-12T17:36:47.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.339+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=9ZH1SWM0P69S tag=04O431NMJQ84 type=write size=3758074 2024-09-12T17:36:47.342 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.341+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=CI7B2NF5GG2E type=del size=4047136 2024-09-12T17:36:47.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.342+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~0DZB0S0C86IQ.0 size=1048576 2024-09-12T17:36:47.344 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.343+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~0DZB0S0C86IQ.1 size=666372 2024-09-12T17:36:47.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.344+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=0DZB0S0C86IQ tag=BDUB58GRM12N type=write size=2763524 2024-09-12T17:36:47.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.346+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=W2331FV6YQHE type=del size=3959994 2024-09-12T17:36:47.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.347+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~QNPXWO9FJRVC.0 size=133897 2024-09-12T17:36:47.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.349+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=QNPXWO9FJRVC tag=PZWHHO51CKVI type=write size=1182473 2024-09-12T17:36:47.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.351+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~H8FPCWT0U1XZ.0 size=1048576 2024-09-12T17:36:47.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.352+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~H8FPCWT0U1XZ.1 size=1048576 2024-09-12T17:36:47.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.353+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~H8FPCWT0U1XZ.2 size=848601 2024-09-12T17:36:47.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.353+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=H8FPCWT0U1XZ tag=R9RNUORI15EJ type=write size=3994329 2024-09-12T17:36:47.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.355+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=2Z9JAGMY1PSK type=del 2024-09-12T17:36:47.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.356+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=T3DQOWNCXR1A type=write size=1028010 2024-09-12T17:36:47.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.358+0000 7fa80ca76780 1 < suggested remove operation key=07LPSZT2RKCC tag=04YWJS9PCCPX type=del 2024-09-12T17:36:47.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.359+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=Q1V6UJMVK75K type=del size=781703 2024-09-12T17:36:47.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.362+0000 7fa80ca76780 1 < suggested remove operation key=R02234GEWV6B tag=MB089C7209FO type=del 2024-09-12T17:36:47.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.363+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=D1XKXNGW2622 type=del size=986909 2024-09-12T17:36:47.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.364+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=7ED58VBZTO6K type=del 2024-09-12T17:36:47.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.365+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=IVZR0EWUOYOD type=del size=2592177 2024-09-12T17:36:47.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.366+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~E5GEL6DRV9EP.0 size=1048576 2024-09-12T17:36:47.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.367+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~E5GEL6DRV9EP.1 size=549159 2024-09-12T17:36:47.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.370+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=E5GEL6DRV9EP tag=Q1W41YJSZOHJ type=write size=2646311 2024-09-12T17:36:47.372 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.371+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=A125FV9EPVVA type=write size=926343 2024-09-12T17:36:47.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.373+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=1YAI3MWX0Q60 type=del 2024-09-12T17:36:47.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.374+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=ZOH2M3TK1N7O type=del size=31858 2024-09-12T17:36:47.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.375+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=DLBLMO4ODRTN type=del 2024-09-12T17:36:47.377 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.376+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=8YGDN5PFRUQG type=del size=2502546 2024-09-12T17:36:47.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.378+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~5K06HMIR7D9P.0 size=1048576 2024-09-12T17:36:47.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.378+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~5K06HMIR7D9P.1 size=231511 2024-09-12T17:36:47.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.380+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=5K06HMIR7D9P tag=L69AS1RGXQVL type=write size=2328663 2024-09-12T17:36:47.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.382+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=PFJ0CRUJDBKI type=del size=1841747 2024-09-12T17:36:47.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.383+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~LH17FVOIVJ3G.0 size=329974 2024-09-12T17:36:47.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.385+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=LH17FVOIVJ3G tag=29E3JXD160H4 type=write size=1378550 2024-09-12T17:36:47.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.386+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=ZF10ADIXHJ3Z type=write size=394066 2024-09-12T17:36:47.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.387+0000 7fa80ca76780 1 < completed write operation key=BLGMV3S9AY24 tag=9VIZUXOGBMCD type=write size=383497 2024-09-12T17:36:47.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.388+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=40CBTI89KW9C type=del size=2926063 2024-09-12T17:36:47.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.390+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~DY5YVW8K43DP.0 size=1048576 2024-09-12T17:36:47.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.390+0000 7fa80ca76780 1 < canceled part key=_multipart_5CAG55DQEF3Y.2~DY5YVW8K43DP.1 size=1048576 2024-09-12T17:36:47.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.390+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~DY5YVW8K43DP.2 size=216281 2024-09-12T17:36:47.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.392+0000 7fa80ca76780 1 < canceled multipart upload key=5CAG55DQEF3Y upload=DY5YVW8K43DP tag=F4DP6MSEZXU5 type=write size=3362009 2024-09-12T17:36:47.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.394+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=ITILBSD1X7HV type=del size=3622532 2024-09-12T17:36:47.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.395+0000 7fa80ca76780 1 < completed write operation key=MSZUYX441Y66 tag=CLWOOPDOTGZS type=write size=77182 2024-09-12T17:36:47.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.396+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=L0PURC3L077D type=del size=2887241 2024-09-12T17:36:47.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.397+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~6925ROI0K9D5.0 size=1048576 2024-09-12T17:36:47.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.398+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~6925ROI0K9D5.1 size=1048576 2024-09-12T17:36:47.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.399+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~6925ROI0K9D5.2 size=611891 2024-09-12T17:36:47.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.401+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=6925ROI0K9D5 tag=GOHAKCX45OLX type=write size=3757619 2024-09-12T17:36:47.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.402+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=A2RQR27I7XU1 type=del size=1499023 2024-09-12T17:36:47.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.403+0000 7fa80ca76780 1 < canceled operation key=GKE6623N268Z tag=CI7B2NF5GG2E type=del size=4047136 2024-09-12T17:36:47.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.406+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~2Y40N10MI2EK.0 size=413964 2024-09-12T17:36:47.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.406+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=2Y40N10MI2EK tag=KSY4ZZ8PVN2Z type=write size=1462540 2024-09-12T17:36:47.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.407+0000 7fa80ca76780 1 < canceled operation key=2AGKLZ3PQ2FD tag=W2331FV6YQHE type=del size=3959994 2024-09-12T17:36:47.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.409+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~ZITD6BKEGNDF.0 size=558793 2024-09-12T17:36:47.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.409+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=ZITD6BKEGNDF tag=LVFW221SVJMO type=write size=1607369 2024-09-12T17:36:47.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.410+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~H8FPCWT0U1XZ.0 size=1048576 2024-09-12T17:36:47.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.411+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~H8FPCWT0U1XZ.1 size=1048576 2024-09-12T17:36:47.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.412+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~H8FPCWT0U1XZ.2 size=848601 2024-09-12T17:36:47.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.414+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=H8FPCWT0U1XZ tag=R9RNUORI15EJ type=write size=3994329 2024-09-12T17:36:47.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.416+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=25JXSVBZHDZH type=del size=2652492 2024-09-12T17:36:47.418 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.417+0000 7fa80ca76780 1 < canceled operation key=GKE6623N268Z tag=T3DQOWNCXR1A type=write size=1028010 2024-09-12T17:36:47.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.420+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~13M909GOEUK6.0 size=1048576 2024-09-12T17:36:47.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.421+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~13M909GOEUK6.1 size=1045513 2024-09-12T17:36:47.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.421+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=13M909GOEUK6 tag=MQ4UMAD3J2Z6 type=write size=3142665 2024-09-12T17:36:47.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.422+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=Q1V6UJMVK75K type=del 2024-09-12T17:36:47.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.423+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=6CDL68CKJS28 type=write size=522439 2024-09-12T17:36:47.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.425+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=D1XKXNGW2622 type=del 2024-09-12T17:36:47.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.426+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=4YBN0WB058A6 type=del size=2144258 2024-09-12T17:36:47.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.427+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=IVZR0EWUOYOD type=del 2024-09-12T17:36:47.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.430+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~5E73JVBK3T5R.0 size=1048576 2024-09-12T17:36:47.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.431+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~5E73JVBK3T5R.1 size=531806 2024-09-12T17:36:47.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.431+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=5E73JVBK3T5R tag=I81HEKI50BOC type=write size=2628958 2024-09-12T17:36:47.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.432+0000 7fa80ca76780 1 < completed write operation key=AKE8O7Q277HX tag=A125FV9EPVVA type=write size=926343 2024-09-12T17:36:47.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.434+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~ZC48Q4HTUZLW.0 size=1048576 2024-09-12T17:36:47.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.435+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~ZC48Q4HTUZLW.1 size=742606 2024-09-12T17:36:47.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.435+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=ZC48Q4HTUZLW tag=9TGI53FTF2MC type=write size=2839758 2024-09-12T17:36:47.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.437+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=ZOH2M3TK1N7O type=del 2024-09-12T17:36:47.439 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.438+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=VLXCQEQTHGPA type=del size=3482306 2024-09-12T17:36:47.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.440+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=8YGDN5PFRUQG type=del 2024-09-12T17:36:47.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.441+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=BY5XCZH70ZXD type=write size=799883 2024-09-12T17:36:47.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.442+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=PFJ0CRUJDBKI type=del 2024-09-12T17:36:47.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.445+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~MZZVENT1PSY6.0 size=1048576 2024-09-12T17:36:47.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.448+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~MZZVENT1PSY6.1 size=860446 2024-09-12T17:36:47.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.448+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=MZZVENT1PSY6 tag=0MNQ22DBE0YN type=write size=2957598 2024-09-12T17:36:47.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.450+0000 7fa80ca76780 1 < suggested remove operation key=WGL9JYJXSHBH tag=ZF10ADIXHJ3Z type=write 2024-09-12T17:36:47.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.452+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=X4L31KOGCYQG type=del size=163659 2024-09-12T17:36:47.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.453+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=40CBTI89KW9C type=del 2024-09-12T17:36:47.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.455+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~EHJEJE0D7O6U.0 size=1048576 2024-09-12T17:36:47.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.456+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~EHJEJE0D7O6U.1 size=990731 2024-09-12T17:36:47.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.456+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=EHJEJE0D7O6U tag=NM472ZZMD5DL type=write size=3087883 2024-09-12T17:36:47.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.458+0000 7fa80ca76780 1 < suggested remove operation key=94801LE91HZ9 tag=ITILBSD1X7HV type=del 2024-09-12T17:36:47.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.460+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=7SY1PQJG92RU type=del size=642912 2024-09-12T17:36:47.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.462+0000 7fa80ca76780 1 < suggested update operation key=E25BUY271ZSI tag=L0PURC3L077D type=del size=2887241 2024-09-12T17:36:47.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.463+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=D4TABEWAD1GI type=write size=845587 2024-09-12T17:36:47.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.465+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=A2RQR27I7XU1 type=del 2024-09-12T17:36:47.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.467+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~FTPVE171XEJZ.0 size=58639 2024-09-12T17:36:47.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.467+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=FTPVE171XEJZ tag=TF2OEILJ34RZ type=write size=1107215 2024-09-12T17:36:47.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.467+0000 7fa80ca76780 1 < canceled part key=_multipart_AKE8O7Q277HX.2~2Y40N10MI2EK.0 size=413964 2024-09-12T17:36:47.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.469+0000 7fa80ca76780 1 < canceled multipart upload key=AKE8O7Q277HX upload=2Y40N10MI2EK tag=KSY4ZZ8PVN2Z type=write size=1462540 2024-09-12T17:36:47.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.471+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~1AIZ9KEWWYSO.0 size=663209 2024-09-12T17:36:47.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.471+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=1AIZ9KEWWYSO tag=2LS0SMXA3K9G type=write size=1711785 2024-09-12T17:36:47.473 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.472+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~ZITD6BKEGNDF.0 size=558793 2024-09-12T17:36:47.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.474+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=ZITD6BKEGNDF tag=LVFW221SVJMO type=write size=1607369 2024-09-12T17:36:47.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.475+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=1Z1Q64DGP3AT type=del size=3112212 2024-09-12T17:36:47.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.477+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=25JXSVBZHDZH type=del 2024-09-12T17:36:47.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.478+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=SZQSWN6GOSWZ type=del size=3185450 2024-09-12T17:36:47.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.479+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~13M909GOEUK6.0 size=1048576 2024-09-12T17:36:47.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.480+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~13M909GOEUK6.1 size=1045513 2024-09-12T17:36:47.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.482+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=13M909GOEUK6 tag=MQ4UMAD3J2Z6 type=write size=3142665 2024-09-12T17:36:47.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.484+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~JDT8X85LL2V0.0 size=1048576 2024-09-12T17:36:47.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.485+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~JDT8X85LL2V0.1 size=365257 2024-09-12T17:36:47.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.485+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=JDT8X85LL2V0 tag=RYZROA05TDIY type=write size=2462409 2024-09-12T17:36:47.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.486+0000 7fa80ca76780 -1 < failed to complete operation key=WGL9JYJXSHBH tag=6CDL68CKJS28 type=write size=522439: (22) Invalid argument 2024-09-12T17:36:47.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.488+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~BOIHBUG1X6FQ.0 size=614445 2024-09-12T17:36:47.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.488+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=BOIHBUG1X6FQ tag=ABT3NXHLGBWM type=write size=1663021 2024-09-12T17:36:47.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.489+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=4YBN0WB058A6 type=del 2024-09-12T17:36:47.492 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.491+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=I1QBZG9LBRX5 type=del size=381413 2024-09-12T17:36:47.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.492+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~5E73JVBK3T5R.0 size=1048576 2024-09-12T17:36:47.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.493+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~5E73JVBK3T5R.1 size=531806 2024-09-12T17:36:47.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.494+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=5E73JVBK3T5R tag=I81HEKI50BOC type=write size=2628958 2024-09-12T17:36:47.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.497+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~QQI72O6LVFRJ.0 size=1048576 2024-09-12T17:36:47.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.498+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~QQI72O6LVFRJ.1 size=1048576 2024-09-12T17:36:47.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.499+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~QQI72O6LVFRJ.2 size=304079 2024-09-12T17:36:47.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.499+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=QQI72O6LVFRJ tag=TJ9ONV8MT7IR type=write size=3449807 2024-09-12T17:36:47.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.500+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~ZC48Q4HTUZLW.0 size=1048576 2024-09-12T17:36:47.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.501+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~ZC48Q4HTUZLW.1 size=742606 2024-09-12T17:36:47.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.503+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=ZC48Q4HTUZLW tag=9TGI53FTF2MC type=write size=2839758 2024-09-12T17:36:47.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.505+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~O49S6GNYPLVR.0 size=446523 2024-09-12T17:36:47.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.505+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=O49S6GNYPLVR tag=I4IK6QAAPJYR type=write size=1495099 2024-09-12T17:36:47.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.506+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=VLXCQEQTHGPA type=del 2024-09-12T17:36:47.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.508+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~FXQAFBUJQ1GX.0 size=1048576 2024-09-12T17:36:47.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.509+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~FXQAFBUJQ1GX.1 size=203278 2024-09-12T17:36:47.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.509+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=FXQAFBUJQ1GX tag=N1IOGLORWS4W type=write size=2300430 2024-09-12T17:36:47.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.510+0000 7fa80ca76780 1 < canceled operation key=RC1IX4DQREEP tag=BY5XCZH70ZXD type=write size=799883 2024-09-12T17:36:47.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.511+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=EVNFZ4HPDV6N type=write size=985823 2024-09-12T17:36:47.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.513+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~MZZVENT1PSY6.0 size=1048576 2024-09-12T17:36:47.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.513+0000 7fa80ca76780 1 < canceled part key=_multipart_WGL9JYJXSHBH.2~MZZVENT1PSY6.1 size=860446 2024-09-12T17:36:47.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.514+0000 7fa80ca76780 1 < canceled multipart upload key=WGL9JYJXSHBH upload=MZZVENT1PSY6 tag=0MNQ22DBE0YN type=write size=2957598 2024-09-12T17:36:47.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.516+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=OLJZKSH4VB4W type=del size=2450347 2024-09-12T17:36:47.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.517+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=X4L31KOGCYQG type=del 2024-09-12T17:36:47.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.518+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=I7J1OSQ0YKXK type=del size=1350747 2024-09-12T17:36:47.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.518+0000 7fa80ca76780 1 < canceled part key=_multipart_U8O04HYQZRJC.2~EHJEJE0D7O6U.0 size=1048576 2024-09-12T17:36:47.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.519+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~EHJEJE0D7O6U.1 size=990731 2024-09-12T17:36:47.522 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.521+0000 7fa80ca76780 1 < canceled multipart upload key=U8O04HYQZRJC upload=EHJEJE0D7O6U tag=NM472ZZMD5DL type=write size=3087883 2024-09-12T17:36:47.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.524+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~L2799VI4P15C.0 size=1048576 2024-09-12T17:36:47.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.525+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~L2799VI4P15C.1 size=188779 2024-09-12T17:36:47.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.525+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=L2799VI4P15C tag=AU9ZPSXSS3VN type=write size=2285931 2024-09-12T17:36:47.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.526+0000 7fa80ca76780 1 < canceled operation key=8Z3EPQHMA6M5 tag=7SY1PQJG92RU type=del size=642912 2024-09-12T17:36:47.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.527+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=4I5V7RS9QPEY type=del size=1014030 2024-09-12T17:36:47.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.528+0000 7fa80ca76780 1 < completed write operation key=RC1IX4DQREEP tag=D4TABEWAD1GI type=write size=845587 2024-09-12T17:36:47.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.530+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~RKUXL579YMAA.0 size=1048576 2024-09-12T17:36:47.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.531+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~RKUXL579YMAA.1 size=205737 2024-09-12T17:36:47.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.531+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=RKUXL579YMAA tag=B123N6LI53ID type=write size=2302889 2024-09-12T17:36:47.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.532+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~FTPVE171XEJZ.0 size=58639 2024-09-12T17:36:47.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.534+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=FTPVE171XEJZ tag=TF2OEILJ34RZ type=write size=1107215 2024-09-12T17:36:47.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.536+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~ENXG54F2LCL2.0 size=1048576 2024-09-12T17:36:47.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.537+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~ENXG54F2LCL2.1 size=1048576 2024-09-12T17:36:47.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.538+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~ENXG54F2LCL2.2 size=698689 2024-09-12T17:36:47.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.538+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=ENXG54F2LCL2 tag=A4F297HT3ITE type=write size=3844417 2024-09-12T17:36:47.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.540+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~1AIZ9KEWWYSO.0 size=663209 2024-09-12T17:36:47.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.541+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=1AIZ9KEWWYSO tag=2LS0SMXA3K9G type=write size=1711785 2024-09-12T17:36:47.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.543+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~OCFJZ5NFKBDP.0 size=1048576 2024-09-12T17:36:47.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.544+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~OCFJZ5NFKBDP.1 size=312976 2024-09-12T17:36:47.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.544+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=OCFJZ5NFKBDP tag=3XOHHJMED2G6 type=write size=2410128 2024-09-12T17:36:47.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.546+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=1Z1Q64DGP3AT type=del 2024-09-12T17:36:47.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.548+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~DNL0X0AE1XTH.0 size=1048576 2024-09-12T17:36:47.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.549+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~DNL0X0AE1XTH.1 size=1048576 2024-09-12T17:36:47.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.550+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~DNL0X0AE1XTH.2 size=450540 2024-09-12T17:36:47.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.550+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=DNL0X0AE1XTH tag=UCQE8JWGDDGZ type=write size=3596268 2024-09-12T17:36:47.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.551+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=SZQSWN6GOSWZ type=del 2024-09-12T17:36:47.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.552+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=QIYXQ26DNZK0 type=write size=934077 2024-09-12T17:36:47.554 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.553+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~JDT8X85LL2V0.0 size=1048576 2024-09-12T17:36:47.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.555+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~JDT8X85LL2V0.1 size=365257 2024-09-12T17:36:47.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.558+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=JDT8X85LL2V0 tag=RYZROA05TDIY type=write size=2462409 2024-09-12T17:36:47.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.560+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=55ZK723A5VHA type=write size=449669 2024-09-12T17:36:47.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.561+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~BOIHBUG1X6FQ.0 size=614445 2024-09-12T17:36:47.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.563+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=BOIHBUG1X6FQ tag=ABT3NXHLGBWM type=write size=1663021 2024-09-12T17:36:47.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.564+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=5KAHO312B8I3 type=write size=218257 2024-09-12T17:36:47.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.565+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=I1QBZG9LBRX5 type=del 2024-09-12T17:36:47.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.566+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=NECD14VD8L5W type=del size=1200715 2024-09-12T17:36:47.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.569+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~QQI72O6LVFRJ.0 size=1048576 2024-09-12T17:36:47.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.570+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~QQI72O6LVFRJ.1 size=1048576 2024-09-12T17:36:47.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.571+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~QQI72O6LVFRJ.2 size=304079 2024-09-12T17:36:47.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.572+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=QQI72O6LVFRJ tag=TJ9ONV8MT7IR type=write size=3449807 2024-09-12T17:36:47.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.574+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~1R614KG6VETF.0 size=1041478 2024-09-12T17:36:47.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.574+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=1R614KG6VETF tag=INUAN78W8YCR type=write size=2090054 2024-09-12T17:36:47.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.575+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~O49S6GNYPLVR.0 size=446523 2024-09-12T17:36:47.578 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.577+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=O49S6GNYPLVR tag=I4IK6QAAPJYR type=write size=1495099 2024-09-12T17:36:47.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.578+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=7O4ZX4NDU0QQ type=write size=437602 2024-09-12T17:36:47.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.578+0000 7fa80ca76780 1 < canceled part key=_multipart_07LPSZT2RKCC.2~FXQAFBUJQ1GX.0 size=1048576 2024-09-12T17:36:47.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.579+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~FXQAFBUJQ1GX.1 size=203278 2024-09-12T17:36:47.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.581+0000 7fa80ca76780 1 < canceled multipart upload key=07LPSZT2RKCC upload=FXQAFBUJQ1GX tag=N1IOGLORWS4W type=write size=2300430 2024-09-12T17:36:47.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.582+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=XLE09DXBHTFR type=del size=2825944 2024-09-12T17:36:47.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.584+0000 7fa80ca76780 1 < completed write operation key=OJPZAWR5BLBN tag=EVNFZ4HPDV6N type=write size=985823 2024-09-12T17:36:47.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.585+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=0ESEEDCP7HMY type=del size=2426205 2024-09-12T17:36:47.587 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.586+0000 7fa80ca76780 1 < canceled operation key=MSZUYX441Y66 tag=OLJZKSH4VB4W type=del size=2450347 2024-09-12T17:36:47.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.588+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=35K8MRH421U0 type=write size=151149 2024-09-12T17:36:47.590 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.589+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=I7J1OSQ0YKXK type=del 2024-09-12T17:36:47.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.592+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~RYPEW4FQDMRO.0 size=274945 2024-09-12T17:36:47.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.592+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=RYPEW4FQDMRO tag=TGMK3D32N19P type=write size=1323521 2024-09-12T17:36:47.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.593+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~L2799VI4P15C.0 size=1048576 2024-09-12T17:36:47.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.594+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~L2799VI4P15C.1 size=188779 2024-09-12T17:36:47.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.596+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=L2799VI4P15C tag=AU9ZPSXSS3VN type=write size=2285931 2024-09-12T17:36:47.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.597+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=I9AL8I2HZ653 type=del size=766193 2024-09-12T17:36:47.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.600+0000 7fa80ca76780 1 < suggested remove operation key=07LPSZT2RKCC tag=4I5V7RS9QPEY type=del 2024-09-12T17:36:47.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.601+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=K50VM1YDV05F type=del size=1474968 2024-09-12T17:36:47.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.602+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~RKUXL579YMAA.0 size=1048576 2024-09-12T17:36:47.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.602+0000 7fa80ca76780 1 < canceled part key=_multipart_H87S6AI6JT6D.2~RKUXL579YMAA.1 size=205737 2024-09-12T17:36:47.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.604+0000 7fa80ca76780 1 < canceled multipart upload key=H87S6AI6JT6D upload=RKUXL579YMAA tag=B123N6LI53ID type=write size=2302889 2024-09-12T17:36:47.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.605+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=1BRJQF9ZS1T0 type=del size=2656393 2024-09-12T17:36:47.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.606+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~ENXG54F2LCL2.0 size=1048576 2024-09-12T17:36:47.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.606+0000 7fa80ca76780 1 < canceled part key=_multipart_RC1IX4DQREEP.2~ENXG54F2LCL2.1 size=1048576 2024-09-12T17:36:47.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.607+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~ENXG54F2LCL2.2 size=698689 2024-09-12T17:36:47.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.609+0000 7fa80ca76780 1 < canceled multipart upload key=RC1IX4DQREEP upload=ENXG54F2LCL2 tag=A4F297HT3ITE type=write size=3844417 2024-09-12T17:36:47.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.610+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=CFO7C3ARJM18 type=del size=420242 2024-09-12T17:36:47.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.611+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~OCFJZ5NFKBDP.0 size=1048576 2024-09-12T17:36:47.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.612+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~OCFJZ5NFKBDP.1 size=312976 2024-09-12T17:36:47.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.615+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=OCFJZ5NFKBDP tag=3XOHHJMED2G6 type=write size=2410128 2024-09-12T17:36:47.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.616+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=3X49WB670AAA type=del size=3517631 2024-09-12T17:36:47.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.617+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~DNL0X0AE1XTH.0 size=1048576 2024-09-12T17:36:47.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.618+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~DNL0X0AE1XTH.1 size=1048576 2024-09-12T17:36:47.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.619+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~DNL0X0AE1XTH.2 size=450540 2024-09-12T17:36:47.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.622+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=DNL0X0AE1XTH tag=UCQE8JWGDDGZ type=write size=3596268 2024-09-12T17:36:47.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.623+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=7JY9I91R5XZP type=del size=1178725 2024-09-12T17:36:47.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.624+0000 7fa80ca76780 -1 < failed to complete operation key=07LPSZT2RKCC tag=QIYXQ26DNZK0 type=write size=934077: (22) Invalid argument 2024-09-12T17:36:47.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.625+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=GAN7BV1T8UZE type=del size=2468949 2024-09-12T17:36:47.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.627+0000 7fa80ca76780 1 < canceled operation key=4S33294MWCO1 tag=55ZK723A5VHA type=write size=449669 2024-09-12T17:36:47.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.628+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=7FZVY6XN3B20 type=del size=2939092 2024-09-12T17:36:47.631 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.630+0000 7fa80ca76780 1 < suggested remove operation key=R871XU2TDWID tag=5KAHO312B8I3 type=write 2024-09-12T17:36:47.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.632+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~W1J5MVMQ3S5J.0 size=241197 2024-09-12T17:36:47.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.632+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=W1J5MVMQ3S5J tag=PHNUY8Z1D5Z2 type=write size=1289773 2024-09-12T17:36:47.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.635+0000 7fa80ca76780 1 < suggested update operation key=5CAG55DQEF3Y tag=NECD14VD8L5W type=del size=1200715 2024-09-12T17:36:47.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.636+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=V37Z95CLWY53 type=write size=730246 2024-09-12T17:36:47.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.637+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~1R614KG6VETF.0 size=1041478 2024-09-12T17:36:47.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.639+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=1R614KG6VETF tag=INUAN78W8YCR type=write size=2090054 2024-09-12T17:36:47.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.641+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~HZ1Z0VVVJHE1.0 size=1048576 2024-09-12T17:36:47.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.642+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~HZ1Z0VVVJHE1.1 size=626206 2024-09-12T17:36:47.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.642+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=HZ1Z0VVVJHE1 tag=XR8F6TMYMEX9 type=write size=2723358 2024-09-12T17:36:47.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.643+0000 7fa80ca76780 1 < completed write operation key=U8O04HYQZRJC tag=7O4ZX4NDU0QQ type=write size=437602 2024-09-12T17:36:47.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.645+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=09DMQ37A9M9H type=del size=1815191 2024-09-12T17:36:47.647 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.646+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=XLE09DXBHTFR type=del 2024-09-12T17:36:47.648 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.647+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=5E0MMASPURP2 type=del size=2685841 2024-09-12T17:36:47.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.649+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=0ESEEDCP7HMY type=del 2024-09-12T17:36:47.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.651+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~1AS85FT1EZIC.0 size=1048576 2024-09-12T17:36:47.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.652+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~1AS85FT1EZIC.1 size=1048576 2024-09-12T17:36:47.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.653+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~1AS85FT1EZIC.2 size=139946 2024-09-12T17:36:47.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.653+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=1AS85FT1EZIC tag=JFEOY23BPQH1 type=write size=3285674 2024-09-12T17:36:47.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.654+0000 7fa80ca76780 1 < completed write operation key=RC1IX4DQREEP tag=35K8MRH421U0 type=write size=151149 2024-09-12T17:36:47.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.656+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~ZDFXZWIF0ZRS.0 size=867819 2024-09-12T17:36:47.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.656+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=ZDFXZWIF0ZRS tag=QK8STZQCHJ3M type=write size=1916395 2024-09-12T17:36:47.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.658+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~RYPEW4FQDMRO.0 size=274945 2024-09-12T17:36:47.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.660+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=RYPEW4FQDMRO tag=TGMK3D32N19P type=write size=1323521 2024-09-12T17:36:47.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.662+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=9IEQL4YS2Z1R type=del size=545319 2024-09-12T17:36:47.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.663+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=I9AL8I2HZ653 type=del 2024-09-12T17:36:47.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.665+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~TM8EPQT2IGEY.0 size=1048576 2024-09-12T17:36:47.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.666+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~TM8EPQT2IGEY.1 size=216015 2024-09-12T17:36:47.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.666+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=TM8EPQT2IGEY tag=VVFCNMWGNZX0 type=write size=2313167 2024-09-12T17:36:47.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.667+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=K50VM1YDV05F type=del 2024-09-12T17:36:47.669 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.668+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=9PNECLUWGQ3V type=del size=1433451 2024-09-12T17:36:47.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.669+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=1BRJQF9ZS1T0 type=del 2024-09-12T17:36:47.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.672+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~B2SLURJJE92D.0 size=1048576 2024-09-12T17:36:47.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.673+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~B2SLURJJE92D.1 size=372832 2024-09-12T17:36:47.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.673+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=B2SLURJJE92D tag=08HNL7OVKMXI type=write size=2469984 2024-09-12T17:36:47.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.675+0000 7fa80ca76780 1 < suggested update operation key=VNGH1DA1HANC tag=CFO7C3ARJM18 type=del size=420242 2024-09-12T17:36:47.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.677+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~M508WLBVGNZQ.0 size=1048576 2024-09-12T17:36:47.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.678+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~M508WLBVGNZQ.1 size=1048576 2024-09-12T17:36:47.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.679+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~M508WLBVGNZQ.2 size=121376 2024-09-12T17:36:47.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.679+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=M508WLBVGNZQ tag=8WFKQXY3Y5MI type=write size=3267104 2024-09-12T17:36:47.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.680+0000 7fa80ca76780 -1 < failed to complete operation key=5CAG55DQEF3Y tag=3X49WB670AAA type=del size=3517631: (22) Invalid argument 2024-09-12T17:36:47.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.681+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=B2BA1KCJ5ARB type=del size=96338 2024-09-12T17:36:47.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.683+0000 7fa80ca76780 1 < suggested remove operation key=WGL9JYJXSHBH tag=7JY9I91R5XZP type=del 2024-09-12T17:36:47.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.686+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~7SW7HQ3Z3E6U.0 size=1048576 2024-09-12T17:36:47.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.686+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~7SW7HQ3Z3E6U.1 size=1048576 2024-09-12T17:36:47.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.687+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~7SW7HQ3Z3E6U.2 size=944607 2024-09-12T17:36:47.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.687+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=7SW7HQ3Z3E6U tag=5W23AMOOOKBM type=write size=4090335 2024-09-12T17:36:47.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.688+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=GAN7BV1T8UZE type=del 2024-09-12T17:36:47.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.690+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=FU52I0RZ5XHK type=del size=2810748 2024-09-12T17:36:47.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.691+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=7FZVY6XN3B20 type=del 2024-09-12T17:36:47.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.692+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=S5EBAZZ6T3C3 type=del size=4177349 2024-09-12T17:36:47.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.693+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~W1J5MVMQ3S5J.0 size=241197 2024-09-12T17:36:47.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.695+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=W1J5MVMQ3S5J tag=PHNUY8Z1D5Z2 type=write size=1289773 2024-09-12T17:36:47.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.696+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=IOI6DY287R1K type=write size=1011320 2024-09-12T17:36:47.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.697+0000 7fa80ca76780 1 < completed write operation key=R02234GEWV6B tag=V37Z95CLWY53 type=write size=730246 2024-09-12T17:36:47.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.699+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~NRWESANKNO2X.0 size=1048576 2024-09-12T17:36:47.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.700+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~NRWESANKNO2X.1 size=316699 2024-09-12T17:36:47.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.700+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=NRWESANKNO2X tag=3DPFK1LYT3XF type=write size=2413851 2024-09-12T17:36:47.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.701+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~HZ1Z0VVVJHE1.0 size=1048576 2024-09-12T17:36:47.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.702+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~HZ1Z0VVVJHE1.1 size=626206 2024-09-12T17:36:47.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.704+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=HZ1Z0VVVJHE1 tag=XR8F6TMYMEX9 type=write size=2723358 2024-09-12T17:36:47.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.706+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~PE6FQT1Z8VY1.0 size=553307 2024-09-12T17:36:47.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.706+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=PE6FQT1Z8VY1 tag=P033DCGX2AZ2 type=write size=1601883 2024-09-12T17:36:47.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.707+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=09DMQ37A9M9H type=del 2024-09-12T17:36:47.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.708+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=IL9Q9AKTWNO9 type=write size=449319 2024-09-12T17:36:47.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.710+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=5E0MMASPURP2 type=del 2024-09-12T17:36:47.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.712+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~JU7EZ06P2MY4.0 size=1048576 2024-09-12T17:36:47.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.713+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~JU7EZ06P2MY4.1 size=395 2024-09-12T17:36:47.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.713+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=JU7EZ06P2MY4 tag=JJM0AK2RD90Y type=write size=2097547 2024-09-12T17:36:47.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.714+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~1AS85FT1EZIC.0 size=1048576 2024-09-12T17:36:47.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.715+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~1AS85FT1EZIC.1 size=1048576 2024-09-12T17:36:47.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.716+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~1AS85FT1EZIC.2 size=139946 2024-09-12T17:36:47.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.718+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=1AS85FT1EZIC tag=JFEOY23BPQH1 type=write size=3285674 2024-09-12T17:36:47.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.719+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~3VBW0Q47MTJY.0 size=701380 2024-09-12T17:36:47.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.719+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=3VBW0Q47MTJY tag=598AGKREMO6E type=write size=1749956 2024-09-12T17:36:47.722 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.721+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~ZDFXZWIF0ZRS.0 size=867819 2024-09-12T17:36:47.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.723+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=ZDFXZWIF0ZRS tag=QK8STZQCHJ3M type=write size=1916395 2024-09-12T17:36:47.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.724+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=LP1Q6QX9XYE3 type=del size=1524038 2024-09-12T17:36:47.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.725+0000 7fa80ca76780 1 < canceled operation key=FKK4IGD1436I tag=9IEQL4YS2Z1R type=del size=545319 2024-09-12T17:36:47.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.726+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=AKX8MA8X19KD type=del size=3182281 2024-09-12T17:36:47.729 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.728+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~TM8EPQT2IGEY.0 size=1048576 2024-09-12T17:36:47.729 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.728+0000 7fa80ca76780 1 < canceled part key=_multipart_94801LE91HZ9.2~TM8EPQT2IGEY.1 size=216015 2024-09-12T17:36:47.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.733+0000 7fa80ca76780 1 < canceled multipart upload key=94801LE91HZ9 upload=TM8EPQT2IGEY tag=VVFCNMWGNZX0 type=write size=2313167 2024-09-12T17:36:47.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.737+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=SRKQ0YHA5THW type=del size=3621868 2024-09-12T17:36:47.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.739+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=9PNECLUWGQ3V type=del 2024-09-12T17:36:47.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.741+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=JWZ57S2KLSKM type=del size=2492759 2024-09-12T17:36:47.743 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.742+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~B2SLURJJE92D.0 size=1048576 2024-09-12T17:36:47.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.743+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~B2SLURJJE92D.1 size=372832 2024-09-12T17:36:47.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.745+0000 7fa80ca76780 1 < completed multipart upload key=07LPSZT2RKCC upload=B2SLURJJE92D tag=08HNL7OVKMXI type=write size=2469984 2024-09-12T17:36:47.747 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.746+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=F5LIWW7EYJCG type=write size=702521 2024-09-12T17:36:47.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.747+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~M508WLBVGNZQ.0 size=1048576 2024-09-12T17:36:47.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.748+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~M508WLBVGNZQ.1 size=1048576 2024-09-12T17:36:47.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.749+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~M508WLBVGNZQ.2 size=121376 2024-09-12T17:36:47.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.752+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=M508WLBVGNZQ tag=8WFKQXY3Y5MI type=write size=3267104 2024-09-12T17:36:47.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.753+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=VRDL5II8HWFM type=write size=637912 2024-09-12T17:36:47.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.755+0000 7fa80ca76780 1 < suggested update operation key=VC1X03K12V80 tag=B2BA1KCJ5ARB type=del size=96338 2024-09-12T17:36:47.758 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.757+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=JP6LY0ZFQPLY type=del size=2185478 2024-09-12T17:36:47.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.758+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~7SW7HQ3Z3E6U.0 size=1048576 2024-09-12T17:36:47.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.759+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~7SW7HQ3Z3E6U.1 size=1048576 2024-09-12T17:36:47.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.759+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~7SW7HQ3Z3E6U.2 size=944607 2024-09-12T17:36:47.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.761+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=7SW7HQ3Z3E6U tag=5W23AMOOOKBM type=write size=4090335 2024-09-12T17:36:47.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.763+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=H8X16H1I03ZT type=del size=23384 2024-09-12T17:36:47.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.764+0000 7fa80ca76780 1 < completed delete operation key=0X3LGXL2QFRN tag=FU52I0RZ5XHK type=del 2024-09-12T17:36:47.767 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.766+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~9K2VDF2SZAZZ.0 size=1048576 2024-09-12T17:36:47.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.767+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~9K2VDF2SZAZZ.1 size=677268 2024-09-12T17:36:47.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.767+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=9K2VDF2SZAZZ tag=Z1K432FSP7B1 type=write size=2774420 2024-09-12T17:36:47.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.768+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=S5EBAZZ6T3C3 type=del 2024-09-12T17:36:47.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.770+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~19URT4WB9EJF.0 size=721436 2024-09-12T17:36:47.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.770+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=19URT4WB9EJF tag=CU92OI0A0CDF type=write size=1770012 2024-09-12T17:36:47.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.771+0000 7fa80ca76780 1 < completed write operation key=LU7PDGWTAK63 tag=IOI6DY287R1K type=write size=1011320 2024-09-12T17:36:47.773 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.772+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=UKDSOLUA8L9M type=del size=1454536 2024-09-12T17:36:47.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.773+0000 7fa80ca76780 1 < canceled part key=_multipart_0J6RTRJWZP1T.2~NRWESANKNO2X.0 size=1048576 2024-09-12T17:36:47.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.773+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~NRWESANKNO2X.1 size=316699 2024-09-12T17:36:47.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.775+0000 7fa80ca76780 1 < canceled multipart upload key=0J6RTRJWZP1T upload=NRWESANKNO2X tag=3DPFK1LYT3XF type=write size=2413851 2024-09-12T17:36:47.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.776+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=6RRPQZGM07U1 type=del size=1151524 2024-09-12T17:36:47.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.778+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~PE6FQT1Z8VY1.0 size=553307 2024-09-12T17:36:47.781 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.779+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=PE6FQT1Z8VY1 tag=P033DCGX2AZ2 type=write size=1601883 2024-09-12T17:36:47.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.781+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~8IGQT6UDGW6I.0 size=698925 2024-09-12T17:36:47.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.781+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=8IGQT6UDGW6I tag=YXCGTNZWHL0D type=write size=1747501 2024-09-12T17:36:47.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.783+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=IL9Q9AKTWNO9 type=write size=449319 2024-09-12T17:36:47.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.784+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=8RJ2ODWIL51G type=del size=2362097 2024-09-12T17:36:47.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.786+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~JU7EZ06P2MY4.0 size=1048576 2024-09-12T17:36:47.788 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.787+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~JU7EZ06P2MY4.1 size=395 2024-09-12T17:36:47.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.789+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=JU7EZ06P2MY4 tag=JJM0AK2RD90Y type=write size=2097547 2024-09-12T17:36:47.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.790+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=MVRA1YQ8EKOW type=del size=274948 2024-09-12T17:36:47.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.791+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~3VBW0Q47MTJY.0 size=701380 2024-09-12T17:36:47.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.793+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=3VBW0Q47MTJY tag=598AGKREMO6E type=write size=1749956 2024-09-12T17:36:47.796 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.795+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~REWAEDP4M9WU.0 size=1048576 2024-09-12T17:36:47.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.796+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~REWAEDP4M9WU.1 size=158630 2024-09-12T17:36:47.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.796+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=REWAEDP4M9WU tag=84F43IQI5V6A type=write size=2255782 2024-09-12T17:36:47.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.797+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=LP1Q6QX9XYE3 type=del 2024-09-12T17:36:47.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.799+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~TUBVGWLI3ZWD.0 size=25824 2024-09-12T17:36:47.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.799+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=TUBVGWLI3ZWD tag=UD402GHHSQSR type=write size=1074400 2024-09-12T17:36:47.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.800+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=AKX8MA8X19KD type=del 2024-09-12T17:36:47.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.802+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~2MIXK0FSR3Q1.0 size=1048576 2024-09-12T17:36:47.804 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.803+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~2MIXK0FSR3Q1.1 size=721193 2024-09-12T17:36:47.804 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.803+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=2MIXK0FSR3Q1 tag=U78NHK4T16J1 type=write size=2818345 2024-09-12T17:36:47.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.804+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=SRKQ0YHA5THW type=del 2024-09-12T17:36:47.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.805+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=XX8CR6LCQF39 type=del size=104058 2024-09-12T17:36:47.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.807+0000 7fa80ca76780 1 < suggested update operation key=H87S6AI6JT6D tag=JWZ57S2KLSKM type=del size=2492759 2024-09-12T17:36:47.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.809+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~ZJNYXTZDSG4A.0 size=654883 2024-09-12T17:36:47.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.809+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=ZJNYXTZDSG4A tag=EFNNMPI852XR type=write size=1703459 2024-09-12T17:36:47.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.811+0000 7fa80ca76780 1 < completed write operation key=GKE6623N268Z tag=F5LIWW7EYJCG type=write size=702521 2024-09-12T17:36:47.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.812+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=6T48Z172RR4L type=write size=483439 2024-09-12T17:36:47.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.813+0000 7fa80ca76780 1 < completed write operation key=MSZUYX441Y66 tag=VRDL5II8HWFM type=write size=637912 2024-09-12T17:36:47.816 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.815+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~YCLKB1G9SA0X.0 size=90971 2024-09-12T17:36:47.816 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.815+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=YCLKB1G9SA0X tag=5QUZWUTPTRAA type=write size=1139547 2024-09-12T17:36:47.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.816+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=JP6LY0ZFQPLY type=del 2024-09-12T17:36:47.818 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.817+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=22KUYLJ955MH type=del size=118304 2024-09-12T17:36:47.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.820+0000 7fa80ca76780 1 < suggested update operation key=VDD4PDR1GLWQ tag=H8X16H1I03ZT type=del size=23384 2024-09-12T17:36:47.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.821+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=ZZV7ZRONMKHE type=del size=554386 2024-09-12T17:36:47.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.822+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~9K2VDF2SZAZZ.0 size=1048576 2024-09-12T17:36:47.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.823+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~9K2VDF2SZAZZ.1 size=677268 2024-09-12T17:36:47.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.825+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=9K2VDF2SZAZZ tag=Z1K432FSP7B1 type=write size=2774420 2024-09-12T17:36:47.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.827+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=VRQQ9USCUEKF type=write size=947914 2024-09-12T17:36:47.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.828+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~19URT4WB9EJF.0 size=721436 2024-09-12T17:36:47.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.830+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=19URT4WB9EJF tag=CU92OI0A0CDF type=write size=1770012 2024-09-12T17:36:47.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.832+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~EJ757ANVDLP3.0 size=1048576 2024-09-12T17:36:47.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.833+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~EJ757ANVDLP3.1 size=1048576 2024-09-12T17:36:47.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.834+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~EJ757ANVDLP3.2 size=694125 2024-09-12T17:36:47.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.834+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=EJ757ANVDLP3 tag=J7SKOWC83QCF type=write size=3839853 2024-09-12T17:36:47.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.835+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=UKDSOLUA8L9M type=del 2024-09-12T17:36:47.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.837+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~7EZU7ZVY6CEM.0 size=463802 2024-09-12T17:36:47.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.837+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=7EZU7ZVY6CEM tag=AKUSANSNOR60 type=write size=1512378 2024-09-12T17:36:47.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.839+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=6RRPQZGM07U1 type=del 2024-09-12T17:36:47.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.841+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~R34DY7C0G422.0 size=1048576 2024-09-12T17:36:47.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.842+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~R34DY7C0G422.1 size=115336 2024-09-12T17:36:47.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.842+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=R34DY7C0G422 tag=V7Q0UM7OVOJC type=write size=2212488 2024-09-12T17:36:47.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.843+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~8IGQT6UDGW6I.0 size=698925 2024-09-12T17:36:47.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.845+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=8IGQT6UDGW6I tag=YXCGTNZWHL0D type=write size=1747501 2024-09-12T17:36:47.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.847+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=MQ2S74B5IGNF type=del size=3366550 2024-09-12T17:36:47.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.848+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=8RJ2ODWIL51G type=del 2024-09-12T17:36:47.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.849+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=AQVQIPPW0OHO type=del size=166906 2024-09-12T17:36:47.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.850+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=MVRA1YQ8EKOW type=del 2024-09-12T17:36:47.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.852+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~RTFBY0SFQRFI.0 size=1048576 2024-09-12T17:36:47.856 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.855+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~RTFBY0SFQRFI.1 size=61742 2024-09-12T17:36:47.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.855+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=RTFBY0SFQRFI tag=HIKRZMYK4EHP type=write size=2158894 2024-09-12T17:36:47.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.856+0000 7fa80ca76780 1 < canceled part key=_multipart_WGL9JYJXSHBH.2~REWAEDP4M9WU.0 size=1048576 2024-09-12T17:36:47.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.856+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~REWAEDP4M9WU.1 size=158630 2024-09-12T17:36:47.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.858+0000 7fa80ca76780 1 < canceled multipart upload key=WGL9JYJXSHBH upload=REWAEDP4M9WU tag=84F43IQI5V6A type=write size=2255782 2024-09-12T17:36:47.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.860+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~9UGGOVWLSX2M.0 size=317950 2024-09-12T17:36:47.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.860+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=9UGGOVWLSX2M tag=WSZFYZH4LNRG type=write size=1366526 2024-09-12T17:36:47.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.862+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~TUBVGWLI3ZWD.0 size=25824 2024-09-12T17:36:47.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.864+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=TUBVGWLI3ZWD tag=UD402GHHSQSR type=write size=1074400 2024-09-12T17:36:47.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.865+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=R7BV58XPL89C type=del size=2268311 2024-09-12T17:36:47.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.866+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~2MIXK0FSR3Q1.0 size=1048576 2024-09-12T17:36:47.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.867+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~2MIXK0FSR3Q1.1 size=721193 2024-09-12T17:36:47.870 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.869+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=2MIXK0FSR3Q1 tag=U78NHK4T16J1 type=write size=2818345 2024-09-12T17:36:47.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.871+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~SJ32JBR1SEYQ.0 size=864426 2024-09-12T17:36:47.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.871+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=SJ32JBR1SEYQ tag=9DL37MZ8HT3J type=write size=1913002 2024-09-12T17:36:47.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.872+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=XX8CR6LCQF39 type=del 2024-09-12T17:36:47.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.873+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=FS3QE2TDLSTQ type=del size=4095243 2024-09-12T17:36:47.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.874+0000 7fa80ca76780 1 < canceled part key=_multipart_OJPZAWR5BLBN.2~ZJNYXTZDSG4A.0 size=654883 2024-09-12T17:36:47.876 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.875+0000 7fa80ca76780 1 < canceled multipart upload key=OJPZAWR5BLBN upload=ZJNYXTZDSG4A tag=EFNNMPI852XR type=write size=1703459 2024-09-12T17:36:47.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.877+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=BYHPPJ3I8WZK type=del size=4192749 2024-09-12T17:36:47.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.878+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=6T48Z172RR4L type=write size=483439 2024-09-12T17:36:47.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.880+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~4RKWJ4S1PFEL.0 size=1048576 2024-09-12T17:36:47.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.881+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~4RKWJ4S1PFEL.1 size=1048576 2024-09-12T17:36:47.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.881+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~4RKWJ4S1PFEL.2 size=311397 2024-09-12T17:36:47.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.881+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=4RKWJ4S1PFEL tag=MW9C9CVDD6BB type=write size=3457125 2024-09-12T17:36:47.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.883+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~YCLKB1G9SA0X.0 size=90971 2024-09-12T17:36:47.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.884+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=YCLKB1G9SA0X tag=5QUZWUTPTRAA type=write size=1139547 2024-09-12T17:36:47.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.886+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~F2MC4X0LQLTW.0 size=1038502 2024-09-12T17:36:47.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.886+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=F2MC4X0LQLTW tag=1EZHSBTG2GWE type=write size=2087078 2024-09-12T17:36:47.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.887+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=22KUYLJ955MH type=del 2024-09-12T17:36:47.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.889+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~UPFLKLUATBYE.0 size=1048576 2024-09-12T17:36:47.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.890+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~UPFLKLUATBYE.1 size=274839 2024-09-12T17:36:47.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.890+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=UPFLKLUATBYE tag=H7T724B3JBZZ type=write size=2371991 2024-09-12T17:36:47.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.892+0000 7fa80ca76780 1 < suggested remove operation key=H87S6AI6JT6D tag=ZZV7ZRONMKHE type=del 2024-09-12T17:36:47.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.895+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~3490SH3X2HLE.0 size=1043642 2024-09-12T17:36:47.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.895+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=3490SH3X2HLE tag=T3LHEAC9K7RU type=write size=2092218 2024-09-12T17:36:47.899 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.898+0000 7fa80ca76780 1 < completed write operation key=WGL9JYJXSHBH tag=VRQQ9USCUEKF type=write size=947914 2024-09-12T17:36:47.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.901+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~U39RBTGCG15J.0 size=1048576 2024-09-12T17:36:47.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.902+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~U39RBTGCG15J.1 size=181795 2024-09-12T17:36:47.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.902+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=U39RBTGCG15J tag=4EYLZ5F7VF3J type=write size=2278947 2024-09-12T17:36:47.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.903+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~EJ757ANVDLP3.0 size=1048576 2024-09-12T17:36:47.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.904+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~EJ757ANVDLP3.1 size=1048576 2024-09-12T17:36:47.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.904+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~EJ757ANVDLP3.2 size=694125 2024-09-12T17:36:47.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.906+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=EJ757ANVDLP3 tag=J7SKOWC83QCF type=write size=3839853 2024-09-12T17:36:47.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.907+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=XZEHT6H0ONPE type=del size=475693 2024-09-12T17:36:47.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.908+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~7EZU7ZVY6CEM.0 size=463802 2024-09-12T17:36:47.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.910+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=7EZU7ZVY6CEM tag=AKUSANSNOR60 type=write size=1512378 2024-09-12T17:36:47.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.911+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=LDYYBBXOIBZI type=del size=2163416 2024-09-12T17:36:47.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.912+0000 7fa80ca76780 1 < canceled part key=_multipart_R871XU2TDWID.2~R34DY7C0G422.0 size=1048576 2024-09-12T17:36:47.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.912+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~R34DY7C0G422.1 size=115336 2024-09-12T17:36:47.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.914+0000 7fa80ca76780 1 < canceled multipart upload key=R871XU2TDWID upload=R34DY7C0G422 tag=V7Q0UM7OVOJC type=write size=2212488 2024-09-12T17:36:47.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.916+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~KLI3ICP1Y2DQ.0 size=1048576 2024-09-12T17:36:47.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.917+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~KLI3ICP1Y2DQ.1 size=378752 2024-09-12T17:36:47.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.917+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=KLI3ICP1Y2DQ tag=JEBRT0M3XWC8 type=write size=2475904 2024-09-12T17:36:47.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.918+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=MQ2S74B5IGNF type=del 2024-09-12T17:36:47.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.920+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~JW76HT82KRQF.0 size=1048576 2024-09-12T17:36:47.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.921+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~JW76HT82KRQF.1 size=236384 2024-09-12T17:36:47.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.921+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=JW76HT82KRQF tag=4TB24PB29G57 type=write size=2333536 2024-09-12T17:36:47.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.922+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=AQVQIPPW0OHO type=del 2024-09-12T17:36:47.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.923+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=DYATEVF02TYQ type=del size=2014044 2024-09-12T17:36:47.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.925+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~RTFBY0SFQRFI.0 size=1048576 2024-09-12T17:36:47.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.925+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~RTFBY0SFQRFI.1 size=61742 2024-09-12T17:36:47.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.928+0000 7fa80ca76780 1 < completed multipart upload key=07LPSZT2RKCC upload=RTFBY0SFQRFI tag=HIKRZMYK4EHP type=write size=2158894 2024-09-12T17:36:47.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.929+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=NIUSOL8DYANN type=write size=243243 2024-09-12T17:36:47.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.930+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~9UGGOVWLSX2M.0 size=317950 2024-09-12T17:36:47.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.932+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=9UGGOVWLSX2M tag=WSZFYZH4LNRG type=write size=1366526 2024-09-12T17:36:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.934+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~HJCWODFZIZDL.0 size=643093 2024-09-12T17:36:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.934+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=HJCWODFZIZDL tag=RQ2YYEP7FG2A type=write size=1691669 2024-09-12T17:36:47.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.935+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=R7BV58XPL89C type=del 2024-09-12T17:36:47.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.936+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=D0AZ7EZ5P39E type=write size=1029908 2024-09-12T17:36:47.938 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.937+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~SJ32JBR1SEYQ.0 size=864426 2024-09-12T17:36:47.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.939+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=SJ32JBR1SEYQ tag=9DL37MZ8HT3J type=write size=1913002 2024-09-12T17:36:47.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.940+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=MHTDIO9UE2L6 type=del size=358687 2024-09-12T17:36:47.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.941+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=FS3QE2TDLSTQ type=del 2024-09-12T17:36:47.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.942+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=Z5L2ZD2P9NV7 type=write size=438232 2024-09-12T17:36:47.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.943+0000 7fa80ca76780 1 < completed delete operation key=0X3LGXL2QFRN tag=BYHPPJ3I8WZK type=del 2024-09-12T17:36:47.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.944+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=AM479XAX0WF1 type=del size=3620801 2024-09-12T17:36:47.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.946+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~4RKWJ4S1PFEL.0 size=1048576 2024-09-12T17:36:47.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.946+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~4RKWJ4S1PFEL.1 size=1048576 2024-09-12T17:36:47.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.947+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~4RKWJ4S1PFEL.2 size=311397 2024-09-12T17:36:47.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.949+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=4RKWJ4S1PFEL tag=MW9C9CVDD6BB type=write size=3457125 2024-09-12T17:36:47.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.950+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=A9305585YMJK type=del size=1981113 2024-09-12T17:36:47.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.950+0000 7fa80ca76780 1 < canceled part key=_multipart_AKE8O7Q277HX.2~F2MC4X0LQLTW.0 size=1038502 2024-09-12T17:36:47.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.952+0000 7fa80ca76780 1 < canceled multipart upload key=AKE8O7Q277HX upload=F2MC4X0LQLTW tag=1EZHSBTG2GWE type=write size=2087078 2024-09-12T17:36:47.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.956+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~777293NVBNF7.0 size=1048576 2024-09-12T17:36:47.958 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.957+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~777293NVBNF7.1 size=443623 2024-09-12T17:36:47.958 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.957+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=777293NVBNF7 tag=0HTXQL5PTG1I type=write size=2540775 2024-09-12T17:36:47.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.958+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~UPFLKLUATBYE.0 size=1048576 2024-09-12T17:36:47.960 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.959+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~UPFLKLUATBYE.1 size=274839 2024-09-12T17:36:47.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.960+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=UPFLKLUATBYE tag=H7T724B3JBZZ type=write size=2371991 2024-09-12T17:36:47.963 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.962+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~S4RQOH5O8YF4.0 size=1048576 2024-09-12T17:36:47.964 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.963+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~S4RQOH5O8YF4.1 size=1048576 2024-09-12T17:36:47.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.964+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~S4RQOH5O8YF4.2 size=684466 2024-09-12T17:36:47.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.964+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=S4RQOH5O8YF4 tag=IGAM4GX51YS7 type=write size=3830194 2024-09-12T17:36:47.966 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.965+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~3490SH3X2HLE.0 size=1043642 2024-09-12T17:36:47.968 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.967+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=3490SH3X2HLE tag=T3LHEAC9K7RU type=write size=2092218 2024-09-12T17:36:47.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.968+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=2JX6BX8MXSXJ type=del size=34941 2024-09-12T17:36:47.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.969+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~U39RBTGCG15J.0 size=1048576 2024-09-12T17:36:47.971 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.970+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~U39RBTGCG15J.1 size=181795 2024-09-12T17:36:47.973 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.972+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=U39RBTGCG15J tag=4EYLZ5F7VF3J type=write size=2278947 2024-09-12T17:36:47.974 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.973+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=4DKE5LC81MSK type=del size=3925492 2024-09-12T17:36:47.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.975+0000 7fa80ca76780 1 < suggested update operation key=R02234GEWV6B tag=XZEHT6H0ONPE type=del size=475693 2024-09-12T17:36:47.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.976+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=TTKKPHLRA05J type=del size=961360 2024-09-12T17:36:47.979 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.978+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=LDYYBBXOIBZI type=del 2024-09-12T17:36:47.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.979+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=9A4DTAI97P2Q type=del size=3949258 2024-09-12T17:36:47.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.980+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~KLI3ICP1Y2DQ.0 size=1048576 2024-09-12T17:36:47.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.981+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~KLI3ICP1Y2DQ.1 size=378752 2024-09-12T17:36:47.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.983+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=KLI3ICP1Y2DQ tag=JEBRT0M3XWC8 type=write size=2475904 2024-09-12T17:36:47.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.984+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=VVLQB1V8KJZK type=del size=3381257 2024-09-12T17:36:47.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.985+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~JW76HT82KRQF.0 size=1048576 2024-09-12T17:36:47.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.986+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~JW76HT82KRQF.1 size=236384 2024-09-12T17:36:47.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.988+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=JW76HT82KRQF tag=4TB24PB29G57 type=write size=2333536 2024-09-12T17:36:47.990 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.989+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~1819Z11XW0TZ.0 size=1048576 2024-09-12T17:36:47.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.990+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~1819Z11XW0TZ.1 size=837262 2024-09-12T17:36:47.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.990+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=1819Z11XW0TZ tag=H34PDYB8EA1Z type=write size=2934414 2024-09-12T17:36:47.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.991+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=DYATEVF02TYQ type=del 2024-09-12T17:36:47.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.993+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=8G9R6HAZX9T1 type=del size=2435664 2024-09-12T17:36:47.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.994+0000 7fa80ca76780 1 < completed write operation key=K243DOYPYVDS tag=NIUSOL8DYANN type=write size=243243 2024-09-12T17:36:47.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.995+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=5YTZI0N3RZMP type=del size=4162319 2024-09-12T17:36:47.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.996+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~HJCWODFZIZDL.0 size=643093 2024-09-12T17:36:47.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:47.998+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=HJCWODFZIZDL tag=RQ2YYEP7FG2A type=write size=1691669 2024-09-12T17:36:48.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.001+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~N1XQ1TZ6AJMG.0 size=1048576 2024-09-12T17:36:48.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.003+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~N1XQ1TZ6AJMG.1 size=147247 2024-09-12T17:36:48.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.003+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=N1XQ1TZ6AJMG tag=LNEVH8ILVQT5 type=write size=2244399 2024-09-12T17:36:48.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.005+0000 7fa80ca76780 1 < completed write operation key=LU7PDGWTAK63 tag=D0AZ7EZ5P39E type=write size=1029908 2024-09-12T17:36:48.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.006+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=ICDX6E040K5O type=del size=1566002 2024-09-12T17:36:48.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.007+0000 7fa80ca76780 1 < completed delete operation key=07LPSZT2RKCC tag=MHTDIO9UE2L6 type=del 2024-09-12T17:36:48.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.008+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=RJP1G3WCY1UH type=del size=2991666 2024-09-12T17:36:48.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.010+0000 7fa80ca76780 1 < completed write operation key=H87S6AI6JT6D tag=Z5L2ZD2P9NV7 type=write size=438232 2024-09-12T17:36:48.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.012+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~590XLFH2KGHU.0 size=164984 2024-09-12T17:36:48.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.012+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=590XLFH2KGHU tag=0NK1DA6LLLO7 type=write size=1213560 2024-09-12T17:36:48.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.013+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=AM479XAX0WF1 type=del 2024-09-12T17:36:48.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.014+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=GTHRUKLPCK1E type=del size=2799818 2024-09-12T17:36:48.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.017+0000 7fa80ca76780 1 < suggested remove operation key=DYZIHCBF3D8U tag=A9305585YMJK type=del 2024-09-12T17:36:48.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.019+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~YMOBQ87GQB1P.0 size=1048576 2024-09-12T17:36:48.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.020+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~YMOBQ87GQB1P.1 size=935265 2024-09-12T17:36:48.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.020+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=YMOBQ87GQB1P tag=G4OWKM71HDA1 type=write size=3032417 2024-09-12T17:36:48.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.021+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~777293NVBNF7.0 size=1048576 2024-09-12T17:36:48.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.022+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~777293NVBNF7.1 size=443623 2024-09-12T17:36:48.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.024+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=777293NVBNF7 tag=0HTXQL5PTG1I type=write size=2540775 2024-09-12T17:36:48.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.025+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=0MK69B1SAWQS type=del size=108011 2024-09-12T17:36:48.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.026+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~S4RQOH5O8YF4.0 size=1048576 2024-09-12T17:36:48.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.027+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~S4RQOH5O8YF4.1 size=1048576 2024-09-12T17:36:48.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.027+0000 7fa80ca76780 1 < canceled part key=_multipart_AKE8O7Q277HX.2~S4RQOH5O8YF4.2 size=684466 2024-09-12T17:36:48.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.029+0000 7fa80ca76780 1 < canceled multipart upload key=AKE8O7Q277HX upload=S4RQOH5O8YF4 tag=IGAM4GX51YS7 type=write size=3830194 2024-09-12T17:36:48.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.031+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=UG5ZQTWRU2GX type=del size=1262413 2024-09-12T17:36:48.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.032+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=2JX6BX8MXSXJ type=del 2024-09-12T17:36:48.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.033+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=1SH96VV1JFD1 type=write size=108489 2024-09-12T17:36:48.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.034+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=4DKE5LC81MSK type=del 2024-09-12T17:36:48.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.037+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~AJFZBWWV0REK.0 size=990025 2024-09-12T17:36:48.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.037+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=AJFZBWWV0REK tag=MKII2QYHVTXO type=write size=2038601 2024-09-12T17:36:48.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.038+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=TTKKPHLRA05J type=del 2024-09-12T17:36:48.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.040+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~DQSC9CMB4M4H.0 size=1048576 2024-09-12T17:36:48.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.041+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~DQSC9CMB4M4H.1 size=1048576 2024-09-12T17:36:48.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.042+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~DQSC9CMB4M4H.2 size=1027704 2024-09-12T17:36:48.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.042+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=DQSC9CMB4M4H tag=J6TPREQU62YJ type=write size=4173432 2024-09-12T17:36:48.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.043+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=9A4DTAI97P2Q type=del 2024-09-12T17:36:48.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.044+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=1SNOYKXZY6TA type=del size=3673912 2024-09-12T17:36:48.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.045+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=VVLQB1V8KJZK type=del 2024-09-12T17:36:48.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.046+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=2TNV52C0LAKV type=write size=95799 2024-09-12T17:36:48.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.047+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~1819Z11XW0TZ.0 size=1048576 2024-09-12T17:36:48.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.048+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~1819Z11XW0TZ.1 size=837262 2024-09-12T17:36:48.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.050+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=1819Z11XW0TZ tag=H34PDYB8EA1Z type=write size=2934414 2024-09-12T17:36:48.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.051+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=5K49KC0593VM type=del size=1179358 2024-09-12T17:36:48.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.052+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=8G9R6HAZX9T1 type=del 2024-09-12T17:36:48.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.055+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~PANXY2ELVD2B.0 size=1048576 2024-09-12T17:36:48.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.055+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~PANXY2ELVD2B.1 size=1048576 2024-09-12T17:36:48.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.056+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~PANXY2ELVD2B.2 size=372656 2024-09-12T17:36:48.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.056+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=PANXY2ELVD2B tag=STXNHZLWQJAU type=write size=3518384 2024-09-12T17:36:48.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.057+0000 7fa80ca76780 1 < completed delete operation key=0X3LGXL2QFRN tag=5YTZI0N3RZMP type=del 2024-09-12T17:36:48.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.059+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=OU25YK1K2FQX type=del size=376129 2024-09-12T17:36:48.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.060+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~N1XQ1TZ6AJMG.0 size=1048576 2024-09-12T17:36:48.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.061+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~N1XQ1TZ6AJMG.1 size=147247 2024-09-12T17:36:48.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.063+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=N1XQ1TZ6AJMG tag=LNEVH8ILVQT5 type=write size=2244399 2024-09-12T17:36:48.066 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.065+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~RITFVAJ1LRSQ.0 size=938308 2024-09-12T17:36:48.066 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.065+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=RITFVAJ1LRSQ tag=S88CLQ1QQBFU type=write size=1986884 2024-09-12T17:36:48.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.066+0000 7fa80ca76780 1 < canceled operation key=07LPSZT2RKCC tag=ICDX6E040K5O type=del size=1566002 2024-09-12T17:36:48.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.068+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~O9EBRZ1QIYY2.0 size=1048576 2024-09-12T17:36:48.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.069+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~O9EBRZ1QIYY2.1 size=303809 2024-09-12T17:36:48.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.069+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=O9EBRZ1QIYY2 tag=92EAIF7VW712 type=write size=2400961 2024-09-12T17:36:48.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.071+0000 7fa80ca76780 1 < suggested update operation key=0U9KSMYWT2C3 tag=RJP1G3WCY1UH type=del size=2991666 2024-09-12T17:36:48.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.072+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=C49Z1BRQ4E6K type=del size=2169179 2024-09-12T17:36:48.074 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.073+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~590XLFH2KGHU.0 size=164984 2024-09-12T17:36:48.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.075+0000 7fa80ca76780 1 < completed multipart upload key=U8O04HYQZRJC upload=590XLFH2KGHU tag=0NK1DA6LLLO7 type=write size=1213560 2024-09-12T17:36:48.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.076+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=ZEIG80WE9V7B type=write size=859010 2024-09-12T17:36:48.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.078+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=GTHRUKLPCK1E type=del 2024-09-12T17:36:48.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.080+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~U19GB7KYGZ05.0 size=1048576 2024-09-12T17:36:48.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.081+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~U19GB7KYGZ05.1 size=748198 2024-09-12T17:36:48.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.081+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=U19GB7KYGZ05 tag=9WKBWJOI8KOQ type=write size=2845350 2024-09-12T17:36:48.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.083+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~YMOBQ87GQB1P.0 size=1048576 2024-09-12T17:36:48.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.084+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~YMOBQ87GQB1P.1 size=935265 2024-09-12T17:36:48.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.086+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=YMOBQ87GQB1P tag=G4OWKM71HDA1 type=write size=3032417 2024-09-12T17:36:48.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.088+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~G22YROKXLZQ1.0 size=1048576 2024-09-12T17:36:48.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.091+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~G22YROKXLZQ1.1 size=489720 2024-09-12T17:36:48.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.091+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=G22YROKXLZQ1 tag=16JC5WV79QHY type=write size=2586872 2024-09-12T17:36:48.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.092+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=0MK69B1SAWQS type=del 2024-09-12T17:36:48.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.095+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~LOQDJ5OH1N74.0 size=1048576 2024-09-12T17:36:48.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.095+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~LOQDJ5OH1N74.1 size=704827 2024-09-12T17:36:48.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.095+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=LOQDJ5OH1N74 tag=U9WSXFLYP3A9 type=write size=2801979 2024-09-12T17:36:48.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.097+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=UG5ZQTWRU2GX type=del 2024-09-12T17:36:48.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.099+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~F38G8XYQX49J.0 size=1048576 2024-09-12T17:36:48.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.100+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~F38G8XYQX49J.1 size=1048576 2024-09-12T17:36:48.102 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.101+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~F38G8XYQX49J.2 size=403583 2024-09-12T17:36:48.102 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.101+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=F38G8XYQX49J tag=TJ39Z848GLA5 type=write size=3549311 2024-09-12T17:36:48.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.102+0000 7fa80ca76780 1 < completed write operation key=VDD4PDR1GLWQ tag=1SH96VV1JFD1 type=write size=108489 2024-09-12T17:36:48.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.103+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=NU31AM8SHVVZ type=write size=1035522 2024-09-12T17:36:48.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.104+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~AJFZBWWV0REK.0 size=990025 2024-09-12T17:36:48.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.106+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=AJFZBWWV0REK tag=MKII2QYHVTXO type=write size=2038601 2024-09-12T17:36:48.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.107+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=FLYO6KAE8MVM type=del size=2040063 2024-09-12T17:36:48.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.108+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~DQSC9CMB4M4H.0 size=1048576 2024-09-12T17:36:48.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.110+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~DQSC9CMB4M4H.1 size=1048576 2024-09-12T17:36:48.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.112+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~DQSC9CMB4M4H.2 size=1027704 2024-09-12T17:36:48.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.114+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=DQSC9CMB4M4H tag=J6TPREQU62YJ type=write size=4173432 2024-09-12T17:36:48.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.116+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=SDJ7VLJDSJIT type=del size=154038 2024-09-12T17:36:48.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.117+0000 7fa80ca76780 1 < canceled operation key=U8O04HYQZRJC tag=1SNOYKXZY6TA type=del size=3673912 2024-09-12T17:36:48.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.120+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~18QPGK5SEVBL.0 size=1048576 2024-09-12T17:36:48.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.120+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~18QPGK5SEVBL.1 size=239639 2024-09-12T17:36:48.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.120+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=18QPGK5SEVBL tag=O902EZKJKHHY type=write size=2336791 2024-09-12T17:36:48.123 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.122+0000 7fa80ca76780 1 < completed write operation key=RC1IX4DQREEP tag=2TNV52C0LAKV type=write size=95799 2024-09-12T17:36:48.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.123+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=2C7BJ3Z7HZNI type=del size=2731796 2024-09-12T17:36:48.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.125+0000 7fa80ca76780 1 < suggested remove operation key=FKK4IGD1436I tag=5K49KC0593VM type=del 2024-09-12T17:36:48.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.126+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=FIBA4P1SF7SH type=del size=964430 2024-09-12T17:36:48.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.126+0000 7fa80ca76780 1 < canceled part key=_multipart_EDRL3T2I9AOO.2~PANXY2ELVD2B.0 size=1048576 2024-09-12T17:36:48.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.126+0000 7fa80ca76780 1 < canceled part key=_multipart_EDRL3T2I9AOO.2~PANXY2ELVD2B.1 size=1048576 2024-09-12T17:36:48.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.127+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~PANXY2ELVD2B.2 size=372656 2024-09-12T17:36:48.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.129+0000 7fa80ca76780 1 < canceled multipart upload key=EDRL3T2I9AOO upload=PANXY2ELVD2B tag=STXNHZLWQJAU type=write size=3518384 2024-09-12T17:36:48.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.132+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~HCN1TC9HB7FF.0 size=1048576 2024-09-12T17:36:48.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.133+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~HCN1TC9HB7FF.1 size=686004 2024-09-12T17:36:48.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.133+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=HCN1TC9HB7FF tag=JZULUQZZ83DU type=write size=2783156 2024-09-12T17:36:48.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.134+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=OU25YK1K2FQX type=del 2024-09-12T17:36:48.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.135+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=6RPEVU3WHFA2 type=write size=164984 2024-09-12T17:36:48.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.136+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~RITFVAJ1LRSQ.0 size=938308 2024-09-12T17:36:48.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.138+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=RITFVAJ1LRSQ tag=S88CLQ1QQBFU type=write size=1986884 2024-09-12T17:36:48.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.139+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=XFG1NJG0GP95 type=del size=2219253 2024-09-12T17:36:48.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.141+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~O9EBRZ1QIYY2.0 size=1048576 2024-09-12T17:36:48.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.142+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~O9EBRZ1QIYY2.1 size=303809 2024-09-12T17:36:48.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.144+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=O9EBRZ1QIYY2 tag=92EAIF7VW712 type=write size=2400961 2024-09-12T17:36:48.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.146+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~NSDYMLAH36JZ.0 size=1048576 2024-09-12T17:36:48.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.147+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~NSDYMLAH36JZ.1 size=735880 2024-09-12T17:36:48.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.147+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=NSDYMLAH36JZ tag=K96MUD0JOTX1 type=write size=2833032 2024-09-12T17:36:48.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.149+0000 7fa80ca76780 1 < canceled operation key=GKE6623N268Z tag=C49Z1BRQ4E6K type=del size=2169179 2024-09-12T17:36:48.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.150+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=L93JBA21CR06 type=write size=138214 2024-09-12T17:36:48.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.151+0000 7fa80ca76780 1 < completed write operation key=2AGKLZ3PQ2FD tag=ZEIG80WE9V7B type=write size=859010 2024-09-12T17:36:48.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.154+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~LBSFVJ8OBPR0.0 size=389310 2024-09-12T17:36:48.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.154+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=LBSFVJ8OBPR0 tag=5TAW6IBKUBGJ type=write size=1437886 2024-09-12T17:36:48.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.155+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~U19GB7KYGZ05.0 size=1048576 2024-09-12T17:36:48.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.156+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~U19GB7KYGZ05.1 size=748198 2024-09-12T17:36:48.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.159+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=U19GB7KYGZ05 tag=9WKBWJOI8KOQ type=write size=2845350 2024-09-12T17:36:48.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.160+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=ET71LUTRTHCF type=write size=980826 2024-09-12T17:36:48.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.161+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~G22YROKXLZQ1.0 size=1048576 2024-09-12T17:36:48.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.161+0000 7fa80ca76780 1 < canceled part key=_multipart_LU7PDGWTAK63.2~G22YROKXLZQ1.1 size=489720 2024-09-12T17:36:48.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.163+0000 7fa80ca76780 1 < canceled multipart upload key=LU7PDGWTAK63 upload=G22YROKXLZQ1 tag=16JC5WV79QHY type=write size=2586872 2024-09-12T17:36:48.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.165+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~WEQ2H9Q5WZ06.0 size=382119 2024-09-12T17:36:48.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.165+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=WEQ2H9Q5WZ06 tag=PVHTAJ1BCOA9 type=write size=1430695 2024-09-12T17:36:48.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.167+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~LOQDJ5OH1N74.0 size=1048576 2024-09-12T17:36:48.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.167+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~LOQDJ5OH1N74.1 size=704827 2024-09-12T17:36:48.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.169+0000 7fa80ca76780 1 < completed multipart upload key=U8O04HYQZRJC upload=LOQDJ5OH1N74 tag=U9WSXFLYP3A9 type=write size=2801979 2024-09-12T17:36:48.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.172+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~MKM4YG29MS9A.0 size=1048576 2024-09-12T17:36:48.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.173+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~MKM4YG29MS9A.1 size=1048576 2024-09-12T17:36:48.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.174+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~MKM4YG29MS9A.2 size=812181 2024-09-12T17:36:48.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.174+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=MKM4YG29MS9A tag=KD0JTS8Q0RM4 type=write size=3957909 2024-09-12T17:36:48.176 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.175+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~F38G8XYQX49J.0 size=1048576 2024-09-12T17:36:48.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.176+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~F38G8XYQX49J.1 size=1048576 2024-09-12T17:36:48.178 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.177+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~F38G8XYQX49J.2 size=403583 2024-09-12T17:36:48.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.179+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=F38G8XYQX49J tag=TJ39Z848GLA5 type=write size=3549311 2024-09-12T17:36:48.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.181+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~34N3KTZIU09H.0 size=1048576 2024-09-12T17:36:48.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.183+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~34N3KTZIU09H.1 size=81933 2024-09-12T17:36:48.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.183+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=34N3KTZIU09H tag=N73AIOTB4Q5W type=write size=2179085 2024-09-12T17:36:48.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.184+0000 7fa80ca76780 1 < completed write operation key=0X3LGXL2QFRN tag=NU31AM8SHVVZ type=write size=1035522 2024-09-12T17:36:48.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.186+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=M7AKKVFF9COI type=del size=2589217 2024-09-12T17:36:48.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.188+0000 7fa80ca76780 -1 < failed to complete operation key=FKK4IGD1436I tag=FLYO6KAE8MVM type=del size=2040063: (22) Invalid argument 2024-09-12T17:36:48.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.190+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~659J4798EMTF.0 size=28160 2024-09-12T17:36:48.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.190+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=659J4798EMTF tag=TFACJ0G5HDW4 type=write size=1076736 2024-09-12T17:36:48.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.190+0000 7fa80ca76780 -1 < no bi entry to suggest for operation key=FKK4IGD1436I tag=SDJ7VLJDSJIT type=del size=154038: (2) No such file or directory 2024-09-12T17:36:48.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.192+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~TBTDUX5EJYXA.0 size=696906 2024-09-12T17:36:48.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.192+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=TBTDUX5EJYXA tag=SPZYUIKCHNC6 type=write size=1745482 2024-09-12T17:36:48.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.194+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~18QPGK5SEVBL.0 size=1048576 2024-09-12T17:36:48.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.195+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~18QPGK5SEVBL.1 size=239639 2024-09-12T17:36:48.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.196+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=18QPGK5SEVBL tag=O902EZKJKHHY type=write size=2336791 2024-09-12T17:36:48.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.199+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~JLETDNIK84VV.0 size=1048576 2024-09-12T17:36:48.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.199+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~JLETDNIK84VV.1 size=288972 2024-09-12T17:36:48.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.199+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=JLETDNIK84VV tag=WO0O3G6EKICI type=write size=2386124 2024-09-12T17:36:48.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.201+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=2C7BJ3Z7HZNI type=del 2024-09-12T17:36:48.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.202+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=79LIXN7PUF3O type=del size=3156373 2024-09-12T17:36:48.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.204+0000 7fa80ca76780 1 < suggested remove operation key=5CAG55DQEF3Y tag=FIBA4P1SF7SH type=del 2024-09-12T17:36:48.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.205+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=XLVPKUML4LSF type=del size=3431403 2024-09-12T17:36:48.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.206+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~HCN1TC9HB7FF.0 size=1048576 2024-09-12T17:36:48.208 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.207+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~HCN1TC9HB7FF.1 size=686004 2024-09-12T17:36:48.210 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.209+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=HCN1TC9HB7FF tag=JZULUQZZ83DU type=write size=2783156 2024-09-12T17:36:48.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.211+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~MGK08MTHCK8I.0 size=1048576 2024-09-12T17:36:48.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.212+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~MGK08MTHCK8I.1 size=1048576 2024-09-12T17:36:48.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.213+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~MGK08MTHCK8I.2 size=476553 2024-09-12T17:36:48.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.213+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=MGK08MTHCK8I tag=W41WUPEDF0E6 type=write size=3622281 2024-09-12T17:36:48.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.214+0000 7fa80ca76780 1 < completed write operation key=MSZUYX441Y66 tag=6RPEVU3WHFA2 type=write size=164984 2024-09-12T17:36:48.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.217+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~Z4IXUX1TVHQ2.0 size=1048576 2024-09-12T17:36:48.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.217+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~Z4IXUX1TVHQ2.1 size=1048576 2024-09-12T17:36:48.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.218+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~Z4IXUX1TVHQ2.2 size=1037241 2024-09-12T17:36:48.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.218+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=Z4IXUX1TVHQ2 tag=FSCL675Y7AD9 type=write size=4182969 2024-09-12T17:36:48.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.220+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=XFG1NJG0GP95 type=del 2024-09-12T17:36:48.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.221+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=GNE6ONZ0ODQG type=write size=622621 2024-09-12T17:36:48.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.221+0000 7fa80ca76780 1 < canceled part key=_multipart_VC1X03K12V80.2~NSDYMLAH36JZ.0 size=1048576 2024-09-12T17:36:48.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.222+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~NSDYMLAH36JZ.1 size=735880 2024-09-12T17:36:48.225 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.224+0000 7fa80ca76780 1 < canceled multipart upload key=VC1X03K12V80 upload=NSDYMLAH36JZ tag=K96MUD0JOTX1 type=write size=2833032 2024-09-12T17:36:48.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.225+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=Q4EHTNRED5DT type=del size=3141627 2024-09-12T17:36:48.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.227+0000 7fa80ca76780 1 < suggested remove operation key=DYZIHCBF3D8U tag=L93JBA21CR06 type=write 2024-09-12T17:36:48.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.229+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=L6DNK28J0TOX type=del size=2072274 2024-09-12T17:36:48.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.231+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~LBSFVJ8OBPR0.0 size=389310 2024-09-12T17:36:48.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.232+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=LBSFVJ8OBPR0 tag=5TAW6IBKUBGJ type=write size=1437886 2024-09-12T17:36:48.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.234+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~S1NSZ0LJXVGF.0 size=1048576 2024-09-12T17:36:48.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.235+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~S1NSZ0LJXVGF.1 size=337192 2024-09-12T17:36:48.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.235+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=S1NSZ0LJXVGF tag=9QAP1NNZKCRO type=write size=2434344 2024-09-12T17:36:48.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.236+0000 7fa80ca76780 1 < completed write operation key=MSZUYX441Y66 tag=ET71LUTRTHCF type=write size=980826 2024-09-12T17:36:48.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.238+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=09I4XZ238ULG type=del size=580163 2024-09-12T17:36:48.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.239+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~WEQ2H9Q5WZ06.0 size=382119 2024-09-12T17:36:48.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.241+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=WEQ2H9Q5WZ06 tag=PVHTAJ1BCOA9 type=write size=1430695 2024-09-12T17:36:48.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.243+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~UT28LXH5T8MG.0 size=719413 2024-09-12T17:36:48.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.243+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=UT28LXH5T8MG tag=QVBTIEJD2DYI type=write size=1767989 2024-09-12T17:36:48.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.244+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~MKM4YG29MS9A.0 size=1048576 2024-09-12T17:36:48.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.245+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~MKM4YG29MS9A.1 size=1048576 2024-09-12T17:36:48.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.246+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~MKM4YG29MS9A.2 size=812181 2024-09-12T17:36:48.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.248+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=MKM4YG29MS9A tag=KD0JTS8Q0RM4 type=write size=3957909 2024-09-12T17:36:48.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.250+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~6GNQFKG0HSP1.0 size=1048576 2024-09-12T17:36:48.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.251+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~6GNQFKG0HSP1.1 size=567115 2024-09-12T17:36:48.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.251+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=6GNQFKG0HSP1 tag=BB03W0FHN83Q type=write size=2664267 2024-09-12T17:36:48.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.252+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~34N3KTZIU09H.0 size=1048576 2024-09-12T17:36:48.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.253+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~34N3KTZIU09H.1 size=81933 2024-09-12T17:36:48.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.255+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=34N3KTZIU09H tag=N73AIOTB4Q5W type=write size=2179085 2024-09-12T17:36:48.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.256+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=021FICSGG1VJ type=write size=815431 2024-09-12T17:36:48.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.258+0000 7fa80ca76780 1 < suggested update operation key=Z81704G91EPL tag=M7AKKVFF9COI type=del size=2589217 2024-09-12T17:36:48.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.260+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~AASBQ96IJHLB.0 size=1048576 2024-09-12T17:36:48.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.261+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~AASBQ96IJHLB.1 size=1048576 2024-09-12T17:36:48.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.262+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~AASBQ96IJHLB.2 size=307740 2024-09-12T17:36:48.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.262+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=AASBQ96IJHLB tag=GNC47P8EU3OT type=write size=3453468 2024-09-12T17:36:48.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.263+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~659J4798EMTF.0 size=28160 2024-09-12T17:36:48.266 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.265+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=659J4798EMTF tag=TFACJ0G5HDW4 type=write size=1076736 2024-09-12T17:36:48.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.267+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~A0U8NRWCP9IX.0 size=1048576 2024-09-12T17:36:48.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.268+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~A0U8NRWCP9IX.1 size=564811 2024-09-12T17:36:48.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.268+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=A0U8NRWCP9IX tag=XRH6YL3LHV1W type=write size=2661963 2024-09-12T17:36:48.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.269+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~TBTDUX5EJYXA.0 size=696906 2024-09-12T17:36:48.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.271+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=TBTDUX5EJYXA tag=SPZYUIKCHNC6 type=write size=1745482 2024-09-12T17:36:48.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.272+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=JQ5HSD55Y3IC type=write size=163511 2024-09-12T17:36:48.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.273+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~JLETDNIK84VV.0 size=1048576 2024-09-12T17:36:48.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.276+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~JLETDNIK84VV.1 size=288972 2024-09-12T17:36:48.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.278+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=JLETDNIK84VV tag=WO0O3G6EKICI type=write size=2386124 2024-09-12T17:36:48.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.280+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~00X1XY1J5AIU.0 size=1048576 2024-09-12T17:36:48.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.281+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~00X1XY1J5AIU.1 size=1048576 2024-09-12T17:36:48.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.282+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~00X1XY1J5AIU.2 size=81894 2024-09-12T17:36:48.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.282+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=00X1XY1J5AIU tag=ZFZ4KL3M6GER type=write size=3227622 2024-09-12T17:36:48.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.284+0000 7fa80ca76780 1 < suggested update operation key=AKE8O7Q277HX tag=79LIXN7PUF3O type=del size=3156373 2024-09-12T17:36:48.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.285+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=N6U32G0T7Q7W type=del size=4015514 2024-09-12T17:36:48.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.287+0000 7fa80ca76780 1 < suggested update operation key=OJPZAWR5BLBN tag=XLVPKUML4LSF type=del size=3431403 2024-09-12T17:36:48.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.289+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~I8CON5J5KZLF.0 size=250202 2024-09-12T17:36:48.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.289+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=I8CON5J5KZLF tag=V6LMINAHFN0P type=write size=1298778 2024-09-12T17:36:48.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.290+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~MGK08MTHCK8I.0 size=1048576 2024-09-12T17:36:48.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.291+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~MGK08MTHCK8I.1 size=1048576 2024-09-12T17:36:48.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.292+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~MGK08MTHCK8I.2 size=476553 2024-09-12T17:36:48.295 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.294+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=MGK08MTHCK8I tag=W41WUPEDF0E6 type=write size=3622281 2024-09-12T17:36:48.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.296+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~S72GGX8C1P4S.0 size=1048576 2024-09-12T17:36:48.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.297+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~S72GGX8C1P4S.1 size=1048576 2024-09-12T17:36:48.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.298+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~S72GGX8C1P4S.2 size=966519 2024-09-12T17:36:48.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.298+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=S72GGX8C1P4S tag=CGFSGKIJZCTM type=write size=4112247 2024-09-12T17:36:48.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.298+0000 7fa80ca76780 1 < canceled part key=_multipart_7QHTQ6VHZ34P.2~Z4IXUX1TVHQ2.0 size=1048576 2024-09-12T17:36:48.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.299+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~Z4IXUX1TVHQ2.1 size=1048576 2024-09-12T17:36:48.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.300+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~Z4IXUX1TVHQ2.2 size=1037241 2024-09-12T17:36:48.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.303+0000 7fa80ca76780 1 < canceled multipart upload key=7QHTQ6VHZ34P upload=Z4IXUX1TVHQ2 tag=FSCL675Y7AD9 type=write size=4182969 2024-09-12T17:36:48.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.304+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=OZ12G6G4SR49 type=del size=892314 2024-09-12T17:36:48.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.305+0000 7fa80ca76780 1 < completed write operation key=MSZUYX441Y66 tag=GNE6ONZ0ODQG type=write size=622621 2024-09-12T17:36:48.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.307+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=IH03IN7MT35Y type=del size=2178976 2024-09-12T17:36:48.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.308+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=Q4EHTNRED5DT type=del 2024-09-12T17:36:48.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.309+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=HGC0PWX3OLC0 type=del size=1921770 2024-09-12T17:36:48.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.311+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=L6DNK28J0TOX type=del 2024-09-12T17:36:48.313 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.312+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=1ZU40IUE0PS2 type=del size=201245 2024-09-12T17:36:48.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.313+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~S1NSZ0LJXVGF.0 size=1048576 2024-09-12T17:36:48.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.313+0000 7fa80ca76780 1 < canceled part key=_multipart_EDRL3T2I9AOO.2~S1NSZ0LJXVGF.1 size=337192 2024-09-12T17:36:48.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.315+0000 7fa80ca76780 1 < canceled multipart upload key=EDRL3T2I9AOO upload=S1NSZ0LJXVGF tag=9QAP1NNZKCRO type=write size=2434344 2024-09-12T17:36:48.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.316+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=752KZBDEC6GQ type=write size=562342 2024-09-12T17:36:48.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.318+0000 7fa80ca76780 -1 < failed to complete operation key=Z81704G91EPL tag=09I4XZ238ULG type=del size=580163: (22) Invalid argument 2024-09-12T17:36:48.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.320+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~ZPS6H0OO705E.0 size=793169 2024-09-12T17:36:48.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.320+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=ZPS6H0OO705E tag=TMPK7O21IYBB type=write size=1841745 2024-09-12T17:36:48.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.321+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~UT28LXH5T8MG.0 size=719413 2024-09-12T17:36:48.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.323+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=UT28LXH5T8MG tag=QVBTIEJD2DYI type=write size=1767989 2024-09-12T17:36:48.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.324+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=ZN3TVGQ7NQ22 type=del size=2341712 2024-09-12T17:36:48.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.325+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~6GNQFKG0HSP1.0 size=1048576 2024-09-12T17:36:48.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.326+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~6GNQFKG0HSP1.1 size=567115 2024-09-12T17:36:48.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.328+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=6GNQFKG0HSP1 tag=BB03W0FHN83Q type=write size=2664267 2024-09-12T17:36:48.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.329+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=WT0VYVNDDMTQ type=del size=131649 2024-09-12T17:36:48.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.330+0000 7fa80ca76780 1 < completed write operation key=VNGH1DA1HANC tag=021FICSGG1VJ type=write size=815431 2024-09-12T17:36:48.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.331+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=2SS1IYKF7K2B type=del size=1007968 2024-09-12T17:36:48.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.333+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~AASBQ96IJHLB.0 size=1048576 2024-09-12T17:36:48.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.334+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~AASBQ96IJHLB.1 size=1048576 2024-09-12T17:36:48.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.334+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~AASBQ96IJHLB.2 size=307740 2024-09-12T17:36:48.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.337+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=AASBQ96IJHLB tag=GNC47P8EU3OT type=write size=3453468 2024-09-12T17:36:48.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.338+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=66Q8S3ZDUCFY type=del size=2047621 2024-09-12T17:36:48.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.340+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~A0U8NRWCP9IX.0 size=1048576 2024-09-12T17:36:48.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.340+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~A0U8NRWCP9IX.1 size=564811 2024-09-12T17:36:48.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.342+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=A0U8NRWCP9IX tag=XRH6YL3LHV1W type=write size=2661963 2024-09-12T17:36:48.344 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.343+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=YJVZQH8LVB70 type=del size=543328 2024-09-12T17:36:48.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.344+0000 7fa80ca76780 1 < completed write operation key=H87S6AI6JT6D tag=JQ5HSD55Y3IC type=write size=163511 2024-09-12T17:36:48.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.345+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=HBB04VWKZ77L type=del size=3650544 2024-09-12T17:36:48.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.347+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~00X1XY1J5AIU.0 size=1048576 2024-09-12T17:36:48.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.347+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~00X1XY1J5AIU.1 size=1048576 2024-09-12T17:36:48.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.348+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~00X1XY1J5AIU.2 size=81894 2024-09-12T17:36:48.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.350+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=00X1XY1J5AIU tag=ZFZ4KL3M6GER type=write size=3227622 2024-09-12T17:36:48.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.351+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=REX2MS2031K2 type=write size=909991 2024-09-12T17:36:48.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.352+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=N6U32G0T7Q7W type=del 2024-09-12T17:36:48.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.353+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=TTP00MI1OF9A type=del size=3890949 2024-09-12T17:36:48.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.354+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~I8CON5J5KZLF.0 size=250202 2024-09-12T17:36:48.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.356+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=I8CON5J5KZLF tag=V6LMINAHFN0P type=write size=1298778 2024-09-12T17:36:48.358 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.357+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=XT85B32SU7JN type=write size=993621 2024-09-12T17:36:48.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.358+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~S72GGX8C1P4S.0 size=1048576 2024-09-12T17:36:48.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.359+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~S72GGX8C1P4S.1 size=1048576 2024-09-12T17:36:48.361 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.360+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~S72GGX8C1P4S.2 size=966519 2024-09-12T17:36:48.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.362+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=S72GGX8C1P4S tag=CGFSGKIJZCTM type=write size=4112247 2024-09-12T17:36:48.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.364+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~3449724KS09B.0 size=1048576 2024-09-12T17:36:48.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.365+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~3449724KS09B.1 size=1048576 2024-09-12T17:36:48.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.365+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~3449724KS09B.2 size=969563 2024-09-12T17:36:48.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.365+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=3449724KS09B tag=4KPB2BMMLAUV type=write size=4115291 2024-09-12T17:36:48.369 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.368+0000 7fa80ca76780 1 < suggested update operation key=AKE8O7Q277HX tag=OZ12G6G4SR49 type=del size=892314 2024-09-12T17:36:48.370 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.369+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=29TO1B6S8829 type=del size=73667 2024-09-12T17:36:48.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.370+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=IH03IN7MT35Y type=del 2024-09-12T17:36:48.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.374+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~BZJ841L1PXEK.0 size=1048576 2024-09-12T17:36:48.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.374+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~BZJ841L1PXEK.1 size=495844 2024-09-12T17:36:48.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.375+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=BZJ841L1PXEK tag=UPIMTYABP4BJ type=write size=2592996 2024-09-12T17:36:48.377 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.376+0000 7fa80ca76780 1 < canceled operation key=R02234GEWV6B tag=HGC0PWX3OLC0 type=del size=1921770 2024-09-12T17:36:48.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.377+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=CJ11E8J40W0V type=write size=25328 2024-09-12T17:36:48.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.379+0000 7fa80ca76780 1 < suggested remove operation key=4S33294MWCO1 tag=1ZU40IUE0PS2 type=del 2024-09-12T17:36:48.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.380+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=TWD326SMCQ8P type=del size=3194705 2024-09-12T17:36:48.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.381+0000 7fa80ca76780 1 < completed write operation key=FKK4IGD1436I tag=752KZBDEC6GQ type=write size=562342 2024-09-12T17:36:48.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.383+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~TGA7PXKRPPI3.0 size=1048576 2024-09-12T17:36:48.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.384+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~TGA7PXKRPPI3.1 size=1048576 2024-09-12T17:36:48.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.385+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~TGA7PXKRPPI3.2 size=287358 2024-09-12T17:36:48.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.385+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=TGA7PXKRPPI3 tag=XKLVQ0A61QJY type=write size=3433086 2024-09-12T17:36:48.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.386+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~ZPS6H0OO705E.0 size=793169 2024-09-12T17:36:48.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.388+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=ZPS6H0OO705E tag=TMPK7O21IYBB type=write size=1841745 2024-09-12T17:36:48.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.390+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~S9IOHSG7RPDB.0 size=1048576 2024-09-12T17:36:48.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.391+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~S9IOHSG7RPDB.1 size=1048576 2024-09-12T17:36:48.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.392+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~S9IOHSG7RPDB.2 size=924644 2024-09-12T17:36:48.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.392+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=S9IOHSG7RPDB tag=JFYUTYAGBHY6 type=write size=4070372 2024-09-12T17:36:48.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.393+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=ZN3TVGQ7NQ22 type=del 2024-09-12T17:36:48.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.395+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~ZK29Y4TW8HIT.0 size=1048576 2024-09-12T17:36:48.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.396+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~ZK29Y4TW8HIT.1 size=1048576 2024-09-12T17:36:48.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.397+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~ZK29Y4TW8HIT.2 size=975240 2024-09-12T17:36:48.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.397+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=ZK29Y4TW8HIT tag=LQQQOEM3EVOW type=write size=4120968 2024-09-12T17:36:48.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.398+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=WT0VYVNDDMTQ type=del 2024-09-12T17:36:48.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.399+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=X7D1SETN35TF type=del size=1761079 2024-09-12T17:36:48.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.400+0000 7fa80ca76780 1 < canceled operation key=R871XU2TDWID tag=2SS1IYKF7K2B type=del size=1007968 2024-09-12T17:36:48.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.402+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=EBLEUBUXJ6DG type=del size=813162 2024-09-12T17:36:48.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.403+0000 7fa80ca76780 1 < canceled operation key=0J6RTRJWZP1T tag=66Q8S3ZDUCFY type=del size=2047621 2024-09-12T17:36:48.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.404+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=P5UA4HZ0DX2N type=del size=319515 2024-09-12T17:36:48.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.405+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=YJVZQH8LVB70 type=del 2024-09-12T17:36:48.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.406+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=6AWQSEVHV2J6 type=del size=1460273 2024-09-12T17:36:48.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.407+0000 7fa80ca76780 1 < canceled operation key=K243DOYPYVDS tag=HBB04VWKZ77L type=del size=3650544 2024-09-12T17:36:48.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.409+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=1YE945RIK7PZ type=del size=2665590 2024-09-12T17:36:48.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.410+0000 7fa80ca76780 1 < completed write operation key=BLGMV3S9AY24 tag=REX2MS2031K2 type=write size=909991 2024-09-12T17:36:48.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.412+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~EPI73PXO5VA8.0 size=836879 2024-09-12T17:36:48.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.412+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=EPI73PXO5VA8 tag=UI1HTMVBS04Q type=write size=1885455 2024-09-12T17:36:48.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.413+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=TTP00MI1OF9A type=del 2024-09-12T17:36:48.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.414+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=KBLVYNYK097B type=write size=542751 2024-09-12T17:36:48.416 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.415+0000 7fa80ca76780 1 < completed write operation key=FKK4IGD1436I tag=XT85B32SU7JN type=write size=993621 2024-09-12T17:36:48.419 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.418+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~8VM3KN6Y7GKJ.0 size=205294 2024-09-12T17:36:48.419 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.418+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=8VM3KN6Y7GKJ tag=9VCV835JT36O type=write size=1253870 2024-09-12T17:36:48.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.419+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~3449724KS09B.0 size=1048576 2024-09-12T17:36:48.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.420+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~3449724KS09B.1 size=1048576 2024-09-12T17:36:48.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.421+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~3449724KS09B.2 size=969563 2024-09-12T17:36:48.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.423+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=3449724KS09B tag=4KPB2BMMLAUV type=write size=4115291 2024-09-12T17:36:48.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.424+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=EC7F3PX4NS2D type=write size=428099 2024-09-12T17:36:48.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.425+0000 7fa80ca76780 1 < canceled operation key=GKE6623N268Z tag=29TO1B6S8829 type=del size=73667 2024-09-12T17:36:48.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.428+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~0XOPNSZNVUG8.0 size=1048576 2024-09-12T17:36:48.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.430+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~0XOPNSZNVUG8.1 size=1048576 2024-09-12T17:36:48.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.431+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~0XOPNSZNVUG8.2 size=313289 2024-09-12T17:36:48.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.431+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=0XOPNSZNVUG8 tag=C6USSXI1OP3Z type=write size=3459017 2024-09-12T17:36:48.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.432+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~BZJ841L1PXEK.0 size=1048576 2024-09-12T17:36:48.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.432+0000 7fa80ca76780 1 < canceled part key=_multipart_5CAG55DQEF3Y.2~BZJ841L1PXEK.1 size=495844 2024-09-12T17:36:48.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.434+0000 7fa80ca76780 1 < canceled multipart upload key=5CAG55DQEF3Y upload=BZJ841L1PXEK tag=UPIMTYABP4BJ type=write size=2592996 2024-09-12T17:36:48.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.435+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=7QGF31X4Z5F4 type=del size=104545 2024-09-12T17:36:48.439 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.438+0000 7fa80ca76780 1 < suggested update operation key=8Z3EPQHMA6M5 tag=CJ11E8J40W0V type=write size=25328 2024-09-12T17:36:48.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.439+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=1EEA5A9R1UDE type=del size=2537412 2024-09-12T17:36:48.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.440+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=TWD326SMCQ8P type=del 2024-09-12T17:36:48.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.441+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=V58K551UBAGR type=del size=1736107 2024-09-12T17:36:48.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.442+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~TGA7PXKRPPI3.0 size=1048576 2024-09-12T17:36:48.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.442+0000 7fa80ca76780 1 < canceled part key=_multipart_RC1IX4DQREEP.2~TGA7PXKRPPI3.1 size=1048576 2024-09-12T17:36:48.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.443+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~TGA7PXKRPPI3.2 size=287358 2024-09-12T17:36:48.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.446+0000 7fa80ca76780 1 < canceled multipart upload key=RC1IX4DQREEP upload=TGA7PXKRPPI3 tag=XKLVQ0A61QJY type=write size=3433086 2024-09-12T17:36:48.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.448+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~BF5I9D3VPJFL.0 size=1048576 2024-09-12T17:36:48.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.449+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~BF5I9D3VPJFL.1 size=41871 2024-09-12T17:36:48.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.449+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=BF5I9D3VPJFL tag=YHCU9CA0NJE4 type=write size=2139023 2024-09-12T17:36:48.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.450+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~S9IOHSG7RPDB.0 size=1048576 2024-09-12T17:36:48.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.451+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~S9IOHSG7RPDB.1 size=1048576 2024-09-12T17:36:48.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.452+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~S9IOHSG7RPDB.2 size=924644 2024-09-12T17:36:48.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.454+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=S9IOHSG7RPDB tag=JFYUTYAGBHY6 type=write size=4070372 2024-09-12T17:36:48.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.455+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=4TMSPKE5TIQG type=del size=445023 2024-09-12T17:36:48.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.456+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~ZK29Y4TW8HIT.0 size=1048576 2024-09-12T17:36:48.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.457+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~ZK29Y4TW8HIT.1 size=1048576 2024-09-12T17:36:48.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.458+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~ZK29Y4TW8HIT.2 size=975240 2024-09-12T17:36:48.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.460+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=ZK29Y4TW8HIT tag=LQQQOEM3EVOW type=write size=4120968 2024-09-12T17:36:48.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.462+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~Z0KMN34A6EEQ.0 size=1048576 2024-09-12T17:36:48.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.463+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~Z0KMN34A6EEQ.1 size=938969 2024-09-12T17:36:48.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.463+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=Z0KMN34A6EEQ tag=084MSU1ZBEML type=write size=3036121 2024-09-12T17:36:48.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.465+0000 7fa80ca76780 1 < suggested remove operation key=0J6RTRJWZP1T tag=X7D1SETN35TF type=del 2024-09-12T17:36:48.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.467+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~0EW7JX60Y27D.0 size=1048576 2024-09-12T17:36:48.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.468+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~0EW7JX60Y27D.1 size=1048576 2024-09-12T17:36:48.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.469+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~0EW7JX60Y27D.2 size=284361 2024-09-12T17:36:48.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.469+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=0EW7JX60Y27D tag=CV7A1W4VDAX5 type=write size=3430089 2024-09-12T17:36:48.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.471+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=EBLEUBUXJ6DG type=del 2024-09-12T17:36:48.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.473+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~1UNXVIXFEDUZ.0 size=709890 2024-09-12T17:36:48.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.473+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=1UNXVIXFEDUZ tag=FDP56LUHU725 type=write size=1758466 2024-09-12T17:36:48.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.474+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=P5UA4HZ0DX2N type=del 2024-09-12T17:36:48.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.475+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=SA8AML3YHMES type=write size=834116 2024-09-12T17:36:48.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.476+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=6AWQSEVHV2J6 type=del 2024-09-12T17:36:48.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.478+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=CAQZOHDA1AMM type=del size=3173839 2024-09-12T17:36:48.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.479+0000 7fa80ca76780 1 < canceled operation key=0X3LGXL2QFRN tag=1YE945RIK7PZ type=del size=2665590 2024-09-12T17:36:48.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.480+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=FAIETR02T53T type=del size=901236 2024-09-12T17:36:48.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.481+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~EPI73PXO5VA8.0 size=836879 2024-09-12T17:36:48.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.483+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=EPI73PXO5VA8 tag=UI1HTMVBS04Q type=write size=1885455 2024-09-12T17:36:48.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.484+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=95XQKH80T1PV type=write size=45450 2024-09-12T17:36:48.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.485+0000 7fa80ca76780 1 < completed write operation key=OJPZAWR5BLBN tag=KBLVYNYK097B type=write size=542751 2024-09-12T17:36:48.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.486+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=ELY8KV4ZIA36 type=del size=3083053 2024-09-12T17:36:48.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.487+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~8VM3KN6Y7GKJ.0 size=205294 2024-09-12T17:36:48.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.489+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=8VM3KN6Y7GKJ tag=9VCV835JT36O type=write size=1253870 2024-09-12T17:36:48.492 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.491+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~QSIC2K3K92QI.0 size=1048576 2024-09-12T17:36:48.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.492+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~QSIC2K3K92QI.1 size=787246 2024-09-12T17:36:48.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.492+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=QSIC2K3K92QI tag=H0AJAKBXRF7G type=write size=2884398 2024-09-12T17:36:48.494 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.493+0000 7fa80ca76780 1 < completed write operation key=7QHTQ6VHZ34P tag=EC7F3PX4NS2D type=write size=428099 2024-09-12T17:36:48.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.495+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~JH7K18S21B4Y.0 size=69188 2024-09-12T17:36:48.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.495+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=JH7K18S21B4Y tag=1PG6XP6YKEXI type=write size=1117764 2024-09-12T17:36:48.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.496+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~0XOPNSZNVUG8.0 size=1048576 2024-09-12T17:36:48.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.497+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~0XOPNSZNVUG8.1 size=1048576 2024-09-12T17:36:48.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.499+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~0XOPNSZNVUG8.2 size=313289 2024-09-12T17:36:48.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.500+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=0XOPNSZNVUG8 tag=C6USSXI1OP3Z type=write size=3459017 2024-09-12T17:36:48.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.503+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~3XU0XC2TZY9I.0 size=678456 2024-09-12T17:36:48.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.503+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=3XU0XC2TZY9I tag=XYC261URSFTK type=write size=1727032 2024-09-12T17:36:48.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.504+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=7QGF31X4Z5F4 type=del 2024-09-12T17:36:48.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.506+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~KXN2CL6XHT3T.0 size=1048576 2024-09-12T17:36:48.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.507+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~KXN2CL6XHT3T.1 size=1048576 2024-09-12T17:36:48.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.508+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~KXN2CL6XHT3T.2 size=372104 2024-09-12T17:36:48.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.508+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=KXN2CL6XHT3T tag=UXD9ALXYU23E type=write size=3517832 2024-09-12T17:36:48.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.509+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=1EEA5A9R1UDE type=del 2024-09-12T17:36:48.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.511+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~6D8FTB7E1EVU.0 size=1048576 2024-09-12T17:36:48.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.512+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~6D8FTB7E1EVU.1 size=1048576 2024-09-12T17:36:48.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.513+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~6D8FTB7E1EVU.2 size=1022574 2024-09-12T17:36:48.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.513+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=6D8FTB7E1EVU tag=3C9O9JFZ6SA2 type=write size=4168302 2024-09-12T17:36:48.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.516+0000 7fa80ca76780 1 < suggested update operation key=2AGKLZ3PQ2FD tag=V58K551UBAGR type=del size=1736107 2024-09-12T17:36:48.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.517+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=W35OPZP72P9U type=del size=2511410 2024-09-12T17:36:48.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.518+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~BF5I9D3VPJFL.0 size=1048576 2024-09-12T17:36:48.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.518+0000 7fa80ca76780 1 < canceled part key=_multipart_AKE8O7Q277HX.2~BF5I9D3VPJFL.1 size=41871 2024-09-12T17:36:48.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.520+0000 7fa80ca76780 1 < canceled multipart upload key=AKE8O7Q277HX upload=BF5I9D3VPJFL tag=YHCU9CA0NJE4 type=write size=2139023 2024-09-12T17:36:48.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.522+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~OQUIDOAMZPV4.0 size=539845 2024-09-12T17:36:48.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.522+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=OQUIDOAMZPV4 tag=4836T0OAP17G type=write size=1588421 2024-09-12T17:36:48.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.523+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=4TMSPKE5TIQG type=del 2024-09-12T17:36:48.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.525+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~AQ2IGPUCZX51.0 size=1048576 2024-09-12T17:36:48.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.526+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~AQ2IGPUCZX51.1 size=969148 2024-09-12T17:36:48.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.526+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=AQ2IGPUCZX51 tag=MF5ZBWXZYO5E type=write size=3066300 2024-09-12T17:36:48.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.527+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~Z0KMN34A6EEQ.0 size=1048576 2024-09-12T17:36:48.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.527+0000 7fa80ca76780 1 < canceled part key=_multipart_MSZUYX441Y66.2~Z0KMN34A6EEQ.1 size=938969 2024-09-12T17:36:48.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.529+0000 7fa80ca76780 1 < canceled multipart upload key=MSZUYX441Y66 upload=Z0KMN34A6EEQ tag=084MSU1ZBEML type=write size=3036121 2024-09-12T17:36:48.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.530+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=WWN0CCE0YIA0 type=del size=947688 2024-09-12T17:36:48.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.531+0000 7fa80ca76780 1 < canceled part key=_multipart_K243DOYPYVDS.2~0EW7JX60Y27D.0 size=1048576 2024-09-12T17:36:48.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.532+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~0EW7JX60Y27D.1 size=1048576 2024-09-12T17:36:48.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.533+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~0EW7JX60Y27D.2 size=284361 2024-09-12T17:36:48.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.535+0000 7fa80ca76780 1 < canceled multipart upload key=K243DOYPYVDS upload=0EW7JX60Y27D tag=CV7A1W4VDAX5 type=write size=3430089 2024-09-12T17:36:48.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.536+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=HZ2S393S28MZ type=del size=3689198 2024-09-12T17:36:48.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.537+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~1UNXVIXFEDUZ.0 size=709890 2024-09-12T17:36:48.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.539+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=1UNXVIXFEDUZ tag=FDP56LUHU725 type=write size=1758466 2024-09-12T17:36:48.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.540+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=XS0T12C1P264 type=del size=2214359 2024-09-12T17:36:48.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.541+0000 7fa80ca76780 1 < completed write operation key=94801LE91HZ9 tag=SA8AML3YHMES type=write size=834116 2024-09-12T17:36:48.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.543+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=OPVW6JH1T4HD type=del size=2763280 2024-09-12T17:36:48.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.545+0000 7fa80ca76780 1 < suggested update operation key=0X3LGXL2QFRN tag=CAQZOHDA1AMM type=del size=3173839 2024-09-12T17:36:48.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.546+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=NT2PO9C6H8YD type=del size=4156775 2024-09-12T17:36:48.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.547+0000 7fa80ca76780 1 < canceled operation key=GKE6623N268Z tag=FAIETR02T53T type=del size=901236 2024-09-12T17:36:48.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.550+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~KU123PXPDSUQ.0 size=328603 2024-09-12T17:36:48.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.550+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=KU123PXPDSUQ tag=G59AG7SU8O2C type=write size=1377179 2024-09-12T17:36:48.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.551+0000 7fa80ca76780 1 < completed write operation key=VDD4PDR1GLWQ tag=95XQKH80T1PV type=write size=45450 2024-09-12T17:36:48.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.552+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=AQWW3DZXTKMN type=del size=3691546 2024-09-12T17:36:48.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.555+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=ELY8KV4ZIA36 type=del 2024-09-12T17:36:48.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.557+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~SW2VX2MHVDDT.0 size=87447 2024-09-12T17:36:48.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.557+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=SW2VX2MHVDDT tag=8SJ8SEQHGS2V type=write size=1136023 2024-09-12T17:36:48.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.558+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~QSIC2K3K92QI.0 size=1048576 2024-09-12T17:36:48.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.559+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~QSIC2K3K92QI.1 size=787246 2024-09-12T17:36:48.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.561+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=QSIC2K3K92QI tag=H0AJAKBXRF7G type=write size=2884398 2024-09-12T17:36:48.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.563+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~BCFX40ID1SYK.0 size=1048576 2024-09-12T17:36:48.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.563+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~BCFX40ID1SYK.1 size=240540 2024-09-12T17:36:48.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.563+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=BCFX40ID1SYK tag=T28WIGE8QPM5 type=write size=2337692 2024-09-12T17:36:48.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.564+0000 7fa80ca76780 1 < canceled part key=_multipart_0X3LGXL2QFRN.2~JH7K18S21B4Y.0 size=69188 2024-09-12T17:36:48.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.565+0000 7fa80ca76780 1 < canceled multipart upload key=0X3LGXL2QFRN upload=JH7K18S21B4Y tag=1PG6XP6YKEXI type=write size=1117764 2024-09-12T17:36:48.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.567+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=ZJ27W3A1O7NK type=del size=1063272 2024-09-12T17:36:48.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.568+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~3XU0XC2TZY9I.0 size=678456 2024-09-12T17:36:48.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.569+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=3XU0XC2TZY9I tag=XYC261URSFTK type=write size=1727032 2024-09-12T17:36:48.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.571+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=RUP5Z6P0VZZ0 type=del size=3775530 2024-09-12T17:36:48.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.572+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~KXN2CL6XHT3T.0 size=1048576 2024-09-12T17:36:48.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.572+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~KXN2CL6XHT3T.1 size=1048576 2024-09-12T17:36:48.574 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.573+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~KXN2CL6XHT3T.2 size=372104 2024-09-12T17:36:48.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.575+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=KXN2CL6XHT3T tag=UXD9ALXYU23E type=write size=3517832 2024-09-12T17:36:48.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.576+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=C3I2JP4R639I type=del size=4180290 2024-09-12T17:36:48.578 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.577+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~6D8FTB7E1EVU.0 size=1048576 2024-09-12T17:36:48.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.578+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~6D8FTB7E1EVU.1 size=1048576 2024-09-12T17:36:48.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.578+0000 7fa80ca76780 1 < canceled part key=_multipart_RC1IX4DQREEP.2~6D8FTB7E1EVU.2 size=1022574 2024-09-12T17:36:48.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.580+0000 7fa80ca76780 1 < canceled multipart upload key=RC1IX4DQREEP upload=6D8FTB7E1EVU tag=3C9O9JFZ6SA2 type=write size=4168302 2024-09-12T17:36:48.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.582+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=ELD0LILEGL7M type=del size=4037488 2024-09-12T17:36:48.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.583+0000 7fa80ca76780 1 < canceled operation key=4S33294MWCO1 tag=W35OPZP72P9U type=del size=2511410 2024-09-12T17:36:48.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.584+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=XHG5N20Q2UTM type=del size=3156890 2024-09-12T17:36:48.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.585+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~OQUIDOAMZPV4.0 size=539845 2024-09-12T17:36:48.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.587+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=OQUIDOAMZPV4 tag=4836T0OAP17G type=write size=1588421 2024-09-12T17:36:48.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.588+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=306KTJHGP3OS type=del size=350744 2024-09-12T17:36:48.590 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.589+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~AQ2IGPUCZX51.0 size=1048576 2024-09-12T17:36:48.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.590+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~AQ2IGPUCZX51.1 size=969148 2024-09-12T17:36:48.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.592+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=AQ2IGPUCZX51 tag=MF5ZBWXZYO5E type=write size=3066300 2024-09-12T17:36:48.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.594+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=I9EPZH1QMDMF type=del size=3045643 2024-09-12T17:36:48.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.595+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=WWN0CCE0YIA0 type=del 2024-09-12T17:36:48.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.597+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~I7DH97YZUQOQ.0 size=1048576 2024-09-12T17:36:48.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.598+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~I7DH97YZUQOQ.1 size=1048576 2024-09-12T17:36:48.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.599+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~I7DH97YZUQOQ.2 size=280944 2024-09-12T17:36:48.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.599+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=I7DH97YZUQOQ tag=RPVV8ZKJ8A3G type=write size=3426672 2024-09-12T17:36:48.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.601+0000 7fa80ca76780 1 < suggested remove operation key=7QHTQ6VHZ34P tag=HZ2S393S28MZ type=del 2024-09-12T17:36:48.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.603+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=ZNN3B1B5UTL0 type=del size=3961103 2024-09-12T17:36:48.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.604+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=XS0T12C1P264 type=del 2024-09-12T17:36:48.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.605+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=1A1N4YC1BHE3 type=del size=2257787 2024-09-12T17:36:48.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.606+0000 7fa80ca76780 1 < completed delete operation key=07LPSZT2RKCC tag=OPVW6JH1T4HD type=del 2024-09-12T17:36:48.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.608+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=SMJHBZK3VOD3 type=del size=316517 2024-09-12T17:36:48.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.609+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=NT2PO9C6H8YD type=del 2024-09-12T17:36:48.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.612+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=6VAFJKRH71WE type=del size=3946186 2024-09-12T17:36:48.614 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.613+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~KU123PXPDSUQ.0 size=328603 2024-09-12T17:36:48.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.615+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=KU123PXPDSUQ tag=G59AG7SU8O2C type=write size=1377179 2024-09-12T17:36:48.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.616+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=5CGFLHY9ZA7B type=del size=2859539 2024-09-12T17:36:48.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.618+0000 7fa80ca76780 1 < canceled operation key=K243DOYPYVDS tag=AQWW3DZXTKMN type=del size=3691546 2024-09-12T17:36:48.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.619+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=7HEP8BQGLWAJ type=write size=606930 2024-09-12T17:36:48.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.620+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~SW2VX2MHVDDT.0 size=87447 2024-09-12T17:36:48.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.622+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=SW2VX2MHVDDT tag=8SJ8SEQHGS2V type=write size=1136023 2024-09-12T17:36:48.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.624+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=XPGM44XHUWQS type=del size=4171584 2024-09-12T17:36:48.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.625+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~BCFX40ID1SYK.0 size=1048576 2024-09-12T17:36:48.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.625+0000 7fa80ca76780 1 < canceled part key=_multipart_4S33294MWCO1.2~BCFX40ID1SYK.1 size=240540 2024-09-12T17:36:48.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.627+0000 7fa80ca76780 1 < canceled multipart upload key=4S33294MWCO1 upload=BCFX40ID1SYK tag=T28WIGE8QPM5 type=write size=2337692 2024-09-12T17:36:48.630 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.629+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~YVX14VTXFP19.0 size=1048576 2024-09-12T17:36:48.631 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.630+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~YVX14VTXFP19.1 size=941232 2024-09-12T17:36:48.631 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.630+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=YVX14VTXFP19 tag=CN3FK3R19JR7 type=write size=3038384 2024-09-12T17:36:48.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.633+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=ZJ27W3A1O7NK type=del 2024-09-12T17:36:48.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.634+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=NR370SENO462 type=del size=3986235 2024-09-12T17:36:48.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.635+0000 7fa80ca76780 1 < canceled operation key=RC1IX4DQREEP tag=RUP5Z6P0VZZ0 type=del size=3775530 2024-09-12T17:36:48.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.636+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=G4AAI1JNE298 type=del size=441434 2024-09-12T17:36:48.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.638+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=C3I2JP4R639I type=del 2024-09-12T17:36:48.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.640+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~FK2566GLDS1Q.0 size=706043 2024-09-12T17:36:48.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.640+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=FK2566GLDS1Q tag=5J5JYL3DS2LB type=write size=1754619 2024-09-12T17:36:48.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.642+0000 7fa80ca76780 1 < suggested remove operation key=H87S6AI6JT6D tag=ELD0LILEGL7M type=del 2024-09-12T17:36:48.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.644+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=2392AHOGUVB3 type=del size=2786973 2024-09-12T17:36:48.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.645+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=XHG5N20Q2UTM type=del 2024-09-12T17:36:48.647 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.646+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=XGQU70TRZ6H4 type=del size=2879843 2024-09-12T17:36:48.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.648+0000 7fa80ca76780 1 < suggested remove operation key=Z81704G91EPL tag=306KTJHGP3OS type=del 2024-09-12T17:36:48.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.650+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=4QBIRPKYDXA1 type=write size=288784 2024-09-12T17:36:48.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.651+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=I9EPZH1QMDMF type=del 2024-09-12T17:36:48.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.653+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~D13IGMVD3IM5.0 size=1048576 2024-09-12T17:36:48.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.654+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~D13IGMVD3IM5.1 size=1048576 2024-09-12T17:36:48.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.655+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~D13IGMVD3IM5.2 size=391179 2024-09-12T17:36:48.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.655+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=D13IGMVD3IM5 tag=3F29V7J9MCG2 type=write size=3536907 2024-09-12T17:36:48.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.656+0000 7fa80ca76780 1 < canceled part key=_multipart_0U9KSMYWT2C3.2~I7DH97YZUQOQ.0 size=1048576 2024-09-12T17:36:48.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.657+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~I7DH97YZUQOQ.1 size=1048576 2024-09-12T17:36:48.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.658+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~I7DH97YZUQOQ.2 size=280944 2024-09-12T17:36:48.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.660+0000 7fa80ca76780 1 < canceled multipart upload key=0U9KSMYWT2C3 upload=I7DH97YZUQOQ tag=RPVV8ZKJ8A3G type=write size=3426672 2024-09-12T17:36:48.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.662+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~4GKJ8ZZGSF8J.0 size=1048576 2024-09-12T17:36:48.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.663+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~4GKJ8ZZGSF8J.1 size=383862 2024-09-12T17:36:48.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.663+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=4GKJ8ZZGSF8J tag=WDF3V8Q04ZAH type=write size=2481014 2024-09-12T17:36:48.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.666+0000 7fa80ca76780 1 < suggested remove operation key=0J6RTRJWZP1T tag=ZNN3B1B5UTL0 type=del 2024-09-12T17:36:48.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.667+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=FRW2NFHPZK93 type=del size=394785 2024-09-12T17:36:48.669 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.668+0000 7fa80ca76780 -1 < failed to complete operation key=0J6RTRJWZP1T tag=1A1N4YC1BHE3 type=del size=2257787: (22) Invalid argument 2024-09-12T17:36:48.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.670+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=PGHFX9HCG9P0 type=write size=607212 2024-09-12T17:36:48.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.671+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=SMJHBZK3VOD3 type=del 2024-09-12T17:36:48.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.672+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=1OZ4G43UX7JD type=del size=145447 2024-09-12T17:36:48.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.674+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=6VAFJKRH71WE type=del 2024-09-12T17:36:48.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.675+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=XUW7BIRUY4UL type=del size=2321747 2024-09-12T17:36:48.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.676+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=5CGFLHY9ZA7B type=del 2024-09-12T17:36:48.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.677+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=1KMD2LDAG8FN type=write size=762805 2024-09-12T17:36:48.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.678+0000 7fa80ca76780 1 < completed write operation key=BLGMV3S9AY24 tag=7HEP8BQGLWAJ type=write size=606930 2024-09-12T17:36:48.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.680+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~C5JXIRJT6H3M.0 size=1048576 2024-09-12T17:36:48.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.681+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~C5JXIRJT6H3M.1 size=1048576 2024-09-12T17:36:48.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.682+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~C5JXIRJT6H3M.2 size=778000 2024-09-12T17:36:48.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.682+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=C5JXIRJT6H3M tag=8RMWLLJ0QO50 type=write size=3923728 2024-09-12T17:36:48.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.683+0000 7fa80ca76780 1 < canceled operation key=GKE6623N268Z tag=XPGM44XHUWQS type=del size=4171584 2024-09-12T17:36:48.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.685+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~LDL0XC1V4PG8.0 size=1048576 2024-09-12T17:36:48.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.686+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~LDL0XC1V4PG8.1 size=1048576 2024-09-12T17:36:48.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.687+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~LDL0XC1V4PG8.2 size=738563 2024-09-12T17:36:48.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.687+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=LDL0XC1V4PG8 tag=WFHJCW23K89X type=write size=3884291 2024-09-12T17:36:48.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.688+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~YVX14VTXFP19.0 size=1048576 2024-09-12T17:36:48.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.689+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~YVX14VTXFP19.1 size=941232 2024-09-12T17:36:48.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.691+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=YVX14VTXFP19 tag=CN3FK3R19JR7 type=write size=3038384 2024-09-12T17:36:48.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.692+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=58FZ64FK2Q48 type=del size=2952365 2024-09-12T17:36:48.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.694+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=NR370SENO462 type=del 2024-09-12T17:36:48.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.696+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~8UDC4TOHRODH.0 size=1048576 2024-09-12T17:36:48.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.697+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~8UDC4TOHRODH.1 size=963547 2024-09-12T17:36:48.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.697+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=8UDC4TOHRODH tag=LGI978FNUFKW type=write size=3060699 2024-09-12T17:36:48.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.698+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=G4AAI1JNE298 type=del 2024-09-12T17:36:48.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.700+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~5C4P8G8FY1CX.0 size=1048576 2024-09-12T17:36:48.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.701+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~5C4P8G8FY1CX.1 size=420737 2024-09-12T17:36:48.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.701+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=5C4P8G8FY1CX tag=U9JJ6HQAD7SY type=write size=2517889 2024-09-12T17:36:48.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.702+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~FK2566GLDS1Q.0 size=706043 2024-09-12T17:36:48.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.704+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=FK2566GLDS1Q tag=5J5JYL3DS2LB type=write size=1754619 2024-09-12T17:36:48.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.705+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=W7FNEYI5GAZU type=write size=907958 2024-09-12T17:36:48.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.707+0000 7fa80ca76780 1 < suggested update operation key=2AGKLZ3PQ2FD tag=2392AHOGUVB3 type=del size=2786973 2024-09-12T17:36:48.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.708+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=MUBJYYMUNW75 type=del size=743388 2024-09-12T17:36:48.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.710+0000 7fa80ca76780 1 < canceled operation key=BLGMV3S9AY24 tag=XGQU70TRZ6H4 type=del size=2879843 2024-09-12T17:36:48.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.711+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=4LLXXDGHV544 type=del size=631691 2024-09-12T17:36:48.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.712+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=4QBIRPKYDXA1 type=write size=288784 2024-09-12T17:36:48.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.715+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=VVBMEABSGHUY type=del size=3190524 2024-09-12T17:36:48.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.716+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~D13IGMVD3IM5.0 size=1048576 2024-09-12T17:36:48.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.717+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~D13IGMVD3IM5.1 size=1048576 2024-09-12T17:36:48.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.718+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~D13IGMVD3IM5.2 size=391179 2024-09-12T17:36:48.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.720+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=D13IGMVD3IM5 tag=3F29V7J9MCG2 type=write size=3536907 2024-09-12T17:36:48.723 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.722+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~23MKJIT0YXMX.0 size=423599 2024-09-12T17:36:48.723 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.722+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=23MKJIT0YXMX tag=3E6EWT2VDA5H type=write size=1472175 2024-09-12T17:36:48.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.723+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~4GKJ8ZZGSF8J.0 size=1048576 2024-09-12T17:36:48.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.724+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~4GKJ8ZZGSF8J.1 size=383862 2024-09-12T17:36:48.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.726+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=4GKJ8ZZGSF8J tag=WDF3V8Q04ZAH type=write size=2481014 2024-09-12T17:36:48.728 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.727+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=JAJI29EHKKI6 type=del size=2658341 2024-09-12T17:36:48.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.728+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=FRW2NFHPZK93 type=del 2024-09-12T17:36:48.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.731+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~SBES6VN1A87O.0 size=1048576 2024-09-12T17:36:48.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.732+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~SBES6VN1A87O.1 size=428426 2024-09-12T17:36:48.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.732+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=SBES6VN1A87O tag=WLKB3UZLN9L1 type=write size=2525578 2024-09-12T17:36:48.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.734+0000 7fa80ca76780 1 < completed write operation key=07LPSZT2RKCC tag=PGHFX9HCG9P0 type=write size=607212 2024-09-12T17:36:48.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.735+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=7YXB5DYJHL6H type=write size=592280 2024-09-12T17:36:48.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.737+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=1OZ4G43UX7JD type=del 2024-09-12T17:36:48.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.739+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~SHU14VAI5WOZ.0 size=1048576 2024-09-12T17:36:48.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.740+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~SHU14VAI5WOZ.1 size=239901 2024-09-12T17:36:48.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.740+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=SHU14VAI5WOZ tag=SP4VDDCB0XID type=write size=2337053 2024-09-12T17:36:48.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.741+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=XUW7BIRUY4UL type=del 2024-09-12T17:36:48.743 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.742+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=Z066LETIBJC9 type=del size=2053924 2024-09-12T17:36:48.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.744+0000 7fa80ca76780 1 < suggested remove operation key=7QHTQ6VHZ34P tag=1KMD2LDAG8FN type=write 2024-09-12T17:36:48.747 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.746+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~4P6ULR8GMNGU.0 size=1048576 2024-09-12T17:36:48.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.747+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~4P6ULR8GMNGU.1 size=906457 2024-09-12T17:36:48.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.747+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=4P6ULR8GMNGU tag=GVABDZLMX84W type=write size=3003609 2024-09-12T17:36:48.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.748+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~C5JXIRJT6H3M.0 size=1048576 2024-09-12T17:36:48.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.749+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~C5JXIRJT6H3M.1 size=1048576 2024-09-12T17:36:48.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.750+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~C5JXIRJT6H3M.2 size=778000 2024-09-12T17:36:48.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.752+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=C5JXIRJT6H3M tag=8RMWLLJ0QO50 type=write size=3923728 2024-09-12T17:36:48.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.755+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~JO6VFE88RUCS.0 size=1048576 2024-09-12T17:36:48.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.755+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~JO6VFE88RUCS.1 size=489453 2024-09-12T17:36:48.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.755+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=JO6VFE88RUCS tag=IL83QHXXCSDZ type=write size=2586605 2024-09-12T17:36:48.758 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.757+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~LDL0XC1V4PG8.0 size=1048576 2024-09-12T17:36:48.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.758+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~LDL0XC1V4PG8.1 size=1048576 2024-09-12T17:36:48.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.758+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~LDL0XC1V4PG8.2 size=738563 2024-09-12T17:36:48.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.760+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=LDL0XC1V4PG8 tag=WFHJCW23K89X type=write size=3884291 2024-09-12T17:36:48.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.763+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~PQ8GP4JDA0WB.0 size=1048576 2024-09-12T17:36:48.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.763+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~PQ8GP4JDA0WB.1 size=1048576 2024-09-12T17:36:48.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.764+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~PQ8GP4JDA0WB.2 size=99826 2024-09-12T17:36:48.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.764+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=PQ8GP4JDA0WB tag=YR4OVCT4YJXA type=write size=3245554 2024-09-12T17:36:48.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.766+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=58FZ64FK2Q48 type=del 2024-09-12T17:36:48.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.767+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=VHP5CX8DY2QO type=del size=1684789 2024-09-12T17:36:48.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.768+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~8UDC4TOHRODH.0 size=1048576 2024-09-12T17:36:48.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.769+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~8UDC4TOHRODH.1 size=963547 2024-09-12T17:36:48.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.771+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=8UDC4TOHRODH tag=LGI978FNUFKW type=write size=3060699 2024-09-12T17:36:48.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.773+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~J3GEV9S089ZZ.0 size=1048576 2024-09-12T17:36:48.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.774+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~J3GEV9S089ZZ.1 size=1048576 2024-09-12T17:36:48.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.775+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~J3GEV9S089ZZ.2 size=727846 2024-09-12T17:36:48.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.775+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=J3GEV9S089ZZ tag=5RNC31CQL0TD type=write size=3873574 2024-09-12T17:36:48.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.776+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~5C4P8G8FY1CX.0 size=1048576 2024-09-12T17:36:48.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.776+0000 7fa80ca76780 1 < canceled part key=_multipart_RC1IX4DQREEP.2~5C4P8G8FY1CX.1 size=420737 2024-09-12T17:36:48.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.778+0000 7fa80ca76780 1 < canceled multipart upload key=RC1IX4DQREEP upload=5C4P8G8FY1CX tag=U9JJ6HQAD7SY type=write size=2517889 2024-09-12T17:36:48.781 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.780+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=HGLM351O77TS type=del size=3221627 2024-09-12T17:36:48.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.782+0000 7fa80ca76780 1 < suggested update operation key=0X3LGXL2QFRN tag=W7FNEYI5GAZU type=write size=907958 2024-09-12T17:36:48.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.784+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=1O59KN992UFM type=del size=1067496 2024-09-12T17:36:48.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.786+0000 7fa80ca76780 1 < suggested remove operation key=EDRL3T2I9AOO tag=MUBJYYMUNW75 type=del 2024-09-12T17:36:48.788 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.787+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=UPHCYKA630HL type=del size=2772270 2024-09-12T17:36:48.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.788+0000 7fa80ca76780 1 < canceled operation key=VC1X03K12V80 tag=4LLXXDGHV544 type=del size=631691 2024-09-12T17:36:48.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.789+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=T2PGFIMUL78G type=del size=1840986 2024-09-12T17:36:48.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.790+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=VVBMEABSGHUY type=del 2024-09-12T17:36:48.793 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.792+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=T05VC54YHK6Z type=del size=3153606 2024-09-12T17:36:48.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.793+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~23MKJIT0YXMX.0 size=423599 2024-09-12T17:36:48.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.796+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=23MKJIT0YXMX tag=3E6EWT2VDA5H type=write size=1472175 2024-09-12T17:36:48.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.797+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=WFN5OE11BUH6 type=write size=399521 2024-09-12T17:36:48.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.798+0000 7fa80ca76780 -1 < failed to complete operation key=EDRL3T2I9AOO tag=JAJI29EHKKI6 type=del size=2658341: (22) Invalid argument 2024-09-12T17:36:48.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.800+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=8WIO48J5CPGB type=del size=308973 2024-09-12T17:36:48.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.801+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~SBES6VN1A87O.0 size=1048576 2024-09-12T17:36:48.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.804+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~SBES6VN1A87O.1 size=428426 2024-09-12T17:36:48.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.808+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=SBES6VN1A87O tag=WLKB3UZLN9L1 type=write size=2525578 2024-09-12T17:36:48.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.809+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=2RYZ0T0F9U6N type=del size=131406 2024-09-12T17:36:48.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.810+0000 7fa80ca76780 1 < completed write operation key=8Z3EPQHMA6M5 tag=7YXB5DYJHL6H type=write size=592280 2024-09-12T17:36:48.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.811+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=WHPR822ID314 type=del size=405171 2024-09-12T17:36:48.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.813+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~SHU14VAI5WOZ.0 size=1048576 2024-09-12T17:36:48.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.814+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~SHU14VAI5WOZ.1 size=239901 2024-09-12T17:36:48.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.816+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=SHU14VAI5WOZ tag=SP4VDDCB0XID type=write size=2337053 2024-09-12T17:36:48.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.818+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~RGE1HSTG9OJ8.0 size=1048576 2024-09-12T17:36:48.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.819+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~RGE1HSTG9OJ8.1 size=317971 2024-09-12T17:36:48.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.819+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=RGE1HSTG9OJ8 tag=NBF4N9FZAVY8 type=write size=2415123 2024-09-12T17:36:48.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.820+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=Z066LETIBJC9 type=del 2024-09-12T17:36:48.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.821+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=32K500TNVE0D type=del size=3263649 2024-09-12T17:36:48.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.822+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~4P6ULR8GMNGU.0 size=1048576 2024-09-12T17:36:48.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.823+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~4P6ULR8GMNGU.1 size=906457 2024-09-12T17:36:48.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.825+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=4P6ULR8GMNGU tag=GVABDZLMX84W type=write size=3003609 2024-09-12T17:36:48.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.827+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~4PD28B8TTOPN.0 size=1048576 2024-09-12T17:36:48.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.828+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~4PD28B8TTOPN.1 size=976938 2024-09-12T17:36:48.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.828+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=4PD28B8TTOPN tag=7WL44YZWNN30 type=write size=3074090 2024-09-12T17:36:48.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.830+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~JO6VFE88RUCS.0 size=1048576 2024-09-12T17:36:48.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.830+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~JO6VFE88RUCS.1 size=489453 2024-09-12T17:36:48.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.832+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=JO6VFE88RUCS tag=IL83QHXXCSDZ type=write size=2586605 2024-09-12T17:36:48.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.834+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=2EZT2Q56N4N4 type=del size=1226073 2024-09-12T17:36:48.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.835+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~PQ8GP4JDA0WB.0 size=1048576 2024-09-12T17:36:48.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.836+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~PQ8GP4JDA0WB.1 size=1048576 2024-09-12T17:36:48.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.837+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~PQ8GP4JDA0WB.2 size=99826 2024-09-12T17:36:48.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.839+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=PQ8GP4JDA0WB tag=YR4OVCT4YJXA type=write size=3245554 2024-09-12T17:36:48.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.840+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=S0QTH2RZNHOY type=del size=3083604 2024-09-12T17:36:48.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.842+0000 7fa80ca76780 1 < suggested update operation key=MSZUYX441Y66 tag=VHP5CX8DY2QO type=del size=1684789 2024-09-12T17:36:48.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.843+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=1UAJM09MMHC1 type=write size=474552 2024-09-12T17:36:48.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.844+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~J3GEV9S089ZZ.0 size=1048576 2024-09-12T17:36:48.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.845+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~J3GEV9S089ZZ.1 size=1048576 2024-09-12T17:36:48.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.846+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~J3GEV9S089ZZ.2 size=727846 2024-09-12T17:36:48.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.848+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=J3GEV9S089ZZ tag=5RNC31CQL0TD type=write size=3873574 2024-09-12T17:36:48.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.850+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~ZP03417QIPIB.0 size=163120 2024-09-12T17:36:48.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.850+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=ZP03417QIPIB tag=PB7URBJI2IY5 type=write size=1211696 2024-09-12T17:36:48.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.852+0000 7fa80ca76780 -1 < failed to complete operation key=EDRL3T2I9AOO tag=HGLM351O77TS type=del size=3221627: (22) Invalid argument 2024-09-12T17:36:48.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.853+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=Q8VFQVANCVDR type=del size=1304990 2024-09-12T17:36:48.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.854+0000 7fa80ca76780 1 < canceled operation key=2AGKLZ3PQ2FD tag=1O59KN992UFM type=del size=1067496 2024-09-12T17:36:48.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.856+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~RBO9KLCY21NG.0 size=1048576 2024-09-12T17:36:48.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.857+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~RBO9KLCY21NG.1 size=1048576 2024-09-12T17:36:48.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.858+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~RBO9KLCY21NG.2 size=414777 2024-09-12T17:36:48.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.858+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=RBO9KLCY21NG tag=O2FP9THFHZ5R type=write size=3560505 2024-09-12T17:36:48.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.859+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=UPHCYKA630HL type=del 2024-09-12T17:36:48.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.861+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~IS59ZFYACZZT.0 size=313893 2024-09-12T17:36:48.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.861+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=IS59ZFYACZZT tag=YJS14EH6V0PA type=write size=1362469 2024-09-12T17:36:48.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.863+0000 7fa80ca76780 -1 < failed to complete operation key=MSZUYX441Y66 tag=T2PGFIMUL78G type=del size=1840986: (22) Invalid argument 2024-09-12T17:36:48.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.864+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=BW37JEHBRHMU type=del size=3959837 2024-09-12T17:36:48.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.865+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=T05VC54YHK6Z type=del 2024-09-12T17:36:48.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.867+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~2CD62FQC5UK1.0 size=1048576 2024-09-12T17:36:48.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.868+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~2CD62FQC5UK1.1 size=904076 2024-09-12T17:36:48.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.868+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=2CD62FQC5UK1 tag=WZBZIJHJVGDE type=write size=3001228 2024-09-12T17:36:48.870 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.869+0000 7fa80ca76780 1 < completed write operation key=WGL9JYJXSHBH tag=WFN5OE11BUH6 type=write size=399521 2024-09-12T17:36:48.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.871+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=E1KE1GA1V601 type=del size=3066611 2024-09-12T17:36:48.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.873+0000 7fa80ca76780 1 < suggested remove operation key=RC1IX4DQREEP tag=8WIO48J5CPGB type=del 2024-09-12T17:36:48.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.874+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=RNDE0B0ES7YR type=del size=1295814 2024-09-12T17:36:48.876 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.875+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=2RYZ0T0F9U6N type=del 2024-09-12T17:36:48.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.877+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=K2FIHMFE7JCV type=del size=360829 2024-09-12T17:36:48.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.878+0000 7fa80ca76780 1 < canceled operation key=GKE6623N268Z tag=WHPR822ID314 type=del size=405171 2024-09-12T17:36:48.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.880+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~W94IZJU71AWX.0 size=1048576 2024-09-12T17:36:48.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.881+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~W94IZJU71AWX.1 size=262523 2024-09-12T17:36:48.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.881+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=W94IZJU71AWX tag=8OTI3H46T0DF type=write size=2359675 2024-09-12T17:36:48.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.882+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~RGE1HSTG9OJ8.0 size=1048576 2024-09-12T17:36:48.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.883+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~RGE1HSTG9OJ8.1 size=317971 2024-09-12T17:36:48.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.885+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=RGE1HSTG9OJ8 tag=NBF4N9FZAVY8 type=write size=2415123 2024-09-12T17:36:48.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.887+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~EFBZY119LCTS.0 size=338280 2024-09-12T17:36:48.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.887+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=EFBZY119LCTS tag=G78RTXENK2G3 type=write size=1386856 2024-09-12T17:36:48.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.888+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=32K500TNVE0D type=del 2024-09-12T17:36:48.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.889+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=NG0VY1FN0VPF type=write size=752535 2024-09-12T17:36:48.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.891+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~4PD28B8TTOPN.0 size=1048576 2024-09-12T17:36:48.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.892+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~4PD28B8TTOPN.1 size=976938 2024-09-12T17:36:48.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.893+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=4PD28B8TTOPN tag=7WL44YZWNN30 type=write size=3074090 2024-09-12T17:36:48.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.896+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=Y4BL9NW5MZOE type=del size=2494111 2024-09-12T17:36:48.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.897+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=2EZT2Q56N4N4 type=del 2024-09-12T17:36:48.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.899+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~0E0HBG20Z8UL.0 size=1048576 2024-09-12T17:36:48.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.900+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~0E0HBG20Z8UL.1 size=1048576 2024-09-12T17:36:48.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.901+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~0E0HBG20Z8UL.2 size=1043320 2024-09-12T17:36:48.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.901+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=0E0HBG20Z8UL tag=YTA472N3IYFF type=write size=4189048 2024-09-12T17:36:48.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.903+0000 7fa80ca76780 1 < suggested update operation key=54KWSI77T73A tag=S0QTH2RZNHOY type=del size=3083604 2024-09-12T17:36:48.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.904+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=ZDNF7HV2KJL5 type=write size=128624 2024-09-12T17:36:48.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.905+0000 7fa80ca76780 -1 < failed to complete operation key=RC1IX4DQREEP tag=1UAJM09MMHC1 type=write size=474552: (22) Invalid argument 2024-09-12T17:36:48.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.907+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~PES32VYIW6MS.0 size=1048576 2024-09-12T17:36:48.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.908+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~PES32VYIW6MS.1 size=1048576 2024-09-12T17:36:48.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.909+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~PES32VYIW6MS.2 size=333556 2024-09-12T17:36:48.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.909+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=PES32VYIW6MS tag=71GSYK67CDL6 type=write size=3479284 2024-09-12T17:36:48.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.910+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~ZP03417QIPIB.0 size=163120 2024-09-12T17:36:48.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.912+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=ZP03417QIPIB tag=PB7URBJI2IY5 type=write size=1211696 2024-09-12T17:36:48.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.914+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~0OJYZYNCAU6H.0 size=915990 2024-09-12T17:36:48.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.914+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=0OJYZYNCAU6H tag=YRX0TEZI5CAW type=write size=1964566 2024-09-12T17:36:48.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.915+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=Q8VFQVANCVDR type=del 2024-09-12T17:36:48.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.916+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=R40V33BSB6KG type=write size=282264 2024-09-12T17:36:48.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.918+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~RBO9KLCY21NG.0 size=1048576 2024-09-12T17:36:48.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.919+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~RBO9KLCY21NG.1 size=1048576 2024-09-12T17:36:48.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.920+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~RBO9KLCY21NG.2 size=414777 2024-09-12T17:36:48.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.921+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=RBO9KLCY21NG tag=O2FP9THFHZ5R type=write size=3560505 2024-09-12T17:36:48.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.923+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=QO12T8WEF9BC type=write size=828137 2024-09-12T17:36:48.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.924+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~IS59ZFYACZZT.0 size=313893 2024-09-12T17:36:48.927 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.926+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=IS59ZFYACZZT tag=YJS14EH6V0PA type=write size=1362469 2024-09-12T17:36:48.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.928+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~TW2K0LRMLZS8.0 size=1048576 2024-09-12T17:36:48.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.929+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~TW2K0LRMLZS8.1 size=747222 2024-09-12T17:36:48.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.929+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=TW2K0LRMLZS8 tag=Z8P4TSROJNZP type=write size=2844374 2024-09-12T17:36:48.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.930+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=BW37JEHBRHMU type=del 2024-09-12T17:36:48.932 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.931+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=9CGLWRKEDUIU type=del size=2374121 2024-09-12T17:36:48.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.932+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~2CD62FQC5UK1.0 size=1048576 2024-09-12T17:36:48.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.933+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~2CD62FQC5UK1.1 size=904076 2024-09-12T17:36:48.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.935+0000 7fa80ca76780 1 < completed multipart upload key=07LPSZT2RKCC upload=2CD62FQC5UK1 tag=WZBZIJHJVGDE type=write size=3001228 2024-09-12T17:36:48.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.936+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~BPCME2BQWI0K.0 size=1048576 2024-09-12T17:36:48.938 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.937+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~BPCME2BQWI0K.1 size=40034 2024-09-12T17:36:48.938 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.937+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=BPCME2BQWI0K tag=9F36QBR0Z15O type=write size=2137186 2024-09-12T17:36:48.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.939+0000 7fa80ca76780 1 < suggested update operation key=94801LE91HZ9 tag=E1KE1GA1V601 type=del size=3066611 2024-09-12T17:36:48.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.941+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~M2OL15J8K0XV.0 size=1048576 2024-09-12T17:36:48.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.942+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~M2OL15J8K0XV.1 size=1048576 2024-09-12T17:36:48.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.943+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~M2OL15J8K0XV.2 size=604608 2024-09-12T17:36:48.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.943+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=M2OL15J8K0XV tag=5MZ55BUAS4DQ type=write size=3750336 2024-09-12T17:36:48.945 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.944+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=RNDE0B0ES7YR type=del 2024-09-12T17:36:48.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.946+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~SIZFI7I5T5A9.0 size=902233 2024-09-12T17:36:48.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.946+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=SIZFI7I5T5A9 tag=0SPX8FMAU0H5 type=write size=1950809 2024-09-12T17:36:48.949 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.948+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=K2FIHMFE7JCV type=del 2024-09-12T17:36:48.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.949+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=9V4J41X4YUPV type=del size=3575339 2024-09-12T17:36:48.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.950+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~W94IZJU71AWX.0 size=1048576 2024-09-12T17:36:48.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.951+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~W94IZJU71AWX.1 size=262523 2024-09-12T17:36:48.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.953+0000 7fa80ca76780 1 < completed multipart upload key=U8O04HYQZRJC upload=W94IZJU71AWX tag=8OTI3H46T0DF type=write size=2359675 2024-09-12T17:36:48.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.954+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=5P5Y59EIJ31W type=del size=2755249 2024-09-12T17:36:48.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.955+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~EFBZY119LCTS.0 size=338280 2024-09-12T17:36:48.958 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.957+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=EFBZY119LCTS tag=G78RTXENK2G3 type=write size=1386856 2024-09-12T17:36:48.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.958+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=3OR4VIAY6Y82 type=write size=844049 2024-09-12T17:36:48.961 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.959+0000 7fa80ca76780 1 < completed write operation key=Z81704G91EPL tag=NG0VY1FN0VPF type=write size=752535 2024-09-12T17:36:48.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.961+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=OHMN213ND05F type=del size=2891373 2024-09-12T17:36:48.963 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.962+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=Y4BL9NW5MZOE type=del 2024-09-12T17:36:48.964 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.963+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=2CUGW2VANLFP type=del size=1041036 2024-09-12T17:36:48.966 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.965+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~0E0HBG20Z8UL.0 size=1048576 2024-09-12T17:36:48.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.966+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~0E0HBG20Z8UL.1 size=1048576 2024-09-12T17:36:48.968 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.967+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~0E0HBG20Z8UL.2 size=1043320 2024-09-12T17:36:48.971 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.970+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=0E0HBG20Z8UL tag=YTA472N3IYFF type=write size=4189048 2024-09-12T17:36:48.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.971+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=F0V70QHSMDH5 type=del size=2460413 2024-09-12T17:36:48.973 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.972+0000 7fa80ca76780 1 < completed write operation key=DYZIHCBF3D8U tag=ZDNF7HV2KJL5 type=write size=128624 2024-09-12T17:36:48.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.975+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~M2BNI6YMPA48.0 size=929860 2024-09-12T17:36:48.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.975+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=M2BNI6YMPA48 tag=KTBYB7BABAP5 type=write size=1978436 2024-09-12T17:36:48.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.976+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~PES32VYIW6MS.0 size=1048576 2024-09-12T17:36:48.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.976+0000 7fa80ca76780 1 < canceled part key=_multipart_54KWSI77T73A.2~PES32VYIW6MS.1 size=1048576 2024-09-12T17:36:48.978 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.977+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~PES32VYIW6MS.2 size=333556 2024-09-12T17:36:48.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.979+0000 7fa80ca76780 1 < canceled multipart upload key=54KWSI77T73A upload=PES32VYIW6MS tag=71GSYK67CDL6 type=write size=3479284 2024-09-12T17:36:48.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.981+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~4O4GAZ6A4STG.0 size=1048576 2024-09-12T17:36:48.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.982+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~4O4GAZ6A4STG.1 size=1048576 2024-09-12T17:36:48.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.983+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~4O4GAZ6A4STG.2 size=908216 2024-09-12T17:36:48.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.983+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=4O4GAZ6A4STG tag=PHW00X3HYU58 type=write size=4053944 2024-09-12T17:36:48.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.984+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~0OJYZYNCAU6H.0 size=915990 2024-09-12T17:36:48.990 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.989+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=0OJYZYNCAU6H tag=YRX0TEZI5CAW type=write size=1964566 2024-09-12T17:36:48.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.991+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=3CJOC8WGHC7X type=del size=904684 2024-09-12T17:36:48.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.992+0000 7fa80ca76780 1 < canceled operation key=OJPZAWR5BLBN tag=R40V33BSB6KG type=write size=282264 2024-09-12T17:36:48.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.994+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=CCFJ2V5SY7W0 type=write size=890922 2024-09-12T17:36:48.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.995+0000 7fa80ca76780 1 < canceled operation key=8Z3EPQHMA6M5 tag=QO12T8WEF9BC type=write size=828137 2024-09-12T17:36:48.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.997+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~BUCXVNROHFVW.0 size=1048576 2024-09-12T17:36:49.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.998+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~BUCXVNROHFVW.1 size=32067 2024-09-12T17:36:49.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:48.998+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=BUCXVNROHFVW tag=1AOJKAHO2MU4 type=write size=2129219 2024-09-12T17:36:49.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.000+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~TW2K0LRMLZS8.0 size=1048576 2024-09-12T17:36:49.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.001+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~TW2K0LRMLZS8.1 size=747222 2024-09-12T17:36:49.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.003+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=TW2K0LRMLZS8 tag=Z8P4TSROJNZP type=write size=2844374 2024-09-12T17:36:49.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.005+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~Z1RNZ78E9M5O.0 size=1048576 2024-09-12T17:36:49.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.006+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~Z1RNZ78E9M5O.1 size=279877 2024-09-12T17:36:49.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.006+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=Z1RNZ78E9M5O tag=IUCDECSCW869 type=write size=2377029 2024-09-12T17:36:49.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.008+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=9CGLWRKEDUIU type=del 2024-09-12T17:36:49.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.010+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=Y5BU7JUPILSH type=del size=2365479 2024-09-12T17:36:49.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.011+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~BPCME2BQWI0K.0 size=1048576 2024-09-12T17:36:49.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.012+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~BPCME2BQWI0K.1 size=40034 2024-09-12T17:36:49.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.014+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=BPCME2BQWI0K tag=9F36QBR0Z15O type=write size=2137186 2024-09-12T17:36:49.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.015+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=RMEPEQ0FDIX3 type=write size=351088 2024-09-12T17:36:49.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.015+0000 7fa80ca76780 1 < canceled part key=_multipart_R02234GEWV6B.2~M2OL15J8K0XV.0 size=1048576 2024-09-12T17:36:49.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.015+0000 7fa80ca76780 1 < canceled part key=_multipart_R02234GEWV6B.2~M2OL15J8K0XV.1 size=1048576 2024-09-12T17:36:49.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.016+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~M2OL15J8K0XV.2 size=604608 2024-09-12T17:36:49.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.018+0000 7fa80ca76780 1 < canceled multipart upload key=R02234GEWV6B upload=M2OL15J8K0XV tag=5MZ55BUAS4DQ type=write size=3750336 2024-09-12T17:36:49.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.020+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~U1W7X3FLV11A.0 size=1048576 2024-09-12T17:36:49.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.021+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~U1W7X3FLV11A.1 size=1048576 2024-09-12T17:36:49.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.022+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~U1W7X3FLV11A.2 size=399947 2024-09-12T17:36:49.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.022+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=U1W7X3FLV11A tag=7ZBS670OYB7O type=write size=3545675 2024-09-12T17:36:49.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.024+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~SIZFI7I5T5A9.0 size=902233 2024-09-12T17:36:49.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.025+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=SIZFI7I5T5A9 tag=0SPX8FMAU0H5 type=write size=1950809 2024-09-12T17:36:49.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.027+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=F5G1LOUIVRYY type=del size=3411437 2024-09-12T17:36:49.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.029+0000 7fa80ca76780 1 < suggested remove operation key=8Z3EPQHMA6M5 tag=9V4J41X4YUPV type=del 2024-09-12T17:36:49.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.031+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~YTWFO4SSAL6B.0 size=1048576 2024-09-12T17:36:49.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.032+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~YTWFO4SSAL6B.1 size=855586 2024-09-12T17:36:49.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.032+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=YTWFO4SSAL6B tag=C0C7YXU6LR63 type=write size=2952738 2024-09-12T17:36:49.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.033+0000 7fa80ca76780 1 < completed delete operation key=0X3LGXL2QFRN tag=5P5Y59EIJ31W type=del 2024-09-12T17:36:49.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.035+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~8H09WHG2Z3I3.0 size=1048576 2024-09-12T17:36:49.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.036+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~8H09WHG2Z3I3.1 size=433510 2024-09-12T17:36:49.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.036+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=8H09WHG2Z3I3 tag=JE9KTVDGGSAV type=write size=2530662 2024-09-12T17:36:49.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.037+0000 7fa80ca76780 1 < completed write operation key=OJPZAWR5BLBN tag=3OR4VIAY6Y82 type=write size=844049 2024-09-12T17:36:49.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.040+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~J0U9FQZPM1SC.0 size=1048576 2024-09-12T17:36:49.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.041+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~J0U9FQZPM1SC.1 size=1048576 2024-09-12T17:36:49.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.042+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~J0U9FQZPM1SC.2 size=148944 2024-09-12T17:36:49.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.042+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=J0U9FQZPM1SC tag=H1TMGW9TEQOP type=write size=3294672 2024-09-12T17:36:49.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.044+0000 7fa80ca76780 1 < suggested remove operation key=07LPSZT2RKCC tag=OHMN213ND05F type=del 2024-09-12T17:36:49.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.046+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~V5T1LY22TCQG.0 size=1048576 2024-09-12T17:36:49.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.047+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~V5T1LY22TCQG.1 size=414538 2024-09-12T17:36:49.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.047+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=V5T1LY22TCQG tag=UZMYJR69U3IB type=write size=2511690 2024-09-12T17:36:49.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.048+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=2CUGW2VANLFP type=del 2024-09-12T17:36:49.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.049+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=B4YPPR0N6VFC type=write size=430282 2024-09-12T17:36:49.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.051+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=F0V70QHSMDH5 type=del 2024-09-12T17:36:49.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.052+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=W1RD6VJLMSB7 type=write size=795268 2024-09-12T17:36:49.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.053+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~M2BNI6YMPA48.0 size=929860 2024-09-12T17:36:49.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.055+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=M2BNI6YMPA48 tag=KTBYB7BABAP5 type=write size=1978436 2024-09-12T17:36:49.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.056+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=ZLL4CEST4RNG type=del size=1676699 2024-09-12T17:36:49.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.058+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~4O4GAZ6A4STG.0 size=1048576 2024-09-12T17:36:49.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.059+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~4O4GAZ6A4STG.1 size=1048576 2024-09-12T17:36:49.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.059+0000 7fa80ca76780 1 < canceled part key=_multipart_VC1X03K12V80.2~4O4GAZ6A4STG.2 size=908216 2024-09-12T17:36:49.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.061+0000 7fa80ca76780 1 < canceled multipart upload key=VC1X03K12V80 upload=4O4GAZ6A4STG tag=PHW00X3HYU58 type=write size=4053944 2024-09-12T17:36:49.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.062+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=OI83BBW10CTP type=del size=676482 2024-09-12T17:36:49.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.063+0000 7fa80ca76780 -1 < failed to complete operation key=8Z3EPQHMA6M5 tag=3CJOC8WGHC7X type=del size=904684: (22) Invalid argument 2024-09-12T17:36:49.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.066+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~N06J857HS1WW.0 size=1048576 2024-09-12T17:36:49.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.066+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~N06J857HS1WW.1 size=1048576 2024-09-12T17:36:49.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.067+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~N06J857HS1WW.2 size=971026 2024-09-12T17:36:49.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.067+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=N06J857HS1WW tag=OANZV0HEJC4F type=write size=4116754 2024-09-12T17:36:49.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.069+0000 7fa80ca76780 1 < canceled operation key=WGL9JYJXSHBH tag=CCFJ2V5SY7W0 type=write size=890922 2024-09-12T17:36:49.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.071+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~31R0T6QPWH8P.0 size=1048576 2024-09-12T17:36:49.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.072+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~31R0T6QPWH8P.1 size=1048576 2024-09-12T17:36:49.074 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.073+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~31R0T6QPWH8P.2 size=989571 2024-09-12T17:36:49.074 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.073+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=31R0T6QPWH8P tag=1C1Z0T54HJSD type=write size=4135299 2024-09-12T17:36:49.075 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.074+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~BUCXVNROHFVW.0 size=1048576 2024-09-12T17:36:49.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.075+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~BUCXVNROHFVW.1 size=32067 2024-09-12T17:36:49.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.077+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=BUCXVNROHFVW tag=1AOJKAHO2MU4 type=write size=2129219 2024-09-12T17:36:49.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.078+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=AGYQZTBU496E type=del size=867810 2024-09-12T17:36:49.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.079+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~Z1RNZ78E9M5O.0 size=1048576 2024-09-12T17:36:49.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.080+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~Z1RNZ78E9M5O.1 size=279877 2024-09-12T17:36:49.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.082+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=Z1RNZ78E9M5O tag=IUCDECSCW869 type=write size=2377029 2024-09-12T17:36:49.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.084+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~KSUB6ZS0ZL1P.0 size=16369 2024-09-12T17:36:49.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.084+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=KSUB6ZS0ZL1P tag=0N5VFIABW5P4 type=write size=1064945 2024-09-12T17:36:49.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.085+0000 7fa80ca76780 1 < canceled operation key=VDD4PDR1GLWQ tag=Y5BU7JUPILSH type=del size=2365479 2024-09-12T17:36:49.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.086+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=5631H8YBY14I type=del size=2435995 2024-09-12T17:36:49.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.089+0000 7fa80ca76780 1 < suggested remove operation key=E25BUY271ZSI tag=RMEPEQ0FDIX3 type=write 2024-09-12T17:36:49.091 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.090+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=ZYWO69H8Z6JU type=write size=657479 2024-09-12T17:36:49.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.091+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~U1W7X3FLV11A.0 size=1048576 2024-09-12T17:36:49.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.093+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~U1W7X3FLV11A.1 size=1048576 2024-09-12T17:36:49.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.094+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~U1W7X3FLV11A.2 size=399947 2024-09-12T17:36:49.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.096+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=U1W7X3FLV11A tag=7ZBS670OYB7O type=write size=3545675 2024-09-12T17:36:49.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.097+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=0BFXNJOU1EPV type=del size=2866456 2024-09-12T17:36:49.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.098+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=F5G1LOUIVRYY type=del 2024-09-12T17:36:49.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.100+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=C1AODOOZBIJH type=del size=2241221 2024-09-12T17:36:49.102 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.101+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~YTWFO4SSAL6B.0 size=1048576 2024-09-12T17:36:49.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.102+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~YTWFO4SSAL6B.1 size=855586 2024-09-12T17:36:49.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.104+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=YTWFO4SSAL6B tag=C0C7YXU6LR63 type=write size=2952738 2024-09-12T17:36:49.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.106+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~HUIKTND07H4I.0 size=386397 2024-09-12T17:36:49.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.106+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=HUIKTND07H4I tag=1SF83BRTGVY7 type=write size=1434973 2024-09-12T17:36:49.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.107+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~8H09WHG2Z3I3.0 size=1048576 2024-09-12T17:36:49.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.107+0000 7fa80ca76780 1 < canceled part key=_multipart_8Z3EPQHMA6M5.2~8H09WHG2Z3I3.1 size=433510 2024-09-12T17:36:49.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.109+0000 7fa80ca76780 1 < canceled multipart upload key=8Z3EPQHMA6M5 upload=8H09WHG2Z3I3 tag=JE9KTVDGGSAV type=write size=2530662 2024-09-12T17:36:49.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.111+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~BEBTQKU1QQID.0 size=1048576 2024-09-12T17:36:49.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.111+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~BEBTQKU1QQID.1 size=1048576 2024-09-12T17:36:49.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.112+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~BEBTQKU1QQID.2 size=359462 2024-09-12T17:36:49.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.112+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=BEBTQKU1QQID tag=M99VIVTZQ1BL type=write size=3505190 2024-09-12T17:36:49.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.114+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~J0U9FQZPM1SC.0 size=1048576 2024-09-12T17:36:49.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.115+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~J0U9FQZPM1SC.1 size=1048576 2024-09-12T17:36:49.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.116+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~J0U9FQZPM1SC.2 size=148944 2024-09-12T17:36:49.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.118+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=J0U9FQZPM1SC tag=H1TMGW9TEQOP type=write size=3294672 2024-09-12T17:36:49.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.119+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=I70B6HE3BDXZ type=del size=2714705 2024-09-12T17:36:49.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.121+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~V5T1LY22TCQG.0 size=1048576 2024-09-12T17:36:49.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.121+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~V5T1LY22TCQG.1 size=414538 2024-09-12T17:36:49.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.123+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=V5T1LY22TCQG tag=UZMYJR69U3IB type=write size=2511690 2024-09-12T17:36:49.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.125+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~PIQ83MK6V6IM.0 size=1048576 2024-09-12T17:36:49.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.126+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~PIQ83MK6V6IM.1 size=1048576 2024-09-12T17:36:49.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.127+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~PIQ83MK6V6IM.2 size=42322 2024-09-12T17:36:49.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.127+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=PIQ83MK6V6IM tag=77N854QZFRSG type=write size=3188050 2024-09-12T17:36:49.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.128+0000 7fa80ca76780 1 < completed write operation key=U8O04HYQZRJC tag=B4YPPR0N6VFC type=write size=430282 2024-09-12T17:36:49.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.131+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~W1R5IK13QD91.0 size=555562 2024-09-12T17:36:49.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.131+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=W1R5IK13QD91 tag=G88JG0I0JUF1 type=write size=1604138 2024-09-12T17:36:49.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.132+0000 7fa80ca76780 1 < completed write operation key=RC1IX4DQREEP tag=W1RD6VJLMSB7 type=write size=795268 2024-09-12T17:36:49.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.133+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=RONUFFQIJMWO type=del size=1515769 2024-09-12T17:36:49.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.134+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=ZLL4CEST4RNG type=del 2024-09-12T17:36:49.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.136+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~EQ8QMRIAI49C.0 size=1048576 2024-09-12T17:36:49.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.137+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~EQ8QMRIAI49C.1 size=1048576 2024-09-12T17:36:49.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.138+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~EQ8QMRIAI49C.2 size=712351 2024-09-12T17:36:49.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.138+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=EQ8QMRIAI49C tag=S01QQR4YPJT8 type=write size=3858079 2024-09-12T17:36:49.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.139+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=OI83BBW10CTP type=del 2024-09-12T17:36:49.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.141+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~7WQMODAUCQP4.0 size=577043 2024-09-12T17:36:49.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.141+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=7WQMODAUCQP4 tag=NK65E9JEIBSQ type=write size=1625619 2024-09-12T17:36:49.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.142+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~N06J857HS1WW.0 size=1048576 2024-09-12T17:36:49.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.143+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~N06J857HS1WW.1 size=1048576 2024-09-12T17:36:49.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.144+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~N06J857HS1WW.2 size=971026 2024-09-12T17:36:49.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.146+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=N06J857HS1WW tag=OANZV0HEJC4F type=write size=4116754 2024-09-12T17:36:49.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.147+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=CZYY9ZCFMRB3 type=del size=3967715 2024-09-12T17:36:49.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.149+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~31R0T6QPWH8P.0 size=1048576 2024-09-12T17:36:49.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.150+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~31R0T6QPWH8P.1 size=1048576 2024-09-12T17:36:49.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.151+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~31R0T6QPWH8P.2 size=989571 2024-09-12T17:36:49.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.154+0000 7fa80ca76780 1 < completed multipart upload key=U8O04HYQZRJC upload=31R0T6QPWH8P tag=1C1Z0T54HJSD type=write size=4135299 2024-09-12T17:36:49.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.155+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=2FDSQI5HA8TH type=del size=1592258 2024-09-12T17:36:49.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.156+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=AGYQZTBU496E type=del 2024-09-12T17:36:49.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.157+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=QPNAE72P6YHK type=del size=1662106 2024-09-12T17:36:49.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.158+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~KSUB6ZS0ZL1P.0 size=16369 2024-09-12T17:36:49.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.160+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=KSUB6ZS0ZL1P tag=0N5VFIABW5P4 type=write size=1064945 2024-09-12T17:36:49.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.162+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=4WPP5SNM5OUL type=del size=901195 2024-09-12T17:36:49.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.164+0000 7fa80ca76780 1 < suggested update operation key=94801LE91HZ9 tag=5631H8YBY14I type=del size=2435995 2024-09-12T17:36:49.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.165+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=KMW79GU2H1UE type=del size=3466086 2024-09-12T17:36:49.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.166+0000 7fa80ca76780 1 < completed write operation key=FKK4IGD1436I tag=ZYWO69H8Z6JU type=write size=657479 2024-09-12T17:36:49.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.169+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~H3GTB2I4TF3R.0 size=1048576 2024-09-12T17:36:49.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.170+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~H3GTB2I4TF3R.1 size=1048576 2024-09-12T17:36:49.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.171+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~H3GTB2I4TF3R.2 size=364178 2024-09-12T17:36:49.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.171+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=H3GTB2I4TF3R tag=KJOJDZ4NRCY7 type=write size=3509906 2024-09-12T17:36:49.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.172+0000 7fa80ca76780 1 < canceled operation key=RC1IX4DQREEP tag=0BFXNJOU1EPV type=del size=2866456 2024-09-12T17:36:49.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.173+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=7YXXL3XYGQM7 type=write size=43388 2024-09-12T17:36:49.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.174+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=C1AODOOZBIJH type=del 2024-09-12T17:36:49.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.176+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=2DF7E11U3ZNF type=del size=1069731 2024-09-12T17:36:49.178 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.177+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~HUIKTND07H4I.0 size=386397 2024-09-12T17:36:49.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.179+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=HUIKTND07H4I tag=1SF83BRTGVY7 type=write size=1434973 2024-09-12T17:36:49.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.180+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=LY3FB38KS7JB type=del size=3907161 2024-09-12T17:36:49.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.181+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~BEBTQKU1QQID.0 size=1048576 2024-09-12T17:36:49.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.182+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~BEBTQKU1QQID.1 size=1048576 2024-09-12T17:36:49.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.183+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~BEBTQKU1QQID.2 size=359462 2024-09-12T17:36:49.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.186+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=BEBTQKU1QQID tag=M99VIVTZQ1BL type=write size=3505190 2024-09-12T17:36:49.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.188+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~NWFHHXXD7TZZ.0 size=1048576 2024-09-12T17:36:49.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.189+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~NWFHHXXD7TZZ.1 size=371807 2024-09-12T17:36:49.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.189+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=NWFHHXXD7TZZ tag=Q42GQPTNMWGT type=write size=2468959 2024-09-12T17:36:49.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.190+0000 7fa80ca76780 1 < canceled operation key=VC1X03K12V80 tag=I70B6HE3BDXZ type=del size=2714705 2024-09-12T17:36:49.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.192+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=CTXWQAPA0ACY type=del size=3267412 2024-09-12T17:36:49.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.193+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~PIQ83MK6V6IM.0 size=1048576 2024-09-12T17:36:49.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.194+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~PIQ83MK6V6IM.1 size=1048576 2024-09-12T17:36:49.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.195+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~PIQ83MK6V6IM.2 size=42322 2024-09-12T17:36:49.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.197+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=PIQ83MK6V6IM tag=77N854QZFRSG type=write size=3188050 2024-09-12T17:36:49.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.200+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~30QLVP62LQVZ.0 size=1048576 2024-09-12T17:36:49.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.201+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~30QLVP62LQVZ.1 size=1048576 2024-09-12T17:36:49.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.202+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~30QLVP62LQVZ.2 size=921080 2024-09-12T17:36:49.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.202+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=30QLVP62LQVZ tag=2JR2LS7TY5NS type=write size=4066808 2024-09-12T17:36:49.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.203+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~W1R5IK13QD91.0 size=555562 2024-09-12T17:36:49.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.205+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=W1R5IK13QD91 tag=G88JG0I0JUF1 type=write size=1604138 2024-09-12T17:36:49.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.206+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=9L9J8UQRBU37 type=write size=601457 2024-09-12T17:36:49.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.208+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=RONUFFQIJMWO type=del 2024-09-12T17:36:49.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.210+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~3XUAOUCQ1FOW.0 size=1048576 2024-09-12T17:36:49.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.211+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~3XUAOUCQ1FOW.1 size=129767 2024-09-12T17:36:49.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.211+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=3XUAOUCQ1FOW tag=GPLLGABJ7XB5 type=write size=2226919 2024-09-12T17:36:49.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.211+0000 7fa80ca76780 1 < canceled part key=_multipart_R871XU2TDWID.2~EQ8QMRIAI49C.0 size=1048576 2024-09-12T17:36:49.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.212+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~EQ8QMRIAI49C.1 size=1048576 2024-09-12T17:36:49.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.212+0000 7fa80ca76780 1 < canceled part key=_multipart_R871XU2TDWID.2~EQ8QMRIAI49C.2 size=712351 2024-09-12T17:36:49.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.214+0000 7fa80ca76780 1 < canceled multipart upload key=R871XU2TDWID upload=EQ8QMRIAI49C tag=S01QQR4YPJT8 type=write size=3858079 2024-09-12T17:36:49.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.216+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~N3V343KA9K5T.0 size=1048576 2024-09-12T17:36:49.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.217+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~N3V343KA9K5T.1 size=1048576 2024-09-12T17:36:49.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.218+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~N3V343KA9K5T.2 size=892471 2024-09-12T17:36:49.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.218+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=N3V343KA9K5T tag=UZU2OSLAWZ7J type=write size=4038199 2024-09-12T17:36:49.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.219+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~7WQMODAUCQP4.0 size=577043 2024-09-12T17:36:49.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.221+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=7WQMODAUCQP4 tag=NK65E9JEIBSQ type=write size=1625619 2024-09-12T17:36:49.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.223+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~0A1T5X612TTC.0 size=83959 2024-09-12T17:36:49.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.223+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=0A1T5X612TTC tag=Q7NNXZPBEFDS type=write size=1132535 2024-09-12T17:36:49.225 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.225+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=CZYY9ZCFMRB3 type=del 2024-09-12T17:36:49.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.226+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=3YAC3IAFLY39 type=del size=2414716 2024-09-12T17:36:49.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.229+0000 7fa80ca76780 1 < suggested update operation key=54KWSI77T73A tag=2FDSQI5HA8TH type=del size=1592258 2024-09-12T17:36:49.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.233+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~K4BPZX3AYIT9.0 size=596112 2024-09-12T17:36:49.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.233+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=K4BPZX3AYIT9 tag=AUZKGCB42HSH type=write size=1644688 2024-09-12T17:36:49.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.235+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=QPNAE72P6YHK type=del 2024-09-12T17:36:49.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.237+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~PU3TILOX26AJ.0 size=1048576 2024-09-12T17:36:49.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.238+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~PU3TILOX26AJ.1 size=117775 2024-09-12T17:36:49.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.238+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=PU3TILOX26AJ tag=VIF1TCWGA5JR type=write size=2214927 2024-09-12T17:36:49.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.239+0000 7fa80ca76780 1 < canceled operation key=MSZUYX441Y66 tag=4WPP5SNM5OUL type=del size=901195 2024-09-12T17:36:49.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.240+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=N9ZSRC80W4J0 type=del size=1048435 2024-09-12T17:36:49.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.241+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=KMW79GU2H1UE type=del 2024-09-12T17:36:49.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.242+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=ROPXMO8MV27B type=del size=400450 2024-09-12T17:36:49.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.244+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~H3GTB2I4TF3R.0 size=1048576 2024-09-12T17:36:49.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.245+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~H3GTB2I4TF3R.1 size=1048576 2024-09-12T17:36:49.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.246+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~H3GTB2I4TF3R.2 size=364178 2024-09-12T17:36:49.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.248+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=H3GTB2I4TF3R tag=KJOJDZ4NRCY7 type=write size=3509906 2024-09-12T17:36:49.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.249+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=LGOWI2AI1L0I type=del size=3654859 2024-09-12T17:36:49.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.252+0000 7fa80ca76780 1 < completed write operation key=MSZUYX441Y66 tag=7YXXL3XYGQM7 type=write size=43388 2024-09-12T17:36:49.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.253+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=7Y9JJRNKBOY5 type=del size=1194488 2024-09-12T17:36:49.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.255+0000 7fa80ca76780 1 < canceled operation key=5CAG55DQEF3Y tag=2DF7E11U3ZNF type=del size=1069731 2024-09-12T17:36:49.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.256+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=9FSKRUWU57ZX type=del size=1168377 2024-09-12T17:36:49.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.257+0000 7fa80ca76780 -1 < failed to complete operation key=54KWSI77T73A tag=LY3FB38KS7JB type=del size=3907161: (22) Invalid argument 2024-09-12T17:36:49.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.258+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=F3BC9ABG2L14 type=del size=86913 2024-09-12T17:36:49.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.259+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~NWFHHXXD7TZZ.0 size=1048576 2024-09-12T17:36:49.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.260+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~NWFHHXXD7TZZ.1 size=371807 2024-09-12T17:36:49.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.262+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=NWFHHXXD7TZZ tag=Q42GQPTNMWGT type=write size=2468959 2024-09-12T17:36:49.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.264+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=DNUC0YPXH29T type=del size=1711651 2024-09-12T17:36:49.266 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.265+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=CTXWQAPA0ACY type=del 2024-09-12T17:36:49.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.267+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~SE0YM0LDP0CW.0 size=1048576 2024-09-12T17:36:49.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.268+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~SE0YM0LDP0CW.1 size=1048576 2024-09-12T17:36:49.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.269+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~SE0YM0LDP0CW.2 size=29170 2024-09-12T17:36:49.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.269+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=SE0YM0LDP0CW tag=GVA3XLB6VJ0E type=write size=3174898 2024-09-12T17:36:49.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.270+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~30QLVP62LQVZ.0 size=1048576 2024-09-12T17:36:49.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.271+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~30QLVP62LQVZ.1 size=1048576 2024-09-12T17:36:49.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.272+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~30QLVP62LQVZ.2 size=921080 2024-09-12T17:36:49.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.274+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=30QLVP62LQVZ tag=2JR2LS7TY5NS type=write size=4066808 2024-09-12T17:36:49.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.275+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=K6LRHMQK5038 type=write size=46349 2024-09-12T17:36:49.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.276+0000 7fa80ca76780 1 < completed write operation key=WGL9JYJXSHBH tag=9L9J8UQRBU37 type=write size=601457 2024-09-12T17:36:49.278 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.277+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=NNACQNAJR120 type=del size=1910048 2024-09-12T17:36:49.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.279+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~3XUAOUCQ1FOW.0 size=1048576 2024-09-12T17:36:49.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.279+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~3XUAOUCQ1FOW.1 size=129767 2024-09-12T17:36:49.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.282+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=3XUAOUCQ1FOW tag=GPLLGABJ7XB5 type=write size=2226919 2024-09-12T17:36:49.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.283+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=XDS2K36CRWNP type=del size=3929835 2024-09-12T17:36:49.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.284+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~N3V343KA9K5T.0 size=1048576 2024-09-12T17:36:49.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.285+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~N3V343KA9K5T.1 size=1048576 2024-09-12T17:36:49.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.286+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~N3V343KA9K5T.2 size=892471 2024-09-12T17:36:49.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.289+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=N3V343KA9K5T tag=UZU2OSLAWZ7J type=write size=4038199 2024-09-12T17:36:49.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.290+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=ARORK7S2E3LO type=del size=238373 2024-09-12T17:36:49.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.291+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~0A1T5X612TTC.0 size=83959 2024-09-12T17:36:49.294 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.293+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=0A1T5X612TTC tag=Q7NNXZPBEFDS type=write size=1132535 2024-09-12T17:36:49.296 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.295+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~S63LLD1BE9IJ.0 size=1048576 2024-09-12T17:36:49.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.296+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~S63LLD1BE9IJ.1 size=1048576 2024-09-12T17:36:49.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.297+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~S63LLD1BE9IJ.2 size=870231 2024-09-12T17:36:49.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.297+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=S63LLD1BE9IJ tag=TS2OMWN6CVCQ type=write size=4015959 2024-09-12T17:36:49.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.298+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=3YAC3IAFLY39 type=del 2024-09-12T17:36:49.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.300+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~7N84LF8WHYX2.0 size=1048576 2024-09-12T17:36:49.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.301+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~7N84LF8WHYX2.1 size=444316 2024-09-12T17:36:49.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.301+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=7N84LF8WHYX2 tag=KNE7LG1BL2R3 type=write size=2541468 2024-09-12T17:36:49.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.301+0000 7fa80ca76780 1 < canceled part key=_multipart_EDRL3T2I9AOO.2~K4BPZX3AYIT9.0 size=596112 2024-09-12T17:36:49.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.303+0000 7fa80ca76780 1 < canceled multipart upload key=EDRL3T2I9AOO upload=K4BPZX3AYIT9 tag=AUZKGCB42HSH type=write size=1644688 2024-09-12T17:36:49.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.305+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=I517XTRRZ5US type=del size=3638032 2024-09-12T17:36:49.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.306+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~PU3TILOX26AJ.0 size=1048576 2024-09-12T17:36:49.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.306+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~PU3TILOX26AJ.1 size=117775 2024-09-12T17:36:49.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.308+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=PU3TILOX26AJ tag=VIF1TCWGA5JR type=write size=2214927 2024-09-12T17:36:49.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.309+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=95S911JSS8DY type=del size=3410417 2024-09-12T17:36:49.313 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.312+0000 7fa80ca76780 1 < suggested update operation key=GKE6623N268Z tag=N9ZSRC80W4J0 type=del size=1048435 2024-09-12T17:36:49.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.313+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=NBHHPIUCQJF0 type=del size=245887 2024-09-12T17:36:49.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.314+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=ROPXMO8MV27B type=del 2024-09-12T17:36:49.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.315+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=1T8S4BKBCV6Q type=del size=610205 2024-09-12T17:36:49.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.316+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=LGOWI2AI1L0I type=del 2024-09-12T17:36:49.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.318+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~OIWBHRNTJFL6.0 size=73185 2024-09-12T17:36:49.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.318+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=OIWBHRNTJFL6 tag=P1TDCS3KXVKB type=write size=1121761 2024-09-12T17:36:49.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.321+0000 7fa80ca76780 1 < suggested remove operation key=RC1IX4DQREEP tag=7Y9JJRNKBOY5 type=del 2024-09-12T17:36:49.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.322+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=Q63IQC3MAX5V type=del size=2414787 2024-09-12T17:36:49.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.323+0000 7fa80ca76780 1 < completed delete operation key=0X3LGXL2QFRN tag=9FSKRUWU57ZX type=del 2024-09-12T17:36:49.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.324+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=DWYZCTCRWTND type=del size=2810321 2024-09-12T17:36:49.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.326+0000 7fa80ca76780 1 < suggested remove operation key=R02234GEWV6B tag=F3BC9ABG2L14 type=del 2024-09-12T17:36:49.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.328+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=45WGHK1CZ3EI type=del size=3513638 2024-09-12T17:36:49.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.329+0000 7fa80ca76780 1 < canceled operation key=Z81704G91EPL tag=DNUC0YPXH29T type=del size=1711651 2024-09-12T17:36:49.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.330+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=IDGVY5A51RYG type=del size=2716936 2024-09-12T17:36:49.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.331+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~SE0YM0LDP0CW.0 size=1048576 2024-09-12T17:36:49.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.334+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~SE0YM0LDP0CW.1 size=1048576 2024-09-12T17:36:49.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.335+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~SE0YM0LDP0CW.2 size=29170 2024-09-12T17:36:49.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.337+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=SE0YM0LDP0CW tag=GVA3XLB6VJ0E type=write size=3174898 2024-09-12T17:36:49.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.339+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~5QOESARWWRJ1.0 size=1048576 2024-09-12T17:36:49.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.339+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~5QOESARWWRJ1.1 size=434742 2024-09-12T17:36:49.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.339+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=5QOESARWWRJ1 tag=0XT72O0AFKDY type=write size=2531894 2024-09-12T17:36:49.342 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.341+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=K6LRHMQK5038 type=write size=46349 2024-09-12T17:36:49.344 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.343+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~05TBHEZPJJG5.0 size=1048576 2024-09-12T17:36:49.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.344+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~05TBHEZPJJG5.1 size=1048576 2024-09-12T17:36:49.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.347+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~05TBHEZPJJG5.2 size=414412 2024-09-12T17:36:49.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.347+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=05TBHEZPJJG5 tag=PWI12TXMO8U8 type=write size=3560140 2024-09-12T17:36:49.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.348+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=NNACQNAJR120 type=del 2024-09-12T17:36:49.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.349+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=ITRJK3MB59DJ type=del size=249601 2024-09-12T17:36:49.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.351+0000 7fa80ca76780 1 < suggested remove operation key=5CAG55DQEF3Y tag=XDS2K36CRWNP type=del 2024-09-12T17:36:49.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.352+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=06FWZ5AACQ8O type=write size=365839 2024-09-12T17:36:49.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.354+0000 7fa80ca76780 1 < canceled operation key=7QHTQ6VHZ34P tag=ARORK7S2E3LO type=del size=238373 2024-09-12T17:36:49.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.355+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=661C1FXN25F4 type=del size=2642432 2024-09-12T17:36:49.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.356+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~S63LLD1BE9IJ.0 size=1048576 2024-09-12T17:36:49.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.356+0000 7fa80ca76780 1 < canceled part key=_multipart_H87S6AI6JT6D.2~S63LLD1BE9IJ.1 size=1048576 2024-09-12T17:36:49.358 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.357+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~S63LLD1BE9IJ.2 size=870231 2024-09-12T17:36:49.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.358+0000 7fa80ca76780 1 < canceled multipart upload key=H87S6AI6JT6D upload=S63LLD1BE9IJ tag=TS2OMWN6CVCQ type=write size=4015959 2024-09-12T17:36:49.361 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.360+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=ZF0BFML1F22B type=del size=3587225 2024-09-12T17:36:49.362 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.361+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~7N84LF8WHYX2.0 size=1048576 2024-09-12T17:36:49.362 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.361+0000 7fa80ca76780 1 < canceled part key=_multipart_EDRL3T2I9AOO.2~7N84LF8WHYX2.1 size=444316 2024-09-12T17:36:49.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.362+0000 7fa80ca76780 1 < canceled multipart upload key=EDRL3T2I9AOO upload=7N84LF8WHYX2 tag=KNE7LG1BL2R3 type=write size=2541468 2024-09-12T17:36:49.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.364+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=NX0K8PMD0XYC type=del size=1418262 2024-09-12T17:36:49.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.365+0000 7fa80ca76780 1 < canceled operation key=AKE8O7Q277HX tag=I517XTRRZ5US type=del size=3638032 2024-09-12T17:36:49.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.367+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~KLTEU6PDZR4D.0 size=573040 2024-09-12T17:36:49.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.367+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=KLTEU6PDZR4D tag=DROI530F3L27 type=write size=1621616 2024-09-12T17:36:49.370 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.369+0000 7fa80ca76780 1 < suggested remove operation key=VC1X03K12V80 tag=95S911JSS8DY type=del 2024-09-12T17:36:49.372 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.371+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~XEGZSUXARNTI.0 size=1048576 2024-09-12T17:36:49.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.372+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~XEGZSUXARNTI.1 size=1048576 2024-09-12T17:36:49.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.372+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~XEGZSUXARNTI.2 size=292531 2024-09-12T17:36:49.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.372+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=XEGZSUXARNTI tag=5MKNAIN8CNT8 type=write size=3438259 2024-09-12T17:36:49.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.374+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=NBHHPIUCQJF0 type=del 2024-09-12T17:36:49.377 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.376+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~VYD23A1RCE7X.0 size=1048576 2024-09-12T17:36:49.377 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.376+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~VYD23A1RCE7X.1 size=765585 2024-09-12T17:36:49.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.376+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=VYD23A1RCE7X tag=3US95JJDCAE4 type=write size=2862737 2024-09-12T17:36:49.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.378+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=1T8S4BKBCV6Q type=del 2024-09-12T17:36:49.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.379+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=CNAVWT1IEQSN type=del size=3898416 2024-09-12T17:36:49.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.380+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~OIWBHRNTJFL6.0 size=73185 2024-09-12T17:36:49.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.382+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=OIWBHRNTJFL6 tag=P1TDCS3KXVKB type=write size=1121761 2024-09-12T17:36:49.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.383+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=SAVK0PILW3BT type=del size=3272258 2024-09-12T17:36:49.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.384+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=Q63IQC3MAX5V type=del 2024-09-12T17:36:49.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.385+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=6B3G44LZHJ8S type=del size=4024337 2024-09-12T17:36:49.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.386+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=DWYZCTCRWTND type=del 2024-09-12T17:36:49.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.389+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~X192MTRSZDLN.0 size=344079 2024-09-12T17:36:49.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.389+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=X192MTRSZDLN tag=4700EZTPI4TF type=write size=1392655 2024-09-12T17:36:49.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.390+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=45WGHK1CZ3EI type=del 2024-09-12T17:36:49.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.391+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=C33M2VX0E64P type=del size=1877391 2024-09-12T17:36:49.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.393+0000 7fa80ca76780 1 < suggested remove operation key=0J6RTRJWZP1T tag=IDGVY5A51RYG type=del 2024-09-12T17:36:49.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.396+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~VM1ZHWKT4SOG.0 size=1048576 2024-09-12T17:36:49.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.397+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~VM1ZHWKT4SOG.1 size=1048576 2024-09-12T17:36:49.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.398+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~VM1ZHWKT4SOG.2 size=567919 2024-09-12T17:36:49.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.398+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=VM1ZHWKT4SOG tag=9SBLAOMLRD2T type=write size=3713647 2024-09-12T17:36:49.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.399+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~5QOESARWWRJ1.0 size=1048576 2024-09-12T17:36:49.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.400+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~5QOESARWWRJ1.1 size=434742 2024-09-12T17:36:49.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.402+0000 7fa80ca76780 1 < completed multipart upload key=U8O04HYQZRJC upload=5QOESARWWRJ1 tag=0XT72O0AFKDY type=write size=2531894 2024-09-12T17:36:49.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.403+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=X3HKYXHWBFWF type=del size=4185661 2024-09-12T17:36:49.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.404+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~05TBHEZPJJG5.0 size=1048576 2024-09-12T17:36:49.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.405+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~05TBHEZPJJG5.1 size=1048576 2024-09-12T17:36:49.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.406+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~05TBHEZPJJG5.2 size=414412 2024-09-12T17:36:49.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.408+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=05TBHEZPJJG5 tag=PWI12TXMO8U8 type=write size=3560140 2024-09-12T17:36:49.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.409+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=M33OS1RLNKDW type=write size=142362 2024-09-12T17:36:49.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.410+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=ITRJK3MB59DJ type=del 2024-09-12T17:36:49.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.412+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=IX2NWJ7VO8MW type=write size=959570 2024-09-12T17:36:49.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.413+0000 7fa80ca76780 1 < completed write operation key=8Z3EPQHMA6M5 tag=06FWZ5AACQ8O type=write size=365839 2024-09-12T17:36:49.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.416+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=N5L7YU8R0CCX type=del size=1400564 2024-09-12T17:36:49.419 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.418+0000 7fa80ca76780 1 < suggested remove operation key=54KWSI77T73A tag=661C1FXN25F4 type=del 2024-09-12T17:36:49.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.419+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=GGMUNJ6SX9HY type=del size=2239361 2024-09-12T17:36:49.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.421+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=ZF0BFML1F22B type=del 2024-09-12T17:36:49.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.423+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~TDPZZ300PS2G.0 size=1048576 2024-09-12T17:36:49.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.424+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~TDPZZ300PS2G.1 size=234299 2024-09-12T17:36:49.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.424+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=TDPZZ300PS2G tag=UY0HM1SQ7SBI type=write size=2331451 2024-09-12T17:36:49.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.426+0000 7fa80ca76780 1 < suggested update operation key=4S33294MWCO1 tag=NX0K8PMD0XYC type=del size=1418262 2024-09-12T17:36:49.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.427+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=HDCBWNK67E7N type=del size=1887036 2024-09-12T17:36:49.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.428+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~KLTEU6PDZR4D.0 size=573040 2024-09-12T17:36:49.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.430+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=KLTEU6PDZR4D tag=DROI530F3L27 type=write size=1621616 2024-09-12T17:36:49.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.432+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=78P0I2IWUW90 type=del size=2424558 2024-09-12T17:36:49.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.433+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~XEGZSUXARNTI.0 size=1048576 2024-09-12T17:36:49.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.434+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~XEGZSUXARNTI.1 size=1048576 2024-09-12T17:36:49.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.434+0000 7fa80ca76780 1 < canceled part key=_multipart_4S33294MWCO1.2~XEGZSUXARNTI.2 size=292531 2024-09-12T17:36:49.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.437+0000 7fa80ca76780 1 < canceled multipart upload key=4S33294MWCO1 upload=XEGZSUXARNTI tag=5MKNAIN8CNT8 type=write size=3438259 2024-09-12T17:36:49.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.439+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~A7JJMBQB12W0.0 size=1048576 2024-09-12T17:36:49.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.440+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~A7JJMBQB12W0.1 size=1048576 2024-09-12T17:36:49.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.441+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~A7JJMBQB12W0.2 size=1042636 2024-09-12T17:36:49.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.441+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=A7JJMBQB12W0 tag=0AMBEH6N12L6 type=write size=4188364 2024-09-12T17:36:49.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.442+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~VYD23A1RCE7X.0 size=1048576 2024-09-12T17:36:49.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.443+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~VYD23A1RCE7X.1 size=765585 2024-09-12T17:36:49.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.445+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=VYD23A1RCE7X tag=3US95JJDCAE4 type=write size=2862737 2024-09-12T17:36:49.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.446+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=NEUXG7EMYD0U type=del size=2895932 2024-09-12T17:36:49.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.447+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=CNAVWT1IEQSN type=del 2024-09-12T17:36:49.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.449+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~9T21IMYL01RU.0 size=125832 2024-09-12T17:36:49.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.449+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=9T21IMYL01RU tag=HL8D004DVHHR type=write size=1174408 2024-09-12T17:36:49.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.451+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=SAVK0PILW3BT type=del 2024-09-12T17:36:49.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.452+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=2WZQC67BFR3N type=del size=1632254 2024-09-12T17:36:49.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.453+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=6B3G44LZHJ8S type=del 2024-09-12T17:36:49.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.454+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=L4KOF9MLW941 type=del size=2320600 2024-09-12T17:36:49.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.455+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~X192MTRSZDLN.0 size=344079 2024-09-12T17:36:49.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.458+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=X192MTRSZDLN tag=4700EZTPI4TF type=write size=1392655 2024-09-12T17:36:49.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.459+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=EHDE9WQEXWYP type=del size=1015969 2024-09-12T17:36:49.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.461+0000 7fa80ca76780 1 < suggested update operation key=4S33294MWCO1 tag=C33M2VX0E64P type=del size=1877391 2024-09-12T17:36:49.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.462+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=0DTOYHZY2P0H type=del size=1615178 2024-09-12T17:36:49.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.464+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~VM1ZHWKT4SOG.0 size=1048576 2024-09-12T17:36:49.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.465+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~VM1ZHWKT4SOG.1 size=1048576 2024-09-12T17:36:49.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.465+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~VM1ZHWKT4SOG.2 size=567919 2024-09-12T17:36:49.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.467+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=VM1ZHWKT4SOG tag=9SBLAOMLRD2T type=write size=3713647 2024-09-12T17:36:49.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.469+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=FDKF3OIU3WSY type=del size=3119494 2024-09-12T17:36:49.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.470+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=X3HKYXHWBFWF type=del 2024-09-12T17:36:49.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.471+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=MEPLIS0PO01F type=write size=334016 2024-09-12T17:36:49.473 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.472+0000 7fa80ca76780 1 < completed write operation key=GKE6623N268Z tag=M33OS1RLNKDW type=write size=142362 2024-09-12T17:36:49.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.473+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=SARIJ6FH05YJ type=del size=3523240 2024-09-12T17:36:49.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.474+0000 7fa80ca76780 1 < completed write operation key=E25BUY271ZSI tag=IX2NWJ7VO8MW type=write size=959570 2024-09-12T17:36:49.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.475+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=HOEQV03008SO type=del size=2587722 2024-09-12T17:36:49.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.476+0000 7fa80ca76780 -1 < failed to complete operation key=4S33294MWCO1 tag=N5L7YU8R0CCX type=del size=1400564: (22) Invalid argument 2024-09-12T17:36:49.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.479+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~75HG2WBOBRX2.0 size=498575 2024-09-12T17:36:49.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.479+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=75HG2WBOBRX2 tag=47805GUC11GV type=write size=1547151 2024-09-12T17:36:49.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.480+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=GGMUNJ6SX9HY type=del 2024-09-12T17:36:49.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.481+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=2D78V2QSF882 type=write size=785320 2024-09-12T17:36:49.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.482+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~TDPZZ300PS2G.0 size=1048576 2024-09-12T17:36:49.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.483+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~TDPZZ300PS2G.1 size=234299 2024-09-12T17:36:49.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.485+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=TDPZZ300PS2G tag=UY0HM1SQ7SBI type=write size=2331451 2024-09-12T17:36:49.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.486+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=WHX67U5UF10Q type=del size=2414317 2024-09-12T17:36:49.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.487+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=HDCBWNK67E7N type=del 2024-09-12T17:36:49.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.488+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=A37RM30HT6NV type=del size=2139966 2024-09-12T17:36:49.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.489+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=78P0I2IWUW90 type=del 2024-09-12T17:36:49.491 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.490+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=U7O8U4LJC3VO type=write size=816336 2024-09-12T17:36:49.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.492+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~A7JJMBQB12W0.0 size=1048576 2024-09-12T17:36:49.494 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.493+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~A7JJMBQB12W0.1 size=1048576 2024-09-12T17:36:49.494 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.494+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~A7JJMBQB12W0.2 size=1042636 2024-09-12T17:36:49.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.496+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=A7JJMBQB12W0 tag=0AMBEH6N12L6 type=write size=4188364 2024-09-12T17:36:49.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.497+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=S9RECGVI2G45 type=del size=2210614 2024-09-12T17:36:49.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.498+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=NEUXG7EMYD0U type=del 2024-09-12T17:36:49.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.500+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~6QJHH89GUOH3.0 size=1048576 2024-09-12T17:36:49.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.501+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~6QJHH89GUOH3.1 size=1048576 2024-09-12T17:36:49.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.502+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~6QJHH89GUOH3.2 size=924393 2024-09-12T17:36:49.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.502+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=6QJHH89GUOH3 tag=202RFDRN9FZO type=write size=4070121 2024-09-12T17:36:49.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.503+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~9T21IMYL01RU.0 size=125832 2024-09-12T17:36:49.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.505+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=9T21IMYL01RU tag=HL8D004DVHHR type=write size=1174408 2024-09-12T17:36:49.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.506+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=C6HSD2DZC3KI type=del size=904484 2024-09-12T17:36:49.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.508+0000 7fa80ca76780 1 < suggested remove operation key=E25BUY271ZSI tag=2WZQC67BFR3N type=del 2024-09-12T17:36:49.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.511+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~9MCSN0Z7U2JZ.0 size=676192 2024-09-12T17:36:49.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.511+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=9MCSN0Z7U2JZ tag=A199P92SO818 type=write size=1724768 2024-09-12T17:36:49.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.512+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=L4KOF9MLW941 type=del 2024-09-12T17:36:49.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.514+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=M69RE47O93L0 type=del size=141500 2024-09-12T17:36:49.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.515+0000 7fa80ca76780 1 < completed delete operation key=07LPSZT2RKCC tag=EHDE9WQEXWYP type=del 2024-09-12T17:36:49.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.517+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~K39OB05F82A7.0 size=1048576 2024-09-12T17:36:49.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.518+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~K39OB05F82A7.1 size=921529 2024-09-12T17:36:49.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.518+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=K39OB05F82A7 tag=Z80J4QIZXG67 type=write size=3018681 2024-09-12T17:36:49.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.519+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=0DTOYHZY2P0H type=del 2024-09-12T17:36:49.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.520+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=ZOTHVBPIRHCG type=del size=3755869 2024-09-12T17:36:49.522 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.521+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=FDKF3OIU3WSY type=del 2024-09-12T17:36:49.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.522+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=KSZV3IY4MW1J type=del size=466370 2024-09-12T17:36:49.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.525+0000 7fa80ca76780 1 < suggested update operation key=7QHTQ6VHZ34P tag=MEPLIS0PO01F type=write size=334016 2024-09-12T17:36:49.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.527+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~0HPEBGY9SDZ0.0 size=1048576 2024-09-12T17:36:49.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.528+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~0HPEBGY9SDZ0.1 size=1048576 2024-09-12T17:36:49.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.529+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~0HPEBGY9SDZ0.2 size=16920 2024-09-12T17:36:49.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.529+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=0HPEBGY9SDZ0 tag=HVSX88OCTUZG type=write size=3162648 2024-09-12T17:36:49.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.529+0000 7fa80ca76780 -1 < no bi entry to suggest for operation key=E25BUY271ZSI tag=SARIJ6FH05YJ type=del size=3523240: (2) No such file or directory 2024-09-12T17:36:49.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.530+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=0GSANK3MM08G type=del size=2613348 2024-09-12T17:36:49.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.532+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=HOEQV03008SO type=del 2024-09-12T17:36:49.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.533+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=CF207KF8B21P type=del size=1778428 2024-09-12T17:36:49.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.534+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~75HG2WBOBRX2.0 size=498575 2024-09-12T17:36:49.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.536+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=75HG2WBOBRX2 tag=47805GUC11GV type=write size=1547151 2024-09-12T17:36:49.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.538+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~P503IX8C0QQA.0 size=141288 2024-09-12T17:36:49.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.538+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=P503IX8C0QQA tag=9V0RT8SRE2G3 type=write size=1189864 2024-09-12T17:36:49.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.539+0000 7fa80ca76780 1 < completed write operation key=FKK4IGD1436I tag=2D78V2QSF882 type=write size=785320 2024-09-12T17:36:49.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.542+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~52F5QFZ7MUL1.0 size=1048576 2024-09-12T17:36:49.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.543+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~52F5QFZ7MUL1.1 size=1048576 2024-09-12T17:36:49.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.544+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~52F5QFZ7MUL1.2 size=216280 2024-09-12T17:36:49.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.544+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=52F5QFZ7MUL1 tag=FGFJOJAUYTFL type=write size=3362008 2024-09-12T17:36:49.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.545+0000 7fa80ca76780 -1 < failed to complete operation key=E25BUY271ZSI tag=WHX67U5UF10Q type=del size=2414317: (22) Invalid argument 2024-09-12T17:36:49.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.546+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=ME6FWSYJLVXY type=del size=3386992 2024-09-12T17:36:49.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.548+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=A37RM30HT6NV type=del 2024-09-12T17:36:49.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.550+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~DPHUX09PB2IP.0 size=1048576 2024-09-12T17:36:49.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.550+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~DPHUX09PB2IP.1 size=1048576 2024-09-12T17:36:49.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.551+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~DPHUX09PB2IP.2 size=998176 2024-09-12T17:36:49.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.551+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=DPHUX09PB2IP tag=KNNT0S8CN526 type=write size=4143904 2024-09-12T17:36:49.554 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.553+0000 7fa80ca76780 1 < completed write operation key=R871XU2TDWID tag=U7O8U4LJC3VO type=write size=816336 2024-09-12T17:36:49.555 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.554+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=24X2DO820V9S type=write size=836404 2024-09-12T17:36:49.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.555+0000 7fa80ca76780 1 < canceled operation key=OJPZAWR5BLBN tag=S9RECGVI2G45 type=del size=2210614 2024-09-12T17:36:49.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.556+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=LBH7VMQGBISP type=del size=2498439 2024-09-12T17:36:49.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.557+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~6QJHH89GUOH3.0 size=1048576 2024-09-12T17:36:49.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.558+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~6QJHH89GUOH3.1 size=1048576 2024-09-12T17:36:49.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.559+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~6QJHH89GUOH3.2 size=924393 2024-09-12T17:36:49.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.561+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=6QJHH89GUOH3 tag=202RFDRN9FZO type=write size=4070121 2024-09-12T17:36:49.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.562+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=ON7JTTPBOAZW type=del size=3621780 2024-09-12T17:36:49.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.563+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=C6HSD2DZC3KI type=del 2024-09-12T17:36:49.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.564+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=12JLI1H4NYTJ type=write size=88936 2024-09-12T17:36:49.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.566+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~9MCSN0Z7U2JZ.0 size=676192 2024-09-12T17:36:49.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.568+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=9MCSN0Z7U2JZ tag=A199P92SO818 type=write size=1724768 2024-09-12T17:36:49.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.569+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=MW512A8JDNLD type=del size=157660 2024-09-12T17:36:49.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.570+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=M69RE47O93L0 type=del 2024-09-12T17:36:49.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.571+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=MJ32LGHCPT7N type=del size=168403 2024-09-12T17:36:49.574 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.573+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~K39OB05F82A7.0 size=1048576 2024-09-12T17:36:49.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.574+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~K39OB05F82A7.1 size=921529 2024-09-12T17:36:49.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.577+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=K39OB05F82A7 tag=Z80J4QIZXG67 type=write size=3018681 2024-09-12T17:36:49.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.578+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=INFM22I4P1G6 type=del size=1881319 2024-09-12T17:36:49.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.579+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=ZOTHVBPIRHCG type=del 2024-09-12T17:36:49.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.581+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~CNOT6264VQ2V.0 size=1048576 2024-09-12T17:36:49.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.582+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~CNOT6264VQ2V.1 size=586376 2024-09-12T17:36:49.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.582+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=CNOT6264VQ2V tag=03T2NN3SC2GA type=write size=2683528 2024-09-12T17:36:49.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.584+0000 7fa80ca76780 1 < suggested update operation key=Z81704G91EPL tag=KSZV3IY4MW1J type=del size=466370 2024-09-12T17:36:49.587 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.586+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~9JH33WDZJNXY.0 size=382972 2024-09-12T17:36:49.587 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.586+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=9JH33WDZJNXY tag=CGKRP2VQFCBF type=write size=1431548 2024-09-12T17:36:49.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.587+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~0HPEBGY9SDZ0.0 size=1048576 2024-09-12T17:36:49.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.588+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~0HPEBGY9SDZ0.1 size=1048576 2024-09-12T17:36:49.590 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.589+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~0HPEBGY9SDZ0.2 size=16920 2024-09-12T17:36:49.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.591+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=0HPEBGY9SDZ0 tag=HVSX88OCTUZG type=write size=3162648 2024-09-12T17:36:49.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.592+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=SM4W8O4BP78C type=write size=860279 2024-09-12T17:36:49.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.594+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=0GSANK3MM08G type=del 2024-09-12T17:36:49.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.595+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=Y61L1VDFIIF3 type=write size=863110 2024-09-12T17:36:49.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.596+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=CF207KF8B21P type=del 2024-09-12T17:36:49.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.598+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~M3WM04PL9W1K.0 size=992805 2024-09-12T17:36:49.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.598+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=M3WM04PL9W1K tag=A0N9Q0Y9UV2V type=write size=2041381 2024-09-12T17:36:49.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.599+0000 7fa80ca76780 1 < canceled part key=_multipart_DYZIHCBF3D8U.2~P503IX8C0QQA.0 size=141288 2024-09-12T17:36:49.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.600+0000 7fa80ca76780 1 < canceled multipart upload key=DYZIHCBF3D8U upload=P503IX8C0QQA tag=9V0RT8SRE2G3 type=write size=1189864 2024-09-12T17:36:49.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.602+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=L72NHRHU1TW4 type=del size=3766152 2024-09-12T17:36:49.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.603+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~52F5QFZ7MUL1.0 size=1048576 2024-09-12T17:36:49.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.604+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~52F5QFZ7MUL1.1 size=1048576 2024-09-12T17:36:49.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.605+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~52F5QFZ7MUL1.2 size=216280 2024-09-12T17:36:49.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.607+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=52F5QFZ7MUL1 tag=FGFJOJAUYTFL type=write size=3362008 2024-09-12T17:36:49.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.608+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=CWKWRYKR3XCI type=del size=4122109 2024-09-12T17:36:49.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.609+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=ME6FWSYJLVXY type=del 2024-09-12T17:36:49.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.610+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=F6SH74LMS0W6 type=write size=643750 2024-09-12T17:36:49.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.611+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~DPHUX09PB2IP.0 size=1048576 2024-09-12T17:36:49.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.612+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~DPHUX09PB2IP.1 size=1048576 2024-09-12T17:36:49.614 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.613+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~DPHUX09PB2IP.2 size=998176 2024-09-12T17:36:49.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.615+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=DPHUX09PB2IP tag=KNNT0S8CN526 type=write size=4143904 2024-09-12T17:36:49.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.616+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=86OU0XE4VBLR type=del size=685732 2024-09-12T17:36:49.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.617+0000 7fa80ca76780 1 < completed write operation key=8Z3EPQHMA6M5 tag=24X2DO820V9S type=write size=836404 2024-09-12T17:36:49.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.618+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=UU6QNK65LBAQ type=del size=1524720 2024-09-12T17:36:49.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.620+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=LBH7VMQGBISP type=del 2024-09-12T17:36:49.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.622+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~7L45701OW7X3.0 size=1048576 2024-09-12T17:36:49.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.622+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~7L45701OW7X3.1 size=738204 2024-09-12T17:36:49.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.623+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=7L45701OW7X3 tag=P2DU1D4EG5PM type=write size=2835356 2024-09-12T17:36:49.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.624+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=ON7JTTPBOAZW type=del 2024-09-12T17:36:49.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.626+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~DP3JWW5J5F2V.0 size=1048576 2024-09-12T17:36:49.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.627+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~DP3JWW5J5F2V.1 size=638889 2024-09-12T17:36:49.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.627+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=DP3JWW5J5F2V tag=D0LZBZY46UHL type=write size=2736041 2024-09-12T17:36:49.630 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.629+0000 7fa80ca76780 1 < suggested update operation key=MSZUYX441Y66 tag=12JLI1H4NYTJ type=write size=88936 2024-09-12T17:36:49.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.631+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~14JSX2BYOY8R.0 size=1048576 2024-09-12T17:36:49.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.632+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~14JSX2BYOY8R.1 size=1048576 2024-09-12T17:36:49.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.633+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~14JSX2BYOY8R.2 size=981464 2024-09-12T17:36:49.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.633+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=14JSX2BYOY8R tag=Y55YLM5NR0L5 type=write size=4127192 2024-09-12T17:36:49.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.634+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=MW512A8JDNLD type=del 2024-09-12T17:36:49.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.636+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~E2S2MLPO72EI.0 size=366154 2024-09-12T17:36:49.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.636+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=E2S2MLPO72EI tag=DYUV0DZ7U6PK type=write size=1414730 2024-09-12T17:36:49.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.637+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=MJ32LGHCPT7N type=del 2024-09-12T17:36:49.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.638+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=ANHUKS3B5BM1 type=write size=11717 2024-09-12T17:36:49.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.640+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=INFM22I4P1G6 type=del 2024-09-12T17:36:49.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.641+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=LFQS1FJXXOLN type=del size=990613 2024-09-12T17:36:49.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.642+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~CNOT6264VQ2V.0 size=1048576 2024-09-12T17:36:49.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.643+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~CNOT6264VQ2V.1 size=586376 2024-09-12T17:36:49.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.645+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=CNOT6264VQ2V tag=03T2NN3SC2GA type=write size=2683528 2024-09-12T17:36:49.647 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.646+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=HJONIWP286F8 type=write size=295275 2024-09-12T17:36:49.648 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.647+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~9JH33WDZJNXY.0 size=382972 2024-09-12T17:36:49.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.649+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=9JH33WDZJNXY tag=CGKRP2VQFCBF type=write size=1431548 2024-09-12T17:36:49.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.650+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=6F5BZZY078K2 type=del size=3844348 2024-09-12T17:36:49.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.651+0000 7fa80ca76780 1 < completed write operation key=FKK4IGD1436I tag=SM4W8O4BP78C type=write size=860279 2024-09-12T17:36:49.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.653+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=TI3KY4E6IOFN type=write size=717024 2024-09-12T17:36:49.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.654+0000 7fa80ca76780 1 < completed write operation key=VDD4PDR1GLWQ tag=Y61L1VDFIIF3 type=write size=863110 2024-09-12T17:36:49.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.656+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~Y3OIELHUQ7FH.0 size=1048576 2024-09-12T17:36:49.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.657+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~Y3OIELHUQ7FH.1 size=1048576 2024-09-12T17:36:49.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.657+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~Y3OIELHUQ7FH.2 size=560739 2024-09-12T17:36:49.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.657+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=Y3OIELHUQ7FH tag=U10IX1HQIQPH type=write size=3706467 2024-09-12T17:36:49.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.659+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~M3WM04PL9W1K.0 size=992805 2024-09-12T17:36:49.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.660+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=M3WM04PL9W1K tag=A0N9Q0Y9UV2V type=write size=2041381 2024-09-12T17:36:49.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.663+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~CUO2KWWQEFAJ.0 size=1048576 2024-09-12T17:36:49.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.664+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~CUO2KWWQEFAJ.1 size=266265 2024-09-12T17:36:49.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.664+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=CUO2KWWQEFAJ tag=RNHKNRBGWLF1 type=write size=2363417 2024-09-12T17:36:49.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.665+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=L72NHRHU1TW4 type=del 2024-09-12T17:36:49.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.666+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=ME1XM5RGNODX type=del size=55706 2024-09-12T17:36:49.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.667+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=CWKWRYKR3XCI type=del 2024-09-12T17:36:49.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.669+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~6TRR15Z4ZICA.0 size=716909 2024-09-12T17:36:49.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.669+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=6TRR15Z4ZICA tag=Y03MUKAWOZAJ type=write size=1765485 2024-09-12T17:36:49.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.670+0000 7fa80ca76780 1 < completed write operation key=94801LE91HZ9 tag=F6SH74LMS0W6 type=write size=643750 2024-09-12T17:36:49.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.671+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=WV2F2ZWIIRGN type=write size=1025546 2024-09-12T17:36:49.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.672+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=86OU0XE4VBLR type=del 2024-09-12T17:36:49.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.673+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=A41N7AICSWEX type=del size=352520 2024-09-12T17:36:49.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.676+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=UU6QNK65LBAQ type=del 2024-09-12T17:36:49.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.677+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=ZDCXWNZG2IXS type=write size=238117 2024-09-12T17:36:49.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.680+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~7L45701OW7X3.0 size=1048576 2024-09-12T17:36:49.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.681+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~7L45701OW7X3.1 size=738204 2024-09-12T17:36:49.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.683+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=7L45701OW7X3 tag=P2DU1D4EG5PM type=write size=2835356 2024-09-12T17:36:49.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.686+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~X4IVSP6TD9RJ.0 size=1048576 2024-09-12T17:36:49.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.687+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~X4IVSP6TD9RJ.1 size=697458 2024-09-12T17:36:49.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.687+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=X4IVSP6TD9RJ tag=NQDC937KA6ZA type=write size=2794610 2024-09-12T17:36:49.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.688+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~DP3JWW5J5F2V.0 size=1048576 2024-09-12T17:36:49.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.689+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~DP3JWW5J5F2V.1 size=638889 2024-09-12T17:36:49.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.693+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=DP3JWW5J5F2V tag=D0LZBZY46UHL type=write size=2736041 2024-09-12T17:36:49.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.694+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=BH60Y8NEQQ4V type=del size=2644577 2024-09-12T17:36:49.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.696+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~14JSX2BYOY8R.0 size=1048576 2024-09-12T17:36:49.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.697+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~14JSX2BYOY8R.1 size=1048576 2024-09-12T17:36:49.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.698+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~14JSX2BYOY8R.2 size=981464 2024-09-12T17:36:49.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.700+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=14JSX2BYOY8R tag=Y55YLM5NR0L5 type=write size=4127192 2024-09-12T17:36:49.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.701+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=T8S3J05FHERK type=del size=2919420 2024-09-12T17:36:49.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.702+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~E2S2MLPO72EI.0 size=366154 2024-09-12T17:36:49.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.704+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=E2S2MLPO72EI tag=DYUV0DZ7U6PK type=write size=1414730 2024-09-12T17:36:49.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.706+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~8P4LT45TESOC.0 size=1048576 2024-09-12T17:36:49.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.707+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~8P4LT45TESOC.1 size=1048576 2024-09-12T17:36:49.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.708+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~8P4LT45TESOC.2 size=762214 2024-09-12T17:36:49.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.708+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=8P4LT45TESOC tag=XAK6CSJH9YED type=write size=3907942 2024-09-12T17:36:49.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.710+0000 7fa80ca76780 1 < completed write operation key=EDRL3T2I9AOO tag=ANHUKS3B5BM1 type=write size=11717 2024-09-12T17:36:49.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.711+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=BTJG5QLGSSPW type=del size=1592533 2024-09-12T17:36:49.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.712+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=LFQS1FJXXOLN type=del 2024-09-12T17:36:49.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.715+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~6CJ0FYBATGEO.0 size=1048576 2024-09-12T17:36:49.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.716+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~6CJ0FYBATGEO.1 size=1048576 2024-09-12T17:36:49.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.717+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~6CJ0FYBATGEO.2 size=629125 2024-09-12T17:36:49.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.717+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=6CJ0FYBATGEO tag=Y215C44VREFX type=write size=3774853 2024-09-12T17:36:49.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.718+0000 7fa80ca76780 1 < completed write operation key=07LPSZT2RKCC tag=HJONIWP286F8 type=write size=295275 2024-09-12T17:36:49.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.719+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=OWD0S27MV19Q type=del size=2378504 2024-09-12T17:36:49.723 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.722+0000 7fa80ca76780 1 < suggested remove operation key=5CAG55DQEF3Y tag=6F5BZZY078K2 type=del 2024-09-12T17:36:49.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.724+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~J6UPWTDPZLFM.0 size=1048576 2024-09-12T17:36:49.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.725+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~J6UPWTDPZLFM.1 size=123938 2024-09-12T17:36:49.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.725+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=J6UPWTDPZLFM tag=CKCEK7TL3RX2 type=write size=2221090 2024-09-12T17:36:49.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.726+0000 7fa80ca76780 1 < completed write operation key=94801LE91HZ9 tag=TI3KY4E6IOFN type=write size=717024 2024-09-12T17:36:49.729 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.728+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=ZV0BPCHV4VMC type=write size=971317 2024-09-12T17:36:49.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.729+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~Y3OIELHUQ7FH.0 size=1048576 2024-09-12T17:36:49.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.730+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~Y3OIELHUQ7FH.1 size=1048576 2024-09-12T17:36:49.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.731+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~Y3OIELHUQ7FH.2 size=560739 2024-09-12T17:36:49.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.733+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=Y3OIELHUQ7FH tag=U10IX1HQIQPH type=write size=3706467 2024-09-12T17:36:49.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.735+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~FPI8RQ16HO0S.0 size=877419 2024-09-12T17:36:49.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.735+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=FPI8RQ16HO0S tag=EFEDZPRMOD8P type=write size=1925995 2024-09-12T17:36:49.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.736+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~CUO2KWWQEFAJ.0 size=1048576 2024-09-12T17:36:49.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.737+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~CUO2KWWQEFAJ.1 size=266265 2024-09-12T17:36:49.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.739+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=CUO2KWWQEFAJ tag=RNHKNRBGWLF1 type=write size=2363417 2024-09-12T17:36:49.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.741+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~53W2DGZ8CA5P.0 size=1048576 2024-09-12T17:36:49.743 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.742+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~53W2DGZ8CA5P.1 size=1048576 2024-09-12T17:36:49.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.743+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~53W2DGZ8CA5P.2 size=755517 2024-09-12T17:36:49.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.743+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=53W2DGZ8CA5P tag=L5F6O0LZ8PS4 type=write size=3901245 2024-09-12T17:36:49.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.745+0000 7fa80ca76780 1 < suggested update operation key=OJPZAWR5BLBN tag=ME1XM5RGNODX type=del size=55706 2024-09-12T17:36:49.747 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.746+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=PSL3MT4ACQCI type=write size=959343 2024-09-12T17:36:49.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.748+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~6TRR15Z4ZICA.0 size=716909 2024-09-12T17:36:49.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.750+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=6TRR15Z4ZICA tag=Y03MUKAWOZAJ type=write size=1765485 2024-09-12T17:36:49.752 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.751+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=YZ4J75KBR0NJ type=del size=2661252 2024-09-12T17:36:49.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.752+0000 7fa80ca76780 1 < canceled operation key=R871XU2TDWID tag=WV2F2ZWIIRGN type=write size=1025546 2024-09-12T17:36:49.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.755+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~NWV0CSGZCQ5C.0 size=1048576 2024-09-12T17:36:49.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.756+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~NWV0CSGZCQ5C.1 size=853642 2024-09-12T17:36:49.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.756+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=NWV0CSGZCQ5C tag=5M62R0A5442A type=write size=2950794 2024-09-12T17:36:49.758 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.757+0000 7fa80ca76780 1 < canceled operation key=R02234GEWV6B tag=A41N7AICSWEX type=del size=352520 2024-09-12T17:36:49.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.760+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~IEFB5BHEFHLZ.0 size=167134 2024-09-12T17:36:49.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.760+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=IEFB5BHEFHLZ tag=IEDV568RYXA0 type=write size=1215710 2024-09-12T17:36:49.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.761+0000 7fa80ca76780 1 < completed write operation key=LU7PDGWTAK63 tag=ZDCXWNZG2IXS type=write size=238117 2024-09-12T17:36:49.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.762+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=9KAE84H1SQPF type=write size=803326 2024-09-12T17:36:49.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.763+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~X4IVSP6TD9RJ.0 size=1048576 2024-09-12T17:36:49.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.764+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~X4IVSP6TD9RJ.1 size=697458 2024-09-12T17:36:49.767 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.766+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=X4IVSP6TD9RJ tag=NQDC937KA6ZA type=write size=2794610 2024-09-12T17:36:49.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.768+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=0XL6JHGN7KLV type=del size=341958 2024-09-12T17:36:49.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.769+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=BH60Y8NEQQ4V type=del 2024-09-12T17:36:49.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.770+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=P62EO7QYU3MQ type=write size=821008 2024-09-12T17:36:49.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.771+0000 7fa80ca76780 -1 < failed to complete operation key=OJPZAWR5BLBN tag=T8S3J05FHERK type=del size=2919420: (22) Invalid argument 2024-09-12T17:36:49.773 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.772+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=QOKSOP29T8QP type=del size=1348414 2024-09-12T17:36:49.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.773+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~8P4LT45TESOC.0 size=1048576 2024-09-12T17:36:49.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.774+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~8P4LT45TESOC.1 size=1048576 2024-09-12T17:36:49.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.775+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~8P4LT45TESOC.2 size=762214 2024-09-12T17:36:49.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.777+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=8P4LT45TESOC tag=XAK6CSJH9YED type=write size=3907942 2024-09-12T17:36:49.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.778+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=59I5GWBFA6XW type=del size=2370969 2024-09-12T17:36:49.782 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.781+0000 7fa80ca76780 1 < suggested update operation key=E25BUY271ZSI tag=BTJG5QLGSSPW type=del size=1592533 2024-09-12T17:36:49.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.782+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=SPCF32Y0Q3NE type=del size=2090046 2024-09-12T17:36:49.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.783+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~6CJ0FYBATGEO.0 size=1048576 2024-09-12T17:36:49.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.784+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~6CJ0FYBATGEO.1 size=1048576 2024-09-12T17:36:49.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.785+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~6CJ0FYBATGEO.2 size=629125 2024-09-12T17:36:49.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.788+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=6CJ0FYBATGEO tag=Y215C44VREFX type=write size=3774853 2024-09-12T17:36:49.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.789+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=8DQOHSE2U0G5 type=write size=519514 2024-09-12T17:36:49.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.790+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=OWD0S27MV19Q type=del 2024-09-12T17:36:49.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.793+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~YCFYHV8FKS83.0 size=1048576 2024-09-12T17:36:49.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.796+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~YCFYHV8FKS83.1 size=1035749 2024-09-12T17:36:49.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.796+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=YCFYHV8FKS83 tag=L7H1JEDYOU2H type=write size=3132901 2024-09-12T17:36:49.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.797+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~J6UPWTDPZLFM.0 size=1048576 2024-09-12T17:36:49.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.798+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~J6UPWTDPZLFM.1 size=123938 2024-09-12T17:36:49.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.800+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=J6UPWTDPZLFM tag=CKCEK7TL3RX2 type=write size=2221090 2024-09-12T17:36:49.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.801+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=4SJK6J7FEBHD type=del size=305514 2024-09-12T17:36:49.804 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.803+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=ZV0BPCHV4VMC type=write size=971317 2024-09-12T17:36:49.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.805+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~90W4V8R1QBQY.0 size=687347 2024-09-12T17:36:49.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.805+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=90W4V8R1QBQY tag=ZZAAIQAOR661 type=write size=1735923 2024-09-12T17:36:49.807 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.806+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~FPI8RQ16HO0S.0 size=877419 2024-09-12T17:36:49.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.808+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=FPI8RQ16HO0S tag=EFEDZPRMOD8P type=write size=1925995 2024-09-12T17:36:49.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.810+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~BY4GBPUC49O5.0 size=1048576 2024-09-12T17:36:49.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.811+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~BY4GBPUC49O5.1 size=1048576 2024-09-12T17:36:49.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.812+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~BY4GBPUC49O5.2 size=851002 2024-09-12T17:36:49.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.812+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=BY4GBPUC49O5 tag=N88FRTVNSXOE type=write size=3996730 2024-09-12T17:36:49.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.812+0000 7fa80ca76780 1 < canceled part key=_multipart_54KWSI77T73A.2~53W2DGZ8CA5P.0 size=1048576 2024-09-12T17:36:49.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.813+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~53W2DGZ8CA5P.1 size=1048576 2024-09-12T17:36:49.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.814+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~53W2DGZ8CA5P.2 size=755517 2024-09-12T17:36:49.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.816+0000 7fa80ca76780 1 < canceled multipart upload key=54KWSI77T73A upload=53W2DGZ8CA5P tag=L5F6O0LZ8PS4 type=write size=3901245 2024-09-12T17:36:49.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.818+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~NJO665BOY2B8.0 size=1048576 2024-09-12T17:36:49.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.819+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~NJO665BOY2B8.1 size=610108 2024-09-12T17:36:49.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.819+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=NJO665BOY2B8 tag=J2ZI6MO5KRPH type=write size=2707260 2024-09-12T17:36:49.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.820+0000 7fa80ca76780 1 < canceled operation key=OJPZAWR5BLBN tag=PSL3MT4ACQCI type=write size=959343 2024-09-12T17:36:49.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.821+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=5PFRE5AA515C type=del size=740847 2024-09-12T17:36:49.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.822+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=YZ4J75KBR0NJ type=del 2024-09-12T17:36:49.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.824+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=AAXG3CECC1O6 type=del size=4043157 2024-09-12T17:36:49.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.825+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~NWV0CSGZCQ5C.0 size=1048576 2024-09-12T17:36:49.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.826+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~NWV0CSGZCQ5C.1 size=853642 2024-09-12T17:36:49.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.828+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=NWV0CSGZCQ5C tag=5M62R0A5442A type=write size=2950794 2024-09-12T17:36:49.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.829+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=J60DF0QIYFFB type=del size=201017 2024-09-12T17:36:49.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.830+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~IEFB5BHEFHLZ.0 size=167134 2024-09-12T17:36:49.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.832+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=IEFB5BHEFHLZ tag=IEDV568RYXA0 type=write size=1215710 2024-09-12T17:36:49.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.834+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~1A3UJ6NGOC1T.0 size=311144 2024-09-12T17:36:49.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.834+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=1A3UJ6NGOC1T tag=GKCMYA8DYN0E type=write size=1359720 2024-09-12T17:36:49.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.835+0000 7fa80ca76780 1 < completed write operation key=RC1IX4DQREEP tag=9KAE84H1SQPF type=write size=803326 2024-09-12T17:36:49.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.836+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=UWLU78ASF6LE type=write size=937686 2024-09-12T17:36:49.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.837+0000 7fa80ca76780 1 < canceled operation key=2AGKLZ3PQ2FD tag=0XL6JHGN7KLV type=del size=341958 2024-09-12T17:36:49.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.840+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~PHPL4OQWTW1E.0 size=1048576 2024-09-12T17:36:49.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.840+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~PHPL4OQWTW1E.1 size=1048576 2024-09-12T17:36:49.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.841+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~PHPL4OQWTW1E.2 size=390308 2024-09-12T17:36:49.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.841+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=PHPL4OQWTW1E tag=S4GGBE90JBC0 type=write size=3536036 2024-09-12T17:36:49.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.843+0000 7fa80ca76780 1 < completed write operation key=07LPSZT2RKCC tag=P62EO7QYU3MQ type=write size=821008 2024-09-12T17:36:49.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.844+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=GV1WMIQXLQ4W type=del size=3888898 2024-09-12T17:36:49.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.845+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=QOKSOP29T8QP type=del 2024-09-12T17:36:49.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.846+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=VOLZ8AGX2ZNS type=del size=1687364 2024-09-12T17:36:49.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.848+0000 7fa80ca76780 1 < suggested remove operation key=7QHTQ6VHZ34P tag=59I5GWBFA6XW type=del 2024-09-12T17:36:49.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.851+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~NTJ9IFOD71M0.0 size=1048576 2024-09-12T17:36:49.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.852+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~NTJ9IFOD71M0.1 size=307608 2024-09-12T17:36:49.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.852+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=NTJ9IFOD71M0 tag=ZK8376NWPU9D type=write size=2404760 2024-09-12T17:36:49.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.854+0000 7fa80ca76780 1 < suggested remove operation key=U8O04HYQZRJC tag=SPCF32Y0Q3NE type=del 2024-09-12T17:36:49.856 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.855+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=YS4IF7K9OJWA type=del size=4021416 2024-09-12T17:36:49.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.856+0000 7fa80ca76780 1 < completed write operation key=R02234GEWV6B tag=8DQOHSE2U0G5 type=write size=519514 2024-09-12T17:36:49.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.857+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=EKQQPSTRN0M8 type=write size=950785 2024-09-12T17:36:49.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.858+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~YCFYHV8FKS83.0 size=1048576 2024-09-12T17:36:49.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.859+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~YCFYHV8FKS83.1 size=1035749 2024-09-12T17:36:49.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.861+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=YCFYHV8FKS83 tag=L7H1JEDYOU2H type=write size=3132901 2024-09-12T17:36:49.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.864+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~9Y6SCTZQRQK6.0 size=357455 2024-09-12T17:36:49.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.864+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=9Y6SCTZQRQK6 tag=AT3QZEI7LGN1 type=write size=1406031 2024-09-12T17:36:49.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.866+0000 7fa80ca76780 1 < suggested update operation key=8Z3EPQHMA6M5 tag=4SJK6J7FEBHD type=del size=305514 2024-09-12T17:36:49.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.867+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=BTUUH4PU5X65 type=del size=1332403 2024-09-12T17:36:49.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.868+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~90W4V8R1QBQY.0 size=687347 2024-09-12T17:36:49.871 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.870+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=90W4V8R1QBQY tag=ZZAAIQAOR661 type=write size=1735923 2024-09-12T17:36:49.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.872+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~0SGKHVWUYFR0.0 size=1048576 2024-09-12T17:36:49.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.873+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~0SGKHVWUYFR0.1 size=244831 2024-09-12T17:36:49.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.873+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=0SGKHVWUYFR0 tag=VDRYR1E81MXT type=write size=2341983 2024-09-12T17:36:49.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.874+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~BY4GBPUC49O5.0 size=1048576 2024-09-12T17:36:49.876 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.875+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~BY4GBPUC49O5.1 size=1048576 2024-09-12T17:36:49.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.876+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~BY4GBPUC49O5.2 size=851002 2024-09-12T17:36:49.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.878+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=BY4GBPUC49O5 tag=N88FRTVNSXOE type=write size=3996730 2024-09-12T17:36:49.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.880+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~FBUAGXOW1SL0.0 size=1048576 2024-09-12T17:36:49.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.881+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~FBUAGXOW1SL0.1 size=638713 2024-09-12T17:36:49.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.881+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=FBUAGXOW1SL0 tag=VG33WPHTX7T3 type=write size=2735865 2024-09-12T17:36:49.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.882+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~NJO665BOY2B8.0 size=1048576 2024-09-12T17:36:49.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.883+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~NJO665BOY2B8.1 size=610108 2024-09-12T17:36:49.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.885+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=NJO665BOY2B8 tag=J2ZI6MO5KRPH type=write size=2707260 2024-09-12T17:36:49.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.886+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=KMKZYGSSG9UU type=del size=3727426 2024-09-12T17:36:49.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.888+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=5PFRE5AA515C type=del 2024-09-12T17:36:49.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.889+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=KKMYG71H5V8L type=write size=733037 2024-09-12T17:36:49.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.890+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=AAXG3CECC1O6 type=del 2024-09-12T17:36:49.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.892+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~3Y07HNW0WW42.0 size=816660 2024-09-12T17:36:49.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.892+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=3Y07HNW0WW42 tag=ST6LD9V4NNE2 type=write size=1865236 2024-09-12T17:36:49.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.893+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=J60DF0QIYFFB type=del 2024-09-12T17:36:49.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.894+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=XLXSZXJNYOXU type=del size=2949640 2024-09-12T17:36:49.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.895+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~1A3UJ6NGOC1T.0 size=311144 2024-09-12T17:36:49.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.897+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=1A3UJ6NGOC1T tag=GKCMYA8DYN0E type=write size=1359720 2024-09-12T17:36:49.899 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.898+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=G6K5B6L3NU7C type=del size=4006447 2024-09-12T17:36:49.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.899+0000 7fa80ca76780 1 < completed write operation key=0U9KSMYWT2C3 tag=UWLU78ASF6LE type=write size=937686 2024-09-12T17:36:49.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.902+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~U7DVFHL87VLL.0 size=1048576 2024-09-12T17:36:49.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.903+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~U7DVFHL87VLL.1 size=43112 2024-09-12T17:36:49.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.903+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=U7DVFHL87VLL tag=WVCDVVCM3MKQ type=write size=2140264 2024-09-12T17:36:49.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.904+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~PHPL4OQWTW1E.0 size=1048576 2024-09-12T17:36:49.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.905+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~PHPL4OQWTW1E.1 size=1048576 2024-09-12T17:36:49.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.905+0000 7fa80ca76780 1 < canceled part key=_multipart_07LPSZT2RKCC.2~PHPL4OQWTW1E.2 size=390308 2024-09-12T17:36:49.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.907+0000 7fa80ca76780 1 < canceled multipart upload key=07LPSZT2RKCC upload=PHPL4OQWTW1E tag=S4GGBE90JBC0 type=write size=3536036 2024-09-12T17:36:49.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.909+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~2QAWFRRSFONF.0 size=1048576 2024-09-12T17:36:49.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.909+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~2QAWFRRSFONF.1 size=1048576 2024-09-12T17:36:49.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.910+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~2QAWFRRSFONF.2 size=183116 2024-09-12T17:36:49.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.910+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=2QAWFRRSFONF tag=JPR3JBY7SDUV type=write size=3328844 2024-09-12T17:36:49.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.912+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=GV1WMIQXLQ4W type=del 2024-09-12T17:36:49.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.913+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=ICD6U7287ZS7 type=del size=1445249 2024-09-12T17:36:49.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.914+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=VOLZ8AGX2ZNS type=del 2024-09-12T17:36:49.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.915+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=TCSX8312BAX6 type=del size=817906 2024-09-12T17:36:49.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.915+0000 7fa80ca76780 1 < canceled part key=_multipart_R02234GEWV6B.2~NTJ9IFOD71M0.0 size=1048576 2024-09-12T17:36:49.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.916+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~NTJ9IFOD71M0.1 size=307608 2024-09-12T17:36:49.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.918+0000 7fa80ca76780 1 < canceled multipart upload key=R02234GEWV6B upload=NTJ9IFOD71M0 tag=ZK8376NWPU9D type=write size=2404760 2024-09-12T17:36:49.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.919+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=9CBCUNS0HPJO type=write size=897979 2024-09-12T17:36:49.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.921+0000 7fa80ca76780 1 < suggested remove operation key=E25BUY271ZSI tag=YS4IF7K9OJWA type=del 2024-09-12T17:36:49.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.922+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=FVJOR5GSTO5L type=del size=486358 2024-09-12T17:36:49.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.924+0000 7fa80ca76780 1 < canceled operation key=VC1X03K12V80 tag=EKQQPSTRN0M8 type=write size=950785 2024-09-12T17:36:49.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.925+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=IS664S1M55ZU type=write size=866675 2024-09-12T17:36:49.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.925+0000 7fa80ca76780 1 < canceled part key=_multipart_5CAG55DQEF3Y.2~9Y6SCTZQRQK6.0 size=357455 2024-09-12T17:36:49.928 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.927+0000 7fa80ca76780 1 < canceled multipart upload key=5CAG55DQEF3Y upload=9Y6SCTZQRQK6 tag=AT3QZEI7LGN1 type=write size=1406031 2024-09-12T17:36:49.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.929+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=MY41KKD3AHBL type=del size=1116515 2024-09-12T17:36:49.932 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.931+0000 7fa80ca76780 1 < suggested remove operation key=54KWSI77T73A tag=BTUUH4PU5X65 type=del 2024-09-12T17:36:49.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.934+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~G86QPQXA5Z3B.0 size=911243 2024-09-12T17:36:49.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.934+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=G86QPQXA5Z3B tag=OAZ0KJ9NDFBC type=write size=1959819 2024-09-12T17:36:49.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.935+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~0SGKHVWUYFR0.0 size=1048576 2024-09-12T17:36:49.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.936+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~0SGKHVWUYFR0.1 size=244831 2024-09-12T17:36:49.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.938+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=0SGKHVWUYFR0 tag=VDRYR1E81MXT type=write size=2341983 2024-09-12T17:36:49.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.940+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~IR0AIVQ4OPK9.0 size=1048576 2024-09-12T17:36:49.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.941+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~IR0AIVQ4OPK9.1 size=929431 2024-09-12T17:36:49.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.941+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=IR0AIVQ4OPK9 tag=UPQON8B8T20B type=write size=3026583 2024-09-12T17:36:49.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.943+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~FBUAGXOW1SL0.0 size=1048576 2024-09-12T17:36:49.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.943+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~FBUAGXOW1SL0.1 size=638713 2024-09-12T17:36:49.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.945+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=FBUAGXOW1SL0 tag=VG33WPHTX7T3 type=write size=2735865 2024-09-12T17:36:49.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.947+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=ID90WB8SK1Y6 type=del size=4075578 2024-09-12T17:36:49.949 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.948+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=KMKZYGSSG9UU type=del 2024-09-12T17:36:49.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.949+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=I9BSSTYMHSDU type=del size=3426351 2024-09-12T17:36:49.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.950+0000 7fa80ca76780 1 < completed write operation key=VDD4PDR1GLWQ tag=KKMYG71H5V8L type=write size=733037 2024-09-12T17:36:49.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.952+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~HPKHG7DHM5K8.0 size=1048576 2024-09-12T17:36:49.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.953+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~HPKHG7DHM5K8.1 size=290231 2024-09-12T17:36:49.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.953+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=HPKHG7DHM5K8 tag=WOY9MAHXRY3S type=write size=2387383 2024-09-12T17:36:49.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.954+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~3Y07HNW0WW42.0 size=816660 2024-09-12T17:36:49.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.956+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=3Y07HNW0WW42 tag=ST6LD9V4NNE2 type=write size=1865236 2024-09-12T17:36:49.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.957+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=0QZY4F7YRYLB type=write size=304588 2024-09-12T17:36:49.961 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.960+0000 7fa80ca76780 1 < suggested update operation key=5CAG55DQEF3Y tag=XLXSZXJNYOXU type=del size=2949640 2024-09-12T17:36:49.963 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.962+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~0QI6P7WZM3BX.0 size=1048576 2024-09-12T17:36:49.964 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.963+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~0QI6P7WZM3BX.1 size=42111 2024-09-12T17:36:49.964 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.963+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=0QI6P7WZM3BX tag=DYPIBYJFCP7Y type=write size=2139263 2024-09-12T17:36:49.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.964+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=G6K5B6L3NU7C type=del 2024-09-12T17:36:49.966 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.965+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=4DRMSNHU61TE type=write size=121229 2024-09-12T17:36:49.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.966+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~U7DVFHL87VLL.0 size=1048576 2024-09-12T17:36:49.968 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.967+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~U7DVFHL87VLL.1 size=43112 2024-09-12T17:36:49.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.969+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=U7DVFHL87VLL tag=WVCDVVCM3MKQ type=write size=2140264 2024-09-12T17:36:49.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.971+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~ZZKXLM191E4G.0 size=1048576 2024-09-12T17:36:49.973 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.972+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~ZZKXLM191E4G.1 size=1048576 2024-09-12T17:36:49.974 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.973+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~ZZKXLM191E4G.2 size=313818 2024-09-12T17:36:49.974 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.973+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=ZZKXLM191E4G tag=IVSLBH5Z8URE type=write size=3459546 2024-09-12T17:36:49.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.974+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~2QAWFRRSFONF.0 size=1048576 2024-09-12T17:36:49.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.975+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~2QAWFRRSFONF.1 size=1048576 2024-09-12T17:36:49.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.976+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~2QAWFRRSFONF.2 size=183116 2024-09-12T17:36:49.979 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.978+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=2QAWFRRSFONF tag=JPR3JBY7SDUV type=write size=3328844 2024-09-12T17:36:49.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.979+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=WASRRKY7PZJ7 type=del size=2926385 2024-09-12T17:36:49.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.980+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=ICD6U7287ZS7 type=del 2024-09-12T17:36:49.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.982+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~D7CFQCQHP7C6.0 size=496849 2024-09-12T17:36:49.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.982+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=D7CFQCQHP7C6 tag=22CX76UGIP0E type=write size=1545425 2024-09-12T17:36:49.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.984+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=TCSX8312BAX6 type=del 2024-09-12T17:36:49.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.986+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~LHHZZQ9JPMIK.0 size=1048576 2024-09-12T17:36:49.988 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.987+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~LHHZZQ9JPMIK.1 size=983139 2024-09-12T17:36:49.988 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.987+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=LHHZZQ9JPMIK tag=1R1UTR0N1LJM type=write size=3080291 2024-09-12T17:36:49.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.988+0000 7fa80ca76780 1 < completed write operation key=H87S6AI6JT6D tag=9CBCUNS0HPJO type=write size=897979 2024-09-12T17:36:49.990 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.989+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=U2K0A13SUXPN type=del size=301299 2024-09-12T17:36:49.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.990+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=FVJOR5GSTO5L type=del 2024-09-12T17:36:49.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.991+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=NVZMVVAIGI8E type=del size=221260 2024-09-12T17:36:49.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.993+0000 7fa80ca76780 1 < completed write operation key=U8O04HYQZRJC tag=IS664S1M55ZU type=write size=866675 2024-09-12T17:36:49.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.994+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=K4T88Y17MS4A type=del size=3392156 2024-09-12T17:36:49.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.996+0000 7fa80ca76780 1 < suggested update operation key=8Z3EPQHMA6M5 tag=MY41KKD3AHBL type=del size=1116515 2024-09-12T17:36:49.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.997+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=XG0FLE3U11PR type=del size=2463907 2024-09-12T17:36:49.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:49.998+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~G86QPQXA5Z3B.0 size=911243 2024-09-12T17:36:50.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.000+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=G86QPQXA5Z3B tag=OAZ0KJ9NDFBC type=write size=1959819 2024-09-12T17:36:50.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.001+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=OPMMNFLUJR9E type=del size=4030475 2024-09-12T17:36:50.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.002+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~IR0AIVQ4OPK9.0 size=1048576 2024-09-12T17:36:50.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.003+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~IR0AIVQ4OPK9.1 size=929431 2024-09-12T17:36:50.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.005+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=IR0AIVQ4OPK9 tag=UPQON8B8T20B type=write size=3026583 2024-09-12T17:36:50.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.006+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=M1HD4K16EN9X type=del size=1116120 2024-09-12T17:36:50.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.008+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=ID90WB8SK1Y6 type=del 2024-09-12T17:36:50.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.009+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=YA2WVFA0SO1U type=del size=844659 2024-09-12T17:36:50.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.011+0000 7fa80ca76780 1 < canceled operation key=H87S6AI6JT6D tag=I9BSSTYMHSDU type=del size=3426351 2024-09-12T17:36:50.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.013+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~P9A5P90P2GHS.0 size=542117 2024-09-12T17:36:50.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.013+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=P9A5P90P2GHS tag=09H9C8AKASKO type=write size=1590693 2024-09-12T17:36:50.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.014+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~HPKHG7DHM5K8.0 size=1048576 2024-09-12T17:36:50.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.015+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~HPKHG7DHM5K8.1 size=290231 2024-09-12T17:36:50.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.017+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=HPKHG7DHM5K8 tag=WOY9MAHXRY3S type=write size=2387383 2024-09-12T17:36:50.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.019+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~9Y0EVNF159IX.0 size=1048576 2024-09-12T17:36:50.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.020+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~9Y0EVNF159IX.1 size=1048576 2024-09-12T17:36:50.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.021+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~9Y0EVNF159IX.2 size=396325 2024-09-12T17:36:50.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.021+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=9Y0EVNF159IX tag=KF9BTH520HNX type=write size=3542053 2024-09-12T17:36:50.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.022+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=0QZY4F7YRYLB type=write size=304588 2024-09-12T17:36:50.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.023+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=D63RXQACZ81B type=del size=3210904 2024-09-12T17:36:50.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.024+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~0QI6P7WZM3BX.0 size=1048576 2024-09-12T17:36:50.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.025+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~0QI6P7WZM3BX.1 size=42111 2024-09-12T17:36:50.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.027+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=0QI6P7WZM3BX tag=DYPIBYJFCP7Y type=write size=2139263 2024-09-12T17:36:50.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.028+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=CAQXLJ0LP1GR type=del size=2863253 2024-09-12T17:36:50.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.029+0000 7fa80ca76780 1 < completed write operation key=VC1X03K12V80 tag=4DRMSNHU61TE type=write size=121229 2024-09-12T17:36:50.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.030+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=FX3M6BZB1JTR type=del size=2989070 2024-09-12T17:36:50.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.031+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~ZZKXLM191E4G.0 size=1048576 2024-09-12T17:36:50.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.033+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~ZZKXLM191E4G.1 size=1048576 2024-09-12T17:36:50.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.035+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~ZZKXLM191E4G.2 size=313818 2024-09-12T17:36:50.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.037+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=ZZKXLM191E4G tag=IVSLBH5Z8URE type=write size=3459546 2024-09-12T17:36:50.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.039+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=V45STQH9GI80 type=del size=4051530 2024-09-12T17:36:50.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.041+0000 7fa80ca76780 1 < suggested update operation key=E25BUY271ZSI tag=WASRRKY7PZJ7 type=del size=2926385 2024-09-12T17:36:50.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.042+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=FAHAAJ3JBDCG type=del size=1102479 2024-09-12T17:36:50.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.043+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~D7CFQCQHP7C6.0 size=496849 2024-09-12T17:36:50.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.045+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=D7CFQCQHP7C6 tag=22CX76UGIP0E type=write size=1545425 2024-09-12T17:36:50.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.048+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~E494LIWBB08W.0 size=287830 2024-09-12T17:36:50.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.048+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=E494LIWBB08W tag=J8M9ACUR55U3 type=write size=1336406 2024-09-12T17:36:50.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.049+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~LHHZZQ9JPMIK.0 size=1048576 2024-09-12T17:36:50.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.050+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~LHHZZQ9JPMIK.1 size=983139 2024-09-12T17:36:50.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.052+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=LHHZZQ9JPMIK tag=1R1UTR0N1LJM type=write size=3080291 2024-09-12T17:36:50.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.053+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=MW1RDXA0R0ZI type=del size=2065207 2024-09-12T17:36:50.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.054+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=U2K0A13SUXPN type=del 2024-09-12T17:36:50.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.055+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=70VQEW8FRRMP type=del size=1288037 2024-09-12T17:36:50.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.057+0000 7fa80ca76780 1 < suggested remove operation key=K243DOYPYVDS tag=NVZMVVAIGI8E type=del 2024-09-12T17:36:50.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.058+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=0P04N1QSYK44 type=del size=389916 2024-09-12T17:36:50.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.060+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=K4T88Y17MS4A type=del 2024-09-12T17:36:50.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.061+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=YKVOV9IYW89A type=del size=604357 2024-09-12T17:36:50.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.062+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=XG0FLE3U11PR type=del 2024-09-12T17:36:50.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.063+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=L476DNDI7WUB type=write size=931664 2024-09-12T17:36:50.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.064+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=OPMMNFLUJR9E type=del 2024-09-12T17:36:50.066 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.065+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=E7WEZ6FEB2P5 type=del size=1741906 2024-09-12T17:36:50.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.067+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=M1HD4K16EN9X type=del 2024-09-12T17:36:50.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.069+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~XKSUN56PBVP7.0 size=1034027 2024-09-12T17:36:50.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.069+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=XKSUN56PBVP7 tag=Q6D83GFCORXX type=write size=2082603 2024-09-12T17:36:50.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.070+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=YA2WVFA0SO1U type=del 2024-09-12T17:36:50.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.072+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~G0H60OAH1HLB.0 size=1048576 2024-09-12T17:36:50.074 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.073+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~G0H60OAH1HLB.1 size=1048576 2024-09-12T17:36:50.075 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.074+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~G0H60OAH1HLB.2 size=390684 2024-09-12T17:36:50.075 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.074+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=G0H60OAH1HLB tag=V9YV4KDX8C39 type=write size=3536412 2024-09-12T17:36:50.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.075+0000 7fa80ca76780 1 < canceled part key=_multipart_DYZIHCBF3D8U.2~P9A5P90P2GHS.0 size=542117 2024-09-12T17:36:50.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.076+0000 7fa80ca76780 1 < canceled multipart upload key=DYZIHCBF3D8U upload=P9A5P90P2GHS tag=09H9C8AKASKO type=write size=1590693 2024-09-12T17:36:50.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.079+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~TCPJX5FOU3OH.0 size=1048576 2024-09-12T17:36:50.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.079+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~TCPJX5FOU3OH.1 size=332609 2024-09-12T17:36:50.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.079+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=TCPJX5FOU3OH tag=BQH6FW7JHC67 type=write size=2429761 2024-09-12T17:36:50.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.081+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~9Y0EVNF159IX.0 size=1048576 2024-09-12T17:36:50.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.081+0000 7fa80ca76780 1 < canceled part key=_multipart_WGL9JYJXSHBH.2~9Y0EVNF159IX.1 size=1048576 2024-09-12T17:36:50.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.082+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~9Y0EVNF159IX.2 size=396325 2024-09-12T17:36:50.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.084+0000 7fa80ca76780 1 < canceled multipart upload key=WGL9JYJXSHBH upload=9Y0EVNF159IX tag=KF9BTH520HNX type=write size=3542053 2024-09-12T17:36:50.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.085+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=ZA5TZLMKB12D type=del size=2245848 2024-09-12T17:36:50.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.086+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=D63RXQACZ81B type=del 2024-09-12T17:36:50.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.087+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=NLLD5E6UIPOQ type=del size=2010183 2024-09-12T17:36:50.091 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.090+0000 7fa80ca76780 1 < suggested remove operation key=0X3LGXL2QFRN tag=CAQXLJ0LP1GR type=del 2024-09-12T17:36:50.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.091+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=6JGZZ30AFM3V type=write size=773761 2024-09-12T17:36:50.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.092+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=FX3M6BZB1JTR type=del 2024-09-12T17:36:50.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.093+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=1XP2XVDWKUB7 type=del size=4002770 2024-09-12T17:36:50.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.096+0000 7fa80ca76780 1 < suggested update operation key=R02234GEWV6B tag=V45STQH9GI80 type=del size=4051530 2024-09-12T17:36:50.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.097+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=PBTQ85OHH4CQ type=del size=4085780 2024-09-12T17:36:50.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.100+0000 7fa80ca76780 1 < suggested update operation key=07LPSZT2RKCC tag=FAHAAJ3JBDCG type=del size=1102479 2024-09-12T17:36:50.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.102+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~Q2LXELX13M8A.0 size=933192 2024-09-12T17:36:50.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.102+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=Q2LXELX13M8A tag=DAVQAVXSJQI2 type=write size=1981768 2024-09-12T17:36:50.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.103+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~E494LIWBB08W.0 size=287830 2024-09-12T17:36:50.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.105+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=E494LIWBB08W tag=J8M9ACUR55U3 type=write size=1336406 2024-09-12T17:36:50.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.108+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~GYZYLT57O0KY.0 size=1048576 2024-09-12T17:36:50.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.109+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~GYZYLT57O0KY.1 size=1048576 2024-09-12T17:36:50.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.110+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~GYZYLT57O0KY.2 size=132210 2024-09-12T17:36:50.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.110+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=GYZYLT57O0KY tag=CHJNB3WE5GU7 type=write size=3277938 2024-09-12T17:36:50.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.111+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=MW1RDXA0R0ZI type=del 2024-09-12T17:36:50.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.112+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=1PN9N2C13NA1 type=del size=2952990 2024-09-12T17:36:50.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.114+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=70VQEW8FRRMP type=del 2024-09-12T17:36:50.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.115+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=BTXKM2LLB0UN type=del size=3987284 2024-09-12T17:36:50.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.117+0000 7fa80ca76780 1 < suggested remove operation key=FKK4IGD1436I tag=0P04N1QSYK44 type=del 2024-09-12T17:36:50.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.119+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~Y3F89S5EBAG0.0 size=1048576 2024-09-12T17:36:50.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.120+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~Y3F89S5EBAG0.1 size=985592 2024-09-12T17:36:50.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.120+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=Y3F89S5EBAG0 tag=SJRDK33D2NO8 type=write size=3082744 2024-09-12T17:36:50.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.121+0000 7fa80ca76780 -1 < failed to complete operation key=0X3LGXL2QFRN tag=YKVOV9IYW89A type=del size=604357: (22) Invalid argument 2024-09-12T17:36:50.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.123+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=MA7BY7AVQ6AU type=del size=3771948 2024-09-12T17:36:50.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.125+0000 7fa80ca76780 -1 < failed to complete operation key=07LPSZT2RKCC tag=L476DNDI7WUB type=write size=931664: (22) Invalid argument 2024-09-12T17:36:50.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.127+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~61PWFZ42RFI9.0 size=190906 2024-09-12T17:36:50.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.127+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=61PWFZ42RFI9 tag=990J0B9URTNZ type=write size=1239482 2024-09-12T17:36:50.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.128+0000 7fa80ca76780 1 < canceled operation key=U8O04HYQZRJC tag=E7WEZ6FEB2P5 type=del size=1741906 2024-09-12T17:36:50.131 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.130+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=3686281SX2KC type=del size=661010 2024-09-12T17:36:50.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.131+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~XKSUN56PBVP7.0 size=1034027 2024-09-12T17:36:50.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.134+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=XKSUN56PBVP7 tag=Q6D83GFCORXX type=write size=2082603 2024-09-12T17:36:50.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.136+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~GMEUZXRN521X.0 size=1048576 2024-09-12T17:36:50.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.136+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~GMEUZXRN521X.1 size=577513 2024-09-12T17:36:50.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.136+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=GMEUZXRN521X tag=3CXW9U3FDFND type=write size=2674665 2024-09-12T17:36:50.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.138+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~G0H60OAH1HLB.0 size=1048576 2024-09-12T17:36:50.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.138+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~G0H60OAH1HLB.1 size=1048576 2024-09-12T17:36:50.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.139+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~G0H60OAH1HLB.2 size=390684 2024-09-12T17:36:50.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.141+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=G0H60OAH1HLB tag=V9YV4KDX8C39 type=write size=3536412 2024-09-12T17:36:50.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.142+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=Z6FSEPF0PA0Q type=del size=3787184 2024-09-12T17:36:50.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.144+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~TCPJX5FOU3OH.0 size=1048576 2024-09-12T17:36:50.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.145+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~TCPJX5FOU3OH.1 size=332609 2024-09-12T17:36:50.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.147+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=TCPJX5FOU3OH tag=BQH6FW7JHC67 type=write size=2429761 2024-09-12T17:36:50.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.149+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~J5RJ41GRZMQR.0 size=1048576 2024-09-12T17:36:50.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.150+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~J5RJ41GRZMQR.1 size=965542 2024-09-12T17:36:50.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.150+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=J5RJ41GRZMQR tag=0KUBVLQL4JUB type=write size=3062694 2024-09-12T17:36:50.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.151+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=ZA5TZLMKB12D type=del 2024-09-12T17:36:50.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.152+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=FVIIWJG8GT1L type=del size=546844 2024-09-12T17:36:50.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.154+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=NLLD5E6UIPOQ type=del 2024-09-12T17:36:50.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.155+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=G7LJYQ6223PZ type=del size=2929462 2024-09-12T17:36:50.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.156+0000 7fa80ca76780 1 < completed write operation key=VC1X03K12V80 tag=6JGZZ30AFM3V type=write size=773761 2024-09-12T17:36:50.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.158+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~CT5JQKCXBMIW.0 size=719593 2024-09-12T17:36:50.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.158+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=CT5JQKCXBMIW tag=J5I38LXFSFMZ type=write size=1768169 2024-09-12T17:36:50.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.159+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=1XP2XVDWKUB7 type=del 2024-09-12T17:36:50.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.161+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~O5O2HHSGE1KY.0 size=1048576 2024-09-12T17:36:50.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.162+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~O5O2HHSGE1KY.1 size=1048576 2024-09-12T17:36:50.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.163+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~O5O2HHSGE1KY.2 size=318825 2024-09-12T17:36:50.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.163+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=O5O2HHSGE1KY tag=J08GGTFMS79W type=write size=3464553 2024-09-12T17:36:50.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.165+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=PBTQ85OHH4CQ type=del 2024-09-12T17:36:50.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.167+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~QB3E9MX3P2L0.0 size=651522 2024-09-12T17:36:50.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.167+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=QB3E9MX3P2L0 tag=QB8D786JHGBA type=write size=1700098 2024-09-12T17:36:50.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.168+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~Q2LXELX13M8A.0 size=933192 2024-09-12T17:36:50.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.170+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=Q2LXELX13M8A tag=DAVQAVXSJQI2 type=write size=1981768 2024-09-12T17:36:50.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.171+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=80IC92XS3ANQ type=write size=140364 2024-09-12T17:36:50.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.172+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~GYZYLT57O0KY.0 size=1048576 2024-09-12T17:36:50.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.173+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~GYZYLT57O0KY.1 size=1048576 2024-09-12T17:36:50.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.174+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~GYZYLT57O0KY.2 size=132210 2024-09-12T17:36:50.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.176+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=GYZYLT57O0KY tag=CHJNB3WE5GU7 type=write size=3277938 2024-09-12T17:36:50.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.178+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~EVNI0L0CSD9R.0 size=1048576 2024-09-12T17:36:50.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.179+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~EVNI0L0CSD9R.1 size=637042 2024-09-12T17:36:50.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.179+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=EVNI0L0CSD9R tag=59F0APKQGRYZ type=write size=2734194 2024-09-12T17:36:50.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.180+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=1PN9N2C13NA1 type=del 2024-09-12T17:36:50.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.182+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~YDVTND8TR36W.0 size=1048576 2024-09-12T17:36:50.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.183+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~YDVTND8TR36W.1 size=1048576 2024-09-12T17:36:50.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.184+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~YDVTND8TR36W.2 size=718932 2024-09-12T17:36:50.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.184+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=YDVTND8TR36W tag=RIQ24NHXGY05 type=write size=3864660 2024-09-12T17:36:50.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.185+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=BTXKM2LLB0UN type=del 2024-09-12T17:36:50.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.186+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=I5HHPYMR1E6N type=del size=1979750 2024-09-12T17:36:50.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.188+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~Y3F89S5EBAG0.0 size=1048576 2024-09-12T17:36:50.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.188+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~Y3F89S5EBAG0.1 size=985592 2024-09-12T17:36:50.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.190+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=Y3F89S5EBAG0 tag=SJRDK33D2NO8 type=write size=3082744 2024-09-12T17:36:50.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.191+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=3DC995PIPMAN type=del size=3342103 2024-09-12T17:36:50.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.193+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=MA7BY7AVQ6AU type=del 2024-09-12T17:36:50.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.194+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=EPW3NYXOMW17 type=write size=994806 2024-09-12T17:36:50.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.195+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~61PWFZ42RFI9.0 size=190906 2024-09-12T17:36:50.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.197+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=61PWFZ42RFI9 tag=990J0B9URTNZ type=write size=1239482 2024-09-12T17:36:50.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.198+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=GDIMHYJ8H77K type=write size=656568 2024-09-12T17:36:50.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.199+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=3686281SX2KC type=del 2024-09-12T17:36:50.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.200+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=Q416P0LRR0H8 type=del size=1561905 2024-09-12T17:36:50.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.201+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~GMEUZXRN521X.0 size=1048576 2024-09-12T17:36:50.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.202+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~GMEUZXRN521X.1 size=577513 2024-09-12T17:36:50.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.204+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=GMEUZXRN521X tag=3CXW9U3FDFND type=write size=2674665 2024-09-12T17:36:50.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.206+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~D042DMTBERCB.0 size=1048576 2024-09-12T17:36:50.208 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.207+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~D042DMTBERCB.1 size=809698 2024-09-12T17:36:50.208 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.207+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=D042DMTBERCB tag=JRUXXOSPG1E3 type=write size=2906850 2024-09-12T17:36:50.210 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.209+0000 7fa80ca76780 1 < suggested remove operation key=DYZIHCBF3D8U tag=Z6FSEPF0PA0Q type=del 2024-09-12T17:36:50.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.210+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=LS7YGAXSU5V3 type=del size=964615 2024-09-12T17:36:50.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.211+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~J5RJ41GRZMQR.0 size=1048576 2024-09-12T17:36:50.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.212+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~J5RJ41GRZMQR.1 size=965542 2024-09-12T17:36:50.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.214+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=J5RJ41GRZMQR tag=0KUBVLQL4JUB type=write size=3062694 2024-09-12T17:36:50.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.215+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=YAZ8A2J45CKT type=del size=3012548 2024-09-12T17:36:50.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.216+0000 7fa80ca76780 1 < canceled operation key=Z81704G91EPL tag=FVIIWJG8GT1L type=del size=546844 2024-09-12T17:36:50.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.218+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~XUYPBOXZXH8J.0 size=803176 2024-09-12T17:36:50.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.218+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=XUYPBOXZXH8J tag=22CAQF1OQPA4 type=write size=1851752 2024-09-12T17:36:50.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.219+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=G7LJYQ6223PZ type=del 2024-09-12T17:36:50.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.220+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=VFU9L6RNP9EH type=del size=593929 2024-09-12T17:36:50.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.221+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~CT5JQKCXBMIW.0 size=719593 2024-09-12T17:36:50.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.223+0000 7fa80ca76780 1 < completed multipart upload key=07LPSZT2RKCC upload=CT5JQKCXBMIW tag=J5I38LXFSFMZ type=write size=1768169 2024-09-12T17:36:50.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.225+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~5XY1NQD1NQRJ.0 size=1002528 2024-09-12T17:36:50.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.225+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=5XY1NQD1NQRJ tag=121YB0EIB51S type=write size=2051104 2024-09-12T17:36:50.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.226+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~O5O2HHSGE1KY.0 size=1048576 2024-09-12T17:36:50.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.227+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~O5O2HHSGE1KY.1 size=1048576 2024-09-12T17:36:50.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.228+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~O5O2HHSGE1KY.2 size=318825 2024-09-12T17:36:50.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.231+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=O5O2HHSGE1KY tag=J08GGTFMS79W type=write size=3464553 2024-09-12T17:36:50.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.234+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=LD4XUKA5IDHN type=del size=2393881 2024-09-12T17:36:50.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.235+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~QB3E9MX3P2L0.0 size=651522 2024-09-12T17:36:50.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.237+0000 7fa80ca76780 1 < completed multipart upload key=U8O04HYQZRJC upload=QB3E9MX3P2L0 tag=QB8D786JHGBA type=write size=1700098 2024-09-12T17:36:50.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.239+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~SGA6EEST6P49.0 size=1048576 2024-09-12T17:36:50.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.240+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~SGA6EEST6P49.1 size=499340 2024-09-12T17:36:50.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.240+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=SGA6EEST6P49 tag=E2VOQGFF2DJL type=write size=2596492 2024-09-12T17:36:50.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.241+0000 7fa80ca76780 1 < canceled operation key=AKE8O7Q277HX tag=80IC92XS3ANQ type=write size=140364 2024-09-12T17:36:50.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.242+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=MAFDNK5MTVPQ type=write size=191661 2024-09-12T17:36:50.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.243+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~EVNI0L0CSD9R.0 size=1048576 2024-09-12T17:36:50.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.244+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~EVNI0L0CSD9R.1 size=637042 2024-09-12T17:36:50.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.246+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=EVNI0L0CSD9R tag=59F0APKQGRYZ type=write size=2734194 2024-09-12T17:36:50.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.247+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=LNNZPYFJU09G type=write size=76294 2024-09-12T17:36:50.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.248+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~YDVTND8TR36W.0 size=1048576 2024-09-12T17:36:50.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.249+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~YDVTND8TR36W.1 size=1048576 2024-09-12T17:36:50.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.250+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~YDVTND8TR36W.2 size=718932 2024-09-12T17:36:50.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.252+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=YDVTND8TR36W tag=RIQ24NHXGY05 type=write size=3864660 2024-09-12T17:36:50.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.254+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~EREJ7UU2EJIB.0 size=1048576 2024-09-12T17:36:50.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.255+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~EREJ7UU2EJIB.1 size=684840 2024-09-12T17:36:50.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.255+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=EREJ7UU2EJIB tag=5444KGOFQ1BA type=write size=2781992 2024-09-12T17:36:50.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.256+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=I5HHPYMR1E6N type=del 2024-09-12T17:36:50.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.258+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~4ODWJQPG6MMW.0 size=1048576 2024-09-12T17:36:50.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.259+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~4ODWJQPG6MMW.1 size=905819 2024-09-12T17:36:50.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.259+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=4ODWJQPG6MMW tag=TIS9JPXYE956 type=write size=3002971 2024-09-12T17:36:50.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.260+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=3DC995PIPMAN type=del 2024-09-12T17:36:50.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.261+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=2D62RSKM2RP8 type=del size=705676 2024-09-12T17:36:50.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.263+0000 7fa80ca76780 1 < suggested update operation key=4S33294MWCO1 tag=EPW3NYXOMW17 type=write size=994806 2024-09-12T17:36:50.266 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.265+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~N0HFSPU4B4L9.0 size=1048576 2024-09-12T17:36:50.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.266+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~N0HFSPU4B4L9.1 size=1048576 2024-09-12T17:36:50.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.267+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~N0HFSPU4B4L9.2 size=650527 2024-09-12T17:36:50.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.267+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=N0HFSPU4B4L9 tag=G3W9SAQ8CKOT type=write size=3796255 2024-09-12T17:36:50.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.269+0000 7fa80ca76780 1 < suggested remove operation key=0U9KSMYWT2C3 tag=GDIMHYJ8H77K type=write 2024-09-12T17:36:50.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.270+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=2QYN9JQ4YP34 type=del size=209339 2024-09-12T17:36:50.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.272+0000 7fa80ca76780 1 < suggested remove operation key=0U9KSMYWT2C3 tag=Q416P0LRR0H8 type=del 2024-09-12T17:36:50.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.274+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~I07YJAXIPT8V.0 size=1048576 2024-09-12T17:36:50.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.275+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~I07YJAXIPT8V.1 size=1048576 2024-09-12T17:36:50.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.276+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~I07YJAXIPT8V.2 size=120164 2024-09-12T17:36:50.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.276+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=I07YJAXIPT8V tag=4Z4QUKU28Z3R type=write size=3265892 2024-09-12T17:36:50.278 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.277+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~D042DMTBERCB.0 size=1048576 2024-09-12T17:36:50.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.278+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~D042DMTBERCB.1 size=809698 2024-09-12T17:36:50.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.280+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=D042DMTBERCB tag=JRUXXOSPG1E3 type=write size=2906850 2024-09-12T17:36:50.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.281+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=6DD7AOFWTDO2 type=write size=230276 2024-09-12T17:36:50.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.282+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=LS7YGAXSU5V3 type=del 2024-09-12T17:36:50.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.284+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=IJ9UTVGLCVP9 type=write size=423894 2024-09-12T17:36:50.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.286+0000 7fa80ca76780 1 < suggested remove operation key=DYZIHCBF3D8U tag=YAZ8A2J45CKT type=del 2024-09-12T17:36:50.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.287+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=FG6ZKC9A9523 type=write size=119558 2024-09-12T17:36:50.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.288+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~XUYPBOXZXH8J.0 size=803176 2024-09-12T17:36:50.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.290+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=XUYPBOXZXH8J tag=22CAQF1OQPA4 type=write size=1851752 2024-09-12T17:36:50.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.291+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=Q7035A40H8NA type=del size=1715878 2024-09-12T17:36:50.294 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.293+0000 7fa80ca76780 1 < suggested remove operation key=5CAG55DQEF3Y tag=VFU9L6RNP9EH type=del 2024-09-12T17:36:50.296 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.295+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=X3AWQ310TH9O type=del size=958897 2024-09-12T17:36:50.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.296+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~5XY1NQD1NQRJ.0 size=1002528 2024-09-12T17:36:50.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.298+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=5XY1NQD1NQRJ tag=121YB0EIB51S type=write size=2051104 2024-09-12T17:36:50.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.299+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=YUHGUHQV30YV type=del size=3366208 2024-09-12T17:36:50.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.300+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=LD4XUKA5IDHN type=del 2024-09-12T17:36:50.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.301+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=KWQ62IIIKOMP type=del size=3713100 2024-09-12T17:36:50.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.302+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~SGA6EEST6P49.0 size=1048576 2024-09-12T17:36:50.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.303+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~SGA6EEST6P49.1 size=499340 2024-09-12T17:36:50.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.305+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=SGA6EEST6P49 tag=E2VOQGFF2DJL type=write size=2596492 2024-09-12T17:36:50.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.306+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=KPOPUQ2YFEQ5 type=write size=606188 2024-09-12T17:36:50.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.307+0000 7fa80ca76780 1 < completed write operation key=BLGMV3S9AY24 tag=MAFDNK5MTVPQ type=write size=191661 2024-09-12T17:36:50.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.309+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~J55YMXVBAL4Z.0 size=934699 2024-09-12T17:36:50.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.309+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=J55YMXVBAL4Z tag=CONV8O2MMIVP type=write size=1983275 2024-09-12T17:36:50.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.311+0000 7fa80ca76780 -1 < failed to complete operation key=4S33294MWCO1 tag=LNNZPYFJU09G type=write size=76294: (22) Invalid argument 2024-09-12T17:36:50.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.315+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~NBDAUK5S96K6.0 size=1048576 2024-09-12T17:36:50.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.315+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~NBDAUK5S96K6.1 size=169567 2024-09-12T17:36:50.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.315+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=NBDAUK5S96K6 tag=21BJA1J411H0 type=write size=2266719 2024-09-12T17:36:50.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.317+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~EREJ7UU2EJIB.0 size=1048576 2024-09-12T17:36:50.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.317+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~EREJ7UU2EJIB.1 size=684840 2024-09-12T17:36:50.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.319+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=EREJ7UU2EJIB tag=5444KGOFQ1BA type=write size=2781992 2024-09-12T17:36:50.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.320+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=W9MU08CL25K9 type=del size=119557 2024-09-12T17:36:50.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.322+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~4ODWJQPG6MMW.0 size=1048576 2024-09-12T17:36:50.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.323+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~4ODWJQPG6MMW.1 size=905819 2024-09-12T17:36:50.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.324+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=4ODWJQPG6MMW tag=TIS9JPXYE956 type=write size=3002971 2024-09-12T17:36:50.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.326+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~GO8Q7UXX1VKY.0 size=1048576 2024-09-12T17:36:50.328 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.327+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~GO8Q7UXX1VKY.1 size=1048576 2024-09-12T17:36:50.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.328+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~GO8Q7UXX1VKY.2 size=609490 2024-09-12T17:36:50.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.328+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=GO8Q7UXX1VKY tag=X9MTZCAG5MSM type=write size=3755218 2024-09-12T17:36:50.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.330+0000 7fa80ca76780 1 < suggested update operation key=E25BUY271ZSI tag=2D62RSKM2RP8 type=del size=705676 2024-09-12T17:36:50.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.332+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=6SN2RO0PHML5 type=del size=1272746 2024-09-12T17:36:50.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.332+0000 7fa80ca76780 1 < canceled part key=_multipart_EDRL3T2I9AOO.2~N0HFSPU4B4L9.0 size=1048576 2024-09-12T17:36:50.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.333+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~N0HFSPU4B4L9.1 size=1048576 2024-09-12T17:36:50.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.334+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~N0HFSPU4B4L9.2 size=650527 2024-09-12T17:36:50.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.335+0000 7fa80ca76780 1 < canceled multipart upload key=EDRL3T2I9AOO upload=N0HFSPU4B4L9 tag=G3W9SAQ8CKOT type=write size=3796255 2024-09-12T17:36:50.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.337+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=3SHQHVWTMFER type=del size=1444223 2024-09-12T17:36:50.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.339+0000 7fa80ca76780 -1 < failed to complete operation key=0U9KSMYWT2C3 tag=2QYN9JQ4YP34 type=del size=209339: (22) Invalid argument 2024-09-12T17:36:50.342 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.341+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~5NOWVDXEVHW3.0 size=836370 2024-09-12T17:36:50.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.341+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=5NOWVDXEVHW3 tag=YSXVQDVO4LDY type=write size=1884946 2024-09-12T17:36:50.344 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.343+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~I07YJAXIPT8V.0 size=1048576 2024-09-12T17:36:50.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.343+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~I07YJAXIPT8V.1 size=1048576 2024-09-12T17:36:50.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.343+0000 7fa80ca76780 1 < canceled part key=_multipart_R871XU2TDWID.2~I07YJAXIPT8V.2 size=120164 2024-09-12T17:36:50.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.345+0000 7fa80ca76780 1 < canceled multipart upload key=R871XU2TDWID upload=I07YJAXIPT8V tag=4Z4QUKU28Z3R type=write size=3265892 2024-09-12T17:36:50.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.346+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=E0HFVSX7PALE type=write size=971856 2024-09-12T17:36:50.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.347+0000 7fa80ca76780 1 < completed write operation key=94801LE91HZ9 tag=6DD7AOFWTDO2 type=write size=230276 2024-09-12T17:36:50.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.349+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=MYK8C6BHXUWS type=del size=3344613 2024-09-12T17:36:50.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.350+0000 7fa80ca76780 1 < canceled operation key=LU7PDGWTAK63 tag=IJ9UTVGLCVP9 type=write size=423894 2024-09-12T17:36:50.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.352+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~IDRCTMCEZYW2.0 size=315673 2024-09-12T17:36:50.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.352+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=IDRCTMCEZYW2 tag=HSCOCGAHB0QI type=write size=1364249 2024-09-12T17:36:50.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.353+0000 7fa80ca76780 1 < canceled operation key=RC1IX4DQREEP tag=FG6ZKC9A9523 type=write size=119558 2024-09-12T17:36:50.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.355+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~VQROQOY1JJ0T.0 size=1048576 2024-09-12T17:36:50.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.355+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~VQROQOY1JJ0T.1 size=1048576 2024-09-12T17:36:50.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.356+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~VQROQOY1JJ0T.2 size=379956 2024-09-12T17:36:50.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.356+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=VQROQOY1JJ0T tag=W1KNYORB1T77 type=write size=3525684 2024-09-12T17:36:50.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.358+0000 7fa80ca76780 1 < suggested update operation key=EDRL3T2I9AOO tag=Q7035A40H8NA type=del size=1715878 2024-09-12T17:36:50.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.359+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=HAWNYFSG7HPT type=del size=2304222 2024-09-12T17:36:50.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.362+0000 7fa80ca76780 1 < suggested remove operation key=EDRL3T2I9AOO tag=X3AWQ310TH9O type=del 2024-09-12T17:36:50.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.363+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=6A2SZOSMW7MK type=write size=194385 2024-09-12T17:36:50.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.364+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=YUHGUHQV30YV type=del 2024-09-12T17:36:50.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.366+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~E0VUS0J400E5.0 size=450848 2024-09-12T17:36:50.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.366+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=E0VUS0J400E5 tag=SY0MEFM1150E type=write size=1499424 2024-09-12T17:36:50.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.367+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=KWQ62IIIKOMP type=del 2024-09-12T17:36:50.369 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.368+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=1439ZJ1TPRKM type=del size=4108936 2024-09-12T17:36:50.370 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.369+0000 7fa80ca76780 1 < completed write operation key=7QHTQ6VHZ34P tag=KPOPUQ2YFEQ5 type=write size=606188 2024-09-12T17:36:50.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.370+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=2EAR0QKR1KXM type=del size=2180109 2024-09-12T17:36:50.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.371+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~J55YMXVBAL4Z.0 size=934699 2024-09-12T17:36:50.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.374+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=J55YMXVBAL4Z tag=CONV8O2MMIVP type=write size=1983275 2024-09-12T17:36:50.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.375+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=P93CK1SN5GPC type=del size=1186934 2024-09-12T17:36:50.377 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.376+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~NBDAUK5S96K6.0 size=1048576 2024-09-12T17:36:50.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.377+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~NBDAUK5S96K6.1 size=169567 2024-09-12T17:36:50.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.379+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=NBDAUK5S96K6 tag=21BJA1J411H0 type=write size=2266719 2024-09-12T17:36:50.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.380+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=N4H1HK2IBDJS type=del size=1677135 2024-09-12T17:36:50.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.381+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=W9MU08CL25K9 type=del 2024-09-12T17:36:50.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.383+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~DX8DFEPRJ391.0 size=597173 2024-09-12T17:36:50.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.383+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=DX8DFEPRJ391 tag=5F1X45S8NRA2 type=write size=1645749 2024-09-12T17:36:50.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.385+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~GO8Q7UXX1VKY.0 size=1048576 2024-09-12T17:36:50.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.386+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~GO8Q7UXX1VKY.1 size=1048576 2024-09-12T17:36:50.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.387+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~GO8Q7UXX1VKY.2 size=609490 2024-09-12T17:36:50.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.388+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=GO8Q7UXX1VKY tag=X9MTZCAG5MSM type=write size=3755218 2024-09-12T17:36:50.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.390+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~5M5KK9LB0OZQ.0 size=1048576 2024-09-12T17:36:50.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.391+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~5M5KK9LB0OZQ.1 size=843782 2024-09-12T17:36:50.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.391+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=5M5KK9LB0OZQ tag=SSWMJSWYF1JL type=write size=2940934 2024-09-12T17:36:50.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.392+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=6SN2RO0PHML5 type=del 2024-09-12T17:36:50.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.394+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~QYLH5NRACA6B.0 size=1048576 2024-09-12T17:36:50.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.395+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~QYLH5NRACA6B.1 size=1048576 2024-09-12T17:36:50.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.396+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~QYLH5NRACA6B.2 size=258880 2024-09-12T17:36:50.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.396+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=QYLH5NRACA6B tag=ZYD3KZ313H0W type=write size=3404608 2024-09-12T17:36:50.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.397+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=3SHQHVWTMFER type=del 2024-09-12T17:36:50.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.398+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=SWGO6DA1N8UT type=write size=282686 2024-09-12T17:36:50.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.400+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~5NOWVDXEVHW3.0 size=836370 2024-09-12T17:36:50.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.401+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=5NOWVDXEVHW3 tag=YSXVQDVO4LDY type=write size=1884946 2024-09-12T17:36:50.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.402+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=FTO175TBM3D9 type=write size=725633 2024-09-12T17:36:50.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.404+0000 7fa80ca76780 1 < canceled operation key=8Z3EPQHMA6M5 tag=E0HFVSX7PALE type=write size=971856 2024-09-12T17:36:50.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.405+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=WVAU0BD1N4MI type=del size=1486200 2024-09-12T17:36:50.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.406+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=MYK8C6BHXUWS type=del 2024-09-12T17:36:50.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.407+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=YBSOHXK2BG2D type=del size=3248630 2024-09-12T17:36:50.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.408+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~IDRCTMCEZYW2.0 size=315673 2024-09-12T17:36:50.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.410+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=IDRCTMCEZYW2 tag=HSCOCGAHB0QI type=write size=1364249 2024-09-12T17:36:50.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.411+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=6UTRR1GO05RJ type=write size=481465 2024-09-12T17:36:50.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.412+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~VQROQOY1JJ0T.0 size=1048576 2024-09-12T17:36:50.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.413+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~VQROQOY1JJ0T.1 size=1048576 2024-09-12T17:36:50.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.414+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~VQROQOY1JJ0T.2 size=379956 2024-09-12T17:36:50.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.416+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=VQROQOY1JJ0T tag=W1KNYORB1T77 type=write size=3525684 2024-09-12T17:36:50.419 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.418+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~U0ZAMQ710I2H.0 size=1048576 2024-09-12T17:36:50.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.419+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~U0ZAMQ710I2H.1 size=959744 2024-09-12T17:36:50.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.419+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=U0ZAMQ710I2H tag=FQ25C0M64I0B type=write size=3056896 2024-09-12T17:36:50.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.420+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=HAWNYFSG7HPT type=del 2024-09-12T17:36:50.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.422+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=O47XKO25D7P0 type=del size=1485140 2024-09-12T17:36:50.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.423+0000 7fa80ca76780 1 < completed write operation key=8Z3EPQHMA6M5 tag=6A2SZOSMW7MK type=write size=194385 2024-09-12T17:36:50.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.425+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~M1UMFPV4ZSS4.0 size=1048576 2024-09-12T17:36:50.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.426+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~M1UMFPV4ZSS4.1 size=1014338 2024-09-12T17:36:50.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.426+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=M1UMFPV4ZSS4 tag=LFGGBAFEDNGW type=write size=3111490 2024-09-12T17:36:50.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.427+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~E0VUS0J400E5.0 size=450848 2024-09-12T17:36:50.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.429+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=E0VUS0J400E5 tag=SY0MEFM1150E type=write size=1499424 2024-09-12T17:36:50.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.431+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~5GB1JFLUHLY8.0 size=1048576 2024-09-12T17:36:50.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.432+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~5GB1JFLUHLY8.1 size=377565 2024-09-12T17:36:50.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.432+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=5GB1JFLUHLY8 tag=CX9MR9V0MI4H type=write size=2474717 2024-09-12T17:36:50.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.433+0000 7fa80ca76780 1 < canceled operation key=K243DOYPYVDS tag=1439ZJ1TPRKM type=del size=4108936 2024-09-12T17:36:50.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.435+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~AZC033POIN1F.0 size=1048576 2024-09-12T17:36:50.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.436+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~AZC033POIN1F.1 size=1048576 2024-09-12T17:36:50.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.437+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~AZC033POIN1F.2 size=49283 2024-09-12T17:36:50.439 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.437+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=AZC033POIN1F tag=GSYGNZQCMUKC type=write size=3195011 2024-09-12T17:36:50.439 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.438+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=2EAR0QKR1KXM type=del 2024-09-12T17:36:50.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.440+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~00XDMZNKRTO1.0 size=1048576 2024-09-12T17:36:50.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.441+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~00XDMZNKRTO1.1 size=426771 2024-09-12T17:36:50.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.441+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=00XDMZNKRTO1 tag=5Y0I7VZX8H27 type=write size=2523923 2024-09-12T17:36:50.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.443+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=P93CK1SN5GPC type=del 2024-09-12T17:36:50.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.446+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~2E4294BTBWT1.0 size=1048576 2024-09-12T17:36:50.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.446+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~2E4294BTBWT1.1 size=1048576 2024-09-12T17:36:50.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.448+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~2E4294BTBWT1.2 size=50336 2024-09-12T17:36:50.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.448+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=2E4294BTBWT1 tag=KC6F4X6UJVNY type=write size=3196064 2024-09-12T17:36:50.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.449+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=N4H1HK2IBDJS type=del 2024-09-12T17:36:50.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.451+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~7YAJJ1O5LIJ6.0 size=1048576 2024-09-12T17:36:50.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.452+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~7YAJJ1O5LIJ6.1 size=1048576 2024-09-12T17:36:50.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.453+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~7YAJJ1O5LIJ6.2 size=942432 2024-09-12T17:36:50.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.453+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=7YAJJ1O5LIJ6 tag=YX81RT28Y70K type=write size=4088160 2024-09-12T17:36:50.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.454+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~DX8DFEPRJ391.0 size=597173 2024-09-12T17:36:50.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.456+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=DX8DFEPRJ391 tag=5F1X45S8NRA2 type=write size=1645749 2024-09-12T17:36:50.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.457+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=VZZIJU7OIL47 type=del size=266162 2024-09-12T17:36:50.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.458+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~5M5KK9LB0OZQ.0 size=1048576 2024-09-12T17:36:50.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.459+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~5M5KK9LB0OZQ.1 size=843782 2024-09-12T17:36:50.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.461+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=5M5KK9LB0OZQ tag=SSWMJSWYF1JL type=write size=2940934 2024-09-12T17:36:50.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.462+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~9A2NQRUZMJC1.0 size=1048576 2024-09-12T17:36:50.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.463+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~9A2NQRUZMJC1.1 size=876864 2024-09-12T17:36:50.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.463+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=9A2NQRUZMJC1 tag=YCYVWSVICL2K type=write size=2974016 2024-09-12T17:36:50.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.465+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~QYLH5NRACA6B.0 size=1048576 2024-09-12T17:36:50.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.466+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~QYLH5NRACA6B.1 size=1048576 2024-09-12T17:36:50.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.466+0000 7fa80ca76780 1 < canceled part key=_multipart_H87S6AI6JT6D.2~QYLH5NRACA6B.2 size=258880 2024-09-12T17:36:50.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.468+0000 7fa80ca76780 1 < canceled multipart upload key=H87S6AI6JT6D upload=QYLH5NRACA6B tag=ZYD3KZ313H0W type=write size=3404608 2024-09-12T17:36:50.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.469+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=LARI3EG08XEV type=del size=1414791 2024-09-12T17:36:50.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.473+0000 7fa80ca76780 1 < suggested update operation key=0J6RTRJWZP1T tag=SWGO6DA1N8UT type=write size=282686 2024-09-12T17:36:50.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.475+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~HWUCQQS7DHRL.0 size=687262 2024-09-12T17:36:50.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.475+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=HWUCQQS7DHRL tag=6Y2YX48US4E2 type=write size=1735838 2024-09-12T17:36:50.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.476+0000 7fa80ca76780 1 < canceled operation key=2AGKLZ3PQ2FD tag=FTO175TBM3D9 type=write size=725633 2024-09-12T17:36:50.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.478+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~S853261XRJB7.0 size=1048576 2024-09-12T17:36:50.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.479+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~S853261XRJB7.1 size=216391 2024-09-12T17:36:50.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.479+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=S853261XRJB7 tag=HJBGIQ54WO9Z type=write size=2313543 2024-09-12T17:36:50.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.480+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=WVAU0BD1N4MI type=del 2024-09-12T17:36:50.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.482+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~THXN8GP5OMIK.0 size=1048576 2024-09-12T17:36:50.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.483+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~THXN8GP5OMIK.1 size=1037035 2024-09-12T17:36:50.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.483+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=THXN8GP5OMIK tag=MUUE13TRZGCH type=write size=3134187 2024-09-12T17:36:50.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.484+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=YBSOHXK2BG2D type=del 2024-09-12T17:36:50.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.486+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~GRIYO19CJQC1.0 size=625200 2024-09-12T17:36:50.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.486+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=GRIYO19CJQC1 tag=KGCCUF0LMJ7R type=write size=1673776 2024-09-12T17:36:50.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.487+0000 7fa80ca76780 1 < completed write operation key=GKE6623N268Z tag=6UTRR1GO05RJ type=write size=481465 2024-09-12T17:36:50.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.489+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~0JNOTY3B0XHV.0 size=1048576 2024-09-12T17:36:50.491 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.490+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~0JNOTY3B0XHV.1 size=136072 2024-09-12T17:36:50.491 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.490+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=0JNOTY3B0XHV tag=I6XFM3BM0HHX type=write size=2233224 2024-09-12T17:36:50.492 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.491+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~U0ZAMQ710I2H.0 size=1048576 2024-09-12T17:36:50.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.492+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~U0ZAMQ710I2H.1 size=959744 2024-09-12T17:36:50.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.494+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=U0ZAMQ710I2H tag=FQ25C0M64I0B type=write size=3056896 2024-09-12T17:36:50.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.496+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~GE5H6HWLPEPN.0 size=1048576 2024-09-12T17:36:50.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.497+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~GE5H6HWLPEPN.1 size=1048576 2024-09-12T17:36:50.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.498+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~GE5H6HWLPEPN.2 size=328786 2024-09-12T17:36:50.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.498+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=GE5H6HWLPEPN tag=4NUU2MAXFMMZ type=write size=3474514 2024-09-12T17:36:50.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.499+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=O47XKO25D7P0 type=del 2024-09-12T17:36:50.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.500+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=8XA6S30GDTQQ type=del size=1505958 2024-09-12T17:36:50.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.502+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~M1UMFPV4ZSS4.0 size=1048576 2024-09-12T17:36:50.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.503+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~M1UMFPV4ZSS4.1 size=1014338 2024-09-12T17:36:50.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.504+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=M1UMFPV4ZSS4 tag=LFGGBAFEDNGW type=write size=3111490 2024-09-12T17:36:50.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.506+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=073C6229S5BJ type=del size=1461264 2024-09-12T17:36:50.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.507+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~5GB1JFLUHLY8.0 size=1048576 2024-09-12T17:36:50.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.508+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~5GB1JFLUHLY8.1 size=377565 2024-09-12T17:36:50.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.510+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=5GB1JFLUHLY8 tag=CX9MR9V0MI4H type=write size=2474717 2024-09-12T17:36:50.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.511+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=VX40OYLLJVCL type=del size=922659 2024-09-12T17:36:50.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.512+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~AZC033POIN1F.0 size=1048576 2024-09-12T17:36:50.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.513+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~AZC033POIN1F.1 size=1048576 2024-09-12T17:36:50.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.514+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~AZC033POIN1F.2 size=49283 2024-09-12T17:36:50.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.516+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=AZC033POIN1F tag=GSYGNZQCMUKC type=write size=3195011 2024-09-12T17:36:50.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.517+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=M0L0JFL8JPH4 type=del size=2265176 2024-09-12T17:36:50.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.517+0000 7fa80ca76780 1 < canceled part key=_multipart_8Z3EPQHMA6M5.2~00XDMZNKRTO1.0 size=1048576 2024-09-12T17:36:50.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.518+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~00XDMZNKRTO1.1 size=426771 2024-09-12T17:36:50.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.520+0000 7fa80ca76780 1 < canceled multipart upload key=8Z3EPQHMA6M5 upload=00XDMZNKRTO1 tag=5Y0I7VZX8H27 type=write size=2523923 2024-09-12T17:36:50.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.522+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~34WAAAVARLYT.0 size=1048576 2024-09-12T17:36:50.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.523+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~34WAAAVARLYT.1 size=1048576 2024-09-12T17:36:50.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.524+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~34WAAAVARLYT.2 size=832230 2024-09-12T17:36:50.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.524+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=34WAAAVARLYT tag=UVQCCEU8BBPZ type=write size=3977958 2024-09-12T17:36:50.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.525+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~2E4294BTBWT1.0 size=1048576 2024-09-12T17:36:50.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.526+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~2E4294BTBWT1.1 size=1048576 2024-09-12T17:36:50.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.527+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~2E4294BTBWT1.2 size=50336 2024-09-12T17:36:50.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.529+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=2E4294BTBWT1 tag=KC6F4X6UJVNY type=write size=3196064 2024-09-12T17:36:50.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.530+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=AJO9E2QI2NQY type=del size=490156 2024-09-12T17:36:50.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.531+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~7YAJJ1O5LIJ6.0 size=1048576 2024-09-12T17:36:50.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.532+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~7YAJJ1O5LIJ6.1 size=1048576 2024-09-12T17:36:50.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.533+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~7YAJJ1O5LIJ6.2 size=942432 2024-09-12T17:36:50.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.535+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=7YAJJ1O5LIJ6 tag=YX81RT28Y70K type=write size=4088160 2024-09-12T17:36:50.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.537+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~GLHMZ3WYJ9AN.0 size=1048576 2024-09-12T17:36:50.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.538+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~GLHMZ3WYJ9AN.1 size=1048576 2024-09-12T17:36:50.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.539+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~GLHMZ3WYJ9AN.2 size=675227 2024-09-12T17:36:50.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.539+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=GLHMZ3WYJ9AN tag=LDFVXAM5GP3J type=write size=3820955 2024-09-12T17:36:50.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.540+0000 7fa80ca76780 1 < canceled operation key=2AGKLZ3PQ2FD tag=VZZIJU7OIL47 type=del size=266162 2024-09-12T17:36:50.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.541+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=EOT8F3AE5P57 type=del size=1792704 2024-09-12T17:36:50.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.542+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~9A2NQRUZMJC1.0 size=1048576 2024-09-12T17:36:50.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.543+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~9A2NQRUZMJC1.1 size=876864 2024-09-12T17:36:50.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.545+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=9A2NQRUZMJC1 tag=YCYVWSVICL2K type=write size=2974016 2024-09-12T17:36:50.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.547+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~B7DML6HUX9XE.0 size=14643 2024-09-12T17:36:50.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.547+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=B7DML6HUX9XE tag=DDYOFS6NC34H type=write size=1063219 2024-09-12T17:36:50.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.551+0000 7fa80ca76780 1 < suggested update operation key=VNGH1DA1HANC tag=LARI3EG08XEV type=del size=1414791 2024-09-12T17:36:50.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.553+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~L5L6MZAWSU3T.0 size=86974 2024-09-12T17:36:50.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.553+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=L5L6MZAWSU3T tag=O7VWO4GO1K9R type=write size=1135550 2024-09-12T17:36:50.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.555+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~HWUCQQS7DHRL.0 size=687262 2024-09-12T17:36:50.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.556+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=HWUCQQS7DHRL tag=6Y2YX48US4E2 type=write size=1735838 2024-09-12T17:36:50.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.558+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=K5EFKXQHFYP1 type=del size=3629808 2024-09-12T17:36:50.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.559+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~S853261XRJB7.0 size=1048576 2024-09-12T17:36:50.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.560+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~S853261XRJB7.1 size=216391 2024-09-12T17:36:50.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.562+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=S853261XRJB7 tag=HJBGIQ54WO9Z type=write size=2313543 2024-09-12T17:36:50.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.563+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=W5SOP50NGFWU type=del size=377393 2024-09-12T17:36:50.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.564+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~THXN8GP5OMIK.0 size=1048576 2024-09-12T17:36:50.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.565+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~THXN8GP5OMIK.1 size=1037035 2024-09-12T17:36:50.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.567+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=THXN8GP5OMIK tag=MUUE13TRZGCH type=write size=3134187 2024-09-12T17:36:50.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.568+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=3YGHMVW07B0T type=del size=1443631 2024-09-12T17:36:50.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.569+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~GRIYO19CJQC1.0 size=625200 2024-09-12T17:36:50.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.571+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=GRIYO19CJQC1 tag=KGCCUF0LMJ7R type=write size=1673776 2024-09-12T17:36:50.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.572+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=KQ42QEIQ112V type=del size=2602015 2024-09-12T17:36:50.574 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.573+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~0JNOTY3B0XHV.0 size=1048576 2024-09-12T17:36:50.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.574+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~0JNOTY3B0XHV.1 size=136072 2024-09-12T17:36:50.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.576+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=0JNOTY3B0XHV tag=I6XFM3BM0HHX type=write size=2233224 2024-09-12T17:36:50.578 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.577+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=KAB4FJYWWJW2 type=del size=1766320 2024-09-12T17:36:50.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.578+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~GE5H6HWLPEPN.0 size=1048576 2024-09-12T17:36:50.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.579+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~GE5H6HWLPEPN.1 size=1048576 2024-09-12T17:36:50.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.581+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~GE5H6HWLPEPN.2 size=328786 2024-09-12T17:36:50.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.583+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=GE5H6HWLPEPN tag=4NUU2MAXFMMZ type=write size=3474514 2024-09-12T17:36:50.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.585+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~VLAGAWQEW0ZK.0 size=273466 2024-09-12T17:36:50.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.585+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=VLAGAWQEW0ZK tag=Y2T1YEW6MZ62 type=write size=1322042 2024-09-12T17:36:50.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.587+0000 7fa80ca76780 1 < suggested remove operation key=E25BUY271ZSI tag=8XA6S30GDTQQ type=del 2024-09-12T17:36:50.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.588+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=1NHWK2U3WSOZ type=del size=1221903 2024-09-12T17:36:50.590 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.589+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=073C6229S5BJ type=del 2024-09-12T17:36:50.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.590+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=6AK229SXQ2IP type=del size=3221303 2024-09-12T17:36:50.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.592+0000 7fa80ca76780 -1 < failed to complete operation key=E25BUY271ZSI tag=VX40OYLLJVCL type=del size=922659: (22) Invalid argument 2024-09-12T17:36:50.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.593+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=HS8U29BOKEVG type=del size=2795726 2024-09-12T17:36:50.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.594+0000 7fa80ca76780 -1 < failed to complete operation key=VNGH1DA1HANC tag=M0L0JFL8JPH4 type=del size=2265176: (22) Invalid argument 2024-09-12T17:36:50.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.595+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=OKA8LFMBWZIL type=write size=549640 2024-09-12T17:36:50.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.596+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~34WAAAVARLYT.0 size=1048576 2024-09-12T17:36:50.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.596+0000 7fa80ca76780 1 < canceled part key=_multipart_E25BUY271ZSI.2~34WAAAVARLYT.1 size=1048576 2024-09-12T17:36:50.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.597+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~34WAAAVARLYT.2 size=832230 2024-09-12T17:36:50.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.600+0000 7fa80ca76780 1 < canceled multipart upload key=E25BUY271ZSI upload=34WAAAVARLYT tag=UVQCCEU8BBPZ type=write size=3977958 2024-09-12T17:36:50.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.601+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=QL423E7PHLS3 type=write size=715889 2024-09-12T17:36:50.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.603+0000 7fa80ca76780 1 < canceled operation key=Z81704G91EPL tag=AJO9E2QI2NQY type=del size=490156 2024-09-12T17:36:50.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.604+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=FO8OF6J20L77 type=write size=450669 2024-09-12T17:36:50.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.605+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~GLHMZ3WYJ9AN.0 size=1048576 2024-09-12T17:36:50.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.606+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~GLHMZ3WYJ9AN.1 size=1048576 2024-09-12T17:36:50.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.607+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~GLHMZ3WYJ9AN.2 size=675227 2024-09-12T17:36:50.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.609+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=GLHMZ3WYJ9AN tag=LDFVXAM5GP3J type=write size=3820955 2024-09-12T17:36:50.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.611+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~MS3RIWW5UQ83.0 size=1048576 2024-09-12T17:36:50.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.612+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~MS3RIWW5UQ83.1 size=1048576 2024-09-12T17:36:50.614 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.613+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~MS3RIWW5UQ83.2 size=687691 2024-09-12T17:36:50.614 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.613+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=MS3RIWW5UQ83 tag=RXKJYUFU95IP type=write size=3833419 2024-09-12T17:36:50.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.614+0000 7fa80ca76780 -1 < failed to complete operation key=E25BUY271ZSI tag=EOT8F3AE5P57 type=del size=1792704: (22) Invalid argument 2024-09-12T17:36:50.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.616+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~24XLS2RJ04CD.0 size=1048576 2024-09-12T17:36:50.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.617+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~24XLS2RJ04CD.1 size=770481 2024-09-12T17:36:50.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.617+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=24XLS2RJ04CD tag=OMID2YSGL1WU type=write size=2867633 2024-09-12T17:36:50.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.618+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~B7DML6HUX9XE.0 size=14643 2024-09-12T17:36:50.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.620+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=B7DML6HUX9XE tag=DDYOFS6NC34H type=write size=1063219 2024-09-12T17:36:50.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.622+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~L8T7H0O6PFP0.0 size=1048576 2024-09-12T17:36:50.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.623+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~L8T7H0O6PFP0.1 size=999743 2024-09-12T17:36:50.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.623+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=L8T7H0O6PFP0 tag=1S04V2B39HK4 type=write size=3096895 2024-09-12T17:36:50.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.624+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~L5L6MZAWSU3T.0 size=86974 2024-09-12T17:36:50.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.626+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=L5L6MZAWSU3T tag=O7VWO4GO1K9R type=write size=1135550 2024-09-12T17:36:50.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.627+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=R498PL03G4MI type=del size=1274510 2024-09-12T17:36:50.630 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.629+0000 7fa80ca76780 1 < suggested update operation key=RC1IX4DQREEP tag=K5EFKXQHFYP1 type=del size=3629808 2024-09-12T17:36:50.631 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.630+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=FFUWHKAYMISM type=del size=1377183 2024-09-12T17:36:50.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.632+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=W5SOP50NGFWU type=del 2024-09-12T17:36:50.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.633+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=57SIAJ7JT7K6 type=write size=720909 2024-09-12T17:36:50.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.635+0000 7fa80ca76780 1 < suggested update operation key=VC1X03K12V80 tag=3YGHMVW07B0T type=del size=1443631 2024-09-12T17:36:50.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.637+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~15M71L02MH3Y.0 size=1048576 2024-09-12T17:36:50.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.638+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~15M71L02MH3Y.1 size=1048576 2024-09-12T17:36:50.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.639+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~15M71L02MH3Y.2 size=1040007 2024-09-12T17:36:50.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.639+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=15M71L02MH3Y tag=WNX5CGGQ8CFH type=write size=4185735 2024-09-12T17:36:50.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.640+0000 7fa80ca76780 1 < completed delete operation key=0X3LGXL2QFRN tag=KQ42QEIQ112V type=del 2024-09-12T17:36:50.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.641+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=YMHG2XRFXTZ2 type=del size=2893541 2024-09-12T17:36:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.642+0000 7fa80ca76780 1 < canceled operation key=DYZIHCBF3D8U tag=KAB4FJYWWJW2 type=del size=1766320 2024-09-12T17:36:50.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.643+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=VASSMHM3F192 type=del size=3027226 2024-09-12T17:36:50.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.644+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~VLAGAWQEW0ZK.0 size=273466 2024-09-12T17:36:50.647 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.646+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=VLAGAWQEW0ZK tag=Y2T1YEW6MZ62 type=write size=1322042 2024-09-12T17:36:50.648 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.647+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=N1EZ1ZOJ31AE type=del size=2002958 2024-09-12T17:36:50.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.649+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=1NHWK2U3WSOZ type=del 2024-09-12T17:36:50.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.650+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=XDR5JOIVY2NN type=del size=3582109 2024-09-12T17:36:50.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.651+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=6AK229SXQ2IP type=del 2024-09-12T17:36:50.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.652+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=8FEJNBV6HOOE type=del size=1005612 2024-09-12T17:36:50.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.653+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=HS8U29BOKEVG type=del 2024-09-12T17:36:50.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.654+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=WQSTGDCVZ9AX type=write size=400692 2024-09-12T17:36:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.655+0000 7fa80ca76780 1 < completed write operation key=DYZIHCBF3D8U tag=OKA8LFMBWZIL type=write size=549640 2024-09-12T17:36:50.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.659+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~II5Q1OXNGJSG.0 size=1048576 2024-09-12T17:36:50.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.661+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~II5Q1OXNGJSG.1 size=1048576 2024-09-12T17:36:50.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.662+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~II5Q1OXNGJSG.2 size=977767 2024-09-12T17:36:50.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.662+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=II5Q1OXNGJSG tag=TA56YGS6F3ZG type=write size=4123495 2024-09-12T17:36:50.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.664+0000 7fa80ca76780 1 < completed write operation key=LU7PDGWTAK63 tag=QL423E7PHLS3 type=write size=715889 2024-09-12T17:36:50.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.666+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~4GMI2LZ4PWIP.0 size=606497 2024-09-12T17:36:50.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.666+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=4GMI2LZ4PWIP tag=EWYE7CUSVC8U type=write size=1655073 2024-09-12T17:36:50.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.667+0000 7fa80ca76780 1 < canceled operation key=K243DOYPYVDS tag=FO8OF6J20L77 type=write size=450669 2024-09-12T17:36:50.669 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.668+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=1ZRRYFCSQ2BF type=del size=2846739 2024-09-12T17:36:50.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.669+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~MS3RIWW5UQ83.0 size=1048576 2024-09-12T17:36:50.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.669+0000 7fa80ca76780 1 < canceled part key=_multipart_Z81704G91EPL.2~MS3RIWW5UQ83.1 size=1048576 2024-09-12T17:36:50.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.670+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~MS3RIWW5UQ83.2 size=687691 2024-09-12T17:36:50.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.672+0000 7fa80ca76780 1 < canceled multipart upload key=Z81704G91EPL upload=MS3RIWW5UQ83 tag=RXKJYUFU95IP type=write size=3833419 2024-09-12T17:36:50.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.673+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=TDMO3ALTI2AV type=write size=870093 2024-09-12T17:36:50.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.674+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~24XLS2RJ04CD.0 size=1048576 2024-09-12T17:36:50.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.675+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~24XLS2RJ04CD.1 size=770481 2024-09-12T17:36:50.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.677+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=24XLS2RJ04CD tag=OMID2YSGL1WU type=write size=2867633 2024-09-12T17:36:50.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.678+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=N9A31PPPM46V type=del size=955469 2024-09-12T17:36:50.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.679+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~L8T7H0O6PFP0.0 size=1048576 2024-09-12T17:36:50.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.680+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~L8T7H0O6PFP0.1 size=999743 2024-09-12T17:36:50.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.682+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=L8T7H0O6PFP0 tag=1S04V2B39HK4 type=write size=3096895 2024-09-12T17:36:50.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.684+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~G0OBMU7V2SBB.0 size=1027201 2024-09-12T17:36:50.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.684+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=G0OBMU7V2SBB tag=PFBVL026D111 type=write size=2075777 2024-09-12T17:36:50.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.685+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=R498PL03G4MI type=del 2024-09-12T17:36:50.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.687+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=89T7C9TNEV5J type=del size=1361364 2024-09-12T17:36:50.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.688+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=FFUWHKAYMISM type=del 2024-09-12T17:36:50.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.690+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~DKTFQVIDUC3E.0 size=1048576 2024-09-12T17:36:50.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.691+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~DKTFQVIDUC3E.1 size=1048576 2024-09-12T17:36:50.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.692+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~DKTFQVIDUC3E.2 size=434869 2024-09-12T17:36:50.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.692+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=DKTFQVIDUC3E tag=7YWYK3D6UBCA type=write size=3580597 2024-09-12T17:36:50.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.693+0000 7fa80ca76780 1 < completed write operation key=WGL9JYJXSHBH tag=57SIAJ7JT7K6 type=write size=720909 2024-09-12T17:36:50.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.695+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~GB5XLSHHPVIM.0 size=453602 2024-09-12T17:36:50.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.695+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=GB5XLSHHPVIM tag=7A81IMKBX1IV type=write size=1502178 2024-09-12T17:36:50.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.696+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~15M71L02MH3Y.0 size=1048576 2024-09-12T17:36:50.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.697+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~15M71L02MH3Y.1 size=1048576 2024-09-12T17:36:50.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.698+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~15M71L02MH3Y.2 size=1040007 2024-09-12T17:36:50.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.700+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=15M71L02MH3Y tag=WNX5CGGQ8CFH type=write size=4185735 2024-09-12T17:36:50.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.702+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~25I3A47XKJN4.0 size=1048576 2024-09-12T17:36:50.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.702+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~25I3A47XKJN4.1 size=507406 2024-09-12T17:36:50.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.702+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=25I3A47XKJN4 tag=4MMZ0C483BDY type=write size=2604558 2024-09-12T17:36:50.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.704+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=YMHG2XRFXTZ2 type=del 2024-09-12T17:36:50.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.706+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~G9PRJTIMK35N.0 size=1048576 2024-09-12T17:36:50.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.707+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~G9PRJTIMK35N.1 size=1048576 2024-09-12T17:36:50.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.708+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~G9PRJTIMK35N.2 size=84655 2024-09-12T17:36:50.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.708+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=G9PRJTIMK35N tag=GO76KMAO46VI type=write size=3230383 2024-09-12T17:36:50.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.710+0000 7fa80ca76780 1 < suggested update operation key=U8O04HYQZRJC tag=VASSMHM3F192 type=del size=3027226 2024-09-12T17:36:50.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.711+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=AID6S79K7AW5 type=del size=1385413 2024-09-12T17:36:50.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.712+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=N1EZ1ZOJ31AE type=del 2024-09-12T17:36:50.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.713+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=KRUROS61BKZL type=del size=3733156 2024-09-12T17:36:50.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.714+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=XDR5JOIVY2NN type=del 2024-09-12T17:36:50.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.717+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~54E0YYDH0VSU.0 size=1048576 2024-09-12T17:36:50.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.717+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~54E0YYDH0VSU.1 size=594356 2024-09-12T17:36:50.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.717+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=54E0YYDH0VSU tag=YLR98305D1A0 type=write size=2691508 2024-09-12T17:36:50.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.719+0000 7fa80ca76780 1 < canceled operation key=R02234GEWV6B tag=8FEJNBV6HOOE type=del size=1005612 2024-09-12T17:36:50.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.720+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=VMY59BKHQIE8 type=del size=2176058 2024-09-12T17:36:50.722 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.721+0000 7fa80ca76780 1 < completed write operation key=VDD4PDR1GLWQ tag=WQSTGDCVZ9AX type=write size=400692 2024-09-12T17:36:50.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.723+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~THULSW3D91YE.0 size=1048576 2024-09-12T17:36:50.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.724+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~THULSW3D91YE.1 size=552683 2024-09-12T17:36:50.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.724+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=THULSW3D91YE tag=HLYOGCDFHUHS type=write size=2649835 2024-09-12T17:36:50.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.725+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~II5Q1OXNGJSG.0 size=1048576 2024-09-12T17:36:50.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.726+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~II5Q1OXNGJSG.1 size=1048576 2024-09-12T17:36:50.728 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.727+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~II5Q1OXNGJSG.2 size=977767 2024-09-12T17:36:50.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.729+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=II5Q1OXNGJSG tag=TA56YGS6F3ZG type=write size=4123495 2024-09-12T17:36:50.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.731+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~4VY0ZP4SRJUT.0 size=1048576 2024-09-12T17:36:50.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.732+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~4VY0ZP4SRJUT.1 size=568356 2024-09-12T17:36:50.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.732+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=4VY0ZP4SRJUT tag=CREZM4RGXHWJ type=write size=2665508 2024-09-12T17:36:50.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.732+0000 7fa80ca76780 1 < canceled part key=_multipart_K243DOYPYVDS.2~4GMI2LZ4PWIP.0 size=606497 2024-09-12T17:36:50.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.734+0000 7fa80ca76780 1 < canceled multipart upload key=K243DOYPYVDS upload=4GMI2LZ4PWIP tag=EWYE7CUSVC8U type=write size=1655073 2024-09-12T17:36:50.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.735+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=V67TB2ZE4DC5 type=del size=887023 2024-09-12T17:36:50.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.737+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=1ZRRYFCSQ2BF type=del 2024-09-12T17:36:50.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.738+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=G1OCSUZ8MP4U type=del size=659005 2024-09-12T17:36:50.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.739+0000 7fa80ca76780 1 < completed write operation key=MSZUYX441Y66 tag=TDMO3ALTI2AV type=write size=870093 2024-09-12T17:36:50.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.741+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~ILUC3JM4IYAR.0 size=1048576 2024-09-12T17:36:50.743 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.742+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~ILUC3JM4IYAR.1 size=1048576 2024-09-12T17:36:50.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.743+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~ILUC3JM4IYAR.2 size=730223 2024-09-12T17:36:50.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.743+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=ILUC3JM4IYAR tag=NE08JXE2PQ70 type=write size=3875951 2024-09-12T17:36:50.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.744+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=N9A31PPPM46V type=del 2024-09-12T17:36:50.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.745+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=TCA2WPHRP8L6 type=del size=11459 2024-09-12T17:36:50.747 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.746+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~G0OBMU7V2SBB.0 size=1027201 2024-09-12T17:36:50.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.748+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=G0OBMU7V2SBB tag=PFBVL026D111 type=write size=2075777 2024-09-12T17:36:50.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.750+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~F6XYLXNQ13JR.0 size=1048576 2024-09-12T17:36:50.752 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.751+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~F6XYLXNQ13JR.1 size=641481 2024-09-12T17:36:50.752 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.751+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=F6XYLXNQ13JR tag=HN6L1AY2087F type=write size=2738633 2024-09-12T17:36:50.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.752+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=89T7C9TNEV5J type=del 2024-09-12T17:36:50.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.754+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~L1YA41LQMKIZ.0 size=1048576 2024-09-12T17:36:50.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.755+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~L1YA41LQMKIZ.1 size=1048576 2024-09-12T17:36:50.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.756+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~L1YA41LQMKIZ.2 size=611606 2024-09-12T17:36:50.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.756+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=L1YA41LQMKIZ tag=QZWF3QP86XZ5 type=write size=3757334 2024-09-12T17:36:50.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.758+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~DKTFQVIDUC3E.0 size=1048576 2024-09-12T17:36:50.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.758+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~DKTFQVIDUC3E.1 size=1048576 2024-09-12T17:36:50.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.759+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~DKTFQVIDUC3E.2 size=434869 2024-09-12T17:36:50.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.761+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=DKTFQVIDUC3E tag=7YWYK3D6UBCA type=write size=3580597 2024-09-12T17:36:50.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.763+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~YN8WD0AZF8GS.0 size=1048576 2024-09-12T17:36:50.767 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.766+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~YN8WD0AZF8GS.1 size=1048576 2024-09-12T17:36:50.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.767+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~YN8WD0AZF8GS.2 size=269063 2024-09-12T17:36:50.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.767+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=YN8WD0AZF8GS tag=M36A75MWX25U type=write size=3414791 2024-09-12T17:36:50.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.769+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~GB5XLSHHPVIM.0 size=453602 2024-09-12T17:36:50.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.771+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=GB5XLSHHPVIM tag=7A81IMKBX1IV type=write size=1502178 2024-09-12T17:36:50.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.772+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=ZJEOEFJE21WS type=write size=88784 2024-09-12T17:36:50.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.773+0000 7fa80ca76780 1 < canceled part key=_multipart_FKK4IGD1436I.2~25I3A47XKJN4.0 size=1048576 2024-09-12T17:36:50.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.774+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~25I3A47XKJN4.1 size=507406 2024-09-12T17:36:50.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.776+0000 7fa80ca76780 1 < canceled multipart upload key=FKK4IGD1436I upload=25I3A47XKJN4 tag=4MMZ0C483BDY type=write size=2604558 2024-09-12T17:36:50.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.778+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~ET1Z2IVYHDVB.0 size=1048576 2024-09-12T17:36:50.780 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.779+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~ET1Z2IVYHDVB.1 size=199089 2024-09-12T17:36:50.780 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.779+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=ET1Z2IVYHDVB tag=XO9HX0CBQLMN type=write size=2296241 2024-09-12T17:36:50.781 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.780+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~G9PRJTIMK35N.0 size=1048576 2024-09-12T17:36:50.782 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.781+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~G9PRJTIMK35N.1 size=1048576 2024-09-12T17:36:50.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.782+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~G9PRJTIMK35N.2 size=84655 2024-09-12T17:36:50.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.784+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=G9PRJTIMK35N tag=GO76KMAO46VI type=write size=3230383 2024-09-12T17:36:50.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.786+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~5R8DZHFW038N.0 size=1048576 2024-09-12T17:36:50.788 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.787+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~5R8DZHFW038N.1 size=1048576 2024-09-12T17:36:50.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.788+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~5R8DZHFW038N.2 size=897510 2024-09-12T17:36:50.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.788+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=5R8DZHFW038N tag=LNZTE0ANLLQB type=write size=4043238 2024-09-12T17:36:50.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.789+0000 7fa80ca76780 1 < canceled operation key=Z81704G91EPL tag=AID6S79K7AW5 type=del size=1385413 2024-09-12T17:36:50.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.791+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~PYLX4VM94I6P.0 size=458971 2024-09-12T17:36:50.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.791+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=PYLX4VM94I6P tag=Z1EQESKCOIAW type=write size=1507547 2024-09-12T17:36:50.793 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.792+0000 7fa80ca76780 1 < canceled operation key=WGL9JYJXSHBH tag=KRUROS61BKZL type=del size=3733156 2024-09-12T17:36:50.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.794+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~YFJI6S0JD8QI.0 size=1048576 2024-09-12T17:36:50.796 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.795+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~YFJI6S0JD8QI.1 size=1048576 2024-09-12T17:36:50.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.796+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~YFJI6S0JD8QI.2 size=768985 2024-09-12T17:36:50.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.796+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=YFJI6S0JD8QI tag=VC8M0FNWW6C7 type=write size=3914713 2024-09-12T17:36:50.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.797+0000 7fa80ca76780 1 < canceled part key=_multipart_7QHTQ6VHZ34P.2~54E0YYDH0VSU.0 size=1048576 2024-09-12T17:36:50.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.797+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~54E0YYDH0VSU.1 size=594356 2024-09-12T17:36:50.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.799+0000 7fa80ca76780 1 < canceled multipart upload key=7QHTQ6VHZ34P upload=54E0YYDH0VSU tag=YLR98305D1A0 type=write size=2691508 2024-09-12T17:36:50.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.801+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~PCOOTYZQY3F9.0 size=1048576 2024-09-12T17:36:50.804 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.803+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~PCOOTYZQY3F9.1 size=1048576 2024-09-12T17:36:50.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.804+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~PCOOTYZQY3F9.2 size=242760 2024-09-12T17:36:50.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.804+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=PCOOTYZQY3F9 tag=9J8U7VI73C9C type=write size=3388488 2024-09-12T17:36:50.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.805+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=VMY59BKHQIE8 type=del 2024-09-12T17:36:50.808 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.807+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~3MC23YZAM6LL.0 size=1048576 2024-09-12T17:36:50.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.808+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~3MC23YZAM6LL.1 size=6225 2024-09-12T17:36:50.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.808+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=3MC23YZAM6LL tag=69RUGDQBIJ5O type=write size=2103377 2024-09-12T17:36:50.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.810+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~THULSW3D91YE.0 size=1048576 2024-09-12T17:36:50.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.810+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~THULSW3D91YE.1 size=552683 2024-09-12T17:36:50.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.812+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=THULSW3D91YE tag=HLYOGCDFHUHS type=write size=2649835 2024-09-12T17:36:50.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.814+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=L4N9BDUD9IU2 type=del size=2749849 2024-09-12T17:36:50.816 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.815+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~4VY0ZP4SRJUT.0 size=1048576 2024-09-12T17:36:50.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.816+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~4VY0ZP4SRJUT.1 size=568356 2024-09-12T17:36:50.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.818+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=4VY0ZP4SRJUT tag=CREZM4RGXHWJ type=write size=2665508 2024-09-12T17:36:50.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.820+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~OKW225E1KSRH.0 size=1048576 2024-09-12T17:36:50.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.821+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~OKW225E1KSRH.1 size=396495 2024-09-12T17:36:50.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.821+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=OKW225E1KSRH tag=6YI6TQKCTOAQ type=write size=2493647 2024-09-12T17:36:50.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.822+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=V67TB2ZE4DC5 type=del 2024-09-12T17:36:50.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.824+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~Q3F0C2SG6FGP.0 size=1048576 2024-09-12T17:36:50.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.825+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~Q3F0C2SG6FGP.1 size=1048576 2024-09-12T17:36:50.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.826+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~Q3F0C2SG6FGP.2 size=418157 2024-09-12T17:36:50.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.826+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=Q3F0C2SG6FGP tag=JT0YCZEV5H2G type=write size=3563885 2024-09-12T17:36:50.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.827+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=G1OCSUZ8MP4U type=del 2024-09-12T17:36:50.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.829+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=JS3EWFH04KAG type=write size=151057 2024-09-12T17:36:50.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.830+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~ILUC3JM4IYAR.0 size=1048576 2024-09-12T17:36:50.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.830+0000 7fa80ca76780 1 < canceled part key=_multipart_WGL9JYJXSHBH.2~ILUC3JM4IYAR.1 size=1048576 2024-09-12T17:36:50.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.831+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~ILUC3JM4IYAR.2 size=730223 2024-09-12T17:36:50.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.833+0000 7fa80ca76780 1 < canceled multipart upload key=WGL9JYJXSHBH upload=ILUC3JM4IYAR tag=NE08JXE2PQ70 type=write size=3875951 2024-09-12T17:36:50.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.835+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~VZXFHMMQCT11.0 size=1048576 2024-09-12T17:36:50.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.836+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~VZXFHMMQCT11.1 size=1048576 2024-09-12T17:36:50.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.837+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~VZXFHMMQCT11.2 size=741559 2024-09-12T17:36:50.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.837+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=VZXFHMMQCT11 tag=URVSYGQ6BT60 type=write size=3887287 2024-09-12T17:36:50.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.838+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=TCA2WPHRP8L6 type=del 2024-09-12T17:36:50.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.839+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=RT8X6HABY3XF type=del size=4035764 2024-09-12T17:36:50.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.840+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~F6XYLXNQ13JR.0 size=1048576 2024-09-12T17:36:50.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.841+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~F6XYLXNQ13JR.1 size=641481 2024-09-12T17:36:50.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.843+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=F6XYLXNQ13JR tag=HN6L1AY2087F type=write size=2738633 2024-09-12T17:36:50.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.845+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~PD8DUT6XDAU6.0 size=1048576 2024-09-12T17:36:50.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.846+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~PD8DUT6XDAU6.1 size=856850 2024-09-12T17:36:50.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.846+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=PD8DUT6XDAU6 tag=USBF5RMII2LA type=write size=2954002 2024-09-12T17:36:50.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.847+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~L1YA41LQMKIZ.0 size=1048576 2024-09-12T17:36:50.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.847+0000 7fa80ca76780 1 < canceled part key=_multipart_RC1IX4DQREEP.2~L1YA41LQMKIZ.1 size=1048576 2024-09-12T17:36:50.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.849+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~L1YA41LQMKIZ.2 size=611606 2024-09-12T17:36:50.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.851+0000 7fa80ca76780 1 < canceled multipart upload key=RC1IX4DQREEP upload=L1YA41LQMKIZ tag=QZWF3QP86XZ5 type=write size=3757334 2024-09-12T17:36:50.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.852+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=DEQMM2HZIAAN type=del size=845795 2024-09-12T17:36:50.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.854+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~YN8WD0AZF8GS.0 size=1048576 2024-09-12T17:36:50.856 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.855+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~YN8WD0AZF8GS.1 size=1048576 2024-09-12T17:36:50.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.856+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~YN8WD0AZF8GS.2 size=269063 2024-09-12T17:36:50.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.857+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=YN8WD0AZF8GS tag=M36A75MWX25U type=write size=3414791 2024-09-12T17:36:50.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.859+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=ZRQCSLZ2H07T type=del size=658695 2024-09-12T17:36:50.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.860+0000 7fa80ca76780 1 < completed write operation key=E25BUY271ZSI tag=ZJEOEFJE21WS type=write size=88784 2024-09-12T17:36:50.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.861+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=DKGM727G108N type=del size=840702 2024-09-12T17:36:50.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.862+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~ET1Z2IVYHDVB.0 size=1048576 2024-09-12T17:36:50.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.862+0000 7fa80ca76780 1 < canceled part key=_multipart_2AGKLZ3PQ2FD.2~ET1Z2IVYHDVB.1 size=199089 2024-09-12T17:36:50.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.864+0000 7fa80ca76780 1 < canceled multipart upload key=2AGKLZ3PQ2FD upload=ET1Z2IVYHDVB tag=XO9HX0CBQLMN type=write size=2296241 2024-09-12T17:36:50.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.865+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=S3SFQWUK247N type=del size=4014228 2024-09-12T17:36:50.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.866+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~5R8DZHFW038N.0 size=1048576 2024-09-12T17:36:50.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.867+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~5R8DZHFW038N.1 size=1048576 2024-09-12T17:36:50.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.868+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~5R8DZHFW038N.2 size=897510 2024-09-12T17:36:50.871 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.870+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=5R8DZHFW038N tag=LNZTE0ANLLQB type=write size=4043238 2024-09-12T17:36:50.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.871+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=0QMCROAPP016 type=write size=641345 2024-09-12T17:36:50.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.872+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~PYLX4VM94I6P.0 size=458971 2024-09-12T17:36:50.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.877+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=PYLX4VM94I6P tag=Z1EQESKCOIAW type=write size=1507547 2024-09-12T17:36:50.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.878+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=EKX1AMVGGGKZ type=del size=2004123 2024-09-12T17:36:50.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.878+0000 7fa80ca76780 1 < canceled part key=_multipart_DYZIHCBF3D8U.2~YFJI6S0JD8QI.0 size=1048576 2024-09-12T17:36:50.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.879+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~YFJI6S0JD8QI.1 size=1048576 2024-09-12T17:36:50.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.880+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~YFJI6S0JD8QI.2 size=768985 2024-09-12T17:36:50.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.882+0000 7fa80ca76780 1 < canceled multipart upload key=DYZIHCBF3D8U upload=YFJI6S0JD8QI tag=VC8M0FNWW6C7 type=write size=3914713 2024-09-12T17:36:50.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.883+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=5GRQW2KC2Q8R type=del size=2031626 2024-09-12T17:36:50.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.883+0000 7fa80ca76780 1 < canceled part key=_multipart_U8O04HYQZRJC.2~PCOOTYZQY3F9.0 size=1048576 2024-09-12T17:36:50.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.884+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~PCOOTYZQY3F9.1 size=1048576 2024-09-12T17:36:50.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.885+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~PCOOTYZQY3F9.2 size=242760 2024-09-12T17:36:50.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.887+0000 7fa80ca76780 1 < canceled multipart upload key=U8O04HYQZRJC upload=PCOOTYZQY3F9 tag=9J8U7VI73C9C type=write size=3388488 2024-09-12T17:36:50.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.888+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=KGFSOH0Q88RA type=del size=2677708 2024-09-12T17:36:50.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.889+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~3MC23YZAM6LL.0 size=1048576 2024-09-12T17:36:50.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.889+0000 7fa80ca76780 1 < canceled part key=_multipart_8Z3EPQHMA6M5.2~3MC23YZAM6LL.1 size=6225 2024-09-12T17:36:50.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.891+0000 7fa80ca76780 1 < canceled multipart upload key=8Z3EPQHMA6M5 upload=3MC23YZAM6LL tag=69RUGDQBIJ5O type=write size=2103377 2024-09-12T17:36:50.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.893+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~W3ECYKZQAUE6.0 size=422353 2024-09-12T17:36:50.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.893+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=W3ECYKZQAUE6 tag=1JB030YZID12 type=write size=1470929 2024-09-12T17:36:50.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.894+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=L4N9BDUD9IU2 type=del 2024-09-12T17:36:50.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.895+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=75GNX22GF6NX type=del size=920579 2024-09-12T17:36:50.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.896+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~OKW225E1KSRH.0 size=1048576 2024-09-12T17:36:50.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.897+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~OKW225E1KSRH.1 size=396495 2024-09-12T17:36:50.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.899+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=OKW225E1KSRH tag=6YI6TQKCTOAQ type=write size=2493647 2024-09-12T17:36:50.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.900+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=L6DU5324LTWW type=del size=171441 2024-09-12T17:36:50.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.901+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~Q3F0C2SG6FGP.0 size=1048576 2024-09-12T17:36:50.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.902+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~Q3F0C2SG6FGP.1 size=1048576 2024-09-12T17:36:50.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.903+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~Q3F0C2SG6FGP.2 size=418157 2024-09-12T17:36:50.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.905+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=Q3F0C2SG6FGP tag=JT0YCZEV5H2G type=write size=3563885 2024-09-12T17:36:50.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.906+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=DRXAY1TQQ0CD type=del size=2041008 2024-09-12T17:36:50.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.907+0000 7fa80ca76780 1 < completed write operation key=94801LE91HZ9 tag=JS3EWFH04KAG type=write size=151057 2024-09-12T17:36:50.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.908+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=IC9LGNSQ2HJ4 type=del size=3227492 2024-09-12T17:36:50.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.910+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~VZXFHMMQCT11.0 size=1048576 2024-09-12T17:36:50.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.911+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~VZXFHMMQCT11.1 size=1048576 2024-09-12T17:36:50.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.911+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~VZXFHMMQCT11.2 size=741559 2024-09-12T17:36:50.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.913+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=VZXFHMMQCT11 tag=URVSYGQ6BT60 type=write size=3887287 2024-09-12T17:36:50.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.914+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=ZD39XTS1TLZS type=write size=739582 2024-09-12T17:36:50.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.916+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=RT8X6HABY3XF type=del 2024-09-12T17:36:50.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.918+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~EAV0R67HZQ7N.0 size=1048576 2024-09-12T17:36:50.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.918+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~EAV0R67HZQ7N.1 size=645943 2024-09-12T17:36:50.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.918+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=EAV0R67HZQ7N tag=75AOP5MJVNYS type=write size=2743095 2024-09-12T17:36:50.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.920+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~PD8DUT6XDAU6.0 size=1048576 2024-09-12T17:36:50.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.921+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~PD8DUT6XDAU6.1 size=856850 2024-09-12T17:36:50.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.922+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=PD8DUT6XDAU6 tag=USBF5RMII2LA type=write size=2954002 2024-09-12T17:36:50.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.924+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~3CMIOF4OY058.0 size=1048576 2024-09-12T17:36:50.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.925+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~3CMIOF4OY058.1 size=484464 2024-09-12T17:36:50.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.925+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=3CMIOF4OY058 tag=S6XWQ1VDOZ84 type=write size=2581616 2024-09-12T17:36:50.927 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.927+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=DEQMM2HZIAAN type=del 2024-09-12T17:36:50.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.928+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=PNM6QHRWRQL8 type=del size=1109757 2024-09-12T17:36:50.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.930+0000 7fa80ca76780 1 < suggested remove operation key=FKK4IGD1436I tag=ZRQCSLZ2H07T type=del 2024-09-12T17:36:50.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.934+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~9AT708I5IRAS.0 size=1048576 2024-09-12T17:36:50.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.935+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~9AT708I5IRAS.1 size=727168 2024-09-12T17:36:50.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.935+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=9AT708I5IRAS tag=OK02T45ZH25G type=write size=2824320 2024-09-12T17:36:50.938 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.937+0000 7fa80ca76780 1 < suggested remove operation key=VNGH1DA1HANC tag=DKGM727G108N type=del 2024-09-12T17:36:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.938+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=UY6XBG8LF56A type=del size=883335 2024-09-12T17:36:50.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.940+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=S3SFQWUK247N type=del 2024-09-12T17:36:50.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.941+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=1S3VAK4JQ72N type=write size=466704 2024-09-12T17:36:50.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.942+0000 7fa80ca76780 1 < completed write operation key=7QHTQ6VHZ34P tag=0QMCROAPP016 type=write size=641345 2024-09-12T17:36:50.945 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.944+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=E6FN9GV1WPXX type=del size=1988368 2024-09-12T17:36:50.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.945+0000 7fa80ca76780 1 < canceled operation key=BLGMV3S9AY24 tag=EKX1AMVGGGKZ type=del size=2004123 2024-09-12T17:36:50.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.946+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=7ETML4JB6P45 type=del size=2203428 2024-09-12T17:36:50.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.949+0000 7fa80ca76780 1 < suggested update operation key=RC1IX4DQREEP tag=5GRQW2KC2Q8R type=del size=2031626 2024-09-12T17:36:50.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.951+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~JW01P70QMQQI.0 size=651875 2024-09-12T17:36:50.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.951+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=JW01P70QMQQI tag=PY1ITP597YFE type=write size=1700451 2024-09-12T17:36:50.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.952+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=KGFSOH0Q88RA type=del 2024-09-12T17:36:50.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.955+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~3VKDJZMAYHES.0 size=208164 2024-09-12T17:36:50.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.955+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=3VKDJZMAYHES tag=31ZAAWI55VO8 type=write size=1256740 2024-09-12T17:36:50.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.955+0000 7fa80ca76780 1 < canceled part key=_multipart_0X3LGXL2QFRN.2~W3ECYKZQAUE6.0 size=422353 2024-09-12T17:36:50.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.958+0000 7fa80ca76780 1 < canceled multipart upload key=0X3LGXL2QFRN upload=W3ECYKZQAUE6 tag=1JB030YZID12 type=write size=1470929 2024-09-12T17:36:50.960 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.959+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=9ZQ5FU3AKIGV type=del size=2437254 2024-09-12T17:36:50.963 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.962+0000 7fa80ca76780 1 < suggested remove operation key=RC1IX4DQREEP tag=75GNX22GF6NX type=del 2024-09-12T17:36:50.964 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.963+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=CX2R323LZE04 type=del size=1472875 2024-09-12T17:36:50.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.964+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=L6DU5324LTWW type=del 2024-09-12T17:36:50.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.966+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=E0TF5SAO7QLL type=del size=951026 2024-09-12T17:36:50.968 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.967+0000 7fa80ca76780 -1 < failed to complete operation key=VNGH1DA1HANC tag=DRXAY1TQQ0CD type=del size=2041008: (22) Invalid argument 2024-09-12T17:36:50.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.968+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=XDJ4W2HY2UAF type=del size=3570821 2024-09-12T17:36:50.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.969+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=IC9LGNSQ2HJ4 type=del 2024-09-12T17:36:50.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.971+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=YUSAL0R43CBH type=del size=3724527 2024-09-12T17:36:50.973 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.972+0000 7fa80ca76780 1 < completed write operation key=0J6RTRJWZP1T tag=ZD39XTS1TLZS type=write size=739582 2024-09-12T17:36:50.974 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.973+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=OOJMG0PZY9G0 type=del size=875526 2024-09-12T17:36:50.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.975+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~EAV0R67HZQ7N.0 size=1048576 2024-09-12T17:36:50.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.976+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~EAV0R67HZQ7N.1 size=645943 2024-09-12T17:36:50.979 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.978+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=EAV0R67HZQ7N tag=75AOP5MJVNYS type=write size=2743095 2024-09-12T17:36:50.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.979+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=CY43OSBCNLU8 type=del size=1906007 2024-09-12T17:36:50.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.980+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~3CMIOF4OY058.0 size=1048576 2024-09-12T17:36:50.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.981+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~3CMIOF4OY058.1 size=484464 2024-09-12T17:36:50.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.985+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=3CMIOF4OY058 tag=S6XWQ1VDOZ84 type=write size=2581616 2024-09-12T17:36:50.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.986+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=6YBNFUYDNDUC type=del size=1428477 2024-09-12T17:36:50.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.988+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=PNM6QHRWRQL8 type=del 2024-09-12T17:36:50.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.992+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~30F41O5JXN8C.0 size=243283 2024-09-12T17:36:50.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.992+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=30F41O5JXN8C tag=ARORNIZM6M8R type=write size=1291859 2024-09-12T17:36:50.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.994+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~9AT708I5IRAS.0 size=1048576 2024-09-12T17:36:50.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.995+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~9AT708I5IRAS.1 size=727168 2024-09-12T17:36:50.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.997+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=9AT708I5IRAS tag=OK02T45ZH25G type=write size=2824320 2024-09-12T17:36:50.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:50.998+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=BNVO05QIZ4HH type=del size=401246 2024-09-12T17:36:51.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.000+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=UY6XBG8LF56A type=del 2024-09-12T17:36:51.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.001+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=L1UMG1CF02TY type=write size=442898 2024-09-12T17:36:51.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.003+0000 7fa80ca76780 1 < suggested remove operation key=GKE6623N268Z tag=1S3VAK4JQ72N type=write 2024-09-12T17:36:51.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.005+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~BEU2AI3OSO8P.0 size=541070 2024-09-12T17:36:51.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.005+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=BEU2AI3OSO8P tag=IZXQZCO02GPL type=write size=1589646 2024-09-12T17:36:51.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.006+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=E6FN9GV1WPXX type=del 2024-09-12T17:36:51.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.007+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=A0IH49E5PYW5 type=del size=3776200 2024-09-12T17:36:51.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.008+0000 7fa80ca76780 1 < canceled operation key=07LPSZT2RKCC tag=7ETML4JB6P45 type=del size=2203428 2024-09-12T17:36:51.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.010+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~H7ECR254PHB1.0 size=1048576 2024-09-12T17:36:51.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.011+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~H7ECR254PHB1.1 size=1048576 2024-09-12T17:36:51.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.012+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~H7ECR254PHB1.2 size=650356 2024-09-12T17:36:51.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.012+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=H7ECR254PHB1 tag=O3FPJDDW6HVV type=write size=3796084 2024-09-12T17:36:51.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.013+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~JW01P70QMQQI.0 size=651875 2024-09-12T17:36:51.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.015+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=JW01P70QMQQI tag=PY1ITP597YFE type=write size=1700451 2024-09-12T17:36:51.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.017+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~2DSRJEHLXAVN.0 size=1048576 2024-09-12T17:36:51.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.018+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~2DSRJEHLXAVN.1 size=1048576 2024-09-12T17:36:51.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.019+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~2DSRJEHLXAVN.2 size=166920 2024-09-12T17:36:51.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.019+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=2DSRJEHLXAVN tag=GR4N6LKH2NWT type=write size=3312648 2024-09-12T17:36:51.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.020+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~3VKDJZMAYHES.0 size=208164 2024-09-12T17:36:51.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.022+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=3VKDJZMAYHES tag=31ZAAWI55VO8 type=write size=1256740 2024-09-12T17:36:51.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.024+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~DZ6M7FTV9O2Y.0 size=1048576 2024-09-12T17:36:51.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.024+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~DZ6M7FTV9O2Y.1 size=658952 2024-09-12T17:36:51.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.024+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=DZ6M7FTV9O2Y tag=MTHKRCH156CW type=write size=2756104 2024-09-12T17:36:51.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.026+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=9ZQ5FU3AKIGV type=del 2024-09-12T17:36:51.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.027+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=M6BZP2RBTZBW type=del size=223824 2024-09-12T17:36:51.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.029+0000 7fa80ca76780 1 < suggested update operation key=VC1X03K12V80 tag=CX2R323LZE04 type=del size=1472875 2024-09-12T17:36:51.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.030+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=NDRN54INY5SV type=del size=2684248 2024-09-12T17:36:51.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.031+0000 7fa80ca76780 1 < canceled operation key=FKK4IGD1436I tag=E0TF5SAO7QLL type=del size=951026 2024-09-12T17:36:51.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.033+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~PC0MDPZR2H98.0 size=1048576 2024-09-12T17:36:51.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.034+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~PC0MDPZR2H98.1 size=1048576 2024-09-12T17:36:51.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.035+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~PC0MDPZR2H98.2 size=784436 2024-09-12T17:36:51.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.035+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=PC0MDPZR2H98 tag=JRHUMPAY8YH6 type=write size=3930164 2024-09-12T17:36:51.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.037+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=XDJ4W2HY2UAF type=del 2024-09-12T17:36:51.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.038+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=TGS29MPGUQ8I type=del size=115858 2024-09-12T17:36:51.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.039+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=YUSAL0R43CBH type=del 2024-09-12T17:36:51.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.040+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=N8CY70GXI2MC type=del size=3484555 2024-09-12T17:36:51.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.042+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=OOJMG0PZY9G0 type=del 2024-09-12T17:36:51.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.043+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=T6K0R603XCLW type=del size=3179374 2024-09-12T17:36:51.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.045+0000 7fa80ca76780 1 < suggested update operation key=VDD4PDR1GLWQ tag=CY43OSBCNLU8 type=del size=1906007 2024-09-12T17:36:51.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.047+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~887HHKWU8958.0 size=1048576 2024-09-12T17:36:51.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.048+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~887HHKWU8958.1 size=1048576 2024-09-12T17:36:51.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.049+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~887HHKWU8958.2 size=13944 2024-09-12T17:36:51.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.049+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=887HHKWU8958 tag=K36SZRV618DH type=write size=3159672 2024-09-12T17:36:51.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.050+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=6YBNFUYDNDUC type=del 2024-09-12T17:36:51.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.052+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=EW51BNPCHVFU type=del size=1728868 2024-09-12T17:36:51.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.053+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~30F41O5JXN8C.0 size=243283 2024-09-12T17:36:51.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.055+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=30F41O5JXN8C tag=ARORNIZM6M8R type=write size=1291859 2024-09-12T17:36:51.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.057+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=II1QLGBNA4G6 type=del size=1326953 2024-09-12T17:36:51.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.058+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=BNVO05QIZ4HH type=del 2024-09-12T17:36:51.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.060+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=GWRUD1MWPQM0 type=del size=2184079 2024-09-12T17:36:51.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.061+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=L1UMG1CF02TY type=write size=442898 2024-09-12T17:36:51.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.062+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=U84DHZ5BKZ0Y type=del size=2280691 2024-09-12T17:36:51.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.064+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~BEU2AI3OSO8P.0 size=541070 2024-09-12T17:36:51.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.065+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=BEU2AI3OSO8P tag=IZXQZCO02GPL type=write size=1589646 2024-09-12T17:36:51.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.067+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=ZZY1NXMJHEOH type=del size=2313965 2024-09-12T17:36:51.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.069+0000 7fa80ca76780 1 < suggested update operation key=8Z3EPQHMA6M5 tag=A0IH49E5PYW5 type=del size=3776200 2024-09-12T17:36:51.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.070+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=GBE1Y06LJM8M type=del size=1863070 2024-09-12T17:36:51.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.072+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~H7ECR254PHB1.0 size=1048576 2024-09-12T17:36:51.074 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.073+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~H7ECR254PHB1.1 size=1048576 2024-09-12T17:36:51.075 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.074+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~H7ECR254PHB1.2 size=650356 2024-09-12T17:36:51.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.076+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=H7ECR254PHB1 tag=O3FPJDDW6HVV type=write size=3796084 2024-09-12T17:36:51.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.078+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~NXPOWL3D8GHS.0 size=1048576 2024-09-12T17:36:51.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.079+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~NXPOWL3D8GHS.1 size=24212 2024-09-12T17:36:51.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.079+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=NXPOWL3D8GHS tag=651ZMFAM03MY type=write size=2121364 2024-09-12T17:36:51.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.080+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~2DSRJEHLXAVN.0 size=1048576 2024-09-12T17:36:51.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.081+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~2DSRJEHLXAVN.1 size=1048576 2024-09-12T17:36:51.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.082+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~2DSRJEHLXAVN.2 size=166920 2024-09-12T17:36:51.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.084+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=2DSRJEHLXAVN tag=GR4N6LKH2NWT type=write size=3312648 2024-09-12T17:36:51.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.085+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=QJHWXKOX5NVI type=del size=3764768 2024-09-12T17:36:51.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.087+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~DZ6M7FTV9O2Y.0 size=1048576 2024-09-12T17:36:51.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.088+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~DZ6M7FTV9O2Y.1 size=658952 2024-09-12T17:36:51.091 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.090+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=DZ6M7FTV9O2Y tag=MTHKRCH156CW type=write size=2756104 2024-09-12T17:36:51.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.092+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~06IW7PHE1RNR.0 size=1048576 2024-09-12T17:36:51.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.093+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~06IW7PHE1RNR.1 size=1048576 2024-09-12T17:36:51.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.094+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~06IW7PHE1RNR.2 size=133769 2024-09-12T17:36:51.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.094+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=06IW7PHE1RNR tag=TPIDT0M4CI4C type=write size=3279497 2024-09-12T17:36:51.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.095+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=M6BZP2RBTZBW type=del 2024-09-12T17:36:51.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.096+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=LX8ENWYRDGAX type=del size=1769425 2024-09-12T17:36:51.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.097+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=NDRN54INY5SV type=del 2024-09-12T17:36:51.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.099+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~U1QL1DBVT2RO.0 size=1048576 2024-09-12T17:36:51.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.100+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~U1QL1DBVT2RO.1 size=1048576 2024-09-12T17:36:51.102 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.101+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~U1QL1DBVT2RO.2 size=4098 2024-09-12T17:36:51.102 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.101+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=U1QL1DBVT2RO tag=D1VFT2GVQ1YH type=write size=3149826 2024-09-12T17:36:51.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.101+0000 7fa80ca76780 1 < canceled part key=_multipart_2AGKLZ3PQ2FD.2~PC0MDPZR2H98.0 size=1048576 2024-09-12T17:36:51.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.102+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~PC0MDPZR2H98.1 size=1048576 2024-09-12T17:36:51.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.105+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~PC0MDPZR2H98.2 size=784436 2024-09-12T17:36:51.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.107+0000 7fa80ca76780 1 < canceled multipart upload key=2AGKLZ3PQ2FD upload=PC0MDPZR2H98 tag=JRHUMPAY8YH6 type=write size=3930164 2024-09-12T17:36:51.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.108+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=5QNP58W6Z624 type=write size=611672 2024-09-12T17:36:51.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.110+0000 7fa80ca76780 1 < suggested remove operation key=4S33294MWCO1 tag=TGS29MPGUQ8I type=del 2024-09-12T17:36:51.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.112+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~XRMORVUVTBHO.0 size=1048576 2024-09-12T17:36:51.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.113+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~XRMORVUVTBHO.1 size=1048576 2024-09-12T17:36:51.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.113+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~XRMORVUVTBHO.2 size=551107 2024-09-12T17:36:51.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.113+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=XRMORVUVTBHO tag=PKM95KZOSNAV type=write size=3696835 2024-09-12T17:36:51.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.115+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=N8CY70GXI2MC type=del 2024-09-12T17:36:51.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.116+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=Q5DUZJY4LZPA type=del size=3491200 2024-09-12T17:36:51.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.119+0000 7fa80ca76780 1 < suggested remove operation key=5CAG55DQEF3Y tag=T6K0R603XCLW type=del 2024-09-12T17:36:51.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.121+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=S9J2TKNDADA4 type=del size=2658628 2024-09-12T17:36:51.123 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.122+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~887HHKWU8958.0 size=1048576 2024-09-12T17:36:51.123 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.123+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~887HHKWU8958.1 size=1048576 2024-09-12T17:36:51.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.123+0000 7fa80ca76780 1 < canceled part key=_multipart_E25BUY271ZSI.2~887HHKWU8958.2 size=13944 2024-09-12T17:36:51.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.124+0000 7fa80ca76780 1 < canceled multipart upload key=E25BUY271ZSI upload=887HHKWU8958 tag=K36SZRV618DH type=write size=3159672 2024-09-12T17:36:51.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.126+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~61SVV69Q92D3.0 size=1048576 2024-09-12T17:36:51.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.127+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~61SVV69Q92D3.1 size=1048576 2024-09-12T17:36:51.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.128+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~61SVV69Q92D3.2 size=886924 2024-09-12T17:36:51.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.128+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=61SVV69Q92D3 tag=JM60S3LHL1O6 type=write size=4032652 2024-09-12T17:36:51.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.129+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=EW51BNPCHVFU type=del 2024-09-12T17:36:51.131 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.130+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=CLDVQVFL4Y5N type=del size=2608693 2024-09-12T17:36:51.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.132+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=II1QLGBNA4G6 type=del 2024-09-12T17:36:51.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.133+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=AZQINK3MUDQM type=write size=981960 2024-09-12T17:36:51.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.135+0000 7fa80ca76780 1 < suggested update operation key=LU7PDGWTAK63 tag=GWRUD1MWPQM0 type=del size=2184079 2024-09-12T17:36:51.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.136+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=WN602T15DN8S type=del size=2837034 2024-09-12T17:36:51.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.138+0000 7fa80ca76780 1 < canceled operation key=EDRL3T2I9AOO tag=U84DHZ5BKZ0Y type=del size=2280691 2024-09-12T17:36:51.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.141+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~ZMNQTY1B95ON.0 size=1048576 2024-09-12T17:36:51.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.141+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~ZMNQTY1B95ON.1 size=1048576 2024-09-12T17:36:51.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.142+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~ZMNQTY1B95ON.2 size=151688 2024-09-12T17:36:51.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.142+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=ZMNQTY1B95ON tag=6R6UV3R50YC1 type=write size=3297416 2024-09-12T17:36:51.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.145+0000 7fa80ca76780 1 < suggested remove operation key=VNGH1DA1HANC tag=ZZY1NXMJHEOH type=del 2024-09-12T17:36:51.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.147+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~MHQUVDI3DBT2.0 size=848587 2024-09-12T17:36:51.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.147+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=MHQUVDI3DBT2 tag=USIFA9BGD8VS type=write size=1897163 2024-09-12T17:36:51.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.149+0000 7fa80ca76780 1 < suggested remove operation key=GKE6623N268Z tag=GBE1Y06LJM8M type=del 2024-09-12T17:36:51.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.150+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=5M1YZNI4QQPH type=del size=1967972 2024-09-12T17:36:51.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.151+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~NXPOWL3D8GHS.0 size=1048576 2024-09-12T17:36:51.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.152+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~NXPOWL3D8GHS.1 size=24212 2024-09-12T17:36:51.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.154+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=NXPOWL3D8GHS tag=651ZMFAM03MY type=write size=2121364 2024-09-12T17:36:51.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.156+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~G0PBZP0NFMTP.0 size=1048576 2024-09-12T17:36:51.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.157+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~G0PBZP0NFMTP.1 size=1048576 2024-09-12T17:36:51.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.158+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~G0PBZP0NFMTP.2 size=958434 2024-09-12T17:36:51.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.158+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=G0PBZP0NFMTP tag=O3Y7WRSQADFV type=write size=4104162 2024-09-12T17:36:51.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.159+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=QJHWXKOX5NVI type=del 2024-09-12T17:36:51.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.161+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=YXHXTI8ZZ11K type=write size=771303 2024-09-12T17:36:51.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.162+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~06IW7PHE1RNR.0 size=1048576 2024-09-12T17:36:51.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.163+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~06IW7PHE1RNR.1 size=1048576 2024-09-12T17:36:51.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.164+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~06IW7PHE1RNR.2 size=133769 2024-09-12T17:36:51.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.166+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=06IW7PHE1RNR tag=TPIDT0M4CI4C type=write size=3279497 2024-09-12T17:36:51.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.168+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~W30KHGVSZ7ZU.0 size=1048576 2024-09-12T17:36:51.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.169+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~W30KHGVSZ7ZU.1 size=657704 2024-09-12T17:36:51.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.169+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=W30KHGVSZ7ZU tag=5A1XXNN2VYPU type=write size=2754856 2024-09-12T17:36:51.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.170+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=LX8ENWYRDGAX type=del 2024-09-12T17:36:51.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.172+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=SDCX2Q63NAF8 type=write size=437736 2024-09-12T17:36:51.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.173+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~U1QL1DBVT2RO.0 size=1048576 2024-09-12T17:36:51.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.173+0000 7fa80ca76780 1 < canceled part key=_multipart_K243DOYPYVDS.2~U1QL1DBVT2RO.1 size=1048576 2024-09-12T17:36:51.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.174+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~U1QL1DBVT2RO.2 size=4098 2024-09-12T17:36:51.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.176+0000 7fa80ca76780 1 < canceled multipart upload key=K243DOYPYVDS upload=U1QL1DBVT2RO tag=D1VFT2GVQ1YH type=write size=3149826 2024-09-12T17:36:51.178 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.177+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=0V16QDF7GGDY type=del size=2871159 2024-09-12T17:36:51.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.178+0000 7fa80ca76780 1 < completed write operation key=Z81704G91EPL tag=5QNP58W6Z624 type=write size=611672 2024-09-12T17:36:51.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.181+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=FWB0T19WODOJ type=del size=3714819 2024-09-12T17:36:51.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.182+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~XRMORVUVTBHO.0 size=1048576 2024-09-12T17:36:51.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.183+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~XRMORVUVTBHO.1 size=1048576 2024-09-12T17:36:51.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.184+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~XRMORVUVTBHO.2 size=551107 2024-09-12T17:36:51.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.186+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=XRMORVUVTBHO tag=PKM95KZOSNAV type=write size=3696835 2024-09-12T17:36:51.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.187+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=7YMCMUJKKNUQ type=del size=2685446 2024-09-12T17:36:51.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.188+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=Q5DUZJY4LZPA type=del 2024-09-12T17:36:51.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.190+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~91OHEGI8T20D.0 size=1048576 2024-09-12T17:36:51.192 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.191+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~91OHEGI8T20D.1 size=1024074 2024-09-12T17:36:51.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.191+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=91OHEGI8T20D tag=4RMA3CQ1N0XL type=write size=3121226 2024-09-12T17:36:51.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.193+0000 7fa80ca76780 1 < completed delete operation key=07LPSZT2RKCC tag=S9J2TKNDADA4 type=del 2024-09-12T17:36:51.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.194+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=FG52V221DI6C type=write size=171480 2024-09-12T17:36:51.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.195+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~61SVV69Q92D3.0 size=1048576 2024-09-12T17:36:51.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.196+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~61SVV69Q92D3.1 size=1048576 2024-09-12T17:36:51.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.197+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~61SVV69Q92D3.2 size=886924 2024-09-12T17:36:51.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.199+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=61SVV69Q92D3 tag=JM60S3LHL1O6 type=write size=4032652 2024-09-12T17:36:51.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.202+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~YH4FAT5HMHYF.0 size=1048576 2024-09-12T17:36:51.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.203+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~YH4FAT5HMHYF.1 size=205062 2024-09-12T17:36:51.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.203+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=YH4FAT5HMHYF tag=DE7PSUZ92N2K type=write size=2302214 2024-09-12T17:36:51.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.205+0000 7fa80ca76780 1 < suggested update operation key=AKE8O7Q277HX tag=CLDVQVFL4Y5N type=del size=2608693 2024-09-12T17:36:51.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.207+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~U47ZOS08UEXU.0 size=261577 2024-09-12T17:36:51.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.207+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=U47ZOS08UEXU tag=CJPCXJKJCHES type=write size=1310153 2024-09-12T17:36:51.210 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.209+0000 7fa80ca76780 1 < completed write operation key=DYZIHCBF3D8U tag=AZQINK3MUDQM type=write size=981960 2024-09-12T17:36:51.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.210+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=1XFDLG6A9FH4 type=del size=3548442 2024-09-12T17:36:51.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.212+0000 7fa80ca76780 1 < suggested update operation key=E25BUY271ZSI tag=WN602T15DN8S type=del size=2837034 2024-09-12T17:36:51.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.214+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=J3D6K21YOC0Y type=del size=3542996 2024-09-12T17:36:51.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.215+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~ZMNQTY1B95ON.0 size=1048576 2024-09-12T17:36:51.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.216+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~ZMNQTY1B95ON.1 size=1048576 2024-09-12T17:36:51.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.218+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~ZMNQTY1B95ON.2 size=151688 2024-09-12T17:36:51.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.220+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=ZMNQTY1B95ON tag=6R6UV3R50YC1 type=write size=3297416 2024-09-12T17:36:51.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.221+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=6DY126TV0L8C type=write size=111374 2024-09-12T17:36:51.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.222+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~MHQUVDI3DBT2.0 size=848587 2024-09-12T17:36:51.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.225+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=MHQUVDI3DBT2 tag=USIFA9BGD8VS type=write size=1897163 2024-09-12T17:36:51.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.226+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=DLIPF5YPSLM8 type=write size=184015 2024-09-12T17:36:51.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.227+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=5M1YZNI4QQPH type=del 2024-09-12T17:36:51.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.229+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=VN2M0YC8TDMW type=del size=2841222 2024-09-12T17:36:51.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.230+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~G0PBZP0NFMTP.0 size=1048576 2024-09-12T17:36:51.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.231+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~G0PBZP0NFMTP.1 size=1048576 2024-09-12T17:36:51.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.232+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~G0PBZP0NFMTP.2 size=958434 2024-09-12T17:36:51.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.233+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=G0PBZP0NFMTP tag=O3Y7WRSQADFV type=write size=4104162 2024-09-12T17:36:51.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.234+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=QB5VG0CWGVXG type=del size=1286511 2024-09-12T17:36:51.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.237+0000 7fa80ca76780 1 < suggested update operation key=OJPZAWR5BLBN tag=YXHXTI8ZZ11K type=write size=771303 2024-09-12T17:36:51.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.239+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~JEZE2AQJQ3OT.0 size=1048576 2024-09-12T17:36:51.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.240+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~JEZE2AQJQ3OT.1 size=1048576 2024-09-12T17:36:51.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.240+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~JEZE2AQJQ3OT.2 size=227240 2024-09-12T17:36:51.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.240+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=JEZE2AQJQ3OT tag=BO767NEK1CE0 type=write size=3372968 2024-09-12T17:36:51.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.242+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~W30KHGVSZ7ZU.0 size=1048576 2024-09-12T17:36:51.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.242+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~W30KHGVSZ7ZU.1 size=657704 2024-09-12T17:36:51.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.244+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=W30KHGVSZ7ZU tag=5A1XXNN2VYPU type=write size=2754856 2024-09-12T17:36:51.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.246+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~7ASTCATPJ2UK.0 size=184702 2024-09-12T17:36:51.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.246+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=7ASTCATPJ2UK tag=EVB36WYJ3WPC type=write size=1233278 2024-09-12T17:36:51.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.249+0000 7fa80ca76780 1 < suggested remove operation key=0U9KSMYWT2C3 tag=SDCX2Q63NAF8 type=write 2024-09-12T17:36:51.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.251+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~D5X7C2UFEKW1.0 size=1048576 2024-09-12T17:36:51.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.252+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~D5X7C2UFEKW1.1 size=162152 2024-09-12T17:36:51.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.252+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=D5X7C2UFEKW1 tag=4D0F2R7UMTQS type=write size=2259304 2024-09-12T17:36:51.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.253+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=0V16QDF7GGDY type=del 2024-09-12T17:36:51.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.255+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~1WG31JY1IU3O.0 size=1048576 2024-09-12T17:36:51.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.256+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~1WG31JY1IU3O.1 size=953921 2024-09-12T17:36:51.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.256+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=1WG31JY1IU3O tag=6AYA9EVV3CXF type=write size=3051073 2024-09-12T17:36:51.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.257+0000 7fa80ca76780 1 < canceled operation key=7QHTQ6VHZ34P tag=FWB0T19WODOJ type=del size=3714819 2024-09-12T17:36:51.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.258+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=MS7511GDCSG3 type=del size=2110929 2024-09-12T17:36:51.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.261+0000 7fa80ca76780 1 < suggested update operation key=BLGMV3S9AY24 tag=7YMCMUJKKNUQ type=del size=2685446 2024-09-12T17:36:51.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.262+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=O82U13ONWJ1K type=del size=1874316 2024-09-12T17:36:51.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.263+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~91OHEGI8T20D.0 size=1048576 2024-09-12T17:36:51.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.264+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~91OHEGI8T20D.1 size=1024074 2024-09-12T17:36:51.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.266+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=91OHEGI8T20D tag=4RMA3CQ1N0XL type=write size=3121226 2024-09-12T17:36:51.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.267+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=X0VBKAYKEDF3 type=write size=1038053 2024-09-12T17:36:51.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.268+0000 7fa80ca76780 1 < completed write operation key=RC1IX4DQREEP tag=FG52V221DI6C type=write size=171480 2024-09-12T17:36:51.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.269+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=EHOOR4SXICKU type=del size=2570625 2024-09-12T17:36:51.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.270+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~YH4FAT5HMHYF.0 size=1048576 2024-09-12T17:36:51.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.271+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~YH4FAT5HMHYF.1 size=205062 2024-09-12T17:36:51.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.274+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=YH4FAT5HMHYF tag=DE7PSUZ92N2K type=write size=2302214 2024-09-12T17:36:51.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.276+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~4JMYPLD3GR3P.0 size=359286 2024-09-12T17:36:51.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.276+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=4JMYPLD3GR3P tag=OQUFXLPXEY4C type=write size=1407862 2024-09-12T17:36:51.278 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.277+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~U47ZOS08UEXU.0 size=261577 2024-09-12T17:36:51.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.279+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=U47ZOS08UEXU tag=CJPCXJKJCHES type=write size=1310153 2024-09-12T17:36:51.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.280+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=MKREU0MJ67SY type=del size=1910622 2024-09-12T17:36:51.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.283+0000 7fa80ca76780 1 < suggested update operation key=VNGH1DA1HANC tag=1XFDLG6A9FH4 type=del size=3548442 2024-09-12T17:36:51.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.284+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=OV1TEAAZ81HH type=write size=663519 2024-09-12T17:36:51.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.285+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=J3D6K21YOC0Y type=del 2024-09-12T17:36:51.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.288+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~V9OZDSCUTERP.0 size=1048576 2024-09-12T17:36:51.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.288+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~V9OZDSCUTERP.1 size=1048576 2024-09-12T17:36:51.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.289+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~V9OZDSCUTERP.2 size=1029017 2024-09-12T17:36:51.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.289+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=V9OZDSCUTERP tag=XHZ26MPVISHB type=write size=4174745 2024-09-12T17:36:51.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.291+0000 7fa80ca76780 -1 < failed to complete operation key=VNGH1DA1HANC tag=6DY126TV0L8C type=write size=111374: (22) Invalid argument 2024-09-12T17:36:51.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.292+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=6TO045BXWJWK type=del size=345977 2024-09-12T17:36:51.294 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.293+0000 7fa80ca76780 -1 < failed to complete operation key=0U9KSMYWT2C3 tag=DLIPF5YPSLM8 type=write size=184015: (22) Invalid argument 2024-09-12T17:36:51.295 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.294+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=SQXYZX6C9292 type=del size=322760 2024-09-12T17:36:51.296 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.295+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=VN2M0YC8TDMW type=del 2024-09-12T17:36:51.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.296+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=DRYOEIWDJHN2 type=del size=1304551 2024-09-12T17:36:51.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.299+0000 7fa80ca76780 1 < suggested remove operation key=LU7PDGWTAK63 tag=QB5VG0CWGVXG type=del 2024-09-12T17:36:51.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.300+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=7UQ8OFJDR2B2 type=del size=942832 2024-09-12T17:36:51.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.301+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~JEZE2AQJQ3OT.0 size=1048576 2024-09-12T17:36:51.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.302+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~JEZE2AQJQ3OT.1 size=1048576 2024-09-12T17:36:51.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.302+0000 7fa80ca76780 1 < canceled part key=_multipart_VC1X03K12V80.2~JEZE2AQJQ3OT.2 size=227240 2024-09-12T17:36:51.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.304+0000 7fa80ca76780 1 < canceled multipart upload key=VC1X03K12V80 upload=JEZE2AQJQ3OT tag=BO767NEK1CE0 type=write size=3372968 2024-09-12T17:36:51.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.306+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~TQ3P6GRKSM7V.0 size=1048576 2024-09-12T17:36:51.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.307+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~TQ3P6GRKSM7V.1 size=1048576 2024-09-12T17:36:51.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.308+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~TQ3P6GRKSM7V.2 size=221440 2024-09-12T17:36:51.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.308+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=TQ3P6GRKSM7V tag=7ARREWSZ6Z4J type=write size=3367168 2024-09-12T17:36:51.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.309+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~7ASTCATPJ2UK.0 size=184702 2024-09-12T17:36:51.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.311+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=7ASTCATPJ2UK tag=EVB36WYJ3WPC type=write size=1233278 2024-09-12T17:36:51.313 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.312+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=TS4ZNVVZCRDL type=write size=409251 2024-09-12T17:36:51.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.313+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~D5X7C2UFEKW1.0 size=1048576 2024-09-12T17:36:51.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.314+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~D5X7C2UFEKW1.1 size=162152 2024-09-12T17:36:51.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.316+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=D5X7C2UFEKW1 tag=4D0F2R7UMTQS type=write size=2259304 2024-09-12T17:36:51.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.318+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~ZOZQ2BTBLS99.0 size=1048576 2024-09-12T17:36:51.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.319+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~ZOZQ2BTBLS99.1 size=1048576 2024-09-12T17:36:51.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.320+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~ZOZQ2BTBLS99.2 size=1000748 2024-09-12T17:36:51.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.320+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=ZOZQ2BTBLS99 tag=D4P388NWEB57 type=write size=4146476 2024-09-12T17:36:51.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.321+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~1WG31JY1IU3O.0 size=1048576 2024-09-12T17:36:51.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.323+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~1WG31JY1IU3O.1 size=953921 2024-09-12T17:36:51.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.325+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=1WG31JY1IU3O tag=6AYA9EVV3CXF type=write size=3051073 2024-09-12T17:36:51.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.329+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~40VABNCY0F9F.0 size=497494 2024-09-12T17:36:51.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.329+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=40VABNCY0F9F tag=VO0ZXCKNIF57 type=write size=1546070 2024-09-12T17:36:51.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.333+0000 7fa80ca76780 1 < suggested update operation key=WGL9JYJXSHBH tag=MS7511GDCSG3 type=del size=2110929 2024-09-12T17:36:51.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.335+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~ACO3L3FVAUV3.0 size=1048576 2024-09-12T17:36:51.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.335+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~ACO3L3FVAUV3.1 size=1048576 2024-09-12T17:36:51.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.336+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~ACO3L3FVAUV3.2 size=1014408 2024-09-12T17:36:51.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.336+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=ACO3L3FVAUV3 tag=00Q7BG8ZIRPJ type=write size=4160136 2024-09-12T17:36:51.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.337+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=O82U13ONWJ1K type=del 2024-09-12T17:36:51.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.339+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~DK8XOOQA3TJY.0 size=1048576 2024-09-12T17:36:51.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.340+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~DK8XOOQA3TJY.1 size=1048576 2024-09-12T17:36:51.342 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.341+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~DK8XOOQA3TJY.2 size=594 2024-09-12T17:36:51.342 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.341+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=DK8XOOQA3TJY tag=2LUFZTN7EV1A type=write size=3146322 2024-09-12T17:36:51.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.342+0000 7fa80ca76780 1 < canceled operation key=VC1X03K12V80 tag=X0VBKAYKEDF3 type=write size=1038053 2024-09-12T17:36:51.344 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.343+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=XSQU52S0NFJY type=del size=670670 2024-09-12T17:36:51.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.344+0000 7fa80ca76780 -1 < no bi entry to suggest for operation key=LU7PDGWTAK63 tag=EHOOR4SXICKU type=del size=2570625: (2) No such file or directory 2024-09-12T17:36:51.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.345+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=6FWS5NR0Z9L3 type=write size=147199 2024-09-12T17:36:51.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.346+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~4JMYPLD3GR3P.0 size=359286 2024-09-12T17:36:51.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.348+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=4JMYPLD3GR3P tag=OQUFXLPXEY4C type=write size=1407862 2024-09-12T17:36:51.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.349+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=WOTNQEI1NGND type=write size=61535 2024-09-12T17:36:51.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.350+0000 7fa80ca76780 1 < canceled operation key=AKE8O7Q277HX tag=MKREU0MJ67SY type=del size=1910622 2024-09-12T17:36:51.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.352+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=BRSKBDKJRJ61 type=del size=775402 2024-09-12T17:36:51.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.353+0000 7fa80ca76780 1 < canceled operation key=7QHTQ6VHZ34P tag=OV1TEAAZ81HH type=write size=663519 2024-09-12T17:36:51.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.354+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=B41LNPIN5RBT type=del size=1037264 2024-09-12T17:36:51.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.355+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~V9OZDSCUTERP.0 size=1048576 2024-09-12T17:36:51.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.356+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~V9OZDSCUTERP.1 size=1048576 2024-09-12T17:36:51.358 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.357+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~V9OZDSCUTERP.2 size=1029017 2024-09-12T17:36:51.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.359+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=V9OZDSCUTERP tag=XHZ26MPVISHB type=write size=4174745 2024-09-12T17:36:51.361 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.360+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=RBAV0BHMN9QZ type=del size=2466439 2024-09-12T17:36:51.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.361+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=6TO045BXWJWK type=del 2024-09-12T17:36:51.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.363+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=MEC5H0V362P3 type=del size=1027560 2024-09-12T17:36:51.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.364+0000 7fa80ca76780 -1 < failed to complete operation key=WGL9JYJXSHBH tag=SQXYZX6C9292 type=del size=322760: (22) Invalid argument 2024-09-12T17:36:51.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.365+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=BHQO5N6153MW type=del size=3140839 2024-09-12T17:36:51.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.366+0000 7fa80ca76780 1 < canceled operation key=54KWSI77T73A tag=DRYOEIWDJHN2 type=del size=1304551 2024-09-12T17:36:51.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.367+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=YJKI7DO49ZCR type=write size=638798 2024-09-12T17:36:51.369 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.368+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=7UQ8OFJDR2B2 type=del 2024-09-12T17:36:51.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.370+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=OPND07S17ESB type=del size=2208559 2024-09-12T17:36:51.372 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.371+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~TQ3P6GRKSM7V.0 size=1048576 2024-09-12T17:36:51.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.372+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~TQ3P6GRKSM7V.1 size=1048576 2024-09-12T17:36:51.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.373+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~TQ3P6GRKSM7V.2 size=221440 2024-09-12T17:36:51.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.375+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=TQ3P6GRKSM7V tag=7ARREWSZ6Z4J type=write size=3367168 2024-09-12T17:36:51.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.377+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~XVA1UO7L9WCL.0 size=451535 2024-09-12T17:36:51.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.377+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=XVA1UO7L9WCL tag=MAPS1WO84C01 type=write size=1500111 2024-09-12T17:36:51.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.378+0000 7fa80ca76780 1 < completed write operation key=U8O04HYQZRJC tag=TS4ZNVVZCRDL type=write size=409251 2024-09-12T17:36:51.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.379+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=BVLJ0JMQGPI9 type=del size=3417879 2024-09-12T17:36:51.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.379+0000 7fa80ca76780 1 < canceled part key=_multipart_AKE8O7Q277HX.2~ZOZQ2BTBLS99.0 size=1048576 2024-09-12T17:36:51.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.380+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~ZOZQ2BTBLS99.1 size=1048576 2024-09-12T17:36:51.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.381+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~ZOZQ2BTBLS99.2 size=1000748 2024-09-12T17:36:51.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.383+0000 7fa80ca76780 1 < canceled multipart upload key=AKE8O7Q277HX upload=ZOZQ2BTBLS99 tag=D4P388NWEB57 type=write size=4146476 2024-09-12T17:36:51.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.385+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~BY3S4B148IY5.0 size=674296 2024-09-12T17:36:51.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.385+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=BY3S4B148IY5 tag=O0WHVU7EL2KL type=write size=1722872 2024-09-12T17:36:51.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.386+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~40VABNCY0F9F.0 size=497494 2024-09-12T17:36:51.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.388+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=40VABNCY0F9F tag=VO0ZXCKNIF57 type=write size=1546070 2024-09-12T17:36:51.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.390+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~X458QYUK2UGY.0 size=198730 2024-09-12T17:36:51.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.390+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=X458QYUK2UGY tag=J3ST5VKUDMZI type=write size=1247306 2024-09-12T17:36:51.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.391+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~ACO3L3FVAUV3.0 size=1048576 2024-09-12T17:36:51.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.392+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~ACO3L3FVAUV3.1 size=1048576 2024-09-12T17:36:51.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.392+0000 7fa80ca76780 1 < canceled part key=_multipart_0J6RTRJWZP1T.2~ACO3L3FVAUV3.2 size=1014408 2024-09-12T17:36:51.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.394+0000 7fa80ca76780 1 < canceled multipart upload key=0J6RTRJWZP1T upload=ACO3L3FVAUV3 tag=00Q7BG8ZIRPJ type=write size=4160136 2024-09-12T17:36:51.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.396+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~UG9SHOWIE47J.0 size=1048576 2024-09-12T17:36:51.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.397+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~UG9SHOWIE47J.1 size=984596 2024-09-12T17:36:51.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.397+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=UG9SHOWIE47J tag=TB6ZINQC8PC7 type=write size=3081748 2024-09-12T17:36:51.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.399+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~DK8XOOQA3TJY.0 size=1048576 2024-09-12T17:36:51.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.400+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~DK8XOOQA3TJY.1 size=1048576 2024-09-12T17:36:51.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.401+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~DK8XOOQA3TJY.2 size=594 2024-09-12T17:36:51.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.403+0000 7fa80ca76780 1 < completed multipart upload key=07LPSZT2RKCC upload=DK8XOOQA3TJY tag=2LUFZTN7EV1A type=write size=3146322 2024-09-12T17:36:51.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.404+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=A2RF0Z1TMT7D type=del size=768018 2024-09-12T17:36:51.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.405+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=XSQU52S0NFJY type=del 2024-09-12T17:36:51.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.406+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=J090IGZP90WU type=del size=2139735 2024-09-12T17:36:51.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.407+0000 7fa80ca76780 1 < completed write operation key=R871XU2TDWID tag=6FWS5NR0Z9L3 type=write size=147199 2024-09-12T17:36:51.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.409+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=06T0R5IUKCQN type=del size=2073610 2024-09-12T17:36:51.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.410+0000 7fa80ca76780 1 < completed write operation key=K243DOYPYVDS tag=WOTNQEI1NGND type=write size=61535 2024-09-12T17:36:51.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.412+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~A299U9ES6PN1.0 size=222128 2024-09-12T17:36:51.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.412+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=A299U9ES6PN1 tag=3HONSIT1A3EI type=write size=1270704 2024-09-12T17:36:51.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.413+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=BRSKBDKJRJ61 type=del 2024-09-12T17:36:51.416 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.415+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~0DCI0WWR6CYH.0 size=1048576 2024-09-12T17:36:51.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.416+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~0DCI0WWR6CYH.1 size=1048576 2024-09-12T17:36:51.419 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.418+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~0DCI0WWR6CYH.2 size=590619 2024-09-12T17:36:51.419 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.418+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=0DCI0WWR6CYH tag=IBI8LB355X5M type=write size=3736347 2024-09-12T17:36:51.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.419+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=B41LNPIN5RBT type=del 2024-09-12T17:36:51.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.420+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=C5QE2ODV3UPT type=del size=2702236 2024-09-12T17:36:51.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.421+0000 7fa80ca76780 1 < completed delete operation key=07LPSZT2RKCC tag=RBAV0BHMN9QZ type=del 2024-09-12T17:36:51.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.422+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=N9M2CLAXWFN2 type=del size=1109020 2024-09-12T17:36:51.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.424+0000 7fa80ca76780 1 < suggested remove operation key=E25BUY271ZSI tag=MEC5H0V362P3 type=del 2024-09-12T17:36:51.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.426+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=8TY7WJ41PVXE type=del size=3267897 2024-09-12T17:36:51.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.428+0000 7fa80ca76780 1 < suggested remove operation key=7QHTQ6VHZ34P tag=BHQO5N6153MW type=del 2024-09-12T17:36:51.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.430+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=2I7XNZJQMUKM type=write size=488624 2024-09-12T17:36:51.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.432+0000 7fa80ca76780 1 < suggested update operation key=VDD4PDR1GLWQ tag=YJKI7DO49ZCR type=write size=638798 2024-09-12T17:36:51.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.435+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~QS3MP2GZMBQK.0 size=1048576 2024-09-12T17:36:51.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.436+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~QS3MP2GZMBQK.1 size=931149 2024-09-12T17:36:51.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.436+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=QS3MP2GZMBQK tag=N88HCWKDSK0R type=write size=3028301 2024-09-12T17:36:51.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.437+0000 7fa80ca76780 1 < canceled operation key=94801LE91HZ9 tag=OPND07S17ESB type=del size=2208559 2024-09-12T17:36:51.439 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.438+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=H3RS7JWOCXXS type=del size=3134973 2024-09-12T17:36:51.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.440+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~XVA1UO7L9WCL.0 size=451535 2024-09-12T17:36:51.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.442+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=XVA1UO7L9WCL tag=MAPS1WO84C01 type=write size=1500111 2024-09-12T17:36:51.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.445+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~TP29VF8U67C1.0 size=273271 2024-09-12T17:36:51.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.445+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=TP29VF8U67C1 tag=EHDKUCQMY979 type=write size=1321847 2024-09-12T17:36:51.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.446+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=BVLJ0JMQGPI9 type=del 2024-09-12T17:36:51.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.447+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=BVYB2APZB2O4 type=del size=3231579 2024-09-12T17:36:51.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.448+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~BY3S4B148IY5.0 size=674296 2024-09-12T17:36:51.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.450+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=BY3S4B148IY5 tag=O0WHVU7EL2KL type=write size=1722872 2024-09-12T17:36:51.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.451+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=50KDAQTC3LWM type=del size=2478414 2024-09-12T17:36:51.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.452+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~X458QYUK2UGY.0 size=198730 2024-09-12T17:36:51.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.454+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=X458QYUK2UGY tag=J3ST5VKUDMZI type=write size=1247306 2024-09-12T17:36:51.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.455+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=LOEOY1ARSF9S type=del size=3460012 2024-09-12T17:36:51.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.456+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~UG9SHOWIE47J.0 size=1048576 2024-09-12T17:36:51.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.457+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~UG9SHOWIE47J.1 size=984596 2024-09-12T17:36:51.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.459+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=UG9SHOWIE47J tag=TB6ZINQC8PC7 type=write size=3081748 2024-09-12T17:36:51.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.460+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=W9CTJ5TV8TRG type=del size=2683001 2024-09-12T17:36:51.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.461+0000 7fa80ca76780 1 < canceled operation key=VNGH1DA1HANC tag=A2RF0Z1TMT7D type=del size=768018 2024-09-12T17:36:51.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.463+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~BIB6721CHIY0.0 size=1048576 2024-09-12T17:36:51.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.464+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~BIB6721CHIY0.1 size=1048576 2024-09-12T17:36:51.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.465+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~BIB6721CHIY0.2 size=348961 2024-09-12T17:36:51.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.465+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=BIB6721CHIY0 tag=7UV5KATGH17R type=write size=3494689 2024-09-12T17:36:51.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.467+0000 7fa80ca76780 1 < suggested remove operation key=LU7PDGWTAK63 tag=J090IGZP90WU type=del 2024-09-12T17:36:51.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.468+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=J9IXHARX8V4G type=del size=1571473 2024-09-12T17:36:51.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.469+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=06T0R5IUKCQN type=del 2024-09-12T17:36:51.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.470+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=HELL34QIHUGH type=del size=1950489 2024-09-12T17:36:51.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.471+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~A299U9ES6PN1.0 size=222128 2024-09-12T17:36:51.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.473+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=A299U9ES6PN1 tag=3HONSIT1A3EI type=write size=1270704 2024-09-12T17:36:51.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.474+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=X52Q6IXSM65A type=del size=2456811 2024-09-12T17:36:51.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.475+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~0DCI0WWR6CYH.0 size=1048576 2024-09-12T17:36:51.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.476+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~0DCI0WWR6CYH.1 size=1048576 2024-09-12T17:36:51.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.477+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~0DCI0WWR6CYH.2 size=590619 2024-09-12T17:36:51.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.479+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=0DCI0WWR6CYH tag=IBI8LB355X5M type=write size=3736347 2024-09-12T17:36:51.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.481+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=NC7F2EYSPWX5 type=del size=1839148 2024-09-12T17:36:51.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.483+0000 7fa80ca76780 1 < suggested remove operation key=54KWSI77T73A tag=C5QE2ODV3UPT type=del 2024-09-12T17:36:51.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.485+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~SKQ032E3TQKY.0 size=459142 2024-09-12T17:36:51.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.485+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=SKQ032E3TQKY tag=SZH6I25IPDEO type=write size=1507718 2024-09-12T17:36:51.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.486+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=N9M2CLAXWFN2 type=del 2024-09-12T17:36:51.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.488+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~P0YS7CHWEFQM.0 size=965230 2024-09-12T17:36:51.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.488+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=P0YS7CHWEFQM tag=LLJJCMY7JIFL type=write size=2013806 2024-09-12T17:36:51.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.490+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=8TY7WJ41PVXE type=del 2024-09-12T17:36:51.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.492+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~YCW49J71Y56Z.0 size=1048576 2024-09-12T17:36:51.494 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.493+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~YCW49J71Y56Z.1 size=1048576 2024-09-12T17:36:51.494 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.493+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~YCW49J71Y56Z.2 size=968275 2024-09-12T17:36:51.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.493+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=YCW49J71Y56Z tag=H6DG4GN3FB94 type=write size=4114003 2024-09-12T17:36:51.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.495+0000 7fa80ca76780 1 < canceled operation key=0X3LGXL2QFRN tag=2I7XNZJQMUKM type=write size=488624 2024-09-12T17:36:51.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.497+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~2PUBZAWIQ3QI.0 size=1048576 2024-09-12T17:36:51.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.498+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~2PUBZAWIQ3QI.1 size=484355 2024-09-12T17:36:51.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.498+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=2PUBZAWIQ3QI tag=9GWX4RGG3F7S type=write size=2581507 2024-09-12T17:36:51.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.499+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~QS3MP2GZMBQK.0 size=1048576 2024-09-12T17:36:51.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.500+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~QS3MP2GZMBQK.1 size=931149 2024-09-12T17:36:51.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.502+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=QS3MP2GZMBQK tag=N88HCWKDSK0R type=write size=3028301 2024-09-12T17:36:51.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.503+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=RMVD3NQBPC94 type=del size=1705334 2024-09-12T17:36:51.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.505+0000 7fa80ca76780 1 < canceled operation key=OJPZAWR5BLBN tag=H3RS7JWOCXXS type=del size=3134973 2024-09-12T17:36:51.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.507+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~FSZQCPAN5K0T.0 size=1048576 2024-09-12T17:36:51.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.508+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~FSZQCPAN5K0T.1 size=127331 2024-09-12T17:36:51.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.508+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=FSZQCPAN5K0T tag=XLOKF53ZJ9W4 type=write size=2224483 2024-09-12T17:36:51.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.509+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~TP29VF8U67C1.0 size=273271 2024-09-12T17:36:51.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.510+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=TP29VF8U67C1 tag=EHDKUCQMY979 type=write size=1321847 2024-09-12T17:36:51.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.512+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~UTSMZ13V2XXT.0 size=319710 2024-09-12T17:36:51.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.512+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=UTSMZ13V2XXT tag=50AKEKP2SVN1 type=write size=1368286 2024-09-12T17:36:51.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.515+0000 7fa80ca76780 1 < suggested update operation key=Z81704G91EPL tag=BVYB2APZB2O4 type=del size=3231579 2024-09-12T17:36:51.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.517+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~7NR1G4OKFFPO.0 size=438643 2024-09-12T17:36:51.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.517+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=7NR1G4OKFFPO tag=G78IWNNRU501 type=write size=1487219 2024-09-12T17:36:51.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.518+0000 7fa80ca76780 -1 < failed to complete operation key=54KWSI77T73A tag=50KDAQTC3LWM type=del size=2478414: (22) Invalid argument 2024-09-12T17:36:51.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.519+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=QQTUNR8HZWFN type=del size=2372368 2024-09-12T17:36:51.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.520+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=LOEOY1ARSF9S type=del 2024-09-12T17:36:51.522 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.521+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=GU3T0WK7NE8Z type=del size=2254795 2024-09-12T17:36:51.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.522+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=W9CTJ5TV8TRG type=del 2024-09-12T17:36:51.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.523+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=QC759SXBPXC7 type=del size=227011 2024-09-12T17:36:51.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.524+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~BIB6721CHIY0.0 size=1048576 2024-09-12T17:36:51.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.525+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~BIB6721CHIY0.1 size=1048576 2024-09-12T17:36:51.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.526+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~BIB6721CHIY0.2 size=348961 2024-09-12T17:36:51.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.528+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=BIB6721CHIY0 tag=7UV5KATGH17R type=write size=3494689 2024-09-12T17:36:51.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.529+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=XQ8YN9J0F3RS type=del size=3315625 2024-09-12T17:36:51.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.530+0000 7fa80ca76780 1 < canceled operation key=GKE6623N268Z tag=J9IXHARX8V4G type=del size=1571473 2024-09-12T17:36:51.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.531+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=E85ZYI20LZRE type=del size=3208970 2024-09-12T17:36:51.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.533+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=HELL34QIHUGH type=del 2024-09-12T17:36:51.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.535+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~OMTOKUF0NCBS.0 size=524017 2024-09-12T17:36:51.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.535+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=OMTOKUF0NCBS tag=L32USDXRHZEA type=write size=1572593 2024-09-12T17:36:51.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.537+0000 7fa80ca76780 1 < suggested remove operation key=0J6RTRJWZP1T tag=X52Q6IXSM65A type=del 2024-09-12T17:36:51.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.539+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~2X48YTTZBCBI.0 size=1048576 2024-09-12T17:36:51.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.540+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~2X48YTTZBCBI.1 size=160719 2024-09-12T17:36:51.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.540+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=2X48YTTZBCBI tag=WCJ7V5866OKJ type=write size=2257871 2024-09-12T17:36:51.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.541+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=NC7F2EYSPWX5 type=del 2024-09-12T17:36:51.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.542+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=Y8MZIQIYK9P6 type=del size=3421843 2024-09-12T17:36:51.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.543+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~SKQ032E3TQKY.0 size=459142 2024-09-12T17:36:51.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.546+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=SKQ032E3TQKY tag=SZH6I25IPDEO type=write size=1507718 2024-09-12T17:36:51.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.547+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=3YQHIRHAOU5I type=del size=3967371 2024-09-12T17:36:51.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.548+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~P0YS7CHWEFQM.0 size=965230 2024-09-12T17:36:51.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.550+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=P0YS7CHWEFQM tag=LLJJCMY7JIFL type=write size=2013806 2024-09-12T17:36:51.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.552+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=W3AOAPXLCSJJ type=del size=3066403 2024-09-12T17:36:51.554 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.553+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~YCW49J71Y56Z.0 size=1048576 2024-09-12T17:36:51.555 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.554+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~YCW49J71Y56Z.1 size=1048576 2024-09-12T17:36:51.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.555+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~YCW49J71Y56Z.2 size=968275 2024-09-12T17:36:51.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.557+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=YCW49J71Y56Z tag=H6DG4GN3FB94 type=write size=4114003 2024-09-12T17:36:51.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.558+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=WDIEKGSFT8OA type=del size=70744 2024-09-12T17:36:51.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.559+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~2PUBZAWIQ3QI.0 size=1048576 2024-09-12T17:36:51.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.560+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~2PUBZAWIQ3QI.1 size=484355 2024-09-12T17:36:51.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.562+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=2PUBZAWIQ3QI tag=9GWX4RGG3F7S type=write size=2581507 2024-09-12T17:36:51.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.565+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~C3Q72RSV8EZ7.0 size=339312 2024-09-12T17:36:51.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.565+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=C3Q72RSV8EZ7 tag=APOA2O8CTZ1U type=write size=1387888 2024-09-12T17:36:51.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.566+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=RMVD3NQBPC94 type=del 2024-09-12T17:36:51.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.568+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~A3CYM5OREBFY.0 size=1048576 2024-09-12T17:36:51.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.570+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~A3CYM5OREBFY.1 size=885334 2024-09-12T17:36:51.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.570+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=A3CYM5OREBFY tag=Y7OV2BWAD76E type=write size=2982486 2024-09-12T17:36:51.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.571+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~FSZQCPAN5K0T.0 size=1048576 2024-09-12T17:36:51.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.571+0000 7fa80ca76780 1 < canceled part key=_multipart_4S33294MWCO1.2~FSZQCPAN5K0T.1 size=127331 2024-09-12T17:36:51.574 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.573+0000 7fa80ca76780 1 < canceled multipart upload key=4S33294MWCO1 upload=FSZQCPAN5K0T tag=XLOKF53ZJ9W4 type=write size=2224483 2024-09-12T17:36:51.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.574+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=5FZQFHZ051GW type=del size=3757473 2024-09-12T17:36:51.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.575+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~UTSMZ13V2XXT.0 size=319710 2024-09-12T17:36:51.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.577+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=UTSMZ13V2XXT tag=50AKEKP2SVN1 type=write size=1368286 2024-09-12T17:36:51.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.578+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=9CA03DOEWQ7P type=write size=34178 2024-09-12T17:36:51.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.579+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~7NR1G4OKFFPO.0 size=438643 2024-09-12T17:36:51.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.580+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=7NR1G4OKFFPO tag=G78IWNNRU501 type=write size=1487219 2024-09-12T17:36:51.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.583+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~Z7BS53MUFBN4.0 size=1048576 2024-09-12T17:36:51.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.583+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~Z7BS53MUFBN4.1 size=1048576 2024-09-12T17:36:51.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.584+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~Z7BS53MUFBN4.2 size=129428 2024-09-12T17:36:51.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.584+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=Z7BS53MUFBN4 tag=4J3QPNAGLPIV type=write size=3275156 2024-09-12T17:36:51.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.588+0000 7fa80ca76780 1 < suggested remove operation key=VNGH1DA1HANC tag=QQTUNR8HZWFN type=del 2024-09-12T17:36:51.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.590+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=LZGBDCG1MDKB type=del size=1381187 2024-09-12T17:36:51.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.591+0000 7fa80ca76780 1 < completed delete operation key=07LPSZT2RKCC tag=GU3T0WK7NE8Z type=del 2024-09-12T17:36:51.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.592+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=9HEXIOK351XS type=del size=1780562 2024-09-12T17:36:51.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.593+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=QC759SXBPXC7 type=del 2024-09-12T17:36:51.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.595+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~FQ4RIUODWFSY.0 size=1048576 2024-09-12T17:36:51.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.596+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~FQ4RIUODWFSY.1 size=256186 2024-09-12T17:36:51.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.596+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=FQ4RIUODWFSY tag=PXZ9E0YHTGDS type=write size=2353338 2024-09-12T17:36:51.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.597+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=XQ8YN9J0F3RS type=del 2024-09-12T17:36:51.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.599+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~RRB89Z3O3GQF.0 size=903774 2024-09-12T17:36:51.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.599+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=RRB89Z3O3GQF tag=05ZJO4MHXUVD type=write size=1952350 2024-09-12T17:36:51.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.600+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=E85ZYI20LZRE type=del 2024-09-12T17:36:51.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.602+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~0NOQ3TWPV85C.0 size=1048576 2024-09-12T17:36:51.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.603+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~0NOQ3TWPV85C.1 size=1048576 2024-09-12T17:36:51.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.604+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~0NOQ3TWPV85C.2 size=243072 2024-09-12T17:36:51.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.604+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=0NOQ3TWPV85C tag=JTPMB5TES59U type=write size=3388800 2024-09-12T17:36:51.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.605+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~OMTOKUF0NCBS.0 size=524017 2024-09-12T17:36:51.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.607+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=OMTOKUF0NCBS tag=L32USDXRHZEA type=write size=1572593 2024-09-12T17:36:51.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.608+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=F5BQOPHS3EMO type=del size=2819342 2024-09-12T17:36:51.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.609+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~2X48YTTZBCBI.0 size=1048576 2024-09-12T17:36:51.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.610+0000 7fa80ca76780 1 < canceled part key=_multipart_0X3LGXL2QFRN.2~2X48YTTZBCBI.1 size=160719 2024-09-12T17:36:51.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.611+0000 7fa80ca76780 1 < canceled multipart upload key=0X3LGXL2QFRN upload=2X48YTTZBCBI tag=WCJ7V5866OKJ type=write size=2257871 2024-09-12T17:36:51.614 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.613+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=NHC3K5T37701 type=write size=264806 2024-09-12T17:36:51.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.614+0000 7fa80ca76780 1 < canceled operation key=Z81704G91EPL tag=Y8MZIQIYK9P6 type=del size=3421843 2024-09-12T17:36:51.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.615+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=NKLHGEELS3EZ type=write size=1018469 2024-09-12T17:36:51.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.617+0000 7fa80ca76780 1 < suggested update operation key=Z81704G91EPL tag=3YQHIRHAOU5I type=del size=3967371 2024-09-12T17:36:51.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.619+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~MUF2B3G9HL4P.0 size=1048576 2024-09-12T17:36:51.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.620+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~MUF2B3G9HL4P.1 size=1048576 2024-09-12T17:36:51.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.621+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~MUF2B3G9HL4P.2 size=501961 2024-09-12T17:36:51.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.621+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=MUF2B3G9HL4P tag=9ODZIL7UG7GO type=write size=3647689 2024-09-12T17:36:51.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.624+0000 7fa80ca76780 1 < suggested update operation key=VC1X03K12V80 tag=W3AOAPXLCSJJ type=del size=3066403 2024-09-12T17:36:51.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.625+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=YZY40CS5D5CJ type=del size=376638 2024-09-12T17:36:51.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.627+0000 7fa80ca76780 1 < suggested remove operation key=GKE6623N268Z tag=WDIEKGSFT8OA type=del 2024-09-12T17:36:51.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.628+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=NKT4KYU7DODH type=del size=1253018 2024-09-12T17:36:51.630 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.629+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~C3Q72RSV8EZ7.0 size=339312 2024-09-12T17:36:51.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.631+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=C3Q72RSV8EZ7 tag=APOA2O8CTZ1U type=write size=1387888 2024-09-12T17:36:51.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.633+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~RAGOGMFDYXJD.0 size=1048576 2024-09-12T17:36:51.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.634+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~RAGOGMFDYXJD.1 size=1048576 2024-09-12T17:36:51.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.635+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~RAGOGMFDYXJD.2 size=795368 2024-09-12T17:36:51.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.635+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=RAGOGMFDYXJD tag=97Y1H4L8A41P type=write size=3941096 2024-09-12T17:36:51.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.636+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~A3CYM5OREBFY.0 size=1048576 2024-09-12T17:36:51.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.637+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~A3CYM5OREBFY.1 size=885334 2024-09-12T17:36:51.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.640+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=A3CYM5OREBFY tag=Y7OV2BWAD76E type=write size=2982486 2024-09-12T17:36:51.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.641+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=P647BDR3F26Q type=write size=115416 2024-09-12T17:36:51.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.642+0000 7fa80ca76780 -1 < failed to complete operation key=Z81704G91EPL tag=5FZQFHZ051GW type=del size=3757473: (22) Invalid argument 2024-09-12T17:36:51.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.643+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=SIKOBQJ61N3H type=del size=16472 2024-09-12T17:36:51.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.645+0000 7fa80ca76780 1 < completed write operation key=AKE8O7Q277HX tag=9CA03DOEWQ7P type=write size=34178 2024-09-12T17:36:51.647 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.646+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=4X1UY6IKS01M type=del size=1147473 2024-09-12T17:36:51.647 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.646+0000 7fa80ca76780 1 < canceled part key=_multipart_BLGMV3S9AY24.2~Z7BS53MUFBN4.0 size=1048576 2024-09-12T17:36:51.648 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.647+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~Z7BS53MUFBN4.1 size=1048576 2024-09-12T17:36:51.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.648+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~Z7BS53MUFBN4.2 size=129428 2024-09-12T17:36:51.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.650+0000 7fa80ca76780 1 < canceled multipart upload key=BLGMV3S9AY24 upload=Z7BS53MUFBN4 tag=4J3QPNAGLPIV type=write size=3275156 2024-09-12T17:36:51.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.652+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~KGDLQ47EWV55.0 size=1048576 2024-09-12T17:36:51.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.653+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~KGDLQ47EWV55.1 size=643353 2024-09-12T17:36:51.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.653+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=KGDLQ47EWV55 tag=DOGQLNYOGJLM type=write size=2740505 2024-09-12T17:36:51.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.654+0000 7fa80ca76780 1 < canceled operation key=5CAG55DQEF3Y tag=LZGBDCG1MDKB type=del size=1381187 2024-09-12T17:36:51.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.656+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=7NTT8DGWH01C type=del size=445456 2024-09-12T17:36:51.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.657+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=9HEXIOK351XS type=del 2024-09-12T17:36:51.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.660+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~XFX5Z1IL0QIL.0 size=351323 2024-09-12T17:36:51.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.660+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=XFX5Z1IL0QIL tag=4V0PF85E172D type=write size=1399899 2024-09-12T17:36:51.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.661+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~FQ4RIUODWFSY.0 size=1048576 2024-09-12T17:36:51.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.662+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~FQ4RIUODWFSY.1 size=256186 2024-09-12T17:36:51.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.664+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=FQ4RIUODWFSY tag=PXZ9E0YHTGDS type=write size=2353338 2024-09-12T17:36:51.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.666+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~FXPL3WNUX61T.0 size=770427 2024-09-12T17:36:51.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.666+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=FXPL3WNUX61T tag=JK4EAY7IFUKN type=write size=1819003 2024-09-12T17:36:51.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.667+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~RRB89Z3O3GQF.0 size=903774 2024-09-12T17:36:51.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.669+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=RRB89Z3O3GQF tag=05ZJO4MHXUVD type=write size=1952350 2024-09-12T17:36:51.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.670+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=YP9I4N95AHBZ type=del size=3777536 2024-09-12T17:36:51.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.671+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~0NOQ3TWPV85C.0 size=1048576 2024-09-12T17:36:51.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.672+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~0NOQ3TWPV85C.1 size=1048576 2024-09-12T17:36:51.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.673+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~0NOQ3TWPV85C.2 size=243072 2024-09-12T17:36:51.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.675+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=0NOQ3TWPV85C tag=JTPMB5TES59U type=write size=3388800 2024-09-12T17:36:51.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.677+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~SWJ5LJBGIALC.0 size=1048576 2024-09-12T17:36:51.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.678+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~SWJ5LJBGIALC.1 size=474805 2024-09-12T17:36:51.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.678+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=SWJ5LJBGIALC tag=0MH5MRVOUK0R type=write size=2571957 2024-09-12T17:36:51.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.679+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=F5BQOPHS3EMO type=del 2024-09-12T17:36:51.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.680+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=ELNRGMDOQCFE type=del size=643007 2024-09-12T17:36:51.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.681+0000 7fa80ca76780 -1 < failed to complete operation key=Z81704G91EPL tag=NHC3K5T37701 type=write size=264806: (22) Invalid argument 2024-09-12T17:36:51.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.683+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~9NEMNLFZO2X4.0 size=1048576 2024-09-12T17:36:51.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.684+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~9NEMNLFZO2X4.1 size=699966 2024-09-12T17:36:51.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.684+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=9NEMNLFZO2X4 tag=YYIGJHK72QQG type=write size=2797118 2024-09-12T17:36:51.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.685+0000 7fa80ca76780 1 < completed write operation key=2AGKLZ3PQ2FD tag=NKLHGEELS3EZ type=write size=1018469 2024-09-12T17:36:51.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.687+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=5RDBGSI4GNRR type=del size=1825892 2024-09-12T17:36:51.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.688+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~MUF2B3G9HL4P.0 size=1048576 2024-09-12T17:36:51.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.689+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~MUF2B3G9HL4P.1 size=1048576 2024-09-12T17:36:51.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.690+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~MUF2B3G9HL4P.2 size=501961 2024-09-12T17:36:51.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.691+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=MUF2B3G9HL4P tag=9ODZIL7UG7GO type=write size=3647689 2024-09-12T17:36:51.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.693+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=DHX911DS8AF7 type=del size=2740406 2024-09-12T17:36:51.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.694+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=YZY40CS5D5CJ type=del 2024-09-12T17:36:51.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.696+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~493U7AG2VFDN.0 size=294071 2024-09-12T17:36:51.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.696+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=493U7AG2VFDN tag=LJNAP030XIYX type=write size=1342647 2024-09-12T17:36:51.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.697+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=NKT4KYU7DODH type=del 2024-09-12T17:36:51.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.698+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=OB1O81MUT9A4 type=del size=556497 2024-09-12T17:36:51.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.699+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~RAGOGMFDYXJD.0 size=1048576 2024-09-12T17:36:51.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.700+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~RAGOGMFDYXJD.1 size=1048576 2024-09-12T17:36:51.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.701+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~RAGOGMFDYXJD.2 size=795368 2024-09-12T17:36:51.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.703+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=RAGOGMFDYXJD tag=97Y1H4L8A41P type=write size=3941096 2024-09-12T17:36:51.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.712+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=A16RD68VBEXU type=del size=747259 2024-09-12T17:36:51.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.713+0000 7fa80ca76780 1 < completed write operation key=VC1X03K12V80 tag=P647BDR3F26Q type=write size=115416 2024-09-12T17:36:51.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.715+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~8Y0C01K5F6G9.0 size=1048576 2024-09-12T17:36:51.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.716+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~8Y0C01K5F6G9.1 size=966927 2024-09-12T17:36:51.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.716+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=8Y0C01K5F6G9 tag=A5CR077VGLL3 type=write size=3064079 2024-09-12T17:36:51.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.717+0000 7fa80ca76780 1 < canceled operation key=VC1X03K12V80 tag=SIKOBQJ61N3H type=del size=16472 2024-09-12T17:36:51.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.719+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~3A0NFK66C6WU.0 size=1048576 2024-09-12T17:36:51.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.720+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~3A0NFK66C6WU.1 size=873330 2024-09-12T17:36:51.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.720+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=3A0NFK66C6WU tag=6W4VVJRNCQ5E type=write size=2970482 2024-09-12T17:36:51.722 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.721+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=4X1UY6IKS01M type=del 2024-09-12T17:36:51.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.724+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~X230IR8E52V9.0 size=1048576 2024-09-12T17:36:51.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.725+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~X230IR8E52V9.1 size=311520 2024-09-12T17:36:51.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.725+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=X230IR8E52V9 tag=O8NKGPLI31WW type=write size=2408672 2024-09-12T17:36:51.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.726+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~KGDLQ47EWV55.0 size=1048576 2024-09-12T17:36:51.728 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.727+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~KGDLQ47EWV55.1 size=643353 2024-09-12T17:36:51.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.729+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=KGDLQ47EWV55 tag=DOGQLNYOGJLM type=write size=2740505 2024-09-12T17:36:51.731 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.730+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=EAAMXRKMTHPD type=del size=2005320 2024-09-12T17:36:51.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.731+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=7NTT8DGWH01C type=del 2024-09-12T17:36:51.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.733+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~805V0Z0OPLT2.0 size=616482 2024-09-12T17:36:51.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.733+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=805V0Z0OPLT2 tag=XGHDII82ZVT0 type=write size=1665058 2024-09-12T17:36:51.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.733+0000 7fa80ca76780 1 < canceled part key=_multipart_AKE8O7Q277HX.2~XFX5Z1IL0QIL.0 size=351323 2024-09-12T17:36:51.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.735+0000 7fa80ca76780 1 < canceled multipart upload key=AKE8O7Q277HX upload=XFX5Z1IL0QIL tag=4V0PF85E172D type=write size=1399899 2024-09-12T17:36:51.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.736+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=QPB1F5WJWNO3 type=del size=2807309 2024-09-12T17:36:51.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.738+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~FXPL3WNUX61T.0 size=770427 2024-09-12T17:36:51.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.740+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=FXPL3WNUX61T tag=JK4EAY7IFUKN type=write size=1819003 2024-09-12T17:36:51.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.741+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=M4AXG10VVOTN type=del size=3085053 2024-09-12T17:36:51.743 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.742+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=YP9I4N95AHBZ type=del 2024-09-12T17:36:51.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.743+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=22DOJ31JZM8X type=del size=980673 2024-09-12T17:36:51.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.744+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~SWJ5LJBGIALC.0 size=1048576 2024-09-12T17:36:51.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.745+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~SWJ5LJBGIALC.1 size=474805 2024-09-12T17:36:51.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.747+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=SWJ5LJBGIALC tag=0MH5MRVOUK0R type=write size=2571957 2024-09-12T17:36:51.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.749+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~GV1RLD81IR2N.0 size=336508 2024-09-12T17:36:51.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.749+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=GV1RLD81IR2N tag=D09GW141H0C6 type=write size=1385084 2024-09-12T17:36:51.752 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.751+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=ELNRGMDOQCFE type=del 2024-09-12T17:36:51.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.753+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~0NGLYH5ZAASL.0 size=1048576 2024-09-12T17:36:51.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.754+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~0NGLYH5ZAASL.1 size=888180 2024-09-12T17:36:51.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.754+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=0NGLYH5ZAASL tag=900I8DCJ3EVK type=write size=2985332 2024-09-12T17:36:51.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.755+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~9NEMNLFZO2X4.0 size=1048576 2024-09-12T17:36:51.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.756+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~9NEMNLFZO2X4.1 size=699966 2024-09-12T17:36:51.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.758+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=9NEMNLFZO2X4 tag=YYIGJHK72QQG type=write size=2797118 2024-09-12T17:36:51.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.759+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=0I4GIDA4KF9Z type=write size=249201 2024-09-12T17:36:51.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.760+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=5RDBGSI4GNRR type=del 2024-09-12T17:36:51.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.762+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~M03UFY5PJLJ6.0 size=1048576 2024-09-12T17:36:51.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.763+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~M03UFY5PJLJ6.1 size=336041 2024-09-12T17:36:51.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.763+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=M03UFY5PJLJ6 tag=BFTCP7SYAFG7 type=write size=2433193 2024-09-12T17:36:51.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.764+0000 7fa80ca76780 1 < canceled operation key=4S33294MWCO1 tag=DHX911DS8AF7 type=del size=2740406 2024-09-12T17:36:51.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.765+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=AVH1Z0BYSMD4 type=del size=741914 2024-09-12T17:36:51.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.767+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~493U7AG2VFDN.0 size=294071 2024-09-12T17:36:51.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.768+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=493U7AG2VFDN tag=LJNAP030XIYX type=write size=1342647 2024-09-12T17:36:51.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.771+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=LVS6LA5S68BT type=del size=1007606 2024-09-12T17:36:51.773 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.772+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=OB1O81MUT9A4 type=del 2024-09-12T17:36:51.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.773+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=D2H6MO7MJDXL type=del size=3728879 2024-09-12T17:36:51.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.774+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=A16RD68VBEXU type=del 2024-09-12T17:36:51.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.775+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=OORVIH9II2UN type=del size=2225237 2024-09-12T17:36:51.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.776+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~8Y0C01K5F6G9.0 size=1048576 2024-09-12T17:36:51.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.777+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~8Y0C01K5F6G9.1 size=966927 2024-09-12T17:36:51.780 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.779+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=8Y0C01K5F6G9 tag=A5CR077VGLL3 type=write size=3064079 2024-09-12T17:36:51.782 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.781+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~WVQO1YQKSWMY.0 size=1048576 2024-09-12T17:36:51.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.782+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~WVQO1YQKSWMY.1 size=1048576 2024-09-12T17:36:51.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.783+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~WVQO1YQKSWMY.2 size=134501 2024-09-12T17:36:51.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.783+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=WVQO1YQKSWMY tag=JYFQ9M2ZZBSQ type=write size=3280229 2024-09-12T17:36:51.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.785+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~3A0NFK66C6WU.0 size=1048576 2024-09-12T17:36:51.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.786+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~3A0NFK66C6WU.1 size=873330 2024-09-12T17:36:51.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.788+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=3A0NFK66C6WU tag=6W4VVJRNCQ5E type=write size=2970482 2024-09-12T17:36:51.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.790+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~VBMPZOQFUTO4.0 size=1048576 2024-09-12T17:36:51.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.791+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~VBMPZOQFUTO4.1 size=1048576 2024-09-12T17:36:51.793 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.792+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~VBMPZOQFUTO4.2 size=347746 2024-09-12T17:36:51.793 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.792+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=VBMPZOQFUTO4 tag=L6AF9Z7SBAOZ type=write size=3493474 2024-09-12T17:36:51.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.793+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~X230IR8E52V9.0 size=1048576 2024-09-12T17:36:51.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.794+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~X230IR8E52V9.1 size=311520 2024-09-12T17:36:51.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.796+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=X230IR8E52V9 tag=O8NKGPLI31WW type=write size=2408672 2024-09-12T17:36:51.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.798+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~FE2U3GYPN14R.0 size=990835 2024-09-12T17:36:51.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.798+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=FE2U3GYPN14R tag=CM4Z1S5C6GC2 type=write size=2039411 2024-09-12T17:36:51.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.800+0000 7fa80ca76780 1 < suggested update operation key=0X3LGXL2QFRN tag=EAAMXRKMTHPD type=del size=2005320 2024-09-12T17:36:51.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.801+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=6NR1X03TKVIZ type=del size=3624737 2024-09-12T17:36:51.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.802+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~805V0Z0OPLT2.0 size=616482 2024-09-12T17:36:51.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.804+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=805V0Z0OPLT2 tag=XGHDII82ZVT0 type=write size=1665058 2024-09-12T17:36:51.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.805+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=TD62AEYD7YNS type=del size=228779 2024-09-12T17:36:51.808 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.807+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=QPB1F5WJWNO3 type=del 2024-09-12T17:36:51.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.809+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~BU15O8RXRDAW.0 size=431214 2024-09-12T17:36:51.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.809+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=BU15O8RXRDAW tag=QQZ1U8S0O5F6 type=write size=1479790 2024-09-12T17:36:51.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.810+0000 7fa80ca76780 1 < canceled operation key=R02234GEWV6B tag=M4AXG10VVOTN type=del size=3085053 2024-09-12T17:36:51.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.811+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=49Y8T16R5QKQ type=del size=769925 2024-09-12T17:36:51.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.814+0000 7fa80ca76780 1 < suggested update operation key=8Z3EPQHMA6M5 tag=22DOJ31JZM8X type=del size=980673 2024-09-12T17:36:51.816 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.815+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=G1PX94DJ0HUQ type=del size=387443 2024-09-12T17:36:51.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.816+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~GV1RLD81IR2N.0 size=336508 2024-09-12T17:36:51.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.818+0000 7fa80ca76780 1 < completed multipart upload key=07LPSZT2RKCC upload=GV1RLD81IR2N tag=D09GW141H0C6 type=write size=1385084 2024-09-12T17:36:51.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.819+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=8YXSJ2Q09HCT type=del size=3164524 2024-09-12T17:36:51.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.821+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~0NGLYH5ZAASL.0 size=1048576 2024-09-12T17:36:51.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.822+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~0NGLYH5ZAASL.1 size=888180 2024-09-12T17:36:51.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.824+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=0NGLYH5ZAASL tag=900I8DCJ3EVK type=write size=2985332 2024-09-12T17:36:51.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.826+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~PW87FF5XKTMF.0 size=453187 2024-09-12T17:36:51.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.826+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=PW87FF5XKTMF tag=U60J9QTOSKH1 type=write size=1501763 2024-09-12T17:36:51.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.827+0000 7fa80ca76780 1 < completed write operation key=E25BUY271ZSI tag=0I4GIDA4KF9Z type=write size=249201 2024-09-12T17:36:51.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.828+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=IFTI4M10HZWW type=del size=2746022 2024-09-12T17:36:51.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.828+0000 7fa80ca76780 1 < canceled part key=_multipart_0X3LGXL2QFRN.2~M03UFY5PJLJ6.0 size=1048576 2024-09-12T17:36:51.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.829+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~M03UFY5PJLJ6.1 size=336041 2024-09-12T17:36:51.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.832+0000 7fa80ca76780 1 < canceled multipart upload key=0X3LGXL2QFRN upload=M03UFY5PJLJ6 tag=BFTCP7SYAFG7 type=write size=2433193 2024-09-12T17:36:51.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.834+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~6HDANJ40FQVM.0 size=765817 2024-09-12T17:36:51.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.834+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=6HDANJ40FQVM tag=VXIRCLAAYINL type=write size=1814393 2024-09-12T17:36:51.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.836+0000 7fa80ca76780 1 < suggested remove operation key=BLGMV3S9AY24 tag=AVH1Z0BYSMD4 type=del 2024-09-12T17:36:51.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.840+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~X37ZKPK7FB12.0 size=508623 2024-09-12T17:36:51.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.840+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=X37ZKPK7FB12 tag=4KB41X1JLWHR type=write size=1557199 2024-09-12T17:36:51.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.841+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=LVS6LA5S68BT type=del 2024-09-12T17:36:51.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.842+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=YLEBVWL97HP6 type=del size=2861299 2024-09-12T17:36:51.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.844+0000 7fa80ca76780 1 < suggested update operation key=VDD4PDR1GLWQ tag=D2H6MO7MJDXL type=del size=3728879 2024-09-12T17:36:51.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.845+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=LRENT3M0WNGJ type=del size=3053544 2024-09-12T17:36:51.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.846+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=OORVIH9II2UN type=del 2024-09-12T17:36:51.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.848+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=2ZROIHAL2MW2 type=del size=1997857 2024-09-12T17:36:51.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.849+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~WVQO1YQKSWMY.0 size=1048576 2024-09-12T17:36:51.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.850+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~WVQO1YQKSWMY.1 size=1048576 2024-09-12T17:36:51.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.850+0000 7fa80ca76780 1 < canceled part key=_multipart_EDRL3T2I9AOO.2~WVQO1YQKSWMY.2 size=134501 2024-09-12T17:36:51.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.852+0000 7fa80ca76780 1 < canceled multipart upload key=EDRL3T2I9AOO upload=WVQO1YQKSWMY tag=JYFQ9M2ZZBSQ type=write size=3280229 2024-09-12T17:36:51.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.853+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~9YFHJCEM058L.0 size=1048576 2024-09-12T17:36:51.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.854+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~9YFHJCEM058L.1 size=26114 2024-09-12T17:36:51.856 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.854+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=9YFHJCEM058L tag=KTHLA9C06BIG type=write size=2123266 2024-09-12T17:36:51.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.856+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~VBMPZOQFUTO4.0 size=1048576 2024-09-12T17:36:51.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.856+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~VBMPZOQFUTO4.1 size=1048576 2024-09-12T17:36:51.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.857+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~VBMPZOQFUTO4.2 size=347746 2024-09-12T17:36:51.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.859+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=VBMPZOQFUTO4 tag=L6AF9Z7SBAOZ type=write size=3493474 2024-09-12T17:36:51.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.860+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=UX9JLVPI3OMI type=write size=984370 2024-09-12T17:36:51.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.862+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~FE2U3GYPN14R.0 size=990835 2024-09-12T17:36:51.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.863+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=FE2U3GYPN14R tag=CM4Z1S5C6GC2 type=write size=2039411 2024-09-12T17:36:51.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.865+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=BVSRHKR2VG0T type=del size=3210966 2024-09-12T17:36:51.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.866+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=6NR1X03TKVIZ type=del 2024-09-12T17:36:51.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.868+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~2NYD1SYKJB80.0 size=458327 2024-09-12T17:36:51.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.868+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=2NYD1SYKJB80 tag=5M0O1UO3ZEWE type=write size=1506903 2024-09-12T17:36:51.870 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.869+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=TD62AEYD7YNS type=del 2024-09-12T17:36:51.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.871+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~K2AVJRHPCXLZ.0 size=1048576 2024-09-12T17:36:51.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.872+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~K2AVJRHPCXLZ.1 size=1048576 2024-09-12T17:36:51.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.873+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~K2AVJRHPCXLZ.2 size=424046 2024-09-12T17:36:51.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.873+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=K2AVJRHPCXLZ tag=7X7V5N9X78WD type=write size=3569774 2024-09-12T17:36:51.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.874+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~BU15O8RXRDAW.0 size=431214 2024-09-12T17:36:51.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.876+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=BU15O8RXRDAW tag=QQZ1U8S0O5F6 type=write size=1479790 2024-09-12T17:36:51.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.878+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=4GZTM7NPD1UQ type=del size=2199587 2024-09-12T17:36:51.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.879+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=49Y8T16R5QKQ type=del 2024-09-12T17:36:51.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.882+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=NM6U7WXNX92E type=del size=2881492 2024-09-12T17:36:51.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.883+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=G1PX94DJ0HUQ type=del 2024-09-12T17:36:51.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.884+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=RU9ICHE3KOQL type=del size=1209167 2024-09-12T17:36:51.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.885+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=8YXSJ2Q09HCT type=del 2024-09-12T17:36:51.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.887+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=UNTZ28MYQHB5 type=del size=3318830 2024-09-12T17:36:51.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.888+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~PW87FF5XKTMF.0 size=453187 2024-09-12T17:36:51.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.891+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=PW87FF5XKTMF tag=U60J9QTOSKH1 type=write size=1501763 2024-09-12T17:36:51.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.892+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=PHJR9G3N3C6U type=del size=639320 2024-09-12T17:36:51.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.893+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=IFTI4M10HZWW type=del 2024-09-12T17:36:51.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.895+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=B3ZMLWM5WZ3O type=del size=747133 2024-09-12T17:36:51.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.896+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~6HDANJ40FQVM.0 size=765817 2024-09-12T17:36:51.899 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.898+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=6HDANJ40FQVM tag=VXIRCLAAYINL type=write size=1814393 2024-09-12T17:36:51.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.899+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=37XX4RH9EYYK type=del size=3189640 2024-09-12T17:36:51.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.900+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~X37ZKPK7FB12.0 size=508623 2024-09-12T17:36:51.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.902+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=X37ZKPK7FB12 tag=4KB41X1JLWHR type=write size=1557199 2024-09-12T17:36:51.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.904+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~RELYSTYEEPAQ.0 size=362849 2024-09-12T17:36:51.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.904+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=RELYSTYEEPAQ tag=EKZCVT88GXS7 type=write size=1411425 2024-09-12T17:36:51.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.906+0000 7fa80ca76780 1 < completed delete operation key=0X3LGXL2QFRN tag=YLEBVWL97HP6 type=del 2024-09-12T17:36:51.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.907+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=63J5PUIA8HLW type=del size=564481 2024-09-12T17:36:51.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.908+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=LRENT3M0WNGJ type=del 2024-09-12T17:36:51.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.910+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=5G9BJ48JOHH0 type=write size=232191 2024-09-12T17:36:51.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.911+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=2ZROIHAL2MW2 type=del 2024-09-12T17:36:51.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.914+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~KTCV4TP1S68G.0 size=1048576 2024-09-12T17:36:51.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.915+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~KTCV4TP1S68G.1 size=302541 2024-09-12T17:36:51.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.915+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=KTCV4TP1S68G tag=G2SP6KSB9BGK type=write size=2399693 2024-09-12T17:36:51.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.915+0000 7fa80ca76780 1 < canceled part key=_multipart_07LPSZT2RKCC.2~9YFHJCEM058L.0 size=1048576 2024-09-12T17:36:51.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.916+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~9YFHJCEM058L.1 size=26114 2024-09-12T17:36:51.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.918+0000 7fa80ca76780 1 < canceled multipart upload key=07LPSZT2RKCC upload=9YFHJCEM058L tag=KTHLA9C06BIG type=write size=2123266 2024-09-12T17:36:51.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.920+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~NK7WLJF1XVJF.0 size=1048576 2024-09-12T17:36:51.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.921+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~NK7WLJF1XVJF.1 size=1048576 2024-09-12T17:36:51.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.921+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~NK7WLJF1XVJF.2 size=990098 2024-09-12T17:36:51.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.921+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=NK7WLJF1XVJF tag=A3EFFOUGLY32 type=write size=4135826 2024-09-12T17:36:51.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.924+0000 7fa80ca76780 1 < completed write operation key=7QHTQ6VHZ34P tag=UX9JLVPI3OMI type=write size=984370 2024-09-12T17:36:51.927 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.926+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~12SE68S0W8BJ.0 size=1048576 2024-09-12T17:36:51.928 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.927+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~12SE68S0W8BJ.1 size=1048576 2024-09-12T17:36:51.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.928+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~12SE68S0W8BJ.2 size=381865 2024-09-12T17:36:51.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.928+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=12SE68S0W8BJ tag=WZR4VVQ0KLEL type=write size=3527593 2024-09-12T17:36:51.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.929+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=BVSRHKR2VG0T type=del 2024-09-12T17:36:51.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.930+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=IFHIQC1TBTK7 type=del size=1007123 2024-09-12T17:36:51.932 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.931+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~2NYD1SYKJB80.0 size=458327 2024-09-12T17:36:51.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.933+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=2NYD1SYKJB80 tag=5M0O1UO3ZEWE type=write size=1506903 2024-09-12T17:36:51.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.935+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~N8S11H7O84PT.0 size=1048576 2024-09-12T17:36:51.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.936+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~N8S11H7O84PT.1 size=257998 2024-09-12T17:36:51.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.936+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=N8S11H7O84PT tag=AVL6XCWSEE0D type=write size=2355150 2024-09-12T17:36:51.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.938+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~K2AVJRHPCXLZ.0 size=1048576 2024-09-12T17:36:51.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.938+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~K2AVJRHPCXLZ.1 size=1048576 2024-09-12T17:36:51.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.939+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~K2AVJRHPCXLZ.2 size=424046 2024-09-12T17:36:51.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.941+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=K2AVJRHPCXLZ tag=7X7V5N9X78WD type=write size=3569774 2024-09-12T17:36:51.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.943+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=P88UH8YQK7J2 type=write size=789695 2024-09-12T17:36:51.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.945+0000 7fa80ca76780 1 < suggested remove operation key=0X3LGXL2QFRN tag=4GZTM7NPD1UQ type=del 2024-09-12T17:36:51.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.947+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~02H9QUW9CJ2F.0 size=1048576 2024-09-12T17:36:51.949 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.948+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~02H9QUW9CJ2F.1 size=1048576 2024-09-12T17:36:51.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.951+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~02H9QUW9CJ2F.2 size=409879 2024-09-12T17:36:51.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.951+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=02H9QUW9CJ2F tag=W5C520FO3CLB type=write size=3555607 2024-09-12T17:36:51.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.952+0000 7fa80ca76780 -1 < failed to complete operation key=0X3LGXL2QFRN tag=NM6U7WXNX92E type=del size=2881492: (22) Invalid argument 2024-09-12T17:36:51.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.954+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~CX33UZG8GSO1.0 size=1048576 2024-09-12T17:36:51.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.955+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~CX33UZG8GSO1.1 size=79142 2024-09-12T17:36:51.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.955+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=CX33UZG8GSO1 tag=0QU7GRDXW91X type=write size=2176294 2024-09-12T17:36:51.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.956+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=RU9ICHE3KOQL type=del 2024-09-12T17:36:51.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.958+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~XZMJQWRMVCNU.0 size=1048576 2024-09-12T17:36:51.960 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.959+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~XZMJQWRMVCNU.1 size=1048576 2024-09-12T17:36:51.961 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.960+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~XZMJQWRMVCNU.2 size=301612 2024-09-12T17:36:51.961 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.960+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=XZMJQWRMVCNU tag=6GFNG5HMSYXG type=write size=3447340 2024-09-12T17:36:51.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.961+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=UNTZ28MYQHB5 type=del 2024-09-12T17:36:51.964 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.963+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~BXRM97X2A3NE.0 size=1048576 2024-09-12T17:36:51.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.964+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~BXRM97X2A3NE.1 size=1048576 2024-09-12T17:36:51.966 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.965+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~BXRM97X2A3NE.2 size=999072 2024-09-12T17:36:51.966 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.965+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=BXRM97X2A3NE tag=TEOEQ2YPZLW6 type=write size=4144800 2024-09-12T17:36:51.968 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.967+0000 7fa80ca76780 1 < suggested update operation key=DYZIHCBF3D8U tag=PHJR9G3N3C6U type=del size=639320 2024-09-12T17:36:51.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.969+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=2J61JA4ETJ59 type=write size=424876 2024-09-12T17:36:51.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.971+0000 7fa80ca76780 1 < suggested update operation key=MSZUYX441Y66 tag=B3ZMLWM5WZ3O type=del size=747133 2024-09-12T17:36:51.974 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.973+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~KE5Z13K8APBN.0 size=897621 2024-09-12T17:36:51.974 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.973+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=KE5Z13K8APBN tag=QHO6TTEKMX48 type=write size=1946197 2024-09-12T17:36:51.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.974+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=37XX4RH9EYYK type=del 2024-09-12T17:36:51.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.975+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=ZIVR7L9RGN0E type=write size=550297 2024-09-12T17:36:51.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.976+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~RELYSTYEEPAQ.0 size=362849 2024-09-12T17:36:51.979 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.978+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=RELYSTYEEPAQ tag=EKZCVT88GXS7 type=write size=1411425 2024-09-12T17:36:51.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.979+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=EAXKO993NYBR type=del size=1852832 2024-09-12T17:36:51.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.981+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=63J5PUIA8HLW type=del 2024-09-12T17:36:51.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.982+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=KRKVPXVXR6LM type=del size=2997631 2024-09-12T17:36:51.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.983+0000 7fa80ca76780 1 < completed write operation key=LU7PDGWTAK63 tag=5G9BJ48JOHH0 type=write size=232191 2024-09-12T17:36:51.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.985+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=QPLP90L7UI5B type=write size=524056 2024-09-12T17:36:51.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.986+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~KTCV4TP1S68G.0 size=1048576 2024-09-12T17:36:51.988 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.987+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~KTCV4TP1S68G.1 size=302541 2024-09-12T17:36:51.990 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.989+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=KTCV4TP1S68G tag=G2SP6KSB9BGK type=write size=2399693 2024-09-12T17:36:51.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.991+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~B091R1G3VWM5.0 size=1048576 2024-09-12T17:36:51.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.992+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~B091R1G3VWM5.1 size=824971 2024-09-12T17:36:51.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.992+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=B091R1G3VWM5 tag=RTHC8UFRN27C type=write size=2922123 2024-09-12T17:36:51.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.993+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~NK7WLJF1XVJF.0 size=1048576 2024-09-12T17:36:51.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.993+0000 7fa80ca76780 1 < canceled part key=_multipart_VDD4PDR1GLWQ.2~NK7WLJF1XVJF.1 size=1048576 2024-09-12T17:36:51.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.994+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~NK7WLJF1XVJF.2 size=990098 2024-09-12T17:36:51.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.997+0000 7fa80ca76780 1 < canceled multipart upload key=VDD4PDR1GLWQ upload=NK7WLJF1XVJF tag=A3EFFOUGLY32 type=write size=4135826 2024-09-12T17:36:51.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.998+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=KQ3YYULY532S type=del size=1688102 2024-09-12T17:36:52.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:51.999+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~12SE68S0W8BJ.0 size=1048576 2024-09-12T17:36:52.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.000+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~12SE68S0W8BJ.1 size=1048576 2024-09-12T17:36:52.003 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.002+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~12SE68S0W8BJ.2 size=381865 2024-09-12T17:36:52.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.004+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=12SE68S0W8BJ tag=WZR4VVQ0KLEL type=write size=3527593 2024-09-12T17:36:52.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.006+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~KHJCHQT1RIG2.0 size=1048576 2024-09-12T17:36:52.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.007+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~KHJCHQT1RIG2.1 size=1002030 2024-09-12T17:36:52.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.007+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=KHJCHQT1RIG2 tag=CVMJ6K7TSA5U type=write size=3099182 2024-09-12T17:36:52.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.008+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=IFHIQC1TBTK7 type=del 2024-09-12T17:36:52.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.010+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~89R1C6NO4C04.0 size=1048576 2024-09-12T17:36:52.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.011+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~89R1C6NO4C04.1 size=1048576 2024-09-12T17:36:52.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.012+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~89R1C6NO4C04.2 size=605395 2024-09-12T17:36:52.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.012+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=89R1C6NO4C04 tag=0SDPZNSUT2BB type=write size=3751123 2024-09-12T17:36:52.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.013+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~N8S11H7O84PT.0 size=1048576 2024-09-12T17:36:52.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.014+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~N8S11H7O84PT.1 size=257998 2024-09-12T17:36:52.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.016+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=N8S11H7O84PT tag=AVL6XCWSEE0D type=write size=2355150 2024-09-12T17:36:52.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.018+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~LPK9WVRVM7EH.0 size=1048576 2024-09-12T17:36:52.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.019+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~LPK9WVRVM7EH.1 size=1048576 2024-09-12T17:36:52.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.020+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~LPK9WVRVM7EH.2 size=986363 2024-09-12T17:36:52.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.020+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=LPK9WVRVM7EH tag=H31K0DSDV89M type=write size=4132091 2024-09-12T17:36:52.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.021+0000 7fa80ca76780 1 < completed write operation key=GKE6623N268Z tag=P88UH8YQK7J2 type=write size=789695 2024-09-12T17:36:52.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.022+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=ZBDIQR82OIG5 type=del size=1489677 2024-09-12T17:36:52.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.023+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~02H9QUW9CJ2F.0 size=1048576 2024-09-12T17:36:52.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.024+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~02H9QUW9CJ2F.1 size=1048576 2024-09-12T17:36:52.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.025+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~02H9QUW9CJ2F.2 size=409879 2024-09-12T17:36:52.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.028+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=02H9QUW9CJ2F tag=W5C520FO3CLB type=write size=3555607 2024-09-12T17:36:52.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.029+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=TPI7FPZM4PLB type=del size=2955602 2024-09-12T17:36:52.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.030+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~CX33UZG8GSO1.0 size=1048576 2024-09-12T17:36:52.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.031+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~CX33UZG8GSO1.1 size=79142 2024-09-12T17:36:52.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.033+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=CX33UZG8GSO1 tag=0QU7GRDXW91X type=write size=2176294 2024-09-12T17:36:52.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.034+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=B6JDHQDV52CV type=write size=180194 2024-09-12T17:36:52.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.035+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~XZMJQWRMVCNU.0 size=1048576 2024-09-12T17:36:52.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.036+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~XZMJQWRMVCNU.1 size=1048576 2024-09-12T17:36:52.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.037+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~XZMJQWRMVCNU.2 size=301612 2024-09-12T17:36:52.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.039+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=XZMJQWRMVCNU tag=6GFNG5HMSYXG type=write size=3447340 2024-09-12T17:36:52.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.040+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=0MCCRPQBKP2Y type=del size=3470014 2024-09-12T17:36:52.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.042+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~BXRM97X2A3NE.0 size=1048576 2024-09-12T17:36:52.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.043+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~BXRM97X2A3NE.1 size=1048576 2024-09-12T17:36:52.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.044+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~BXRM97X2A3NE.2 size=999072 2024-09-12T17:36:52.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.045+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=BXRM97X2A3NE tag=TEOEQ2YPZLW6 type=write size=4144800 2024-09-12T17:36:52.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.048+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~SO9I58G51MFF.0 size=491731 2024-09-12T17:36:52.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.048+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=SO9I58G51MFF tag=A6XAU2J0DGV6 type=write size=1540307 2024-09-12T17:36:52.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.050+0000 7fa80ca76780 1 < suggested update operation key=5CAG55DQEF3Y tag=2J61JA4ETJ59 type=write size=424876 2024-09-12T17:36:52.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.052+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~0E2K22KDLP3U.0 size=1048576 2024-09-12T17:36:52.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.053+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~0E2K22KDLP3U.1 size=1048576 2024-09-12T17:36:52.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.054+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~0E2K22KDLP3U.2 size=572155 2024-09-12T17:36:52.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.054+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=0E2K22KDLP3U tag=SA743RRSWEK0 type=write size=3717883 2024-09-12T17:36:52.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.055+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~KE5Z13K8APBN.0 size=897621 2024-09-12T17:36:52.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.057+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=KE5Z13K8APBN tag=QHO6TTEKMX48 type=write size=1946197 2024-09-12T17:36:52.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.059+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~33VD8FV3CP7I.0 size=1048576 2024-09-12T17:36:52.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.060+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~33VD8FV3CP7I.1 size=1048576 2024-09-12T17:36:52.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.061+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~33VD8FV3CP7I.2 size=623396 2024-09-12T17:36:52.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.061+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=33VD8FV3CP7I tag=6E62A4JZ7DEN type=write size=3769124 2024-09-12T17:36:52.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.062+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=ZIVR7L9RGN0E type=write size=550297 2024-09-12T17:36:52.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.063+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=CKOS5H0XRIGQ type=del size=3681657 2024-09-12T17:36:52.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.064+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=EAXKO993NYBR type=del 2024-09-12T17:36:52.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.066+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~716SENFFOWLN.0 size=98809 2024-09-12T17:36:52.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.066+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=716SENFFOWLN tag=MI8CUFI4KSV5 type=write size=1147385 2024-09-12T17:36:52.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.068+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=KRKVPXVXR6LM type=del 2024-09-12T17:36:52.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.069+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=CKZZDENDREYA type=write size=269283 2024-09-12T17:36:52.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.070+0000 7fa80ca76780 1 < completed write operation key=0U9KSMYWT2C3 tag=QPLP90L7UI5B type=write size=524056 2024-09-12T17:36:52.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.072+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~PG31GCC6T4DC.0 size=1048576 2024-09-12T17:36:52.074 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.073+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~PG31GCC6T4DC.1 size=838595 2024-09-12T17:36:52.074 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.073+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=PG31GCC6T4DC tag=QXF4DJV2XIX3 type=write size=2935747 2024-09-12T17:36:52.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.075+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~B091R1G3VWM5.0 size=1048576 2024-09-12T17:36:52.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.075+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~B091R1G3VWM5.1 size=824971 2024-09-12T17:36:52.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.077+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=B091R1G3VWM5 tag=RTHC8UFRN27C type=write size=2922123 2024-09-12T17:36:52.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.079+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=DS24JKQLCMYU type=del size=1965427 2024-09-12T17:36:52.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.081+0000 7fa80ca76780 1 < suggested remove operation key=0J6RTRJWZP1T tag=KQ3YYULY532S type=del 2024-09-12T17:36:52.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.082+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=2RK8D0WDVHE7 type=del size=1383025 2024-09-12T17:36:52.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.082+0000 7fa80ca76780 1 < canceled part key=_multipart_54KWSI77T73A.2~KHJCHQT1RIG2.0 size=1048576 2024-09-12T17:36:52.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.083+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~KHJCHQT1RIG2.1 size=1002030 2024-09-12T17:36:52.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.085+0000 7fa80ca76780 1 < canceled multipart upload key=54KWSI77T73A upload=KHJCHQT1RIG2 tag=CVMJ6K7TSA5U type=write size=3099182 2024-09-12T17:36:52.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.087+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~46MD7AOHP34D.0 size=1048576 2024-09-12T17:36:52.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.088+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~46MD7AOHP34D.1 size=1048576 2024-09-12T17:36:52.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.089+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~46MD7AOHP34D.2 size=428623 2024-09-12T17:36:52.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.089+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=46MD7AOHP34D tag=249ILQCHOQBH type=write size=3574351 2024-09-12T17:36:52.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.091+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~89R1C6NO4C04.0 size=1048576 2024-09-12T17:36:52.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.092+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~89R1C6NO4C04.1 size=1048576 2024-09-12T17:36:52.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.093+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~89R1C6NO4C04.2 size=605395 2024-09-12T17:36:52.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.095+0000 7fa80ca76780 1 < completed multipart upload key=U8O04HYQZRJC upload=89R1C6NO4C04 tag=0SDPZNSUT2BB type=write size=3751123 2024-09-12T17:36:52.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.097+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~4W20Y1GE24G7.0 size=1048576 2024-09-12T17:36:52.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.098+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~4W20Y1GE24G7.1 size=1048576 2024-09-12T17:36:52.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.099+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~4W20Y1GE24G7.2 size=481186 2024-09-12T17:36:52.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.099+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=4W20Y1GE24G7 tag=8VHGF3P47I9P type=write size=3626914 2024-09-12T17:36:52.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.099+0000 7fa80ca76780 1 < canceled part key=_multipart_54KWSI77T73A.2~LPK9WVRVM7EH.0 size=1048576 2024-09-12T17:36:52.102 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.100+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~LPK9WVRVM7EH.1 size=1048576 2024-09-12T17:36:52.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.102+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~LPK9WVRVM7EH.2 size=986363 2024-09-12T17:36:52.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.107+0000 7fa80ca76780 1 < canceled multipart upload key=54KWSI77T73A upload=LPK9WVRVM7EH tag=H31K0DSDV89M type=write size=4132091 2024-09-12T17:36:52.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.110+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=UGZZLOL7YA0R type=del size=4130601 2024-09-12T17:36:52.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.111+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=ZBDIQR82OIG5 type=del 2024-09-12T17:36:52.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.113+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=AW37NS8IBCGU type=del size=133847 2024-09-12T17:36:52.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.115+0000 7fa80ca76780 1 < suggested remove operation key=7QHTQ6VHZ34P tag=TPI7FPZM4PLB type=del 2024-09-12T17:36:52.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.116+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=T2YO1BB9OA0N type=del size=2622846 2024-09-12T17:36:52.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.118+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=B6JDHQDV52CV type=write size=180194 2024-09-12T17:36:52.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.119+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=386KMNBBFZPF type=del size=2009625 2024-09-12T17:36:52.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.120+0000 7fa80ca76780 1 < canceled operation key=RC1IX4DQREEP tag=0MCCRPQBKP2Y type=del size=3470014 2024-09-12T17:36:52.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.121+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=2K084H2NQ3DX type=del size=102422 2024-09-12T17:36:52.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.123+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~SO9I58G51MFF.0 size=491731 2024-09-12T17:36:52.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.125+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=SO9I58G51MFF tag=A6XAU2J0DGV6 type=write size=1540307 2024-09-12T17:36:52.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.126+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=LNECEE8KAXE1 type=del size=2596924 2024-09-12T17:36:52.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.127+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~0E2K22KDLP3U.0 size=1048576 2024-09-12T17:36:52.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.128+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~0E2K22KDLP3U.1 size=1048576 2024-09-12T17:36:52.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.129+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~0E2K22KDLP3U.2 size=572155 2024-09-12T17:36:52.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.132+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=0E2K22KDLP3U tag=SA743RRSWEK0 type=write size=3717883 2024-09-12T17:36:52.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.133+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=VPU10YB9YWBB type=del size=1665832 2024-09-12T17:36:52.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.134+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~33VD8FV3CP7I.0 size=1048576 2024-09-12T17:36:52.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.135+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~33VD8FV3CP7I.1 size=1048576 2024-09-12T17:36:52.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.135+0000 7fa80ca76780 1 < canceled part key=_multipart_BLGMV3S9AY24.2~33VD8FV3CP7I.2 size=623396 2024-09-12T17:36:52.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.137+0000 7fa80ca76780 1 < canceled multipart upload key=BLGMV3S9AY24 upload=33VD8FV3CP7I tag=6E62A4JZ7DEN type=write size=3769124 2024-09-12T17:36:52.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.140+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~YJSVOMJK95B3.0 size=396593 2024-09-12T17:36:52.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.140+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=YJSVOMJK95B3 tag=XNKCV38ND1WN type=write size=1445169 2024-09-12T17:36:52.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.141+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=CKOS5H0XRIGQ type=del 2024-09-12T17:36:52.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.142+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=H35IFSK0RBRO type=del size=2839232 2024-09-12T17:36:52.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.143+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~716SENFFOWLN.0 size=98809 2024-09-12T17:36:52.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.145+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=716SENFFOWLN tag=MI8CUFI4KSV5 type=write size=1147385 2024-09-12T17:36:52.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.147+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~JHO1RHM3JSPX.0 size=1048576 2024-09-12T17:36:52.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.148+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~JHO1RHM3JSPX.1 size=1048576 2024-09-12T17:36:52.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.149+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~JHO1RHM3JSPX.2 size=761774 2024-09-12T17:36:52.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.149+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=JHO1RHM3JSPX tag=TXOGHOMNM9MJ type=write size=3907502 2024-09-12T17:36:52.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.151+0000 7fa80ca76780 1 < suggested update operation key=GKE6623N268Z tag=CKZZDENDREYA type=write size=269283 2024-09-12T17:36:52.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.153+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=J00AP5PRNQG6 type=del size=638865 2024-09-12T17:36:52.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.154+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~PG31GCC6T4DC.0 size=1048576 2024-09-12T17:36:52.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.155+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~PG31GCC6T4DC.1 size=838595 2024-09-12T17:36:52.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.157+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=PG31GCC6T4DC tag=QXF4DJV2XIX3 type=write size=2935747 2024-09-12T17:36:52.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.159+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~6ILBW3RM6WVN.0 size=1048576 2024-09-12T17:36:52.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.160+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~6ILBW3RM6WVN.1 size=1048576 2024-09-12T17:36:52.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.161+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~6ILBW3RM6WVN.2 size=27784 2024-09-12T17:36:52.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.161+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=6ILBW3RM6WVN tag=M5CFI86GCT32 type=write size=3173512 2024-09-12T17:36:52.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.162+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=DS24JKQLCMYU type=del 2024-09-12T17:36:52.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.163+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=K713TRK2HAAB type=write size=710357 2024-09-12T17:36:52.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.164+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=2RK8D0WDVHE7 type=del 2024-09-12T17:36:52.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.165+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=7PXK9NPR3JRG type=del size=2638060 2024-09-12T17:36:52.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.166+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~46MD7AOHP34D.0 size=1048576 2024-09-12T17:36:52.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.167+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~46MD7AOHP34D.1 size=1048576 2024-09-12T17:36:52.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.167+0000 7fa80ca76780 1 < canceled part key=_multipart_0U9KSMYWT2C3.2~46MD7AOHP34D.2 size=428623 2024-09-12T17:36:52.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.169+0000 7fa80ca76780 1 < canceled multipart upload key=0U9KSMYWT2C3 upload=46MD7AOHP34D tag=249ILQCHOQBH type=write size=3574351 2024-09-12T17:36:52.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.170+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=X9NB0FX7MIHH type=del size=692500 2024-09-12T17:36:52.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.172+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~4W20Y1GE24G7.0 size=1048576 2024-09-12T17:36:52.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.172+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~4W20Y1GE24G7.1 size=1048576 2024-09-12T17:36:52.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.173+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~4W20Y1GE24G7.2 size=481186 2024-09-12T17:36:52.176 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.175+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=4W20Y1GE24G7 tag=8VHGF3P47I9P type=write size=3626914 2024-09-12T17:36:52.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.176+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=98Z2AHOR99ZJ type=del size=954212 2024-09-12T17:36:52.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.179+0000 7fa80ca76780 1 < suggested update operation key=5CAG55DQEF3Y tag=UGZZLOL7YA0R type=del size=4130601 2024-09-12T17:36:52.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.180+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~7UYQMWQWKLS3.0 size=286482 2024-09-12T17:36:52.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.181+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=7UYQMWQWKLS3 tag=7FA8HM5SDSA2 type=write size=1335058 2024-09-12T17:36:52.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.183+0000 7fa80ca76780 1 < suggested remove operation key=R02234GEWV6B tag=AW37NS8IBCGU type=del 2024-09-12T17:36:52.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.185+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~00NZJH0V60GR.0 size=1048576 2024-09-12T17:36:52.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.186+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~00NZJH0V60GR.1 size=821897 2024-09-12T17:36:52.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.186+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=00NZJH0V60GR tag=3GS5N9ZTIQEB type=write size=2919049 2024-09-12T17:36:52.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.187+0000 7fa80ca76780 1 < canceled operation key=EDRL3T2I9AOO tag=T2YO1BB9OA0N type=del size=2622846 2024-09-12T17:36:52.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.188+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=C21BPIL9MLL8 type=del size=1361661 2024-09-12T17:36:52.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.189+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=386KMNBBFZPF type=del 2024-09-12T17:36:52.192 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.191+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~1XKNJX313JC0.0 size=1048576 2024-09-12T17:36:52.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.192+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~1XKNJX313JC0.1 size=409654 2024-09-12T17:36:52.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.192+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=1XKNJX313JC0 tag=1BK4MD3A6H9A type=write size=2506806 2024-09-12T17:36:52.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.193+0000 7fa80ca76780 -1 < failed to complete operation key=GKE6623N268Z tag=2K084H2NQ3DX type=del size=102422: (22) Invalid argument 2024-09-12T17:36:52.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.194+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=S95YVAXF3IJZ type=del size=655117 2024-09-12T17:36:52.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.195+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=LNECEE8KAXE1 type=del 2024-09-12T17:36:52.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.197+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=W5AYRWM8BY2J type=del size=1635372 2024-09-12T17:36:52.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.199+0000 7fa80ca76780 1 < suggested remove operation key=U8O04HYQZRJC tag=VPU10YB9YWBB type=del 2024-09-12T17:36:52.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.200+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=TS9W1ZGXHUYQ type=del size=828489 2024-09-12T17:36:52.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.201+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~YJSVOMJK95B3.0 size=396593 2024-09-12T17:36:52.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.203+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=YJSVOMJK95B3 tag=XNKCV38ND1WN type=write size=1445169 2024-09-12T17:36:52.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.204+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=3WVVRUESFLJG type=write size=631292 2024-09-12T17:36:52.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.205+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=H35IFSK0RBRO type=del 2024-09-12T17:36:52.208 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.207+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~LO55T0H2ZKYP.0 size=1048576 2024-09-12T17:36:52.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.208+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~LO55T0H2ZKYP.1 size=983519 2024-09-12T17:36:52.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.208+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=LO55T0H2ZKYP tag=RXOYHS9NI7EE type=write size=3080671 2024-09-12T17:36:52.210 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.209+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~JHO1RHM3JSPX.0 size=1048576 2024-09-12T17:36:52.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.210+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~JHO1RHM3JSPX.1 size=1048576 2024-09-12T17:36:52.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.211+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~JHO1RHM3JSPX.2 size=761774 2024-09-12T17:36:52.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.213+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=JHO1RHM3JSPX tag=TXOGHOMNM9MJ type=write size=3907502 2024-09-12T17:36:52.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.214+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=GPAJ2RDOHX6N type=del size=2451805 2024-09-12T17:36:52.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.216+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=J00AP5PRNQG6 type=del 2024-09-12T17:36:52.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.218+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=9ZG4YZ7RG63I type=del size=189870 2024-09-12T17:36:52.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.219+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~6ILBW3RM6WVN.0 size=1048576 2024-09-12T17:36:52.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.220+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~6ILBW3RM6WVN.1 size=1048576 2024-09-12T17:36:52.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.221+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~6ILBW3RM6WVN.2 size=27784 2024-09-12T17:36:52.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.223+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=6ILBW3RM6WVN tag=M5CFI86GCT32 type=write size=3173512 2024-09-12T17:36:52.225 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.225+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~IL9BKD07LZ34.0 size=1048576 2024-09-12T17:36:52.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.225+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~IL9BKD07LZ34.1 size=1048576 2024-09-12T17:36:52.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.226+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~IL9BKD07LZ34.2 size=48304 2024-09-12T17:36:52.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.226+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=IL9BKD07LZ34 tag=5YPCA9J4EE8V type=write size=3194032 2024-09-12T17:36:52.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.228+0000 7fa80ca76780 1 < completed write operation key=R871XU2TDWID tag=K713TRK2HAAB type=write size=710357 2024-09-12T17:36:52.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.229+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=0FXLHUD4ICEG type=write size=471137 2024-09-12T17:36:52.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.231+0000 7fa80ca76780 1 < suggested remove operation key=0J6RTRJWZP1T tag=7PXK9NPR3JRG type=del 2024-09-12T17:36:52.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.232+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=85PJ9DZPC41W type=del size=130070 2024-09-12T17:36:52.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.235+0000 7fa80ca76780 1 < suggested update operation key=VDD4PDR1GLWQ tag=X9NB0FX7MIHH type=del size=692500 2024-09-12T17:36:52.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.236+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=PY8K34Q5IYRU type=del size=1125408 2024-09-12T17:36:52.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.237+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=98Z2AHOR99ZJ type=del 2024-09-12T17:36:52.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.238+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=DCUTIBM65R30 type=del size=842548 2024-09-12T17:36:52.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.239+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~7UYQMWQWKLS3.0 size=286482 2024-09-12T17:36:52.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.241+0000 7fa80ca76780 1 < completed multipart upload key=07LPSZT2RKCC upload=7UYQMWQWKLS3 tag=7FA8HM5SDSA2 type=write size=1335058 2024-09-12T17:36:52.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.243+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~GWGC0R5N5YOI.0 size=212728 2024-09-12T17:36:52.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.243+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=GWGC0R5N5YOI tag=L03TMPH71TS2 type=write size=1261304 2024-09-12T17:36:52.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.244+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~00NZJH0V60GR.0 size=1048576 2024-09-12T17:36:52.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.245+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~00NZJH0V60GR.1 size=821897 2024-09-12T17:36:52.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.247+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=00NZJH0V60GR tag=3GS5N9ZTIQEB type=write size=2919049 2024-09-12T17:36:52.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.248+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=MOMPX9ODL7TI type=del size=2413931 2024-09-12T17:36:52.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.249+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=C21BPIL9MLL8 type=del 2024-09-12T17:36:52.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.251+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=9WVT329JU9V2 type=del size=1531085 2024-09-12T17:36:52.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.252+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~1XKNJX313JC0.0 size=1048576 2024-09-12T17:36:52.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.252+0000 7fa80ca76780 1 < canceled part key=_multipart_94801LE91HZ9.2~1XKNJX313JC0.1 size=409654 2024-09-12T17:36:52.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.254+0000 7fa80ca76780 1 < canceled multipart upload key=94801LE91HZ9 upload=1XKNJX313JC0 tag=1BK4MD3A6H9A type=write size=2506806 2024-09-12T17:36:52.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.255+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=09SUUIB55DM3 type=del size=1198869 2024-09-12T17:36:52.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.256+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=S95YVAXF3IJZ type=del 2024-09-12T17:36:52.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.257+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=N1LQU2PGQK1W type=del size=1797265 2024-09-12T17:36:52.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.258+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=W5AYRWM8BY2J type=del 2024-09-12T17:36:52.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.260+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~9AE37VPFDSI4.0 size=1048576 2024-09-12T17:36:52.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.261+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~9AE37VPFDSI4.1 size=244208 2024-09-12T17:36:52.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.261+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=9AE37VPFDSI4 tag=Y9MT7MYISA0D type=write size=2341360 2024-09-12T17:36:52.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.263+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=TS9W1ZGXHUYQ type=del 2024-09-12T17:36:52.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.264+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=LG7SG2OBBN36 type=write size=916493 2024-09-12T17:36:52.266 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.265+0000 7fa80ca76780 1 < completed write operation key=0U9KSMYWT2C3 tag=3WVVRUESFLJG type=write size=631292 2024-09-12T17:36:52.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.266+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=SP1A01ZXLD2Q type=del size=3847334 2024-09-12T17:36:52.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.267+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~LO55T0H2ZKYP.0 size=1048576 2024-09-12T17:36:52.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.268+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~LO55T0H2ZKYP.1 size=983519 2024-09-12T17:36:52.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.270+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=LO55T0H2ZKYP tag=RXOYHS9NI7EE type=write size=3080671 2024-09-12T17:36:52.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.271+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=06MIY8THG9EN type=del size=3240336 2024-09-12T17:36:52.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.272+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=GPAJ2RDOHX6N type=del 2024-09-12T17:36:52.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.274+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=CVMSITQTRSI1 type=del size=2706369 2024-09-12T17:36:52.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.275+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=9ZG4YZ7RG63I type=del 2024-09-12T17:36:52.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.276+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=RV3EX7E7ITUT type=write size=171160 2024-09-12T17:36:52.278 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.277+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~IL9BKD07LZ34.0 size=1048576 2024-09-12T17:36:52.278 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.277+0000 7fa80ca76780 1 < canceled part key=_multipart_0U9KSMYWT2C3.2~IL9BKD07LZ34.1 size=1048576 2024-09-12T17:36:52.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.278+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~IL9BKD07LZ34.2 size=48304 2024-09-12T17:36:52.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.280+0000 7fa80ca76780 1 < canceled multipart upload key=0U9KSMYWT2C3 upload=IL9BKD07LZ34 tag=5YPCA9J4EE8V type=write size=3194032 2024-09-12T17:36:52.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.281+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=BZ0FS4GHU7I6 type=del size=1306106 2024-09-12T17:36:52.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.283+0000 7fa80ca76780 1 < completed write operation key=LU7PDGWTAK63 tag=0FXLHUD4ICEG type=write size=471137 2024-09-12T17:36:52.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.284+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=IKS9ZOWRL0ZJ type=del size=3049428 2024-09-12T17:36:52.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.285+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=85PJ9DZPC41W type=del 2024-09-12T17:36:52.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.286+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=H5K2G5EMD2OK type=del size=1449580 2024-09-12T17:36:52.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.288+0000 7fa80ca76780 1 < suggested remove operation key=8Z3EPQHMA6M5 tag=PY8K34Q5IYRU type=del 2024-09-12T17:36:52.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.289+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=WEBS23RZ40DH type=del size=3148924 2024-09-12T17:36:52.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.291+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=DCUTIBM65R30 type=del 2024-09-12T17:36:52.294 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.293+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~JSEQ60YA7NXT.0 size=784922 2024-09-12T17:36:52.294 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.293+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=JSEQ60YA7NXT tag=3NDCDJ4XQEF1 type=write size=1833498 2024-09-12T17:36:52.295 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.294+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~GWGC0R5N5YOI.0 size=212728 2024-09-12T17:36:52.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.296+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=GWGC0R5N5YOI tag=L03TMPH71TS2 type=write size=1261304 2024-09-12T17:36:52.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.297+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=P2U21OIN6VJ0 type=del size=813637 2024-09-12T17:36:52.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.298+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=MOMPX9ODL7TI type=del 2024-09-12T17:36:52.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.300+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~BR26S8HXRZ1R.0 size=1048576 2024-09-12T17:36:52.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.301+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~BR26S8HXRZ1R.1 size=1048576 2024-09-12T17:36:52.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.302+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~BR26S8HXRZ1R.2 size=356078 2024-09-12T17:36:52.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.302+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=BR26S8HXRZ1R tag=6GZ14OJPQQYE type=write size=3501806 2024-09-12T17:36:52.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.303+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=9WVT329JU9V2 type=del 2024-09-12T17:36:52.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.304+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=W1E3T7I0VDNR type=del size=3001142 2024-09-12T17:36:52.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.306+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=09SUUIB55DM3 type=del 2024-09-12T17:36:52.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.307+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=WXEH6SEZBUS1 type=del size=1721147 2024-09-12T17:36:52.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.308+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=N1LQU2PGQK1W type=del 2024-09-12T17:36:52.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.310+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=BGK99TC9EKWJ type=del size=1522868 2024-09-12T17:36:52.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.311+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~9AE37VPFDSI4.0 size=1048576 2024-09-12T17:36:52.313 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.312+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~9AE37VPFDSI4.1 size=244208 2024-09-12T17:36:52.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.314+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=9AE37VPFDSI4 tag=Y9MT7MYISA0D type=write size=2341360 2024-09-12T17:36:52.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.315+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=GIKX4W8MR9LE type=del size=3315138 2024-09-12T17:36:52.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.317+0000 7fa80ca76780 1 < suggested update operation key=VDD4PDR1GLWQ tag=LG7SG2OBBN36 type=write size=916493 2024-09-12T17:36:52.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.318+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=JVPR6XAXY4YB type=del size=2784503 2024-09-12T17:36:52.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.319+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=SP1A01ZXLD2Q type=del 2024-09-12T17:36:52.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.322+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=6X4U583P8OW6 type=del size=62604 2024-09-12T17:36:52.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.323+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=06MIY8THG9EN type=del 2024-09-12T17:36:52.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.325+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~GVIRT2W61G7R.0 size=1048576 2024-09-12T17:36:52.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.326+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~GVIRT2W61G7R.1 size=1048576 2024-09-12T17:36:52.328 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.327+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~GVIRT2W61G7R.2 size=42779 2024-09-12T17:36:52.328 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.327+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=GVIRT2W61G7R tag=JKJJ1GRCHPK9 type=write size=3188507 2024-09-12T17:36:52.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.329+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=CVMSITQTRSI1 type=del 2024-09-12T17:36:52.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.330+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=DPFDLFCX8HC5 type=write size=190756 2024-09-12T17:36:52.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.331+0000 7fa80ca76780 1 < completed write operation key=GKE6623N268Z tag=RV3EX7E7ITUT type=write size=171160 2024-09-12T17:36:52.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.332+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=K6I4DADLCXYM type=write size=650533 2024-09-12T17:36:52.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.333+0000 7fa80ca76780 -1 < failed to complete operation key=8Z3EPQHMA6M5 tag=BZ0FS4GHU7I6 type=del size=1306106: (22) Invalid argument 2024-09-12T17:36:52.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.334+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=L5UWDHE2ISOY type=write size=836051 2024-09-12T17:36:52.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.335+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=IKS9ZOWRL0ZJ type=del 2024-09-12T17:36:52.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.336+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=PWFM6P5A9H1Q type=del size=375305 2024-09-12T17:36:52.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.337+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=H5K2G5EMD2OK type=del 2024-09-12T17:36:52.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.339+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=SV93PD7YO1Z1 type=del size=3642638 2024-09-12T17:36:52.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.340+0000 7fa80ca76780 -1 < failed to complete operation key=VDD4PDR1GLWQ tag=WEBS23RZ40DH type=del size=3148924: (22) Invalid argument 2024-09-12T17:36:52.342 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.341+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=6VOOU2U0UDUE type=write size=190953 2024-09-12T17:36:52.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.342+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~JSEQ60YA7NXT.0 size=784922 2024-09-12T17:36:52.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.344+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=JSEQ60YA7NXT tag=3NDCDJ4XQEF1 type=write size=1833498 2024-09-12T17:36:52.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.345+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=KNO1WIXGZ1IJ type=del size=528013 2024-09-12T17:36:52.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.346+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=P2U21OIN6VJ0 type=del 2024-09-12T17:36:52.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.347+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=7XNVCOUEZEJL type=del size=3938426 2024-09-12T17:36:52.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.349+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~BR26S8HXRZ1R.0 size=1048576 2024-09-12T17:36:52.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.349+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~BR26S8HXRZ1R.1 size=1048576 2024-09-12T17:36:52.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.350+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~BR26S8HXRZ1R.2 size=356078 2024-09-12T17:36:52.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.352+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=BR26S8HXRZ1R tag=6GZ14OJPQQYE type=write size=3501806 2024-09-12T17:36:52.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.354+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=S22VBVPCH4R1 type=write size=1013698 2024-09-12T17:36:52.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.355+0000 7fa80ca76780 1 < canceled operation key=FKK4IGD1436I tag=W1E3T7I0VDNR type=del size=3001142 2024-09-12T17:36:52.358 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.357+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~TMXDPONH2V3H.0 size=1048576 2024-09-12T17:36:52.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.358+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~TMXDPONH2V3H.1 size=1048576 2024-09-12T17:36:52.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.359+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~TMXDPONH2V3H.2 size=153480 2024-09-12T17:36:52.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.359+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=TMXDPONH2V3H tag=H2OLQ0FQ4RN9 type=write size=3299208 2024-09-12T17:36:52.361 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.360+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=WXEH6SEZBUS1 type=del 2024-09-12T17:36:52.362 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.361+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=M9W2D6YQZOF9 type=del size=1171930 2024-09-12T17:36:52.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.362+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=BGK99TC9EKWJ type=del 2024-09-12T17:36:52.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.364+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~3RF38Z3JN4T5.0 size=517854 2024-09-12T17:36:52.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.364+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=3RF38Z3JN4T5 tag=CYPKUGPTYXG6 type=write size=1566430 2024-09-12T17:36:52.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.366+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=GIKX4W8MR9LE type=del 2024-09-12T17:36:52.369 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.368+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~VXM288RZ38FZ.0 size=1048576 2024-09-12T17:36:52.370 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.369+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~VXM288RZ38FZ.1 size=902943 2024-09-12T17:36:52.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.369+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=VXM288RZ38FZ tag=2U3NDJP82SJ8 type=write size=3000095 2024-09-12T17:36:52.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.372+0000 7fa80ca76780 1 < suggested remove operation key=MSZUYX441Y66 tag=JVPR6XAXY4YB type=del 2024-09-12T17:36:52.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.373+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=Q7O7XG1FGOOK type=write size=198171 2024-09-12T17:36:52.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.374+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=6X4U583P8OW6 type=del 2024-09-12T17:36:52.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.375+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=FSNEPQ0KG5TF type=del size=540879 2024-09-12T17:36:52.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.376+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~GVIRT2W61G7R.0 size=1048576 2024-09-12T17:36:52.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.377+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~GVIRT2W61G7R.1 size=1048576 2024-09-12T17:36:52.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.378+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~GVIRT2W61G7R.2 size=42779 2024-09-12T17:36:52.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.380+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=GVIRT2W61G7R tag=JKJJ1GRCHPK9 type=write size=3188507 2024-09-12T17:36:52.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.382+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=Q534KKMXB7J1 type=del size=2114607 2024-09-12T17:36:52.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.383+0000 7fa80ca76780 1 < completed write operation key=DYZIHCBF3D8U tag=DPFDLFCX8HC5 type=write size=190756 2024-09-12T17:36:52.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.385+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~Z14IJH09BYTA.0 size=821461 2024-09-12T17:36:52.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.385+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=Z14IJH09BYTA tag=XTHZ5FB1SD0H type=write size=1870037 2024-09-12T17:36:52.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.386+0000 7fa80ca76780 1 < completed write operation key=BLGMV3S9AY24 tag=K6I4DADLCXYM type=write size=650533 2024-09-12T17:36:52.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.388+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=WGWCG9SD1RJA type=del size=1312957 2024-09-12T17:36:52.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.389+0000 7fa80ca76780 1 < completed write operation key=LU7PDGWTAK63 tag=L5UWDHE2ISOY type=write size=836051 2024-09-12T17:36:52.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.390+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=IPDTB3N0XOZS type=del size=1110805 2024-09-12T17:36:52.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.391+0000 7fa80ca76780 -1 < failed to complete operation key=MSZUYX441Y66 tag=PWFM6P5A9H1Q type=del size=375305: (22) Invalid argument 2024-09-12T17:36:52.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.393+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~R7TVMF9LJ8M0.0 size=462301 2024-09-12T17:36:52.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.393+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=R7TVMF9LJ8M0 tag=AJC00T9Q193Z type=write size=1510877 2024-09-12T17:36:52.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.395+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=SV93PD7YO1Z1 type=del 2024-09-12T17:36:52.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.397+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~WXEP2JLCMTJE.0 size=1048576 2024-09-12T17:36:52.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.398+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~WXEP2JLCMTJE.1 size=1048576 2024-09-12T17:36:52.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.399+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~WXEP2JLCMTJE.2 size=536588 2024-09-12T17:36:52.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.399+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=WXEP2JLCMTJE tag=VA7MKCL71DP8 type=write size=3682316 2024-09-12T17:36:52.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.400+0000 7fa80ca76780 -1 < failed to complete operation key=MSZUYX441Y66 tag=6VOOU2U0UDUE type=write size=190953: (22) Invalid argument 2024-09-12T17:36:52.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.401+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=DGYFXE8SLUJJ type=write size=593635 2024-09-12T17:36:52.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.404+0000 7fa80ca76780 1 < suggested update operation key=54KWSI77T73A tag=KNO1WIXGZ1IJ type=del size=528013 2024-09-12T17:36:52.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.405+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=ETUCW2GV45JU type=del size=3559925 2024-09-12T17:36:52.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.407+0000 7fa80ca76780 1 < suggested update operation key=8Z3EPQHMA6M5 tag=7XNVCOUEZEJL type=del size=3938426 2024-09-12T17:36:52.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.409+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~MKSMA4DBHWSK.0 size=488193 2024-09-12T17:36:52.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.409+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=MKSMA4DBHWSK tag=4BMANLMLY3FF type=write size=1536769 2024-09-12T17:36:52.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.410+0000 7fa80ca76780 -1 < failed to complete operation key=54KWSI77T73A tag=S22VBVPCH4R1 type=write size=1013698: (22) Invalid argument 2024-09-12T17:36:52.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.412+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~H6F4YZD74GKP.0 size=1048576 2024-09-12T17:36:52.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.413+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~H6F4YZD74GKP.1 size=1048576 2024-09-12T17:36:52.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.414+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~H6F4YZD74GKP.2 size=910416 2024-09-12T17:36:52.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.414+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=H6F4YZD74GKP tag=J9NGV9OZOOTF type=write size=4056144 2024-09-12T17:36:52.416 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.415+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~TMXDPONH2V3H.0 size=1048576 2024-09-12T17:36:52.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.416+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~TMXDPONH2V3H.1 size=1048576 2024-09-12T17:36:52.418 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.417+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~TMXDPONH2V3H.2 size=153480 2024-09-12T17:36:52.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.419+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=TMXDPONH2V3H tag=H2OLQ0FQ4RN9 type=write size=3299208 2024-09-12T17:36:52.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.420+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=DSACS44H8Z8F type=del size=1619773 2024-09-12T17:36:52.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.422+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=M9W2D6YQZOF9 type=del 2024-09-12T17:36:52.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.424+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~DLE06MAE0XUJ.0 size=1048576 2024-09-12T17:36:52.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.425+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~DLE06MAE0XUJ.1 size=1048576 2024-09-12T17:36:52.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.425+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~DLE06MAE0XUJ.2 size=157294 2024-09-12T17:36:52.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.425+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=DLE06MAE0XUJ tag=LKQU122G2623 type=write size=3303022 2024-09-12T17:36:52.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.427+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~3RF38Z3JN4T5.0 size=517854 2024-09-12T17:36:52.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.429+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=3RF38Z3JN4T5 tag=CYPKUGPTYXG6 type=write size=1566430 2024-09-12T17:36:52.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.430+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=VVM3M9SQUJ2E type=del size=1336491 2024-09-12T17:36:52.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.431+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~VXM288RZ38FZ.0 size=1048576 2024-09-12T17:36:52.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.432+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~VXM288RZ38FZ.1 size=902943 2024-09-12T17:36:52.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.434+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=VXM288RZ38FZ tag=2U3NDJP82SJ8 type=write size=3000095 2024-09-12T17:36:52.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.436+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~LIZDRUPBFODA.0 size=1048576 2024-09-12T17:36:52.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.437+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~LIZDRUPBFODA.1 size=1048576 2024-09-12T17:36:52.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.439+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~LIZDRUPBFODA.2 size=617290 2024-09-12T17:36:52.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.439+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=LIZDRUPBFODA tag=ZX46QBWJJ32Q type=write size=3763018 2024-09-12T17:36:52.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.440+0000 7fa80ca76780 1 < completed write operation key=GKE6623N268Z tag=Q7O7XG1FGOOK type=write size=198171 2024-09-12T17:36:52.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.443+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~C91YY43ITY6N.0 size=1048576 2024-09-12T17:36:52.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.444+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~C91YY43ITY6N.1 size=805459 2024-09-12T17:36:52.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.444+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=C91YY43ITY6N tag=3G38HNHH0ZRD type=write size=2902611 2024-09-12T17:36:52.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.446+0000 7fa80ca76780 -1 < failed to complete operation key=54KWSI77T73A tag=FSNEPQ0KG5TF type=del size=540879: (22) Invalid argument 2024-09-12T17:36:52.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.447+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=BTCWQ9X1VQVO type=del size=4130907 2024-09-12T17:36:52.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.448+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=Q534KKMXB7J1 type=del 2024-09-12T17:36:52.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.450+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~FB9YTCTR4199.0 size=1048576 2024-09-12T17:36:52.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.451+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~FB9YTCTR4199.1 size=565150 2024-09-12T17:36:52.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.451+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=FB9YTCTR4199 tag=UB2D2IOWHSHR type=write size=2662302 2024-09-12T17:36:52.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.453+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~Z14IJH09BYTA.0 size=821461 2024-09-12T17:36:52.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.455+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=Z14IJH09BYTA tag=XTHZ5FB1SD0H type=write size=1870037 2024-09-12T17:36:52.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.457+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~FELKDJRB5XS3.0 size=1048576 2024-09-12T17:36:52.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.458+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~FELKDJRB5XS3.1 size=756355 2024-09-12T17:36:52.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.458+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=FELKDJRB5XS3 tag=W1Q91V8XM352 type=write size=2853507 2024-09-12T17:36:52.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.459+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=WGWCG9SD1RJA type=del 2024-09-12T17:36:52.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.460+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=EVF1MSZTHQ5Q type=del size=1550460 2024-09-12T17:36:52.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.462+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=IPDTB3N0XOZS type=del 2024-09-12T17:36:52.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.463+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=PKB6MONVFAFB type=write size=48187 2024-09-12T17:36:52.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.464+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~R7TVMF9LJ8M0.0 size=462301 2024-09-12T17:36:52.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.466+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=R7TVMF9LJ8M0 tag=AJC00T9Q193Z type=write size=1510877 2024-09-12T17:36:52.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.468+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~ZEKVUMXQ4YPJ.0 size=1048576 2024-09-12T17:36:52.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.469+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~ZEKVUMXQ4YPJ.1 size=1048576 2024-09-12T17:36:52.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.470+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~ZEKVUMXQ4YPJ.2 size=376291 2024-09-12T17:36:52.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.470+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=ZEKVUMXQ4YPJ tag=PFUF2KM92NBG type=write size=3522019 2024-09-12T17:36:52.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.471+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~WXEP2JLCMTJE.0 size=1048576 2024-09-12T17:36:52.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.471+0000 7fa80ca76780 1 < canceled part key=_multipart_MSZUYX441Y66.2~WXEP2JLCMTJE.1 size=1048576 2024-09-12T17:36:52.473 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.472+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~WXEP2JLCMTJE.2 size=536588 2024-09-12T17:36:52.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.474+0000 7fa80ca76780 1 < canceled multipart upload key=MSZUYX441Y66 upload=WXEP2JLCMTJE tag=VA7MKCL71DP8 type=write size=3682316 2024-09-12T17:36:52.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.476+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~IR7NVMRWD8VY.0 size=1048576 2024-09-12T17:36:52.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.477+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~IR7NVMRWD8VY.1 size=222999 2024-09-12T17:36:52.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.477+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=IR7NVMRWD8VY tag=37ZYGDIO74Z5 type=write size=2320151 2024-09-12T17:36:52.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.478+0000 7fa80ca76780 1 < completed write operation key=LU7PDGWTAK63 tag=DGYFXE8SLUJJ type=write size=593635 2024-09-12T17:36:52.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.480+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=72LD3X27VE4G type=del size=972266 2024-09-12T17:36:52.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.481+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=ETUCW2GV45JU type=del 2024-09-12T17:36:52.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.482+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=RWADD11TGPZK type=del size=3401321 2024-09-12T17:36:52.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.483+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~MKSMA4DBHWSK.0 size=488193 2024-09-12T17:36:52.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.485+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=MKSMA4DBHWSK tag=4BMANLMLY3FF type=write size=1536769 2024-09-12T17:36:52.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.487+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~878C1CRZQICC.0 size=1048576 2024-09-12T17:36:52.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.488+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~878C1CRZQICC.1 size=1021093 2024-09-12T17:36:52.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.488+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=878C1CRZQICC tag=ABOQVC7S431Q type=write size=3118245 2024-09-12T17:36:52.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.489+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~H6F4YZD74GKP.0 size=1048576 2024-09-12T17:36:52.491 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.490+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~H6F4YZD74GKP.1 size=1048576 2024-09-12T17:36:52.492 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.491+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~H6F4YZD74GKP.2 size=910416 2024-09-12T17:36:52.494 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.493+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=H6F4YZD74GKP tag=J9NGV9OZOOTF type=write size=4056144 2024-09-12T17:36:52.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.494+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=P0OU08PV9SL0 type=del size=26308 2024-09-12T17:36:52.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.497+0000 7fa80ca76780 1 < suggested remove operation key=H87S6AI6JT6D tag=DSACS44H8Z8F type=del 2024-09-12T17:36:52.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.498+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=A7ERM4M9GM17 type=del size=10197 2024-09-12T17:36:52.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.499+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~DLE06MAE0XUJ.0 size=1048576 2024-09-12T17:36:52.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.500+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~DLE06MAE0XUJ.1 size=1048576 2024-09-12T17:36:52.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.501+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~DLE06MAE0XUJ.2 size=157294 2024-09-12T17:36:52.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.503+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=DLE06MAE0XUJ tag=LKQU122G2623 type=write size=3303022 2024-09-12T17:36:52.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.505+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=23DA3FSL8Z6Z type=write size=154016 2024-09-12T17:36:52.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.506+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=VVM3M9SQUJ2E type=del 2024-09-12T17:36:52.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.508+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~OLWDBIY3IRBG.0 size=1048576 2024-09-12T17:36:52.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.509+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~OLWDBIY3IRBG.1 size=388220 2024-09-12T17:36:52.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.509+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=OLWDBIY3IRBG tag=1Z17XUO656D6 type=write size=2485372 2024-09-12T17:36:52.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.511+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~LIZDRUPBFODA.0 size=1048576 2024-09-12T17:36:52.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.512+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~LIZDRUPBFODA.1 size=1048576 2024-09-12T17:36:52.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.513+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~LIZDRUPBFODA.2 size=617290 2024-09-12T17:36:52.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.515+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=LIZDRUPBFODA tag=ZX46QBWJJ32Q type=write size=3763018 2024-09-12T17:36:52.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.517+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=VL9ORTO4XA0O type=write size=440344 2024-09-12T17:36:52.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.518+0000 7fa80ca76780 1 < canceled part key=_multipart_R02234GEWV6B.2~C91YY43ITY6N.0 size=1048576 2024-09-12T17:36:52.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.519+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~C91YY43ITY6N.1 size=805459 2024-09-12T17:36:52.522 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.520+0000 7fa80ca76780 1 < canceled multipart upload key=R02234GEWV6B upload=C91YY43ITY6N tag=3G38HNHH0ZRD type=write size=2902611 2024-09-12T17:36:52.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.522+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=6QKB0C5OUHCC type=write size=858672 2024-09-12T17:36:52.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.523+0000 7fa80ca76780 1 < canceled operation key=LU7PDGWTAK63 tag=BTCWQ9X1VQVO type=del size=4130907 2024-09-12T17:36:52.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.524+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=2QMRMF3ZRACK type=write size=512725 2024-09-12T17:36:52.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.525+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~FB9YTCTR4199.0 size=1048576 2024-09-12T17:36:52.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.526+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~FB9YTCTR4199.1 size=565150 2024-09-12T17:36:52.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.529+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=FB9YTCTR4199 tag=UB2D2IOWHSHR type=write size=2662302 2024-09-12T17:36:52.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.530+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=NX1LMMLITBIO type=write size=178013 2024-09-12T17:36:52.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.531+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~FELKDJRB5XS3.0 size=1048576 2024-09-12T17:36:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.532+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~FELKDJRB5XS3.1 size=756355 2024-09-12T17:36:52.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.534+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=FELKDJRB5XS3 tag=W1Q91V8XM352 type=write size=2853507 2024-09-12T17:36:52.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.535+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=7HJ0MMNSHI2U type=del size=2416744 2024-09-12T17:36:52.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.537+0000 7fa80ca76780 1 < suggested remove operation key=VDD4PDR1GLWQ tag=EVF1MSZTHQ5Q type=del 2024-09-12T17:36:52.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.538+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=UO35ZF2TQXQU type=del size=3870074 2024-09-12T17:36:52.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.540+0000 7fa80ca76780 1 < completed write operation key=K243DOYPYVDS tag=PKB6MONVFAFB type=write size=48187 2024-09-12T17:36:52.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.541+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=NAE13IEUYOC5 type=del size=1554837 2024-09-12T17:36:52.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.542+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~ZEKVUMXQ4YPJ.0 size=1048576 2024-09-12T17:36:52.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.543+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~ZEKVUMXQ4YPJ.1 size=1048576 2024-09-12T17:36:52.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.544+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~ZEKVUMXQ4YPJ.2 size=376291 2024-09-12T17:36:52.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.546+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=ZEKVUMXQ4YPJ tag=PFUF2KM92NBG type=write size=3522019 2024-09-12T17:36:52.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.547+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=QR1O2KOZ83MF type=del size=3091551 2024-09-12T17:36:52.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.549+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~IR7NVMRWD8VY.0 size=1048576 2024-09-12T17:36:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.550+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~IR7NVMRWD8VY.1 size=222999 2024-09-12T17:36:52.554 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.553+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=IR7NVMRWD8VY tag=37ZYGDIO74Z5 type=write size=2320151 2024-09-12T17:36:52.555 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.554+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=4Y9XU58NLGSD type=del size=2679052 2024-09-12T17:36:52.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.557+0000 7fa80ca76780 1 < suggested remove operation key=8Z3EPQHMA6M5 tag=72LD3X27VE4G type=del 2024-09-12T17:36:52.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.559+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~CUDV3JZAS2AH.0 size=1048576 2024-09-12T17:36:52.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.559+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~CUDV3JZAS2AH.1 size=1048576 2024-09-12T17:36:52.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.560+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~CUDV3JZAS2AH.2 size=143369 2024-09-12T17:36:52.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.560+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=CUDV3JZAS2AH tag=GG1CTWD6W44H type=write size=3289097 2024-09-12T17:36:52.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.562+0000 7fa80ca76780 1 < canceled operation key=4S33294MWCO1 tag=RWADD11TGPZK type=del size=3401321 2024-09-12T17:36:52.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.563+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=WJXFJABFAUVB type=del size=3080549 2024-09-12T17:36:52.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.564+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~878C1CRZQICC.0 size=1048576 2024-09-12T17:36:52.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.565+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~878C1CRZQICC.1 size=1021093 2024-09-12T17:36:52.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.567+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=878C1CRZQICC tag=ABOQVC7S431Q type=write size=3118245 2024-09-12T17:36:52.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.568+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=L6J14PX2JS3B type=write size=558742 2024-09-12T17:36:52.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.569+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=P0OU08PV9SL0 type=del 2024-09-12T17:36:52.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.571+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=Q2WX3JCNFGYL type=del size=1458714 2024-09-12T17:36:52.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.572+0000 7fa80ca76780 -1 < failed to complete operation key=VDD4PDR1GLWQ tag=A7ERM4M9GM17 type=del size=10197: (22) Invalid argument 2024-09-12T17:36:52.574 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.573+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=H701NDEADMET type=write size=185904 2024-09-12T17:36:52.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.574+0000 7fa80ca76780 1 < completed write operation key=DYZIHCBF3D8U tag=23DA3FSL8Z6Z type=write size=154016 2024-09-12T17:36:52.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.575+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=E9NNI753DQCI type=del size=196321 2024-09-12T17:36:52.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.577+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~OLWDBIY3IRBG.0 size=1048576 2024-09-12T17:36:52.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.578+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~OLWDBIY3IRBG.1 size=388220 2024-09-12T17:36:52.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.581+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=OLWDBIY3IRBG tag=1Z17XUO656D6 type=write size=2485372 2024-09-12T17:36:52.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.584+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~9JF6YSPS0QBY.0 size=52411 2024-09-12T17:36:52.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.584+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=9JF6YSPS0QBY tag=3J9KJM9NW3XM type=write size=1100987 2024-09-12T17:36:52.587 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.586+0000 7fa80ca76780 1 < suggested update operation key=R871XU2TDWID tag=VL9ORTO4XA0O type=write size=440344 2024-09-12T17:36:52.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.587+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=0MYPPF3E31VU type=del size=2879587 2024-09-12T17:36:52.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.590+0000 7fa80ca76780 1 < suggested remove operation key=RC1IX4DQREEP tag=6QKB0C5OUHCC type=write 2024-09-12T17:36:52.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.591+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=HDQND5XX9J3S type=del size=3221008 2024-09-12T17:36:52.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.592+0000 7fa80ca76780 1 < completed write operation key=K243DOYPYVDS tag=2QMRMF3ZRACK type=write size=512725 2024-09-12T17:36:52.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.594+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~GZ67O8186L9R.0 size=843308 2024-09-12T17:36:52.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.594+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=GZ67O8186L9R tag=51WGDJJBIKKH type=write size=1891884 2024-09-12T17:36:52.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.597+0000 7fa80ca76780 1 < suggested update operation key=BLGMV3S9AY24 tag=NX1LMMLITBIO type=write size=178013 2024-09-12T17:36:52.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.598+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=OVHX7LTXO4LP type=del size=382553 2024-09-12T17:36:52.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.599+0000 7fa80ca76780 -1 < failed to complete operation key=RC1IX4DQREEP tag=7HJ0MMNSHI2U type=del size=2416744: (22) Invalid argument 2024-09-12T17:36:52.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.602+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~2OI5V7ZJBBR5.0 size=1048576 2024-09-12T17:36:52.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.603+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~2OI5V7ZJBBR5.1 size=1048576 2024-09-12T17:36:52.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.604+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~2OI5V7ZJBBR5.2 size=1019377 2024-09-12T17:36:52.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.604+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=2OI5V7ZJBBR5 tag=BF214M03A0KN type=write size=4165105 2024-09-12T17:36:52.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.605+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=UO35ZF2TQXQU type=del 2024-09-12T17:36:52.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.606+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=I9LJSCIAVJ3N type=del size=4099330 2024-09-12T17:36:52.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.607+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=NAE13IEUYOC5 type=del 2024-09-12T17:36:52.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.610+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~PE23VFCHJ3XD.0 size=152751 2024-09-12T17:36:52.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.610+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=PE23VFCHJ3XD tag=HM2948O40BCH type=write size=1201327 2024-09-12T17:36:52.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.611+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=QR1O2KOZ83MF type=del 2024-09-12T17:36:52.614 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.613+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~3BQC0Q0X5YXO.0 size=1048576 2024-09-12T17:36:52.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.614+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~3BQC0Q0X5YXO.1 size=1048576 2024-09-12T17:36:52.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.614+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~3BQC0Q0X5YXO.2 size=76203 2024-09-12T17:36:52.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.614+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=3BQC0Q0X5YXO tag=JIGRCAX6VOUZ type=write size=3221931 2024-09-12T17:36:52.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.616+0000 7fa80ca76780 -1 < failed to complete operation key=R871XU2TDWID tag=4Y9XU58NLGSD type=del size=2679052: (22) Invalid argument 2024-09-12T17:36:52.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.618+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~Q5YPYGLVXHU1.0 size=1048576 2024-09-12T17:36:52.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.619+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~Q5YPYGLVXHU1.1 size=953644 2024-09-12T17:36:52.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.619+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=Q5YPYGLVXHU1 tag=IFJH80JK8ZIG type=write size=3050796 2024-09-12T17:36:52.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.620+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~CUDV3JZAS2AH.0 size=1048576 2024-09-12T17:36:52.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.620+0000 7fa80ca76780 1 < canceled part key=_multipart_DYZIHCBF3D8U.2~CUDV3JZAS2AH.1 size=1048576 2024-09-12T17:36:52.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.621+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~CUDV3JZAS2AH.2 size=143369 2024-09-12T17:36:52.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.623+0000 7fa80ca76780 1 < canceled multipart upload key=DYZIHCBF3D8U upload=CUDV3JZAS2AH tag=GG1CTWD6W44H type=write size=3289097 2024-09-12T17:36:52.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.625+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~GIJV4C7Z4A8J.0 size=1048576 2024-09-12T17:36:52.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.626+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~GIJV4C7Z4A8J.1 size=1048576 2024-09-12T17:36:52.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.627+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~GIJV4C7Z4A8J.2 size=220700 2024-09-12T17:36:52.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.627+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=GIJV4C7Z4A8J tag=Y0K705KH4YBP type=write size=3366428 2024-09-12T17:36:52.630 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.629+0000 7fa80ca76780 1 < suggested remove operation key=U8O04HYQZRJC tag=WJXFJABFAUVB type=del 2024-09-12T17:36:52.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.631+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=J72F4UYYPXZJ type=del size=385845 2024-09-12T17:36:52.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.632+0000 7fa80ca76780 1 < canceled operation key=GKE6623N268Z tag=L6J14PX2JS3B type=write size=558742 2024-09-12T17:36:52.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.633+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=8KVY4QA2EZQJ type=write size=266228 2024-09-12T17:36:52.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.634+0000 7fa80ca76780 -1 < failed to complete operation key=R871XU2TDWID tag=Q2WX3JCNFGYL type=del size=1458714: (22) Invalid argument 2024-09-12T17:36:52.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.635+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=NI9M85LNUTP1 type=del size=3824835 2024-09-12T17:36:52.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.636+0000 7fa80ca76780 -1 < failed to complete operation key=RC1IX4DQREEP tag=H701NDEADMET type=write size=185904: (22) Invalid argument 2024-09-12T17:36:52.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.637+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=4V08BKNC11AR type=del size=3435077 2024-09-12T17:36:52.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.638+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=E9NNI753DQCI type=del 2024-09-12T17:36:52.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.640+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=NYV2RUB58C8N type=del size=106489 2024-09-12T17:36:52.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.641+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~9JF6YSPS0QBY.0 size=52411 2024-09-12T17:36:52.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.643+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=9JF6YSPS0QBY tag=3J9KJM9NW3XM type=write size=1100987 2024-09-12T17:36:52.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.645+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~JSA5P5BAGF0V.0 size=1048576 2024-09-12T17:36:52.647 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.646+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~JSA5P5BAGF0V.1 size=327178 2024-09-12T17:36:52.647 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.646+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=JSA5P5BAGF0V tag=6U6D9GCMWK8A type=write size=2424330 2024-09-12T17:36:52.648 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.647+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=0MYPPF3E31VU type=del 2024-09-12T17:36:52.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.648+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=X0FGC3Q9BR3H type=del size=1164420 2024-09-12T17:36:52.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.649+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=HDQND5XX9J3S type=del 2024-09-12T17:36:52.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.651+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~YHACIY5UPRWW.0 size=1048576 2024-09-12T17:36:52.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.652+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~YHACIY5UPRWW.1 size=1048576 2024-09-12T17:36:52.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.653+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~YHACIY5UPRWW.2 size=943064 2024-09-12T17:36:52.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.653+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=YHACIY5UPRWW tag=A17A95M4TOAN type=write size=4088792 2024-09-12T17:36:52.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.656+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~GZ67O8186L9R.0 size=843308 2024-09-12T17:36:52.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.657+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=GZ67O8186L9R tag=51WGDJJBIKKH type=write size=1891884 2024-09-12T17:36:52.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.659+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=3ZA3S7UU19O0 type=del size=3866410 2024-09-12T17:36:52.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.660+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=OVHX7LTXO4LP type=del 2024-09-12T17:36:52.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.662+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~TPNIYWWZKT8Z.0 size=1048576 2024-09-12T17:36:52.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.663+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~TPNIYWWZKT8Z.1 size=578755 2024-09-12T17:36:52.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.663+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=TPNIYWWZKT8Z tag=BLXF3VDO19MR type=write size=2675907 2024-09-12T17:36:52.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.664+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~2OI5V7ZJBBR5.0 size=1048576 2024-09-12T17:36:52.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.665+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~2OI5V7ZJBBR5.1 size=1048576 2024-09-12T17:36:52.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.667+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~2OI5V7ZJBBR5.2 size=1019377 2024-09-12T17:36:52.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.669+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=2OI5V7ZJBBR5 tag=BF214M03A0KN type=write size=4165105 2024-09-12T17:36:52.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.670+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=AN42LMP8SHSG type=write size=147170 2024-09-12T17:36:52.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.671+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=I9LJSCIAVJ3N type=del 2024-09-12T17:36:52.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.672+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=BXA9619U0JWQ type=del size=1487275 2024-09-12T17:36:52.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.672+0000 7fa80ca76780 1 < canceled part key=_multipart_07LPSZT2RKCC.2~PE23VFCHJ3XD.0 size=152751 2024-09-12T17:36:52.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.676+0000 7fa80ca76780 1 < canceled multipart upload key=07LPSZT2RKCC upload=PE23VFCHJ3XD tag=HM2948O40BCH type=write size=1201327 2024-09-12T17:36:52.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.678+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~FIY0GX3DCRUD.0 size=1048576 2024-09-12T17:36:52.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.679+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~FIY0GX3DCRUD.1 size=957211 2024-09-12T17:36:52.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.679+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=FIY0GX3DCRUD tag=E2ZAWOG72CGS type=write size=3054363 2024-09-12T17:36:52.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.680+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~3BQC0Q0X5YXO.0 size=1048576 2024-09-12T17:36:52.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.680+0000 7fa80ca76780 1 < canceled part key=_multipart_OJPZAWR5BLBN.2~3BQC0Q0X5YXO.1 size=1048576 2024-09-12T17:36:52.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.681+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~3BQC0Q0X5YXO.2 size=76203 2024-09-12T17:36:52.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.683+0000 7fa80ca76780 1 < canceled multipart upload key=OJPZAWR5BLBN upload=3BQC0Q0X5YXO tag=JIGRCAX6VOUZ type=write size=3221931 2024-09-12T17:36:52.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.684+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~GAU9O2AYWPG6.0 size=1048576 2024-09-12T17:36:52.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.685+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~GAU9O2AYWPG6.1 size=1038061 2024-09-12T17:36:52.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.685+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=GAU9O2AYWPG6 tag=NPG1Z2D28EC1 type=write size=3135213 2024-09-12T17:36:52.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.686+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~Q5YPYGLVXHU1.0 size=1048576 2024-09-12T17:36:52.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.687+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~Q5YPYGLVXHU1.1 size=953644 2024-09-12T17:36:52.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.689+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=Q5YPYGLVXHU1 tag=IFJH80JK8ZIG type=write size=3050796 2024-09-12T17:36:52.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.690+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=2RMITBNCPHNY type=write size=655204 2024-09-12T17:36:52.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.691+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~GIJV4C7Z4A8J.0 size=1048576 2024-09-12T17:36:52.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.692+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~GIJV4C7Z4A8J.1 size=1048576 2024-09-12T17:36:52.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.693+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~GIJV4C7Z4A8J.2 size=220700 2024-09-12T17:36:52.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.695+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=GIJV4C7Z4A8J tag=Y0K705KH4YBP type=write size=3366428 2024-09-12T17:36:52.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.696+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=90M9YE1B0PUS type=del size=242437 2024-09-12T17:36:52.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.697+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=J72F4UYYPXZJ type=del 2024-09-12T17:36:52.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.699+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~3LMUN9QWP3KA.0 size=1048576 2024-09-12T17:36:52.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.700+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~3LMUN9QWP3KA.1 size=1048576 2024-09-12T17:36:52.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.701+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~3LMUN9QWP3KA.2 size=993582 2024-09-12T17:36:52.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.701+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=3LMUN9QWP3KA tag=LWAMW3NJRAIU type=write size=4139310 2024-09-12T17:36:52.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.703+0000 7fa80ca76780 1 < suggested remove operation key=GKE6623N268Z tag=8KVY4QA2EZQJ type=write 2024-09-12T17:36:52.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.704+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=SILTQR2AZC6Z type=del size=1514332 2024-09-12T17:36:52.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.707+0000 7fa80ca76780 1 < suggested remove operation key=4S33294MWCO1 tag=NI9M85LNUTP1 type=del 2024-09-12T17:36:52.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.709+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~VYQRJ0Z53LD6.0 size=1048576 2024-09-12T17:36:52.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.709+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~VYQRJ0Z53LD6.1 size=1048576 2024-09-12T17:36:52.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.710+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~VYQRJ0Z53LD6.2 size=326602 2024-09-12T17:36:52.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.710+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=VYQRJ0Z53LD6 tag=8RTY51QSFHSM type=write size=3472330 2024-09-12T17:36:52.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.711+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=4V08BKNC11AR type=del 2024-09-12T17:36:52.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.714+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~PUCO0S60RWHK.0 size=1048576 2024-09-12T17:36:52.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.715+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~PUCO0S60RWHK.1 size=1048576 2024-09-12T17:36:52.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.716+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~PUCO0S60RWHK.2 size=704455 2024-09-12T17:36:52.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.716+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=PUCO0S60RWHK tag=KXGLKDZOJP9S type=write size=3850183 2024-09-12T17:36:52.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.717+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=NYV2RUB58C8N type=del 2024-09-12T17:36:52.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.719+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~KY5K2UPF8CVG.0 size=1048576 2024-09-12T17:36:52.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.720+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~KY5K2UPF8CVG.1 size=1048576 2024-09-12T17:36:52.722 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.721+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~KY5K2UPF8CVG.2 size=611145 2024-09-12T17:36:52.722 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.721+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=KY5K2UPF8CVG tag=U6MUMA0AS535 type=write size=3756873 2024-09-12T17:36:52.723 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.722+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~JSA5P5BAGF0V.0 size=1048576 2024-09-12T17:36:52.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.723+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~JSA5P5BAGF0V.1 size=327178 2024-09-12T17:36:52.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.725+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=JSA5P5BAGF0V tag=6U6D9GCMWK8A type=write size=2424330 2024-09-12T17:36:52.729 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.728+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~FUQB591VFQT0.0 size=1048576 2024-09-12T17:36:52.729 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.728+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~FUQB591VFQT0.1 size=1048576 2024-09-12T17:36:52.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.729+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~FUQB591VFQT0.2 size=743119 2024-09-12T17:36:52.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.729+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=FUQB591VFQT0 tag=7LD50YJ4LWAH type=write size=3888847 2024-09-12T17:36:52.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.731+0000 7fa80ca76780 1 < completed delete operation key=07LPSZT2RKCC tag=X0FGC3Q9BR3H type=del 2024-09-12T17:36:52.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.732+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=A0RFJV3AKJMH type=del size=3645114 2024-09-12T17:36:52.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.733+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~YHACIY5UPRWW.0 size=1048576 2024-09-12T17:36:52.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.734+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~YHACIY5UPRWW.1 size=1048576 2024-09-12T17:36:52.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.735+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~YHACIY5UPRWW.2 size=943064 2024-09-12T17:36:52.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.737+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=YHACIY5UPRWW tag=A17A95M4TOAN type=write size=4088792 2024-09-12T17:36:52.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.739+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~7MS6UJADRTTV.0 size=1048576 2024-09-12T17:36:52.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.740+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~7MS6UJADRTTV.1 size=890515 2024-09-12T17:36:52.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.740+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=7MS6UJADRTTV tag=OGXW85BMJX87 type=write size=2987667 2024-09-12T17:36:52.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.741+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=3ZA3S7UU19O0 type=del 2024-09-12T17:36:52.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.743+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~BXOX0EDJNPC3.0 size=1048576 2024-09-12T17:36:52.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.744+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~BXOX0EDJNPC3.1 size=1048576 2024-09-12T17:36:52.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.745+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~BXOX0EDJNPC3.2 size=459037 2024-09-12T17:36:52.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.745+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=BXOX0EDJNPC3 tag=OR8Y82YN6BYO type=write size=3604765 2024-09-12T17:36:52.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.747+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~TPNIYWWZKT8Z.0 size=1048576 2024-09-12T17:36:52.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.748+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~TPNIYWWZKT8Z.1 size=578755 2024-09-12T17:36:52.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.749+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=TPNIYWWZKT8Z tag=BLXF3VDO19MR type=write size=2675907 2024-09-12T17:36:52.752 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.751+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=N7MSBZ0AE44Q type=del size=985307 2024-09-12T17:36:52.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.752+0000 7fa80ca76780 1 < completed write operation key=Z81704G91EPL tag=AN42LMP8SHSG type=write size=147170 2024-09-12T17:36:52.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.754+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~FPRHSIF3BO1V.0 size=673089 2024-09-12T17:36:52.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.754+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=FPRHSIF3BO1V tag=1H40TD8M4G1E type=write size=1721665 2024-09-12T17:36:52.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.755+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=BXA9619U0JWQ type=del 2024-09-12T17:36:52.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.756+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=Z19KMF6YSQNF type=del size=2564582 2024-09-12T17:36:52.758 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.757+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~FIY0GX3DCRUD.0 size=1048576 2024-09-12T17:36:52.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.758+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~FIY0GX3DCRUD.1 size=957211 2024-09-12T17:36:52.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.760+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=FIY0GX3DCRUD tag=E2ZAWOG72CGS type=write size=3054363 2024-09-12T17:36:52.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.762+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~8G865Y3GITM7.0 size=1048576 2024-09-12T17:36:52.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.764+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~8G865Y3GITM7.1 size=61547 2024-09-12T17:36:52.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.764+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=8G865Y3GITM7 tag=L5RN33OOJ3ZB type=write size=2158699 2024-09-12T17:36:52.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.765+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~GAU9O2AYWPG6.0 size=1048576 2024-09-12T17:36:52.767 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.766+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~GAU9O2AYWPG6.1 size=1038061 2024-09-12T17:36:52.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.768+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=GAU9O2AYWPG6 tag=NPG1Z2D28EC1 type=write size=3135213 2024-09-12T17:36:52.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.770+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=21R2O8TZC18K type=del size=2721472 2024-09-12T17:36:52.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.771+0000 7fa80ca76780 1 < completed write operation key=MSZUYX441Y66 tag=2RMITBNCPHNY type=write size=655204 2024-09-12T17:36:52.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.774+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=1FD28DGGP6H3 type=del size=2146702 2024-09-12T17:36:52.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.777+0000 7fa80ca76780 1 < suggested remove operation key=VNGH1DA1HANC tag=90M9YE1B0PUS type=del 2024-09-12T17:36:52.781 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.780+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~02Y595CVUJ0F.0 size=1048576 2024-09-12T17:36:52.782 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.781+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~02Y595CVUJ0F.1 size=1048576 2024-09-12T17:36:52.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.782+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~02Y595CVUJ0F.2 size=16738 2024-09-12T17:36:52.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.782+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=02Y595CVUJ0F tag=87ELA0J1KPYC type=write size=3162466 2024-09-12T17:36:52.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.783+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~3LMUN9QWP3KA.0 size=1048576 2024-09-12T17:36:52.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.784+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~3LMUN9QWP3KA.1 size=1048576 2024-09-12T17:36:52.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.785+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~3LMUN9QWP3KA.2 size=993582 2024-09-12T17:36:52.788 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.787+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=3LMUN9QWP3KA tag=LWAMW3NJRAIU type=write size=4139310 2024-09-12T17:36:52.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.789+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~PKYQNJ7B7PKC.0 size=977472 2024-09-12T17:36:52.791 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.789+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=PKYQNJ7B7PKC tag=AJVE97GBMD3D type=write size=2026048 2024-09-12T17:36:52.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.790+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=SILTQR2AZC6Z type=del 2024-09-12T17:36:52.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.793+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~RN0J889D6SNQ.0 size=1048576 2024-09-12T17:36:52.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.793+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~RN0J889D6SNQ.1 size=1048576 2024-09-12T17:36:52.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.794+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~RN0J889D6SNQ.2 size=1024419 2024-09-12T17:36:52.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.794+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=RN0J889D6SNQ tag=O8RTHCDF6CIZ type=write size=4170147 2024-09-12T17:36:52.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.795+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~VYQRJ0Z53LD6.0 size=1048576 2024-09-12T17:36:52.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.796+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~VYQRJ0Z53LD6.1 size=1048576 2024-09-12T17:36:52.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.796+0000 7fa80ca76780 1 < canceled part key=_multipart_94801LE91HZ9.2~VYQRJ0Z53LD6.2 size=326602 2024-09-12T17:36:52.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.798+0000 7fa80ca76780 1 < canceled multipart upload key=94801LE91HZ9 upload=VYQRJ0Z53LD6 tag=8RTY51QSFHSM type=write size=3472330 2024-09-12T17:36:52.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.799+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=90LJHDVY3H3N type=del size=678979 2024-09-12T17:36:52.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.801+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~PUCO0S60RWHK.0 size=1048576 2024-09-12T17:36:52.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.802+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~PUCO0S60RWHK.1 size=1048576 2024-09-12T17:36:52.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.802+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~PUCO0S60RWHK.2 size=704455 2024-09-12T17:36:52.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.804+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=PUCO0S60RWHK tag=KXGLKDZOJP9S type=write size=3850183 2024-09-12T17:36:52.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.807+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~TID14SOUK5US.0 size=668883 2024-09-12T17:36:52.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.807+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=TID14SOUK5US tag=ORLFQKDQL212 type=write size=1717459 2024-09-12T17:36:52.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.808+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~KY5K2UPF8CVG.0 size=1048576 2024-09-12T17:36:52.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.808+0000 7fa80ca76780 1 < canceled part key=_multipart_BLGMV3S9AY24.2~KY5K2UPF8CVG.1 size=1048576 2024-09-12T17:36:52.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.809+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~KY5K2UPF8CVG.2 size=611145 2024-09-12T17:36:52.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.811+0000 7fa80ca76780 1 < canceled multipart upload key=BLGMV3S9AY24 upload=KY5K2UPF8CVG tag=U6MUMA0AS535 type=write size=3756873 2024-09-12T17:36:52.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.813+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~R6EPAOP9UAJ6.0 size=659691 2024-09-12T17:36:52.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.813+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=R6EPAOP9UAJ6 tag=UUI974Y71T81 type=write size=1708267 2024-09-12T17:36:52.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.814+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~FUQB591VFQT0.0 size=1048576 2024-09-12T17:36:52.816 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.815+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~FUQB591VFQT0.1 size=1048576 2024-09-12T17:36:52.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.816+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~FUQB591VFQT0.2 size=743119 2024-09-12T17:36:52.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.818+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=FUQB591VFQT0 tag=7LD50YJ4LWAH type=write size=3888847 2024-09-12T17:36:52.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.820+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~YFN2M1IAYDRC.0 size=690651 2024-09-12T17:36:52.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.820+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=YFN2M1IAYDRC tag=KFM8807Y9WY7 type=write size=1739227 2024-09-12T17:36:52.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.822+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=A0RFJV3AKJMH type=del 2024-09-12T17:36:52.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.824+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~7HLEKN2BL1XS.0 size=813489 2024-09-12T17:36:52.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.824+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=7HLEKN2BL1XS tag=20JJDAKHZTSF type=write size=1862065 2024-09-12T17:36:52.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.825+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~7MS6UJADRTTV.0 size=1048576 2024-09-12T17:36:52.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.827+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~7MS6UJADRTTV.1 size=890515 2024-09-12T17:36:52.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.830+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=7MS6UJADRTTV tag=OGXW85BMJX87 type=write size=2987667 2024-09-12T17:36:52.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.831+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=O4LQST01UONO type=del size=350758 2024-09-12T17:36:52.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.832+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~BXOX0EDJNPC3.0 size=1048576 2024-09-12T17:36:52.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.833+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~BXOX0EDJNPC3.1 size=1048576 2024-09-12T17:36:52.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.834+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~BXOX0EDJNPC3.2 size=459037 2024-09-12T17:36:52.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.836+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=BXOX0EDJNPC3 tag=OR8Y82YN6BYO type=write size=3604765 2024-09-12T17:36:52.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.838+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=3FPUFEVOD2JF type=del size=3597737 2024-09-12T17:36:52.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.839+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=N7MSBZ0AE44Q type=del 2024-09-12T17:36:52.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.840+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=PO23718W8WMG type=write size=488878 2024-09-12T17:36:52.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.841+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~FPRHSIF3BO1V.0 size=673089 2024-09-12T17:36:52.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.843+0000 7fa80ca76780 1 < completed multipart upload key=U8O04HYQZRJC upload=FPRHSIF3BO1V tag=1H40TD8M4G1E type=write size=1721665 2024-09-12T17:36:52.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.844+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=VEJ3KRMNS3O0 type=del size=2133686 2024-09-12T17:36:52.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.847+0000 7fa80ca76780 1 < suggested update operation key=Z81704G91EPL tag=Z19KMF6YSQNF type=del size=2564582 2024-09-12T17:36:52.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.848+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=YJ01W28X6JGM type=del size=1623117 2024-09-12T17:36:52.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.849+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~8G865Y3GITM7.0 size=1048576 2024-09-12T17:36:52.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.850+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~8G865Y3GITM7.1 size=61547 2024-09-12T17:36:52.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.852+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=8G865Y3GITM7 tag=L5RN33OOJ3ZB type=write size=2158699 2024-09-12T17:36:52.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.853+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=DLPCIZM0PC9X type=del size=3071998 2024-09-12T17:36:52.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.854+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=21R2O8TZC18K type=del 2024-09-12T17:36:52.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.855+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=E9SIW4DR6E38 type=del size=666555 2024-09-12T17:36:52.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.857+0000 7fa80ca76780 1 < completed delete operation key=07LPSZT2RKCC tag=1FD28DGGP6H3 type=del 2024-09-12T17:36:52.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.858+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=M9OFC71HM8C6 type=del size=2257380 2024-09-12T17:36:52.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.859+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~02Y595CVUJ0F.0 size=1048576 2024-09-12T17:36:52.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.859+0000 7fa80ca76780 1 < canceled part key=_multipart_94801LE91HZ9.2~02Y595CVUJ0F.1 size=1048576 2024-09-12T17:36:52.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.860+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~02Y595CVUJ0F.2 size=16738 2024-09-12T17:36:52.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.862+0000 7fa80ca76780 1 < canceled multipart upload key=94801LE91HZ9 upload=02Y595CVUJ0F tag=87ELA0J1KPYC type=write size=3162466 2024-09-12T17:36:52.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.864+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~I3W4SH8X3R21.0 size=1048576 2024-09-12T17:36:52.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.865+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~I3W4SH8X3R21.1 size=1048576 2024-09-12T17:36:52.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.866+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~I3W4SH8X3R21.2 size=342261 2024-09-12T17:36:52.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.866+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=I3W4SH8X3R21 tag=D1U31A2AQKOK type=write size=3487989 2024-09-12T17:36:52.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.867+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~PKYQNJ7B7PKC.0 size=977472 2024-09-12T17:36:52.870 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.869+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=PKYQNJ7B7PKC tag=AJVE97GBMD3D type=write size=2026048 2024-09-12T17:36:52.871 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.870+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=UHEXX0VZ4I6Y type=del size=1673702 2024-09-12T17:36:52.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.871+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~RN0J889D6SNQ.0 size=1048576 2024-09-12T17:36:52.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.872+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~RN0J889D6SNQ.1 size=1048576 2024-09-12T17:36:52.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.873+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~RN0J889D6SNQ.2 size=1024419 2024-09-12T17:36:52.876 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.875+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=RN0J889D6SNQ tag=O8RTHCDF6CIZ type=write size=4170147 2024-09-12T17:36:52.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.876+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=BEODOO7CLKKD type=del size=3614363 2024-09-12T17:36:52.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.877+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=90LJHDVY3H3N type=del 2024-09-12T17:36:52.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.878+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=P2UTFFXVM58R type=del size=468477 2024-09-12T17:36:52.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.879+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~TID14SOUK5US.0 size=668883 2024-09-12T17:36:52.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.881+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=TID14SOUK5US tag=ORLFQKDQL212 type=write size=1717459 2024-09-12T17:36:52.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.883+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~NQDG7ASTQCJP.0 size=1048576 2024-09-12T17:36:52.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.885+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~NQDG7ASTQCJP.1 size=826151 2024-09-12T17:36:52.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.885+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=NQDG7ASTQCJP tag=S2AKDUAK5SFM type=write size=2923303 2024-09-12T17:36:52.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.885+0000 7fa80ca76780 1 < canceled part key=_multipart_H87S6AI6JT6D.2~R6EPAOP9UAJ6.0 size=659691 2024-09-12T17:36:52.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.887+0000 7fa80ca76780 1 < canceled multipart upload key=H87S6AI6JT6D upload=R6EPAOP9UAJ6 tag=UUI974Y71T81 type=write size=1708267 2024-09-12T17:36:52.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.889+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~NM5QYOB3EXJM.0 size=704269 2024-09-12T17:36:52.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.889+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=NM5QYOB3EXJM tag=B2BLGJU98775 type=write size=1752845 2024-09-12T17:36:52.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.890+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~YFN2M1IAYDRC.0 size=690651 2024-09-12T17:36:52.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.892+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=YFN2M1IAYDRC tag=KFM8807Y9WY7 type=write size=1739227 2024-09-12T17:36:52.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.894+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=42T19N2KZ0YL type=del size=3394128 2024-09-12T17:36:52.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.894+0000 7fa80ca76780 1 < canceled part key=_multipart_R871XU2TDWID.2~7HLEKN2BL1XS.0 size=813489 2024-09-12T17:36:52.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.896+0000 7fa80ca76780 1 < canceled multipart upload key=R871XU2TDWID upload=7HLEKN2BL1XS tag=20JJDAKHZTSF type=write size=1862065 2024-09-12T17:36:52.899 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.898+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~0DXUER4BZV10.0 size=1048576 2024-09-12T17:36:52.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.899+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~0DXUER4BZV10.1 size=715604 2024-09-12T17:36:52.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.899+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=0DXUER4BZV10 tag=WXP94AMA0FF4 type=write size=2812756 2024-09-12T17:36:52.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.900+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=O4LQST01UONO type=del 2024-09-12T17:36:52.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.902+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~CZDSLRHTR10X.0 size=1048576 2024-09-12T17:36:52.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.903+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~CZDSLRHTR10X.1 size=49598 2024-09-12T17:36:52.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.903+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=CZDSLRHTR10X tag=DU6PCPLA4JJO type=write size=2146750 2024-09-12T17:36:52.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.904+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=3FPUFEVOD2JF type=del 2024-09-12T17:36:52.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.905+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=IX23PIVFWIYK type=del size=4191072 2024-09-12T17:36:52.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.907+0000 7fa80ca76780 1 < suggested remove operation key=07LPSZT2RKCC tag=PO23718W8WMG type=write 2024-09-12T17:36:52.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.909+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~50ZEG3OWOD9I.0 size=1048576 2024-09-12T17:36:52.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.910+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~50ZEG3OWOD9I.1 size=800563 2024-09-12T17:36:52.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.910+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=50ZEG3OWOD9I tag=3SUR34FVM5CA type=write size=2897715 2024-09-12T17:36:52.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.911+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=VEJ3KRMNS3O0 type=del 2024-09-12T17:36:52.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.913+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~PWRUCR6E8ECE.0 size=280576 2024-09-12T17:36:52.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.913+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=PWRUCR6E8ECE tag=Q1BNB0L4MSF4 type=write size=1329152 2024-09-12T17:36:52.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.914+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=YJ01W28X6JGM type=del 2024-09-12T17:36:52.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.915+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=DT72R7845YEM type=del size=2164941 2024-09-12T17:36:52.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.918+0000 7fa80ca76780 1 < suggested update operation key=OJPZAWR5BLBN tag=DLPCIZM0PC9X type=del size=3071998 2024-09-12T17:36:52.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.919+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=4VSMAKAS11OU type=del size=3501760 2024-09-12T17:36:52.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.920+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=E9SIW4DR6E38 type=del 2024-09-12T17:36:52.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.921+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=2GAWLUGMV51G type=del size=1141259 2024-09-12T17:36:52.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.923+0000 7fa80ca76780 1 < suggested remove operation key=VC1X03K12V80 tag=M9OFC71HM8C6 type=del 2024-09-12T17:36:52.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.925+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~3SZYMUPXHDVE.0 size=557536 2024-09-12T17:36:52.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.925+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=3SZYMUPXHDVE tag=1DDAAW1KDA7Q type=write size=1606112 2024-09-12T17:36:52.927 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.926+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~I3W4SH8X3R21.0 size=1048576 2024-09-12T17:36:52.928 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.927+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~I3W4SH8X3R21.1 size=1048576 2024-09-12T17:36:52.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.928+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~I3W4SH8X3R21.2 size=342261 2024-09-12T17:36:52.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.930+0000 7fa80ca76780 1 < completed multipart upload key=U8O04HYQZRJC upload=I3W4SH8X3R21 tag=D1U31A2AQKOK type=write size=3487989 2024-09-12T17:36:52.932 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.931+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=VZ189FVAKVSD type=write size=972042 2024-09-12T17:36:52.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.933+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=UHEXX0VZ4I6Y type=del 2024-09-12T17:36:52.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.934+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=ZETBOYOBBDFL type=del size=1332037 2024-09-12T17:36:52.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.934+0000 7fa80ca76780 -1 < no bi entry to suggest for operation key=07LPSZT2RKCC tag=BEODOO7CLKKD type=del size=3614363: (2) No such file or directory 2024-09-12T17:36:52.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.936+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~K0P64LHN4Z5N.0 size=46835 2024-09-12T17:36:52.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.936+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=K0P64LHN4Z5N tag=YHR954SKIQI3 type=write size=1095411 2024-09-12T17:36:52.938 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.937+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=P2UTFFXVM58R type=del 2024-09-12T17:36:52.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.938+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=29I5F0AIETFY type=del size=3412564 2024-09-12T17:36:52.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.940+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~NQDG7ASTQCJP.0 size=1048576 2024-09-12T17:36:52.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.941+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~NQDG7ASTQCJP.1 size=826151 2024-09-12T17:36:52.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.943+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=NQDG7ASTQCJP tag=S2AKDUAK5SFM type=write size=2923303 2024-09-12T17:36:52.945 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.944+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=UQE2JABSV74L type=write size=60590 2024-09-12T17:36:52.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.946+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~NM5QYOB3EXJM.0 size=704269 2024-09-12T17:36:52.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.947+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=NM5QYOB3EXJM tag=B2BLGJU98775 type=write size=1752845 2024-09-12T17:36:52.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.949+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=QZZPI4NRSV6V type=write size=152429 2024-09-12T17:36:52.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.950+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=42T19N2KZ0YL type=del 2024-09-12T17:36:52.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.952+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~T7OGESG6YHKA.0 size=1048576 2024-09-12T17:36:52.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.953+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~T7OGESG6YHKA.1 size=1048576 2024-09-12T17:36:52.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.954+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~T7OGESG6YHKA.2 size=65208 2024-09-12T17:36:52.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.954+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=T7OGESG6YHKA tag=KJ0WXKGP5ST6 type=write size=3210936 2024-09-12T17:36:52.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.955+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~0DXUER4BZV10.0 size=1048576 2024-09-12T17:36:52.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.956+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~0DXUER4BZV10.1 size=715604 2024-09-12T17:36:52.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.958+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=0DXUER4BZV10 tag=WXP94AMA0FF4 type=write size=2812756 2024-09-12T17:36:52.960 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.959+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=95P0Y2362L49 type=del size=906743 2024-09-12T17:36:52.963 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.961+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~CZDSLRHTR10X.0 size=1048576 2024-09-12T17:36:52.963 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.962+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~CZDSLRHTR10X.1 size=49598 2024-09-12T17:36:52.966 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.965+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=CZDSLRHTR10X tag=DU6PCPLA4JJO type=write size=2146750 2024-09-12T17:36:52.968 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.967+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~KBDU3FXVCRCZ.0 size=1048576 2024-09-12T17:36:52.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.968+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~KBDU3FXVCRCZ.1 size=1048576 2024-09-12T17:36:52.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.969+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~KBDU3FXVCRCZ.2 size=276161 2024-09-12T17:36:52.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.969+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=KBDU3FXVCRCZ tag=L3YOABP6M3KI type=write size=3421889 2024-09-12T17:36:52.971 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.970+0000 7fa80ca76780 1 < canceled operation key=FKK4IGD1436I tag=IX23PIVFWIYK type=del size=4191072 2024-09-12T17:36:52.974 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.973+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~SD4YURC1304B.0 size=1048576 2024-09-12T17:36:52.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.974+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~SD4YURC1304B.1 size=194661 2024-09-12T17:36:52.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.974+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=SD4YURC1304B tag=LZ7KZQYTNUOQ type=write size=2291813 2024-09-12T17:36:52.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.975+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~50ZEG3OWOD9I.0 size=1048576 2024-09-12T17:36:52.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.976+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~50ZEG3OWOD9I.1 size=800563 2024-09-12T17:36:52.979 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.978+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=50ZEG3OWOD9I tag=3SUR34FVM5CA type=write size=2897715 2024-09-12T17:36:52.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.979+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=L9BS3709CKJB type=write size=472311 2024-09-12T17:36:52.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.980+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~PWRUCR6E8ECE.0 size=280576 2024-09-12T17:36:52.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.982+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=PWRUCR6E8ECE tag=Q1BNB0L4MSF4 type=write size=1329152 2024-09-12T17:36:52.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.983+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=W5S8L1JGAM2V type=del size=3267182 2024-09-12T17:36:52.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.984+0000 7fa80ca76780 -1 < failed to complete operation key=VC1X03K12V80 tag=DT72R7845YEM type=del size=2164941: (22) Invalid argument 2024-09-12T17:36:52.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.985+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=TXWSBD1P3HR0 type=del size=1566711 2024-09-12T17:36:52.988 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.987+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=4VSMAKAS11OU type=del 2024-09-12T17:36:52.990 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.989+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~OQW10GIJTIGX.0 size=1048576 2024-09-12T17:36:52.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.990+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~OQW10GIJTIGX.1 size=1048576 2024-09-12T17:36:52.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.991+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~OQW10GIJTIGX.2 size=424510 2024-09-12T17:36:52.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.991+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=OQW10GIJTIGX tag=J7P2ZUEAXBN3 type=write size=3570238 2024-09-12T17:36:52.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.992+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=2GAWLUGMV51G type=del 2024-09-12T17:36:52.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.995+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~MRVNZ1931Y8S.0 size=1048576 2024-09-12T17:36:52.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.996+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~MRVNZ1931Y8S.1 size=1048576 2024-09-12T17:36:52.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.997+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~MRVNZ1931Y8S.2 size=439984 2024-09-12T17:36:52.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.997+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=MRVNZ1931Y8S tag=9XQHCJWM1J43 type=write size=3585712 2024-09-12T17:36:52.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:52.998+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~3SZYMUPXHDVE.0 size=557536 2024-09-12T17:36:53.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.000+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=3SZYMUPXHDVE tag=1DDAAW1KDA7Q type=write size=1606112 2024-09-12T17:36:53.003 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.002+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~ERL8FWR8RABJ.0 size=1048576 2024-09-12T17:36:53.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.003+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~ERL8FWR8RABJ.1 size=1048576 2024-09-12T17:36:53.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.004+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~ERL8FWR8RABJ.2 size=381761 2024-09-12T17:36:53.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.004+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=ERL8FWR8RABJ tag=Q6EABTQJ38LF type=write size=3527489 2024-09-12T17:36:53.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.005+0000 7fa80ca76780 1 < completed write operation key=EDRL3T2I9AOO tag=VZ189FVAKVSD type=write size=972042 2024-09-12T17:36:53.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.007+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~N3KGA3EG6UIS.0 size=1048576 2024-09-12T17:36:53.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.008+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~N3KGA3EG6UIS.1 size=1048576 2024-09-12T17:36:53.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.009+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~N3KGA3EG6UIS.2 size=778511 2024-09-12T17:36:53.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.009+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=N3KGA3EG6UIS tag=BSGZQ6M1S769 type=write size=3924239 2024-09-12T17:36:53.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.011+0000 7fa80ca76780 1 < suggested update operation key=WGL9JYJXSHBH tag=ZETBOYOBBDFL type=del size=1332037 2024-09-12T17:36:53.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.012+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=LM8K0C1PLVAQ type=del size=31394 2024-09-12T17:36:53.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.013+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~K0P64LHN4Z5N.0 size=46835 2024-09-12T17:36:53.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.015+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=K0P64LHN4Z5N tag=YHR954SKIQI3 type=write size=1095411 2024-09-12T17:36:53.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.017+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~X95DUKU99TWN.0 size=7869 2024-09-12T17:36:53.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.017+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=X95DUKU99TWN tag=Y6G3X207VJ3J type=write size=1056445 2024-09-12T17:36:53.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.018+0000 7fa80ca76780 1 < canceled operation key=2AGKLZ3PQ2FD tag=29I5F0AIETFY type=del size=3412564 2024-09-12T17:36:53.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.021+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~H06VUL0UAJEQ.0 size=1048576 2024-09-12T17:36:53.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.021+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~H06VUL0UAJEQ.1 size=1048576 2024-09-12T17:36:53.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.022+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~H06VUL0UAJEQ.2 size=184628 2024-09-12T17:36:53.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.022+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=H06VUL0UAJEQ tag=NY8ZFV7EEQ17 type=write size=3330356 2024-09-12T17:36:53.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.023+0000 7fa80ca76780 1 < canceled operation key=0U9KSMYWT2C3 tag=UQE2JABSV74L type=write size=60590 2024-09-12T17:36:53.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.024+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=12CBQ4VS8XI6 type=del size=2524689 2024-09-12T17:36:53.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.025+0000 7fa80ca76780 1 < completed write operation key=VC1X03K12V80 tag=QZZPI4NRSV6V type=write size=152429 2024-09-12T17:36:53.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.027+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=0KRO70XHNK8Y type=del size=295896 2024-09-12T17:36:53.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.028+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~T7OGESG6YHKA.0 size=1048576 2024-09-12T17:36:53.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.029+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~T7OGESG6YHKA.1 size=1048576 2024-09-12T17:36:53.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.030+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~T7OGESG6YHKA.2 size=65208 2024-09-12T17:36:53.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.032+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=T7OGESG6YHKA tag=KJ0WXKGP5ST6 type=write size=3210936 2024-09-12T17:36:53.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.034+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~NV0P5UJB46TX.0 size=1048576 2024-09-12T17:36:53.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.035+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~NV0P5UJB46TX.1 size=1048576 2024-09-12T17:36:53.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.036+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~NV0P5UJB46TX.2 size=802737 2024-09-12T17:36:53.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.036+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=NV0P5UJB46TX tag=9480GVD1QOJH type=write size=3948465 2024-09-12T17:36:53.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.037+0000 7fa80ca76780 -1 < failed to complete operation key=WGL9JYJXSHBH tag=95P0Y2362L49 type=del size=906743: (22) Invalid argument 2024-09-12T17:36:53.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.039+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~UI3I3OHAD373.0 size=1048576 2024-09-12T17:36:53.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.040+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~UI3I3OHAD373.1 size=589430 2024-09-12T17:36:53.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.040+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=UI3I3OHAD373 tag=DT7WWV9UKQ1C type=write size=2686582 2024-09-12T17:36:53.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.041+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~KBDU3FXVCRCZ.0 size=1048576 2024-09-12T17:36:53.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.042+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~KBDU3FXVCRCZ.1 size=1048576 2024-09-12T17:36:53.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.043+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~KBDU3FXVCRCZ.2 size=276161 2024-09-12T17:36:53.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.045+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=KBDU3FXVCRCZ tag=L3YOABP6M3KI type=write size=3421889 2024-09-12T17:36:53.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.047+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~S9TBLV6WOJM2.0 size=522179 2024-09-12T17:36:53.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.047+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=S9TBLV6WOJM2 tag=4HM8KMAACATO type=write size=1570755 2024-09-12T17:36:53.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.049+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~SD4YURC1304B.0 size=1048576 2024-09-12T17:36:53.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.050+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~SD4YURC1304B.1 size=194661 2024-09-12T17:36:53.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.052+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=SD4YURC1304B tag=LZ7KZQYTNUOQ type=write size=2291813 2024-09-12T17:36:53.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.054+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~7RVHBPDJMG81.0 size=1048576 2024-09-12T17:36:53.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.055+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~7RVHBPDJMG81.1 size=329950 2024-09-12T17:36:53.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.055+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=7RVHBPDJMG81 tag=RVBZH0ZOEYBE type=write size=2427102 2024-09-12T17:36:53.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.056+0000 7fa80ca76780 1 < completed write operation key=2AGKLZ3PQ2FD tag=L9BS3709CKJB type=write size=472311 2024-09-12T17:36:53.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.059+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~R2XM7XLLI171.0 size=1048576 2024-09-12T17:36:53.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.060+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~R2XM7XLLI171.1 size=622417 2024-09-12T17:36:53.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.060+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=R2XM7XLLI171 tag=BNJZAXFT575T type=write size=2719569 2024-09-12T17:36:53.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.061+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=W5S8L1JGAM2V type=del 2024-09-12T17:36:53.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.062+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=19K9ZAI2XDAD type=del size=984402 2024-09-12T17:36:53.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.063+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=TXWSBD1P3HR0 type=del 2024-09-12T17:36:53.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.064+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=6A1U5H5218JX type=del size=2723634 2024-09-12T17:36:53.066 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.065+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~OQW10GIJTIGX.0 size=1048576 2024-09-12T17:36:53.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.066+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~OQW10GIJTIGX.1 size=1048576 2024-09-12T17:36:53.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.067+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~OQW10GIJTIGX.2 size=424510 2024-09-12T17:36:53.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.069+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=OQW10GIJTIGX tag=J7P2ZUEAXBN3 type=write size=3570238 2024-09-12T17:36:53.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.070+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=X2IPTDAWB5XR type=write size=72844 2024-09-12T17:36:53.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.072+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~MRVNZ1931Y8S.0 size=1048576 2024-09-12T17:36:53.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.072+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~MRVNZ1931Y8S.1 size=1048576 2024-09-12T17:36:53.074 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.073+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~MRVNZ1931Y8S.2 size=439984 2024-09-12T17:36:53.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.075+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=MRVNZ1931Y8S tag=9XQHCJWM1J43 type=write size=3585712 2024-09-12T17:36:53.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.078+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~YPVGJQM8DFJ5.0 size=1048576 2024-09-12T17:36:53.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.079+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~YPVGJQM8DFJ5.1 size=1048576 2024-09-12T17:36:53.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.080+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~YPVGJQM8DFJ5.2 size=404265 2024-09-12T17:36:53.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.080+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=YPVGJQM8DFJ5 tag=4NSLPSG3L6HN type=write size=3549993 2024-09-12T17:36:53.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.081+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~ERL8FWR8RABJ.0 size=1048576 2024-09-12T17:36:53.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.082+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~ERL8FWR8RABJ.1 size=1048576 2024-09-12T17:36:53.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.083+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~ERL8FWR8RABJ.2 size=381761 2024-09-12T17:36:53.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.086+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=ERL8FWR8RABJ tag=Q6EABTQJ38LF type=write size=3527489 2024-09-12T17:36:53.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.087+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=7B88NK3MIK96 type=del size=2717626 2024-09-12T17:36:53.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.088+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~N3KGA3EG6UIS.0 size=1048576 2024-09-12T17:36:53.091 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.089+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~N3KGA3EG6UIS.1 size=1048576 2024-09-12T17:36:53.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.090+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~N3KGA3EG6UIS.2 size=778511 2024-09-12T17:36:53.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.093+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=N3KGA3EG6UIS tag=BSGZQ6M1S769 type=write size=3924239 2024-09-12T17:36:53.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.094+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=KLUV7JPW03KJ type=del size=842303 2024-09-12T17:36:53.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.095+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=LM8K0C1PLVAQ type=del 2024-09-12T17:36:53.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.096+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=1D3PMZ8V03DA type=del size=1401787 2024-09-12T17:36:53.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.097+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~X95DUKU99TWN.0 size=7869 2024-09-12T17:36:53.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.099+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=X95DUKU99TWN tag=Y6G3X207VJ3J type=write size=1056445 2024-09-12T17:36:53.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.100+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=8Z2T5CMVACWT type=del size=2276296 2024-09-12T17:36:53.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.102+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~H06VUL0UAJEQ.0 size=1048576 2024-09-12T17:36:53.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.103+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~H06VUL0UAJEQ.1 size=1048576 2024-09-12T17:36:53.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.104+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~H06VUL0UAJEQ.2 size=184628 2024-09-12T17:36:53.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.106+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=H06VUL0UAJEQ tag=NY8ZFV7EEQ17 type=write size=3330356 2024-09-12T17:36:53.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.107+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=GKPTFRDNBQUL type=del size=2190813 2024-09-12T17:36:53.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.108+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=12CBQ4VS8XI6 type=del 2024-09-12T17:36:53.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.109+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=UHKV311EA1A5 type=write size=788089 2024-09-12T17:36:53.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.111+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=0KRO70XHNK8Y type=del 2024-09-12T17:36:53.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.112+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=VMWQN7AL54SB type=write size=308828 2024-09-12T17:36:53.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.112+0000 7fa80ca76780 1 < canceled part key=_multipart_EDRL3T2I9AOO.2~NV0P5UJB46TX.0 size=1048576 2024-09-12T17:36:53.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.113+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~NV0P5UJB46TX.1 size=1048576 2024-09-12T17:36:53.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.114+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~NV0P5UJB46TX.2 size=802737 2024-09-12T17:36:53.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.116+0000 7fa80ca76780 1 < canceled multipart upload key=EDRL3T2I9AOO upload=NV0P5UJB46TX tag=9480GVD1QOJH type=write size=3948465 2024-09-12T17:36:53.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.118+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~7Z76H2QFPSXN.0 size=1048576 2024-09-12T17:36:53.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.119+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~7Z76H2QFPSXN.1 size=1048576 2024-09-12T17:36:53.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.119+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~7Z76H2QFPSXN.2 size=1000907 2024-09-12T17:36:53.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.119+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=7Z76H2QFPSXN tag=HZQFBNWUWS06 type=write size=4146635 2024-09-12T17:36:53.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.120+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~UI3I3OHAD373.0 size=1048576 2024-09-12T17:36:53.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.121+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~UI3I3OHAD373.1 size=589430 2024-09-12T17:36:53.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.123+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=UI3I3OHAD373 tag=DT7WWV9UKQ1C type=write size=2686582 2024-09-12T17:36:53.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.124+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=PI0V3I3GSNYF type=del size=3329005 2024-09-12T17:36:53.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.126+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~S9TBLV6WOJM2.0 size=522179 2024-09-12T17:36:53.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.127+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=S9TBLV6WOJM2 tag=4HM8KMAACATO type=write size=1570755 2024-09-12T17:36:53.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.129+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=CJ4JGYJNIBSU type=del size=1519075 2024-09-12T17:36:53.131 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.130+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~7RVHBPDJMG81.0 size=1048576 2024-09-12T17:36:53.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.131+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~7RVHBPDJMG81.1 size=329950 2024-09-12T17:36:53.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.133+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=7RVHBPDJMG81 tag=RVBZH0ZOEYBE type=write size=2427102 2024-09-12T17:36:53.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.134+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=HCNJ947NE76M type=del size=3933920 2024-09-12T17:36:53.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.136+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~R2XM7XLLI171.0 size=1048576 2024-09-12T17:36:53.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.137+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~R2XM7XLLI171.1 size=622417 2024-09-12T17:36:53.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.139+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=R2XM7XLLI171 tag=BNJZAXFT575T type=write size=2719569 2024-09-12T17:36:53.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.140+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=IOQWGNGV9JOG type=write size=14865 2024-09-12T17:36:53.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.141+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=19K9ZAI2XDAD type=del 2024-09-12T17:36:53.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.143+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~TG2QVMJV5USH.0 size=161929 2024-09-12T17:36:53.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.143+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=TG2QVMJV5USH tag=9CWNMB3QZ8YY type=write size=1210505 2024-09-12T17:36:53.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.146+0000 7fa80ca76780 1 < suggested update operation key=FKK4IGD1436I tag=6A1U5H5218JX type=del size=2723634 2024-09-12T17:36:53.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.147+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=CE5QVSD8BX8P type=del size=4194249 2024-09-12T17:36:53.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.149+0000 7fa80ca76780 1 < completed write operation key=OJPZAWR5BLBN tag=X2IPTDAWB5XR type=write size=72844 2024-09-12T17:36:53.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.150+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=AS5AILXLK1A4 type=del size=3245744 2024-09-12T17:36:53.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.151+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~YPVGJQM8DFJ5.0 size=1048576 2024-09-12T17:36:53.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.152+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~YPVGJQM8DFJ5.1 size=1048576 2024-09-12T17:36:53.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.153+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~YPVGJQM8DFJ5.2 size=404265 2024-09-12T17:36:53.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.155+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=YPVGJQM8DFJ5 tag=4NSLPSG3L6HN type=write size=3549993 2024-09-12T17:36:53.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.157+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~HW2SJ6SRS8MW.0 size=1048576 2024-09-12T17:36:53.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.158+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~HW2SJ6SRS8MW.1 size=639158 2024-09-12T17:36:53.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.158+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=HW2SJ6SRS8MW tag=D7GIMLWAYIOK type=write size=2736310 2024-09-12T17:36:53.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.160+0000 7fa80ca76780 1 < suggested remove operation key=MSZUYX441Y66 tag=7B88NK3MIK96 type=del 2024-09-12T17:36:53.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.163+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~ASNYI2E49P6D.0 size=148778 2024-09-12T17:36:53.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.163+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=ASNYI2E49P6D tag=BGA30SIJVRP9 type=write size=1197354 2024-09-12T17:36:53.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.164+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=KLUV7JPW03KJ type=del 2024-09-12T17:36:53.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.166+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~C6VO8HZ2D3CA.0 size=212954 2024-09-12T17:36:53.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.166+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=C6VO8HZ2D3CA tag=ZOG9QNDK5LQN type=write size=1261530 2024-09-12T17:36:53.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.168+0000 7fa80ca76780 1 < suggested remove operation key=VC1X03K12V80 tag=1D3PMZ8V03DA type=del 2024-09-12T17:36:53.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.170+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~A3LESVBV41LK.0 size=324752 2024-09-12T17:36:53.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.170+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=A3LESVBV41LK tag=PHAMJLYHP9D1 type=write size=1373328 2024-09-12T17:36:53.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.172+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=8Z2T5CMVACWT type=del 2024-09-12T17:36:53.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.174+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~H6K97MWYOWTI.0 size=459699 2024-09-12T17:36:53.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.174+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=H6K97MWYOWTI tag=TQA3E3MG2UB6 type=write size=1508275 2024-09-12T17:36:53.176 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.175+0000 7fa80ca76780 1 < canceled operation key=R871XU2TDWID tag=GKPTFRDNBQUL type=del size=2190813 2024-09-12T17:36:53.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.176+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=A2OLB3DRQJG9 type=del size=3124619 2024-09-12T17:36:53.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.179+0000 7fa80ca76780 1 < suggested remove operation key=H87S6AI6JT6D tag=UHKV311EA1A5 type=write 2024-09-12T17:36:53.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.181+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~7BEQ42L3MRY6.0 size=27181 2024-09-12T17:36:53.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.181+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=7BEQ42L3MRY6 tag=I6O2VOBQ7450 type=write size=1075757 2024-09-12T17:36:53.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.183+0000 7fa80ca76780 1 < suggested remove operation key=2AGKLZ3PQ2FD tag=VMWQN7AL54SB type=write 2024-09-12T17:36:53.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.184+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=1BLOL5R62MW0 type=del size=3361843 2024-09-12T17:36:53.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.185+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~7Z76H2QFPSXN.0 size=1048576 2024-09-12T17:36:53.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.186+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~7Z76H2QFPSXN.1 size=1048576 2024-09-12T17:36:53.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.187+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~7Z76H2QFPSXN.2 size=1000907 2024-09-12T17:36:53.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.190+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=7Z76H2QFPSXN tag=HZQFBNWUWS06 type=write size=4146635 2024-09-12T17:36:53.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.192+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~HY3YI335HVAF.0 size=1048576 2024-09-12T17:36:53.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.193+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~HY3YI335HVAF.1 size=18982 2024-09-12T17:36:53.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.193+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=HY3YI335HVAF tag=9K6H4383OXGF type=write size=2116134 2024-09-12T17:36:53.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.195+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=PI0V3I3GSNYF type=del 2024-09-12T17:36:53.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.197+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~E3HVNTQ827GX.0 size=1048576 2024-09-12T17:36:53.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.198+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~E3HVNTQ827GX.1 size=1048576 2024-09-12T17:36:53.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.199+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~E3HVNTQ827GX.2 size=13569 2024-09-12T17:36:53.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.199+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=E3HVNTQ827GX tag=68JBGBYEQFYP type=write size=3159297 2024-09-12T17:36:53.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.200+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=CJ4JGYJNIBSU type=del 2024-09-12T17:36:53.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.202+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~H0T389M9A31B.0 size=1048576 2024-09-12T17:36:53.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.203+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~H0T389M9A31B.1 size=1048576 2024-09-12T17:36:53.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.204+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~H0T389M9A31B.2 size=337708 2024-09-12T17:36:53.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.204+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=H0T389M9A31B tag=4A1WYVIQJ9A6 type=write size=3483436 2024-09-12T17:36:53.208 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.207+0000 7fa80ca76780 1 < suggested remove operation key=0U9KSMYWT2C3 tag=HCNJ947NE76M type=del 2024-09-12T17:36:53.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.208+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=SCFPPHR0B33Q type=del size=1551605 2024-09-12T17:36:53.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.210+0000 7fa80ca76780 1 < suggested remove operation key=WGL9JYJXSHBH tag=IOQWGNGV9JOG type=write 2024-09-12T17:36:53.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.211+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=A2P468RMB37Y type=del size=1704822 2024-09-12T17:36:53.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.212+0000 7fa80ca76780 1 < canceled part key=_multipart_FKK4IGD1436I.2~TG2QVMJV5USH.0 size=161929 2024-09-12T17:36:53.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.215+0000 7fa80ca76780 1 < canceled multipart upload key=FKK4IGD1436I upload=TG2QVMJV5USH tag=9CWNMB3QZ8YY type=write size=1210505 2024-09-12T17:36:53.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.216+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=XNIZDDL6LYYH type=del size=1955006 2024-09-12T17:36:53.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.217+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=CE5QVSD8BX8P type=del 2024-09-12T17:36:53.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.219+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~RLE7HVR5I2GE.0 size=152636 2024-09-12T17:36:53.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.219+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=RLE7HVR5I2GE tag=N6WBAAW93K3H type=write size=1201212 2024-09-12T17:36:53.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.221+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=AS5AILXLK1A4 type=del 2024-09-12T17:36:53.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.223+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~72Q125V3WXOH.0 size=899327 2024-09-12T17:36:53.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.223+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=72Q125V3WXOH tag=F56FYBOM51E9 type=write size=1947903 2024-09-12T17:36:53.225 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.224+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~HW2SJ6SRS8MW.0 size=1048576 2024-09-12T17:36:53.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.225+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~HW2SJ6SRS8MW.1 size=639158 2024-09-12T17:36:53.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.227+0000 7fa80ca76780 1 < completed multipart upload key=U8O04HYQZRJC upload=HW2SJ6SRS8MW tag=D7GIMLWAYIOK type=write size=2736310 2024-09-12T17:36:53.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.228+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=5VF0DOJXSJMF type=del size=2705783 2024-09-12T17:36:53.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.229+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~ASNYI2E49P6D.0 size=148778 2024-09-12T17:36:53.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.231+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=ASNYI2E49P6D tag=BGA30SIJVRP9 type=write size=1197354 2024-09-12T17:36:53.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.233+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=HJCYZ1MAFJ1Y type=write size=1025349 2024-09-12T17:36:53.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.234+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~C6VO8HZ2D3CA.0 size=212954 2024-09-12T17:36:53.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.236+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=C6VO8HZ2D3CA tag=ZOG9QNDK5LQN type=write size=1261530 2024-09-12T17:36:53.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.238+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~CYIP1OCNC3ES.0 size=878590 2024-09-12T17:36:53.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.238+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=CYIP1OCNC3ES tag=2S3W6QS0PLOR type=write size=1927166 2024-09-12T17:36:53.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.239+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~A3LESVBV41LK.0 size=324752 2024-09-12T17:36:53.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.241+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=A3LESVBV41LK tag=PHAMJLYHP9D1 type=write size=1373328 2024-09-12T17:36:53.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.242+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=4J9C0X8I1PHU type=write size=773359 2024-09-12T17:36:53.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.243+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~H6K97MWYOWTI.0 size=459699 2024-09-12T17:36:53.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.245+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=H6K97MWYOWTI tag=TQA3E3MG2UB6 type=write size=1508275 2024-09-12T17:36:53.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.246+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=OL2UTPUTP86S type=del size=2391154 2024-09-12T17:36:53.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.247+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=A2OLB3DRQJG9 type=del 2024-09-12T17:36:53.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.249+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~JUPAF1TULZER.0 size=1048576 2024-09-12T17:36:53.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.250+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~JUPAF1TULZER.1 size=452598 2024-09-12T17:36:53.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.250+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=JUPAF1TULZER tag=W8DCQILAQ8XL type=write size=2549750 2024-09-12T17:36:53.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.252+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~7BEQ42L3MRY6.0 size=27181 2024-09-12T17:36:53.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.254+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=7BEQ42L3MRY6 tag=I6O2VOBQ7450 type=write size=1075757 2024-09-12T17:36:53.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.256+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~TIH41CZ46J0N.0 size=1048576 2024-09-12T17:36:53.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.257+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~TIH41CZ46J0N.1 size=388182 2024-09-12T17:36:53.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.257+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=TIH41CZ46J0N tag=N6WPEH434TJN type=write size=2485334 2024-09-12T17:36:53.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.258+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=1BLOL5R62MW0 type=del 2024-09-12T17:36:53.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.260+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=IGUG7UKK7WH8 type=del size=1097260 2024-09-12T17:36:53.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.261+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~HY3YI335HVAF.0 size=1048576 2024-09-12T17:36:53.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.262+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~HY3YI335HVAF.1 size=18982 2024-09-12T17:36:53.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.264+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=HY3YI335HVAF tag=9K6H4383OXGF type=write size=2116134 2024-09-12T17:36:53.266 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.265+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=V7UZFMBL2550 type=del size=3850353 2024-09-12T17:36:53.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.266+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~E3HVNTQ827GX.0 size=1048576 2024-09-12T17:36:53.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.267+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~E3HVNTQ827GX.1 size=1048576 2024-09-12T17:36:53.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.268+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~E3HVNTQ827GX.2 size=13569 2024-09-12T17:36:53.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.271+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=E3HVNTQ827GX tag=68JBGBYEQFYP type=write size=3159297 2024-09-12T17:36:53.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.272+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=LW8MXEY48YPJ type=del size=2027526 2024-09-12T17:36:53.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.273+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~H0T389M9A31B.0 size=1048576 2024-09-12T17:36:53.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.273+0000 7fa80ca76780 1 < canceled part key=_multipart_U8O04HYQZRJC.2~H0T389M9A31B.1 size=1048576 2024-09-12T17:36:53.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.274+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~H0T389M9A31B.2 size=337708 2024-09-12T17:36:53.278 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.277+0000 7fa80ca76780 1 < canceled multipart upload key=U8O04HYQZRJC upload=H0T389M9A31B tag=4A1WYVIQJ9A6 type=write size=3483436 2024-09-12T17:36:53.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.278+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=7FCS9RJ5SWKD type=write size=22443 2024-09-12T17:36:53.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.279+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=SCFPPHR0B33Q type=del 2024-09-12T17:36:53.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.280+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=O9L26J81CGVJ type=del size=2332823 2024-09-12T17:36:53.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.282+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=A2P468RMB37Y type=del 2024-09-12T17:36:53.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.283+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=7K95RO71Y210 type=del size=2442744 2024-09-12T17:36:53.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.285+0000 7fa80ca76780 1 < suggested remove operation key=R871XU2TDWID tag=XNIZDDL6LYYH type=del 2024-09-12T17:36:53.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.286+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=F333HSNQ25IM type=del size=2095094 2024-09-12T17:36:53.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.288+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~RLE7HVR5I2GE.0 size=152636 2024-09-12T17:36:53.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.289+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=RLE7HVR5I2GE tag=N6WBAAW93K3H type=write size=1201212 2024-09-12T17:36:53.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.291+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=TB7OTRVG4PDM type=del size=2726477 2024-09-12T17:36:53.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.292+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~72Q125V3WXOH.0 size=899327 2024-09-12T17:36:53.295 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.294+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=72Q125V3WXOH tag=F56FYBOM51E9 type=write size=1947903 2024-09-12T17:36:53.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.296+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~N8IFGMKR2LXQ.0 size=1048576 2024-09-12T17:36:53.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.297+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~N8IFGMKR2LXQ.1 size=640556 2024-09-12T17:36:53.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.297+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=N8IFGMKR2LXQ tag=UAX456A2SE39 type=write size=2737708 2024-09-12T17:36:53.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.298+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=5VF0DOJXSJMF type=del 2024-09-12T17:36:53.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.300+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=05YXNV4HQZZI type=del size=3251738 2024-09-12T17:36:53.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.301+0000 7fa80ca76780 1 < completed write operation key=RC1IX4DQREEP tag=HJCYZ1MAFJ1Y type=write size=1025349 2024-09-12T17:36:53.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.302+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=NXRQ75NH2E8I type=del size=4073807 2024-09-12T17:36:53.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.303+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~CYIP1OCNC3ES.0 size=878590 2024-09-12T17:36:53.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.305+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=CYIP1OCNC3ES tag=2S3W6QS0PLOR type=write size=1927166 2024-09-12T17:36:53.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.306+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=ZUWXJJMGKRQN type=del size=1935922 2024-09-12T17:36:53.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.309+0000 7fa80ca76780 1 < suggested remove operation key=U8O04HYQZRJC tag=4J9C0X8I1PHU type=write 2024-09-12T17:36:53.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.310+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=JGX40ZUA8VL9 type=del size=1243179 2024-09-12T17:36:53.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.311+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=OL2UTPUTP86S type=del 2024-09-12T17:36:53.313 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.312+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=TCVP1EEBYHC3 type=write size=442795 2024-09-12T17:36:53.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.314+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~JUPAF1TULZER.0 size=1048576 2024-09-12T17:36:53.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.314+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~JUPAF1TULZER.1 size=452598 2024-09-12T17:36:53.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.316+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=JUPAF1TULZER tag=W8DCQILAQ8XL type=write size=2549750 2024-09-12T17:36:53.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.318+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=YTTFOVGYQC6Y type=del size=1083382 2024-09-12T17:36:53.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.319+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~TIH41CZ46J0N.0 size=1048576 2024-09-12T17:36:53.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.320+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~TIH41CZ46J0N.1 size=388182 2024-09-12T17:36:53.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.323+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=TIH41CZ46J0N tag=N6WPEH434TJN type=write size=2485334 2024-09-12T17:36:53.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.325+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=5PPIXKW8JWF2 type=del size=922561 2024-09-12T17:36:53.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.326+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=IGUG7UKK7WH8 type=del 2024-09-12T17:36:53.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.328+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=AD8AULY1G8OD type=del size=1437222 2024-09-12T17:36:53.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.331+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=V7UZFMBL2550 type=del 2024-09-12T17:36:53.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.332+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=6KNZVKSGGCRO type=del size=1801069 2024-09-12T17:36:53.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.334+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=LW8MXEY48YPJ type=del 2024-09-12T17:36:53.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.335+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=CFX1GX4910O0 type=del size=2872695 2024-09-12T17:36:53.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.336+0000 7fa80ca76780 1 < completed write operation key=5CAG55DQEF3Y tag=7FCS9RJ5SWKD type=write size=22443 2024-09-12T17:36:53.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.338+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~WHPSGU8MJ6TN.0 size=862436 2024-09-12T17:36:53.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.338+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=WHPSGU8MJ6TN tag=UDEPH9Y2DB8F type=write size=1911012 2024-09-12T17:36:53.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.339+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=O9L26J81CGVJ type=del 2024-09-12T17:36:53.342 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.341+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=H1F5FTVHD2JI type=del size=1931096 2024-09-12T17:36:53.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.342+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=7K95RO71Y210 type=del 2024-09-12T17:36:53.344 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.343+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=7BU4BG6R9KOE type=del size=48495 2024-09-12T17:36:53.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.344+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=F333HSNQ25IM type=del 2024-09-12T17:36:53.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.346+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~X4VO9N0ZGY2S.0 size=1048576 2024-09-12T17:36:53.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.347+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~X4VO9N0ZGY2S.1 size=119971 2024-09-12T17:36:53.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.347+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=X4VO9N0ZGY2S tag=B5ED5617IK96 type=write size=2217123 2024-09-12T17:36:53.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.348+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=TB7OTRVG4PDM type=del 2024-09-12T17:36:53.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.349+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=PJM6MFU38I3H type=del size=2679547 2024-09-12T17:36:53.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.350+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~N8IFGMKR2LXQ.0 size=1048576 2024-09-12T17:36:53.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.351+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~N8IFGMKR2LXQ.1 size=640556 2024-09-12T17:36:53.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.353+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=N8IFGMKR2LXQ tag=UAX456A2SE39 type=write size=2737708 2024-09-12T17:36:53.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.354+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=H4Q20N4U8OWK type=del size=1447290 2024-09-12T17:36:53.358 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.357+0000 7fa80ca76780 1 < suggested update operation key=2AGKLZ3PQ2FD tag=05YXNV4HQZZI type=del size=3251738 2024-09-12T17:36:53.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.359+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~4GPX648PQLVP.0 size=612810 2024-09-12T17:36:53.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.359+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=4GPX648PQLVP tag=O5G43HKIPUN7 type=write size=1661386 2024-09-12T17:36:53.361 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.360+0000 7fa80ca76780 -1 < failed to complete operation key=U8O04HYQZRJC tag=NXRQ75NH2E8I type=del size=4073807: (22) Invalid argument 2024-09-12T17:36:53.362 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.361+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=0Y0SM2FLSB8B type=write size=485893 2024-09-12T17:36:53.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.363+0000 7fa80ca76780 1 < suggested remove operation key=RC1IX4DQREEP tag=ZUWXJJMGKRQN type=del 2024-09-12T17:36:53.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.365+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=Z7OWPN6A07FH type=del size=79786 2024-09-12T17:36:53.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.366+0000 7fa80ca76780 -1 < failed to complete operation key=RC1IX4DQREEP tag=JGX40ZUA8VL9 type=del size=1243179: (22) Invalid argument 2024-09-12T17:36:53.369 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.368+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~4K2WLS59351N.0 size=1048576 2024-09-12T17:36:53.370 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.369+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~4K2WLS59351N.1 size=80769 2024-09-12T17:36:53.370 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.369+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=4K2WLS59351N tag=Z9OEZJ59A31H type=write size=2177921 2024-09-12T17:36:53.372 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.371+0000 7fa80ca76780 1 < suggested update operation key=0X3LGXL2QFRN tag=TCVP1EEBYHC3 type=write size=442795 2024-09-12T17:36:53.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.373+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~MHJCGPJWVKJ1.0 size=399782 2024-09-12T17:36:53.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.373+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=MHJCGPJWVKJ1 tag=W3MOLC324391 type=write size=1448358 2024-09-12T17:36:53.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.374+0000 7fa80ca76780 -1 < failed to complete operation key=2AGKLZ3PQ2FD tag=YTTFOVGYQC6Y type=del size=1083382: (22) Invalid argument 2024-09-12T17:36:53.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.375+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=AP3TJLW8JUU3 type=del size=3972739 2024-09-12T17:36:53.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.377+0000 7fa80ca76780 1 < canceled operation key=5CAG55DQEF3Y tag=5PPIXKW8JWF2 type=del size=922561 2024-09-12T17:36:53.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.378+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=ALDH546O7XI8 type=write size=709843 2024-09-12T17:36:53.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.379+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=AD8AULY1G8OD type=del 2024-09-12T17:36:53.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.381+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~NG3NK4LDGNJM.0 size=1048576 2024-09-12T17:36:53.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.382+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~NG3NK4LDGNJM.1 size=1048576 2024-09-12T17:36:53.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.383+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~NG3NK4LDGNJM.2 size=727098 2024-09-12T17:36:53.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.383+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=NG3NK4LDGNJM tag=X10HLRLN65L8 type=write size=3872826 2024-09-12T17:36:53.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.384+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=6KNZVKSGGCRO type=del 2024-09-12T17:36:53.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.385+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=X30G3VQ8T1C4 type=del size=2133823 2024-09-12T17:36:53.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.387+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=CFX1GX4910O0 type=del 2024-09-12T17:36:53.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.388+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=0JOACU3D4US4 type=del size=2061331 2024-09-12T17:36:53.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.389+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~WHPSGU8MJ6TN.0 size=862436 2024-09-12T17:36:53.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.391+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=WHPSGU8MJ6TN tag=UDEPH9Y2DB8F type=write size=1911012 2024-09-12T17:36:53.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.393+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~V3HKMK7Q2NR5.0 size=1048576 2024-09-12T17:36:53.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.394+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~V3HKMK7Q2NR5.1 size=1048576 2024-09-12T17:36:53.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.395+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~V3HKMK7Q2NR5.2 size=2911 2024-09-12T17:36:53.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.395+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=V3HKMK7Q2NR5 tag=GICYBCBYQJNT type=write size=3148639 2024-09-12T17:36:53.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.397+0000 7fa80ca76780 1 < suggested remove operation key=94801LE91HZ9 tag=H1F5FTVHD2JI type=del 2024-09-12T17:36:53.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.399+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~DLPPCPN8VFNZ.0 size=1048576 2024-09-12T17:36:53.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.400+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~DLPPCPN8VFNZ.1 size=1048576 2024-09-12T17:36:53.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.401+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~DLPPCPN8VFNZ.2 size=321407 2024-09-12T17:36:53.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.401+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=DLPPCPN8VFNZ tag=QP3T26FXZYLX type=write size=3467135 2024-09-12T17:36:53.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.402+0000 7fa80ca76780 1 < canceled operation key=MSZUYX441Y66 tag=7BU4BG6R9KOE type=del size=48495 2024-09-12T17:36:53.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.403+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=8U6OBHDXG7DV type=del size=2671820 2024-09-12T17:36:53.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.405+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~X4VO9N0ZGY2S.0 size=1048576 2024-09-12T17:36:53.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.405+0000 7fa80ca76780 1 < canceled part key=_multipart_E25BUY271ZSI.2~X4VO9N0ZGY2S.1 size=119971 2024-09-12T17:36:53.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.407+0000 7fa80ca76780 1 < canceled multipart upload key=E25BUY271ZSI upload=X4VO9N0ZGY2S tag=B5ED5617IK96 type=write size=2217123 2024-09-12T17:36:53.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.409+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~NSQIBW4WHIQI.0 size=56721 2024-09-12T17:36:53.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.409+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=NSQIBW4WHIQI tag=EO5DGNUF1I5E type=write size=1105297 2024-09-12T17:36:53.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.410+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=PJM6MFU38I3H type=del 2024-09-12T17:36:53.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.412+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~GDR3FSW5634B.0 size=1048576 2024-09-12T17:36:53.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.413+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~GDR3FSW5634B.1 size=1048576 2024-09-12T17:36:53.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.414+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~GDR3FSW5634B.2 size=583371 2024-09-12T17:36:53.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.414+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=GDR3FSW5634B tag=L65JVTAOX2KA type=write size=3729099 2024-09-12T17:36:53.416 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.415+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=H4Q20N4U8OWK type=del 2024-09-12T17:36:53.418 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.417+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~Z3MODTHNFESV.0 size=1048576 2024-09-12T17:36:53.419 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.418+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~Z3MODTHNFESV.1 size=1048576 2024-09-12T17:36:53.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.419+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~Z3MODTHNFESV.2 size=993476 2024-09-12T17:36:53.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.419+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=Z3MODTHNFESV tag=71MN06L9I61D type=write size=4139204 2024-09-12T17:36:53.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.420+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~4GPX648PQLVP.0 size=612810 2024-09-12T17:36:53.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.422+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=4GPX648PQLVP tag=O5G43HKIPUN7 type=write size=1661386 2024-09-12T17:36:53.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.424+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~2AKHY85OWLWE.0 size=235304 2024-09-12T17:36:53.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.424+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=2AKHY85OWLWE tag=ZEKNFEGVXD8O type=write size=1283880 2024-09-12T17:36:53.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.425+0000 7fa80ca76780 1 < completed write operation key=2AGKLZ3PQ2FD tag=0Y0SM2FLSB8B type=write size=485893 2024-09-12T17:36:53.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.428+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~IU2FJT7IBFAF.0 size=1048576 2024-09-12T17:36:53.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.428+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~IU2FJT7IBFAF.1 size=436114 2024-09-12T17:36:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.428+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=IU2FJT7IBFAF tag=E8WD9ONDE46O type=write size=2533266 2024-09-12T17:36:53.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.431+0000 7fa80ca76780 1 < suggested remove operation key=VDD4PDR1GLWQ tag=Z7OWPN6A07FH type=del 2024-09-12T17:36:53.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.432+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=5JFAM00GFG1H type=del size=2224247 2024-09-12T17:36:53.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.433+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~4K2WLS59351N.0 size=1048576 2024-09-12T17:36:53.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.435+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~4K2WLS59351N.1 size=80769 2024-09-12T17:36:53.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.437+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=4K2WLS59351N tag=Z9OEZJ59A31H type=write size=2177921 2024-09-12T17:36:53.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.440+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~LKC3MGEWI4I7.0 size=1048576 2024-09-12T17:36:53.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.443+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~LKC3MGEWI4I7.1 size=1048576 2024-09-12T17:36:53.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.446+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~LKC3MGEWI4I7.2 size=736322 2024-09-12T17:36:53.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.446+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=LKC3MGEWI4I7 tag=D59B2Z5DUWDL type=write size=3882050 2024-09-12T17:36:53.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.447+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~MHJCGPJWVKJ1.0 size=399782 2024-09-12T17:36:53.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.449+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=MHJCGPJWVKJ1 tag=W3MOLC324391 type=write size=1448358 2024-09-12T17:36:53.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.451+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~L0Q6OEXT8SUN.0 size=1048576 2024-09-12T17:36:53.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.452+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~L0Q6OEXT8SUN.1 size=1048576 2024-09-12T17:36:53.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.453+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~L0Q6OEXT8SUN.2 size=86493 2024-09-12T17:36:53.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.453+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=L0Q6OEXT8SUN tag=5F7ASVK2WJOG type=write size=3232221 2024-09-12T17:36:53.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.455+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=AP3TJLW8JUU3 type=del 2024-09-12T17:36:53.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.457+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~81AL8ZC0B4PL.0 size=1048576 2024-09-12T17:36:53.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.458+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~81AL8ZC0B4PL.1 size=1048576 2024-09-12T17:36:53.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.459+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~81AL8ZC0B4PL.2 size=766487 2024-09-12T17:36:53.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.459+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=81AL8ZC0B4PL tag=NMFWORIGZ1UB type=write size=3912215 2024-09-12T17:36:53.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.460+0000 7fa80ca76780 1 < canceled operation key=5CAG55DQEF3Y tag=ALDH546O7XI8 type=write size=709843 2024-09-12T17:36:53.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.461+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=4HA96DQAENCR type=del size=2850269 2024-09-12T17:36:53.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.462+0000 7fa80ca76780 1 < canceled part key=_multipart_R871XU2TDWID.2~NG3NK4LDGNJM.0 size=1048576 2024-09-12T17:36:53.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.463+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~NG3NK4LDGNJM.1 size=1048576 2024-09-12T17:36:53.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.464+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~NG3NK4LDGNJM.2 size=727098 2024-09-12T17:36:53.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.466+0000 7fa80ca76780 1 < canceled multipart upload key=R871XU2TDWID upload=NG3NK4LDGNJM tag=X10HLRLN65L8 type=write size=3872826 2024-09-12T17:36:53.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.468+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~R3LPMBQFT5XK.0 size=212061 2024-09-12T17:36:53.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.468+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=R3LPMBQFT5XK tag=3X1V0AE40VHU type=write size=1260637 2024-09-12T17:36:53.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.469+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=X30G3VQ8T1C4 type=del 2024-09-12T17:36:53.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.470+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=NQF7ZFOTLVX2 type=del size=2433728 2024-09-12T17:36:53.473 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.472+0000 7fa80ca76780 1 < suggested update operation key=OJPZAWR5BLBN tag=0JOACU3D4US4 type=del size=2061331 2024-09-12T17:36:53.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.473+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=DF10O50LRX45 type=del size=3321694 2024-09-12T17:36:53.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.475+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~V3HKMK7Q2NR5.0 size=1048576 2024-09-12T17:36:53.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.476+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~V3HKMK7Q2NR5.1 size=1048576 2024-09-12T17:36:53.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.477+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~V3HKMK7Q2NR5.2 size=2911 2024-09-12T17:36:53.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.478+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=V3HKMK7Q2NR5 tag=GICYBCBYQJNT type=write size=3148639 2024-09-12T17:36:53.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.480+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=G2Z2WWP85CR6 type=del size=1693685 2024-09-12T17:36:53.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.481+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~DLPPCPN8VFNZ.0 size=1048576 2024-09-12T17:36:53.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.482+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~DLPPCPN8VFNZ.1 size=1048576 2024-09-12T17:36:53.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.483+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~DLPPCPN8VFNZ.2 size=321407 2024-09-12T17:36:53.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.485+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=DLPPCPN8VFNZ tag=QP3T26FXZYLX type=write size=3467135 2024-09-12T17:36:53.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.487+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~5HS5KEXQD8OR.0 size=840806 2024-09-12T17:36:53.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.487+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=5HS5KEXQD8OR tag=JI6RSSCGX18H type=write size=1889382 2024-09-12T17:36:53.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.489+0000 7fa80ca76780 1 < suggested update operation key=4S33294MWCO1 tag=8U6OBHDXG7DV type=del size=2671820 2024-09-12T17:36:53.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.492+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~96G3UYMSJMUM.0 size=1048576 2024-09-12T17:36:53.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.492+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~96G3UYMSJMUM.1 size=313838 2024-09-12T17:36:53.494 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.492+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=96G3UYMSJMUM tag=11F0CK3Q1VNX type=write size=2410990 2024-09-12T17:36:53.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.494+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~NSQIBW4WHIQI.0 size=56721 2024-09-12T17:36:53.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.496+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=NSQIBW4WHIQI tag=EO5DGNUF1I5E type=write size=1105297 2024-09-12T17:36:53.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.497+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=LXP08LQC7CTN type=del size=3720258 2024-09-12T17:36:53.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.498+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~GDR3FSW5634B.0 size=1048576 2024-09-12T17:36:53.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.499+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~GDR3FSW5634B.1 size=1048576 2024-09-12T17:36:53.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.500+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~GDR3FSW5634B.2 size=583371 2024-09-12T17:36:53.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.503+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=GDR3FSW5634B tag=L65JVTAOX2KA type=write size=3729099 2024-09-12T17:36:53.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.505+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~3Y2PS92PSYVN.0 size=1048576 2024-09-12T17:36:53.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.506+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~3Y2PS92PSYVN.1 size=682169 2024-09-12T17:36:53.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.506+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=3Y2PS92PSYVN tag=9Z1JEC64DLXB type=write size=2779321 2024-09-12T17:36:53.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.508+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~Z3MODTHNFESV.0 size=1048576 2024-09-12T17:36:53.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.508+0000 7fa80ca76780 1 < canceled part key=_multipart_54KWSI77T73A.2~Z3MODTHNFESV.1 size=1048576 2024-09-12T17:36:53.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.509+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~Z3MODTHNFESV.2 size=993476 2024-09-12T17:36:53.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.511+0000 7fa80ca76780 1 < canceled multipart upload key=54KWSI77T73A upload=Z3MODTHNFESV tag=71MN06L9I61D type=write size=4139204 2024-09-12T17:36:53.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.512+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=NDYXWMSP1354 type=del size=903265 2024-09-12T17:36:53.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.513+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~2AKHY85OWLWE.0 size=235304 2024-09-12T17:36:53.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.515+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=2AKHY85OWLWE tag=ZEKNFEGVXD8O type=write size=1283880 2024-09-12T17:36:53.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.517+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~WVA3AVAN1CH3.0 size=1048576 2024-09-12T17:36:53.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.518+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~WVA3AVAN1CH3.1 size=816661 2024-09-12T17:36:53.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.518+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=WVA3AVAN1CH3 tag=EPMBESPSGPBO type=write size=2913813 2024-09-12T17:36:53.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.519+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~IU2FJT7IBFAF.0 size=1048576 2024-09-12T17:36:53.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.520+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~IU2FJT7IBFAF.1 size=436114 2024-09-12T17:36:53.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.522+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=IU2FJT7IBFAF tag=E8WD9ONDE46O type=write size=2533266 2024-09-12T17:36:53.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.524+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~Y2XTH576DK7Q.0 size=1048576 2024-09-12T17:36:53.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.525+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~Y2XTH576DK7Q.1 size=1048576 2024-09-12T17:36:53.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.526+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~Y2XTH576DK7Q.2 size=419620 2024-09-12T17:36:53.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.526+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=Y2XTH576DK7Q tag=TQ110CMIYRIN type=write size=3565348 2024-09-12T17:36:53.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.527+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=5JFAM00GFG1H type=del 2024-09-12T17:36:53.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.528+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=ZNPG0431439F type=write size=295783 2024-09-12T17:36:53.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.529+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~LKC3MGEWI4I7.0 size=1048576 2024-09-12T17:36:53.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.529+0000 7fa80ca76780 1 < canceled part key=_multipart_VC1X03K12V80.2~LKC3MGEWI4I7.1 size=1048576 2024-09-12T17:36:53.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.530+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~LKC3MGEWI4I7.2 size=736322 2024-09-12T17:36:53.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.532+0000 7fa80ca76780 1 < canceled multipart upload key=VC1X03K12V80 upload=LKC3MGEWI4I7 tag=D59B2Z5DUWDL type=write size=3882050 2024-09-12T17:36:53.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.533+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=XHU6Z9L6GQ4H type=del size=1368940 2024-09-12T17:36:53.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.535+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~L0Q6OEXT8SUN.0 size=1048576 2024-09-12T17:36:53.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.536+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~L0Q6OEXT8SUN.1 size=1048576 2024-09-12T17:36:53.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.537+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~L0Q6OEXT8SUN.2 size=86493 2024-09-12T17:36:53.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.539+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=L0Q6OEXT8SUN tag=5F7ASVK2WJOG type=write size=3232221 2024-09-12T17:36:53.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.540+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=0QX0LRUED7NP type=del size=1663946 2024-09-12T17:36:53.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.541+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~81AL8ZC0B4PL.0 size=1048576 2024-09-12T17:36:53.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.541+0000 7fa80ca76780 1 < canceled part key=_multipart_WGL9JYJXSHBH.2~81AL8ZC0B4PL.1 size=1048576 2024-09-12T17:36:53.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.542+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~81AL8ZC0B4PL.2 size=766487 2024-09-12T17:36:53.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.544+0000 7fa80ca76780 1 < canceled multipart upload key=WGL9JYJXSHBH upload=81AL8ZC0B4PL tag=NMFWORIGZ1UB type=write size=3912215 2024-09-12T17:36:53.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.545+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=B79Q5BMDN6RR type=del size=3723673 2024-09-12T17:36:53.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.546+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=4HA96DQAENCR type=del 2024-09-12T17:36:53.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.548+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~GYXPCASU2XNQ.0 size=1048576 2024-09-12T17:36:53.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.549+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~GYXPCASU2XNQ.1 size=1048576 2024-09-12T17:36:53.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.550+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~GYXPCASU2XNQ.2 size=1044363 2024-09-12T17:36:53.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.550+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=GYXPCASU2XNQ tag=QYCX5KODF214 type=write size=4190091 2024-09-12T17:36:53.554 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.553+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~R3LPMBQFT5XK.0 size=212061 2024-09-12T17:36:53.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.555+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=R3LPMBQFT5XK tag=3X1V0AE40VHU type=write size=1260637 2024-09-12T17:36:53.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.557+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~KMUSO9YEWQLW.0 size=827204 2024-09-12T17:36:53.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.557+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=KMUSO9YEWQLW tag=KZ0HAHX2LGTA type=write size=1875780 2024-09-12T17:36:53.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.558+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=NQF7ZFOTLVX2 type=del 2024-09-12T17:36:53.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.562+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~6G7GCN9L3AYY.0 size=1048576 2024-09-12T17:36:53.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.563+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~6G7GCN9L3AYY.1 size=1048576 2024-09-12T17:36:53.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.564+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~6G7GCN9L3AYY.2 size=130051 2024-09-12T17:36:53.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.564+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=6G7GCN9L3AYY tag=B4UQKARMZC1O type=write size=3275779 2024-09-12T17:36:53.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.565+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=DF10O50LRX45 type=del 2024-09-12T17:36:53.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.566+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=V38DFLWO4YYJ type=del size=837961 2024-09-12T17:36:53.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.568+0000 7fa80ca76780 1 < suggested remove operation key=R871XU2TDWID tag=G2Z2WWP85CR6 type=del 2024-09-12T17:36:53.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.570+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=E9M6ZWQWW5TY type=del size=384325 2024-09-12T17:36:53.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.570+0000 7fa80ca76780 1 < canceled part key=_multipart_94801LE91HZ9.2~5HS5KEXQD8OR.0 size=840806 2024-09-12T17:36:53.574 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.573+0000 7fa80ca76780 1 < canceled multipart upload key=94801LE91HZ9 upload=5HS5KEXQD8OR tag=JI6RSSCGX18H type=write size=1889382 2024-09-12T17:36:53.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.575+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~5D0Y4K6EIK8Z.0 size=1048576 2024-09-12T17:36:53.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.576+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~5D0Y4K6EIK8Z.1 size=1048576 2024-09-12T17:36:53.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.577+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~5D0Y4K6EIK8Z.2 size=240671 2024-09-12T17:36:53.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.577+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=5D0Y4K6EIK8Z tag=FND8BIDEZEKY type=write size=3386399 2024-09-12T17:36:53.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.579+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~96G3UYMSJMUM.0 size=1048576 2024-09-12T17:36:53.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.580+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~96G3UYMSJMUM.1 size=313838 2024-09-12T17:36:53.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.582+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=96G3UYMSJMUM tag=11F0CK3Q1VNX type=write size=2410990 2024-09-12T17:36:53.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.583+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=LZ8ULLKYPTOV type=del size=211037 2024-09-12T17:36:53.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.584+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=LXP08LQC7CTN type=del 2024-09-12T17:36:53.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.585+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=R0XZAPMANIPD type=write size=379216 2024-09-12T17:36:53.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.587+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~3Y2PS92PSYVN.0 size=1048576 2024-09-12T17:36:53.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.588+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~3Y2PS92PSYVN.1 size=682169 2024-09-12T17:36:53.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.590+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=3Y2PS92PSYVN tag=9Z1JEC64DLXB type=write size=2779321 2024-09-12T17:36:53.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.592+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~ZQND3IA1RZ18.0 size=194506 2024-09-12T17:36:53.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.592+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=ZQND3IA1RZ18 tag=M5R5FZR961HT type=write size=1243082 2024-09-12T17:36:53.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.593+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=NDYXWMSP1354 type=del 2024-09-12T17:36:53.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.596+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~VJYIPJ9DATXT.0 size=910295 2024-09-12T17:36:53.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.596+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=VJYIPJ9DATXT tag=KA88O0N1T47N type=write size=1958871 2024-09-12T17:36:53.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.596+0000 7fa80ca76780 1 < canceled part key=_multipart_R871XU2TDWID.2~WVA3AVAN1CH3.0 size=1048576 2024-09-12T17:36:53.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.597+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~WVA3AVAN1CH3.1 size=816661 2024-09-12T17:36:53.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.599+0000 7fa80ca76780 1 < canceled multipart upload key=R871XU2TDWID upload=WVA3AVAN1CH3 tag=EPMBESPSGPBO type=write size=2913813 2024-09-12T17:36:53.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.600+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=73QJU7T60A9O type=del size=417110 2024-09-12T17:36:53.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.602+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~Y2XTH576DK7Q.0 size=1048576 2024-09-12T17:36:53.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.603+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~Y2XTH576DK7Q.1 size=1048576 2024-09-12T17:36:53.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.604+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~Y2XTH576DK7Q.2 size=419620 2024-09-12T17:36:53.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.606+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=Y2XTH576DK7Q tag=TQ110CMIYRIN type=write size=3565348 2024-09-12T17:36:53.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.608+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~2RNQBHWWHIJM.0 size=594340 2024-09-12T17:36:53.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.608+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=2RNQBHWWHIJM tag=F7QU18ZL9YHU type=write size=1642916 2024-09-12T17:36:53.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.609+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=ZNPG0431439F type=write size=295783 2024-09-12T17:36:53.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.611+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~H0DORUYFBXAL.0 size=517023 2024-09-12T17:36:53.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.611+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=H0DORUYFBXAL tag=NI2WYGFBSRGH type=write size=1565599 2024-09-12T17:36:53.614 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.613+0000 7fa80ca76780 1 < suggested remove operation key=VDD4PDR1GLWQ tag=XHU6Z9L6GQ4H type=del 2024-09-12T17:36:53.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.615+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~BWNAPRD8646H.0 size=1048576 2024-09-12T17:36:53.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.616+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~BWNAPRD8646H.1 size=854975 2024-09-12T17:36:53.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.616+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=BWNAPRD8646H tag=DBC95HYIIU4T type=write size=2952127 2024-09-12T17:36:53.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.617+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=0QX0LRUED7NP type=del 2024-09-12T17:36:53.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.620+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~VLUOHD4LJBMW.0 size=1048576 2024-09-12T17:36:53.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.620+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~VLUOHD4LJBMW.1 size=1048576 2024-09-12T17:36:53.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.622+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~VLUOHD4LJBMW.2 size=232386 2024-09-12T17:36:53.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.622+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=VLUOHD4LJBMW tag=52I8EDFUFKAC type=write size=3378114 2024-09-12T17:36:53.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.623+0000 7fa80ca76780 1 < canceled operation key=VC1X03K12V80 tag=B79Q5BMDN6RR type=del size=3723673 2024-09-12T17:36:53.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.624+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=DD139EP2H5FN type=write size=62151 2024-09-12T17:36:53.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.626+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~GYXPCASU2XNQ.0 size=1048576 2024-09-12T17:36:53.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.626+0000 7fa80ca76780 1 < canceled part key=_multipart_07LPSZT2RKCC.2~GYXPCASU2XNQ.1 size=1048576 2024-09-12T17:36:53.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.627+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~GYXPCASU2XNQ.2 size=1044363 2024-09-12T17:36:53.630 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.629+0000 7fa80ca76780 1 < canceled multipart upload key=07LPSZT2RKCC upload=GYXPCASU2XNQ tag=QYCX5KODF214 type=write size=4190091 2024-09-12T17:36:53.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.631+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~HHCKI90KDTS3.0 size=1048576 2024-09-12T17:36:53.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.632+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~HHCKI90KDTS3.1 size=1048576 2024-09-12T17:36:53.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.633+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~HHCKI90KDTS3.2 size=569732 2024-09-12T17:36:53.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.633+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=HHCKI90KDTS3 tag=DIDCN4X65YDW type=write size=3715460 2024-09-12T17:36:53.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.635+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~KMUSO9YEWQLW.0 size=827204 2024-09-12T17:36:53.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.637+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=KMUSO9YEWQLW tag=KZ0HAHX2LGTA type=write size=1875780 2024-09-12T17:36:53.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.639+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~XTVT4YVP9U41.0 size=1045970 2024-09-12T17:36:53.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.639+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=XTVT4YVP9U41 tag=1ZI5VGRENIIJ type=write size=2094546 2024-09-12T17:36:53.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.640+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~6G7GCN9L3AYY.0 size=1048576 2024-09-12T17:36:53.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.641+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~6G7GCN9L3AYY.1 size=1048576 2024-09-12T17:36:53.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.642+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~6G7GCN9L3AYY.2 size=130051 2024-09-12T17:36:53.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.644+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=6G7GCN9L3AYY tag=B4UQKARMZC1O type=write size=3275779 2024-09-12T17:36:53.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.645+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=F2ZPR74R9CJY type=del size=2971818 2024-09-12T17:36:53.648 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.647+0000 7fa80ca76780 1 < suggested update operation key=Z81704G91EPL tag=V38DFLWO4YYJ type=del size=837961 2024-09-12T17:36:53.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.648+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=Z8ZYNJBM5K3K type=del size=4093239 2024-09-12T17:36:53.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.649+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=E9M6ZWQWW5TY type=del 2024-09-12T17:36:53.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.651+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=3IG79IMGC4BJ type=del size=4135589 2024-09-12T17:36:53.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.653+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~5D0Y4K6EIK8Z.0 size=1048576 2024-09-12T17:36:53.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.653+0000 7fa80ca76780 1 < canceled part key=_multipart_07LPSZT2RKCC.2~5D0Y4K6EIK8Z.1 size=1048576 2024-09-12T17:36:53.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.653+0000 7fa80ca76780 1 < canceled part key=_multipart_07LPSZT2RKCC.2~5D0Y4K6EIK8Z.2 size=240671 2024-09-12T17:36:53.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.655+0000 7fa80ca76780 1 < canceled multipart upload key=07LPSZT2RKCC upload=5D0Y4K6EIK8Z tag=FND8BIDEZEKY type=write size=3386399 2024-09-12T17:36:53.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.657+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=Q07PG503EKDD type=write size=924266 2024-09-12T17:36:53.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.658+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=LZ8ULLKYPTOV type=del 2024-09-12T17:36:53.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.661+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~AV1PEE5LPEKM.0 size=1048576 2024-09-12T17:36:53.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.662+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~AV1PEE5LPEKM.1 size=894776 2024-09-12T17:36:53.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.662+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=AV1PEE5LPEKM tag=UFRSQZ3105PY type=write size=2991928 2024-09-12T17:36:53.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.663+0000 7fa80ca76780 1 < completed write operation key=E25BUY271ZSI tag=R0XZAPMANIPD type=write size=379216 2024-09-12T17:36:53.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.664+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=SYO4EWE2RE2S type=del size=3481717 2024-09-12T17:36:53.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.665+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~ZQND3IA1RZ18.0 size=194506 2024-09-12T17:36:53.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.667+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=ZQND3IA1RZ18 tag=M5R5FZR961HT type=write size=1243082 2024-09-12T17:36:53.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.670+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~Z27JSF2R3KZ8.0 size=1048576 2024-09-12T17:36:53.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.671+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~Z27JSF2R3KZ8.1 size=510111 2024-09-12T17:36:53.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.671+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=Z27JSF2R3KZ8 tag=6M534N7LNUHE type=write size=2607263 2024-09-12T17:36:53.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.673+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~VJYIPJ9DATXT.0 size=910295 2024-09-12T17:36:53.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.674+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=VJYIPJ9DATXT tag=KA88O0N1T47N type=write size=1958871 2024-09-12T17:36:53.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.677+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~POH1B4WESYYP.0 size=1048576 2024-09-12T17:36:53.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.678+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~POH1B4WESYYP.1 size=1048576 2024-09-12T17:36:53.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.679+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~POH1B4WESYYP.2 size=855121 2024-09-12T17:36:53.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.679+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=POH1B4WESYYP tag=BPHJMYDFAV1V type=write size=4000849 2024-09-12T17:36:53.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.680+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=73QJU7T60A9O type=del 2024-09-12T17:36:53.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.681+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=SKQIC7DIYICZ type=del size=3518880 2024-09-12T17:36:53.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.682+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~2RNQBHWWHIJM.0 size=594340 2024-09-12T17:36:53.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.684+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=2RNQBHWWHIJM tag=F7QU18ZL9YHU type=write size=1642916 2024-09-12T17:36:53.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.686+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~I428DOOUQZM0.0 size=1048576 2024-09-12T17:36:53.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.687+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~I428DOOUQZM0.1 size=344290 2024-09-12T17:36:53.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.687+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=I428DOOUQZM0 tag=V13VKK07JU81 type=write size=2441442 2024-09-12T17:36:53.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.690+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~H0DORUYFBXAL.0 size=517023 2024-09-12T17:36:53.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.692+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=H0DORUYFBXAL tag=NI2WYGFBSRGH type=write size=1565599 2024-09-12T17:36:53.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.694+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~HXOBVWUYEHAW.0 size=1048576 2024-09-12T17:36:53.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.695+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~HXOBVWUYEHAW.1 size=1041446 2024-09-12T17:36:53.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.695+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=HXOBVWUYEHAW tag=7D0P3SRV1V8U type=write size=3138598 2024-09-12T17:36:53.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.696+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~BWNAPRD8646H.0 size=1048576 2024-09-12T17:36:53.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.697+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~BWNAPRD8646H.1 size=854975 2024-09-12T17:36:53.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.699+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=BWNAPRD8646H tag=DBC95HYIIU4T type=write size=2952127 2024-09-12T17:36:53.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.701+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~EBAET82JSQJV.0 size=66945 2024-09-12T17:36:53.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.701+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=EBAET82JSQJV tag=203V4W0Y423A type=write size=1115521 2024-09-12T17:36:53.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.702+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~VLUOHD4LJBMW.0 size=1048576 2024-09-12T17:36:53.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.703+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~VLUOHD4LJBMW.1 size=1048576 2024-09-12T17:36:53.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.704+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~VLUOHD4LJBMW.2 size=232386 2024-09-12T17:36:53.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.706+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=VLUOHD4LJBMW tag=52I8EDFUFKAC type=write size=3378114 2024-09-12T17:36:53.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.708+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=MD2TIVC03L1Y type=del size=288051 2024-09-12T17:36:53.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.709+0000 7fa80ca76780 1 < completed write operation key=0X3LGXL2QFRN tag=DD139EP2H5FN type=write size=62151 2024-09-12T17:36:53.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.710+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=CKGEPVLS1SYQ type=del size=1573201 2024-09-12T17:36:53.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.711+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~HHCKI90KDTS3.0 size=1048576 2024-09-12T17:36:53.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.712+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~HHCKI90KDTS3.1 size=1048576 2024-09-12T17:36:53.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.712+0000 7fa80ca76780 1 < canceled part key=_multipart_U8O04HYQZRJC.2~HHCKI90KDTS3.2 size=569732 2024-09-12T17:36:53.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.714+0000 7fa80ca76780 1 < canceled multipart upload key=U8O04HYQZRJC upload=HHCKI90KDTS3 tag=DIDCN4X65YDW type=write size=3715460 2024-09-12T17:36:53.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.715+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=BS6S1R87MH8U type=del size=921648 2024-09-12T17:36:53.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.717+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~XTVT4YVP9U41.0 size=1045970 2024-09-12T17:36:53.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.719+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=XTVT4YVP9U41 tag=1ZI5VGRENIIJ type=write size=2094546 2024-09-12T17:36:53.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.720+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=DP52HZBL0TS5 type=del size=294964 2024-09-12T17:36:53.722 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.721+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=F2ZPR74R9CJY type=del 2024-09-12T17:36:53.723 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.722+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=YZMI8CKBZPHH type=del size=1406369 2024-09-12T17:36:53.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.723+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=Z8ZYNJBM5K3K type=del 2024-09-12T17:36:53.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.724+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=VA8JN3LA9NZD type=del size=3343539 2024-09-12T17:36:53.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.725+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=3IG79IMGC4BJ type=del 2024-09-12T17:36:53.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.727+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=I2IL5JMGZOQZ type=del size=1218828 2024-09-12T17:36:53.729 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.728+0000 7fa80ca76780 1 < completed write operation key=VC1X03K12V80 tag=Q07PG503EKDD type=write size=924266 2024-09-12T17:36:53.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.729+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=70V1M2CMXRBS type=del size=3673489 2024-09-12T17:36:53.731 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.730+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~AV1PEE5LPEKM.0 size=1048576 2024-09-12T17:36:53.731 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.730+0000 7fa80ca76780 1 < canceled part key=_multipart_94801LE91HZ9.2~AV1PEE5LPEKM.1 size=894776 2024-09-12T17:36:53.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.732+0000 7fa80ca76780 1 < canceled multipart upload key=94801LE91HZ9 upload=AV1PEE5LPEKM tag=UFRSQZ3105PY type=write size=2991928 2024-09-12T17:36:53.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.733+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=7CRA0G1HNECU type=write size=694292 2024-09-12T17:36:53.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.734+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=SYO4EWE2RE2S type=del 2024-09-12T17:36:53.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.735+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=A3SEIWDPKTLJ type=del size=3451200 2024-09-12T17:36:53.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.736+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~Z27JSF2R3KZ8.0 size=1048576 2024-09-12T17:36:53.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.737+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~Z27JSF2R3KZ8.1 size=510111 2024-09-12T17:36:53.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.739+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=Z27JSF2R3KZ8 tag=6M534N7LNUHE type=write size=2607263 2024-09-12T17:36:53.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.740+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=8W4Y7BPD8STZ type=del size=1851999 2024-09-12T17:36:53.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.741+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~POH1B4WESYYP.0 size=1048576 2024-09-12T17:36:53.743 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.742+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~POH1B4WESYYP.1 size=1048576 2024-09-12T17:36:53.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.743+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~POH1B4WESYYP.2 size=855121 2024-09-12T17:36:53.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.745+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=POH1B4WESYYP tag=BPHJMYDFAV1V type=write size=4000849 2024-09-12T17:36:53.747 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.746+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=UBD4YFB7XG42 type=del size=2027807 2024-09-12T17:36:53.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.749+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=SKQIC7DIYICZ type=del 2024-09-12T17:36:53.752 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.751+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~859XZKOP84U9.0 size=1048576 2024-09-12T17:36:53.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.752+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~859XZKOP84U9.1 size=662679 2024-09-12T17:36:53.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.752+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=859XZKOP84U9 tag=JZDJ4KPYFRKS type=write size=2759831 2024-09-12T17:36:53.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.753+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~I428DOOUQZM0.0 size=1048576 2024-09-12T17:36:53.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.753+0000 7fa80ca76780 1 < canceled part key=_multipart_FKK4IGD1436I.2~I428DOOUQZM0.1 size=344290 2024-09-12T17:36:53.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.755+0000 7fa80ca76780 1 < canceled multipart upload key=FKK4IGD1436I upload=I428DOOUQZM0 tag=V13VKK07JU81 type=write size=2441442 2024-09-12T17:36:53.758 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.757+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~CFB5QFKNOJKI.0 size=1048576 2024-09-12T17:36:53.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.758+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~CFB5QFKNOJKI.1 size=588852 2024-09-12T17:36:53.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.758+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=CFB5QFKNOJKI tag=STNCT6QBW3B2 type=write size=2686004 2024-09-12T17:36:53.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.758+0000 7fa80ca76780 1 < canceled part key=_multipart_VNGH1DA1HANC.2~HXOBVWUYEHAW.0 size=1048576 2024-09-12T17:36:53.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.758+0000 7fa80ca76780 1 < canceled part key=_multipart_VNGH1DA1HANC.2~HXOBVWUYEHAW.1 size=1041446 2024-09-12T17:36:53.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.760+0000 7fa80ca76780 1 < canceled multipart upload key=VNGH1DA1HANC upload=HXOBVWUYEHAW tag=7D0P3SRV1V8U type=write size=3138598 2024-09-12T17:36:53.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.761+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=9T6Z7P2U7PHM type=del size=2915617 2024-09-12T17:36:53.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.762+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~EBAET82JSQJV.0 size=66945 2024-09-12T17:36:53.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.764+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=EBAET82JSQJV tag=203V4W0Y423A type=write size=1115521 2024-09-12T17:36:53.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.765+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=LVMYNXL4WPRR type=del size=1774542 2024-09-12T17:36:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.766+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=MD2TIVC03L1Y type=del 2024-09-12T17:36:53.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.768+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~5KPIQYMIY4R9.0 size=35625 2024-09-12T17:36:53.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.768+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=5KPIQYMIY4R9 tag=DB7JFVV0OYDQ type=write size=1084201 2024-09-12T17:36:53.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.770+0000 7fa80ca76780 1 < canceled operation key=2AGKLZ3PQ2FD tag=CKGEPVLS1SYQ type=del size=1573201 2024-09-12T17:36:53.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.771+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=3HB97C4IATLK type=del size=3117663 2024-09-12T17:36:53.773 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.772+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=BS6S1R87MH8U type=del 2024-09-12T17:36:53.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.774+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~O1Y0K1QZ4F4G.0 size=123464 2024-09-12T17:36:53.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.774+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=O1Y0K1QZ4F4G tag=RXYVLEQ7CP2K type=write size=1172040 2024-09-12T17:36:53.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.775+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=DP52HZBL0TS5 type=del 2024-09-12T17:36:53.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.776+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=58CI5VDZQDD7 type=write size=977395 2024-09-12T17:36:53.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.777+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=YZMI8CKBZPHH type=del 2024-09-12T17:36:53.781 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.780+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~NUSAPRKYNKJA.0 size=595276 2024-09-12T17:36:53.782 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.780+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=NUSAPRKYNKJA tag=KSG1Y9X0YAVP type=write size=1643852 2024-09-12T17:36:53.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.783+0000 7fa80ca76780 1 < suggested remove operation key=E25BUY271ZSI tag=VA8JN3LA9NZD type=del 2024-09-12T17:36:53.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.784+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=R050Y6QU73N8 type=del size=2792767 2024-09-12T17:36:53.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.785+0000 7fa80ca76780 1 < canceled operation key=AKE8O7Q277HX tag=I2IL5JMGZOQZ type=del size=1218828 2024-09-12T17:36:53.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.786+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=WOJ7ACKIGFGU type=del size=2129846 2024-09-12T17:36:53.788 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.787+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=70V1M2CMXRBS type=del 2024-09-12T17:36:53.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.788+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=1OEWQSGWB14P type=del size=3666873 2024-09-12T17:36:53.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.789+0000 7fa80ca76780 1 < completed write operation key=GKE6623N268Z tag=7CRA0G1HNECU type=write size=694292 2024-09-12T17:36:53.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.791+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~61ID7T3X0PB6.0 size=853683 2024-09-12T17:36:53.793 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.791+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=61ID7T3X0PB6 tag=EBZQFZYUXU0X type=write size=1902259 2024-09-12T17:36:53.793 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.792+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=A3SEIWDPKTLJ type=del 2024-09-12T17:36:53.796 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.795+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~O29SMCYZEVUH.0 size=1048576 2024-09-12T17:36:53.796 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.795+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~O29SMCYZEVUH.1 size=616163 2024-09-12T17:36:53.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.795+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=O29SMCYZEVUH tag=FQA15MRR683W type=write size=2713315 2024-09-12T17:36:53.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.798+0000 7fa80ca76780 1 < suggested remove operation key=7QHTQ6VHZ34P tag=8W4Y7BPD8STZ type=del 2024-09-12T17:36:53.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.800+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~2HFR3IVL3EH6.0 size=1048576 2024-09-12T17:36:53.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.801+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~2HFR3IVL3EH6.1 size=1048576 2024-09-12T17:36:53.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.801+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~2HFR3IVL3EH6.2 size=46308 2024-09-12T17:36:53.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.801+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=2HFR3IVL3EH6 tag=WXD6K8H3EBZM type=write size=3192036 2024-09-12T17:36:53.804 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.803+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=UBD4YFB7XG42 type=del 2024-09-12T17:36:53.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.804+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=5L1FPPEGCQLE type=del size=3133346 2024-09-12T17:36:53.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.805+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~859XZKOP84U9.0 size=1048576 2024-09-12T17:36:53.807 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.806+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~859XZKOP84U9.1 size=662679 2024-09-12T17:36:53.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.808+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=859XZKOP84U9 tag=JZDJ4KPYFRKS type=write size=2759831 2024-09-12T17:36:53.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.810+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=OG7FIY6UW3FO type=write size=939704 2024-09-12T17:36:53.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.811+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~CFB5QFKNOJKI.0 size=1048576 2024-09-12T17:36:53.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.812+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~CFB5QFKNOJKI.1 size=588852 2024-09-12T17:36:53.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.814+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=CFB5QFKNOJKI tag=STNCT6QBW3B2 type=write size=2686004 2024-09-12T17:36:53.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.816+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~J6KRL147LSFC.0 size=1048576 2024-09-12T17:36:53.818 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.817+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~J6KRL147LSFC.1 size=1048576 2024-09-12T17:36:53.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.818+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~J6KRL147LSFC.2 size=554980 2024-09-12T17:36:53.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.818+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=J6KRL147LSFC tag=OYAE1VP3Z3PJ type=write size=3700708 2024-09-12T17:36:53.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.820+0000 7fa80ca76780 1 < suggested update operation key=0J6RTRJWZP1T tag=9T6Z7P2U7PHM type=del size=2915617 2024-09-12T17:36:53.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.821+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=97K4CAQCC33H type=del size=4103751 2024-09-12T17:36:53.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.822+0000 7fa80ca76780 1 < canceled operation key=07LPSZT2RKCC tag=LVMYNXL4WPRR type=del size=1774542 2024-09-12T17:36:53.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.824+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~4X6OYHI0DN64.0 size=1048576 2024-09-12T17:36:53.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.825+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~4X6OYHI0DN64.1 size=61710 2024-09-12T17:36:53.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.825+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=4X6OYHI0DN64 tag=88ZA9YPHLO7G type=write size=2158862 2024-09-12T17:36:53.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.826+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~5KPIQYMIY4R9.0 size=35625 2024-09-12T17:36:53.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.829+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=5KPIQYMIY4R9 tag=DB7JFVV0OYDQ type=write size=1084201 2024-09-12T17:36:53.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.830+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=PAU1Q4T2F4U2 type=write size=991718 2024-09-12T17:36:53.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.832+0000 7fa80ca76780 1 < suggested update operation key=94801LE91HZ9 tag=3HB97C4IATLK type=del size=3117663 2024-09-12T17:36:53.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.834+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=67ACO33QM6BQ type=write size=854678 2024-09-12T17:36:53.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.834+0000 7fa80ca76780 1 < canceled part key=_multipart_E25BUY271ZSI.2~O1Y0K1QZ4F4G.0 size=123464 2024-09-12T17:36:53.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.836+0000 7fa80ca76780 1 < canceled multipart upload key=E25BUY271ZSI upload=O1Y0K1QZ4F4G tag=RXYVLEQ7CP2K type=write size=1172040 2024-09-12T17:36:53.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.837+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=52BMCG92O4C7 type=del size=2815419 2024-09-12T17:36:53.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.839+0000 7fa80ca76780 1 < completed write operation key=07LPSZT2RKCC tag=58CI5VDZQDD7 type=write size=977395 2024-09-12T17:36:53.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.840+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=0BF1R9R0V0P8 type=del size=3292036 2024-09-12T17:36:53.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.841+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~NUSAPRKYNKJA.0 size=595276 2024-09-12T17:36:53.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.843+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=NUSAPRKYNKJA tag=KSG1Y9X0YAVP type=write size=1643852 2024-09-12T17:36:53.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.845+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=W0KTMLJHPA6S type=del size=2863115 2024-09-12T17:36:53.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.846+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=R050Y6QU73N8 type=del 2024-09-12T17:36:53.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.847+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=OI8EKHNYF66U type=del size=3685423 2024-09-12T17:36:53.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.848+0000 7fa80ca76780 1 < canceled operation key=K243DOYPYVDS tag=WOJ7ACKIGFGU type=del size=2129846 2024-09-12T17:36:53.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.849+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=3QEJQHQT7V24 type=del size=3922499 2024-09-12T17:36:53.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.852+0000 7fa80ca76780 1 < suggested update operation key=VC1X03K12V80 tag=1OEWQSGWB14P type=del size=3666873 2024-09-12T17:36:53.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.854+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~WA8TH5U2YFY7.0 size=1048576 2024-09-12T17:36:53.856 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.855+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~WA8TH5U2YFY7.1 size=1048576 2024-09-12T17:36:53.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.856+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~WA8TH5U2YFY7.2 size=85223 2024-09-12T17:36:53.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.856+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=WA8TH5U2YFY7 tag=P00O2VQRHD59 type=write size=3230951 2024-09-12T17:36:53.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.858+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~61ID7T3X0PB6.0 size=853683 2024-09-12T17:36:53.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.860+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=61ID7T3X0PB6 tag=EBZQFZYUXU0X type=write size=1902259 2024-09-12T17:36:53.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.862+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~NOFBXAGWLMEB.0 size=733329 2024-09-12T17:36:53.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.862+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=NOFBXAGWLMEB tag=FMBWNZOZPHAF type=write size=1781905 2024-09-12T17:36:53.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.863+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~O29SMCYZEVUH.0 size=1048576 2024-09-12T17:36:53.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.864+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~O29SMCYZEVUH.1 size=616163 2024-09-12T17:36:53.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.866+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=O29SMCYZEVUH tag=FQA15MRR683W type=write size=2713315 2024-09-12T17:36:53.870 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.869+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~3ZA9VB79FPYH.0 size=847769 2024-09-12T17:36:53.870 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.869+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=3ZA9VB79FPYH tag=NUJ1C889KKLC type=write size=1896345 2024-09-12T17:36:53.870 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.869+0000 7fa80ca76780 1 < canceled part key=_multipart_0X3LGXL2QFRN.2~2HFR3IVL3EH6.0 size=1048576 2024-09-12T17:36:53.871 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.870+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~2HFR3IVL3EH6.1 size=1048576 2024-09-12T17:36:53.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.871+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~2HFR3IVL3EH6.2 size=46308 2024-09-12T17:36:53.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.873+0000 7fa80ca76780 1 < canceled multipart upload key=0X3LGXL2QFRN upload=2HFR3IVL3EH6 tag=WXD6K8H3EBZM type=write size=3192036 2024-09-12T17:36:53.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.874+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=1A32MK3NG5CB type=write size=253801 2024-09-12T17:36:53.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.876+0000 7fa80ca76780 1 < canceled operation key=5CAG55DQEF3Y tag=5L1FPPEGCQLE type=del size=3133346 2024-09-12T17:36:53.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.877+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=G95USB92C2NL type=del size=4015511 2024-09-12T17:36:53.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.880+0000 7fa80ca76780 1 < suggested update operation key=4S33294MWCO1 tag=OG7FIY6UW3FO type=write size=939704 2024-09-12T17:36:53.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.882+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~HEKYWAC7Y6QT.0 size=1048576 2024-09-12T17:36:53.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.883+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~HEKYWAC7Y6QT.1 size=1048576 2024-09-12T17:36:53.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.884+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~HEKYWAC7Y6QT.2 size=660120 2024-09-12T17:36:53.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.884+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=HEKYWAC7Y6QT tag=VHJ3SV8J4L0S type=write size=3805848 2024-09-12T17:36:53.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.885+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~J6KRL147LSFC.0 size=1048576 2024-09-12T17:36:53.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.886+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~J6KRL147LSFC.1 size=1048576 2024-09-12T17:36:53.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.888+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~J6KRL147LSFC.2 size=554980 2024-09-12T17:36:53.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.890+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=J6KRL147LSFC tag=OYAE1VP3Z3PJ type=write size=3700708 2024-09-12T17:36:53.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.891+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=52HAOEXY96FD type=del size=3088856 2024-09-12T17:36:53.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.895+0000 7fa80ca76780 1 < suggested update operation key=54KWSI77T73A tag=97K4CAQCC33H type=del size=4103751 2024-09-12T17:36:53.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.896+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=EP1WQOFGEK9L type=del size=1254424 2024-09-12T17:36:53.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.897+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~4X6OYHI0DN64.0 size=1048576 2024-09-12T17:36:53.899 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.898+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~4X6OYHI0DN64.1 size=61710 2024-09-12T17:36:53.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.901+0000 7fa80ca76780 1 < completed multipart upload key=07LPSZT2RKCC upload=4X6OYHI0DN64 tag=88ZA9YPHLO7G type=write size=2158862 2024-09-12T17:36:53.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.902+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=199ZP5HU4KAP type=del size=3832347 2024-09-12T17:36:53.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.903+0000 7fa80ca76780 1 < completed write operation key=OJPZAWR5BLBN tag=PAU1Q4T2F4U2 type=write size=991718 2024-09-12T17:36:53.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.905+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=VBWTHXZKDA7D type=del size=363115 2024-09-12T17:36:53.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.907+0000 7fa80ca76780 1 < suggested update operation key=VNGH1DA1HANC tag=67ACO33QM6BQ type=write size=854678 2024-09-12T17:36:53.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.908+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=1BK4HXJGPH7Y type=del size=1289057 2024-09-12T17:36:53.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.911+0000 7fa80ca76780 1 < suggested remove operation key=GKE6623N268Z tag=52BMCG92O4C7 type=del 2024-09-12T17:36:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.912+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=WRT0ZSHUSHKY type=del size=2817055 2024-09-12T17:36:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.914+0000 7fa80ca76780 1 < suggested update operation key=WGL9JYJXSHBH tag=0BF1R9R0V0P8 type=del size=3292036 2024-09-12T17:36:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.915+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=0Z2O30I9RWIX type=write size=512864 2024-09-12T17:36:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.916+0000 7fa80ca76780 1 < canceled operation key=2AGKLZ3PQ2FD tag=W0KTMLJHPA6S type=del size=2863115 2024-09-12T17:36:53.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.917+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=M5277J3PBX63 type=del size=3674324 2024-09-12T17:36:53.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.918+0000 7fa80ca76780 -1 < failed to complete operation key=WGL9JYJXSHBH tag=OI8EKHNYF66U type=del size=3685423: (22) Invalid argument 2024-09-12T17:36:53.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.920+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=ZDPG3GDE4WZ2 type=del size=3457873 2024-09-12T17:36:53.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.921+0000 7fa80ca76780 -1 < failed to complete operation key=GKE6623N268Z tag=3QEJQHQT7V24 type=del size=3922499: (22) Invalid argument 2024-09-12T17:36:53.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.922+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=PVPLF3DZOT7K type=del size=215889 2024-09-12T17:36:53.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.923+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~WA8TH5U2YFY7.0 size=1048576 2024-09-12T17:36:53.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.924+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~WA8TH5U2YFY7.1 size=1048576 2024-09-12T17:36:53.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.924+0000 7fa80ca76780 1 < canceled part key=_multipart_5CAG55DQEF3Y.2~WA8TH5U2YFY7.2 size=85223 2024-09-12T17:36:53.927 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.926+0000 7fa80ca76780 1 < canceled multipart upload key=5CAG55DQEF3Y upload=WA8TH5U2YFY7 tag=P00O2VQRHD59 type=write size=3230951 2024-09-12T17:36:53.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.928+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=Y97BYKP20XGU type=del size=852847 2024-09-12T17:36:53.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.929+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~NOFBXAGWLMEB.0 size=733329 2024-09-12T17:36:53.932 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.931+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=NOFBXAGWLMEB tag=FMBWNZOZPHAF type=write size=1781905 2024-09-12T17:36:53.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.933+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=ULLQV96V7C21 type=del size=1849840 2024-09-12T17:36:53.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.933+0000 7fa80ca76780 1 < canceled part key=_multipart_54KWSI77T73A.2~3ZA9VB79FPYH.0 size=847769 2024-09-12T17:36:53.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.935+0000 7fa80ca76780 1 < canceled multipart upload key=54KWSI77T73A upload=3ZA9VB79FPYH tag=NUJ1C889KKLC type=write size=1896345 2024-09-12T17:36:53.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.936+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=KJHX51VUF5DI type=del size=385335 2024-09-12T17:36:53.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.938+0000 7fa80ca76780 1 < canceled operation key=LU7PDGWTAK63 tag=1A32MK3NG5CB type=write size=253801 2024-09-12T17:36:53.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.939+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=2VZ4TXF445HH type=del size=2674858 2024-09-12T17:36:53.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.940+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=G95USB92C2NL type=del 2024-09-12T17:36:53.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.942+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=FXK4CBBM8K2Q type=del size=2498907 2024-09-12T17:36:53.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.943+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~HEKYWAC7Y6QT.0 size=1048576 2024-09-12T17:36:53.945 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.944+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~HEKYWAC7Y6QT.1 size=1048576 2024-09-12T17:36:53.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.945+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~HEKYWAC7Y6QT.2 size=660120 2024-09-12T17:36:53.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.949+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=HEKYWAC7Y6QT tag=VHJ3SV8J4L0S type=write size=3805848 2024-09-12T17:36:53.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.950+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=ZLI5S326JTKO type=del size=2650837 2024-09-12T17:36:53.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.951+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=52HAOEXY96FD type=del 2024-09-12T17:36:53.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.953+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~R6WX3R52PKV5.0 size=249566 2024-09-12T17:36:53.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.953+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=R6WX3R52PKV5 tag=6UTHUIJO5I38 type=write size=1298142 2024-09-12T17:36:53.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.954+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=EP1WQOFGEK9L type=del 2024-09-12T17:36:53.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.956+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~6I7MP7I4XO8S.0 size=1048576 2024-09-12T17:36:53.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.957+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~6I7MP7I4XO8S.1 size=609300 2024-09-12T17:36:53.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.958+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=6I7MP7I4XO8S tag=S38703BE1WA1 type=write size=2706452 2024-09-12T17:36:53.960 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.959+0000 7fa80ca76780 1 < completed delete operation key=0X3LGXL2QFRN tag=199ZP5HU4KAP type=del 2024-09-12T17:36:53.961 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.960+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=OBE0L8EF3M8C type=del size=3230779 2024-09-12T17:36:53.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.961+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=VBWTHXZKDA7D type=del 2024-09-12T17:36:53.964 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.963+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~CB0JQDPXL6XH.0 size=984501 2024-09-12T17:36:53.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.963+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=CB0JQDPXL6XH tag=LR0AKKO5KU42 type=write size=2033077 2024-09-12T17:36:53.966 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.965+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=1BK4HXJGPH7Y type=del 2024-09-12T17:36:53.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.966+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=E9Q1BUZITZMX type=del size=1146595 2024-09-12T17:36:53.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.968+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=WRT0ZSHUSHKY type=del 2024-09-12T17:36:53.971 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.970+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=34LOS3X47GOL type=del size=1856081 2024-09-12T17:36:53.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.971+0000 7fa80ca76780 1 < completed write operation key=94801LE91HZ9 tag=0Z2O30I9RWIX type=write size=512864 2024-09-12T17:36:53.974 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.973+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~V38WGI6JR3F7.0 size=1048576 2024-09-12T17:36:53.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.974+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~V38WGI6JR3F7.1 size=1048576 2024-09-12T17:36:53.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.975+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~V38WGI6JR3F7.2 size=270809 2024-09-12T17:36:53.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.975+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=V38WGI6JR3F7 tag=HH299ALSY504 type=write size=3416537 2024-09-12T17:36:53.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.976+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=M5277J3PBX63 type=del 2024-09-12T17:36:53.978 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.977+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=AGKHEA1HAIZT type=del size=1326681 2024-09-12T17:36:53.979 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.978+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=ZDPG3GDE4WZ2 type=del 2024-09-12T17:36:53.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.980+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~58L68LK7DJ58.0 size=532379 2024-09-12T17:36:53.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.980+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=58L68LK7DJ58 tag=JGMEYXOA96ZS type=write size=1580955 2024-09-12T17:36:53.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.981+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=PVPLF3DZOT7K type=del 2024-09-12T17:36:53.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.982+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=5HT8SZ2PP50M type=write size=447976 2024-09-12T17:36:53.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.983+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=Y97BYKP20XGU type=del 2024-09-12T17:36:53.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.984+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=9GQA924ANPLZ type=write size=327976 2024-09-12T17:36:53.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.986+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=ULLQV96V7C21 type=del 2024-09-12T17:36:53.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.988+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~HG26Q97P57T5.0 size=421078 2024-09-12T17:36:53.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.988+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=HG26Q97P57T5 tag=ITYHT2S6EM86 type=write size=1469654 2024-09-12T17:36:53.990 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.989+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=KJHX51VUF5DI type=del 2024-09-12T17:36:53.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.990+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=1O0SXLLKUXPL type=del size=2737677 2024-09-12T17:36:53.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.991+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=2VZ4TXF445HH type=del 2024-09-12T17:36:53.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.993+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=NM29EIF81OIG type=del size=1785530 2024-09-12T17:36:53.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.994+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=FXK4CBBM8K2Q type=del 2024-09-12T17:36:53.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.995+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=XV5OX47KKCJZ type=write size=769803 2024-09-12T17:36:53.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.996+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=ZLI5S326JTKO type=del 2024-09-12T17:36:53.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.997+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=6VG3YDUJCZ3I type=write size=254906 2024-09-12T17:36:54.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:53.999+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~R6WX3R52PKV5.0 size=249566 2024-09-12T17:36:54.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.001+0000 7fa80ca76780 1 < completed multipart upload key=07LPSZT2RKCC upload=R6WX3R52PKV5 tag=6UTHUIJO5I38 type=write size=1298142 2024-09-12T17:36:54.003 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.002+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=QQ4PCAC8PONZ type=write size=346107 2024-09-12T17:36:54.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.004+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~6I7MP7I4XO8S.0 size=1048576 2024-09-12T17:36:54.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.005+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~6I7MP7I4XO8S.1 size=609300 2024-09-12T17:36:54.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.007+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=6I7MP7I4XO8S tag=S38703BE1WA1 type=write size=2706452 2024-09-12T17:36:54.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.008+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=HO9QDWNS464I type=del size=921220 2024-09-12T17:36:54.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.010+0000 7fa80ca76780 1 < suggested remove operation key=0U9KSMYWT2C3 tag=OBE0L8EF3M8C type=del 2024-09-12T17:36:54.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.014+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~N62WVTUJEVIG.0 size=1048576 2024-09-12T17:36:54.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.017+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~N62WVTUJEVIG.1 size=1027766 2024-09-12T17:36:54.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.017+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=N62WVTUJEVIG tag=FI15S2Y3VITJ type=write size=3124918 2024-09-12T17:36:54.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.018+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~CB0JQDPXL6XH.0 size=984501 2024-09-12T17:36:54.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.021+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=CB0JQDPXL6XH tag=LR0AKKO5KU42 type=write size=2033077 2024-09-12T17:36:54.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.023+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~8II61075FAUM.0 size=770747 2024-09-12T17:36:54.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.023+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=8II61075FAUM tag=PXLPXJDIS5UE type=write size=1819323 2024-09-12T17:36:54.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.024+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=E9Q1BUZITZMX type=del 2024-09-12T17:36:54.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.026+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~E3G5RONYA9KM.0 size=1048576 2024-09-12T17:36:54.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.027+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~E3G5RONYA9KM.1 size=875358 2024-09-12T17:36:54.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.027+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=E3G5RONYA9KM tag=S9XI929ZRMXT type=write size=2972510 2024-09-12T17:36:54.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.028+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=34LOS3X47GOL type=del 2024-09-12T17:36:54.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.029+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=SYATE6U71XFJ type=del size=155763 2024-09-12T17:36:54.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.031+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~V38WGI6JR3F7.0 size=1048576 2024-09-12T17:36:54.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.032+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~V38WGI6JR3F7.1 size=1048576 2024-09-12T17:36:54.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.033+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~V38WGI6JR3F7.2 size=270809 2024-09-12T17:36:54.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.035+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=V38WGI6JR3F7 tag=HH299ALSY504 type=write size=3416537 2024-09-12T17:36:54.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.036+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=M44ISQW9ES60 type=del size=2251552 2024-09-12T17:36:54.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.038+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=AGKHEA1HAIZT type=del 2024-09-12T17:36:54.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.039+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=ETBNC8PRKEYL type=del size=2605647 2024-09-12T17:36:54.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.040+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~58L68LK7DJ58.0 size=532379 2024-09-12T17:36:54.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.042+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=58L68LK7DJ58 tag=JGMEYXOA96ZS type=write size=1580955 2024-09-12T17:36:54.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.044+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~DKSSMMV5QVZC.0 size=1048576 2024-09-12T17:36:54.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.045+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~DKSSMMV5QVZC.1 size=1048576 2024-09-12T17:36:54.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.046+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~DKSSMMV5QVZC.2 size=374026 2024-09-12T17:36:54.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.046+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=DKSSMMV5QVZC tag=0R6F5AWA86W4 type=write size=3519754 2024-09-12T17:36:54.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.047+0000 7fa80ca76780 1 < completed write operation key=8Z3EPQHMA6M5 tag=5HT8SZ2PP50M type=write size=447976 2024-09-12T17:36:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.048+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=W18TGBZ7XPM7 type=del size=254942 2024-09-12T17:36:54.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.049+0000 7fa80ca76780 1 < completed write operation key=WGL9JYJXSHBH tag=9GQA924ANPLZ type=write size=327976 2024-09-12T17:36:54.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.050+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=KY88ICE6K2SB type=del size=1254341 2024-09-12T17:36:54.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.052+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~HG26Q97P57T5.0 size=421078 2024-09-12T17:36:54.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.053+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=HG26Q97P57T5 tag=ITYHT2S6EM86 type=write size=1469654 2024-09-12T17:36:54.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.056+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~SVQ3DXQD6OX2.0 size=246345 2024-09-12T17:36:54.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.056+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=SVQ3DXQD6OX2 tag=6JX26RKFWXKN type=write size=1294921 2024-09-12T17:36:54.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.057+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=1O0SXLLKUXPL type=del 2024-09-12T17:36:54.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.058+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=RT8Y5XHOMEW8 type=del size=3128974 2024-09-12T17:36:54.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.059+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=NM29EIF81OIG type=del 2024-09-12T17:36:54.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.060+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=VHPGN2KPEDTQ type=write size=843053 2024-09-12T17:36:54.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.062+0000 7fa80ca76780 1 < completed write operation key=R871XU2TDWID tag=XV5OX47KKCJZ type=write size=769803 2024-09-12T17:36:54.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.063+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=4GITUZU42B5V type=del size=650897 2024-09-12T17:36:54.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.065+0000 7fa80ca76780 1 < suggested update operation key=Z81704G91EPL tag=6VG3YDUJCZ3I type=write size=254906 2024-09-12T17:36:54.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.066+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=I1RB4PZB61HG type=del size=3047604 2024-09-12T17:36:54.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.069+0000 7fa80ca76780 1 < suggested remove operation key=0J6RTRJWZP1T tag=QQ4PCAC8PONZ type=write 2024-09-12T17:36:54.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.070+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=Z5F5S4V343GY type=del size=1264099 2024-09-12T17:36:54.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.071+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=HO9QDWNS464I type=del 2024-09-12T17:36:54.074 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.073+0000 7fa80ca76780 1 > prepared part key=_multipart_MSZUYX441Y66.2~4HHOLXWOQWGP.0 size=792673 2024-09-12T17:36:54.074 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.073+0000 7fa80ca76780 1 > prepared multipart upload key=MSZUYX441Y66 upload=4HHOLXWOQWGP tag=G8PZG77LZWGK type=write size=1841249 2024-09-12T17:36:54.075 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.074+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~N62WVTUJEVIG.0 size=1048576 2024-09-12T17:36:54.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.075+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~N62WVTUJEVIG.1 size=1027766 2024-09-12T17:36:54.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.077+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=N62WVTUJEVIG tag=FI15S2Y3VITJ type=write size=3124918 2024-09-12T17:36:54.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.079+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~WU4N981A033I.0 size=571925 2024-09-12T17:36:54.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.079+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=WU4N981A033I tag=IVJKT2KYJ1VQ type=write size=1620501 2024-09-12T17:36:54.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.081+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~8II61075FAUM.0 size=770747 2024-09-12T17:36:54.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.083+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=8II61075FAUM tag=PXLPXJDIS5UE type=write size=1819323 2024-09-12T17:36:54.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.084+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=12X3LAAMBDYG type=del size=1148799 2024-09-12T17:36:54.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.085+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~E3G5RONYA9KM.0 size=1048576 2024-09-12T17:36:54.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.086+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~E3G5RONYA9KM.1 size=875358 2024-09-12T17:36:54.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.088+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=E3G5RONYA9KM tag=S9XI929ZRMXT type=write size=2972510 2024-09-12T17:36:54.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.089+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=K35XH8KNE4QX type=del size=554476 2024-09-12T17:36:54.091 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.090+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=SYATE6U71XFJ type=del 2024-09-12T17:36:54.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.093+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~NL2WNE6P4750.0 size=467831 2024-09-12T17:36:54.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.093+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=NL2WNE6P4750 tag=910O4SXV56Z1 type=write size=1516407 2024-09-12T17:36:54.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.094+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=M44ISQW9ES60 type=del 2024-09-12T17:36:54.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.095+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=F7BN7X233CQL type=del size=3940055 2024-09-12T17:36:54.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.096+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=ETBNC8PRKEYL type=del 2024-09-12T17:36:54.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.098+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~FPJTDVXF2D20.0 size=1048576 2024-09-12T17:36:54.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.099+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~FPJTDVXF2D20.1 size=8556 2024-09-12T17:36:54.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.099+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=FPJTDVXF2D20 tag=4G0W13EF9512 type=write size=2105708 2024-09-12T17:36:54.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.100+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~DKSSMMV5QVZC.0 size=1048576 2024-09-12T17:36:54.102 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.101+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~DKSSMMV5QVZC.1 size=1048576 2024-09-12T17:36:54.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.102+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~DKSSMMV5QVZC.2 size=374026 2024-09-12T17:36:54.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.104+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=DKSSMMV5QVZC tag=0R6F5AWA86W4 type=write size=3519754 2024-09-12T17:36:54.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.106+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~53YDVEAOP6LW.0 size=412043 2024-09-12T17:36:54.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.106+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=53YDVEAOP6LW tag=450J23DIWJH7 type=write size=1460619 2024-09-12T17:36:54.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.108+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=W18TGBZ7XPM7 type=del 2024-09-12T17:36:54.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.109+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=VY1CZHZ2V4EU type=del size=723102 2024-09-12T17:36:54.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.110+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=KY88ICE6K2SB type=del 2024-09-12T17:36:54.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.112+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~6HI5UKB4V9XM.0 size=1048576 2024-09-12T17:36:54.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.113+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~6HI5UKB4V9XM.1 size=506257 2024-09-12T17:36:54.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.113+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=6HI5UKB4V9XM tag=BUVAN4C7CTTV type=write size=2603409 2024-09-12T17:36:54.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.115+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~SVQ3DXQD6OX2.0 size=246345 2024-09-12T17:36:54.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.117+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=SVQ3DXQD6OX2 tag=6JX26RKFWXKN type=write size=1294921 2024-09-12T17:36:54.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.119+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~XF3UIKU5Q2QB.0 size=1048576 2024-09-12T17:36:54.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.120+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~XF3UIKU5Q2QB.1 size=389976 2024-09-12T17:36:54.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.120+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=XF3UIKU5Q2QB tag=4ENINSK2A0M8 type=write size=2487128 2024-09-12T17:36:54.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.122+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=RT8Y5XHOMEW8 type=del 2024-09-12T17:36:54.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.123+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=SN8TDXXCVGFW type=del size=3521560 2024-09-12T17:36:54.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.124+0000 7fa80ca76780 1 < completed write operation key=MSZUYX441Y66 tag=VHPGN2KPEDTQ type=write size=843053 2024-09-12T17:36:54.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.126+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~U534LKM0QRE1.0 size=838173 2024-09-12T17:36:54.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.126+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=U534LKM0QRE1 tag=QJH7OEBEY5AX type=write size=1886749 2024-09-12T17:36:54.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.129+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=4GITUZU42B5V type=del 2024-09-12T17:36:54.131 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.130+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=S8YHLUCX13NH type=del size=4176180 2024-09-12T17:36:54.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.133+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=I1RB4PZB61HG type=del 2024-09-12T17:36:54.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.134+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=7RSWJHFUEM5K type=del size=2929096 2024-09-12T17:36:54.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.136+0000 7fa80ca76780 1 < suggested remove operation key=OJPZAWR5BLBN tag=Z5F5S4V343GY type=del 2024-09-12T17:36:54.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.138+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~23JNN0WHKY5C.0 size=44235 2024-09-12T17:36:54.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.138+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=23JNN0WHKY5C tag=9J6XHZ8Y6PSI type=write size=1092811 2024-09-12T17:36:54.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.139+0000 7fa80ca76780 1 < completed part key=_multipart_MSZUYX441Y66.2~4HHOLXWOQWGP.0 size=792673 2024-09-12T17:36:54.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.141+0000 7fa80ca76780 1 < completed multipart upload key=MSZUYX441Y66 upload=4HHOLXWOQWGP tag=G8PZG77LZWGK type=write size=1841249 2024-09-12T17:36:54.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.142+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=LWGBT83KL9RU type=del size=2616931 2024-09-12T17:36:54.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.143+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~WU4N981A033I.0 size=571925 2024-09-12T17:36:54.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.145+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=WU4N981A033I tag=IVJKT2KYJ1VQ type=write size=1620501 2024-09-12T17:36:54.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.147+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=YK0WSGO46535 type=del size=1812041 2024-09-12T17:36:54.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.149+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=12X3LAAMBDYG type=del 2024-09-12T17:36:54.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.151+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=S5LIRQ05BBA0 type=del size=1052184 2024-09-12T17:36:54.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.152+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=K35XH8KNE4QX type=del 2024-09-12T17:36:54.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.153+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=AHJWLX28DORR type=del size=643044 2024-09-12T17:36:54.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.154+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~NL2WNE6P4750.0 size=467831 2024-09-12T17:36:54.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.157+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=NL2WNE6P4750 tag=910O4SXV56Z1 type=write size=1516407 2024-09-12T17:36:54.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.158+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=GOC6E2BIDQI1 type=del size=2345153 2024-09-12T17:36:54.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.159+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=F7BN7X233CQL type=del 2024-09-12T17:36:54.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.161+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=9OTGYEIKF72P type=del size=1337282 2024-09-12T17:36:54.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.162+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~FPJTDVXF2D20.0 size=1048576 2024-09-12T17:36:54.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.162+0000 7fa80ca76780 1 < canceled part key=_multipart_VNGH1DA1HANC.2~FPJTDVXF2D20.1 size=8556 2024-09-12T17:36:54.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.164+0000 7fa80ca76780 1 < canceled multipart upload key=VNGH1DA1HANC upload=FPJTDVXF2D20 tag=4G0W13EF9512 type=write size=2105708 2024-09-12T17:36:54.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.167+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~VASP34RGYB5O.0 size=1048576 2024-09-12T17:36:54.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.168+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~VASP34RGYB5O.1 size=999083 2024-09-12T17:36:54.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.168+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=VASP34RGYB5O tag=K2B32XM2KX71 type=write size=3096235 2024-09-12T17:36:54.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.169+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~53YDVEAOP6LW.0 size=412043 2024-09-12T17:36:54.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.172+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=53YDVEAOP6LW tag=450J23DIWJH7 type=write size=1460619 2024-09-12T17:36:54.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.174+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=638EPWBB9Y2Y type=del size=2235782 2024-09-12T17:36:54.176 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.175+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=VY1CZHZ2V4EU type=del 2024-09-12T17:36:54.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.176+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=4DS5EFEF0K5E type=write size=817175 2024-09-12T17:36:54.178 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.177+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~6HI5UKB4V9XM.0 size=1048576 2024-09-12T17:36:54.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.178+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~6HI5UKB4V9XM.1 size=506257 2024-09-12T17:36:54.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.181+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=6HI5UKB4V9XM tag=BUVAN4C7CTTV type=write size=2603409 2024-09-12T17:36:54.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.182+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=VIMS3AJAD1LR type=write size=831494 2024-09-12T17:36:54.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.183+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~XF3UIKU5Q2QB.0 size=1048576 2024-09-12T17:36:54.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.183+0000 7fa80ca76780 1 < canceled part key=_multipart_H87S6AI6JT6D.2~XF3UIKU5Q2QB.1 size=389976 2024-09-12T17:36:54.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.185+0000 7fa80ca76780 1 < canceled multipart upload key=H87S6AI6JT6D upload=XF3UIKU5Q2QB tag=4ENINSK2A0M8 type=write size=2487128 2024-09-12T17:36:54.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.186+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=373L3JEUHAOG type=write size=861810 2024-09-12T17:36:54.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.188+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=SN8TDXXCVGFW type=del 2024-09-12T17:36:54.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.189+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=U1HF2KUOGABD type=del size=2527425 2024-09-12T17:36:54.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.190+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~U534LKM0QRE1.0 size=838173 2024-09-12T17:36:54.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.192+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=U534LKM0QRE1 tag=QJH7OEBEY5AX type=write size=1886749 2024-09-12T17:36:54.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.194+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~9V4T7F0ICMES.0 size=1048576 2024-09-12T17:36:54.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.195+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~9V4T7F0ICMES.1 size=805093 2024-09-12T17:36:54.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.195+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=9V4T7F0ICMES tag=QBE8ZVJUPUFG type=write size=2902245 2024-09-12T17:36:54.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.196+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=S8YHLUCX13NH type=del 2024-09-12T17:36:54.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.197+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=4FG66B0TPFXN type=write size=485426 2024-09-12T17:36:54.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.198+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=7RSWJHFUEM5K type=del 2024-09-12T17:36:54.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.200+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=BD75EPQS0VBX type=del size=3471830 2024-09-12T17:36:54.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.201+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~23JNN0WHKY5C.0 size=44235 2024-09-12T17:36:54.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.203+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=23JNN0WHKY5C tag=9J6XHZ8Y6PSI type=write size=1092811 2024-09-12T17:36:54.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.205+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~1FM6S14N0GT6.0 size=223605 2024-09-12T17:36:54.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.205+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=1FM6S14N0GT6 tag=KGGG9PO0WMZX type=write size=1272181 2024-09-12T17:36:54.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.206+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=LWGBT83KL9RU type=del 2024-09-12T17:36:54.208 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.207+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=270WQVZVOKLM type=write size=985101 2024-09-12T17:36:54.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.208+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=YK0WSGO46535 type=del 2024-09-12T17:36:54.210 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.209+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=2GDDZ5L5MS6T type=write size=289371 2024-09-12T17:36:54.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.212+0000 7fa80ca76780 1 < suggested remove operation key=4S33294MWCO1 tag=S5LIRQ05BBA0 type=del 2024-09-12T17:36:54.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.214+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~8K5C9VWXZXH6.0 size=251815 2024-09-12T17:36:54.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.214+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=8K5C9VWXZXH6 tag=6I6RIBN8PU5Z type=write size=1300391 2024-09-12T17:36:54.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.215+0000 7fa80ca76780 1 < completed delete operation key=BLGMV3S9AY24 tag=AHJWLX28DORR type=del 2024-09-12T17:36:54.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.217+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~F7ZGQ23JJCGL.0 size=1048576 2024-09-12T17:36:54.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.218+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~F7ZGQ23JJCGL.1 size=495990 2024-09-12T17:36:54.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.218+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=F7ZGQ23JJCGL tag=85ZC4RVE32TO type=write size=2593142 2024-09-12T17:36:54.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.219+0000 7fa80ca76780 1 < completed delete operation key=0X3LGXL2QFRN tag=GOC6E2BIDQI1 type=del 2024-09-12T17:36:54.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.222+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~61ZF20SC1J0J.0 size=268792 2024-09-12T17:36:54.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.222+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=61ZF20SC1J0J tag=AZTH2T7A1GJT type=write size=1317368 2024-09-12T17:36:54.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.223+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=9OTGYEIKF72P type=del 2024-09-12T17:36:54.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.225+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~3LMOA9013QGW.0 size=467778 2024-09-12T17:36:54.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.225+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=3LMOA9013QGW tag=OYPWMH7MCP5F type=write size=1516354 2024-09-12T17:36:54.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.227+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~VASP34RGYB5O.0 size=1048576 2024-09-12T17:36:54.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.228+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~VASP34RGYB5O.1 size=999083 2024-09-12T17:36:54.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.230+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=VASP34RGYB5O tag=K2B32XM2KX71 type=write size=3096235 2024-09-12T17:36:54.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.231+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=YA0QZ0ZZYT6J type=del size=3408020 2024-09-12T17:36:54.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.232+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=638EPWBB9Y2Y type=del 2024-09-12T17:36:54.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.234+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~2CTP8NDV7XT6.0 size=563499 2024-09-12T17:36:54.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.234+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=2CTP8NDV7XT6 tag=TDSTFQKX3JBB type=write size=1612075 2024-09-12T17:36:54.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.235+0000 7fa80ca76780 -1 < no bi entry to suggest for operation key=4S33294MWCO1 tag=4DS5EFEF0K5E type=write size=817175: (2) No such file or directory 2024-09-12T17:36:54.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.237+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~M2V8PV0NER92.0 size=442131 2024-09-12T17:36:54.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.237+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=M2V8PV0NER92 tag=LTL18QR2X9R2 type=write size=1490707 2024-09-12T17:36:54.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.238+0000 7fa80ca76780 1 < completed write operation key=MSZUYX441Y66 tag=VIMS3AJAD1LR type=write size=831494 2024-09-12T17:36:54.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.241+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~R8FE1N8NQHSF.0 size=614171 2024-09-12T17:36:54.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.241+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=R8FE1N8NQHSF tag=18TK51SW40KH type=write size=1662747 2024-09-12T17:36:54.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.242+0000 7fa80ca76780 1 < completed write operation key=0U9KSMYWT2C3 tag=373L3JEUHAOG type=write size=861810 2024-09-12T17:36:54.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.244+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~8XCETGNKDSKY.0 size=1048576 2024-09-12T17:36:54.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.245+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~8XCETGNKDSKY.1 size=383851 2024-09-12T17:36:54.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.245+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=8XCETGNKDSKY tag=F8SME4PUDY92 type=write size=2481003 2024-09-12T17:36:54.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.248+0000 7fa80ca76780 1 < suggested remove operation key=2AGKLZ3PQ2FD tag=U1HF2KUOGABD type=del 2024-09-12T17:36:54.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.251+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=123HC8A0MMR6 type=write size=505939 2024-09-12T17:36:54.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.252+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~9V4T7F0ICMES.0 size=1048576 2024-09-12T17:36:54.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.253+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~9V4T7F0ICMES.1 size=805093 2024-09-12T17:36:54.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.255+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=9V4T7F0ICMES tag=QBE8ZVJUPUFG type=write size=2902245 2024-09-12T17:36:54.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.256+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=FSQH8RU2I2ZN type=write size=96053 2024-09-12T17:36:54.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.259+0000 7fa80ca76780 1 < suggested update operation key=AKE8O7Q277HX tag=4FG66B0TPFXN type=write size=485426 2024-09-12T17:36:54.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.260+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=MJFMG2M28ESN type=write size=358869 2024-09-12T17:36:54.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.262+0000 7fa80ca76780 1 < suggested remove operation key=E25BUY271ZSI tag=BD75EPQS0VBX type=del 2024-09-12T17:36:54.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.263+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=LRMM934API02 type=write size=711024 2024-09-12T17:36:54.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.264+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~1FM6S14N0GT6.0 size=223605 2024-09-12T17:36:54.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.266+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=1FM6S14N0GT6 tag=KGGG9PO0WMZX type=write size=1272181 2024-09-12T17:36:54.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.267+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=7H43KKDOYH28 type=write size=976736 2024-09-12T17:36:54.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.269+0000 7fa80ca76780 1 < suggested remove operation key=VC1X03K12V80 tag=270WQVZVOKLM type=write 2024-09-12T17:36:54.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.271+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~O386SKLYHKNX.0 size=1048576 2024-09-12T17:36:54.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.272+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~O386SKLYHKNX.1 size=1048576 2024-09-12T17:36:54.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.273+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~O386SKLYHKNX.2 size=64528 2024-09-12T17:36:54.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.273+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=O386SKLYHKNX tag=AE5EMEDOI8OO type=write size=3210256 2024-09-12T17:36:54.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.274+0000 7fa80ca76780 1 < completed write operation key=WGL9JYJXSHBH tag=2GDDZ5L5MS6T type=write size=289371 2024-09-12T17:36:54.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.276+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~ATQO36TBSCQU.0 size=1048576 2024-09-12T17:36:54.278 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.277+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~ATQO36TBSCQU.1 size=1048576 2024-09-12T17:36:54.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.278+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~ATQO36TBSCQU.2 size=235593 2024-09-12T17:36:54.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.278+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=ATQO36TBSCQU tag=W1JFS4Y1ZW3I type=write size=3381321 2024-09-12T17:36:54.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.279+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~8K5C9VWXZXH6.0 size=251815 2024-09-12T17:36:54.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.281+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=8K5C9VWXZXH6 tag=6I6RIBN8PU5Z type=write size=1300391 2024-09-12T17:36:54.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.283+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~G21LAVIO414J.0 size=378515 2024-09-12T17:36:54.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.283+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=G21LAVIO414J tag=R2V339WJFPDU type=write size=1427091 2024-09-12T17:36:54.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.284+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~F7ZGQ23JJCGL.0 size=1048576 2024-09-12T17:36:54.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.285+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~F7ZGQ23JJCGL.1 size=495990 2024-09-12T17:36:54.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.287+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=F7ZGQ23JJCGL tag=85ZC4RVE32TO type=write size=2593142 2024-09-12T17:36:54.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.289+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~PPYYG3YUCBWD.0 size=1048576 2024-09-12T17:36:54.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.290+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~PPYYG3YUCBWD.1 size=1048576 2024-09-12T17:36:54.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.291+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~PPYYG3YUCBWD.2 size=185115 2024-09-12T17:36:54.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.291+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=PPYYG3YUCBWD tag=I2F1UIWOQEGG type=write size=3330843 2024-09-12T17:36:54.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.292+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~61ZF20SC1J0J.0 size=268792 2024-09-12T17:36:54.295 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.294+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=61ZF20SC1J0J tag=AZTH2T7A1GJT type=write size=1317368 2024-09-12T17:36:54.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.296+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~U1NOVUE0XYXL.0 size=506464 2024-09-12T17:36:54.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.296+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=U1NOVUE0XYXL tag=I36QVP9AB21P type=write size=1555040 2024-09-12T17:36:54.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.297+0000 7fa80ca76780 1 < canceled part key=_multipart_7QHTQ6VHZ34P.2~3LMOA9013QGW.0 size=467778 2024-09-12T17:36:54.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.299+0000 7fa80ca76780 1 < canceled multipart upload key=7QHTQ6VHZ34P upload=3LMOA9013QGW tag=OYPWMH7MCP5F type=write size=1516354 2024-09-12T17:36:54.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.301+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~VK9J5OC5O5TY.0 size=139133 2024-09-12T17:36:54.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.301+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=VK9J5OC5O5TY tag=6X84KFAPFSWY type=write size=1187709 2024-09-12T17:36:54.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.302+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=YA0QZ0ZZYT6J type=del 2024-09-12T17:36:54.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.303+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=EBZBF3G6AKLG type=write size=423562 2024-09-12T17:36:54.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.305+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~2CTP8NDV7XT6.0 size=563499 2024-09-12T17:36:54.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.307+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=2CTP8NDV7XT6 tag=TDSTFQKX3JBB type=write size=1612075 2024-09-12T17:36:54.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.308+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=X2VR0GB6NIFB type=del size=3464636 2024-09-12T17:36:54.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.308+0000 7fa80ca76780 1 < canceled part key=_multipart_OJPZAWR5BLBN.2~M2V8PV0NER92.0 size=442131 2024-09-12T17:36:54.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.310+0000 7fa80ca76780 1 < canceled multipart upload key=OJPZAWR5BLBN upload=M2V8PV0NER92 tag=LTL18QR2X9R2 type=write size=1490707 2024-09-12T17:36:54.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.311+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=Y0D91TEQP27M type=del size=521323 2024-09-12T17:36:54.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.313+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~R8FE1N8NQHSF.0 size=614171 2024-09-12T17:36:54.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.314+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=R8FE1N8NQHSF tag=18TK51SW40KH type=write size=1662747 2024-09-12T17:36:54.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.316+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=XR2QLXKDY1AJ type=del size=3579989 2024-09-12T17:36:54.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.317+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~8XCETGNKDSKY.0 size=1048576 2024-09-12T17:36:54.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.318+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~8XCETGNKDSKY.1 size=383851 2024-09-12T17:36:54.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.320+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=8XCETGNKDSKY tag=F8SME4PUDY92 type=write size=2481003 2024-09-12T17:36:54.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.321+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=0FV127PEO74B type=del size=4141734 2024-09-12T17:36:54.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.322+0000 7fa80ca76780 1 < completed write operation key=R871XU2TDWID tag=123HC8A0MMR6 type=write size=505939 2024-09-12T17:36:54.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.324+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~UEB4MC7M4W69.0 size=1048576 2024-09-12T17:36:54.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.325+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~UEB4MC7M4W69.1 size=1048576 2024-09-12T17:36:54.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.326+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~UEB4MC7M4W69.2 size=492480 2024-09-12T17:36:54.328 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.326+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=UEB4MC7M4W69 tag=CLCCJ1M3CMBJ type=write size=3638208 2024-09-12T17:36:54.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.329+0000 7fa80ca76780 1 < suggested update operation key=VNGH1DA1HANC tag=FSQH8RU2I2ZN type=write size=96053 2024-09-12T17:36:54.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.331+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~TZ8ZVMZ2OI0N.0 size=1048576 2024-09-12T17:36:54.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.332+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~TZ8ZVMZ2OI0N.1 size=544927 2024-09-12T17:36:54.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.332+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=TZ8ZVMZ2OI0N tag=A8B6BKKH0PNI type=write size=2642079 2024-09-12T17:36:54.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.333+0000 7fa80ca76780 1 < completed write operation key=FKK4IGD1436I tag=MJFMG2M28ESN type=write size=358869 2024-09-12T17:36:54.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.336+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~RUWZXR9PTFWM.0 size=13752 2024-09-12T17:36:54.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.336+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=RUWZXR9PTFWM tag=N1UYK6CESM47 type=write size=1062328 2024-09-12T17:36:54.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.337+0000 7fa80ca76780 1 < completed write operation key=AKE8O7Q277HX tag=LRMM934API02 type=write size=711024 2024-09-12T17:36:54.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.339+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~PNHZ2FFZSAX8.0 size=88501 2024-09-12T17:36:54.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.339+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=PNHZ2FFZSAX8 tag=3JQ2R04WNJZE type=write size=1137077 2024-09-12T17:36:54.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.340+0000 7fa80ca76780 1 < completed write operation key=54KWSI77T73A tag=7H43KKDOYH28 type=write size=976736 2024-09-12T17:36:54.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.342+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=WTV3CP03OJYN type=del size=1629422 2024-09-12T17:36:54.344 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.343+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~O386SKLYHKNX.0 size=1048576 2024-09-12T17:36:54.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.344+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~O386SKLYHKNX.1 size=1048576 2024-09-12T17:36:54.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.344+0000 7fa80ca76780 1 < canceled part key=_multipart_K243DOYPYVDS.2~O386SKLYHKNX.2 size=64528 2024-09-12T17:36:54.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.346+0000 7fa80ca76780 1 < canceled multipart upload key=K243DOYPYVDS upload=O386SKLYHKNX tag=AE5EMEDOI8OO type=write size=3210256 2024-09-12T17:36:54.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.348+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=3EB08GLN5LAV type=del size=3527802 2024-09-12T17:36:54.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.350+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~ATQO36TBSCQU.0 size=1048576 2024-09-12T17:36:54.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.350+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~ATQO36TBSCQU.1 size=1048576 2024-09-12T17:36:54.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.351+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~ATQO36TBSCQU.2 size=235593 2024-09-12T17:36:54.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.354+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=ATQO36TBSCQU tag=W1JFS4Y1ZW3I type=write size=3381321 2024-09-12T17:36:54.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.355+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=30OOATV4Y170 type=write size=862768 2024-09-12T17:36:54.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.356+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~G21LAVIO414J.0 size=378515 2024-09-12T17:36:54.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.358+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=G21LAVIO414J tag=R2V339WJFPDU type=write size=1427091 2024-09-12T17:36:54.362 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.361+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=JAN38OI38GTI type=del size=498256 2024-09-12T17:36:54.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.363+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~PPYYG3YUCBWD.0 size=1048576 2024-09-12T17:36:54.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.366+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~PPYYG3YUCBWD.1 size=1048576 2024-09-12T17:36:54.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.367+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~PPYYG3YUCBWD.2 size=185115 2024-09-12T17:36:54.370 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.369+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=PPYYG3YUCBWD tag=I2F1UIWOQEGG type=write size=3330843 2024-09-12T17:36:54.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.370+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=RGH5QFOSYK5C type=del size=2216915 2024-09-12T17:36:54.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.370+0000 7fa80ca76780 1 < canceled part key=_multipart_K243DOYPYVDS.2~U1NOVUE0XYXL.0 size=506464 2024-09-12T17:36:54.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.372+0000 7fa80ca76780 1 < canceled multipart upload key=K243DOYPYVDS upload=U1NOVUE0XYXL tag=I36QVP9AB21P type=write size=1555040 2024-09-12T17:36:54.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.373+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=RMP3IKFAFHWH type=del size=2883234 2024-09-12T17:36:54.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.374+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~VK9J5OC5O5TY.0 size=139133 2024-09-12T17:36:54.377 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.376+0000 7fa80ca76780 1 < completed multipart upload key=FKK4IGD1436I upload=VK9J5OC5O5TY tag=6X84KFAPFSWY type=write size=1187709 2024-09-12T17:36:54.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.379+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~SQADL9E0TY04.0 size=1048576 2024-09-12T17:36:54.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.379+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~SQADL9E0TY04.1 size=881828 2024-09-12T17:36:54.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.379+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=SQADL9E0TY04 tag=Z2R2L2A0G4FP type=write size=2978980 2024-09-12T17:36:54.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.381+0000 7fa80ca76780 1 < completed write operation key=2AGKLZ3PQ2FD tag=EBZBF3G6AKLG type=write size=423562 2024-09-12T17:36:54.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.382+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=NLTIMOMV4TOD type=del size=2702958 2024-09-12T17:36:54.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.383+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=X2VR0GB6NIFB type=del 2024-09-12T17:36:54.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.385+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~ZZ8TKY8IPCCL.0 size=1048576 2024-09-12T17:36:54.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.386+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~ZZ8TKY8IPCCL.1 size=1048576 2024-09-12T17:36:54.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.387+0000 7fa80ca76780 1 > prepared part key=_multipart_4S33294MWCO1.2~ZZ8TKY8IPCCL.2 size=445675 2024-09-12T17:36:54.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.387+0000 7fa80ca76780 1 > prepared multipart upload key=4S33294MWCO1 upload=ZZ8TKY8IPCCL tag=R6Z13EQWYP7B type=write size=3591403 2024-09-12T17:36:54.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.388+0000 7fa80ca76780 1 < canceled operation key=E25BUY271ZSI tag=Y0D91TEQP27M type=del size=521323 2024-09-12T17:36:54.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.389+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=CQMXXC91ABKI type=del size=703111 2024-09-12T17:36:54.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.390+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=XR2QLXKDY1AJ type=del 2024-09-12T17:36:54.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.392+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~F7CGNUDLCR9G.0 size=257868 2024-09-12T17:36:54.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.392+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=F7CGNUDLCR9G tag=2W9X416PPK2U type=write size=1306444 2024-09-12T17:36:54.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.393+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=0FV127PEO74B type=del 2024-09-12T17:36:54.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.394+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=WH3O4X9S2ZXI type=del size=1966562 2024-09-12T17:36:54.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.395+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~UEB4MC7M4W69.0 size=1048576 2024-09-12T17:36:54.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.396+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~UEB4MC7M4W69.1 size=1048576 2024-09-12T17:36:54.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.397+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~UEB4MC7M4W69.2 size=492480 2024-09-12T17:36:54.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.399+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=UEB4MC7M4W69 tag=CLCCJ1M3CMBJ type=write size=3638208 2024-09-12T17:36:54.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.401+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~2Z8IPXTEHF0Z.0 size=848516 2024-09-12T17:36:54.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.401+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=2Z8IPXTEHF0Z tag=XWOCZ3VB6H73 type=write size=1897092 2024-09-12T17:36:54.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.402+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~TZ8ZVMZ2OI0N.0 size=1048576 2024-09-12T17:36:54.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.403+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~TZ8ZVMZ2OI0N.1 size=544927 2024-09-12T17:36:54.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.405+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=TZ8ZVMZ2OI0N tag=A8B6BKKH0PNI type=write size=2642079 2024-09-12T17:36:54.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.407+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~LDSA8GCE3TLN.0 size=391731 2024-09-12T17:36:54.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.407+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=LDSA8GCE3TLN tag=EJKE931HFF4B type=write size=1440307 2024-09-12T17:36:54.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.408+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~RUWZXR9PTFWM.0 size=13752 2024-09-12T17:36:54.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.409+0000 7fa80ca76780 1 < completed multipart upload key=0J6RTRJWZP1T upload=RUWZXR9PTFWM tag=N1UYK6CESM47 type=write size=1062328 2024-09-12T17:36:54.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.411+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=PVCGN81PP3CI type=del size=506753 2024-09-12T17:36:54.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.412+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~PNHZ2FFZSAX8.0 size=88501 2024-09-12T17:36:54.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.414+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=PNHZ2FFZSAX8 tag=3JQ2R04WNJZE type=write size=1137077 2024-09-12T17:36:54.416 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.415+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=OQSRLX0QL1J7 type=del size=4146380 2024-09-12T17:36:54.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.416+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=WTV3CP03OJYN type=del 2024-09-12T17:36:54.418 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.417+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=7IDULFOG35UE type=del size=3636895 2024-09-12T17:36:54.419 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.419+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=3EB08GLN5LAV type=del 2024-09-12T17:36:54.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.420+0000 7fa80ca76780 1 > prepared operation key=DYZIHCBF3D8U tag=1R73UZNISIAD type=del size=1072410 2024-09-12T17:36:54.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.421+0000 7fa80ca76780 1 < completed write operation key=0U9KSMYWT2C3 tag=30OOATV4Y170 type=write size=862768 2024-09-12T17:36:54.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.423+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~4XK6HD75EV5X.0 size=1048576 2024-09-12T17:36:54.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.425+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~4XK6HD75EV5X.1 size=1048576 2024-09-12T17:36:54.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.425+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~4XK6HD75EV5X.2 size=696365 2024-09-12T17:36:54.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.425+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=4XK6HD75EV5X tag=W3BTIU58CQ4G type=write size=3842093 2024-09-12T17:36:54.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.427+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=JAN38OI38GTI type=del 2024-09-12T17:36:54.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.429+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~304ORA1DMMTL.0 size=1048576 2024-09-12T17:36:54.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.430+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~304ORA1DMMTL.1 size=1048576 2024-09-12T17:36:54.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.432+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~304ORA1DMMTL.2 size=327860 2024-09-12T17:36:54.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.432+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=304ORA1DMMTL tag=7SAQREB20WI2 type=write size=3473588 2024-09-12T17:36:54.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.434+0000 7fa80ca76780 1 < completed delete operation key=VNGH1DA1HANC tag=RGH5QFOSYK5C type=del 2024-09-12T17:36:54.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.436+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~D848OA1CPZYF.0 size=1048576 2024-09-12T17:36:54.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.437+0000 7fa80ca76780 1 > prepared part key=_multipart_VC1X03K12V80.2~D848OA1CPZYF.1 size=121846 2024-09-12T17:36:54.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.437+0000 7fa80ca76780 1 > prepared multipart upload key=VC1X03K12V80 upload=D848OA1CPZYF tag=9TPAEWIS3BL1 type=write size=2218998 2024-09-12T17:36:54.439 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.438+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=RMP3IKFAFHWH type=del 2024-09-12T17:36:54.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.439+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=2QOEK8J1JRSE type=write size=1037053 2024-09-12T17:36:54.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.440+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~SQADL9E0TY04.0 size=1048576 2024-09-12T17:36:54.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.440+0000 7fa80ca76780 1 < canceled part key=_multipart_VDD4PDR1GLWQ.2~SQADL9E0TY04.1 size=881828 2024-09-12T17:36:54.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.442+0000 7fa80ca76780 1 < canceled multipart upload key=VDD4PDR1GLWQ upload=SQADL9E0TY04 tag=Z2R2L2A0G4FP type=write size=2978980 2024-09-12T17:36:54.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.444+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~93JEMGDS64E1.0 size=1048576 2024-09-12T17:36:54.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.445+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~93JEMGDS64E1.1 size=1048576 2024-09-12T17:36:54.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.446+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~93JEMGDS64E1.2 size=787125 2024-09-12T17:36:54.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.446+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=93JEMGDS64E1 tag=Q5RAJZSI2VNE type=write size=3932853 2024-09-12T17:36:54.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.447+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=NLTIMOMV4TOD type=del 2024-09-12T17:36:54.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.449+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=JSHKBA5L6X3H type=del size=1990997 2024-09-12T17:36:54.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.450+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~ZZ8TKY8IPCCL.0 size=1048576 2024-09-12T17:36:54.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.451+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~ZZ8TKY8IPCCL.1 size=1048576 2024-09-12T17:36:54.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.452+0000 7fa80ca76780 1 < completed part key=_multipart_4S33294MWCO1.2~ZZ8TKY8IPCCL.2 size=445675 2024-09-12T17:36:54.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.453+0000 7fa80ca76780 1 < completed multipart upload key=4S33294MWCO1 upload=ZZ8TKY8IPCCL tag=R6Z13EQWYP7B type=write size=3591403 2024-09-12T17:36:54.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.455+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=A03AJ97P1Y1N type=del size=466622 2024-09-12T17:36:54.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.457+0000 7fa80ca76780 1 < suggested update operation key=Z81704G91EPL tag=CQMXXC91ABKI type=del size=703111 2024-09-12T17:36:54.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.458+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=U0TB8HHUBST4 type=del size=292878 2024-09-12T17:36:54.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.459+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~F7CGNUDLCR9G.0 size=257868 2024-09-12T17:36:54.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.461+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=F7CGNUDLCR9G tag=2W9X416PPK2U type=write size=1306444 2024-09-12T17:36:54.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.463+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=DL6YHWOJJRYS type=del size=4111850 2024-09-12T17:36:54.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.464+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=WH3O4X9S2ZXI type=del 2024-09-12T17:36:54.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.465+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=JS8WH7W75WO6 type=del size=100219 2024-09-12T17:36:54.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.466+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~2Z8IPXTEHF0Z.0 size=848516 2024-09-12T17:36:54.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.469+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=2Z8IPXTEHF0Z tag=XWOCZ3VB6H73 type=write size=1897092 2024-09-12T17:36:54.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.471+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~YZJXLTKAO1RI.0 size=1048576 2024-09-12T17:36:54.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.473+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~YZJXLTKAO1RI.1 size=107974 2024-09-12T17:36:54.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.473+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=YZJXLTKAO1RI tag=WO0L302ON9JI type=write size=2205126 2024-09-12T17:36:54.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.474+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~LDSA8GCE3TLN.0 size=391731 2024-09-12T17:36:54.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.476+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=LDSA8GCE3TLN tag=EJKE931HFF4B type=write size=1440307 2024-09-12T17:36:54.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.477+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=P4J0OLGJ78T5 type=del size=551508 2024-09-12T17:36:54.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.479+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=PVCGN81PP3CI type=del 2024-09-12T17:36:54.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.480+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=7SJ6D1F6Z7EE type=del size=914540 2024-09-12T17:36:54.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.481+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=OQSRLX0QL1J7 type=del 2024-09-12T17:36:54.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.482+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=0B54CL04I4XS type=del size=2309745 2024-09-12T17:36:54.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.483+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=7IDULFOG35UE type=del 2024-09-12T17:36:54.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.484+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=UZI0EVBDK9WL type=del size=1979008 2024-09-12T17:36:54.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.486+0000 7fa80ca76780 1 < completed delete operation key=DYZIHCBF3D8U tag=1R73UZNISIAD type=del 2024-09-12T17:36:54.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.487+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=OZSD1AC7UXR3 type=del size=3992345 2024-09-12T17:36:54.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.488+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~4XK6HD75EV5X.0 size=1048576 2024-09-12T17:36:54.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.489+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~4XK6HD75EV5X.1 size=1048576 2024-09-12T17:36:54.491 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.490+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~4XK6HD75EV5X.2 size=696365 2024-09-12T17:36:54.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.492+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=4XK6HD75EV5X tag=W3BTIU58CQ4G type=write size=3842093 2024-09-12T17:36:54.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.494+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~N9WOFVL1CI4F.0 size=1048576 2024-09-12T17:36:54.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.495+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~N9WOFVL1CI4F.1 size=1048576 2024-09-12T17:36:54.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.496+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~N9WOFVL1CI4F.2 size=601661 2024-09-12T17:36:54.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.496+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=N9WOFVL1CI4F tag=XG27RW463X47 type=write size=3747389 2024-09-12T17:36:54.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.497+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~304ORA1DMMTL.0 size=1048576 2024-09-12T17:36:54.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.497+0000 7fa80ca76780 1 < canceled part key=_multipart_GKE6623N268Z.2~304ORA1DMMTL.1 size=1048576 2024-09-12T17:36:54.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.498+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~304ORA1DMMTL.2 size=327860 2024-09-12T17:36:54.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.500+0000 7fa80ca76780 1 < canceled multipart upload key=GKE6623N268Z upload=304ORA1DMMTL tag=7SAQREB20WI2 type=write size=3473588 2024-09-12T17:36:54.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.502+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~GTL9MOVHN681.0 size=497036 2024-09-12T17:36:54.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.502+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=GTL9MOVHN681 tag=KQWMYH0ZS2NP type=write size=1545612 2024-09-12T17:36:54.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.503+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~D848OA1CPZYF.0 size=1048576 2024-09-12T17:36:54.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.504+0000 7fa80ca76780 1 < completed part key=_multipart_VC1X03K12V80.2~D848OA1CPZYF.1 size=121846 2024-09-12T17:36:54.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.506+0000 7fa80ca76780 1 < completed multipart upload key=VC1X03K12V80 upload=D848OA1CPZYF tag=9TPAEWIS3BL1 type=write size=2218998 2024-09-12T17:36:54.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.507+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=4EIN2GVQ3J6R type=del size=4123892 2024-09-12T17:36:54.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.508+0000 7fa80ca76780 1 < completed write operation key=R871XU2TDWID tag=2QOEK8J1JRSE type=write size=1037053 2024-09-12T17:36:54.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.510+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~79K23V2J02HW.0 size=634761 2024-09-12T17:36:54.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.510+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=79K23V2J02HW tag=BL0DJ18T5FOA type=write size=1683337 2024-09-12T17:36:54.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.512+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~93JEMGDS64E1.0 size=1048576 2024-09-12T17:36:54.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.512+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~93JEMGDS64E1.1 size=1048576 2024-09-12T17:36:54.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.513+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~93JEMGDS64E1.2 size=787125 2024-09-12T17:36:54.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.515+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=93JEMGDS64E1 tag=Q5RAJZSI2VNE type=write size=3932853 2024-09-12T17:36:54.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.516+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=1412W0G8CDWE type=del size=392874 2024-09-12T17:36:54.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.519+0000 7fa80ca76780 1 < suggested remove operation key=OJPZAWR5BLBN tag=JSHKBA5L6X3H type=del 2024-09-12T17:36:54.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.520+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=K90GLJZ4GEBC type=del size=278669 2024-09-12T17:36:54.522 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.521+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=A03AJ97P1Y1N type=del 2024-09-12T17:36:54.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.522+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=RBXMT6LEAWUE type=del size=706233 2024-09-12T17:36:54.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.523+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=U0TB8HHUBST4 type=del 2024-09-12T17:36:54.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.524+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=2ES6Y2V42N3P type=del size=606734 2024-09-12T17:36:54.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.526+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=DL6YHWOJJRYS type=del 2024-09-12T17:36:54.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.527+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=TWBP361URN9B type=write size=670664 2024-09-12T17:36:54.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.529+0000 7fa80ca76780 1 < suggested update operation key=VNGH1DA1HANC tag=JS8WH7W75WO6 type=del size=100219 2024-09-12T17:36:54.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.530+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=UD3CMI64PJ10 type=del size=2027524 2024-09-12T17:36:54.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.531+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~YZJXLTKAO1RI.0 size=1048576 2024-09-12T17:36:54.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.532+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~YZJXLTKAO1RI.1 size=107974 2024-09-12T17:36:54.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.535+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=YZJXLTKAO1RI tag=WO0L302ON9JI type=write size=2205126 2024-09-12T17:36:54.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.536+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=EZ8BXX0HY4I7 type=del size=1924790 2024-09-12T17:36:54.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.537+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=P4J0OLGJ78T5 type=del 2024-09-12T17:36:54.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.539+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=2WVYTJ9X6CLC type=del size=1825309 2024-09-12T17:36:54.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.540+0000 7fa80ca76780 1 < completed delete operation key=H87S6AI6JT6D tag=7SJ6D1F6Z7EE type=del 2024-09-12T17:36:54.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.541+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=ZCBOA2CXJ6TY type=del size=2789708 2024-09-12T17:36:54.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.542+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=0B54CL04I4XS type=del 2024-09-12T17:36:54.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.544+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~JQ3VAOWX9DNB.0 size=1048576 2024-09-12T17:36:54.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.545+0000 7fa80ca76780 1 > prepared part key=_multipart_07LPSZT2RKCC.2~JQ3VAOWX9DNB.1 size=698629 2024-09-12T17:36:54.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.545+0000 7fa80ca76780 1 > prepared multipart upload key=07LPSZT2RKCC upload=JQ3VAOWX9DNB tag=UCJ3ZBYXFNV8 type=write size=2795781 2024-09-12T17:36:54.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.547+0000 7fa80ca76780 1 < canceled operation key=E25BUY271ZSI tag=UZI0EVBDK9WL type=del size=1979008 2024-09-12T17:36:54.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.548+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=VAD1ZY2KDVJA type=del size=3049507 2024-09-12T17:36:54.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.550+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=OZSD1AC7UXR3 type=del 2024-09-12T17:36:54.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.551+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=ZTFKU9D6UXV4 type=del size=1727376 2024-09-12T17:36:54.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.552+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~N9WOFVL1CI4F.0 size=1048576 2024-09-12T17:36:54.554 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.553+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~N9WOFVL1CI4F.1 size=1048576 2024-09-12T17:36:54.555 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.554+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~N9WOFVL1CI4F.2 size=601661 2024-09-12T17:36:54.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.556+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=N9WOFVL1CI4F tag=XG27RW463X47 type=write size=3747389 2024-09-12T17:36:54.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.557+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=042AL1X1640W type=del size=3738178 2024-09-12T17:36:54.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.558+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~GTL9MOVHN681.0 size=497036 2024-09-12T17:36:54.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.560+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=GTL9MOVHN681 tag=KQWMYH0ZS2NP type=write size=1545612 2024-09-12T17:36:54.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.562+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=MP9LA4HDR0YE type=del size=981334 2024-09-12T17:36:54.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.563+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=4EIN2GVQ3J6R type=del 2024-09-12T17:36:54.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.564+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=V0NAGKADQFPP type=del size=1708910 2024-09-12T17:36:54.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.565+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~79K23V2J02HW.0 size=634761 2024-09-12T17:36:54.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.568+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=79K23V2J02HW tag=BL0DJ18T5FOA type=write size=1683337 2024-09-12T17:36:54.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.570+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~H9144VTK6RMY.0 size=836945 2024-09-12T17:36:54.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.570+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=H9144VTK6RMY tag=PHTJAPN32JEQ type=write size=1885521 2024-09-12T17:36:54.574 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.573+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=1412W0G8CDWE type=del 2024-09-12T17:36:54.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.574+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=UWIW54WV2EU0 type=del size=2362214 2024-09-12T17:36:54.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.576+0000 7fa80ca76780 1 < suggested update operation key=H87S6AI6JT6D tag=K90GLJZ4GEBC type=del size=278669 2024-09-12T17:36:54.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.579+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~HDCOIB9PHNPI.0 size=1048576 2024-09-12T17:36:54.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.580+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~HDCOIB9PHNPI.1 size=1048576 2024-09-12T17:36:54.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.581+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~HDCOIB9PHNPI.2 size=312019 2024-09-12T17:36:54.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.581+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=HDCOIB9PHNPI tag=ROET8JZ8W7CF type=write size=3457747 2024-09-12T17:36:54.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.582+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=RBXMT6LEAWUE type=del 2024-09-12T17:36:54.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.583+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=5ZVWKVIO7CSQ type=del size=147772 2024-09-12T17:36:54.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.585+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=2ES6Y2V42N3P type=del 2024-09-12T17:36:54.587 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.586+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=8GYNV62GKDGN type=del size=3345532 2024-09-12T17:36:54.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.588+0000 7fa80ca76780 1 < completed write operation key=FKK4IGD1436I tag=TWBP361URN9B type=write size=670664 2024-09-12T17:36:54.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.589+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=XT4MNC4MKEZ5 type=del size=2739483 2024-09-12T17:36:54.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.592+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=UD3CMI64PJ10 type=del 2024-09-12T17:36:54.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.593+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=12A8O9RO32OB type=del size=3187775 2024-09-12T17:36:54.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.595+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=EZ8BXX0HY4I7 type=del 2024-09-12T17:36:54.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.596+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=QV4U5YFPAPTJ type=del size=4043415 2024-09-12T17:36:54.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.597+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=2WVYTJ9X6CLC type=del 2024-09-12T17:36:54.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.598+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=FNYV2BZEM1NL type=del size=3952166 2024-09-12T17:36:54.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.599+0000 7fa80ca76780 -1 < failed to complete operation key=H87S6AI6JT6D tag=ZCBOA2CXJ6TY type=del size=2789708: (22) Invalid argument 2024-09-12T17:36:54.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.602+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~INO6NP1O3A12.0 size=34985 2024-09-12T17:36:54.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.602+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=INO6NP1O3A12 tag=9P5A19O740GE type=write size=1083561 2024-09-12T17:36:54.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.603+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~JQ3VAOWX9DNB.0 size=1048576 2024-09-12T17:36:54.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.604+0000 7fa80ca76780 1 < completed part key=_multipart_07LPSZT2RKCC.2~JQ3VAOWX9DNB.1 size=698629 2024-09-12T17:36:54.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.606+0000 7fa80ca76780 1 < completed multipart upload key=07LPSZT2RKCC upload=JQ3VAOWX9DNB tag=UCJ3ZBYXFNV8 type=write size=2795781 2024-09-12T17:36:54.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.608+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~UY41SQLD2EQK.0 size=1048576 2024-09-12T17:36:54.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.609+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~UY41SQLD2EQK.1 size=975467 2024-09-12T17:36:54.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.609+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=UY41SQLD2EQK tag=IKZLESW1WQ3J type=write size=3072619 2024-09-12T17:36:54.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.612+0000 7fa80ca76780 1 < suggested remove operation key=K243DOYPYVDS tag=VAD1ZY2KDVJA type=del 2024-09-12T17:36:54.614 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.613+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=JQAC9GAXPWCY type=del size=2949924 2024-09-12T17:36:54.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.615+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=ZTFKU9D6UXV4 type=del 2024-09-12T17:36:54.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.617+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~FB4OFOZB7V5I.0 size=327815 2024-09-12T17:36:54.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.617+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=FB4OFOZB7V5I tag=XS48PB1M2KTT type=write size=1376391 2024-09-12T17:36:54.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.619+0000 7fa80ca76780 1 < completed delete operation key=FKK4IGD1436I tag=042AL1X1640W type=del 2024-09-12T17:36:54.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.620+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=1SLSPQL12U1R type=del size=524267 2024-09-12T17:36:54.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.621+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=MP9LA4HDR0YE type=del 2024-09-12T17:36:54.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.622+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=MY8P97F3YQTW type=del size=2451139 2024-09-12T17:36:54.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.624+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=V0NAGKADQFPP type=del 2024-09-12T17:36:54.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.625+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=O5K3KZV6VLQ2 type=del size=2404209 2024-09-12T17:36:54.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.625+0000 7fa80ca76780 1 < canceled part key=_multipart_RC1IX4DQREEP.2~H9144VTK6RMY.0 size=836945 2024-09-12T17:36:54.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.627+0000 7fa80ca76780 1 < canceled multipart upload key=RC1IX4DQREEP upload=H9144VTK6RMY tag=PHTJAPN32JEQ type=write size=1885521 2024-09-12T17:36:54.630 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.629+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~CR23V6GE6NHH.0 size=1048576 2024-09-12T17:36:54.631 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.630+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~CR23V6GE6NHH.1 size=327241 2024-09-12T17:36:54.631 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.630+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=CR23V6GE6NHH tag=7MJEOSPGX20Q type=write size=2424393 2024-09-12T17:36:54.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.631+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=UWIW54WV2EU0 type=del 2024-09-12T17:36:54.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.632+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=284NMO53667Z type=del size=1486051 2024-09-12T17:36:54.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.633+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~HDCOIB9PHNPI.0 size=1048576 2024-09-12T17:36:54.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.634+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~HDCOIB9PHNPI.1 size=1048576 2024-09-12T17:36:54.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.635+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~HDCOIB9PHNPI.2 size=312019 2024-09-12T17:36:54.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.637+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=HDCOIB9PHNPI tag=ROET8JZ8W7CF type=write size=3457747 2024-09-12T17:36:54.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.638+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=3YA2YEHA5BSG type=del size=1592611 2024-09-12T17:36:54.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.641+0000 7fa80ca76780 1 < suggested remove operation key=0X3LGXL2QFRN tag=5ZVWKVIO7CSQ type=del 2024-09-12T17:36:54.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.643+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~Z0KBB9KJ3QR0.0 size=1048576 2024-09-12T17:36:54.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.644+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~Z0KBB9KJ3QR0.1 size=1048576 2024-09-12T17:36:54.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.645+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~Z0KBB9KJ3QR0.2 size=170050 2024-09-12T17:36:54.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.645+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=Z0KBB9KJ3QR0 tag=UE90DEDSMYRS type=write size=3315778 2024-09-12T17:36:54.647 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.646+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=8GYNV62GKDGN type=del 2024-09-12T17:36:54.648 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.647+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=04J40MQB4B4O type=del size=1993425 2024-09-12T17:36:54.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.649+0000 7fa80ca76780 1 < suggested remove operation key=94801LE91HZ9 tag=XT4MNC4MKEZ5 type=del 2024-09-12T17:36:54.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.651+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=34XGCTWTGQ4X type=write size=467009 2024-09-12T17:36:54.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.652+0000 7fa80ca76780 1 < completed delete operation key=07LPSZT2RKCC tag=12A8O9RO32OB type=del 2024-09-12T17:36:54.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.653+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=5GUWUTNUBV53 type=write size=406240 2024-09-12T17:36:54.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.655+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=QV4U5YFPAPTJ type=del 2024-09-12T17:36:54.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.656+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=IPH2ENDEEHH0 type=del size=3695871 2024-09-12T17:36:54.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.657+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=FNYV2BZEM1NL type=del 2024-09-12T17:36:54.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.659+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~EIHEY0KV88EM.0 size=1048576 2024-09-12T17:36:54.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.660+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~EIHEY0KV88EM.1 size=124261 2024-09-12T17:36:54.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.660+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=EIHEY0KV88EM tag=GP4OBCGWZCOM type=write size=2221413 2024-09-12T17:36:54.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.661+0000 7fa80ca76780 1 < canceled part key=_multipart_E25BUY271ZSI.2~INO6NP1O3A12.0 size=34985 2024-09-12T17:36:54.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.663+0000 7fa80ca76780 1 < canceled multipart upload key=E25BUY271ZSI upload=INO6NP1O3A12 tag=9P5A19O740GE type=write size=1083561 2024-09-12T17:36:54.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.665+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~6HU3QQVDQPTG.0 size=1048576 2024-09-12T17:36:54.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.666+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~6HU3QQVDQPTG.1 size=106234 2024-09-12T17:36:54.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.666+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=6HU3QQVDQPTG tag=0VYE1VCUY6VZ type=write size=2203386 2024-09-12T17:36:54.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.667+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~UY41SQLD2EQK.0 size=1048576 2024-09-12T17:36:54.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.667+0000 7fa80ca76780 1 < canceled part key=_multipart_0J6RTRJWZP1T.2~UY41SQLD2EQK.1 size=975467 2024-09-12T17:36:54.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.669+0000 7fa80ca76780 1 < canceled multipart upload key=0J6RTRJWZP1T upload=UY41SQLD2EQK tag=IKZLESW1WQ3J type=write size=3072619 2024-09-12T17:36:54.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.670+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=LK8YCS4Q4A59 type=del size=4036268 2024-09-12T17:36:54.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.672+0000 7fa80ca76780 1 < suggested update operation key=BLGMV3S9AY24 tag=JQAC9GAXPWCY type=del size=2949924 2024-09-12T17:36:54.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.674+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=J4EUW7PT7Q7Q type=del size=331208 2024-09-12T17:36:54.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.675+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~FB4OFOZB7V5I.0 size=327815 2024-09-12T17:36:54.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.677+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=FB4OFOZB7V5I tag=XS48PB1M2KTT type=write size=1376391 2024-09-12T17:36:54.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.678+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=Z0SMCYHKVOKX type=write size=999881 2024-09-12T17:36:54.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.680+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=1SLSPQL12U1R type=del 2024-09-12T17:36:54.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.681+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=JHSOWDC14NVK type=del size=3773406 2024-09-12T17:36:54.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.682+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=MY8P97F3YQTW type=del 2024-09-12T17:36:54.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.684+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=M60051D498V0 type=del size=1123210 2024-09-12T17:36:54.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.685+0000 7fa80ca76780 1 < canceled operation key=LU7PDGWTAK63 tag=O5K3KZV6VLQ2 type=del size=2404209 2024-09-12T17:36:54.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.686+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=Y9R8VEWXE811 type=del size=1406841 2024-09-12T17:36:54.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.687+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~CR23V6GE6NHH.0 size=1048576 2024-09-12T17:36:54.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.688+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~CR23V6GE6NHH.1 size=327241 2024-09-12T17:36:54.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.690+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=CR23V6GE6NHH tag=7MJEOSPGX20Q type=write size=2424393 2024-09-12T17:36:54.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.693+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~H95E4N9HQGTU.0 size=659985 2024-09-12T17:36:54.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.693+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=H95E4N9HQGTU tag=NJ3RH893EVJ3 type=write size=1708561 2024-09-12T17:36:54.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.694+0000 7fa80ca76780 1 < canceled operation key=U8O04HYQZRJC tag=284NMO53667Z type=del size=1486051 2024-09-12T17:36:54.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.695+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=MGGRHKQKFRXN type=del size=421084 2024-09-12T17:36:54.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.696+0000 7fa80ca76780 1 < canceled operation key=EDRL3T2I9AOO tag=3YA2YEHA5BSG type=del size=1592611 2024-09-12T17:36:54.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.697+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=K0875S1FWBO6 type=write size=424759 2024-09-12T17:36:54.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.699+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~Z0KBB9KJ3QR0.0 size=1048576 2024-09-12T17:36:54.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.700+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~Z0KBB9KJ3QR0.1 size=1048576 2024-09-12T17:36:54.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.701+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~Z0KBB9KJ3QR0.2 size=170050 2024-09-12T17:36:54.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.703+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=Z0KBB9KJ3QR0 tag=UE90DEDSMYRS type=write size=3315778 2024-09-12T17:36:54.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.706+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~47IB6ATLHBJI.0 size=1048576 2024-09-12T17:36:54.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.708+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~47IB6ATLHBJI.1 size=835541 2024-09-12T17:36:54.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.708+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=47IB6ATLHBJI tag=L06NY94YIQZ7 type=write size=2932693 2024-09-12T17:36:54.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.711+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=04J40MQB4B4O type=del 2024-09-12T17:36:54.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.712+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=NGHNMHHTAULS type=del size=4138744 2024-09-12T17:36:54.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.714+0000 7fa80ca76780 1 < completed write operation key=EDRL3T2I9AOO tag=34XGCTWTGQ4X type=write size=467009 2024-09-12T17:36:54.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.715+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=7KK99EKP2ZF8 type=write size=909892 2024-09-12T17:36:54.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.716+0000 7fa80ca76780 1 < completed write operation key=U8O04HYQZRJC tag=5GUWUTNUBV53 type=write size=406240 2024-09-12T17:36:54.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.717+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=W9S4ITCJ8LOV type=del size=2956515 2024-09-12T17:36:54.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.718+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=IPH2ENDEEHH0 type=del 2024-09-12T17:36:54.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.719+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=C998KDJWPKVI type=write size=988179 2024-09-12T17:36:54.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.720+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~EIHEY0KV88EM.0 size=1048576 2024-09-12T17:36:54.722 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.721+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~EIHEY0KV88EM.1 size=124261 2024-09-12T17:36:54.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.723+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=EIHEY0KV88EM tag=GP4OBCGWZCOM type=write size=2221413 2024-09-12T17:36:54.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.725+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~U1JN49TL9E2F.0 size=1048576 2024-09-12T17:36:54.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.726+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~U1JN49TL9E2F.1 size=47968 2024-09-12T17:36:54.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.726+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=U1JN49TL9E2F tag=JL13NE1FIVT6 type=write size=2145120 2024-09-12T17:36:54.729 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.728+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~6HU3QQVDQPTG.0 size=1048576 2024-09-12T17:36:54.729 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.728+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~6HU3QQVDQPTG.1 size=106234 2024-09-12T17:36:54.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.730+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=6HU3QQVDQPTG tag=0VYE1VCUY6VZ type=write size=2203386 2024-09-12T17:36:54.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.732+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=OB6SA5FGDDIU type=del size=3741819 2024-09-12T17:36:54.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.733+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=LK8YCS4Q4A59 type=del 2024-09-12T17:36:54.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.735+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~EZ1BTXRP3PRW.0 size=1048576 2024-09-12T17:36:54.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.736+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~EZ1BTXRP3PRW.1 size=1048576 2024-09-12T17:36:54.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.737+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~EZ1BTXRP3PRW.2 size=680235 2024-09-12T17:36:54.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.737+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=EZ1BTXRP3PRW tag=ZQ5T792DF2AB type=write size=3825963 2024-09-12T17:36:54.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.738+0000 7fa80ca76780 1 < canceled operation key=0J6RTRJWZP1T tag=J4EUW7PT7Q7Q type=del size=331208 2024-09-12T17:36:54.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.741+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~WQ0SLY6S9XFO.0 size=258063 2024-09-12T17:36:54.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.741+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=WQ0SLY6S9XFO tag=HKQ1GN4HHQWQ type=write size=1306639 2024-09-12T17:36:54.743 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.742+0000 7fa80ca76780 1 < completed write operation key=07LPSZT2RKCC tag=Z0SMCYHKVOKX type=write size=999881 2024-09-12T17:36:54.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.743+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=9F9FTW5490Y4 type=del size=558088 2024-09-12T17:36:54.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.745+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=JHSOWDC14NVK type=del 2024-09-12T17:36:54.747 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.746+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=WN47S2XF7MBP type=del size=3156342 2024-09-12T17:36:54.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.747+0000 7fa80ca76780 1 < canceled operation key=GKE6623N268Z tag=M60051D498V0 type=del size=1123210 2024-09-12T17:36:54.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.748+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=B3HC3LWNSN9L type=del size=1112304 2024-09-12T17:36:54.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.749+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=Y9R8VEWXE811 type=del 2024-09-12T17:36:54.752 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.751+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=CZYA5KTGJIEK type=del size=3195027 2024-09-12T17:36:54.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.752+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~H95E4N9HQGTU.0 size=659985 2024-09-12T17:36:54.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.754+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=H95E4N9HQGTU tag=NJ3RH893EVJ3 type=write size=1708561 2024-09-12T17:36:54.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.756+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~TVI5G3T71TTT.0 size=1048576 2024-09-12T17:36:54.758 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.757+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~TVI5G3T71TTT.1 size=1021984 2024-09-12T17:36:54.758 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.757+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=TVI5G3T71TTT tag=IR2VYPA4K38Y type=write size=3119136 2024-09-12T17:36:54.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.759+0000 7fa80ca76780 1 < suggested remove operation key=OJPZAWR5BLBN tag=MGGRHKQKFRXN type=del 2024-09-12T17:36:54.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.760+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=M8IE9N5SRTHN type=write size=854136 2024-09-12T17:36:54.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.761+0000 7fa80ca76780 1 < completed write operation key=VNGH1DA1HANC tag=K0875S1FWBO6 type=write size=424759 2024-09-12T17:36:54.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.762+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=GDKLTMD115A9 type=del size=3458479 2024-09-12T17:36:54.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.764+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~47IB6ATLHBJI.0 size=1048576 2024-09-12T17:36:54.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.765+0000 7fa80ca76780 1 < completed part key=_multipart_5CAG55DQEF3Y.2~47IB6ATLHBJI.1 size=835541 2024-09-12T17:36:54.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.767+0000 7fa80ca76780 1 < completed multipart upload key=5CAG55DQEF3Y upload=47IB6ATLHBJI tag=L06NY94YIQZ7 type=write size=2932693 2024-09-12T17:36:54.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.769+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~USVFLNIOXYSX.0 size=1048576 2024-09-12T17:36:54.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.770+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~USVFLNIOXYSX.1 size=328317 2024-09-12T17:36:54.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.770+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=USVFLNIOXYSX tag=ONBYUAR2V6QI type=write size=2425469 2024-09-12T17:36:54.773 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.772+0000 7fa80ca76780 1 < suggested update operation key=0U9KSMYWT2C3 tag=NGHNMHHTAULS type=del size=4138744 2024-09-12T17:36:54.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.774+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=VK88GKTBRFAX type=del size=63324 2024-09-12T17:36:54.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.776+0000 7fa80ca76780 1 < suggested remove operation key=Z81704G91EPL tag=7KK99EKP2ZF8 type=write 2024-09-12T17:36:54.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.778+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~D2IK99FLEIO5.0 size=1048576 2024-09-12T17:36:54.780 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.779+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~D2IK99FLEIO5.1 size=1048576 2024-09-12T17:36:54.781 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.780+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~D2IK99FLEIO5.2 size=965390 2024-09-12T17:36:54.781 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.780+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=D2IK99FLEIO5 tag=GA0A4VRT6KYJ type=write size=4111118 2024-09-12T17:36:54.782 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.781+0000 7fa80ca76780 1 < completed delete operation key=VC1X03K12V80 tag=W9S4ITCJ8LOV type=del 2024-09-12T17:36:54.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.782+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=AKHUR4B55H5L type=del size=4022677 2024-09-12T17:36:54.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.783+0000 7fa80ca76780 1 < completed write operation key=BLGMV3S9AY24 tag=C998KDJWPKVI type=write size=988179 2024-09-12T17:36:54.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.785+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~IYB13DK889UW.0 size=1048576 2024-09-12T17:36:54.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.786+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~IYB13DK889UW.1 size=1048576 2024-09-12T17:36:54.788 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.787+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~IYB13DK889UW.2 size=60275 2024-09-12T17:36:54.788 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.787+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=IYB13DK889UW tag=22NJX4MCT6H2 type=write size=3206003 2024-09-12T17:36:54.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.788+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~U1JN49TL9E2F.0 size=1048576 2024-09-12T17:36:54.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.789+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~U1JN49TL9E2F.1 size=47968 2024-09-12T17:36:54.792 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.791+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=U1JN49TL9E2F tag=JL13NE1FIVT6 type=write size=2145120 2024-09-12T17:36:54.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.793+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~A9CD437NLRW6.0 size=1048576 2024-09-12T17:36:54.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.794+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~A9CD437NLRW6.1 size=1048576 2024-09-12T17:36:54.796 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.795+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~A9CD437NLRW6.2 size=758528 2024-09-12T17:36:54.796 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.795+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=A9CD437NLRW6 tag=IW4RLCN36KN2 type=write size=3904256 2024-09-12T17:36:54.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.797+0000 7fa80ca76780 1 < suggested update operation key=E25BUY271ZSI tag=OB6SA5FGDDIU type=del size=3741819 2024-09-12T17:36:54.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.799+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~BYR4ZT9RAQJV.0 size=143709 2024-09-12T17:36:54.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.799+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=BYR4ZT9RAQJV tag=XHQPGLUBKBS7 type=write size=1192285 2024-09-12T17:36:54.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.800+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~EZ1BTXRP3PRW.0 size=1048576 2024-09-12T17:36:54.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.801+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~EZ1BTXRP3PRW.1 size=1048576 2024-09-12T17:36:54.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.802+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~EZ1BTXRP3PRW.2 size=680235 2024-09-12T17:36:54.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.804+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=EZ1BTXRP3PRW tag=ZQ5T792DF2AB type=write size=3825963 2024-09-12T17:36:54.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.805+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=ZXL4WX58EY1G type=write size=284142 2024-09-12T17:36:54.807 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.806+0000 7fa80ca76780 1 < completed part key=_multipart_OJPZAWR5BLBN.2~WQ0SLY6S9XFO.0 size=258063 2024-09-12T17:36:54.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.808+0000 7fa80ca76780 1 < completed multipart upload key=OJPZAWR5BLBN upload=WQ0SLY6S9XFO tag=HKQ1GN4HHQWQ type=write size=1306639 2024-09-12T17:36:54.812 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.811+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~ROYB9PA3DQN0.0 size=1048576 2024-09-12T17:36:54.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.812+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~ROYB9PA3DQN0.1 size=304021 2024-09-12T17:36:54.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.812+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=ROYB9PA3DQN0 tag=HJ35R684MBFX type=write size=2401173 2024-09-12T17:36:54.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.813+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=9F9FTW5490Y4 type=del 2024-09-12T17:36:54.816 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.815+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~1AU7CWFF0D5P.0 size=1048576 2024-09-12T17:36:54.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.816+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~1AU7CWFF0D5P.1 size=1048576 2024-09-12T17:36:54.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.819+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~1AU7CWFF0D5P.2 size=564842 2024-09-12T17:36:54.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.819+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=1AU7CWFF0D5P tag=SVUFFHJ9OR9S type=write size=3710570 2024-09-12T17:36:54.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.820+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=WN47S2XF7MBP type=del 2024-09-12T17:36:54.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.822+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~ZRS5LKZ8JS6Z.0 size=1048576 2024-09-12T17:36:54.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.823+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~ZRS5LKZ8JS6Z.1 size=1003870 2024-09-12T17:36:54.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.823+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=ZRS5LKZ8JS6Z tag=CGXUFV2SHT5V type=write size=3101022 2024-09-12T17:36:54.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.824+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=B3HC3LWNSN9L type=del 2024-09-12T17:36:54.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.825+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=LLMGWHZZZ2WO type=write size=199530 2024-09-12T17:36:54.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.826+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=CZYA5KTGJIEK type=del 2024-09-12T17:36:54.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.828+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~3ET6VF3ORH2D.0 size=620768 2024-09-12T17:36:54.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.828+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=3ET6VF3ORH2D tag=B4LAJZBJ9XCD type=write size=1669344 2024-09-12T17:36:54.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.829+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~TVI5G3T71TTT.0 size=1048576 2024-09-12T17:36:54.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.830+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~TVI5G3T71TTT.1 size=1021984 2024-09-12T17:36:54.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.832+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=TVI5G3T71TTT tag=IR2VYPA4K38Y type=write size=3119136 2024-09-12T17:36:54.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.833+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=77CBUAGYTAUS type=write size=297886 2024-09-12T17:36:54.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.835+0000 7fa80ca76780 -1 < failed to complete operation key=0U9KSMYWT2C3 tag=M8IE9N5SRTHN type=write size=854136: (22) Invalid argument 2024-09-12T17:36:54.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.836+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=59ALWFTG2IH7 type=del size=2391430 2024-09-12T17:36:54.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.837+0000 7fa80ca76780 -1 < failed to complete operation key=Z81704G91EPL tag=GDKLTMD115A9 type=del size=3458479: (22) Invalid argument 2024-09-12T17:36:54.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.838+0000 7fa80ca76780 1 > prepared operation key=BLGMV3S9AY24 tag=TYQDU0KS9ZGE type=write size=775578 2024-09-12T17:36:54.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.839+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~USVFLNIOXYSX.0 size=1048576 2024-09-12T17:36:54.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.840+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~USVFLNIOXYSX.1 size=328317 2024-09-12T17:36:54.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.842+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=USVFLNIOXYSX tag=ONBYUAR2V6QI type=write size=2425469 2024-09-12T17:36:54.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.843+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=K2AAVOV98VTQ type=write size=141582 2024-09-12T17:36:54.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.845+0000 7fa80ca76780 1 < suggested remove operation key=GKE6623N268Z tag=VK88GKTBRFAX type=del 2024-09-12T17:36:54.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.847+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~0P9ABW8TNDKN.0 size=1048576 2024-09-12T17:36:54.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.848+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~0P9ABW8TNDKN.1 size=244168 2024-09-12T17:36:54.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.848+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=0P9ABW8TNDKN tag=PQVYEGT2YE9K type=write size=2341320 2024-09-12T17:36:54.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.850+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~D2IK99FLEIO5.0 size=1048576 2024-09-12T17:36:54.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.851+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~D2IK99FLEIO5.1 size=1048576 2024-09-12T17:36:54.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.852+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~D2IK99FLEIO5.2 size=965390 2024-09-12T17:36:54.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.854+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=D2IK99FLEIO5 tag=GA0A4VRT6KYJ type=write size=4111118 2024-09-12T17:36:54.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.855+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=BZS2XQA8IM5Y type=del size=2961596 2024-09-12T17:36:54.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.857+0000 7fa80ca76780 1 < suggested remove operation key=0U9KSMYWT2C3 tag=AKHUR4B55H5L type=del 2024-09-12T17:36:54.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.859+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~B566YYV36W2N.0 size=1048576 2024-09-12T17:36:54.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.860+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~B566YYV36W2N.1 size=1048576 2024-09-12T17:36:54.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.861+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~B566YYV36W2N.2 size=626946 2024-09-12T17:36:54.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.861+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=B566YYV36W2N tag=9D11XJ78USDT type=write size=3772674 2024-09-12T17:36:54.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.862+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~IYB13DK889UW.0 size=1048576 2024-09-12T17:36:54.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.863+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~IYB13DK889UW.1 size=1048576 2024-09-12T17:36:54.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.864+0000 7fa80ca76780 1 < completed part key=_multipart_R871XU2TDWID.2~IYB13DK889UW.2 size=60275 2024-09-12T17:36:54.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.866+0000 7fa80ca76780 1 < completed multipart upload key=R871XU2TDWID upload=IYB13DK889UW tag=22NJX4MCT6H2 type=write size=3206003 2024-09-12T17:36:54.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.868+0000 7fa80ca76780 1 > prepared part key=_multipart_R02234GEWV6B.2~VT1A9RFCAB8Q.0 size=778491 2024-09-12T17:36:54.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.868+0000 7fa80ca76780 1 > prepared multipart upload key=R02234GEWV6B upload=VT1A9RFCAB8Q tag=806M4XT7GN43 type=write size=1827067 2024-09-12T17:36:54.870 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.869+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~A9CD437NLRW6.0 size=1048576 2024-09-12T17:36:54.871 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.870+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~A9CD437NLRW6.1 size=1048576 2024-09-12T17:36:54.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.871+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~A9CD437NLRW6.2 size=758528 2024-09-12T17:36:54.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.873+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=A9CD437NLRW6 tag=IW4RLCN36KN2 type=write size=3904256 2024-09-12T17:36:54.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.874+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=PFY4WFWGQ3MP type=del size=2238688 2024-09-12T17:36:54.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.875+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~BYR4ZT9RAQJV.0 size=143709 2024-09-12T17:36:54.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.877+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=BYR4ZT9RAQJV tag=XHQPGLUBKBS7 type=write size=1192285 2024-09-12T17:36:54.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.878+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=MIZOD05KV4I5 type=del size=4045406 2024-09-12T17:36:54.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.880+0000 7fa80ca76780 1 < completed write operation key=2AGKLZ3PQ2FD tag=ZXL4WX58EY1G type=write size=284142 2024-09-12T17:36:54.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.881+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=B8L34EIS92C7 type=write size=150010 2024-09-12T17:36:54.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.882+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~ROYB9PA3DQN0.0 size=1048576 2024-09-12T17:36:54.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.883+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~ROYB9PA3DQN0.1 size=304021 2024-09-12T17:36:54.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.885+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=ROYB9PA3DQN0 tag=HJ35R684MBFX type=write size=2401173 2024-09-12T17:36:54.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.886+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=7WF3V2I2LLO0 type=del size=4177380 2024-09-12T17:36:54.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.887+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~1AU7CWFF0D5P.0 size=1048576 2024-09-12T17:36:54.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.888+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~1AU7CWFF0D5P.1 size=1048576 2024-09-12T17:36:54.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.889+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~1AU7CWFF0D5P.2 size=564842 2024-09-12T17:36:54.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.891+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=1AU7CWFF0D5P tag=SVUFFHJ9OR9S type=write size=3710570 2024-09-12T17:36:54.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.893+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~0BPCTLCJ29EI.0 size=1048576 2024-09-12T17:36:54.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.894+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~0BPCTLCJ29EI.1 size=1048576 2024-09-12T17:36:54.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.895+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~0BPCTLCJ29EI.2 size=413581 2024-09-12T17:36:54.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.895+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=0BPCTLCJ29EI tag=202BBJ25IFRU type=write size=3559309 2024-09-12T17:36:54.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.896+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~ZRS5LKZ8JS6Z.0 size=1048576 2024-09-12T17:36:54.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.897+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~ZRS5LKZ8JS6Z.1 size=1003870 2024-09-12T17:36:54.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.899+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=ZRS5LKZ8JS6Z tag=CGXUFV2SHT5V type=write size=3101022 2024-09-12T17:36:54.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.900+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=Q3T9GHC0BOKA type=del size=3301088 2024-09-12T17:36:54.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.901+0000 7fa80ca76780 1 < completed write operation key=07LPSZT2RKCC tag=LLMGWHZZZ2WO type=write size=199530 2024-09-12T17:36:54.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.903+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=AWYOI81OK5QF type=del size=2159356 2024-09-12T17:36:54.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.904+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~3ET6VF3ORH2D.0 size=620768 2024-09-12T17:36:54.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.906+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=3ET6VF3ORH2D tag=B4LAJZBJ9XCD type=write size=1669344 2024-09-12T17:36:54.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.907+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=5YHDW2PEZ2RL type=del size=3175016 2024-09-12T17:36:54.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.908+0000 7fa80ca76780 1 < completed write operation key=MSZUYX441Y66 tag=77CBUAGYTAUS type=write size=297886 2024-09-12T17:36:54.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.910+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~O68V11UD652S.0 size=146944 2024-09-12T17:36:54.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.910+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=O68V11UD652S tag=JAL9EWEAC13K type=write size=1195520 2024-09-12T17:36:54.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.912+0000 7fa80ca76780 1 < suggested remove operation key=94801LE91HZ9 tag=59ALWFTG2IH7 type=del 2024-09-12T17:36:54.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.914+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=2ONAV4855TIA type=del size=52636 2024-09-12T17:36:54.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.915+0000 7fa80ca76780 1 < completed write operation key=BLGMV3S9AY24 tag=TYQDU0KS9ZGE type=write size=775578 2024-09-12T17:36:54.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.916+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=E00K34RS9ANM type=del size=2924039 2024-09-12T17:36:54.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.917+0000 7fa80ca76780 1 < canceled operation key=R871XU2TDWID tag=K2AAVOV98VTQ type=write size=141582 2024-09-12T17:36:54.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.918+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=UV2CB2B9T18U type=del size=959757 2024-09-12T17:36:54.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.920+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~0P9ABW8TNDKN.0 size=1048576 2024-09-12T17:36:54.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.921+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~0P9ABW8TNDKN.1 size=244168 2024-09-12T17:36:54.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.923+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=0P9ABW8TNDKN tag=PQVYEGT2YE9K type=write size=2341320 2024-09-12T17:36:54.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.924+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=1BAFBB632EXS type=del size=2607236 2024-09-12T17:36:54.927 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.926+0000 7fa80ca76780 1 < canceled operation key=WGL9JYJXSHBH tag=BZS2XQA8IM5Y type=del size=2961596 2024-09-12T17:36:54.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.928+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~3WPKGY8UC8T4.0 size=1048576 2024-09-12T17:36:54.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.929+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~3WPKGY8UC8T4.1 size=397162 2024-09-12T17:36:54.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.929+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=3WPKGY8UC8T4 tag=UZ26B8RU9UDX type=write size=2494314 2024-09-12T17:36:54.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.930+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~B566YYV36W2N.0 size=1048576 2024-09-12T17:36:54.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.931+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~B566YYV36W2N.1 size=1048576 2024-09-12T17:36:54.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.932+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~B566YYV36W2N.2 size=626946 2024-09-12T17:36:54.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.934+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=B566YYV36W2N tag=9D11XJ78USDT type=write size=3772674 2024-09-12T17:36:54.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.936+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=R5IG76VMZWJH type=del size=2193511 2024-09-12T17:36:54.938 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.937+0000 7fa80ca76780 1 < completed part key=_multipart_R02234GEWV6B.2~VT1A9RFCAB8Q.0 size=778491 2024-09-12T17:36:54.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.939+0000 7fa80ca76780 1 < completed multipart upload key=R02234GEWV6B upload=VT1A9RFCAB8Q tag=806M4XT7GN43 type=write size=1827067 2024-09-12T17:36:54.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.940+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~C6L11VPGA2DP.0 size=1048576 2024-09-12T17:36:54.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.941+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~C6L11VPGA2DP.1 size=700715 2024-09-12T17:36:54.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.941+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=C6L11VPGA2DP tag=UY51C9DVCSO0 type=write size=2797867 2024-09-12T17:36:54.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.943+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=PFY4WFWGQ3MP type=del 2024-09-12T17:36:54.945 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.944+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=WJGR0LIYM2NI type=write size=755478 2024-09-12T17:36:54.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.945+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=MIZOD05KV4I5 type=del 2024-09-12T17:36:54.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.947+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=G76ANJOJNHGE type=del size=1725419 2024-09-12T17:36:54.949 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.948+0000 7fa80ca76780 1 < completed write operation key=2AGKLZ3PQ2FD tag=B8L34EIS92C7 type=write size=150010 2024-09-12T17:36:54.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.950+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~MX7QWE7QB56B.0 size=373793 2024-09-12T17:36:54.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.950+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=MX7QWE7QB56B tag=D3358WM6X72P type=write size=1422369 2024-09-12T17:36:54.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.952+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=7WF3V2I2LLO0 type=del 2024-09-12T17:36:54.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.953+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=FLKOSNBEC6HA type=del size=3900796 2024-09-12T17:36:54.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.954+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~0BPCTLCJ29EI.0 size=1048576 2024-09-12T17:36:54.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.955+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~0BPCTLCJ29EI.1 size=1048576 2024-09-12T17:36:54.958 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.957+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~0BPCTLCJ29EI.2 size=413581 2024-09-12T17:36:54.960 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.959+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=0BPCTLCJ29EI tag=202BBJ25IFRU type=write size=3559309 2024-09-12T17:36:54.961 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.960+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=XVALA8OHIN27 type=del size=1051844 2024-09-12T17:36:54.963 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.962+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=Q3T9GHC0BOKA type=del 2024-09-12T17:36:54.964 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.963+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=2JU42I21I9A2 type=del size=1077037 2024-09-12T17:36:54.966 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.964+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=AWYOI81OK5QF type=del 2024-09-12T17:36:54.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.966+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=VM5OCRUKMQX3 type=del size=3042063 2024-09-12T17:36:54.968 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.967+0000 7fa80ca76780 1 < canceled operation key=R02234GEWV6B tag=5YHDW2PEZ2RL type=del size=3175016 2024-09-12T17:36:54.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.969+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~NQ27Z9D2ZK6Y.0 size=1048576 2024-09-12T17:36:54.971 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.970+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~NQ27Z9D2ZK6Y.1 size=87096 2024-09-12T17:36:54.971 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.970+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=NQ27Z9D2ZK6Y tag=DA3GUM6J91MM type=write size=2184248 2024-09-12T17:36:54.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.971+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~O68V11UD652S.0 size=146944 2024-09-12T17:36:54.974 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.973+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=O68V11UD652S tag=JAL9EWEAC13K type=write size=1195520 2024-09-12T17:36:54.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.974+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=IQLGP3X0SZ7B type=write size=206268 2024-09-12T17:36:54.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.976+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=2ONAV4855TIA type=del 2024-09-12T17:36:54.978 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.977+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=GG6EB891JZ1N type=del size=2419304 2024-09-12T17:36:54.979 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.978+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=E00K34RS9ANM type=del 2024-09-12T17:36:54.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.979+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=6QI17OGVTN7U type=del size=320367 2024-09-12T17:36:54.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.982+0000 7fa80ca76780 1 < suggested remove operation key=GKE6623N268Z tag=UV2CB2B9T18U type=del 2024-09-12T17:36:54.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.983+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=CPPFO69YZCY1 type=del size=4004365 2024-09-12T17:36:54.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.984+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=1BAFBB632EXS type=del 2024-09-12T17:36:54.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.985+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=LJEE36TEM6SV type=del size=3802590 2024-09-12T17:36:54.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.986+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~3WPKGY8UC8T4.0 size=1048576 2024-09-12T17:36:54.988 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.987+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~3WPKGY8UC8T4.1 size=397162 2024-09-12T17:36:54.990 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.989+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=3WPKGY8UC8T4 tag=UZ26B8RU9UDX type=write size=2494314 2024-09-12T17:36:54.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.991+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=7F6CKBM8SK2U type=del size=2272590 2024-09-12T17:36:54.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.992+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=R5IG76VMZWJH type=del 2024-09-12T17:36:54.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.993+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=4EDCYYPA1NYW type=del size=2205740 2024-09-12T17:36:54.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.994+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~C6L11VPGA2DP.0 size=1048576 2024-09-12T17:36:54.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.996+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~C6L11VPGA2DP.1 size=700715 2024-09-12T17:36:54.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:54.998+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=C6L11VPGA2DP tag=UY51C9DVCSO0 type=write size=2797867 2024-09-12T17:36:55.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.000+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~GHHVPLBXJF4M.0 size=1048576 2024-09-12T17:36:55.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.001+0000 7fa80ca76780 1 > prepared part key=_multipart_LU7PDGWTAK63.2~GHHVPLBXJF4M.1 size=434413 2024-09-12T17:36:55.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.001+0000 7fa80ca76780 1 > prepared multipart upload key=LU7PDGWTAK63 upload=GHHVPLBXJF4M tag=KKXSMF47CFPV type=write size=2531565 2024-09-12T17:36:55.003 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.002+0000 7fa80ca76780 1 < completed write operation key=54KWSI77T73A tag=WJGR0LIYM2NI type=write size=755478 2024-09-12T17:36:55.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.003+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=0HXIDD2NTDNK type=write size=1012643 2024-09-12T17:36:55.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.005+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=G76ANJOJNHGE type=del 2024-09-12T17:36:55.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.006+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=TEQE22XVVFFX type=del size=708564 2024-09-12T17:36:55.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.007+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~MX7QWE7QB56B.0 size=373793 2024-09-12T17:36:55.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.009+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=MX7QWE7QB56B tag=D3358WM6X72P type=write size=1422369 2024-09-12T17:36:55.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.010+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=JIK98Z0FW0K4 type=del size=125762 2024-09-12T17:36:55.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.011+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=FLKOSNBEC6HA type=del 2024-09-12T17:36:55.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.013+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=AI1OP1UJGTV7 type=write size=1026519 2024-09-12T17:36:55.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.014+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=XVALA8OHIN27 type=del 2024-09-12T17:36:55.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.015+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=MSVKNJWWVZAF type=del size=115071 2024-09-12T17:36:55.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.018+0000 7fa80ca76780 1 < suggested remove operation key=RC1IX4DQREEP tag=2JU42I21I9A2 type=del 2024-09-12T17:36:55.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.019+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=0PQNBPQKLT4W type=del size=3453056 2024-09-12T17:36:55.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.020+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=VM5OCRUKMQX3 type=del 2024-09-12T17:36:55.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.022+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=FZUI7K2IE0QM type=del size=24970 2024-09-12T17:36:55.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.023+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~NQ27Z9D2ZK6Y.0 size=1048576 2024-09-12T17:36:55.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.024+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~NQ27Z9D2ZK6Y.1 size=87096 2024-09-12T17:36:55.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.026+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=NQ27Z9D2ZK6Y tag=DA3GUM6J91MM type=write size=2184248 2024-09-12T17:36:55.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.027+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=B9KKG631FMWB type=write size=184414 2024-09-12T17:36:55.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.028+0000 7fa80ca76780 1 < completed write operation key=0J6RTRJWZP1T tag=IQLGP3X0SZ7B type=write size=206268 2024-09-12T17:36:55.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.029+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=3YI3FEG51EFC type=del size=3140825 2024-09-12T17:36:55.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.031+0000 7fa80ca76780 1 < canceled operation key=0X3LGXL2QFRN tag=GG6EB891JZ1N type=del size=2419304 2024-09-12T17:36:55.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.032+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=E9TXQ26Y288Z type=del size=2775772 2024-09-12T17:36:55.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.033+0000 7fa80ca76780 -1 < failed to complete operation key=GKE6623N268Z tag=6QI17OGVTN7U type=del size=320367: (22) Invalid argument 2024-09-12T17:36:55.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.034+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=B2141CTA4IZP type=del size=3981959 2024-09-12T17:36:55.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.035+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=CPPFO69YZCY1 type=del 2024-09-12T17:36:55.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.037+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~IMGUID84KZ29.0 size=1048576 2024-09-12T17:36:55.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.039+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~IMGUID84KZ29.1 size=752277 2024-09-12T17:36:55.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.039+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=IMGUID84KZ29 tag=1UAUAFJY2FBK type=write size=2849429 2024-09-12T17:36:55.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.040+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=LJEE36TEM6SV type=del 2024-09-12T17:36:55.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.043+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~VK12CCNVDFO3.0 size=1048576 2024-09-12T17:36:55.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.044+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~VK12CCNVDFO3.1 size=711863 2024-09-12T17:36:55.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.044+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=VK12CCNVDFO3 tag=RRZQRMPW4LBJ type=write size=2809015 2024-09-12T17:36:55.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.045+0000 7fa80ca76780 1 < canceled operation key=EDRL3T2I9AOO tag=7F6CKBM8SK2U type=del size=2272590 2024-09-12T17:36:55.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.046+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=7XREO2W66LN1 type=del size=1621451 2024-09-12T17:36:55.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.047+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=4EDCYYPA1NYW type=del 2024-09-12T17:36:55.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.049+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=FA7IEJPBP0MG type=del size=3169303 2024-09-12T17:36:55.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.050+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~GHHVPLBXJF4M.0 size=1048576 2024-09-12T17:36:55.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.051+0000 7fa80ca76780 1 < completed part key=_multipart_LU7PDGWTAK63.2~GHHVPLBXJF4M.1 size=434413 2024-09-12T17:36:55.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.053+0000 7fa80ca76780 1 < completed multipart upload key=LU7PDGWTAK63 upload=GHHVPLBXJF4M tag=KKXSMF47CFPV type=write size=2531565 2024-09-12T17:36:55.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.054+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=GZURIJLMN97B type=del size=886101 2024-09-12T17:36:55.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.055+0000 7fa80ca76780 1 < completed write operation key=0X3LGXL2QFRN tag=0HXIDD2NTDNK type=write size=1012643 2024-09-12T17:36:55.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.056+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=OE8FJTZCBGWN type=del size=3299013 2024-09-12T17:36:55.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.057+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=TEQE22XVVFFX type=del 2024-09-12T17:36:55.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.059+0000 7fa80ca76780 1 > prepared part key=_multipart_VDD4PDR1GLWQ.2~YU4LAV9942F1.0 size=1022555 2024-09-12T17:36:55.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.059+0000 7fa80ca76780 1 > prepared multipart upload key=VDD4PDR1GLWQ upload=YU4LAV9942F1 tag=UZY27B5DYFJB type=write size=2071131 2024-09-12T17:36:55.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.061+0000 7fa80ca76780 1 < canceled operation key=AKE8O7Q277HX tag=JIK98Z0FW0K4 type=del size=125762 2024-09-12T17:36:55.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.062+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=3CH4T9KR7KAT type=write size=443917 2024-09-12T17:36:55.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.063+0000 7fa80ca76780 1 < completed write operation key=R02234GEWV6B tag=AI1OP1UJGTV7 type=write size=1026519 2024-09-12T17:36:55.066 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.065+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~1XPZIFJ7PG7L.0 size=1048576 2024-09-12T17:36:55.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.066+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~1XPZIFJ7PG7L.1 size=1048576 2024-09-12T17:36:55.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.067+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~1XPZIFJ7PG7L.2 size=601683 2024-09-12T17:36:55.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.067+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=1XPZIFJ7PG7L tag=VFWZ6N60DE4W type=write size=3747411 2024-09-12T17:36:55.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.068+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=MSVKNJWWVZAF type=del 2024-09-12T17:36:55.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.070+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~OZPQSZFAH54P.0 size=1048576 2024-09-12T17:36:55.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.071+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~OZPQSZFAH54P.1 size=53314 2024-09-12T17:36:55.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.071+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=OZPQSZFAH54P tag=YC5Q658XIPMJ type=write size=2150466 2024-09-12T17:36:55.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.072+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=0PQNBPQKLT4W type=del 2024-09-12T17:36:55.075 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.074+0000 7fa80ca76780 1 > prepared part key=_multipart_GKE6623N268Z.2~1GVYHZC03YDO.0 size=7631 2024-09-12T17:36:55.075 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.074+0000 7fa80ca76780 1 > prepared multipart upload key=GKE6623N268Z upload=1GVYHZC03YDO tag=K1CR8QT443BI type=write size=1056207 2024-09-12T17:36:55.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.075+0000 7fa80ca76780 1 < canceled operation key=GKE6623N268Z tag=FZUI7K2IE0QM type=del size=24970 2024-09-12T17:36:55.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.076+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=P8V1E3POJ8VZ type=del size=1442540 2024-09-12T17:36:55.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.079+0000 7fa80ca76780 1 < suggested update operation key=VDD4PDR1GLWQ tag=B9KKG631FMWB type=write size=184414 2024-09-12T17:36:55.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.080+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=78PR4OHZ4T7I type=write size=621133 2024-09-12T17:36:55.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.081+0000 7fa80ca76780 1 < canceled operation key=Z81704G91EPL tag=3YI3FEG51EFC type=del size=3140825 2024-09-12T17:36:55.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.082+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=81EHZ0C2J0QX type=del size=2286856 2024-09-12T17:36:55.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.083+0000 7fa80ca76780 -1 < failed to complete operation key=VDD4PDR1GLWQ tag=E9TXQ26Y288Z type=del size=2775772: (22) Invalid argument 2024-09-12T17:36:55.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.084+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=N3DRO5Q9KK96 type=del size=2851802 2024-09-12T17:36:55.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.087+0000 7fa80ca76780 1 < suggested update operation key=RC1IX4DQREEP tag=B2141CTA4IZP type=del size=3981959 2024-09-12T17:36:55.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.088+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=RDH1FEPY9Q39 type=del size=880596 2024-09-12T17:36:55.091 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.089+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~IMGUID84KZ29.0 size=1048576 2024-09-12T17:36:55.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.091+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~IMGUID84KZ29.1 size=752277 2024-09-12T17:36:55.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.093+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=IMGUID84KZ29 tag=1UAUAFJY2FBK type=write size=2849429 2024-09-12T17:36:55.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.094+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=40V75F1ZJD16 type=write size=383892 2024-09-12T17:36:55.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.096+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~VK12CCNVDFO3.0 size=1048576 2024-09-12T17:36:55.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.097+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~VK12CCNVDFO3.1 size=711863 2024-09-12T17:36:55.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.099+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=VK12CCNVDFO3 tag=RRZQRMPW4LBJ type=write size=2809015 2024-09-12T17:36:55.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.100+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=GA392JLKO5LR type=del size=552505 2024-09-12T17:36:55.102 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.101+0000 7fa80ca76780 1 < completed delete operation key=EDRL3T2I9AOO tag=7XREO2W66LN1 type=del 2024-09-12T17:36:55.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.104+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~UDKDFHOHKJNQ.0 size=1048576 2024-09-12T17:36:55.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.105+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~UDKDFHOHKJNQ.1 size=1048576 2024-09-12T17:36:55.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.106+0000 7fa80ca76780 1 > prepared part key=_multipart_U8O04HYQZRJC.2~UDKDFHOHKJNQ.2 size=933943 2024-09-12T17:36:55.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.106+0000 7fa80ca76780 1 > prepared multipart upload key=U8O04HYQZRJC upload=UDKDFHOHKJNQ tag=SKW3CEZBU5KG type=write size=4079671 2024-09-12T17:36:55.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.107+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=FA7IEJPBP0MG type=del 2024-09-12T17:36:55.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.108+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=ZVOO140EC0TY type=del size=1147191 2024-09-12T17:36:55.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.110+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=GZURIJLMN97B type=del 2024-09-12T17:36:55.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.111+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=GO1LF7Q79LEQ type=del size=3064015 2024-09-12T17:36:55.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.112+0000 7fa80ca76780 -1 < failed to complete operation key=RC1IX4DQREEP tag=OE8FJTZCBGWN type=del size=3299013: (22) Invalid argument 2024-09-12T17:36:55.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.114+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~ZJNHK5WGR050.0 size=1048576 2024-09-12T17:36:55.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.115+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~ZJNHK5WGR050.1 size=1048576 2024-09-12T17:36:55.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.116+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~ZJNHK5WGR050.2 size=290144 2024-09-12T17:36:55.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.116+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=ZJNHK5WGR050 tag=9FBYND91XV13 type=write size=3435872 2024-09-12T17:36:55.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.117+0000 7fa80ca76780 1 < completed part key=_multipart_VDD4PDR1GLWQ.2~YU4LAV9942F1.0 size=1022555 2024-09-12T17:36:55.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.119+0000 7fa80ca76780 1 < completed multipart upload key=VDD4PDR1GLWQ upload=YU4LAV9942F1 tag=UZY27B5DYFJB type=write size=2071131 2024-09-12T17:36:55.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.120+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=BN7H24L3A2A7 type=del size=3424641 2024-09-12T17:36:55.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.121+0000 7fa80ca76780 1 < canceled operation key=54KWSI77T73A tag=3CH4T9KR7KAT type=write size=443917 2024-09-12T17:36:55.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.123+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=GNXC9UG5A4MT type=write size=985093 2024-09-12T17:36:55.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.124+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~1XPZIFJ7PG7L.0 size=1048576 2024-09-12T17:36:55.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.125+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~1XPZIFJ7PG7L.1 size=1048576 2024-09-12T17:36:55.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.126+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~1XPZIFJ7PG7L.2 size=601683 2024-09-12T17:36:55.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.128+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=1XPZIFJ7PG7L tag=VFWZ6N60DE4W type=write size=3747411 2024-09-12T17:36:55.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.129+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=OZJ9KOMFON3I type=del size=2430440 2024-09-12T17:36:55.131 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.130+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~OZPQSZFAH54P.0 size=1048576 2024-09-12T17:36:55.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.131+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~OZPQSZFAH54P.1 size=53314 2024-09-12T17:36:55.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.133+0000 7fa80ca76780 1 < completed multipart upload key=0X3LGXL2QFRN upload=OZPQSZFAH54P tag=YC5Q658XIPMJ type=write size=2150466 2024-09-12T17:36:55.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.134+0000 7fa80ca76780 1 > prepared operation key=EDRL3T2I9AOO tag=QE9X132XURC6 type=write size=679575 2024-09-12T17:36:55.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.135+0000 7fa80ca76780 1 < completed part key=_multipart_GKE6623N268Z.2~1GVYHZC03YDO.0 size=7631 2024-09-12T17:36:55.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.138+0000 7fa80ca76780 1 < completed multipart upload key=GKE6623N268Z upload=1GVYHZC03YDO tag=K1CR8QT443BI type=write size=1056207 2024-09-12T17:36:55.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.139+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=6MCZ9LY2YHKP type=del size=3987928 2024-09-12T17:36:55.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.140+0000 7fa80ca76780 1 < completed delete operation key=8Z3EPQHMA6M5 tag=P8V1E3POJ8VZ type=del 2024-09-12T17:36:55.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.141+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=ZW245AJRQVK3 type=del size=1973592 2024-09-12T17:36:55.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.142+0000 7fa80ca76780 1 < completed write operation key=AKE8O7Q277HX tag=78PR4OHZ4T7I type=write size=621133 2024-09-12T17:36:55.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.143+0000 7fa80ca76780 1 > prepared operation key=E25BUY271ZSI tag=P309YGBI9WIW type=del size=2885508 2024-09-12T17:36:55.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.145+0000 7fa80ca76780 1 < completed delete operation key=E25BUY271ZSI tag=81EHZ0C2J0QX type=del 2024-09-12T17:36:55.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.147+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~12USTFJ33Z6D.0 size=1048576 2024-09-12T17:36:55.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.148+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~12USTFJ33Z6D.1 size=1048576 2024-09-12T17:36:55.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.149+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~12USTFJ33Z6D.2 size=667567 2024-09-12T17:36:55.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.149+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=12USTFJ33Z6D tag=DQ8BWFN0S8J3 type=write size=3813295 2024-09-12T17:36:55.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.150+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=N3DRO5Q9KK96 type=del 2024-09-12T17:36:55.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.152+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~QTNHFTYONYGK.0 size=1048576 2024-09-12T17:36:55.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.154+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~QTNHFTYONYGK.1 size=1048576 2024-09-12T17:36:55.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.156+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~QTNHFTYONYGK.2 size=227324 2024-09-12T17:36:55.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.156+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=QTNHFTYONYGK tag=807WDNC6WFWW type=write size=3373052 2024-09-12T17:36:55.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.158+0000 7fa80ca76780 1 < completed delete operation key=0X3LGXL2QFRN tag=RDH1FEPY9Q39 type=del 2024-09-12T17:36:55.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.160+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=TBX8A7U2ZMOO type=del size=2076831 2024-09-12T17:36:55.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.162+0000 7fa80ca76780 1 < completed write operation key=7QHTQ6VHZ34P tag=40V75F1ZJD16 type=write size=383892 2024-09-12T17:36:55.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.163+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=CMOLRXZCLFVU type=write size=662361 2024-09-12T17:36:55.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.164+0000 7fa80ca76780 1 < completed delete operation key=K243DOYPYVDS tag=GA392JLKO5LR type=del 2024-09-12T17:36:55.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.166+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~12BOW2I9YFME.0 size=1048576 2024-09-12T17:36:55.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.167+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~12BOW2I9YFME.1 size=288798 2024-09-12T17:36:55.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.167+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=12BOW2I9YFME tag=2NN8DGQTH9N0 type=write size=2385950 2024-09-12T17:36:55.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.167+0000 7fa80ca76780 1 < canceled part key=_multipart_U8O04HYQZRJC.2~UDKDFHOHKJNQ.0 size=1048576 2024-09-12T17:36:55.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.168+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~UDKDFHOHKJNQ.1 size=1048576 2024-09-12T17:36:55.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.169+0000 7fa80ca76780 1 < completed part key=_multipart_U8O04HYQZRJC.2~UDKDFHOHKJNQ.2 size=933943 2024-09-12T17:36:55.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.171+0000 7fa80ca76780 1 < canceled multipart upload key=U8O04HYQZRJC upload=UDKDFHOHKJNQ tag=SKW3CEZBU5KG type=write size=4079671 2024-09-12T17:36:55.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.172+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=9XOLKXI18QHL type=del size=887056 2024-09-12T17:36:55.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.173+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=ZVOO140EC0TY type=del 2024-09-12T17:36:55.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.174+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=9W9K0HBTCN5E type=del size=3435262 2024-09-12T17:36:55.176 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.175+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=GO1LF7Q79LEQ type=del 2024-09-12T17:36:55.178 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.177+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~HJ6SDS2CM3XF.0 size=1048576 2024-09-12T17:36:55.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.179+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~HJ6SDS2CM3XF.1 size=892401 2024-09-12T17:36:55.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.179+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=HJ6SDS2CM3XF tag=3R306BHGHQC9 type=write size=2989553 2024-09-12T17:36:55.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.179+0000 7fa80ca76780 1 < canceled part key=_multipart_FKK4IGD1436I.2~ZJNHK5WGR050.0 size=1048576 2024-09-12T17:36:55.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.180+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~ZJNHK5WGR050.1 size=1048576 2024-09-12T17:36:55.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.181+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~ZJNHK5WGR050.2 size=290144 2024-09-12T17:36:55.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.183+0000 7fa80ca76780 1 < canceled multipart upload key=FKK4IGD1436I upload=ZJNHK5WGR050 tag=9FBYND91XV13 type=write size=3435872 2024-09-12T17:36:55.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.185+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~WHW0UDLH4LOQ.0 size=1048576 2024-09-12T17:36:55.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.186+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~WHW0UDLH4LOQ.1 size=1048576 2024-09-12T17:36:55.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.187+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~WHW0UDLH4LOQ.2 size=138983 2024-09-12T17:36:55.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.187+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=WHW0UDLH4LOQ tag=BILBBKDJCAG0 type=write size=3284711 2024-09-12T17:36:55.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.188+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=BN7H24L3A2A7 type=del 2024-09-12T17:36:55.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.189+0000 7fa80ca76780 1 > prepared operation key=0U9KSMYWT2C3 tag=4F3U0F91QIU7 type=del size=3462863 2024-09-12T17:36:55.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.190+0000 7fa80ca76780 1 < completed write operation key=U8O04HYQZRJC tag=GNXC9UG5A4MT type=write size=985093 2024-09-12T17:36:55.192 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.191+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=UHUK3LXTGIDR type=write size=127615 2024-09-12T17:36:55.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.193+0000 7fa80ca76780 1 < completed delete operation key=0X3LGXL2QFRN tag=OZJ9KOMFON3I type=del 2024-09-12T17:36:55.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.195+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~C24W2KIB4J7U.0 size=1048576 2024-09-12T17:36:55.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.195+0000 7fa80ca76780 1 > prepared part key=_multipart_0J6RTRJWZP1T.2~C24W2KIB4J7U.1 size=621383 2024-09-12T17:36:55.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.195+0000 7fa80ca76780 1 > prepared multipart upload key=0J6RTRJWZP1T upload=C24W2KIB4J7U tag=WEXY26FQU4FR type=write size=2718535 2024-09-12T17:36:55.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.198+0000 7fa80ca76780 1 < suggested update operation key=EDRL3T2I9AOO tag=QE9X132XURC6 type=write size=679575 2024-09-12T17:36:55.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.199+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=GLEA0WHMNW12 type=del size=1017691 2024-09-12T17:36:55.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.200+0000 7fa80ca76780 1 < canceled operation key=94801LE91HZ9 tag=6MCZ9LY2YHKP type=del size=3987928 2024-09-12T17:36:55.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.203+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~BEEA4FUHBJE4.0 size=1048576 2024-09-12T17:36:55.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.203+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~BEEA4FUHBJE4.1 size=413429 2024-09-12T17:36:55.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.203+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=BEEA4FUHBJE4 tag=T2Q8RTTR2AVF type=write size=2510581 2024-09-12T17:36:55.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.205+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=ZW245AJRQVK3 type=del 2024-09-12T17:36:55.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.206+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=W83K55NDQZKC type=del size=3271404 2024-09-12T17:36:55.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.208+0000 7fa80ca76780 1 < suggested remove operation key=E25BUY271ZSI tag=P309YGBI9WIW type=del 2024-09-12T17:36:55.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.211+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~73CTKSBJT8ZS.0 size=1048576 2024-09-12T17:36:55.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.212+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~73CTKSBJT8ZS.1 size=348075 2024-09-12T17:36:55.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.212+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=73CTKSBJT8ZS tag=RVEI9G7GEI7K type=write size=2445227 2024-09-12T17:36:55.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.213+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~12USTFJ33Z6D.0 size=1048576 2024-09-12T17:36:55.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.214+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~12USTFJ33Z6D.1 size=1048576 2024-09-12T17:36:55.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.215+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~12USTFJ33Z6D.2 size=667567 2024-09-12T17:36:55.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.217+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=12USTFJ33Z6D tag=DQ8BWFN0S8J3 type=write size=3813295 2024-09-12T17:36:55.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.219+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~6B4WEB7V3PV1.0 size=1048576 2024-09-12T17:36:55.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.220+0000 7fa80ca76780 1 > prepared part key=_multipart_94801LE91HZ9.2~6B4WEB7V3PV1.1 size=208472 2024-09-12T17:36:55.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.220+0000 7fa80ca76780 1 > prepared multipart upload key=94801LE91HZ9 upload=6B4WEB7V3PV1 tag=93PEI18KHA1X type=write size=2305624 2024-09-12T17:36:55.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.221+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~QTNHFTYONYGK.0 size=1048576 2024-09-12T17:36:55.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.222+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~QTNHFTYONYGK.1 size=1048576 2024-09-12T17:36:55.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.223+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~QTNHFTYONYGK.2 size=227324 2024-09-12T17:36:55.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.225+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=QTNHFTYONYGK tag=807WDNC6WFWW type=write size=3373052 2024-09-12T17:36:55.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.226+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=725Z7FMBXMXC type=del size=2688461 2024-09-12T17:36:55.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.228+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=TBX8A7U2ZMOO type=del 2024-09-12T17:36:55.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.230+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~MLGEPBQ3P28I.0 size=1004853 2024-09-12T17:36:55.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.230+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=MLGEPBQ3P28I tag=93P685GR70TQ type=write size=2053429 2024-09-12T17:36:55.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.232+0000 7fa80ca76780 1 < suggested remove operation key=FKK4IGD1436I tag=CMOLRXZCLFVU type=write 2024-09-12T17:36:55.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.233+0000 7fa80ca76780 1 > prepared operation key=0X3LGXL2QFRN tag=90X49SFRBMH4 type=del size=3752586 2024-09-12T17:36:55.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.235+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~12BOW2I9YFME.0 size=1048576 2024-09-12T17:36:55.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.236+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~12BOW2I9YFME.1 size=288798 2024-09-12T17:36:55.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.238+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=12BOW2I9YFME tag=2NN8DGQTH9N0 type=write size=2385950 2024-09-12T17:36:55.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.241+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~JCHCUUDL2U9G.0 size=1048576 2024-09-12T17:36:55.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.242+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~JCHCUUDL2U9G.1 size=88084 2024-09-12T17:36:55.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.242+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=JCHCUUDL2U9G tag=853FVE3EBDES type=write size=2185236 2024-09-12T17:36:55.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.243+0000 7fa80ca76780 1 < completed delete operation key=R871XU2TDWID tag=9XOLKXI18QHL type=del 2024-09-12T17:36:55.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.245+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=UAC59KH7DNBW type=del size=1187361 2024-09-12T17:36:55.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.246+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=9W9K0HBTCN5E type=del 2024-09-12T17:36:55.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.248+0000 7fa80ca76780 1 > prepared part key=_multipart_RC1IX4DQREEP.2~1KXPRNVUJ18E.0 size=323212 2024-09-12T17:36:55.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.248+0000 7fa80ca76780 1 > prepared multipart upload key=RC1IX4DQREEP upload=1KXPRNVUJ18E tag=O5IU8ATI7OOP type=write size=1371788 2024-09-12T17:36:55.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.249+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~HJ6SDS2CM3XF.0 size=1048576 2024-09-12T17:36:55.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.250+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~HJ6SDS2CM3XF.1 size=892401 2024-09-12T17:36:55.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.252+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=HJ6SDS2CM3XF tag=3R306BHGHQC9 type=write size=2989553 2024-09-12T17:36:55.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.254+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~4ZK2UT2VQ8ZQ.0 size=1048576 2024-09-12T17:36:55.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.255+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~4ZK2UT2VQ8ZQ.1 size=1048576 2024-09-12T17:36:55.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.256+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~4ZK2UT2VQ8ZQ.2 size=544928 2024-09-12T17:36:55.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.256+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=4ZK2UT2VQ8ZQ tag=RF23ZN7LQ200 type=write size=3690656 2024-09-12T17:36:55.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.257+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~WHW0UDLH4LOQ.0 size=1048576 2024-09-12T17:36:55.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.257+0000 7fa80ca76780 1 < canceled part key=_multipart_54KWSI77T73A.2~WHW0UDLH4LOQ.1 size=1048576 2024-09-12T17:36:55.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.258+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~WHW0UDLH4LOQ.2 size=138983 2024-09-12T17:36:55.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.261+0000 7fa80ca76780 1 < canceled multipart upload key=54KWSI77T73A upload=WHW0UDLH4LOQ tag=BILBBKDJCAG0 type=write size=3284711 2024-09-12T17:36:55.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.263+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~T3XKO53ZRQ53.0 size=474570 2024-09-12T17:36:55.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.263+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=T3XKO53ZRQ53 tag=20AQICEUNVOL type=write size=1523146 2024-09-12T17:36:55.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.264+0000 7fa80ca76780 1 < completed delete operation key=0U9KSMYWT2C3 tag=4F3U0F91QIU7 type=del 2024-09-12T17:36:55.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.266+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~IWQXW67P00WE.0 size=587248 2024-09-12T17:36:55.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.266+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=IWQXW67P00WE tag=GNZ4QUIY6GHD type=write size=1635824 2024-09-12T17:36:55.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.270+0000 7fa80ca76780 1 < suggested update operation key=MSZUYX441Y66 tag=UHUK3LXTGIDR type=write size=127615 2024-09-12T17:36:55.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.271+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=320LZB41O6I9 type=del size=2663491 2024-09-12T17:36:55.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.271+0000 7fa80ca76780 1 < canceled part key=_multipart_0J6RTRJWZP1T.2~C24W2KIB4J7U.0 size=1048576 2024-09-12T17:36:55.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.273+0000 7fa80ca76780 1 < completed part key=_multipart_0J6RTRJWZP1T.2~C24W2KIB4J7U.1 size=621383 2024-09-12T17:36:55.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.275+0000 7fa80ca76780 1 < canceled multipart upload key=0J6RTRJWZP1T upload=C24W2KIB4J7U tag=WEXY26FQU4FR type=write size=2718535 2024-09-12T17:36:55.278 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.277+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~Q3G7J9HK1CC8.0 size=1048576 2024-09-12T17:36:55.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.278+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~Q3G7J9HK1CC8.1 size=1048576 2024-09-12T17:36:55.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.279+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~Q3G7J9HK1CC8.2 size=6718 2024-09-12T17:36:55.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.279+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=Q3G7J9HK1CC8 tag=BDKQWICZZE2E type=write size=3152446 2024-09-12T17:36:55.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.281+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=GLEA0WHMNW12 type=del 2024-09-12T17:36:55.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.284+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~B00E2L41FMSC.0 size=1048576 2024-09-12T17:36:55.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.285+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~B00E2L41FMSC.1 size=1048576 2024-09-12T17:36:55.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.285+0000 7fa80ca76780 1 > prepared part key=_multipart_WGL9JYJXSHBH.2~B00E2L41FMSC.2 size=720488 2024-09-12T17:36:55.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.285+0000 7fa80ca76780 1 > prepared multipart upload key=WGL9JYJXSHBH upload=B00E2L41FMSC tag=X8JAS4E50PKI type=write size=3866216 2024-09-12T17:36:55.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.286+0000 7fa80ca76780 1 < canceled part key=_multipart_2AGKLZ3PQ2FD.2~BEEA4FUHBJE4.0 size=1048576 2024-09-12T17:36:55.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.287+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~BEEA4FUHBJE4.1 size=413429 2024-09-12T17:36:55.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.289+0000 7fa80ca76780 1 < canceled multipart upload key=2AGKLZ3PQ2FD upload=BEEA4FUHBJE4 tag=T2Q8RTTR2AVF type=write size=2510581 2024-09-12T17:36:55.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.290+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=2G6QK8VO08WB type=write size=112858 2024-09-12T17:36:55.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.291+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=W83K55NDQZKC type=del 2024-09-12T17:36:55.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.292+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=KA9XBRSUPDN2 type=del size=1027156 2024-09-12T17:36:55.294 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.293+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~73CTKSBJT8ZS.0 size=1048576 2024-09-12T17:36:55.295 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.294+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~73CTKSBJT8ZS.1 size=348075 2024-09-12T17:36:55.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.296+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=73CTKSBJT8ZS tag=RVEI9G7GEI7K type=write size=2445227 2024-09-12T17:36:55.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.298+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~ZU56JPXF3F5R.0 size=1048576 2024-09-12T17:36:55.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.299+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~ZU56JPXF3F5R.1 size=1048576 2024-09-12T17:36:55.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.300+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~ZU56JPXF3F5R.2 size=360104 2024-09-12T17:36:55.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.300+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=ZU56JPXF3F5R tag=71DQD0H3ZY95 type=write size=3505832 2024-09-12T17:36:55.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.301+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~6B4WEB7V3PV1.0 size=1048576 2024-09-12T17:36:55.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.302+0000 7fa80ca76780 1 < completed part key=_multipart_94801LE91HZ9.2~6B4WEB7V3PV1.1 size=208472 2024-09-12T17:36:55.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.304+0000 7fa80ca76780 1 < completed multipart upload key=94801LE91HZ9 upload=6B4WEB7V3PV1 tag=93PEI18KHA1X type=write size=2305624 2024-09-12T17:36:55.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.305+0000 7fa80ca76780 1 > prepared operation key=VNGH1DA1HANC tag=IL04X309TBFA type=del size=3997345 2024-09-12T17:36:55.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.306+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=725Z7FMBXMXC type=del 2024-09-12T17:36:55.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.307+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=WUWZ3RDDHKDF type=del size=2944089 2024-09-12T17:36:55.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.309+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~MLGEPBQ3P28I.0 size=1004853 2024-09-12T17:36:55.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.311+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=MLGEPBQ3P28I tag=93P685GR70TQ type=write size=2053429 2024-09-12T17:36:55.313 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.312+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=LY4C3HEEZS3A type=del size=2802533 2024-09-12T17:36:55.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.313+0000 7fa80ca76780 1 < canceled operation key=0X3LGXL2QFRN tag=90X49SFRBMH4 type=del size=3752586 2024-09-12T17:36:55.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.314+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=CG6SV0DUYO8O type=del size=651806 2024-09-12T17:36:55.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.315+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~JCHCUUDL2U9G.0 size=1048576 2024-09-12T17:36:55.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.315+0000 7fa80ca76780 1 < canceled part key=_multipart_2AGKLZ3PQ2FD.2~JCHCUUDL2U9G.1 size=88084 2024-09-12T17:36:55.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.317+0000 7fa80ca76780 1 < canceled multipart upload key=2AGKLZ3PQ2FD upload=JCHCUUDL2U9G tag=853FVE3EBDES type=write size=2185236 2024-09-12T17:36:55.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.319+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~N0EX8LYK1OEG.0 size=969752 2024-09-12T17:36:55.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.319+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=N0EX8LYK1OEG tag=QUKUOC395HOS type=write size=2018328 2024-09-12T17:36:55.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.320+0000 7fa80ca76780 1 < completed delete operation key=94801LE91HZ9 tag=UAC59KH7DNBW type=del 2024-09-12T17:36:55.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.322+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=VYZPVFZEX5HL type=del size=1565525 2024-09-12T17:36:55.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.323+0000 7fa80ca76780 1 < completed part key=_multipart_RC1IX4DQREEP.2~1KXPRNVUJ18E.0 size=323212 2024-09-12T17:36:55.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.325+0000 7fa80ca76780 1 < completed multipart upload key=RC1IX4DQREEP upload=1KXPRNVUJ18E tag=O5IU8ATI7OOP type=write size=1371788 2024-09-12T17:36:55.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.326+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=VBAYHQP5HFC3 type=del size=1445357 2024-09-12T17:36:55.328 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.327+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~4ZK2UT2VQ8ZQ.0 size=1048576 2024-09-12T17:36:55.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.328+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~4ZK2UT2VQ8ZQ.1 size=1048576 2024-09-12T17:36:55.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.329+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~4ZK2UT2VQ8ZQ.2 size=544928 2024-09-12T17:36:55.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.331+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=4ZK2UT2VQ8ZQ tag=RF23ZN7LQ200 type=write size=3690656 2024-09-12T17:36:55.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.332+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=QRB012CZS6EA type=write size=42409 2024-09-12T17:36:55.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.333+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~T3XKO53ZRQ53.0 size=474570 2024-09-12T17:36:55.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.335+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=T3XKO53ZRQ53 tag=20AQICEUNVOL type=write size=1523146 2024-09-12T17:36:55.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.336+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=0B5R04SLKXOF type=del size=1359810 2024-09-12T17:36:55.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.337+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~IWQXW67P00WE.0 size=587248 2024-09-12T17:36:55.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.339+0000 7fa80ca76780 1 < completed multipart upload key=EDRL3T2I9AOO upload=IWQXW67P00WE tag=GNZ4QUIY6GHD type=write size=1635824 2024-09-12T17:36:55.342 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.341+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=8PP8N7HR8HNY type=del size=2877942 2024-09-12T17:36:55.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.342+0000 7fa80ca76780 1 < completed delete operation key=U8O04HYQZRJC tag=320LZB41O6I9 type=del 2024-09-12T17:36:55.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.344+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~5O2RTV9PN2QV.0 size=1048576 2024-09-12T17:36:55.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.345+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~5O2RTV9PN2QV.1 size=1048576 2024-09-12T17:36:55.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.346+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~5O2RTV9PN2QV.2 size=834105 2024-09-12T17:36:55.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.346+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=5O2RTV9PN2QV tag=FKV9FB65M9J0 type=write size=3979833 2024-09-12T17:36:55.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.347+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~Q3G7J9HK1CC8.0 size=1048576 2024-09-12T17:36:55.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.347+0000 7fa80ca76780 1 < canceled part key=_multipart_DYZIHCBF3D8U.2~Q3G7J9HK1CC8.1 size=1048576 2024-09-12T17:36:55.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.348+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~Q3G7J9HK1CC8.2 size=6718 2024-09-12T17:36:55.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.350+0000 7fa80ca76780 1 < canceled multipart upload key=DYZIHCBF3D8U upload=Q3G7J9HK1CC8 tag=BDKQWICZZE2E type=write size=3152446 2024-09-12T17:36:55.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.352+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~21OM3X8RLDN6.0 size=1048576 2024-09-12T17:36:55.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.353+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~21OM3X8RLDN6.1 size=1048576 2024-09-12T17:36:55.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.355+0000 7fa80ca76780 1 > prepared part key=_multipart_EDRL3T2I9AOO.2~21OM3X8RLDN6.2 size=697746 2024-09-12T17:36:55.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.355+0000 7fa80ca76780 1 > prepared multipart upload key=EDRL3T2I9AOO upload=21OM3X8RLDN6 tag=B3GYTML86LS5 type=write size=3843474 2024-09-12T17:36:55.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.356+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~B00E2L41FMSC.0 size=1048576 2024-09-12T17:36:55.358 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.357+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~B00E2L41FMSC.1 size=1048576 2024-09-12T17:36:55.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.358+0000 7fa80ca76780 1 < completed part key=_multipart_WGL9JYJXSHBH.2~B00E2L41FMSC.2 size=720488 2024-09-12T17:36:55.361 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.360+0000 7fa80ca76780 1 < completed multipart upload key=WGL9JYJXSHBH upload=B00E2L41FMSC tag=X8JAS4E50PKI type=write size=3866216 2024-09-12T17:36:55.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.362+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~EG3DAXJTZ6LM.0 size=1048576 2024-09-12T17:36:55.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.363+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~EG3DAXJTZ6LM.1 size=746669 2024-09-12T17:36:55.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.363+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=EG3DAXJTZ6LM tag=6C4PKAVH0GPJ type=write size=2843821 2024-09-12T17:36:55.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.366+0000 7fa80ca76780 1 < suggested remove operation key=R02234GEWV6B tag=2G6QK8VO08WB type=write 2024-09-12T17:36:55.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.367+0000 7fa80ca76780 1 > prepared operation key=AKE8O7Q277HX tag=IDBJO3NYKD0X type=del size=1134984 2024-09-12T17:36:55.370 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.369+0000 7fa80ca76780 1 < suggested update operation key=LU7PDGWTAK63 tag=KA9XBRSUPDN2 type=del size=1027156 2024-09-12T17:36:55.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.370+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=D7ZYPOX6TL8B type=del size=1219801 2024-09-12T17:36:55.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.372+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~ZU56JPXF3F5R.0 size=1048576 2024-09-12T17:36:55.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.373+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~ZU56JPXF3F5R.1 size=1048576 2024-09-12T17:36:55.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.374+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~ZU56JPXF3F5R.2 size=360104 2024-09-12T17:36:55.377 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.375+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=ZU56JPXF3F5R tag=71DQD0H3ZY95 type=write size=3505832 2024-09-12T17:36:55.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.377+0000 7fa80ca76780 1 > prepared operation key=H87S6AI6JT6D tag=GPYZCZ1RMDNL type=del size=323076 2024-09-12T17:36:55.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.378+0000 7fa80ca76780 1 < canceled operation key=VNGH1DA1HANC tag=IL04X309TBFA type=del size=3997345 2024-09-12T17:36:55.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.381+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~27ZLJG40YOCN.0 size=1048576 2024-09-12T17:36:55.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.382+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~27ZLJG40YOCN.1 size=1048576 2024-09-12T17:36:55.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.383+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~27ZLJG40YOCN.2 size=516149 2024-09-12T17:36:55.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.383+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=27ZLJG40YOCN tag=MCPFC86F4LP9 type=write size=3661877 2024-09-12T17:36:55.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.384+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=WUWZ3RDDHKDF type=del 2024-09-12T17:36:55.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.386+0000 7fa80ca76780 1 > prepared part key=_multipart_E25BUY271ZSI.2~IVNR6WP80VJE.0 size=483350 2024-09-12T17:36:55.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.386+0000 7fa80ca76780 1 > prepared multipart upload key=E25BUY271ZSI upload=IVNR6WP80VJE tag=ZB0POZL1IWPJ type=write size=1531926 2024-09-12T17:36:55.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.387+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=LY4C3HEEZS3A type=del 2024-09-12T17:36:55.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.389+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=YQYS7MPI1W9K type=del size=199167 2024-09-12T17:36:55.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.390+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=CG6SV0DUYO8O type=del 2024-09-12T17:36:55.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.393+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~QQMGZTO9H7TE.0 size=1048576 2024-09-12T17:36:55.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.394+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~QQMGZTO9H7TE.1 size=492489 2024-09-12T17:36:55.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.394+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=QQMGZTO9H7TE tag=V8U8KYGO73TY type=write size=2589641 2024-09-12T17:36:55.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.395+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~N0EX8LYK1OEG.0 size=969752 2024-09-12T17:36:55.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.397+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=N0EX8LYK1OEG tag=QUKUOC395HOS type=write size=2018328 2024-09-12T17:36:55.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.398+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=DX480RGHQENH type=del size=1431261 2024-09-12T17:36:55.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.399+0000 7fa80ca76780 1 < canceled operation key=07LPSZT2RKCC tag=VYZPVFZEX5HL type=del size=1565525 2024-09-12T17:36:55.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.401+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=X57QXJLZS2D6 type=del size=822124 2024-09-12T17:36:55.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.402+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=VBAYHQP5HFC3 type=del 2024-09-12T17:36:55.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.403+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=ODB70GHS08TY type=del size=2856748 2024-09-12T17:36:55.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.404+0000 7fa80ca76780 1 < completed write operation key=94801LE91HZ9 tag=QRB012CZS6EA type=write size=42409 2024-09-12T17:36:55.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.405+0000 7fa80ca76780 1 > prepared operation key=RC1IX4DQREEP tag=TN3RLP64AYB4 type=del size=1940408 2024-09-12T17:36:55.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.407+0000 7fa80ca76780 1 < suggested remove operation key=OJPZAWR5BLBN tag=0B5R04SLKXOF type=del 2024-09-12T17:36:55.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.409+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~NWST948G6R50.0 size=1048576 2024-09-12T17:36:55.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.410+0000 7fa80ca76780 1 > prepared part key=_multipart_8Z3EPQHMA6M5.2~NWST948G6R50.1 size=155304 2024-09-12T17:36:55.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.410+0000 7fa80ca76780 1 > prepared multipart upload key=8Z3EPQHMA6M5 upload=NWST948G6R50 tag=KF1T1X6EHI4Q type=write size=2252456 2024-09-12T17:36:55.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.413+0000 7fa80ca76780 1 < suggested update operation key=0J6RTRJWZP1T tag=8PP8N7HR8HNY type=del size=2877942 2024-09-12T17:36:55.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.414+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=A265WJPG5MGE type=del size=3715016 2024-09-12T17:36:55.416 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.415+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~5O2RTV9PN2QV.0 size=1048576 2024-09-12T17:36:55.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.416+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~5O2RTV9PN2QV.1 size=1048576 2024-09-12T17:36:55.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.418+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~5O2RTV9PN2QV.2 size=834105 2024-09-12T17:36:55.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.420+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=5O2RTV9PN2QV tag=FKV9FB65M9J0 type=write size=3979833 2024-09-12T17:36:55.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.422+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=6OVPO02A6N6L type=del size=628369 2024-09-12T17:36:55.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.422+0000 7fa80ca76780 1 < canceled part key=_multipart_EDRL3T2I9AOO.2~21OM3X8RLDN6.0 size=1048576 2024-09-12T17:36:55.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.423+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~21OM3X8RLDN6.1 size=1048576 2024-09-12T17:36:55.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.424+0000 7fa80ca76780 1 < completed part key=_multipart_EDRL3T2I9AOO.2~21OM3X8RLDN6.2 size=697746 2024-09-12T17:36:55.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.426+0000 7fa80ca76780 1 < canceled multipart upload key=EDRL3T2I9AOO upload=21OM3X8RLDN6 tag=B3GYTML86LS5 type=write size=3843474 2024-09-12T17:36:55.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.427+0000 7fa80ca76780 1 > prepared operation key=VDD4PDR1GLWQ tag=6UFSYW0R5496 type=del size=1352526 2024-09-12T17:36:55.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.428+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~EG3DAXJTZ6LM.0 size=1048576 2024-09-12T17:36:55.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.429+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~EG3DAXJTZ6LM.1 size=746669 2024-09-12T17:36:55.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.431+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=EG3DAXJTZ6LM tag=6C4PKAVH0GPJ type=write size=2843821 2024-09-12T17:36:55.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.432+0000 7fa80ca76780 1 > prepared operation key=R871XU2TDWID tag=J6J3L5M41X0H type=write size=455579 2024-09-12T17:36:55.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.433+0000 7fa80ca76780 1 < completed delete operation key=AKE8O7Q277HX tag=IDBJO3NYKD0X type=del 2024-09-12T17:36:55.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.436+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~WAB2I6VH0HG4.0 size=1048576 2024-09-12T17:36:55.439 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.438+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~WAB2I6VH0HG4.1 size=1048576 2024-09-12T17:36:55.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.439+0000 7fa80ca76780 1 > prepared part key=_multipart_2AGKLZ3PQ2FD.2~WAB2I6VH0HG4.2 size=580437 2024-09-12T17:36:55.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.439+0000 7fa80ca76780 1 > prepared multipart upload key=2AGKLZ3PQ2FD upload=WAB2I6VH0HG4 tag=47MFKRXMK41J type=write size=3726165 2024-09-12T17:36:55.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.440+0000 7fa80ca76780 1 < completed delete operation key=LU7PDGWTAK63 tag=D7ZYPOX6TL8B type=del 2024-09-12T17:36:55.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.441+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=ERON9443CWZL type=del size=3447188 2024-09-12T17:36:55.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.444+0000 7fa80ca76780 1 < suggested remove operation key=H87S6AI6JT6D tag=GPYZCZ1RMDNL type=del 2024-09-12T17:36:55.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.445+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=MMN606G0E20T type=write size=568421 2024-09-12T17:36:55.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.446+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~27ZLJG40YOCN.0 size=1048576 2024-09-12T17:36:55.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.447+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~27ZLJG40YOCN.1 size=1048576 2024-09-12T17:36:55.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.448+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~27ZLJG40YOCN.2 size=516149 2024-09-12T17:36:55.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.450+0000 7fa80ca76780 1 < completed multipart upload key=2AGKLZ3PQ2FD upload=27ZLJG40YOCN tag=MCPFC86F4LP9 type=write size=3661877 2024-09-12T17:36:55.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.452+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=EUADUFHXPDGE type=write size=593306 2024-09-12T17:36:55.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.453+0000 7fa80ca76780 1 < completed part key=_multipart_E25BUY271ZSI.2~IVNR6WP80VJE.0 size=483350 2024-09-12T17:36:55.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.455+0000 7fa80ca76780 1 < completed multipart upload key=E25BUY271ZSI upload=IVNR6WP80VJE tag=ZB0POZL1IWPJ type=write size=1531926 2024-09-12T17:36:55.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.456+0000 7fa80ca76780 1 > prepared operation key=Z81704G91EPL tag=814TQT2UZR31 type=del size=2404580 2024-09-12T17:36:55.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.458+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=YQYS7MPI1W9K type=del 2024-09-12T17:36:55.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.460+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~6X04LRH6X81B.0 size=350775 2024-09-12T17:36:55.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.460+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=6X04LRH6X81B tag=C4II6Q2BPBNM type=write size=1399351 2024-09-12T17:36:55.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.461+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~QQMGZTO9H7TE.0 size=1048576 2024-09-12T17:36:55.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.462+0000 7fa80ca76780 1 < completed part key=_multipart_H87S6AI6JT6D.2~QQMGZTO9H7TE.1 size=492489 2024-09-12T17:36:55.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.464+0000 7fa80ca76780 1 < completed multipart upload key=H87S6AI6JT6D upload=QQMGZTO9H7TE tag=V8U8KYGO73TY type=write size=2589641 2024-09-12T17:36:55.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.466+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=XIN79FC9IOWV type=del size=1563734 2024-09-12T17:36:55.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.467+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=DX480RGHQENH type=del 2024-09-12T17:36:55.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.468+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=YFQKWN4I55D2 type=write size=119227 2024-09-12T17:36:55.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.469+0000 7fa80ca76780 -1 < failed to complete operation key=OJPZAWR5BLBN tag=X57QXJLZS2D6 type=del size=822124: (22) Invalid argument 2024-09-12T17:36:55.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.471+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=WX5SIXO5BNOB type=write size=890395 2024-09-12T17:36:55.473 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.472+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=ODB70GHS08TY type=del 2024-09-12T17:36:55.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.473+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=SV02OEO8QQ3Q type=write size=994641 2024-09-12T17:36:55.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.475+0000 7fa80ca76780 1 < completed delete operation key=RC1IX4DQREEP tag=TN3RLP64AYB4 type=del 2024-09-12T17:36:55.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.477+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~XG1XT40NPJVD.0 size=1048576 2024-09-12T17:36:55.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.478+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~XG1XT40NPJVD.1 size=1048576 2024-09-12T17:36:55.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.479+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~XG1XT40NPJVD.2 size=597401 2024-09-12T17:36:55.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.479+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=XG1XT40NPJVD tag=9FXEW9023QRP type=write size=3743129 2024-09-12T17:36:55.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.480+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~NWST948G6R50.0 size=1048576 2024-09-12T17:36:55.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.481+0000 7fa80ca76780 1 < completed part key=_multipart_8Z3EPQHMA6M5.2~NWST948G6R50.1 size=155304 2024-09-12T17:36:55.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.483+0000 7fa80ca76780 1 < completed multipart upload key=8Z3EPQHMA6M5 upload=NWST948G6R50 tag=KF1T1X6EHI4Q type=write size=2252456 2024-09-12T17:36:55.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.484+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=ZLE101O0YHPR type=del size=1731107 2024-09-12T17:36:55.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.487+0000 7fa80ca76780 1 < suggested update operation key=MSZUYX441Y66 tag=A265WJPG5MGE type=del size=3715016 2024-09-12T17:36:55.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.489+0000 7fa80ca76780 1 > prepared part key=_multipart_VNGH1DA1HANC.2~CWC0G6KPJ7AA.0 size=308174 2024-09-12T17:36:55.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.489+0000 7fa80ca76780 1 > prepared multipart upload key=VNGH1DA1HANC upload=CWC0G6KPJ7AA tag=CDYMB4VG4P2Y type=write size=1356750 2024-09-12T17:36:55.491 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.490+0000 7fa80ca76780 1 < canceled operation key=FKK4IGD1436I tag=6OVPO02A6N6L type=del size=628369 2024-09-12T17:36:55.492 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.491+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=K8P5J1BOL3EB type=del size=1111050 2024-09-12T17:36:55.494 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.493+0000 7fa80ca76780 1 < completed delete operation key=VDD4PDR1GLWQ tag=6UFSYW0R5496 type=del 2024-09-12T17:36:55.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.494+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=PCX4VZB359IW type=del size=1278467 2024-09-12T17:36:55.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.495+0000 7fa80ca76780 1 < completed write operation key=R871XU2TDWID tag=J6J3L5M41X0H type=write size=455579 2024-09-12T17:36:55.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.499+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~IAJGEUIU7L8Y.0 size=1048576 2024-09-12T17:36:55.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.500+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~IAJGEUIU7L8Y.1 size=241627 2024-09-12T17:36:55.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.500+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=IAJGEUIU7L8Y tag=L09L875HVS1E type=write size=2338779 2024-09-12T17:36:55.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.501+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~WAB2I6VH0HG4.0 size=1048576 2024-09-12T17:36:55.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.501+0000 7fa80ca76780 1 < canceled part key=_multipart_2AGKLZ3PQ2FD.2~WAB2I6VH0HG4.1 size=1048576 2024-09-12T17:36:55.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.502+0000 7fa80ca76780 1 < completed part key=_multipart_2AGKLZ3PQ2FD.2~WAB2I6VH0HG4.2 size=580437 2024-09-12T17:36:55.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.504+0000 7fa80ca76780 1 < canceled multipart upload key=2AGKLZ3PQ2FD upload=WAB2I6VH0HG4 tag=47MFKRXMK41J type=write size=3726165 2024-09-12T17:36:55.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.505+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=HNWJFUMTM4YL type=del size=2826869 2024-09-12T17:36:55.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.506+0000 7fa80ca76780 1 < completed delete operation key=7QHTQ6VHZ34P tag=ERON9443CWZL type=del 2024-09-12T17:36:55.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.508+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~AYTX27SDQ6DE.0 size=1048576 2024-09-12T17:36:55.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.509+0000 7fa80ca76780 1 > prepared part key=_multipart_FKK4IGD1436I.2~AYTX27SDQ6DE.1 size=393209 2024-09-12T17:36:55.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.509+0000 7fa80ca76780 1 > prepared multipart upload key=FKK4IGD1436I upload=AYTX27SDQ6DE tag=9CZCLR3FTT0R type=write size=2490361 2024-09-12T17:36:55.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.511+0000 7fa80ca76780 1 < completed write operation key=4S33294MWCO1 tag=MMN606G0E20T type=write size=568421 2024-09-12T17:36:55.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.512+0000 7fa80ca76780 1 > prepared operation key=7QHTQ6VHZ34P tag=B0SLTAD48X1B type=del size=2586256 2024-09-12T17:36:55.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.514+0000 7fa80ca76780 1 < suggested update operation key=94801LE91HZ9 tag=EUADUFHXPDGE type=write size=593306 2024-09-12T17:36:55.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.517+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~1D38GUCE5XNM.0 size=326340 2024-09-12T17:36:55.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.517+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=1D38GUCE5XNM tag=5R1L7QZWXR9P type=write size=1374916 2024-09-12T17:36:55.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.518+0000 7fa80ca76780 1 < completed delete operation key=Z81704G91EPL tag=814TQT2UZR31 type=del 2024-09-12T17:36:55.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.519+0000 7fa80ca76780 1 > prepared operation key=MSZUYX441Y66 tag=RQVOMUSRQX07 type=del size=1777165 2024-09-12T17:36:55.522 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.520+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~6X04LRH6X81B.0 size=350775 2024-09-12T17:36:55.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.522+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=6X04LRH6X81B tag=C4II6Q2BPBNM type=write size=1399351 2024-09-12T17:36:55.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.525+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~9F8YFE8O59F5.0 size=243203 2024-09-12T17:36:55.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.525+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=9F8YFE8O59F5 tag=HWWH0SPUZ5K3 type=write size=1291779 2024-09-12T17:36:55.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.527+0000 7fa80ca76780 1 < suggested update operation key=7QHTQ6VHZ34P tag=XIN79FC9IOWV type=del size=1563734 2024-09-12T17:36:55.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.529+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~0ZX8XIEZYQNI.0 size=1048576 2024-09-12T17:36:55.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.530+0000 7fa80ca76780 1 > prepared part key=_multipart_AKE8O7Q277HX.2~0ZX8XIEZYQNI.1 size=599538 2024-09-12T17:36:55.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.530+0000 7fa80ca76780 1 > prepared multipart upload key=AKE8O7Q277HX upload=0ZX8XIEZYQNI tag=X6SUYCC3ZFWF type=write size=2696690 2024-09-12T17:36:55.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.532+0000 7fa80ca76780 1 < completed write operation key=U8O04HYQZRJC tag=YFQKWN4I55D2 type=write size=119227 2024-09-12T17:36:55.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.533+0000 7fa80ca76780 1 > prepared operation key=5CAG55DQEF3Y tag=FSXK3K3U2FC0 type=del size=2626955 2024-09-12T17:36:55.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.534+0000 7fa80ca76780 1 < completed write operation key=FKK4IGD1436I tag=WX5SIXO5BNOB type=write size=890395 2024-09-12T17:36:55.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.535+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=SR5S3ZPYL9YT type=del size=733200 2024-09-12T17:36:55.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.538+0000 7fa80ca76780 1 < suggested remove operation key=U8O04HYQZRJC tag=SV02OEO8QQ3Q type=write 2024-09-12T17:36:55.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.539+0000 7fa80ca76780 1 > prepared operation key=OJPZAWR5BLBN tag=8ICH0KH2ZDHF type=del size=1167760 2024-09-12T17:36:55.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.540+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~XG1XT40NPJVD.0 size=1048576 2024-09-12T17:36:55.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.540+0000 7fa80ca76780 1 < canceled part key=_multipart_FKK4IGD1436I.2~XG1XT40NPJVD.1 size=1048576 2024-09-12T17:36:55.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.541+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~XG1XT40NPJVD.2 size=597401 2024-09-12T17:36:55.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.544+0000 7fa80ca76780 1 < canceled multipart upload key=FKK4IGD1436I upload=XG1XT40NPJVD tag=9FXEW9023QRP type=write size=3743129 2024-09-12T17:36:55.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.545+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=AQZQO88OEIDS type=del size=1855611 2024-09-12T17:36:55.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.547+0000 7fa80ca76780 -1 < failed to complete operation key=94801LE91HZ9 tag=ZLE101O0YHPR type=del size=1731107: (22) Invalid argument 2024-09-12T17:36:55.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.548+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=3SZONO0DR991 type=del size=2520551 2024-09-12T17:36:55.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.549+0000 7fa80ca76780 1 < completed part key=_multipart_VNGH1DA1HANC.2~CWC0G6KPJ7AA.0 size=308174 2024-09-12T17:36:55.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.551+0000 7fa80ca76780 1 < completed multipart upload key=VNGH1DA1HANC upload=CWC0G6KPJ7AA tag=CDYMB4VG4P2Y type=write size=1356750 2024-09-12T17:36:55.555 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.554+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~CK9TN9OUTVCX.0 size=361690 2024-09-12T17:36:55.555 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.554+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=CK9TN9OUTVCX tag=1J0HVLW5SM32 type=write size=1410266 2024-09-12T17:36:55.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.555+0000 7fa80ca76780 1 < canceled operation key=WGL9JYJXSHBH tag=K8P5J1BOL3EB type=del size=1111050 2024-09-12T17:36:55.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.556+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=CZA7XIB43IGM type=del size=1797924 2024-09-12T17:36:55.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.558+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=PCX4VZB359IW type=del 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.560+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~1ABVAX8CLEWH.0 size=1048576 2024-09-12T17:36:55.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.561+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~1ABVAX8CLEWH.1 size=1048576 2024-09-12T17:36:55.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.562+0000 7fa80ca76780 1 > prepared part key=_multipart_DYZIHCBF3D8U.2~1ABVAX8CLEWH.2 size=439589 2024-09-12T17:36:55.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.562+0000 7fa80ca76780 1 > prepared multipart upload key=DYZIHCBF3D8U upload=1ABVAX8CLEWH tag=X7PM3ECGGTCR type=write size=3585317 2024-09-12T17:36:55.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.563+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~IAJGEUIU7L8Y.0 size=1048576 2024-09-12T17:36:55.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.564+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~IAJGEUIU7L8Y.1 size=241627 2024-09-12T17:36:55.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.566+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=IAJGEUIU7L8Y tag=L09L875HVS1E type=write size=2338779 2024-09-12T17:36:55.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.569+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~RLUE0XJSQC4W.0 size=1048576 2024-09-12T17:36:55.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.570+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~RLUE0XJSQC4W.1 size=460813 2024-09-12T17:36:55.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.570+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=RLUE0XJSQC4W tag=YCC3WMCO0MIZ type=write size=2557965 2024-09-12T17:36:55.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.571+0000 7fa80ca76780 1 < canceled operation key=OJPZAWR5BLBN tag=HNWJFUMTM4YL type=del size=2826869 2024-09-12T17:36:55.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.572+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=FGOWNLTF091G type=write size=769655 2024-09-12T17:36:55.574 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.573+0000 7fa80ca76780 1 < canceled part key=_multipart_FKK4IGD1436I.2~AYTX27SDQ6DE.0 size=1048576 2024-09-12T17:36:55.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.574+0000 7fa80ca76780 1 < completed part key=_multipart_FKK4IGD1436I.2~AYTX27SDQ6DE.1 size=393209 2024-09-12T17:36:55.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.576+0000 7fa80ca76780 1 < canceled multipart upload key=FKK4IGD1436I upload=AYTX27SDQ6DE tag=9CZCLR3FTT0R type=write size=2490361 2024-09-12T17:36:55.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.581+0000 7fa80ca76780 1 > prepared operation key=94801LE91HZ9 tag=77Z7LRYXK7PO type=del size=323482 2024-09-12T17:36:55.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.582+0000 7fa80ca76780 -1 < failed to complete operation key=7QHTQ6VHZ34P tag=B0SLTAD48X1B type=del size=2586256: (22) Invalid argument 2024-09-12T17:36:55.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.584+0000 7fa80ca76780 1 > prepared operation key=07LPSZT2RKCC tag=J6SKFK7NH88B type=del size=908739 2024-09-12T17:36:55.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.585+0000 7fa80ca76780 1 < completed part key=_multipart_K243DOYPYVDS.2~1D38GUCE5XNM.0 size=326340 2024-09-12T17:36:55.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.587+0000 7fa80ca76780 1 < completed multipart upload key=K243DOYPYVDS upload=1D38GUCE5XNM tag=5R1L7QZWXR9P type=write size=1374916 2024-09-12T17:36:55.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.589+0000 7fa80ca76780 1 > prepared part key=_multipart_BLGMV3S9AY24.2~7XKWNADP3GLU.0 size=248403 2024-09-12T17:36:55.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.589+0000 7fa80ca76780 1 > prepared multipart upload key=BLGMV3S9AY24 upload=7XKWNADP3GLU tag=D75Q2E2JLE76 type=write size=1296979 2024-09-12T17:36:55.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.591+0000 7fa80ca76780 1 < completed delete operation key=MSZUYX441Y66 tag=RQVOMUSRQX07 type=del 2024-09-12T17:36:55.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.592+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=9QIM3ISY7ZB2 type=del size=1543465 2024-09-12T17:36:55.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.593+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~9F8YFE8O59F5.0 size=243203 2024-09-12T17:36:55.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.595+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=9F8YFE8O59F5 tag=HWWH0SPUZ5K3 type=write size=1291779 2024-09-12T17:36:55.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.597+0000 7fa80ca76780 1 > prepared operation key=4S33294MWCO1 tag=ZBALUB6VXWQ8 type=del size=2564243 2024-09-12T17:36:55.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.598+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~0ZX8XIEZYQNI.0 size=1048576 2024-09-12T17:36:55.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.599+0000 7fa80ca76780 1 < completed part key=_multipart_AKE8O7Q277HX.2~0ZX8XIEZYQNI.1 size=599538 2024-09-12T17:36:55.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.601+0000 7fa80ca76780 1 < completed multipart upload key=AKE8O7Q277HX upload=0ZX8XIEZYQNI tag=X6SUYCC3ZFWF type=write size=2696690 2024-09-12T17:36:55.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.603+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~JT73SMDPPLQI.0 size=1048576 2024-09-12T17:36:55.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.604+0000 7fa80ca76780 1 > prepared part key=_multipart_Z81704G91EPL.2~JT73SMDPPLQI.1 size=728215 2024-09-12T17:36:55.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.604+0000 7fa80ca76780 1 > prepared multipart upload key=Z81704G91EPL upload=JT73SMDPPLQI tag=VIFNPKBN41YZ type=write size=2825367 2024-09-12T17:36:55.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.606+0000 7fa80ca76780 1 < completed delete operation key=5CAG55DQEF3Y tag=FSXK3K3U2FC0 type=del 2024-09-12T17:36:55.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.607+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=PWT6VOTQKHDD type=del size=2847750 2024-09-12T17:36:55.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.608+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=SR5S3ZPYL9YT type=del 2024-09-12T17:36:55.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.610+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~B1E2XEDWNMBM.0 size=1048576 2024-09-12T17:36:55.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.611+0000 7fa80ca76780 1 > prepared part key=_multipart_7QHTQ6VHZ34P.2~B1E2XEDWNMBM.1 size=324519 2024-09-12T17:36:55.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.611+0000 7fa80ca76780 1 > prepared multipart upload key=7QHTQ6VHZ34P upload=B1E2XEDWNMBM tag=ZB1MMVYYHGVM type=write size=2421671 2024-09-12T17:36:55.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.612+0000 7fa80ca76780 1 < completed delete operation key=OJPZAWR5BLBN tag=8ICH0KH2ZDHF type=del 2024-09-12T17:36:55.614 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.613+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=R6M5ZJDFYIP1 type=del size=302262 2024-09-12T17:36:55.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.614+0000 7fa80ca76780 1 < completed delete operation key=WGL9JYJXSHBH tag=AQZQO88OEIDS type=del 2024-09-12T17:36:55.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.617+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~4G8PYP45ZZN0.0 size=1048576 2024-09-12T17:36:55.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.619+0000 7fa80ca76780 1 > prepared part key=_multipart_0U9KSMYWT2C3.2~4G8PYP45ZZN0.1 size=748200 2024-09-12T17:36:55.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.619+0000 7fa80ca76780 1 > prepared multipart upload key=0U9KSMYWT2C3 upload=4G8PYP45ZZN0 tag=E5QZ2L8WQDA9 type=write size=2845352 2024-09-12T17:36:55.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.620+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=3SZONO0DR991 type=del 2024-09-12T17:36:55.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.624+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~K53FBXI67H3A.0 size=1048576 2024-09-12T17:36:55.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.625+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~K53FBXI67H3A.1 size=482409 2024-09-12T17:36:55.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.625+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=K53FBXI67H3A tag=9T6E7P1IZ1Y9 type=write size=2579561 2024-09-12T17:36:55.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.626+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~CK9TN9OUTVCX.0 size=361690 2024-09-12T17:36:55.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.628+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=CK9TN9OUTVCX tag=1J0HVLW5SM32 type=write size=1410266 2024-09-12T17:36:55.630 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.629+0000 7fa80ca76780 1 > prepared operation key=U8O04HYQZRJC tag=PR0EACD0OHM0 type=write size=100199 2024-09-12T17:36:55.631 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.630+0000 7fa80ca76780 1 < completed delete operation key=0J6RTRJWZP1T tag=CZA7XIB43IGM type=del 2024-09-12T17:36:55.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.631+0000 7fa80ca76780 1 > prepared operation key=54KWSI77T73A tag=LAUU15DTHFDI type=del size=1450665 2024-09-12T17:36:55.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.632+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~1ABVAX8CLEWH.0 size=1048576 2024-09-12T17:36:55.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.633+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~1ABVAX8CLEWH.1 size=1048576 2024-09-12T17:36:55.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.634+0000 7fa80ca76780 1 < completed part key=_multipart_DYZIHCBF3D8U.2~1ABVAX8CLEWH.2 size=439589 2024-09-12T17:36:55.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.636+0000 7fa80ca76780 1 < completed multipart upload key=DYZIHCBF3D8U upload=1ABVAX8CLEWH tag=X7PM3ECGGTCR type=write size=3585317 2024-09-12T17:36:55.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.637+0000 7fa80ca76780 1 > prepared operation key=R02234GEWV6B tag=XN1EYPUNXQHD type=del size=1876404 2024-09-12T17:36:55.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.639+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~RLUE0XJSQC4W.0 size=1048576 2024-09-12T17:36:55.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.640+0000 7fa80ca76780 1 < completed part key=_multipart_54KWSI77T73A.2~RLUE0XJSQC4W.1 size=460813 2024-09-12T17:36:55.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.642+0000 7fa80ca76780 1 < completed multipart upload key=54KWSI77T73A upload=RLUE0XJSQC4W tag=YCC3WMCO0MIZ type=write size=2557965 2024-09-12T17:36:55.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.643+0000 7fa80ca76780 1 > prepared operation key=2AGKLZ3PQ2FD tag=2TWZ2CKOG6V2 type=del size=1018997 2024-09-12T17:36:55.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.645+0000 7fa80ca76780 1 < suggested remove operation key=VC1X03K12V80 tag=FGOWNLTF091G type=write 2024-09-12T17:36:55.647 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.646+0000 7fa80ca76780 1 > prepared operation key=K243DOYPYVDS tag=P647YV2KD7XU type=write size=425888 2024-09-12T17:36:55.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.649+0000 7fa80ca76780 1 < suggested remove operation key=94801LE91HZ9 tag=77Z7LRYXK7PO type=del 2024-09-12T17:36:55.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.650+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=EJTQKP0FNXLZ type=del size=38149 2024-09-12T17:36:55.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.651+0000 7fa80ca76780 1 < completed delete operation key=07LPSZT2RKCC tag=J6SKFK7NH88B type=del 2024-09-12T17:36:55.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.653+0000 7fa80ca76780 1 > prepared part key=_multipart_5CAG55DQEF3Y.2~ZU7UPTR169XD.0 size=667773 2024-09-12T17:36:55.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.653+0000 7fa80ca76780 1 > prepared multipart upload key=5CAG55DQEF3Y upload=ZU7UPTR169XD tag=0O7YAFJ5ZA4Z type=write size=1716349 2024-09-12T17:36:55.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.655+0000 7fa80ca76780 1 < completed part key=_multipart_BLGMV3S9AY24.2~7XKWNADP3GLU.0 size=248403 2024-09-12T17:36:55.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.657+0000 7fa80ca76780 1 < completed multipart upload key=BLGMV3S9AY24 upload=7XKWNADP3GLU tag=D75Q2E2JLE76 type=write size=1296979 2024-09-12T17:36:55.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.658+0000 7fa80ca76780 1 > prepared operation key=GKE6623N268Z tag=X0RH2YRJEVHF type=del size=1169614 2024-09-12T17:36:55.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.659+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=9QIM3ISY7ZB2 type=del 2024-09-12T17:36:55.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.661+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~PH0ZRIDJNUXH.0 size=1048576 2024-09-12T17:36:55.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.662+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~PH0ZRIDJNUXH.1 size=1048576 2024-09-12T17:36:55.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.663+0000 7fa80ca76780 1 > prepared part key=_multipart_OJPZAWR5BLBN.2~PH0ZRIDJNUXH.2 size=811379 2024-09-12T17:36:55.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.663+0000 7fa80ca76780 1 > prepared multipart upload key=OJPZAWR5BLBN upload=PH0ZRIDJNUXH tag=X6Q0YFMX4EZA type=write size=3957107 2024-09-12T17:36:55.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.664+0000 7fa80ca76780 1 < completed delete operation key=4S33294MWCO1 tag=ZBALUB6VXWQ8 type=del 2024-09-12T17:36:55.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.665+0000 7fa80ca76780 1 > prepared operation key=VC1X03K12V80 tag=LT3PQY5D1MK1 type=del size=1350972 2024-09-12T17:36:55.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.666+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~JT73SMDPPLQI.0 size=1048576 2024-09-12T17:36:55.669 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.667+0000 7fa80ca76780 1 < completed part key=_multipart_Z81704G91EPL.2~JT73SMDPPLQI.1 size=728215 2024-09-12T17:36:55.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.669+0000 7fa80ca76780 1 < completed multipart upload key=Z81704G91EPL upload=JT73SMDPPLQI tag=VIFNPKBN41YZ type=write size=2825367 2024-09-12T17:36:55.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.671+0000 7fa80ca76780 1 > prepared operation key=LU7PDGWTAK63 tag=LAFRYAMPWZ9S type=del size=217142 2024-09-12T17:36:55.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.672+0000 7fa80ca76780 1 < completed delete operation key=GKE6623N268Z tag=PWT6VOTQKHDD type=del 2024-09-12T17:36:55.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.673+0000 7fa80ca76780 1 > prepared operation key=WGL9JYJXSHBH tag=YXRP1TE4VNR1 type=del size=3465244 2024-09-12T17:36:55.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.674+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~B1E2XEDWNMBM.0 size=1048576 2024-09-12T17:36:55.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.675+0000 7fa80ca76780 1 < completed part key=_multipart_7QHTQ6VHZ34P.2~B1E2XEDWNMBM.1 size=324519 2024-09-12T17:36:55.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.677+0000 7fa80ca76780 1 < completed multipart upload key=7QHTQ6VHZ34P upload=B1E2XEDWNMBM tag=ZB1MMVYYHGVM type=write size=2421671 2024-09-12T17:36:55.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.678+0000 7fa80ca76780 1 > prepared operation key=8Z3EPQHMA6M5 tag=EMU47BT0GR7V type=del size=151671 2024-09-12T17:36:55.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.679+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=R6M5ZJDFYIP1 type=del 2024-09-12T17:36:55.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.682+0000 7fa80ca76780 1 > prepared part key=_multipart_0X3LGXL2QFRN.2~KLSCFD7EH4TD.0 size=391490 2024-09-12T17:36:55.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.682+0000 7fa80ca76780 1 > prepared multipart upload key=0X3LGXL2QFRN upload=KLSCFD7EH4TD tag=52GCPRS02PO1 type=write size=1440066 2024-09-12T17:36:55.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.683+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~4G8PYP45ZZN0.0 size=1048576 2024-09-12T17:36:55.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.684+0000 7fa80ca76780 1 < completed part key=_multipart_0U9KSMYWT2C3.2~4G8PYP45ZZN0.1 size=748200 2024-09-12T17:36:55.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.686+0000 7fa80ca76780 1 < completed multipart upload key=0U9KSMYWT2C3 upload=4G8PYP45ZZN0 tag=E5QZ2L8WQDA9 type=write size=2845352 2024-09-12T17:36:55.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.688+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~ISY5VHL34QRR.0 size=1048576 2024-09-12T17:36:55.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.689+0000 7fa80ca76780 1 > prepared part key=_multipart_H87S6AI6JT6D.2~ISY5VHL34QRR.1 size=856799 2024-09-12T17:36:55.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.689+0000 7fa80ca76780 1 > prepared multipart upload key=H87S6AI6JT6D upload=ISY5VHL34QRR tag=8BTD5PUJMYIP type=write size=2953951 2024-09-12T17:36:55.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.690+0000 7fa80ca76780 1 < completed part key=_multipart_0X3LGXL2QFRN.2~K53FBXI67H3A.0 size=1048576 2024-09-12T17:36:55.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.690+0000 7fa80ca76780 1 < canceled part key=_multipart_0X3LGXL2QFRN.2~K53FBXI67H3A.1 size=482409 2024-09-12T17:36:55.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.692+0000 7fa80ca76780 1 < canceled multipart upload key=0X3LGXL2QFRN upload=K53FBXI67H3A tag=9T6E7P1IZ1Y9 type=write size=2579561 2024-09-12T17:36:55.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.694+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~1V4WS6EXQF1X.0 size=1048576 2024-09-12T17:36:55.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.695+0000 7fa80ca76780 1 > prepared part key=_multipart_54KWSI77T73A.2~1V4WS6EXQF1X.1 size=981044 2024-09-12T17:36:55.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.695+0000 7fa80ca76780 1 > prepared multipart upload key=54KWSI77T73A upload=1V4WS6EXQF1X tag=RAB0SGZFARRV type=write size=3078196 2024-09-12T17:36:55.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.696+0000 7fa80ca76780 1 < completed write operation key=U8O04HYQZRJC tag=PR0EACD0OHM0 type=write size=100199 2024-09-12T17:36:55.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.697+0000 7fa80ca76780 1 > prepared operation key=FKK4IGD1436I tag=BFMF5VQG9SST type=del size=2682390 2024-09-12T17:36:55.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.698+0000 7fa80ca76780 1 < completed delete operation key=54KWSI77T73A tag=LAUU15DTHFDI type=del 2024-09-12T17:36:55.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.700+0000 7fa80ca76780 1 > prepared operation key=0J6RTRJWZP1T tag=4O5A0GKOLRB4 type=del size=3461228 2024-09-12T17:36:55.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.701+0000 7fa80ca76780 1 < completed delete operation key=R02234GEWV6B tag=XN1EYPUNXQHD type=del 2024-09-12T17:36:55.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.703+0000 7fa80ca76780 1 > prepared part key=_multipart_R871XU2TDWID.2~K2CT2EAIWB4C.0 size=761490 2024-09-12T17:36:55.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.703+0000 7fa80ca76780 1 > prepared multipart upload key=R871XU2TDWID upload=K2CT2EAIWB4C tag=17HP2KME8VGF type=write size=1810066 2024-09-12T17:36:55.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.704+0000 7fa80ca76780 1 < completed delete operation key=2AGKLZ3PQ2FD tag=2TWZ2CKOG6V2 type=del 2024-09-12T17:36:55.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.706+0000 7fa80ca76780 1 > prepared part key=_multipart_K243DOYPYVDS.2~7C1C4NO3YKIV.0 size=575999 2024-09-12T17:36:55.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:36:55.706+0000 7fa80ca76780 1 > prepared multipart upload key=K243DOYPYVDS upload=7C1C4NO3YKIV tag=NJL9CRX7SZ05 type=write size=1624575 2024-09-12T17:36:55.708 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] cls_rgw_stats.simulate (8964 ms) 2024-09-12T17:36:55.708 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 1 test from cls_rgw_stats (8964 ms total) 2024-09-12T17:36:55.708 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:36:55.708 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:36:55.820 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 1 test from 1 test suite ran. (10980 ms total) 2024-09-12T17:36:55.821 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 1 test. 2024-09-12T17:36:55.824 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:36:55.824 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:36:55.903 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T17:36:55.904 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T17:36:55.904 DEBUG:teuthology.orchestra.run.smithi107:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T17:36:55.986 INFO:tasks.workunit.client.0.smithi107.stdout:Running main() from gmock_main.cc 2024-09-12T17:36:55.986 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T17:36:55.986 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:36:57.845 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 31 tests from CmpOmap 2024-09-12T17:36:57.845 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T17:36:57.856 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (11 ms) 2024-09-12T17:36:57.856 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T17:36:57.868 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (11 ms) 2024-09-12T17:36:57.868 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T17:36:57.870 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T17:36:57.870 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T17:36:57.873 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-12T17:36:57.873 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T17:36:57.879 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-09-12T17:36:57.879 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T17:36:57.885 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2024-09-12T17:36:57.885 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T17:36:57.888 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-12T17:36:57.888 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T17:36:57.891 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-09-12T17:36:57.891 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T17:36:57.895 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-12T17:36:57.895 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T17:36:57.899 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-09-12T17:36:57.900 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T17:36:57.900 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T17:36:57.900 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T17:36:57.901 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-12T17:36:57.901 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T17:36:57.908 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-12T17:36:57.908 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T17:36:57.915 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-09-12T17:36:57.915 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T17:36:57.921 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-09-12T17:36:57.921 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T17:36:57.927 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-09-12T17:36:57.927 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T17:36:57.936 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_set_vals_str (7 ms) 2024-09-12T17:36:57.937 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T17:36:57.943 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (9 ms) 2024-09-12T17:36:57.943 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T17:36:57.946 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-12T17:36:57.946 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T17:36:57.949 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-12T17:36:57.949 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T17:36:57.949 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (0 ms) 2024-09-12T17:36:57.950 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T17:36:57.950 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-12T17:36:57.950 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T17:36:57.956 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (6 ms) 2024-09-12T17:36:57.956 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T17:36:57.961 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (5 ms) 2024-09-12T17:36:57.961 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T17:36:57.968 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-12T17:36:57.968 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T17:36:57.976 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-09-12T17:36:57.976 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T17:36:57.978 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-12T17:36:57.978 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T17:36:57.981 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-12T17:36:57.981 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T17:36:57.982 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T17:36:57.982 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T17:36:57.982 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-12T17:36:57.982 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T17:36:57.989 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-09-12T17:36:57.989 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 31 tests from CmpOmap (144 ms total) 2024-09-12T17:36:57.989 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:36:57.989 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:36:58.851 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 31 tests from 1 test suite ran. (2865 ms total) 2024-09-12T17:36:58.852 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 31 tests. 2024-09-12T17:36:58.855 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:36:58.855 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:36:58.937 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T17:36:58.939 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T17:36:58.939 DEBUG:teuthology.orchestra.run.smithi107:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T17:36:59.024 INFO:tasks.workunit.client.0.smithi107.stdout:Running main() from gmock_main.cc 2024-09-12T17:36:59.024 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:36:59.024 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:36:59.024 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T17:36:59.024 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T17:37:01.873 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2846 ms) 2024-09-12T17:37:01.873 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T17:37:04.893 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3023 ms) 2024-09-12T17:37:04.893 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T17:37:07.909 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.Reserve (3012 ms) 2024-09-12T17:37:07.909 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T17:37:10.932 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3026 ms) 2024-09-12T17:37:10.932 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T17:37:13.947 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.Commit (3015 ms) 2024-09-12T17:37:13.947 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T17:37:16.981 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.Stats (3035 ms) 2024-09-12T17:37:16.981 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T17:37:21.012 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4031 ms) 2024-09-12T17:37:21.012 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T17:37:24.031 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.Abort (3019 ms) 2024-09-12T17:37:24.032 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T17:37:27.051 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.ReserveError (3020 ms) 2024-09-12T17:37:27.051 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T17:37:30.071 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.CommitError (3020 ms) 2024-09-12T17:37:30.072 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T17:37:33.094 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.AbortError (3022 ms) 2024-09-12T17:37:33.094 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T17:37:36.115 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3020 ms) 2024-09-12T17:37:36.115 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T17:37:39.137 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3024 ms) 2024-09-12T17:37:39.137 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T17:37:42.154 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3017 ms) 2024-09-12T17:37:42.155 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T17:37:45.176 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3021 ms) 2024-09-12T17:37:45.176 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T17:37:48.190 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3015 ms) 2024-09-12T17:37:48.191 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T17:37:51.222 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3032 ms) 2024-09-12T17:37:51.222 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T17:37:54.237 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.Cleanup (3015 ms) 2024-09-12T17:37:54.237 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T17:38:04.323 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10086 ms) 2024-09-12T17:38:04.324 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T17:38:07.359 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3036 ms) 2024-09-12T17:38:07.360 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T17:38:20.685 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13326 ms) 2024-09-12T17:38:20.686 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T17:38:24.705 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4020 ms) 2024-09-12T17:38:24.705 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T17:38:30.741 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6035 ms) 2024-09-12T17:38:30.741 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5034 ms) 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 24 tests from TestCls2PCQueue (96750 ms total) 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 24 tests from 1 test suite ran. (96750 ms total) 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 24 tests. 2024-09-12T17:38:35.779 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:38:35.779 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:38:35.821 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T17:38:35.823 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T17:38:35.824 DEBUG:teuthology.orchestra.run.smithi107:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T17:38:35.916 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:35.917 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:35.917 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:38:35.917 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:38:37.784 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 4 tests from ClsAccount 2024-09-12T17:38:37.784 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsAccount.add 2024-09-12T17:38:37.802 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsAccount.add (19 ms) 2024-09-12T17:38:37.802 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsAccount.get 2024-09-12T17:38:37.806 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsAccount.get (4 ms) 2024-09-12T17:38:37.806 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsAccount.rm 2024-09-12T17:38:37.812 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsAccount.rm (6 ms) 2024-09-12T17:38:37.812 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] ClsAccount.list 2024-09-12T17:38:37.831 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] ClsAccount.list (19 ms) 2024-09-12T17:38:37.831 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 4 tests from ClsAccount (48 ms total) 2024-09-12T17:38:37.831 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:38:37.831 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:38:38.807 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 4 tests from 1 test suite ran. (2889 ms total) 2024-09-12T17:38:38.807 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 4 tests. 2024-09-12T17:38:38.810 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:38:38.811 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:38:38.855 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T17:38:38.856 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T17:38:38.856 DEBUG:teuthology.orchestra.run.smithi107:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T17:38:38.950 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:38.950 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:38.950 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T17:38:38.950 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:38:40.801 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T17:38:40.802 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T17:38:40.825 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] rgw_gc_log.init_existing_queue (24 ms) 2024-09-12T17:38:40.825 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T17:38:40.828 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-12T17:38:40.828 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T17:38:40.831 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-09-12T17:38:40.831 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T17:38:40.833 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-12T17:38:40.833 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T17:38:40.836 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-12T17:38:40.837 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T17:38:40.838 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] rgw_gc_log.defer2_before_init (1 ms) 2024-09-12T17:38:40.838 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 6 tests from rgw_gc_log (37 ms total) 2024-09-12T17:38:40.838 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:38:40.838 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:38:41.806 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 6 tests from 1 test suite ran. (2856 ms total) 2024-09-12T17:38:41.807 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 6 tests. 2024-09-12T17:38:41.810 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:38:41.810 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:38:41.853 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T17:38:41.854 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T17:38:41.854 DEBUG:teuthology.orchestra.run.smithi107:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T17:38:41.950 INFO:tasks.workunit.client.0.smithi107.stdout:Running main() from gmock_main.cc 2024-09-12T17:38:41.950 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: _obj ns= i= 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: _obj ns= i= 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: _obj ns= i= 2024-09-12T17:38:41.951 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:41.952 INFO:tasks.workunit.client.0.smithi107.stdout: "obj1": { 2024-09-12T17:38:41.952 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.952 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.952 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.952 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.952 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.952 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.952 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.952 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.952 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.952 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.952 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.953 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.953 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.953 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.953 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.953 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.953 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.956 INFO:tasks.workunit.client.0.smithi107.stdout: "obj2": { 2024-09-12T17:38:41.956 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.956 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.956 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.956 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.956 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.956 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.956 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.956 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.957 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.957 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.957 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.957 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.957 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.957 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.957 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.957 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.957 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.957 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3": { 2024-09-12T17:38:41.957 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.957 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.958 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.958 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.958 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.958 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.958 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.958 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.958 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.958 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3-2": { 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.959 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:41.960 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: _obj ns=ns i= 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: _obj ns=ns i= 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: _obj ns=ns i= 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout: "obj1": { 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.961 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.962 INFO:tasks.workunit.client.0.smithi107.stdout: "obj2": { 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.963 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.964 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:41.964 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.964 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.964 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3": { 2024-09-12T17:38:41.964 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.964 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.964 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.965 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3-2": { 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.966 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj[v1] 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj[v1] 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: _obj ns= i=v1 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj[v1] 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj[v1] 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: _obj ns= i=v1 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj[v1] 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj[v1] 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: _obj ns= i=v1 2024-09-12T17:38:41.967 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: "obj1": { 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.968 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "v1", 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: "obj2": { 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.969 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "v1", 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3": { 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.970 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.971 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3-2": { 2024-09-12T17:38:41.972 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.972 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.972 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.972 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.972 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "v1", 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.973 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj[v1] 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj[v1] 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj[v1] 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj[v1] 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj[v1] 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: _obj[v1] 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout: "obj1": { 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.974 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "v1", 2024-09-12T17:38:41.975 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: "obj2": { 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.976 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "v1", 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3": { 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.977 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3-2": { 2024-09-12T17:38:41.978 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_obj", 2024-09-12T17:38:41.979 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "v1", 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestRGWObj.underscore (1 ms) 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: obj ns= i= 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: obj ns= i= 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj 2024-09-12T17:38:41.980 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: obj ns= i= 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout: "obj1": { 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.981 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: "obj2": { 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.982 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3": { 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.983 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.984 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3-2": { 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.985 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: obj ns=ns i= 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: obj ns=ns i= 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj 2024-09-12T17:38:41.986 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: obj ns=ns i= 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: "obj1": { 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.987 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: "obj2": { 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.988 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3": { 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.989 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.990 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3-2": { 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.991 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj[v1] 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj[v1] 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: obj ns= i=v1 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj[v1] 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj[v1] 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: obj ns= i=v1 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj[v1] 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj[v1] 2024-09-12T17:38:41.992 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: obj ns= i=v1 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: "obj1": { 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.993 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "v1", 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: "obj2": { 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.994 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "v1", 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3": { 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.995 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.996 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3-2": { 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.997 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "v1", 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj[v1] 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj[v1] 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj[v1] 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj[v1] 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj[v1] 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout:parsed: obj[v1] 2024-09-12T17:38:41.998 INFO:tasks.workunit.client.0.smithi107.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: "obj1": { 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:41.999 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "v1", 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: "obj2": { 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.000 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "v1", 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3": { 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.001 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.002 INFO:tasks.workunit.client.0.smithi107.stdout: "obj3-2": { 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "obj", 2024-09-12T17:38:42.003 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "v1", 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.004 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.005 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.006 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": "default-placement.data", 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker_myobj", 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.007 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.008 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.009 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.010 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker_myobj", 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.011 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.012 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.013 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.014 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": "default-placement.data", 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.015 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.016 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.017 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.018 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:38:42.019 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.020 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.021 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.022 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.023 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": "default-placement.data", 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.024 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.025 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.026 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.027 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.028 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.029 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.030 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.031 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": "default-placement.data", 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.032 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.033 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.034 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.035 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.036 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.037 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.038 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.039 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.040 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": "default-placement.data", 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker___myobj", 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj" 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.041 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.042 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.043 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.043 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.043 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.043 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.043 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.043 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.043 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.043 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.043 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.043 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.043 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.043 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.044 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.045 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.045 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.045 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.045 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.045 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.045 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.045 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.045 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.045 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.045 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.045 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.045 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker___myobj", 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj" 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.046 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.047 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.048 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.049 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": "default-placement.data", 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.050 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.051 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.052 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.053 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.054 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.055 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.056 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.057 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": "default-placement.data", 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:38:42.058 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj" 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.059 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.060 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.061 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.062 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj" 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.063 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.064 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.065 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.066 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": "default-placement.data", 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.067 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.068 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.069 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.070 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:38:42.071 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.072 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.073 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.074 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.075 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": "default-placement.data", 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker___myobj_", 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj_" 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.076 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.077 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.078 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.079 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker___myobj_", 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj_" 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.080 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.081 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.082 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.083 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": "default-placement.data", 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.084 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.085 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.086 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.087 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.088 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.089 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.090 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.091 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.092 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": "default-placement.data", 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj_" 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.093 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.094 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.095 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.096 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj_" 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.097 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.098 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.099 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.100 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": "default-placement.data", 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:38:42.101 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "test", 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": "", 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": "" 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.102 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.103 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout: "obj": { 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.104 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.105 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.106 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T17:38:42.107 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker_myobj", 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.108 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.109 INFO:tasks.workunit.client.0.smithi107.stdout:raw=.data-pool:marker_myobj 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj2": { 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker_myobj", 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj2": { 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.110 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.111 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout:raw2=.data-pool:marker_myobj 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.112 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.113 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj2": { 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj2": { 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.114 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.115 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.116 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.117 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj2": { 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj2": { 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.118 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.119 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.120 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.121 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj2": { 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj2": { 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.122 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "myobj", 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.123 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker___myobj", 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj" 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.124 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.125 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout:raw=.data-pool:marker___myobj 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj2": { 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker___myobj", 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj" 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj2": { 2024-09-12T17:38:42.126 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.127 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout:raw2=.data-pool:marker___myobj 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.128 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.129 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj2": { 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj2": { 2024-09-12T17:38:42.130 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.131 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj" 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.132 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.133 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj2": { 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj" 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.134 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj2": { 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.135 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.136 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.137 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj2": { 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj2": { 2024-09-12T17:38:42.138 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj", 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.139 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker___myobj_", 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj_" 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.140 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.141 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj2": { 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker___myobj_", 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj_" 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.142 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj2": { 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.143 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.144 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.145 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj2": { 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.146 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj2": { 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.147 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "", 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj_" 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.148 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.149 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj2": { 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "marker__myobj_" 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.150 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj2": { 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.151 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "" 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj": { 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.152 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj": { 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.153 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout: "raw_obj2": { 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout: "pool": ".data-pool", 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout: "loc": "" 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.154 INFO:tasks.workunit.client.0.smithi107.stdout: "new_obj2": { 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket": { 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "ebtest", 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "marker": "marker", 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_id": "bucket-id", 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "tenant": "", 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "explicit_placement": { 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "data_pool": ".data-pool", 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "data_extra_pool": "", 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "index_pool": ".index-pool" 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "key": { 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "name": "_myobj_", 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "instance": "inst", 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: "ns": "ns" 2024-09-12T17:38:42.155 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.156 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.156 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.156 INFO:tasks.workunit.client.0.smithi107.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:38:42.156 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T17:38:42.156 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T17:38:42.156 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:38:42.156 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:38:42.156 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T17:38:42.156 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 4 tests. 2024-09-12T17:38:42.156 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:38:42.157 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:38:42.202 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T17:38:42.204 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T17:38:42.204 DEBUG:teuthology.orchestra.run.smithi107:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T17:38:42.342 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:42.343 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:42.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.378+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.379+0000 7f9d54698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.379+0000 7f9d54698800 20 realm 2024-09-12T17:38:42.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.379+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.379+0000 7f9d54698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.379+0000 7f9d54698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:42.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.379+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.380+0000 7f9d54698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.380+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.381+0000 7f9d54698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:42.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.381+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.381+0000 7f9d54698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:42.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.381+0000 7f9d54698800 20 searching for the correct realm 2024-09-12T17:38:42.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.385+0000 7f9d4bfff640 0 -- 172.21.15.107:0/587811725 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f9d3c06c040 msgr2=0x7f9d3c066d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:42.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.389+0000 7f9d52983640 0 -- 172.21.15.107:0/587811725 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7f9d3c070e00 msgr2=0x7f9d3c026910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:42.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.392+0000 7f9d54698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:42.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.392+0000 7f9d54698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:42.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.392+0000 7f9d54698800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.392+0000 7f9d54698800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.392+0000 7f9d54698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.392+0000 7f9d54698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.392+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.392+0000 7f9d54698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.392+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.393+0000 7f9d54698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.393+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.393+0000 7f9d54698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.393+0000 7f9d54698800 20 zone default found 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.393+0000 7f9d54698800 4 Realm: () 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.393+0000 7f9d54698800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.393+0000 7f9d54698800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:38:42.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.393+0000 7f9d54698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:42.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.393+0000 7f9d54698800 20 zonegroup default 2024-09-12T17:38:42.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.393+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.393+0000 7f9d54698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.393+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.394+0000 7f9d54698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.394+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.394+0000 7f9d54698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.394+0000 7f9d54698800 20 started sync module instance, tier type = 2024-09-12T17:38:42.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.394+0000 7f9d54698800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:38:42.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.403+0000 7f9d54698800 20 add_watcher() i=0 2024-09-12T17:38:42.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.403+0000 7f9d54698800 20 add_watcher() i=1 2024-09-12T17:38:42.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.403+0000 7f9d54698800 20 add_watcher() i=2 2024-09-12T17:38:42.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.403+0000 7f9d54698800 20 add_watcher() i=3 2024-09-12T17:38:42.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.403+0000 7f9d54698800 20 add_watcher() i=4 2024-09-12T17:38:42.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.403+0000 7f9d54698800 20 add_watcher() i=5 2024-09-12T17:38:42.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.403+0000 7f9d54698800 20 add_watcher() i=6 2024-09-12T17:38:42.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.404+0000 7f9d54698800 20 add_watcher() i=7 2024-09-12T17:38:42.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.404+0000 7f9d54698800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:42.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.406+0000 7f9c08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:42.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.406+0000 7f9d54698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:42.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.406+0000 7f9d54698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:42.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.406+0000 7f9d54698800 5 note: GC not initialized 2024-09-12T17:38:42.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.407+0000 7f9b837fe640 20 reqs_thread_entry: start 2024-09-12T17:38:42.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.407+0000 7f9d54698800 20 init_complete bucket index max shards: 1 2024-09-12T17:38:42.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.407+0000 7f9d54698800 20 Filter name: none 2024-09-12T17:38:42.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.407+0000 7f9b817fa640 20 reqs_thread_entry: start 2024-09-12T17:38:42.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.407+0000 7f9d54698800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T17:38:42.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.407+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.407+0000 7f9d54698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.407+0000 7f9d54698800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.407+0000 7f9d54698800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.407+0000 7f9d54698800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.407+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.408+0000 7f9d54698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.408+0000 7f9d54698800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.408+0000 7f9d54698800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.408+0000 7f9d54698800 10 cache get: name=default.rgw.meta+users.keys+Ve4B9lJgRJwdALaGxYSofEvglPc= : miss 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.408+0000 7f9d54698800 20 rados->read ofs=0 len=0 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.408+0000 7f9d54698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.408+0000 7f9d54698800 10 cache put: name=default.rgw.meta+users.keys+Ve4B9lJgRJwdALaGxYSofEvglPc= info.flags=0x0 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.408+0000 7f9d54698800 10 adding default.rgw.meta+users.keys+Ve4B9lJgRJwdALaGxYSofEvglPc= to cache LRU end 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.408+0000 7f9d54698800 10 cache get: name=default.rgw.meta+users.keys+Ve4B9lJgRJwdALaGxYSofEvglPc= : hit (negative entry) 2024-09-12T17:38:42.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.408+0000 7f9d54698800 10 cache get: name=default.rgw.meta+users.keys+Ve4B9lJgRJwdALaGxYSofEvglPc= : hit (negative entry) 2024-09-12T17:38:42.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.409+0000 7f9d54698800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:38:42.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.409+0000 7f9d54698800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:38:42.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.409+0000 7f9d54698800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T17:38:42.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.410+0000 7f9c35ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824002 cookie 94618407997968 notifier 5511 bl.length()=697 2024-09-12T17:38:42.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.410+0000 7f9c35ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:38:42.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.410+0000 7f9c35ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:38:42.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.411+0000 7f9d54698800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:38:42.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.411+0000 7f9d54698800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:38:42.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.411+0000 7f9d54698800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T17:38:42.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.412+0000 7f9c357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824000 cookie 94618407992960 notifier 5511 bl.length()=194 2024-09-12T17:38:42.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.412+0000 7f9c357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:38:42.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.412+0000 7f9c357fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:38:42.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.414+0000 7f9d54698800 10 cache put: name=default.rgw.meta+users.keys+Ve4B9lJgRJwdALaGxYSofEvglPc= info.flags=0x7 2024-09-12T17:38:42.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.414+0000 7f9d54698800 10 moving default.rgw.meta+users.keys+Ve4B9lJgRJwdALaGxYSofEvglPc= to cache LRU end 2024-09-12T17:38:42.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.414+0000 7f9d54698800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:Ve4B9lJgRJwdALaGxYSofEvglPc=, ofs0, ns] 2024-09-12T17:38:42.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.414+0000 7f9c357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824002 cookie 94618408010528 notifier 5511 bl.length()=203 2024-09-12T17:38:42.416 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.414+0000 7f9c357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+Ve4B9lJgRJwdALaGxYSofEvglPc= info.flags=0x7 2024-09-12T17:38:42.416 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.414+0000 7f9c357fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+Ve4B9lJgRJwdALaGxYSofEvglPc= to cache LRU end 2024-09-12T17:38:42.416 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:38:42.416 INFO:tasks.workunit.client.0.smithi107.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T17:38:42.416 INFO:tasks.workunit.client.0.smithi107.stdout: "display_name": "librgw test user", 2024-09-12T17:38:42.416 INFO:tasks.workunit.client.0.smithi107.stdout: "email": "librgw@example.com", 2024-09-12T17:38:42.416 INFO:tasks.workunit.client.0.smithi107.stdout: "suspended": 0, 2024-09-12T17:38:42.416 INFO:tasks.workunit.client.0.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:38:42.416 INFO:tasks.workunit.client.0.smithi107.stdout: "subusers": [], 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi107.stdout: "keys": [ 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi107.stdout: { 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi107.stdout: "user": "ceph-test-librgw-file", 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi107.stdout: "access_key": "Ve4B9lJgRJwdALaGxYSofEvglPc=", 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi107.stdout: "secret_key": "VzhcoqKAofONGv6E4LaW1eX0BRMKmPMlaqwFbrirPP32OW5KfkbqAQ==", 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi107.stdout: "active": true, 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi107.stdout: "create_date": "2024-09-12T17:38:42.409519Z" 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi107.stdout: ], 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi107.stdout: "swift_keys": [], 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi107.stdout: "caps": [], 2024-09-12T17:38:42.417 INFO:tasks.workunit.client.0.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "default_placement": "", 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "placement_tags": [], 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_quota": { 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "enabled": false, 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "max_size": -1, 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "max_objects": -1 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "user_quota": { 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "enabled": false, 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:38:42.418 INFO:tasks.workunit.client.0.smithi107.stdout: "max_size": -1, 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout: "max_objects": -1 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout: "type": "rgw", 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout: "mfa_ids": [], 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout: "account_id": "", 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout: "path": "/", 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout: "create_date": "2024-09-12T17:38:42.409508Z", 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout: "tags": [], 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout: "group_ids": [] 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:38:42.419 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:38:42.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.415+0000 7f9c08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:42.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.418+0000 7f9d54698800 20 remove_watcher() i=0 2024-09-12T17:38:42.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.418+0000 7f9d54698800 2 removed watcher, disabling cache 2024-09-12T17:38:42.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.419+0000 7f9d54698800 20 remove_watcher() i=1 2024-09-12T17:38:42.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.420+0000 7f9d54698800 20 remove_watcher() i=2 2024-09-12T17:38:42.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.421+0000 7f9d54698800 20 remove_watcher() i=3 2024-09-12T17:38:42.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.422+0000 7f9d54698800 20 remove_watcher() i=4 2024-09-12T17:38:42.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.423+0000 7f9d54698800 20 remove_watcher() i=5 2024-09-12T17:38:42.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.424+0000 7f9d54698800 20 remove_watcher() i=6 2024-09-12T17:38:42.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:42.425+0000 7f9d54698800 20 remove_watcher() i=7 2024-09-12T17:38:42.436 INFO:tasks.workunit.client.0.smithi107.stdout:phase 1.1 2024-09-12T17:38:42.457 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:38:42.457 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:38:42.458 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:38:42.458 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:38:42.468 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:42.469 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:43.046 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.INIT (589 ms) 2024-09-12T17:38:43.046 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:38:43.049 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT_NOROOT (3 ms) 2024-09-12T17:38:43.049 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:38:43.049 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:38:43.049 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:38:43.056 INFO:tasks.workunit.client.0.smithi107.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T17:38:43.060 INFO:tasks.workunit.client.0.smithi107.stdout:creating: nfsroot:foo/f1 2024-09-12T17:38:43.063 INFO:tasks.workunit.client.0.smithi107.stdout:creating: nfsroot:foo/f2 2024-09-12T17:38:43.066 INFO:tasks.workunit.client.0.smithi107.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T17:38:43.071 INFO:tasks.workunit.client.0.smithi107.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T17:38:43.074 INFO:tasks.workunit.client.0.smithi107.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T17:38:43.077 INFO:tasks.workunit.client.0.smithi107.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T17:38:43.080 INFO:tasks.workunit.client.0.smithi107.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T17:38:43.083 INFO:tasks.workunit.client.0.smithi107.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T17:38:43.086 INFO:tasks.workunit.client.0.smithi107.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T17:38:43.089 INFO:tasks.workunit.client.0.smithi107.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T17:38:43.092 INFO:tasks.workunit.client.0.smithi107.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T17:38:43.096 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SETUP_HIER1 (47 ms) 2024-09-12T17:38:43.096 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:38:43.180 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SETUP_DIRS1 (84 ms) 2024-09-12T17:38:43.181 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:38:43.181 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:38:43.181 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:38:43.196 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (16 ms) 2024-09-12T17:38:43.197 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:38:43.231 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (35 ms) 2024-09-12T17:38:43.231 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:38:43.231 INFO:tasks.workunit.client.0.smithi107.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T17:38:43.237 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-09-12T17:38:43.237 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:38:43.238 INFO:tasks.workunit.client.0.smithi107.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T17:38:43.244 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-09-12T17:38:43.244 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:38:43.244 INFO:tasks.workunit.client.0.smithi107.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:38:43.244 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:38:43.244 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:38:43.244 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:38:43.244 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:38:43.244 INFO:tasks.workunit.client.0.smithi107.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:38:43.244 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:38:43.245 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:38:43.245 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:38:43.245 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:38:43.245 INFO:tasks.workunit.client.0.smithi107.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:38:43.245 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:38:43.245 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:38:43.245 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:38:43.245 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:38:43.245 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:38:43.245 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:38:43.245 INFO:tasks.workunit.client.0.smithi107.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:38:43.245 INFO:tasks.workunit.client.0.smithi107.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:38:43.247 INFO:tasks.workunit.client.0.smithi107.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:38:43.247 INFO:tasks.workunit.client.0.smithi107.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:38:43.249 INFO:tasks.workunit.client.0.smithi107.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:38:43.249 INFO:tasks.workunit.client.0.smithi107.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:38:43.249 INFO:tasks.workunit.client.0.smithi107.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:38:43.250 INFO:tasks.workunit.client.0.smithi107.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:38:43.250 INFO:tasks.workunit.client.0.smithi107.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:38:43.251 INFO:tasks.workunit.client.0.smithi107.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:38:43.251 INFO:tasks.workunit.client.0.smithi107.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:38:43.251 INFO:tasks.workunit.client.0.smithi107.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:38:43.252 INFO:tasks.workunit.client.0.smithi107.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:38:43.253 INFO:tasks.workunit.client.0.smithi107.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:38:43.254 INFO:tasks.workunit.client.0.smithi107.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:38:43.254 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-09-12T17:38:43.254 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:38:43.426 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READF_SETUP1 (171 ms) 2024-09-12T17:38:43.426 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:38:43.426 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:38:43.426 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:38:43.426 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:38:43.427 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:38:43.427 INFO:tasks.workunit.client.0.smithi107.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:38:43.427 INFO:tasks.workunit.client.0.smithi107.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:38:43.427 INFO:tasks.workunit.client.0.smithi107.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:38:43.427 INFO:tasks.workunit.client.0.smithi107.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:38:43.428 INFO:tasks.workunit.client.0.smithi107.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:38:43.428 INFO:tasks.workunit.client.0.smithi107.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:38:43.428 INFO:tasks.workunit.client.0.smithi107.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:38:43.428 INFO:tasks.workunit.client.0.smithi107.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:38:43.428 INFO:tasks.workunit.client.0.smithi107.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:38:43.428 INFO:tasks.workunit.client.0.smithi107.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:38:43.429 INFO:tasks.workunit.client.0.smithi107.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:38:43.429 INFO:tasks.workunit.client.0.smithi107.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:38:43.429 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:38:43.429 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:38:43.431 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:38:43.431 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:38:43.434 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:38:43.435 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:38:43.438 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:38:43.438 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:38:43.439 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:38:43.439 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:38:43.439 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:38:43.440 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:38:43.440 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:38:43.442 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:38:43.442 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:38:43.442 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:38:43.442 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:38:43.442 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:38:43.442 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.HIER1 (17 ms) 2024-09-12T17:38:43.442 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:38:43.442 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:38:43.443 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:38:43.443 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:38:43.443 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:38:43.443 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:38:43.443 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:38:43.443 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:38:43.443 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:38:43.443 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:38:43.443 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:38:43.443 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:38:43.443 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:38:43.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:43.441+0000 7fb68c33b8c0 -1 shutting down 2024-09-12T17:38:43.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:38:43.442+0000 7fb56423f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64313, si_uid : 1000, si_addr0x3e80000fb39, si_status0 2024-09-12T17:39:13.245 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SHUTDOWN (29802 ms) 2024-09-12T17:39:13.246 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 24 tests from LibRGW (30787 ms total) 2024-09-12T17:39:13.246 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:39:13.246 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:39:13.246 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 24 tests from 1 test suite ran. (30787 ms total) 2024-09-12T17:39:13.246 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 24 tests. 2024-09-12T17:39:13.252 INFO:tasks.workunit.client.0.smithi107.stdout:phase 1.2 2024-09-12T17:39:13.276 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:39:13.276 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:39:13.276 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:39:13.276 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:39:13.284 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:13.285 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:13.460 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.INIT (184 ms) 2024-09-12T17:39:13.461 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:39:13.462 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:39:13.462 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:39:13.462 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:39:13.462 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:39:13.463 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T17:39:13.463 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:39:13.463 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T17:39:13.463 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:39:13.463 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:39:13.464 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:39:13.464 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:39:13.464 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:39:13.464 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:39:13.464 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:39:13.464 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:39:13.464 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:39:13.464 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:39:13.464 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:39:13.464 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:39:13.465 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:39:13.465 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T17:39:13.465 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:39:13.465 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:39:13.465 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:39:13.465 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:39:13.465 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:39:13.465 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:39:13.465 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:39:13.466 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:39:13.466 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:39:13.466 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T17:39:13.466 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:39:13.466 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:39:13.466 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:39:13.466 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:39:13.466 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:39:13.466 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:39:13.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:39:13.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:39:13.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:39:13.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:39:13.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:39:13.468 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:39:13.468 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:39:13.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:39:13.461+0000 7fa0581268c0 -1 shutting down 2024-09-12T17:39:13.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:39:13.463+0000 7f9f2ff77640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64936, si_uid : 1000, si_addr0x3e80000fda8, si_status0 2024-09-12T17:39:43.589 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SHUTDOWN (30127 ms) 2024-09-12T17:39:43.589 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 24 tests from LibRGW (30312 ms total) 2024-09-12T17:39:43.589 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:39:43.590 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:39:43.590 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 24 tests from 1 test suite ran. (30312 ms total) 2024-09-12T17:39:43.590 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 24 tests. 2024-09-12T17:39:43.594 INFO:tasks.workunit.client.0.smithi107.stdout:phase 1.3 2024-09-12T17:39:43.618 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:39:43.618 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:39:43.618 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:39:43.618 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:39:43.629 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:43.629 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:44.042 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.INIT (423 ms) 2024-09-12T17:39:44.042 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:39:44.043 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:39:44.043 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:39:44.043 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:39:44.043 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:39:44.047 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-09-12T17:39:44.047 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:39:44.107 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SETUP_DIRS1 (60 ms) 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:39:44.108 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:39:44.109 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:39:44.109 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:39:44.109 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:39:44.109 INFO:tasks.workunit.client.0.smithi107.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:39:44.109 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:39:44.109 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:39:44.109 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:39:44.109 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:39:44.109 INFO:tasks.workunit.client.0.smithi107.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:39:44.110 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:39:44.110 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:39:44.110 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:39:44.110 INFO:tasks.workunit.client.0.smithi107.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:39:44.110 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:39:44.110 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:39:44.110 INFO:tasks.workunit.client.0.smithi107.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:39:44.110 INFO:tasks.workunit.client.0.smithi107.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:39:44.111 INFO:tasks.workunit.client.0.smithi107.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:39:44.111 INFO:tasks.workunit.client.0.smithi107.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:39:44.111 INFO:tasks.workunit.client.0.smithi107.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:39:44.111 INFO:tasks.workunit.client.0.smithi107.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:39:44.111 INFO:tasks.workunit.client.0.smithi107.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:39:44.112 INFO:tasks.workunit.client.0.smithi107.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:39:44.112 INFO:tasks.workunit.client.0.smithi107.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:39:44.113 INFO:tasks.workunit.client.0.smithi107.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:39:44.113 INFO:tasks.workunit.client.0.smithi107.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:39:44.113 INFO:tasks.workunit.client.0.smithi107.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:39:44.115 INFO:tasks.workunit.client.0.smithi107.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:39:44.115 INFO:tasks.workunit.client.0.smithi107.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:39:44.116 INFO:tasks.workunit.client.0.smithi107.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:39:44.116 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-12T17:39:44.116 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:39:44.116 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:39:44.116 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:39:44.116 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:39:44.117 INFO:tasks.workunit.client.0.smithi107.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:39:44.118 INFO:tasks.workunit.client.0.smithi107.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:39:44.118 INFO:tasks.workunit.client.0.smithi107.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:39:44.118 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:39:44.118 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:39:44.121 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:39:44.122 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:39:44.124 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:39:44.126 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:39:44.128 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:39:44.128 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:39:44.129 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:39:44.129 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:39:44.130 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:39:44.130 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:39:44.130 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:39:44.132 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:39:44.132 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:39:44.133 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:39:44.133 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:39:44.133 INFO:tasks.workunit.client.0.smithi107.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:39:44.133 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.HIER1 (16 ms) 2024-09-12T17:39:44.133 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:39:44.133 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:39:44.133 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:39:44.133 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:39:44.133 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:39:44.134 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:39:44.134 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:39:44.134 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:39:44.134 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:39:44.135 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:39:44.135 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:39:44.135 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:39:44.136 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:39:44.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:39:44.131+0000 7f5b4f8538c0 -1 shutting down 2024-09-12T17:39:44.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:39:44.132+0000 7f5a29592640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65555, si_uid : 1000, si_addr0x3e800010013, si_status0 2024-09-12T17:40:14.333 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SHUTDOWN (30200 ms) 2024-09-12T17:40:14.334 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 24 tests from LibRGW (30714 ms total) 2024-09-12T17:40:14.334 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:40:14.334 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:40:14.334 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 24 tests from 1 test suite ran. (30714 ms total) 2024-09-12T17:40:14.334 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 24 tests. 2024-09-12T17:40:14.340 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2.1 2024-09-12T17:40:14.365 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:40:14.365 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:40:14.366 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:40:14.366 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:40:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:14.556 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.INIT (191 ms) 2024-09-12T17:40:14.557 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:40:14.557 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:40:14.557 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:40:14.565 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-12T17:40:14.565 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:40:14.565 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:40:14.565 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:40:14.571 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave0 2024-09-12T17:40:14.578 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave1 2024-09-12T17:40:14.584 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave2 2024-09-12T17:40:14.591 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave3 2024-09-12T17:40:14.598 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave4 2024-09-12T17:40:14.604 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave5 2024-09-12T17:40:14.611 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave6 2024-09-12T17:40:14.617 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave7 2024-09-12T17:40:14.624 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave8 2024-09-12T17:40:14.631 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave9 2024-09-12T17:40:14.631 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (66 ms) 2024-09-12T17:40:14.631 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:40:14.774 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (142 ms) 2024-09-12T17:40:14.774 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:40:14.774 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:40:14.774 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:40:14.774 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:40:14.774 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:40:14.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:40:14.772+0000 7f16b1e538c0 -1 shutting down 2024-09-12T17:40:14.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:40:14.773+0000 7f158bb92640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66175, si_uid : 1000, si_addr0x3e80001027f, si_status0 2024-09-12T17:40:44.635 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SHUTDOWN (29861 ms) 2024-09-12T17:40:44.635 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 9 tests from LibRGW (30269 ms total) 2024-09-12T17:40:44.635 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:40:44.635 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:40:44.635 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 9 tests from 1 test suite ran. (30269 ms total) 2024-09-12T17:40:44.635 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 9 tests. 2024-09-12T17:40:44.641 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2.2 2024-09-12T17:40:44.666 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:40:44.666 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:40:44.666 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:40:44.666 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:40:44.676 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:44.676 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:44.892 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.INIT (226 ms) 2024-09-12T17:40:44.893 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:40:44.893 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:40:44.893 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:40:44.893 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:40:44.894 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:40:44.911 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.DELETE_BUCKET (18 ms) 2024-09-12T17:40:44.911 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:40:44.918 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave0 2024-09-12T17:40:44.924 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave1 2024-09-12T17:40:44.931 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave2 2024-09-12T17:40:44.938 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave3 2024-09-12T17:40:44.945 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave4 2024-09-12T17:40:44.951 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave5 2024-09-12T17:40:44.958 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave6 2024-09-12T17:40:44.966 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave7 2024-09-12T17:40:44.972 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave8 2024-09-12T17:40:44.979 INFO:tasks.workunit.client.0.smithi107.stdout:created: sorrydave9 2024-09-12T17:40:44.979 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (68 ms) 2024-09-12T17:40:44.979 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:40:45.118 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (139 ms) 2024-09-12T17:40:45.119 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:40:45.119 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:40:45.119 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:40:45.119 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:40:45.119 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:40:45.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:40:45.117+0000 7fa5c78408c0 -1 shutting down 2024-09-12T17:40:45.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:40:45.119+0000 7fa4a157f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66795, si_uid : 1000, si_addr0x3e8000104eb, si_status0 2024-09-12T17:41:15.141 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SHUTDOWN (30022 ms) 2024-09-12T17:41:15.141 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 9 tests from LibRGW (30474 ms total) 2024-09-12T17:41:15.141 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:41:15.141 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:41:15.141 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 9 tests from 1 test suite ran. (30474 ms total) 2024-09-12T17:41:15.141 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 9 tests. 2024-09-12T17:41:15.146 INFO:tasks.workunit.client.0.smithi107.stdout:phase 3.1 2024-09-12T17:41:15.462 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:41:15.462 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:41:15.462 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:41:15.462 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:41:15.471 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:15.471 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:15.869 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.INIT (407 ms) 2024-09-12T17:41:15.870 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:41:15.870 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:41:15.870 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:41:15.878 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-12T17:41:15.878 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:41:15.880 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (2 ms) 2024-09-12T17:41:15.880 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:41:15.881 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T17:41:15.881 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:41:16.314 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LARGE1 (433 ms) 2024-09-12T17:41:16.314 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:41:16.362 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LARGE2 (48 ms) 2024-09-12T17:41:16.362 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:41:16.362 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:41:16.362 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:41:16.362 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:41:16.362 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:41:16.363 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:41:16.363 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:41:16.363 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:41:16.363 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:41:16.363 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:41:16.363 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:41:16.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:41:16.361+0000 7f960472f8c0 -1 shutting down 2024-09-12T17:41:16.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:41:16.362+0000 7f94dc6c7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67414, si_uid : 1000, si_addr0x3e800010756, si_status0 2024-09-12T17:41:46.152 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SHUTDOWN (29788 ms) 2024-09-12T17:41:46.152 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 13 tests from LibRGW (30688 ms total) 2024-09-12T17:41:46.152 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:41:46.152 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:41:46.153 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 13 tests from 1 test suite ran. (30688 ms total) 2024-09-12T17:41:46.153 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 13 tests. 2024-09-12T17:41:46.158 INFO:tasks.workunit.client.0.smithi107.stdout:phase 3.2 2024-09-12T17:41:46.474 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:41:46.474 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:41:46.474 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:41:46.474 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:41:46.482 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:46.482 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:46.885 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.INIT (411 ms) 2024-09-12T17:41:46.885 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:41:46.886 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:41:46.886 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:41:46.886 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:41:46.886 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:41:46.890 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T17:41:46.890 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:41:46.894 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T17:41:46.894 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:41:46.977 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LARGE1 (82 ms) 2024-09-12T17:41:46.977 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:41:46.977 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T17:41:46.977 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:41:46.977 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:41:46.977 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:41:46.982 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.DELETE_OBJECT (6 ms) 2024-09-12T17:41:46.982 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:41:46.996 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.DELETE_BUCKET (14 ms) 2024-09-12T17:41:46.997 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:41:46.997 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:41:46.997 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:41:46.997 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:41:46.997 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:41:46.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:41:46.995+0000 7fe3fbb0c8c0 -1 shutting down 2024-09-12T17:41:46.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:41:46.996+0000 7fe2d584b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68033, si_uid : 1000, si_addr0x3e8000109c1, si_status0 2024-09-12T17:42:16.940 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SHUTDOWN (29944 ms) 2024-09-12T17:42:16.941 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 13 tests from LibRGW (30466 ms total) 2024-09-12T17:42:16.941 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:42:16.941 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:42:16.941 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 13 tests from 1 test suite ran. (30466 ms total) 2024-09-12T17:42:16.941 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 13 tests. 2024-09-12T17:42:16.948 INFO:tasks.workunit.client.0.smithi107.stdout:phase 4.1 2024-09-12T17:42:16.975 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:42:16.975 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:42:16.975 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:42:16.975 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:42:16.975 INFO:tasks.workunit.client.0.smithi107.stdout:read i1: 64001 2024-09-12T17:42:16.975 INFO:tasks.workunit.client.0.smithi107.stdout:read s1: blunderbuss 2024-09-12T17:42:16.975 INFO:tasks.workunit.client.0.smithi107.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:42:16.975 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:42:16.988 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:16.988 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:17.369 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.INIT (394 ms) 2024-09-12T17:42:17.369 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:42:17.370 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:42:17.370 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:42:17.384 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (14 ms) 2024-09-12T17:42:17.384 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:42:17.804 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_0 2024-09-12T17:42:17.804 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_1 2024-09-12T17:42:17.804 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_2 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_3 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_4 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_5 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_6 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_7 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_8 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_9 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_10 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_11 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_12 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_13 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_14 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_15 2024-09-12T17:42:17.805 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_16 2024-09-12T17:42:17.806 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_17 2024-09-12T17:42:17.806 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_18 2024-09-12T17:42:17.806 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_19 2024-09-12T17:42:17.806 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_20 2024-09-12T17:42:17.806 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_21 2024-09-12T17:42:17.806 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_22 2024-09-12T17:42:17.806 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_23 2024-09-12T17:42:17.806 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_24 2024-09-12T17:42:17.806 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_25 2024-09-12T17:42:17.806 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_26 2024-09-12T17:42:17.806 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_27 2024-09-12T17:42:17.806 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_28 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_29 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_30 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_31 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_32 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_33 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_34 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_35 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_36 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_37 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_38 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_39 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_40 2024-09-12T17:42:17.807 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_41 2024-09-12T17:42:17.808 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_42 2024-09-12T17:42:17.808 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_43 2024-09-12T17:42:17.808 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_44 2024-09-12T17:42:17.808 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_45 2024-09-12T17:42:17.808 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_46 2024-09-12T17:42:17.808 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_47 2024-09-12T17:42:17.808 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_48 2024-09-12T17:42:17.808 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_49 2024-09-12T17:42:17.809 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_50 2024-09-12T17:42:17.809 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_51 2024-09-12T17:42:17.809 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_52 2024-09-12T17:42:17.809 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_53 2024-09-12T17:42:17.809 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_54 2024-09-12T17:42:17.809 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_55 2024-09-12T17:42:17.809 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_56 2024-09-12T17:42:17.809 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_57 2024-09-12T17:42:17.810 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_58 2024-09-12T17:42:17.810 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_59 2024-09-12T17:42:17.810 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_60 2024-09-12T17:42:17.810 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_61 2024-09-12T17:42:17.810 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_62 2024-09-12T17:42:17.810 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_63 2024-09-12T17:42:17.810 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_64 2024-09-12T17:42:17.810 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_65 2024-09-12T17:42:17.810 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_66 2024-09-12T17:42:17.810 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_67 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_68 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_69 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_70 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_71 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_72 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_73 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_74 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_75 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_76 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_77 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_78 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_79 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_80 2024-09-12T17:42:17.811 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_81 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_82 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_83 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_84 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_85 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_86 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_87 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_88 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_89 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_90 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_91 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_92 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_93 2024-09-12T17:42:17.812 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_94 2024-09-12T17:42:17.813 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_95 2024-09-12T17:42:17.813 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_96 2024-09-12T17:42:17.813 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_97 2024-09-12T17:42:17.813 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_98 2024-09-12T17:42:17.813 INFO:tasks.workunit.client.0.smithi107.stdout:created: dmarker:f_99 2024-09-12T17:42:17.813 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (420 ms) 2024-09-12T17:42:17.813 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:42:17.814 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T17:42:17.814 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:42:17.815 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:42:17.816 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:42:17.816 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:42:17.816 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:42:17.816 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:42:17.816 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:42:17.816 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:42:17.816 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:42:17.816 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:42:17.816 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:42:17.816 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:42:17.816 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:42:17.816 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:42:17.817 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:42:17.818 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:42:17.819 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:42:17.820 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:42:17.820 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:42:17.820 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:42:17.820 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:42:17.820 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:42:17.820 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:42:17.820 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:42:17.820 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:42:17.820 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:42:17.820 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:42:17.821 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_READDIR (4 ms) 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:42:17.822 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:42:17.823 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:42:17.823 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:42:17.823 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:42:17.823 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:42:17.823 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:42:17.823 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:42:17.823 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:42:17.823 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:42:17.823 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:42:17.823 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:42:17.823 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:42:17.823 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:42:17.824 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:42:17.825 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:42:17.826 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:42:17.827 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:42:17.828 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-12T17:42:17.829 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:42:17.830 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:42:17.830 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:42:17.830 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:42:17.830 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:42:17.830 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:42:17.830 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:42:17.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:42:17.809+0000 7fc3b492e8c0 -1 shutting down 2024-09-12T17:42:17.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:42:17.810+0000 7fc28c7b6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68652, si_uid : 1000, si_addr0x3e800010c2c, si_status0 2024-09-12T17:42:47.677 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SHUTDOWN (29866 ms) 2024-09-12T17:42:47.678 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 11 tests from LibRGW (30701 ms total) 2024-09-12T17:42:47.678 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:42:47.678 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:42:47.678 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 11 tests from 1 test suite ran. (30701 ms total) 2024-09-12T17:42:47.678 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 11 tests. 2024-09-12T17:42:47.683 INFO:tasks.workunit.client.0.smithi107.stdout:phase 4.2 2024-09-12T17:42:47.708 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:42:47.708 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:42:47.708 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:42:47.708 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:42:47.708 INFO:tasks.workunit.client.0.smithi107.stdout:read i1: 64001 2024-09-12T17:42:47.708 INFO:tasks.workunit.client.0.smithi107.stdout:read s1: blunderbuss 2024-09-12T17:42:47.708 INFO:tasks.workunit.client.0.smithi107.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:42:47.708 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:42:47.716 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:47.716 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:47.887 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.INIT (180 ms) 2024-09-12T17:42:47.888 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:42:47.888 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:42:47.888 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:42:47.896 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (8 ms) 2024-09-12T17:42:47.896 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:42:47.896 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:42:47.896 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:42:47.896 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:42:47.896 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:42:47.900 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:42:47.900 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:42:47.900 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:42:47.900 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:42:47.900 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:42:47.900 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:42:47.900 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:42:47.900 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:42:47.901 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:42:47.902 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:42:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:42:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:42:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:42:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:42:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:42:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:42:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:42:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:42:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:42:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:42:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:42:47.903 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:42:47.904 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:42:47.905 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:42:47.906 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:42:47.907 INFO:tasks.workunit.client.0.smithi107.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:42:47.908 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-12T17:42:47.908 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:42:47.908 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:42:47.908 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:42:47.908 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:42:47.908 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:42:47.908 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:42:47.908 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:42:47.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:42:47.899+0000 7f3815cc18c0 -1 shutting down 2024-09-12T17:42:47.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:42:47.900+0000 7f36eccd5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69272, si_uid : 1000, si_addr0x3e800010e98, si_status0 2024-09-12T17:43:18.022 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SHUTDOWN (30120 ms) 2024-09-12T17:43:18.022 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 11 tests from LibRGW (30313 ms total) 2024-09-12T17:43:18.022 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:43:18.022 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:43:18.022 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 11 tests from 1 test suite ran. (30313 ms total) 2024-09-12T17:43:18.022 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 11 tests. 2024-09-12T17:43:18.026 INFO:tasks.workunit.client.0.smithi107.stdout:phase 5.1 2024-09-12T17:43:18.060 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:43:18.060 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:43:18.060 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:43:18.060 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:43:18.070 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:18.070 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:18.447 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.INIT (388 ms) 2024-09-12T17:43:18.448 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:43:18.448 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:43:18.448 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:43:18.456 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-12T17:43:18.456 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:43:18.458 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (2 ms) 2024-09-12T17:43:18.458 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:43:18.458 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:43:18.458 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:43:18.460 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T17:43:18.460 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:43:18.460 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:43:18.460 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:43:18.464 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-12T17:43:18.464 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:43:18.466 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.GET_OBJECT (1 ms) 2024-09-12T17:43:18.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:43:18.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:43:18.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:43:18.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:43:18.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:43:18.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:43:18.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:43:18.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:43:18.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:43:18.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:43:18.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:43:18.467 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:43:18.468 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:43:18.468 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:43:18.468 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:43:18.468 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:43:18.468 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:43:18.468 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:43:18.468 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:43:18.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:43:18.465+0000 7fb9dfd3b8c0 -1 shutting down 2024-09-12T17:43:18.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:43:18.466+0000 7fb8b7d3c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69892, si_uid : 1000, si_addr0x3e800011104, si_status0 2024-09-12T17:43:48.737 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SHUTDOWN (30270 ms) 2024-09-12T17:43:48.737 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 19 tests from LibRGW (30677 ms total) 2024-09-12T17:43:48.737 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:43:48.738 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:43:48.738 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 19 tests from 1 test suite ran. (30677 ms total) 2024-09-12T17:43:48.738 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 19 tests. 2024-09-12T17:43:48.742 INFO:tasks.workunit.client.0.smithi107.stdout:phase 5.2 2024-09-12T17:43:48.775 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:43:48.775 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:43:48.775 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:43:48.775 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:43:48.782 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:48.783 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:49.372 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.INIT (597 ms) 2024-09-12T17:43:49.372 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:43:49.373 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:43:49.373 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:43:49.373 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:43:49.373 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:43:49.378 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T17:43:49.378 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:43:49.378 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:43:49.378 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:43:49.378 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T17:43:49.378 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:43:49.378 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:43:49.378 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:43:49.378 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T17:43:49.378 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:43:49.378 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T17:43:49.379 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:43:49.379 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:43:49.379 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:43:49.379 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:43:49.379 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:43:49.379 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:43:49.379 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:43:49.379 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:43:49.379 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:43:49.379 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:43:49.379 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:43:49.381 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.DELETE_OBJECT (3 ms) 2024-09-12T17:43:49.381 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:43:49.398 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.DELETE_BUCKET (17 ms) 2024-09-12T17:43:49.398 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:43:49.398 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:43:49.398 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:43:49.398 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:43:49.398 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:43:49.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:43:49.397+0000 7f955cf3b8c0 -1 shutting down 2024-09-12T17:43:49.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:43:49.398+0000 7f9434f3c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70511, si_uid : 1000, si_addr0x3e80001136f, si_status0 2024-09-12T17:44:19.717 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SHUTDOWN (30318 ms) 2024-09-12T17:44:19.717 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 19 tests from LibRGW (30941 ms total) 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 19 tests from 1 test suite ran. (30941 ms total) 2024-09-12T17:44:19.718 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 19 tests. 2024-09-12T17:44:19.723 INFO:tasks.workunit.client.0.smithi107.stdout:phase 6.1 2024-09-12T17:44:19.748 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:44:19.748 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment set-up. 2024-09-12T17:44:19.748 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 10 tests from LibRGW 2024-09-12T17:44:19.748 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:44:19.755 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:19.755 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:20.134 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.INIT (386 ms) 2024-09-12T17:44:20.134 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:44:20.135 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:44:20.135 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T17:44:20.149 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CREATE_BUCKETS (14 ms) 2024-09-12T17:44:20.150 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T17:44:20.154 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (5 ms) 2024-09-12T17:44:20.154 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T17:44:20.172 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.TOPDIR_RENAME (18 ms) 2024-09-12T17:44:20.172 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T17:44:20.193 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SUBDIR_RENAME (21 ms) 2024-09-12T17:44:20.193 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T17:44:20.212 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (19 ms) 2024-09-12T17:44:20.212 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:44:20.212 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:44:20.212 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:44:20.212 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:44:20.212 INFO:tasks.workunit.client.0.smithi107.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:44:20.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:20.211+0000 7f0f95b458c0 -1 shutting down 2024-09-12T17:44:20.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:20.212+0000 7f0e6f882640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71130, si_uid : 1000, si_addr0x3e8000115da, si_status0 2024-09-12T17:44:50.260 INFO:tasks.workunit.client.0.smithi107.stdout:[ OK ] LibRGW.SHUTDOWN (30047 ms) 2024-09-12T17:44:50.260 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] 10 tests from LibRGW (30511 ms total) 2024-09-12T17:44:50.260 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:44:50.260 INFO:tasks.workunit.client.0.smithi107.stdout:[----------] Global test environment tear-down 2024-09-12T17:44:50.260 INFO:tasks.workunit.client.0.smithi107.stdout:[==========] 10 tests from 1 test suite ran. (30511 ms total) 2024-09-12T17:44:50.260 INFO:tasks.workunit.client.0.smithi107.stdout:[ PASSED ] 10 tests. 2024-09-12T17:44:50.267 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:44:50.267 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:44:50.313 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T17:44:50.314 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T17:44:50.314 DEBUG:teuthology.orchestra.run.smithi107:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T17:44:50.350 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -z ']' 2024-09-12T17:44:50.351 INFO:tasks.workunit.client.0.smithi107.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:44:50.351 INFO:tasks.workunit.client.0.smithi107.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:44:50.351 INFO:tasks.workunit.client.0.smithi107.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:44:50.351 INFO:tasks.workunit.client.0.smithi107.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:44:50.351 INFO:tasks.workunit.client.0.smithi107.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T17:44:50.387 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:50.387 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:50.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.424+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.425+0000 7fcf85c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.425+0000 7fcf85c13800 20 realm 2024-09-12T17:44:50.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.425+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.425+0000 7fcf85c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.425+0000 7fcf85c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:50.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.425+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.426+0000 7fcf85c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.426+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.427+0000 7fcf85c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:50.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.427+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.427+0000 7fcf85c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:50.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.427+0000 7fcf85c13800 20 searching for the correct realm 2024-09-12T17:44:50.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.430+0000 7fcf78b21640 0 -- 172.21.15.107:0/2858135707 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fcf6c07c070 msgr2=0x7fcf6c0b6860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:50.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.433+0000 7fcf81322640 0 -- 172.21.15.107:0/2858135707 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fcf6c0bc060 msgr2=0x7fcf6c0e14f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:50.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.639+0000 7fcf85c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:50.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.639+0000 7fcf85c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:50.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.639+0000 7fcf85c13800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:44:50.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.639+0000 7fcf85c13800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:44:50.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.639+0000 7fcf85c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:50.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.639+0000 7fcf85c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:50.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.639+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.639+0000 7fcf85c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.639+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.640+0000 7fcf85c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:50.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.640+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.640+0000 7fcf85c13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.640+0000 7fcf85c13800 20 zone default found 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.640+0000 7fcf85c13800 4 Realm: () 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.640+0000 7fcf85c13800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.640+0000 7fcf85c13800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.640+0000 7fcf85c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.640+0000 7fcf85c13800 20 zonegroup default 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.640+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.640+0000 7fcf85c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.641+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.641+0000 7fcf85c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.641+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.641+0000 7fcf85c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.641+0000 7fcf85c13800 20 started sync module instance, tier type = 2024-09-12T17:44:50.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.641+0000 7fcf85c13800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:44:50.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.650+0000 7fcf85c13800 20 add_watcher() i=0 2024-09-12T17:44:50.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.650+0000 7fcf85c13800 20 add_watcher() i=1 2024-09-12T17:44:50.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.650+0000 7fcf85c13800 20 add_watcher() i=2 2024-09-12T17:44:50.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.650+0000 7fcf85c13800 20 add_watcher() i=3 2024-09-12T17:44:50.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.650+0000 7fcf85c13800 20 add_watcher() i=4 2024-09-12T17:44:50.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.650+0000 7fcf85c13800 20 add_watcher() i=5 2024-09-12T17:44:50.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.650+0000 7fcf85c13800 20 add_watcher() i=6 2024-09-12T17:44:50.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.651+0000 7fcf85c13800 20 add_watcher() i=7 2024-09-12T17:44:50.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.651+0000 7fcf85c13800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:50.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.653+0000 7fce37fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:50.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.653+0000 7fcf85c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:50.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.653+0000 7fcf85c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:50.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.653+0000 7fcf85c13800 5 note: GC not initialized 2024-09-12T17:44:50.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.653+0000 7fce36fe5640 20 reqs_thread_entry: start 2024-09-12T17:44:50.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 20 init_complete bucket index max shards: 1 2024-09-12T17:44:50.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 20 Filter name: none 2024-09-12T17:44:50.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fce34fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:50.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.654+0000 7fcf85c13800 20 rados->read ofs=0 len=0 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.655+0000 7fcf85c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:50.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.655+0000 7fcf85c13800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T17:44:50.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.655+0000 7fcf85c13800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:44:50.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.655+0000 7fcf85c13800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:44:50.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.655+0000 7fcf85c13800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:44:50.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.656+0000 7fcf85c13800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:44:50.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.656+0000 7fcf85c13800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:44:50.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.656+0000 7fcf85c13800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T17:44:50.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.656+0000 7fce64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824002 cookie 94477820474432 notifier 5751 bl.length()=677 2024-09-12T17:44:50.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.656+0000 7fce64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:44:50.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.656+0000 7fce64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:44:50.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.658+0000 7fcf85c13800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:44:50.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.658+0000 7fcf85c13800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:44:50.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.658+0000 7fcf85c13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T17:44:50.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.658+0000 7fce53fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824012 cookie 94477820449264 notifier 5751 bl.length()=187 2024-09-12T17:44:50.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.658+0000 7fce53fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:44:50.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.658+0000 7fce53fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:44:50.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.660+0000 7fcf85c13800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:44:50.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.660+0000 7fcf85c13800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:44:50.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.660+0000 7fcf85c13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T17:44:50.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.660+0000 7fce64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824013 cookie 94477820449264 notifier 5751 bl.length()=197 2024-09-12T17:44:50.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.660+0000 7fce64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:44:50.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.660+0000 7fce64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:44:50.662 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:44:50.662 INFO:tasks.workunit.client.0.smithi107.stdout: "user_id": "ceph-test-maven", 2024-09-12T17:44:50.662 INFO:tasks.workunit.client.0.smithi107.stdout: "display_name": "maven test user", 2024-09-12T17:44:50.662 INFO:tasks.workunit.client.0.smithi107.stdout: "email": "sigv4@example.com", 2024-09-12T17:44:50.662 INFO:tasks.workunit.client.0.smithi107.stdout: "suspended": 0, 2024-09-12T17:44:50.662 INFO:tasks.workunit.client.0.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:44:50.663 INFO:tasks.workunit.client.0.smithi107.stdout: "subusers": [], 2024-09-12T17:44:50.663 INFO:tasks.workunit.client.0.smithi107.stdout: "keys": [ 2024-09-12T17:44:50.663 INFO:tasks.workunit.client.0.smithi107.stdout: { 2024-09-12T17:44:50.663 INFO:tasks.workunit.client.0.smithi107.stdout: "user": "ceph-test-maven", 2024-09-12T17:44:50.663 INFO:tasks.workunit.client.0.smithi107.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T17:44:50.663 INFO:tasks.workunit.client.0.smithi107.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T17:44:50.663 INFO:tasks.workunit.client.0.smithi107.stdout: "active": true, 2024-09-12T17:44:50.663 INFO:tasks.workunit.client.0.smithi107.stdout: "create_date": "2024-09-12T17:44:50.656123Z" 2024-09-12T17:44:50.663 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:44:50.664 INFO:tasks.workunit.client.0.smithi107.stdout: ], 2024-09-12T17:44:50.664 INFO:tasks.workunit.client.0.smithi107.stdout: "swift_keys": [], 2024-09-12T17:44:50.664 INFO:tasks.workunit.client.0.smithi107.stdout: "caps": [], 2024-09-12T17:44:50.665 INFO:tasks.workunit.client.0.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:44:50.665 INFO:tasks.workunit.client.0.smithi107.stdout: "default_placement": "", 2024-09-12T17:44:50.665 INFO:tasks.workunit.client.0.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:44:50.665 INFO:tasks.workunit.client.0.smithi107.stdout: "placement_tags": [], 2024-09-12T17:44:50.665 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_quota": { 2024-09-12T17:44:50.665 INFO:tasks.workunit.client.0.smithi107.stdout: "enabled": false, 2024-09-12T17:44:50.665 INFO:tasks.workunit.client.0.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:44:50.665 INFO:tasks.workunit.client.0.smithi107.stdout: "max_size": -1, 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "max_objects": -1 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "user_quota": { 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "enabled": false, 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "max_size": -1, 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "max_objects": -1 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "type": "rgw", 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "mfa_ids": [], 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "account_id": "", 2024-09-12T17:44:50.666 INFO:tasks.workunit.client.0.smithi107.stdout: "path": "/", 2024-09-12T17:44:50.667 INFO:tasks.workunit.client.0.smithi107.stdout: "create_date": "2024-09-12T17:44:50.656112Z", 2024-09-12T17:44:50.667 INFO:tasks.workunit.client.0.smithi107.stdout: "tags": [], 2024-09-12T17:44:50.667 INFO:tasks.workunit.client.0.smithi107.stdout: "group_ids": [] 2024-09-12T17:44:50.667 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:44:50.667 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:44:50.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.661+0000 7fce37fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:50.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.663+0000 7fcf85c13800 20 remove_watcher() i=0 2024-09-12T17:44:50.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.663+0000 7fcf85c13800 2 removed watcher, disabling cache 2024-09-12T17:44:50.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.665+0000 7fcf85c13800 20 remove_watcher() i=1 2024-09-12T17:44:50.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.666+0000 7fcf85c13800 20 remove_watcher() i=2 2024-09-12T17:44:50.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.667+0000 7fcf85c13800 20 remove_watcher() i=3 2024-09-12T17:44:50.669 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.668+0000 7fcf85c13800 20 remove_watcher() i=4 2024-09-12T17:44:50.669 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.669+0000 7fcf85c13800 20 remove_watcher() i=5 2024-09-12T17:44:50.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.669+0000 7fcf85c13800 20 remove_watcher() i=6 2024-09-12T17:44:50.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:44:50.670+0000 7fcf85c13800 20 remove_watcher() i=7 2024-09-12T17:44:50.681 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -z ']' 2024-09-12T17:44:50.681 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T17:44:50.681 INFO:tasks.workunit.client.0.smithi107.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T17:44:50.682 INFO:tasks.workunit.client.0.smithi107.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi107.front.sepia.ceph.com:80 2024-09-12T17:44:50.682 INFO:tasks.workunit.client.0.smithi107.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi107.front.sepia.ceph.com:80 2024-09-12T17:44:50.682 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T17:44:50.682 INFO:tasks.workunit.client.0.smithi107.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T17:44:50.683 INFO:tasks.workunit.client.0.smithi107.stderr:+ ./mvnw clean package 2024-09-12T17:44:50.722 INFO:tasks.workunit.client.0.smithi107.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:44:52.231 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Scanning for projects... 2024-09-12T17:44:52.348 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T17:44:52.432 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 64 kB/s) 2024-09-12T17:44:52.444 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T17:44:52.490 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 32/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.8 MB/s) 2024-09-12T17:44:52.500 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T17:44:52.529 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 2.6 MB/s) 2024-09-12T17:44:52.558 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:52.558 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:44:52.558 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:44:52.558 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] from pom.xml 2024-09-12T17:44:52.558 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:44:52.560 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T17:44:52.576 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T17:44:52.582 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T17:44:52.598 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-12T17:44:52.601 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T17:44:52.618 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-12T17:44:52.622 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T17:44:52.638 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.3 MB/s) 2024-09-12T17:44:52.649 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T17:44:52.666 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-09-12T17:44:52.673 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T17:44:52.688 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-12T17:44:52.690 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T17:44:52.705 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-12T17:44:52.707 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T17:44:52.724 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-12T17:44:52.727 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T17:44:52.743 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-12T17:44:52.748 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T17:44:52.763 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.1 MB/s) 2024-09-12T17:44:52.768 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T17:44:52.784 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 613 kB/s) 2024-09-12T17:44:52.791 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T17:44:52.810 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.6 MB/s) 2024-09-12T17:44:52.818 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T17:44:52.835 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-12T17:44:52.838 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T17:44:52.854 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-12T17:44:52.857 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T17:44:52.875 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-09-12T17:44:52.878 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T17:44:52.894 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-12T17:44:52.899 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T17:44:52.914 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-12T17:44:52.918 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T17:44:52.934 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-12T17:44:52.941 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T17:44:52.956 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 451 kB/s) 2024-09-12T17:44:52.958 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T17:44:52.973 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-12T17:44:52.975 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T17:44:52.991 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.7 MB/s) 2024-09-12T17:44:52.996 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T17:44:53.012 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.3 MB/s) 2024-09-12T17:44:53.018 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T17:44:53.035 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.6 MB/s) 2024-09-12T17:44:53.052 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T17:44:53.068 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 380 kB/s) 2024-09-12T17:44:53.070 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T17:44:53.086 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-09-12T17:44:53.092 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T17:44:53.108 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-12T17:44:53.119 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T17:44:53.135 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 250 kB/s) 2024-09-12T17:44:53.137 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T17:44:53.153 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-12T17:44:53.156 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T17:44:53.171 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-12T17:44:53.176 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T17:44:53.191 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-12T17:44:53.195 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T17:44:53.211 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-12T17:44:53.217 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T17:44:53.233 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 685 kB/s) 2024-09-12T17:44:53.237 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T17:44:53.253 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 105 kB/s) 2024-09-12T17:44:53.257 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T17:44:53.274 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 225 kB/s) 2024-09-12T17:44:53.278 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T17:44:53.293 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-12T17:44:53.296 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T17:44:53.311 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-12T17:44:53.313 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T17:44:53.328 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 256 kB/s) 2024-09-12T17:44:53.329 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T17:44:53.344 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-12T17:44:53.347 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T17:44:53.363 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 230 kB/s) 2024-09-12T17:44:53.367 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T17:44:53.382 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 163 kB/s) 2024-09-12T17:44:53.385 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T17:44:53.401 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 182 kB/s) 2024-09-12T17:44:53.405 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T17:44:53.421 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 463 kB/s) 2024-09-12T17:44:53.425 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T17:44:53.440 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 364 kB/s) 2024-09-12T17:44:53.443 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T17:44:53.459 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 218 kB/s) 2024-09-12T17:44:53.463 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T17:44:53.479 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 275 kB/s) 2024-09-12T17:44:53.481 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T17:44:53.496 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-12T17:44:53.499 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T17:44:53.514 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 429 kB/s) 2024-09-12T17:44:53.518 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T17:44:53.533 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 404 kB/s) 2024-09-12T17:44:53.536 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T17:44:53.552 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 186 kB/s) 2024-09-12T17:44:53.556 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T17:44:53.571 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 232 kB/s) 2024-09-12T17:44:53.575 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T17:44:53.591 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 255 kB/s) 2024-09-12T17:44:53.593 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T17:44:53.607 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 118 kB/s) 2024-09-12T17:44:53.611 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T17:44:53.626 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-12T17:44:53.628 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T17:44:53.644 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-12T17:44:53.646 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T17:44:53.661 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-12T17:44:53.664 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T17:44:53.679 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-12T17:44:53.682 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T17:44:53.698 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 310 kB/s) 2024-09-12T17:44:53.700 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T17:44:53.716 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 823 kB/s) 2024-09-12T17:44:53.719 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T17:44:53.733 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 931 kB/s) 2024-09-12T17:44:53.736 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T17:44:53.753 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.8 MB/s) 2024-09-12T17:44:53.759 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T17:44:53.774 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 979 kB/s) 2024-09-12T17:44:53.779 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T17:44:53.794 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.0 MB/s) 2024-09-12T17:44:53.796 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T17:44:53.813 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.7 MB/s) 2024-09-12T17:44:53.816 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T17:44:53.831 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-12T17:44:53.834 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T17:44:53.851 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-09-12T17:44:53.854 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T17:44:53.870 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-12T17:44:53.876 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T17:44:53.890 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 274 kB/s) 2024-09-12T17:44:53.892 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T17:44:53.906 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-12T17:44:53.909 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T17:44:53.924 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T17:44:53.926 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T17:44:53.940 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-12T17:44:53.942 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T17:44:53.957 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 136 kB/s) 2024-09-12T17:44:53.959 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T17:44:53.973 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-12T17:44:53.975 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T17:44:53.990 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-12T17:44:53.992 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T17:44:54.007 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 201 kB/s) 2024-09-12T17:44:54.009 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T17:44:54.024 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T17:44:54.025 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T17:44:54.040 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-12T17:44:54.042 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T17:44:54.057 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 68 kB/s) 2024-09-12T17:44:54.061 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T17:44:54.076 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 64 kB/s) 2024-09-12T17:44:54.078 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T17:44:54.093 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 203 kB/s) 2024-09-12T17:44:54.095 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T17:44:54.109 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-12T17:44:54.111 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T17:44:54.126 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 215 kB/s) 2024-09-12T17:44:54.129 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T17:44:54.143 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-12T17:44:54.145 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T17:44:54.160 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 216 kB/s) 2024-09-12T17:44:54.176 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T17:44:54.259 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 40 MB/s) 2024-09-12T17:44:54.261 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T17:44:54.261 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T17:44:54.261 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T17:44:54.261 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T17:44:54.262 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T17:44:54.279 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 15/35 kB Progress (1): 31/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 2.0 MB/s) 2024-09-12T17:44:54.279 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T17:44:54.294 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 486 kB/s) 2024-09-12T17:44:54.294 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T17:44:54.313 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.4/49 kB Progress (2): 1.4/49 kB | 1.4/16 kB Progress (2): 2.8/49 kB | 1.4/16 kB Progress (2): 2.8/49 kB | 2.8/16 kB Progress (2): 4.1/49 kB | 2.8/16 kB Progress (2): 4.1/49 kB | 4.1/16 kB Progress (3): 4.1/49 kB | 4.1/16 kB | 1.4/98 kB Progress (3): 5.5/49 kB | 4.1/16 kB | 1.4/98 kB Progress (3): 5.5/49 kB | 5.5/16 kB | 1.4/98 kB Progress (3): 6.9/49 kB | 5.5/16 kB | 1.4/98 kB Progress (3): 6.9/49 kB | 5.5/16 kB | 2.8/98 kB Progress (3): 6.9/49 kB | 6.9/16 kB | 2.8/98 kB Progress (3): 8.3/49 kB | 6.9/16 kB | 2.8/98 kB Progress (3): 8.3/49 kB | 6.9/16 kB | 4.1/98 kB Progress (3): 8.3/49 kB | 8.3/16 kB | 4.1/98 kB Progress (4): 8.3/49 kB | 8.3/16 kB | 4.1/98 kB | 1.4/71 kB Progress (4): 8.3/49 kB | 9.7/16 kB | 4.1/98 kB | 1.4/71 kB Progress (4): 8.3/49 kB | 9.7/16 kB | 4.1/98 kB | 2.8/71 kB Progress (4): 8.3/49 kB | 9.7/16 kB | 5.5/98 kB | 2.8/71 kB Progress (4): 8.3/49 kB | 9.7/16 kB | 5.5/98 kB | 4.1/71 kB Progress (4): 9.7/49 kB | 9.7/16 kB | 5.5/98 kB | 4.1/71 kB Progress (4): 9.7/49 kB | 9.7/16 kB | 5.5/98 kB | 5.5/71 kB Progress (4): 11/49 kB | 9.7/16 kB | 5.5/98 kB | 5.5/71 kB Progress (4): 11/49 kB | 9.7/16 kB | 6.9/98 kB | 5.5/71 kB Progress (4): 11/49 kB | 11/16 kB | 6.9/98 kB | 5.5/71 kB Progress (4): 12/49 kB | 11/16 kB | 6.9/98 kB | 5.5/71 kB Progress (4): 12/49 kB | 11/16 kB | 6.9/98 kB | 6.9/71 kB Progress (4): 14/49 kB | 11/16 kB | 6.9/98 kB | 6.9/71 kB Progress (4): 14/49 kB | 11/16 kB | 6.9/98 kB | 8.3/71 kB Progress (4): 14/49 kB | 12/16 kB | 6.9/98 kB | 8.3/71 kB Progress (4): 14/49 kB | 12/16 kB | 8.3/98 kB | 8.3/71 kB Progress (4): 14/49 kB | 14/16 kB | 8.3/98 kB | 8.3/71 kB Progress (4): 14/49 kB | 14/16 kB | 8.3/98 kB | 9.7/71 kB Progress (4): 15/49 kB | 14/16 kB | 8.3/98 kB | 9.7/71 kB Progress (4): 15/49 kB | 14/16 kB | 8.3/98 kB | 11/71 kB Progress (5): 15/49 kB | 14/16 kB | 8.3/98 kB | 11/71 kB | 16/782 kB Progress (5): 15/49 kB | 15/16 kB | 8.3/98 kB | 11/71 kB | 16/782 kB Progress (5): 15/49 kB | 15/16 kB | 9.7/98 kB | 11/71 kB | 16/782 kB Progress (5): 15/49 kB | 16 kB | 9.7/98 kB | 11/71 kB | 16/782 kB Progress (5): 15/49 kB | 16 kB | 9.7/98 kB | 12/71 kB | 16/782 kB Progress (5): 16/49 kB | 16 kB | 9.7/98 kB | 12/71 kB | 16/782 kB Progress (5): 16/49 kB | 16 kB | 9.7/98 kB | 14/71 kB | 16/782 kB Progress (5): 16/49 kB | 16 kB | 9.7/98 kB | 14/71 kB | 33/782 kB Progress (5): 16/49 kB | 16 kB | 11/98 kB | 14/71 kB | 33/782 kB Progress (5): 16/49 kB | 16 kB | 11/98 kB | 15/71 kB | 33/782 kB Progress (5): 18/49 kB | 16 kB | 11/98 kB | 15/71 kB | 33/782 kB Progress (5): 18/49 kB | 16 kB | 11/98 kB | 16/71 kB | 33/782 kB Progress (5): 18/49 kB | 16 kB | 11/98 kB | 16/71 kB | 49/782 kB Progress (5): 18/49 kB | 16 kB | 12/98 kB | 16/71 kB | 49/782 kB Progress (5): 19/49 kB | 16 kB | 12/98 kB | 16/71 kB | 49/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 322 kB/s) 2024-09-12T17:44:54.313 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (4): 21/49 kB | 12/98 kB | 16/71 kB | 49/782 kB Progress (4): 21/49 kB | 14/98 kB | 16/71 kB | 49/782 kB Progress (4): 22/49 kB | 14/98 kB | 16/71 kB | 49/782 kB Progress (4): 22/49 kB | 14/98 kB | 16/71 kB | 65/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T17:44:54.323 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (4): 23/49 kB | 14/98 kB | 16/71 kB | 65/782 kB Progress (4): 23/49 kB | 15/98 kB | 16/71 kB | 65/782 kB Progress (4): 25/49 kB | 15/98 kB | 16/71 kB | 65/782 kB Progress (4): 25/49 kB | 16/98 kB | 16/71 kB | 65/782 kB Progress (4): 26/49 kB | 16/98 kB | 16/71 kB | 65/782 kB Progress (4): 26/49 kB | 18/98 kB | 16/71 kB | 65/782 kB Progress (4): 27/49 kB | 18/98 kB | 16/71 kB | 65/782 kB Progress (4): 27/49 kB | 18/98 kB | 16/71 kB | 81/782 kB Progress (4): 27/49 kB | 19/98 kB | 16/71 kB | 81/782 kB Progress (4): 29/49 kB | 19/98 kB | 16/71 kB | 81/782 kB Progress (4): 29/49 kB | 21/98 kB | 16/71 kB | 81/782 kB Progress (4): 30/49 kB | 21/98 kB | 16/71 kB | 81/782 kB Progress (4): 30/49 kB | 22/98 kB | 16/71 kB | 81/782 kB Progress (4): 30/49 kB | 22/98 kB | 16/71 kB | 98/782 kB Progress (4): 30/49 kB | 23/98 kB | 16/71 kB | 98/782 kB Progress (4): 30/49 kB | 25/98 kB | 16/71 kB | 98/782 kB Progress (4): 30/49 kB | 26/98 kB | 16/71 kB | 98/782 kB Progress (4): 30/49 kB | 26/98 kB | 16/71 kB | 114/782 kB Progress (4): 30/49 kB | 27/98 kB | 16/71 kB | 114/782 kB Progress (4): 30/49 kB | 29/98 kB | 16/71 kB | 114/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 114/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 130/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 147/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 163/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 180/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 196/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 212/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 229/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 245/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 262/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 278/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 294/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 311/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 327/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 343/782 kB Progress (4): 30/49 kB | 30/98 kB | 16/71 kB | 360/782 kB Progress (4): 32/49 kB | 30/98 kB | 16/71 kB | 360/782 kB Progress (4): 33/49 kB | 30/98 kB | 16/71 kB | 360/782 kB Progress (4): 33/49 kB | 30/98 kB | 16/71 kB | 376/782 kB Progress (4): 34/49 kB | 30/98 kB | 16/71 kB | 376/782 kB Progress (4): 36/49 kB | 30/98 kB | 16/71 kB | 376/782 kB Progress (4): 37/49 kB | 30/98 kB | 16/71 kB | 376/782 kB Progress (4): 37/49 kB | 30/98 kB | 16/71 kB | 393/782 kB Progress (4): 38/49 kB | 30/98 kB | 16/71 kB | 393/782 kB Progress (4): 40/49 kB | 30/98 kB | 16/71 kB | 393/782 kB Progress (4): 40/49 kB | 32/98 kB | 16/71 kB | 393/782 kB Progress (4): 41/49 kB | 32/98 kB | 16/71 kB | 393/782 kB Progress (4): 41/49 kB | 33/98 kB | 16/71 kB | 393/782 kB Progress (4): 41/49 kB | 33/98 kB | 16/71 kB | 409/782 kB Progress (4): 41/49 kB | 34/98 kB | 16/71 kB | 409/782 kB Progress (4): 43/49 kB | 34/98 kB | 16/71 kB | 409/782 kB Progress (4): 43/49 kB | 36/98 kB | 16/71 kB | 409/782 kB Progress (4): 43/49 kB | 36/98 kB | 32/71 kB | 409/782 kB Progress (4): 44/49 kB | 36/98 kB | 32/71 kB | 409/782 kB Progress (4): 44/49 kB | 36/98 kB | 32/71 kB | 425/782 kB Progress (4): 45/49 kB | 36/98 kB | 32/71 kB | 425/782 kB Progress (4): 45/49 kB | 37/98 kB | 32/71 kB | 425/782 kB Progress (4): 45/49 kB | 38/98 kB | 32/71 kB | 425/782 kB Progress (4): 45/49 kB | 40/98 kB | 32/71 kB | 425/782 kB Progress (4): 45/49 kB | 40/98 kB | 32/71 kB | 442/782 kB Progress (4): 45/49 kB | 41/98 kB | 32/71 kB | 442/782 kB Progress (4): 45/49 kB | 43/98 kB | 32/71 kB | 442/782 kB Progress (4): 45/49 kB | 44/98 kB | 32/71 kB | 442/782 kB Progress (4): 47/49 kB | 44/98 kB | 32/71 kB | 442/782 kB Progress (4): 47/49 kB | 44/98 kB | 32/71 kB | 458/782 kB Progress (4): 47/49 kB | 45/98 kB | 32/71 kB | 458/782 kB Progress (4): 48/49 kB | 45/98 kB | 32/71 kB | 458/782 kB Progress (4): 49 kB | 45/98 kB | 32/71 kB | 458/782 kB Progress (4): 49 kB | 45/98 kB | 32/71 kB | 475/782 kB Progress (4): 49 kB | 45/98 kB | 32/71 kB | 491/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 807 kB/s) 2024-09-12T17:44:54.323 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (3): 45/98 kB | 32/71 kB | 507/782 kB Progress (3): 45/98 kB | 49/71 kB | 507/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T17:44:54.330 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (3): 45/98 kB | 49/71 kB | 524/782 kB Progress (3): 47/98 kB | 49/71 kB | 524/782 kB Progress (3): 48/98 kB | 49/71 kB | 524/782 kB Progress (3): 49/98 kB | 49/71 kB | 524/782 kB Progress (3): 49/98 kB | 49/71 kB | 540/782 kB Progress (3): 51/98 kB | 49/71 kB | 540/782 kB Progress (3): 52/98 kB | 49/71 kB | 540/782 kB Progress (3): 54/98 kB | 49/71 kB | 540/782 kB Progress (3): 55/98 kB | 49/71 kB | 540/782 kB Progress (3): 55/98 kB | 49/71 kB | 556/782 kB Progress (3): 55/98 kB | 49/71 kB | 573/782 kB Progress (3): 56/98 kB | 49/71 kB | 573/782 kB Progress (3): 56/98 kB | 49/71 kB | 589/782 kB Progress (3): 58/98 kB | 49/71 kB | 589/782 kB Progress (3): 59/98 kB | 49/71 kB | 589/782 kB Progress (3): 61/98 kB | 49/71 kB | 589/782 kB Progress (3): 61/98 kB | 49/71 kB | 606/782 kB Progress (3): 61/98 kB | 49/71 kB | 622/782 kB Progress (3): 61/98 kB | 49/71 kB | 638/782 kB Progress (4): 61/98 kB | 49/71 kB | 638/782 kB | 1.4/11 kB Progress (4): 61/98 kB | 49/71 kB | 638/782 kB | 2.8/11 kB Progress (4): 61/98 kB | 49/71 kB | 638/782 kB | 4.1/11 kB Progress (4): 61/98 kB | 49/71 kB | 655/782 kB | 4.1/11 kB Progress (4): 61/98 kB | 49/71 kB | 655/782 kB | 5.5/11 kB Progress (4): 61/98 kB | 49/71 kB | 671/782 kB | 5.5/11 kB Progress (4): 61/98 kB | 49/71 kB | 671/782 kB | 6.9/11 kB Progress (4): 61/98 kB | 49/71 kB | 671/782 kB | 8.3/11 kB Progress (4): 61/98 kB | 49/71 kB | 671/782 kB | 9.7/11 kB Progress (4): 61/98 kB | 49/71 kB | 688/782 kB | 9.7/11 kB Progress (4): 61/98 kB | 49/71 kB | 704/782 kB | 9.7/11 kB Progress (4): 61/98 kB | 49/71 kB | 704/782 kB | 11/11 kB Progress (4): 61/98 kB | 49/71 kB | 704/782 kB | 11 kB Progress (4): 61/98 kB | 49/71 kB | 720/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 175 kB/s) 2024-09-12T17:44:54.330 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T17:44:54.330 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (3): 61/98 kB | 49/71 kB | 737/782 kB Progress (3): 61/98 kB | 49/71 kB | 753/782 kB Progress (3): 61/98 kB | 49/71 kB | 769/782 kB Progress (3): 61/98 kB | 49/71 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-12T17:44:54.330 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T17:44:54.332 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 62/98 kB | 49/71 kB Progress (2): 62/98 kB | 49/71 kB Progress (2): 62/98 kB | 65/71 kB Progress (2): 62/98 kB | 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 980 kB/s) 2024-09-12T17:44:54.332 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T17:44:54.335 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 78/98 kB Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.3 MB/s) 2024-09-12T17:44:54.336 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T17:44:54.346 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (1): 49/205 kB Progress (2): 49/205 kB | 1.4/30 kB Progress (2): 49/205 kB | 2.8/30 kB Progress (2): 49/205 kB | 4.1/30 kB Progress (2): 49/205 kB | 5.5/30 kB Progress (2): 49/205 kB | 6.9/30 kB Progress (2): 49/205 kB | 8.3/30 kB Progress (2): 49/205 kB | 9.7/30 kB Progress (2): 49/205 kB | 11/30 kB Progress (2): 49/205 kB | 12/30 kB Progress (2): 49/205 kB | 14/30 kB Progress (2): 49/205 kB | 15/30 kB Progress (2): 49/205 kB | 16/30 kB Progress (2): 49/205 kB | 17/30 kB Progress (2): 49/205 kB | 19/30 kB Progress (2): 49/205 kB | 20/30 kB Progress (3): 49/205 kB | 20/30 kB | 16/81 kB Progress (3): 49/205 kB | 21/30 kB | 16/81 kB Progress (3): 49/205 kB | 23/30 kB | 16/81 kB Progress (3): 49/205 kB | 24/30 kB | 16/81 kB Progress (3): 49/205 kB | 25/30 kB | 16/81 kB Progress (3): 49/205 kB | 25/30 kB | 33/81 kB Progress (3): 49/205 kB | 25/30 kB | 49/81 kB Progress (3): 49/205 kB | 27/30 kB | 49/81 kB Progress (3): 49/205 kB | 28/30 kB | 49/81 kB Progress (3): 49/205 kB | 30/30 kB | 49/81 kB Progress (3): 49/205 kB | 30 kB | 49/81 kB Progress (3): 49/205 kB | 30 kB | 64/81 kB Progress (3): 49/205 kB | 30 kB | 81/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 364 kB/s) 2024-09-12T17:44:54.378 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 49/205 kB | 81 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T17:44:54.378 INFO:tasks.workunit.client.0.smithi107.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 967 kB/s) 2024-09-12T17:44:54.378 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T17:44:54.390 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 49/205 kB | 16/798 kB Progress (2): 64/205 kB | 16/798 kB Progress (2): 64/205 kB | 33/798 kB Progress (2): 80/205 kB | 33/798 kB Progress (3): 80/205 kB | 33/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 152 kB/s) 2024-09-12T17:44:54.390 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 80/205 kB | 49/798 kB Progress (2): 97/205 kB | 49/798 kB Progress (2): 113/205 kB | 49/798 kB Progress (2): 113/205 kB | 66/798 kB Progress (2): 130/205 kB | 66/798 kB Progress (2): 146/205 kB | 66/798 kB Progress (2): 162/205 kB | 66/798 kB Progress (2): 162/205 kB | 81/798 kB Progress (3): 162/205 kB | 81/798 kB | 16/182 kB Progress (3): 179/205 kB | 81/798 kB | 16/182 kB Progress (3): 179/205 kB | 81/798 kB | 33/182 kB Progress (3): 195/205 kB | 81/798 kB | 33/182 kB Progress (3): 195/205 kB | 81/798 kB | 49/182 kB Progress (3): 195/205 kB | 81/798 kB | 66/182 kB Progress (3): 205 kB | 81/798 kB | 66/182 kB Progress (3): 205 kB | 81/798 kB | 82/182 kB Progress (3): 205 kB | 97/798 kB | 82/182 kB Progress (3): 205 kB | 97/798 kB | 98/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.1 MB/s) 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 97/798 kB | 115/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 97/798 kB | 131/182 kB Progress (3): 97/798 kB | 131/182 kB | 16/151 kB Progress (3): 97/798 kB | 147/182 kB | 16/151 kB Progress (3): 114/798 kB | 147/182 kB | 16/151 kB Progress (3): 114/798 kB | 164/182 kB | 16/151 kB Progress (3): 114/798 kB | 180/182 kB | 16/151 kB Progress (3): 114/798 kB | 182 kB | 16/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.8 MB/s) 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 130/798 kB | 16/151 kB Progress (2): 130/798 kB | 30/151 kB Progress (2): 146/798 kB | 30/151 kB Progress (2): 163/798 kB | 30/151 kB Progress (2): 179/798 kB | 30/151 kB Progress (3): 179/798 kB | 30/151 kB | 16/27 kB Progress (3): 179/798 kB | 47/151 kB | 16/27 kB Progress (3): 179/798 kB | 47/151 kB | 27 kB Progress (3): 195/798 kB | 47/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 265 kB/s) 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 212/798 kB | 47/151 kB Progress (2): 228/798 kB | 47/151 kB Progress (2): 245/798 kB | 47/151 kB Progress (2): 245/798 kB | 63/151 kB Progress (2): 261/798 kB | 63/151 kB Progress (2): 277/798 kB | 63/151 kB Progress (2): 277/798 kB | 79/151 kB Progress (2): 294/798 kB | 79/151 kB Progress (2): 310/798 kB | 79/151 kB Progress (2): 327/798 kB | 79/151 kB Progress (2): 327/798 kB | 96/151 kB Progress (2): 343/798 kB | 96/151 kB Progress (2): 343/798 kB | 104/151 kB Progress (3): 343/798 kB | 104/151 kB | 15/30 kB Progress (3): 359/798 kB | 104/151 kB | 15/30 kB Progress (3): 359/798 kB | 104/151 kB | 30 kB Progress (3): 359/798 kB | 120/151 kB | 30 kB Progress (3): 376/798 kB | 120/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 264 kB/s) 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 392/798 kB | 120/151 kB Progress (2): 392/798 kB | 128/151 kB Progress (2): 408/798 kB | 128/151 kB Progress (3): 408/798 kB | 128/151 kB | 16/385 kB Progress (3): 408/798 kB | 128/151 kB | 33/385 kB Progress (3): 408/798 kB | 128/151 kB | 49/385 kB Progress (3): 425/798 kB | 128/151 kB | 49/385 kB Progress (3): 425/798 kB | 145/151 kB | 49/385 kB Progress (3): 425/798 kB | 145/151 kB | 66/385 kB Progress (3): 441/798 kB | 145/151 kB | 66/385 kB Progress (3): 441/798 kB | 151 kB | 66/385 kB Progress (3): 441/798 kB | 151 kB | 80/385 kB Progress (3): 458/798 kB | 151 kB | 80/385 kB Progress (3): 458/798 kB | 151 kB | 96/385 kB Progress (3): 458/798 kB | 151 kB | 113/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.3 MB/s) 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 458/798 kB | 129/385 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 458/798 kB | 145/385 kB Progress (2): 458/798 kB | 162/385 kB Progress (2): 458/798 kB | 178/385 kB Progress (2): 458/798 kB | 195/385 kB Progress (2): 458/798 kB | 211/385 kB Progress (2): 458/798 kB | 227/385 kB Progress (3): 458/798 kB | 227/385 kB | 13 kB Progress (3): 458/798 kB | 244/385 kB | 13 kB Progress (3): 458/798 kB | 260/385 kB | 13 kB Progress (3): 458/798 kB | 277/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 111 kB/s) 2024-09-12T17:44:54.391 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T17:44:54.392 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 458/798 kB | 293/385 kB Progress (2): 458/798 kB | 309/385 kB Progress (2): 458/798 kB | 326/385 kB Progress (2): 458/798 kB | 342/385 kB Progress (2): 458/798 kB | 358/385 kB Progress (2): 458/798 kB | 375/385 kB Progress (2): 458/798 kB | 385 kB Progress (2): 474/798 kB | 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.2 MB/s) 2024-09-12T17:44:54.392 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T17:44:54.392 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 490/798 kB Progress (1): 507/798 kB Progress (1): 523/798 kB Progress (1): 540/798 kB Progress (1): 556/798 kB Progress (1): 572/798 kB Progress (1): 589/798 kB Progress (1): 605/798 kB Progress (1): 621/798 kB Progress (1): 638/798 kB Progress (1): 654/798 kB Progress (1): 671/798 kB Progress (1): 687/798 kB Progress (1): 703/798 kB Progress (1): 720/798 kB Progress (1): 736/798 kB Progress (1): 753/798 kB Progress (1): 769/798 kB Progress (1): 785/798 kB Progress (1): 798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.3 MB/s) 2024-09-12T17:44:54.392 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T17:44:54.393 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/75 kB Progress (1): 33/75 kB Progress (1): 49/75 kB Progress (1): 64/75 kB Progress (1): 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 573 kB/s) 2024-09-12T17:44:54.393 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T17:44:54.422 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/780 kB Progress (1): 33/780 kB Progress (1): 39/780 kB Progress (1): 55/780 kB Progress (1): 72/780 kB Progress (1): 88/780 kB Progress (1): 105/780 kB Progress (1): 121/780 kB Progress (2): 121/780 kB | 16/329 kB Progress (2): 137/780 kB | 16/329 kB Progress (2): 154/780 kB | 16/329 kB Progress (2): 154/780 kB | 32/329 kB Progress (2): 170/780 kB | 32/329 kB Progress (2): 187/780 kB | 32/329 kB Progress (2): 187/780 kB | 49/329 kB Progress (3): 187/780 kB | 49/329 kB | 16/501 kB Progress (3): 187/780 kB | 49/329 kB | 32/501 kB Progress (3): 203/780 kB | 49/329 kB | 32/501 kB Progress (3): 203/780 kB | 49/329 kB | 49/501 kB Progress (3): 203/780 kB | 49/329 kB | 65/501 kB Progress (3): 203/780 kB | 49/329 kB | 81/501 kB Progress (3): 203/780 kB | 65/329 kB | 81/501 kB Progress (3): 203/780 kB | 65/329 kB | 98/501 kB Progress (3): 203/780 kB | 65/329 kB | 114/501 kB Progress (3): 203/780 kB | 65/329 kB | 130/501 kB Progress (3): 203/780 kB | 78/329 kB | 130/501 kB Progress (3): 203/780 kB | 78/329 kB | 147/501 kB Progress (3): 203/780 kB | 78/329 kB | 163/501 kB Progress (3): 203/780 kB | 78/329 kB | 180/501 kB Progress (3): 203/780 kB | 95/329 kB | 180/501 kB Progress (3): 203/780 kB | 95/329 kB | 196/501 kB Progress (3): 203/780 kB | 95/329 kB | 212/501 kB Progress (3): 203/780 kB | 95/329 kB | 229/501 kB Progress (3): 203/780 kB | 95/329 kB | 245/501 kB Progress (3): 203/780 kB | 95/329 kB | 262/501 kB Progress (3): 203/780 kB | 95/329 kB | 278/501 kB Progress (3): 203/780 kB | 95/329 kB | 294/501 kB Progress (3): 203/780 kB | 95/329 kB | 311/501 kB Progress (3): 203/780 kB | 95/329 kB | 327/501 kB Progress (3): 203/780 kB | 95/329 kB | 343/501 kB Progress (3): 203/780 kB | 95/329 kB | 360/501 kB Progress (3): 203/780 kB | 95/329 kB | 376/501 kB Progress (3): 203/780 kB | 95/329 kB | 393/501 kB Progress (3): 203/780 kB | 95/329 kB | 402/501 kB Progress (4): 203/780 kB | 95/329 kB | 402/501 kB | 16/354 kB Progress (4): 203/780 kB | 95/329 kB | 418/501 kB | 16/354 kB Progress (4): 203/780 kB | 95/329 kB | 418/501 kB | 32/354 kB Progress (4): 203/780 kB | 95/329 kB | 435/501 kB | 32/354 kB Progress (4): 203/780 kB | 95/329 kB | 435/501 kB | 49/354 kB Progress (4): 203/780 kB | 95/329 kB | 451/501 kB | 49/354 kB Progress (4): 219/780 kB | 95/329 kB | 451/501 kB | 49/354 kB Progress (4): 219/780 kB | 95/329 kB | 451/501 kB | 65/354 kB Progress (4): 219/780 kB | 95/329 kB | 468/501 kB | 65/354 kB Progress (4): 219/780 kB | 95/329 kB | 468/501 kB | 81/354 kB Progress (4): 236/780 kB | 95/329 kB | 468/501 kB | 81/354 kB Progress (4): 236/780 kB | 111/329 kB | 468/501 kB | 81/354 kB Progress (4): 236/780 kB | 111/329 kB | 484/501 kB | 81/354 kB Progress (4): 236/780 kB | 111/329 kB | 484/501 kB | 98/354 kB Progress (4): 252/780 kB | 111/329 kB | 484/501 kB | 98/354 kB Progress (4): 252/780 kB | 127/329 kB | 484/501 kB | 98/354 kB Progress (4): 252/780 kB | 127/329 kB | 500/501 kB | 98/354 kB Progress (4): 252/780 kB | 127/329 kB | 500/501 kB | 114/354 kB Progress (5): 252/780 kB | 127/329 kB | 500/501 kB | 114/354 kB | 16/41 kB Progress (5): 252/780 kB | 127/329 kB | 501 kB | 114/354 kB | 16/41 kB Progress (5): 268/780 kB | 127/329 kB | 501 kB | 114/354 kB | 16/41 kB Progress (5): 268/780 kB | 144/329 kB | 501 kB | 114/354 kB | 16/41 kB Progress (5): 268/780 kB | 144/329 kB | 501 kB | 130/354 kB | 16/41 kB Progress (5): 268/780 kB | 144/329 kB | 501 kB | 130/354 kB | 33/41 kB Progress (5): 285/780 kB | 144/329 kB | 501 kB | 130/354 kB | 33/41 kB Progress (5): 285/780 kB | 160/329 kB | 501 kB | 130/354 kB | 33/41 kB Progress (5): 285/780 kB | 160/329 kB | 501 kB | 147/354 kB | 33/41 kB Progress (5): 285/780 kB | 160/329 kB | 501 kB | 147/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.2 MB/s) 2024-09-12T17:44:54.422 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (4): 301/780 kB | 160/329 kB | 147/354 kB | 41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T17:44:54.422 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (4): 301/780 kB | 177/329 kB | 147/354 kB | 41 kB Progress (4): 301/780 kB | 177/329 kB | 163/354 kB | 41 kB Progress (4): 318/780 kB | 177/329 kB | 163/354 kB | 41 kB Progress (4): 318/780 kB | 177/329 kB | 180/354 kB | 41 kB Progress (4): 318/780 kB | 193/329 kB | 180/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 260 kB/s) 2024-09-12T17:44:54.422 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (3): 318/780 kB | 193/329 kB | 196/354 kB Progress (3): 334/780 kB | 193/329 kB | 196/354 kB Progress (3): 334/780 kB | 209/329 kB | 196/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T17:44:54.425 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (3): 350/780 kB | 209/329 kB | 196/354 kB Progress (3): 350/780 kB | 209/329 kB | 212/354 kB Progress (3): 350/780 kB | 226/329 kB | 212/354 kB Progress (3): 367/780 kB | 226/329 kB | 212/354 kB Progress (3): 367/780 kB | 226/329 kB | 229/354 kB Progress (3): 367/780 kB | 242/329 kB | 229/354 kB Progress (3): 383/780 kB | 242/329 kB | 229/354 kB Progress (3): 383/780 kB | 242/329 kB | 245/354 kB Progress (3): 400/780 kB | 242/329 kB | 245/354 kB Progress (3): 400/780 kB | 259/329 kB | 245/354 kB Progress (3): 416/780 kB | 259/329 kB | 245/354 kB Progress (3): 416/780 kB | 259/329 kB | 262/354 kB Progress (3): 416/780 kB | 275/329 kB | 262/354 kB Progress (3): 432/780 kB | 275/329 kB | 262/354 kB Progress (3): 432/780 kB | 275/329 kB | 278/354 kB Progress (3): 432/780 kB | 291/329 kB | 278/354 kB Progress (3): 449/780 kB | 291/329 kB | 278/354 kB Progress (3): 449/780 kB | 291/329 kB | 294/354 kB Progress (3): 465/780 kB | 291/329 kB | 294/354 kB Progress (3): 465/780 kB | 308/329 kB | 294/354 kB Progress (3): 481/780 kB | 308/329 kB | 294/354 kB Progress (3): 481/780 kB | 308/329 kB | 311/354 kB Progress (3): 481/780 kB | 324/329 kB | 311/354 kB Progress (3): 481/780 kB | 329 kB | 311/354 kB Progress (3): 498/780 kB | 329 kB | 311/354 kB Progress (3): 498/780 kB | 329 kB | 327/354 kB Progress (3): 514/780 kB | 329 kB | 327/354 kB Progress (3): 514/780 kB | 329 kB | 343/354 kB Progress (3): 531/780 kB | 329 kB | 343/354 kB Progress (3): 531/780 kB | 329 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.0 MB/s) 2024-09-12T17:44:54.425 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 547/780 kB | 354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T17:44:54.425 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 563/780 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.2 MB/s) 2024-09-12T17:44:54.425 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T17:44:54.429 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 580/780 kB Progress (1): 596/780 kB Progress (1): 613/780 kB Progress (1): 629/780 kB Progress (1): 645/780 kB Progress (1): 662/780 kB Progress (1): 678/780 kB Progress (1): 694/780 kB Progress (1): 711/780 kB Progress (1): 727/780 kB Progress (1): 744/780 kB Progress (1): 760/780 kB Progress (1): 776/780 kB Progress (1): 780 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.7 MB/s) 2024-09-12T17:44:54.429 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T17:44:54.435 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 37 kB/s) 2024-09-12T17:44:54.436 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T17:44:54.448 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 65/586 kB Progress (1): 81/586 kB Progress (1): 97/586 kB Progress (1): 114/586 kB Progress (1): 130/586 kB Progress (1): 147/586 kB Progress (1): 163/586 kB Progress (1): 179/586 kB Progress (1): 196/586 kB Progress (1): 212/586 kB Progress (2): 212/586 kB | 14 kB Progress (2): 228/586 kB | 14 kB Progress (2): 245/586 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 81 kB/s) 2024-09-12T17:44:54.448 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T17:44:54.448 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 261/586 kB Progress (2): 261/586 kB | 15/211 kB Progress (2): 278/586 kB | 15/211 kB Progress (2): 278/586 kB | 31/211 kB Progress (2): 294/586 kB | 31/211 kB Progress (2): 294/586 kB | 48/211 kB Progress (2): 310/586 kB | 48/211 kB Progress (2): 310/586 kB | 64/211 kB Progress (2): 327/586 kB | 64/211 kB Progress (2): 327/586 kB | 78/211 kB Progress (2): 343/586 kB | 78/211 kB Progress (2): 343/586 kB | 94/211 kB Progress (2): 360/586 kB | 94/211 kB Progress (2): 360/586 kB | 110/211 kB Progress (2): 376/586 kB | 110/211 kB Progress (2): 376/586 kB | 127/211 kB Progress (2): 376/586 kB | 143/211 kB Progress (2): 392/586 kB | 143/211 kB Progress (2): 392/586 kB | 160/211 kB Progress (2): 409/586 kB | 160/211 kB Progress (2): 409/586 kB | 176/211 kB Progress (2): 425/586 kB | 176/211 kB Progress (2): 425/586 kB | 192/211 kB Progress (2): 441/586 kB | 192/211 kB Progress (2): 458/586 kB | 192/211 kB Progress (2): 458/586 kB | 209/211 kB Progress (2): 458/586 kB | 211 kB Progress (3): 458/586 kB | 211 kB | 16/106 kB Progress (3): 474/586 kB | 211 kB | 16/106 kB Progress (3): 474/586 kB | 211 kB | 33/106 kB Progress (3): 491/586 kB | 211 kB | 33/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-12T17:44:54.448 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 491/586 kB | 49/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T17:44:54.448 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 507/586 kB | 49/106 kB Progress (2): 507/586 kB | 66/106 kB Progress (2): 523/586 kB | 66/106 kB Progress (2): 523/586 kB | 82/106 kB Progress (2): 540/586 kB | 82/106 kB Progress (2): 540/586 kB | 98/106 kB Progress (2): 556/586 kB | 98/106 kB Progress (2): 556/586 kB | 106 kB Progress (2): 573/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 584 kB/s) 2024-09-12T17:44:54.448 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T17:44:54.448 INFO:tasks.workunit.client.0.smithi107.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-12T17:44:54.449 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:44:54.449 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 37 kB/s) 2024-09-12T17:44:54.449 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T17:44:54.462 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 62/245 kB Progress (1): 79/245 kB Progress (1): 95/245 kB Progress (1): 111/245 kB Progress (1): 128/245 kB Progress (1): 144/245 kB Progress (1): 161/245 kB Progress (1): 177/245 kB Progress (1): 193/245 kB Progress (1): 210/245 kB Progress (1): 226/245 kB Progress (1): 243/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T17:44:54.462 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T17:44:54.462 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 33/205 kB Progress (2): 33/205 kB | 16/16 kB Progress (2): 33/205 kB | 16 kB Progress (2): 49/205 kB | 16 kB Progress (3): 49/205 kB | 16 kB | 15 kB Progress (3): 65/205 kB | 16 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 84 kB/s) 2024-09-12T17:44:54.462 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T17:44:54.463 INFO:tasks.workunit.client.0.smithi107.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 77 kB/s) 2024-09-12T17:44:54.463 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 81/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T17:44:54.463 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 98/205 kB Progress (1): 114/205 kB Progress (1): 130/205 kB Progress (1): 147/205 kB Progress (1): 163/205 kB Progress (1): 180/205 kB Progress (1): 196/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.0 MB/s) 2024-09-12T17:44:54.463 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T17:44:54.464 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 32 kB/s) 2024-09-12T17:44:54.474 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 108 kB/s) 2024-09-12T17:44:54.475 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 82 kB/s) 2024-09-12T17:44:54.475 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 15/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 114 kB/s) 2024-09-12T17:44:54.479 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 78/184 kB Progress (1): 94/184 kB Progress (1): 111/184 kB Progress (1): 127/184 kB Progress (1): 143/184 kB Progress (1): 160/184 kB Progress (1): 176/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 855 kB/s) 2024-09-12T17:44:54.497 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:54.497 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T17:44:54.503 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T17:44:54.518 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-12T17:44:54.519 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T17:44:54.534 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 364 kB/s) 2024-09-12T17:44:54.536 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T17:44:54.552 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.7 MB/s) 2024-09-12T17:44:54.556 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T17:44:54.573 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 839 kB/s) 2024-09-12T17:44:54.577 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T17:44:54.595 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.1 MB/s) 2024-09-12T17:44:54.596 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T17:44:54.615 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-12T17:44:54.651 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:54.651 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:44:54.654 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T17:44:54.668 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-12T17:44:54.670 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T17:44:54.684 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.5 MB/s) 2024-09-12T17:44:54.687 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T17:44:54.702 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-12T17:44:54.704 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T17:44:54.719 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-12T17:44:54.721 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T17:44:54.737 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-12T17:44:54.738 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T17:44:54.752 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 215 kB/s) 2024-09-12T17:44:54.755 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T17:44:54.769 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-12T17:44:54.771 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T17:44:54.785 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-12T17:44:54.786 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T17:44:54.801 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 940 kB/s) 2024-09-12T17:44:54.803 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T17:44:54.818 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 214 kB/s) 2024-09-12T17:44:54.820 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T17:44:54.834 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-12T17:44:54.836 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T17:44:54.851 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 558 kB/s) 2024-09-12T17:44:54.854 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T17:44:54.868 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-12T17:44:54.871 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T17:44:54.885 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.3 MB/s) 2024-09-12T17:44:54.889 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T17:44:54.904 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-12T17:44:54.906 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T17:44:54.921 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.0 MB/s) 2024-09-12T17:44:54.925 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T17:44:54.940 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-12T17:44:54.943 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T17:44:54.960 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/85 kB Progress (1): 32/85 kB Progress (1): 49/85 kB Progress (1): 65/85 kB Progress (1): 81/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.3 MB/s) 2024-09-12T17:44:54.960 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T17:44:54.960 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T17:44:54.960 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T17:44:54.960 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T17:44:54.960 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T17:44:54.976 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/41 kB Progress (2): 2.5 kB | 33/41 kB Progress (3): 2.5 kB | 33/41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-12T17:44:54.976 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T17:44:54.976 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 41 kB | 8.5 kB Progress (3): 41 kB | 8.5 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-12T17:44:54.976 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 8.5 kB | 32/55 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T17:44:54.976 INFO:tasks.workunit.client.0.smithi107.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-12T17:44:54.976 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 32/55 kB | 16/269 kB Progress (2): 49/55 kB | 16/269 kB Progress (2): 55 kB | 16/269 kB Progress (2): 55 kB | 32/269 kB Progress (2): 55 kB | 49/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.4 MB/s) 2024-09-12T17:44:54.978 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 65/269 kB Progress (1): 81/269 kB Progress (1): 98/269 kB Progress (1): 114/269 kB Progress (1): 130/269 kB Progress (1): 147/269 kB Progress (1): 163/269 kB Progress (1): 180/269 kB Progress (1): 196/269 kB Progress (1): 212/269 kB Progress (1): 229/269 kB Progress (1): 245/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 14 MB/s) 2024-09-12T17:44:54.992 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/327 kB Progress (2): 16/327 kB | 16/587 kB Progress (2): 33/327 kB | 16/587 kB Progress (2): 33/327 kB | 33/587 kB Progress (2): 49/327 kB | 33/587 kB Progress (2): 62/327 kB | 33/587 kB Progress (2): 78/327 kB | 33/587 kB Progress (2): 78/327 kB | 49/587 kB Progress (2): 95/327 kB | 49/587 kB Progress (2): 95/327 kB | 65/587 kB Progress (2): 111/327 kB | 65/587 kB Progress (2): 111/327 kB | 81/587 kB Progress (2): 128/327 kB | 81/587 kB Progress (2): 128/327 kB | 98/587 kB Progress (2): 144/327 kB | 98/587 kB Progress (2): 160/327 kB | 98/587 kB Progress (2): 177/327 kB | 98/587 kB Progress (2): 177/327 kB | 114/587 kB Progress (2): 193/327 kB | 114/587 kB Progress (2): 193/327 kB | 130/587 kB Progress (2): 210/327 kB | 130/587 kB Progress (2): 210/327 kB | 147/587 kB Progress (2): 226/327 kB | 147/587 kB Progress (2): 242/327 kB | 147/587 kB Progress (2): 259/327 kB | 147/587 kB Progress (2): 259/327 kB | 163/587 kB Progress (2): 275/327 kB | 163/587 kB Progress (2): 275/327 kB | 180/587 kB Progress (2): 291/327 kB | 180/587 kB Progress (2): 308/327 kB | 180/587 kB Progress (2): 324/327 kB | 180/587 kB Progress (2): 327 kB | 180/587 kB Progress (2): 327 kB | 196/587 kB Progress (2): 327 kB | 212/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 10 MB/s) 2024-09-12T17:44:55.005 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 229/587 kB Progress (1): 245/587 kB Progress (1): 261/587 kB Progress (1): 278/587 kB Progress (1): 294/587 kB Progress (1): 311/587 kB Progress (1): 327/587 kB Progress (1): 343/587 kB Progress (1): 360/587 kB Progress (1): 376/587 kB Progress (1): 393/587 kB Progress (1): 409/587 kB Progress (1): 425/587 kB Progress (1): 442/587 kB Progress (1): 458/587 kB Progress (1): 474/587 kB Progress (1): 491/587 kB Progress (1): 507/587 kB Progress (1): 524/587 kB Progress (1): 540/587 kB Progress (1): 556/587 kB Progress (1): 573/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 13 MB/s) 2024-09-12T17:44:55.035 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:44:55.035 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:55.035 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:44:55.038 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T17:44:55.052 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 339 kB/s) 2024-09-12T17:44:55.054 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T17:44:55.068 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-12T17:44:55.070 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T17:44:55.084 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-12T17:44:55.086 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T17:44:55.100 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-12T17:44:55.104 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T17:44:55.118 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-12T17:44:55.119 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T17:44:55.134 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-12T17:44:55.135 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T17:44:55.150 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T17:44:55.152 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T17:44:55.167 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-12T17:44:55.168 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T17:44:55.182 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-12T17:44:55.185 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T17:44:55.199 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-12T17:44:55.201 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T17:44:55.216 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-12T17:44:55.218 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T17:44:55.232 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.2 MB/s) 2024-09-12T17:44:55.234 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T17:44:55.249 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-12T17:44:55.251 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T17:44:55.266 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-12T17:44:55.267 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T17:44:55.281 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-12T17:44:55.283 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T17:44:55.297 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 191 kB/s) 2024-09-12T17:44:55.300 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T17:44:55.314 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-12T17:44:55.317 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T17:44:55.331 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 81 kB/s) 2024-09-12T17:44:55.334 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T17:44:55.348 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-12T17:44:55.349 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T17:44:55.364 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-12T17:44:55.365 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T17:44:55.380 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.7 MB/s) 2024-09-12T17:44:55.382 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T17:44:55.397 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-12T17:44:55.398 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T17:44:55.413 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-12T17:44:55.418 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T17:44:55.432 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-12T17:44:55.433 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T17:44:55.433 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T17:44:55.433 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T17:44:55.433 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T17:44:55.433 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T17:44:55.449 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Progress (3): 4.2 kB | 16/55 kB | 16/122 kB Progress (3): 4.2 kB | 33/55 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-12T17:44:55.450 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T17:44:55.450 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 49/55 kB | 16/122 kB Progress (2): 49/55 kB | 33/122 kB Progress (2): 55 kB | 33/122 kB Progress (3): 55 kB | 33/122 kB | 16/27 kB Progress (3): 55 kB | 49/122 kB | 16/27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-12T17:44:55.450 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (3): 49/122 kB | 16/27 kB | 16/334 kB Progress (3): 49/122 kB | 27 kB | 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T17:44:55.450 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (3): 66/122 kB | 27 kB | 16/334 kB Progress (3): 66/122 kB | 27 kB | 32/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-12T17:44:55.450 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 82/122 kB | 32/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T17:44:55.450 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 82/122 kB | 49/334 kB Progress (2): 98/122 kB | 49/334 kB Progress (2): 98/122 kB | 65/334 kB Progress (2): 115/122 kB | 65/334 kB Progress (2): 115/122 kB | 81/334 kB Progress (2): 122 kB | 81/334 kB Progress (2): 122 kB | 98/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-09-12T17:44:55.452 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 114/334 kB Progress (1): 130/334 kB Progress (1): 147/334 kB Progress (1): 163/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 212/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 294/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 18 MB/s) 2024-09-12T17:44:55.461 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 166 kB/s) 2024-09-12T17:44:55.462 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (2): 49/267 kB | 16/23 kB Progress (2): 49/267 kB | 23 kB Progress (2): 62/267 kB | 23 kB Progress (2): 79/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-12T17:44:55.465 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 95/267 kB Progress (1): 111/267 kB Progress (1): 128/267 kB Progress (1): 144/267 kB Progress (1): 161/267 kB Progress (1): 177/267 kB Progress (1): 193/267 kB Progress (1): 210/267 kB Progress (1): 226/267 kB Progress (1): 242/267 kB Progress (1): 259/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.4 MB/s) 2024-09-12T17:44:55.528 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T17:44:55.529 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T17:44:56.192 INFO:tasks.workunit.client.0.smithi107.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:44:56.193 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:56.193 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:44:56.194 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:44:56.195 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:56.195 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:44:56.199 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T17:44:56.199 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T17:44:56.340 INFO:tasks.workunit.client.0.smithi107.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:44:56.340 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:56.340 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:44:56.344 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T17:44:56.359 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-12T17:44:56.362 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T17:44:56.377 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-12T17:44:56.380 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T17:44:56.395 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-12T17:44:56.398 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T17:44:56.414 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 239 kB/s) 2024-09-12T17:44:56.418 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T17:44:56.433 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-12T17:44:56.436 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T17:44:56.451 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-12T17:44:56.454 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T17:44:56.469 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 117 kB/s) 2024-09-12T17:44:56.472 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T17:44:56.486 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-12T17:44:56.488 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T17:44:56.503 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-12T17:44:56.505 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T17:44:56.520 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T17:44:56.522 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T17:44:56.536 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-12T17:44:56.539 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T17:44:56.554 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 157 kB/s) 2024-09-12T17:44:56.555 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T17:44:56.569 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-12T17:44:56.571 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T17:44:56.586 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.5 MB/s) 2024-09-12T17:44:56.588 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T17:44:56.602 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.2 MB/s) 2024-09-12T17:44:56.604 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T17:44:56.618 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-12T17:44:56.619 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T17:44:56.635 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-12T17:44:56.637 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T17:44:56.651 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-12T17:44:56.654 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T17:44:56.669 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-12T17:44:56.671 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T17:44:56.685 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-12T17:44:56.688 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T17:44:56.702 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-12T17:44:56.703 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T17:44:56.717 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-12T17:44:56.718 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T17:44:56.733 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.4 MB/s) 2024-09-12T17:44:56.734 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T17:44:56.749 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-12T17:44:56.750 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T17:44:56.764 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-12T17:44:56.767 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T17:44:56.781 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-12T17:44:56.784 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T17:44:56.797 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-12T17:44:56.798 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T17:44:56.813 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-12T17:44:56.814 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T17:44:56.828 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 138 kB/s) 2024-09-12T17:44:56.831 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T17:44:56.845 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-12T17:44:56.848 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T17:44:56.864 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 189 kB/s) 2024-09-12T17:44:56.867 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T17:44:56.881 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-12T17:44:56.883 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T17:44:56.898 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T17:44:56.901 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T17:44:56.915 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-12T17:44:56.917 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T17:44:56.931 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-12T17:44:56.933 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T17:44:56.946 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 483 kB/s) 2024-09-12T17:44:56.948 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T17:44:56.963 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-12T17:44:56.965 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T17:44:56.980 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-12T17:44:56.982 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T17:44:56.998 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 925 kB/s) 2024-09-12T17:44:57.001 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T17:44:57.016 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 50 kB/s) 2024-09-12T17:44:57.017 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T17:44:57.031 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-12T17:44:57.033 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T17:44:57.048 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 527 kB/s) 2024-09-12T17:44:57.051 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T17:44:57.065 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-12T17:44:57.069 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T17:44:57.084 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 283 kB/s) 2024-09-12T17:44:57.087 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T17:44:57.101 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-12T17:44:57.103 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T17:44:57.118 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 232 kB/s) 2024-09-12T17:44:57.120 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T17:44:57.135 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 729 kB/s) 2024-09-12T17:44:57.137 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T17:44:57.151 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 898 kB/s) 2024-09-12T17:44:57.153 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T17:44:57.167 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-12T17:44:57.169 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T17:44:57.183 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 24 kB/s) 2024-09-12T17:44:57.185 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T17:44:57.199 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 436 kB/s) 2024-09-12T17:44:57.201 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T17:44:57.215 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-12T17:44:57.217 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T17:44:57.231 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-12T17:44:57.233 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T17:44:57.247 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-12T17:44:57.250 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T17:44:57.264 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-12T17:44:57.266 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T17:44:57.281 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-12T17:44:57.284 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T17:44:57.298 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-12T17:44:57.301 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T17:44:57.315 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-12T17:44:57.317 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T17:44:57.331 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-12T17:44:57.332 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T17:44:57.346 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-12T17:44:57.348 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T17:44:57.362 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-12T17:44:57.365 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T17:44:57.380 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 158 kB/s) 2024-09-12T17:44:57.386 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T17:44:57.406 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 62/308 kB Progress (1): 79/308 kB Progress (1): 95/308 kB Progress (1): 112/308 kB Progress (1): 128/308 kB Progress (1): 144/308 kB Progress (1): 161/308 kB Progress (1): 177/308 kB Progress (1): 194/308 kB Progress (1): 210/308 kB Progress (1): 226/308 kB Progress (1): 243/308 kB Progress (1): 259/308 kB Progress (1): 275/308 kB Progress (1): 292/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 16 MB/s) 2024-09-12T17:44:57.407 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T17:44:57.407 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T17:44:57.407 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T17:44:57.407 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T17:44:57.407 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T17:44:57.422 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/171 kB Progress (2): 16/171 kB | 14 kB Progress (2): 33/171 kB | 14 kB Progress (2): 49/171 kB | 14 kB Progress (3): 49/171 kB | 14 kB | 16/26 kB Progress (4): 49/171 kB | 14 kB | 16/26 kB | 8.2 kB Progress (4): 49/171 kB | 14 kB | 26 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 906 kB/s) 2024-09-12T17:44:57.422 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (3): 63/171 kB | 26 kB | 8.2 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T17:44:57.423 INFO:tasks.workunit.client.0.smithi107.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 545 kB/s) 2024-09-12T17:44:57.423 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T17:44:57.423 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 79/171 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.7 MB/s) 2024-09-12T17:44:57.423 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T17:44:57.424 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 79/171 kB | 16/118 kB Progress (2): 95/171 kB | 16/118 kB Progress (2): 95/171 kB | 33/118 kB Progress (2): 112/171 kB | 33/118 kB Progress (2): 112/171 kB | 49/118 kB Progress (2): 128/171 kB | 49/118 kB Progress (2): 128/171 kB | 66/118 kB Progress (2): 144/171 kB | 66/118 kB Progress (2): 144/171 kB | 81/118 kB Progress (2): 161/171 kB | 81/118 kB Progress (2): 161/171 kB | 97/118 kB Progress (2): 171 kB | 97/118 kB Progress (2): 171 kB | 113/118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.5 MB/s) 2024-09-12T17:44:57.424 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T17:44:57.424 INFO:tasks.workunit.client.0.smithi107.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.5 MB/s) 2024-09-12T17:44:57.424 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T17:44:57.436 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/61 kB Progress (2): 16/61 kB | 16/146 kB Progress (2): 33/61 kB | 16/146 kB Progress (2): 33/61 kB | 32/146 kB Progress (2): 49/61 kB | 32/146 kB Progress (2): 49/61 kB | 49/146 kB Progress (2): 61 kB | 49/146 kB Progress (2): 61 kB | 65/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.0 MB/s) 2024-09-12T17:44:57.437 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T17:44:57.440 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 65/146 kB | 16/136 kB Progress (2): 81/146 kB | 16/136 kB Progress (2): 81/146 kB | 32/136 kB Progress (2): 97/146 kB | 32/136 kB Progress (2): 97/146 kB | 49/136 kB Progress (2): 114/146 kB | 49/136 kB Progress (2): 114/146 kB | 65/136 kB Progress (2): 130/146 kB | 65/136 kB Progress (3): 130/146 kB | 65/136 kB | 16/58 kB Progress (3): 130/146 kB | 81/136 kB | 16/58 kB Progress (3): 146 kB | 81/136 kB | 16/58 kB Progress (3): 146 kB | 81/136 kB | 32/58 kB Progress (3): 146 kB | 98/136 kB | 32/58 kB Progress (3): 146 kB | 98/136 kB | 49/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.4 MB/s) 2024-09-12T17:44:57.440 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T17:44:57.440 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 114/136 kB | 49/58 kB Progress (2): 114/136 kB | 58 kB Progress (3): 114/136 kB | 58 kB | 16/501 kB Progress (3): 130/136 kB | 58 kB | 16/501 kB Progress (3): 130/136 kB | 58 kB | 33/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.8 MB/s) 2024-09-12T17:44:57.440 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 136 kB | 33/501 kB Progress (2): 136 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.0 MB/s) 2024-09-12T17:44:57.446 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 66/501 kB Progress (1): 82/501 kB Progress (1): 98/501 kB Progress (1): 113/501 kB Progress (1): 129/501 kB Progress (1): 145/501 kB Progress (1): 162/501 kB Progress (1): 178/501 kB Progress (1): 194/501 kB Progress (1): 211/501 kB Progress (1): 227/501 kB Progress (1): 244/501 kB Progress (1): 260/501 kB Progress (1): 276/501 kB Progress (1): 293/501 kB Progress (1): 309/501 kB Progress (1): 325/501 kB Progress (1): 342/501 kB Progress (1): 358/501 kB Progress (1): 375/501 kB Progress (1): 391/501 kB Progress (1): 407/501 kB Progress (1): 424/501 kB Progress (1): 440/501 kB Progress (1): 457/501 kB Progress (1): 473/501 kB Progress (1): 489/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-12T17:44:57.452 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.7 MB/s) 2024-09-12T17:44:57.487 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 30 MB/s) 2024-09-12T17:44:57.578 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:57.578 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T17:44:57.581 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T17:44:57.596 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-12T17:44:57.599 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T17:44:57.613 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-12T17:44:57.614 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T17:44:57.628 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.2 MB/s) 2024-09-12T17:44:57.630 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T17:44:57.645 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.3 MB/s) 2024-09-12T17:44:57.649 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T17:44:57.664 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 345 kB/s) 2024-09-12T17:44:57.665 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T17:44:57.680 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-12T17:44:57.682 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T17:44:57.696 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-12T17:44:57.698 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T17:44:57.713 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-09-12T17:44:57.715 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T17:44:57.729 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T17:44:57.733 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T17:44:57.748 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 969 kB/s) 2024-09-12T17:44:57.751 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T17:44:57.766 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 128 kB/s) 2024-09-12T17:44:57.769 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T17:44:57.785 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 514 kB/s) 2024-09-12T17:44:57.787 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T17:44:57.805 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.4 MB/s) 2024-09-12T17:44:57.812 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T17:44:57.828 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.0 MB/s) 2024-09-12T17:44:57.829 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T17:44:57.829 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T17:44:57.829 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T17:44:57.830 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T17:44:57.830 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T17:44:57.846 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/26 kB Progress (2): 16/79 kB | 26 kB Progress (2): 33/79 kB | 26 kB Progress (3): 33/79 kB | 26 kB | 16/58 kB Progress (3): 49/79 kB | 26 kB | 16/58 kB Progress (4): 49/79 kB | 26 kB | 16/58 kB | 16/211 kB Progress (4): 49/79 kB | 26 kB | 33/58 kB | 16/211 kB Progress (4): 66/79 kB | 26 kB | 33/58 kB | 16/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-09-12T17:44:57.846 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (3): 66/79 kB | 33/58 kB | 33/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T17:44:57.846 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (3): 79 kB | 33/58 kB | 33/211 kB Progress (3): 79 kB | 49/58 kB | 33/211 kB Progress (3): 79 kB | 49/58 kB | 49/211 kB Progress (3): 79 kB | 58 kB | 49/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.0 MB/s) 2024-09-12T17:44:57.846 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T17:44:57.846 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 58 kB | 66/211 kB Progress (2): 58 kB | 82/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-12T17:44:57.848 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 98/211 kB Progress (1): 115/211 kB Progress (1): 131/211 kB Progress (1): 147/211 kB Progress (2): 147/211 kB | 0/1.0 MB Progress (2): 164/211 kB | 0/1.0 MB Progress (2): 164/211 kB | 0/1.0 MB Progress (2): 180/211 kB | 0/1.0 MB Progress (2): 197/211 kB | 0/1.0 MB Progress (2): 197/211 kB | 0/1.0 MB Progress (2): 211 kB | 0/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 12 MB/s) 2024-09-12T17:44:57.861 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 33/116 kB Progress (2): 0.6/1.0 MB | 33/116 kB Progress (2): 0.6/1.0 MB | 49/116 kB Progress (2): 0.6/1.0 MB | 49/116 kB Progress (2): 0.6/1.0 MB | 66/116 kB Progress (2): 0.6/1.0 MB | 66/116 kB Progress (2): 0.6/1.0 MB | 82/116 kB Progress (3): 0.6/1.0 MB | 82/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 82/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 115/116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 49/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 49/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 66/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.6 MB/s) 2024-09-12T17:44:57.866 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 0.7/1.0 MB | 66/267 kB Progress (2): 0.7/1.0 MB | 82/267 kB Progress (2): 0.7/1.0 MB | 82/267 kB Progress (2): 0.7/1.0 MB | 98/267 kB Progress (2): 0.7/1.0 MB | 98/267 kB Progress (2): 0.7/1.0 MB | 115/267 kB Progress (2): 0.8/1.0 MB | 115/267 kB Progress (2): 0.8/1.0 MB | 131/267 kB Progress (2): 0.8/1.0 MB | 131/267 kB Progress (2): 0.8/1.0 MB | 147/267 kB Progress (2): 0.8/1.0 MB | 147/267 kB Progress (2): 0.8/1.0 MB | 164/267 kB Progress (2): 0.8/1.0 MB | 164/267 kB Progress (2): 0.8/1.0 MB | 180/267 kB Progress (2): 0.8/1.0 MB | 180/267 kB Progress (2): 0.8/1.0 MB | 197/267 kB Progress (2): 0.8/1.0 MB | 197/267 kB Progress (2): 0.8/1.0 MB | 213/267 kB Progress (2): 0.9/1.0 MB | 213/267 kB Progress (2): 0.9/1.0 MB | 229/267 kB Progress (2): 0.9/1.0 MB | 229/267 kB Progress (2): 0.9/1.0 MB | 246/267 kB Progress (2): 0.9/1.0 MB | 246/267 kB Progress (2): 0.9/1.0 MB | 256/267 kB Progress (2): 0.9/1.0 MB | 256/267 kB Progress (2): 0.9/1.0 MB | 267 kB Progress (2): 0.9/1.0 MB | 267 kB Progress (2): 0.9/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.2 MB/s) 2024-09-12T17:44:57.869 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 25 MB/s) 2024-09-12T17:44:57.997 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T17:44:58.034 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:44:58.034 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:44:58.034 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:44:58.035 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Total time: 5.837 s 2024-09-12T17:44:58.035 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Finished at: 2024-09-12T17:44:58Z 2024-09-12T17:44:58.035 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:44:58.057 INFO:tasks.workunit.client.0.smithi107.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T17:44:58.066 INFO:tasks.workunit.client.0.smithi107.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:44:59.094 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Scanning for projects... 2024-09-12T17:44:59.188 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:59.188 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:44:59.188 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:44:59.188 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] from pom.xml 2024-09-12T17:44:59.188 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:44:59.425 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:59.425 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:44:59.514 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:44:59.515 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:59.515 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:44:59.603 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:44:59.603 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:59.603 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:44:59.605 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:44:59.605 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:59.605 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:44:59.610 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:44:59.610 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:44:59.610 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:44:59.782 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T17:45:00.015 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T17:45:00.207 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-09-12T17:45:00.215 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T17:45:00.233 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 145 kB/s) 2024-09-12T17:45:00.238 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T17:45:00.255 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-12T17:45:00.259 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T17:45:00.276 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 178 kB/s) 2024-09-12T17:45:00.278 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T17:45:00.294 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-12T17:45:00.297 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T17:45:00.313 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T17:45:00.316 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T17:45:00.332 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-12T17:45:00.337 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T17:45:00.358 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-12T17:45:00.360 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T17:45:00.360 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T17:45:00.360 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T17:45:00.360 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T17:45:00.362 INFO:tasks.workunit.client.0.smithi107.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T17:45:00.400 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 66/169 kB Progress (1): 82/169 kB Progress (1): 98/169 kB Progress (1): 115/169 kB Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 4.1 MB/s) 2024-09-12T17:45:00.416 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 2.8/189 kB Progress (3): 2.8/7.7 kB | 2.8/189 kB | 1.4/18 kB Progress (3): 2.8/7.7 kB | 4.1/189 kB | 1.4/18 kB Progress (3): 4.1/7.7 kB | 4.1/189 kB | 1.4/18 kB Progress (3): 4.1/7.7 kB | 5.5/189 kB | 1.4/18 kB Progress (3): 4.1/7.7 kB | 5.5/189 kB | 2.8/18 kB Progress (3): 4.1/7.7 kB | 6.9/189 kB | 2.8/18 kB Progress (3): 5.5/7.7 kB | 6.9/189 kB | 2.8/18 kB Progress (4): 5.5/7.7 kB | 6.9/189 kB | 2.8/18 kB | 16/103 kB Progress (4): 6.9/7.7 kB | 6.9/189 kB | 2.8/18 kB | 16/103 kB Progress (4): 6.9/7.7 kB | 8.3/189 kB | 2.8/18 kB | 16/103 kB Progress (4): 6.9/7.7 kB | 8.3/189 kB | 4.1/18 kB | 16/103 kB Progress (4): 6.9/7.7 kB | 9.7/189 kB | 4.1/18 kB | 16/103 kB Progress (4): 7.7 kB | 9.7/189 kB | 4.1/18 kB | 16/103 kB Progress (4): 7.7 kB | 11/189 kB | 4.1/18 kB | 16/103 kB Progress (4): 7.7 kB | 11/189 kB | 5.5/18 kB | 16/103 kB Progress (4): 7.7 kB | 12/189 kB | 5.5/18 kB | 16/103 kB Progress (4): 7.7 kB | 12/189 kB | 6.9/18 kB | 16/103 kB Progress (4): 7.7 kB | 14/189 kB | 6.9/18 kB | 16/103 kB Progress (4): 7.7 kB | 14/189 kB | 8.3/18 kB | 16/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 137 kB/s) 2024-09-12T17:45:00.420 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (3): 14/189 kB | 9.7/18 kB | 16/103 kB Progress (3): 15/189 kB | 9.7/18 kB | 16/103 kB Progress (3): 15/189 kB | 11/18 kB | 16/103 kB Progress (3): 16/189 kB | 11/18 kB | 16/103 kB Progress (3): 16/189 kB | 12/18 kB | 16/103 kB Progress (3): 18/189 kB | 12/18 kB | 16/103 kB Progress (3): 18/189 kB | 14/18 kB | 16/103 kB Progress (3): 19/189 kB | 14/18 kB | 16/103 kB Progress (3): 19/189 kB | 15/18 kB | 16/103 kB Progress (3): 21/189 kB | 15/18 kB | 16/103 kB Progress (3): 21/189 kB | 17/18 kB | 16/103 kB Progress (3): 22/189 kB | 17/18 kB | 16/103 kB Progress (3): 22/189 kB | 18 kB | 16/103 kB Progress (3): 23/189 kB | 18 kB | 16/103 kB Progress (3): 25/189 kB | 18 kB | 16/103 kB Progress (3): 26/189 kB | 18 kB | 16/103 kB Progress (3): 27/189 kB | 18 kB | 16/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 283 kB/s) 2024-09-12T17:45:00.437 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (2): 29/189 kB | 16/103 kB Progress (2): 30/189 kB | 16/103 kB Progress (2): 31/189 kB | 16/103 kB Progress (2): 31/189 kB | 33/103 kB Progress (2): 31/189 kB | 49/103 kB Progress (2): 48/189 kB | 49/103 kB Progress (2): 64/189 kB | 49/103 kB Progress (2): 64/189 kB | 66/103 kB Progress (2): 64/189 kB | 82/103 kB Progress (2): 78/189 kB | 82/103 kB Progress (2): 78/189 kB | 98/103 kB Progress (2): 94/189 kB | 98/103 kB Progress (2): 94/189 kB | 103 kB Progress (2): 111/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-12T17:45:00.448 INFO:tasks.workunit.client.0.smithi107.stdout:Progress (1): 127/189 kB Progress (1): 143/189 kB Progress (1): 160/189 kB Progress (1): 176/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.1 MB/s) 2024-09-12T17:45:00.461 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:45:00.461 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:45:00.461 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] T E S T S 2024-09-12T17:45:00.461 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:45:00.882 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T17:45:00.920 INFO:tasks.workunit.client.0.smithi107.stdout:PutObjects.java: starting test run: 2024-09-12T17:45:00.920 INFO:tasks.workunit.client.0.smithi107.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:45:00.920 INFO:tasks.workunit.client.0.smithi107.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:45:00.920 INFO:tasks.workunit.client.0.smithi107.stdout: EndpointUrl=http://smithi107.front.sepia.ceph.com:80 2024-09-12T17:45:01.018 INFO:tasks.workunit.client.0.smithi107.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T17:45:01.118 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: Environment Variables Read 2024-09-12T17:45:01.419 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: S3 Client Initialized 2024-09-12T17:45:01.419 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: Generating File 2024-09-12T17:45:01.419 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: File Generated 2024-09-12T17:45:01.420 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: Generating File 2024-09-12T17:45:01.420 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: File Generated 2024-09-12T17:45:01.420 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: Generating File 2024-09-12T17:45:01.420 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: File Generated 2024-09-12T17:45:01.420 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: Generating File 2024-09-12T17:45:01.420 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: File Generated 2024-09-12T17:45:01.420 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: Generating File 2024-09-12T17:45:01.420 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: File Generated 2024-09-12T17:45:01.420 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: Generating File 2024-09-12T17:45:01.420 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: File Generated 2024-09-12T17:45:01.420 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: Generated Big Files 2024-09-12T17:45:01.574 INFO:tasks.workunit.client.0.smithi107.stdout:HeadBucketResponse() 2024-09-12T17:45:01.574 INFO:tasks.workunit.client.0.smithi107.stdout:sheik is ready 2024-09-12T17:45:01.575 INFO:tasks.workunit.client.0.smithi107.stdout:DEBUG: Test Bucket Created 2024-09-12T17:45:01.619 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T17:45:01.719 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T17:45:01.819 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T17:45:01.851 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T17:45:01.909 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T17:45:01.919 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T17:45:02.026 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T17:45:02.081 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T17:45:02.119 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T17:45:02.220 INFO:tasks.workunit.client.0.smithi107.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T17:45:04.224 INFO:tasks.workunit.client.0.smithi107.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T17:45:04.724 INFO:tasks.workunit.client.0.smithi107.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T17:45:08.464 INFO:tasks.workunit.client.0.smithi107.stdout:arg: file-0b 2024-09-12T17:45:08.465 INFO:tasks.workunit.client.0.smithi107.stdout:arg: file-8b 2024-09-12T17:45:08.466 INFO:tasks.workunit.client.0.smithi107.stdout:arg: file-200b 2024-09-12T17:45:08.466 INFO:tasks.workunit.client.0.smithi107.stdout:arg: file-21983b 2024-09-12T17:45:08.468 INFO:tasks.workunit.client.0.smithi107.stdout:arg: file-5519b 2024-09-12T17:45:08.468 INFO:tasks.workunit.client.0.smithi107.stdout:arg: file-204329b 2024-09-12T17:45:08.469 INFO:tasks.workunit.client.0.smithi107.stdout:arg: file-256k 2024-09-12T17:45:08.470 INFO:tasks.workunit.client.0.smithi107.stdout:arg: file-1m 2024-09-12T17:45:08.471 INFO:tasks.workunit.client.0.smithi107.stdout:arg: file-1038757b 2024-09-12T17:45:08.503 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T17:45:08.503 INFO:tasks.workunit.client.0.smithi107.stdout:PutObjectResponse 2024-09-12T17:45:08.530 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T17:45:08.530 INFO:tasks.workunit.client.0.smithi107.stdout:PutObjectResponse 2024-09-12T17:45:08.612 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T17:45:08.612 INFO:tasks.workunit.client.0.smithi107.stdout:PutObjectResponse 2024-09-12T17:45:08.630 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T17:45:08.630 INFO:tasks.workunit.client.0.smithi107.stdout:PutObjectResponse 2024-09-12T17:45:08.726 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T17:45:08.726 INFO:tasks.workunit.client.0.smithi107.stdout:PutObjectResponse 2024-09-12T17:45:08.730 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T17:45:08.751 INFO:tasks.workunit.client.0.smithi107.stdout:PutObjectResponse 2024-09-12T17:45:08.775 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T17:45:08.775 INFO:tasks.workunit.client.0.smithi107.stdout:PutObjectResponse 2024-09-12T17:45:08.815 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T17:45:08.815 INFO:tasks.workunit.client.0.smithi107.stdout:PutObjectResponse 2024-09-12T17:45:08.830 INFO:tasks.workunit.client.0.smithi107.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T17:45:08.854 INFO:tasks.workunit.client.0.smithi107.stdout:PutObjectResponse 2024-09-12T17:45:08.930 INFO:tasks.workunit.client.0.smithi107.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T17:45:09.131 INFO:tasks.workunit.client.0.smithi107.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T17:45:09.431 INFO:tasks.workunit.client.0.smithi107.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T17:45:11.784 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.90 s -- in io.ceph.jcksum.PutObjects 2024-09-12T17:45:11.794 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:45:11.794 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Results: 2024-09-12T17:45:11.794 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:45:11.794 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T17:45:11.794 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] 2024-09-12T17:45:11.796 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:45:11.796 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:45:11.796 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:45:11.798 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Total time: 12.722 s 2024-09-12T17:45:11.798 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] Finished at: 2024-09-12T17:45:11Z 2024-09-12T17:45:11.798 INFO:tasks.workunit.client.0.smithi107.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:45:11.810 INFO:tasks.workunit.client.0.smithi107.stderr:+ exit 2024-09-12T17:45:11.811 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:45:11.811 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:45:11.939 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T17:45:11.939 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:45:12.253 DEBUG:teuthology.parallel:result is None 2024-09-12T17:45:12.254 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:45:12.291 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:45:12.292 DEBUG:teuthology.orchestra.run.smithi107:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:45:12.360 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:45:12.361 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:45:12.373 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:45:12.374 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:45:12.374 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:45:12.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:45:12.429 INFO:teuthology.orchestra.run.smithi107.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:45:12.430 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:45:12.498 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:45:12.499 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:45:12.567 INFO:tasks.workunit:timeout=3h 2024-09-12T17:45:12.567 INFO:tasks.workunit:cleanup=True 2024-09-12T17:45:12.567 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:45:12.636 INFO:tasks.workunit.client.0.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:46:13.575 INFO:tasks.workunit.client.0.smithi107.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:46:13.576 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:46:13.576 INFO:tasks.workunit.client.0.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:46:13.576 INFO:tasks.workunit.client.0.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:46:13.576 INFO:tasks.workunit.client.0.smithi107.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:46:13.577 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:46:13.577 INFO:tasks.workunit.client.0.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:46:13.577 INFO:tasks.workunit.client.0.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:46:13.577 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:46:13.577 INFO:tasks.workunit.client.0.smithi107.stderr: git switch -c 2024-09-12T17:46:13.577 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:46:13.577 INFO:tasks.workunit.client.0.smithi107.stderr:Or undo this operation with: 2024-09-12T17:46:13.577 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:46:13.578 INFO:tasks.workunit.client.0.smithi107.stderr: git switch - 2024-09-12T17:46:13.578 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:46:13.578 INFO:tasks.workunit.client.0.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:46:13.578 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:46:13.578 INFO:tasks.workunit.client.0.smithi107.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:46:13.581 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:46:13.648 INFO:tasks.workunit.client.0.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:46:13.650 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:46:13.650 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:46:13.698 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:46:13.746 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:46:13.785 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:46:13.786 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:46:13.787 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:46:13.825 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:46:13.828 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:46:13.828 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:46:13.898 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T17:46:13.899 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T17:46:13.900 DEBUG:teuthology.orchestra.run.smithi107:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T17:46:13.973 INFO:tasks.workunit.client.0.smithi107.stdout:INFO: fully qualified domain name: smithi107.front.sepia.ceph.com 2024-09-12T17:46:13.974 INFO:tasks.workunit.client.0.smithi107.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T17:46:13.974 INFO:tasks.workunit.client.0.smithi107.stdout:== TESTING VERSIONED BUCKET == 2024-09-12T17:46:16.503 INFO:tasks.workunit.client.0.smithi107.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:46:16.687 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting pip 2024-09-12T17:46:16.692 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:46:16.736 INFO:tasks.workunit.client.0.smithi107.stdout:Installing collected packages: pip 2024-09-12T17:46:16.736 INFO:tasks.workunit.client.0.smithi107.stdout: Attempting uninstall: pip 2024-09-12T17:46:16.736 INFO:tasks.workunit.client.0.smithi107.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:46:16.887 INFO:tasks.workunit.client.0.smithi107.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:46:16.891 INFO:tasks.workunit.client.0.smithi107.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:46:17.630 INFO:tasks.workunit.client.0.smithi107.stdout:Successfully installed pip-24.2 2024-09-12T17:46:18.435 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting boto3 2024-09-12T17:46:18.437 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:46:18.969 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:46:18.970 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:46:19.016 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:46:19.017 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:46:19.063 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:46:19.064 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:46:19.113 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:46:19.114 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:46:19.190 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:46:19.191 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:46:19.335 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:46:19.337 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:46:19.341 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:46:19.342 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:46:19.352 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:46:19.353 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:46:19.355 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:46:19.356 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:46:19.357 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:46:19.430 INFO:tasks.workunit.client.0.smithi107.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:46:20.449 INFO:tasks.workunit.client.0.smithi107.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:46:20.881 INFO:tasks.workunit.client.0.smithi107.stdout:INFO: creating user 2024-09-12T17:46:21.802 INFO:tasks.workunit.client.0.smithi107.stdout:{ 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: "user_id": "testid", 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: "display_name": "M. Tester", 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: "email": "tester@ceph.com", 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: "suspended": 0, 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: "subusers": [], 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: "keys": [ 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: { 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: "user": "testid", 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: "active": true, 2024-09-12T17:46:21.803 INFO:tasks.workunit.client.0.smithi107.stdout: "create_date": "2024-09-12T17:46:21.795850Z" 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: } 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: ], 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: "swift_keys": [], 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: "caps": [], 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: "default_placement": "", 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: "placement_tags": [], 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: "bucket_quota": { 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: "enabled": false, 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: "max_size": -1, 2024-09-12T17:46:21.804 INFO:tasks.workunit.client.0.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: "max_objects": -1 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: "user_quota": { 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: "enabled": false, 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: "max_size": -1, 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: "max_objects": -1 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: }, 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: "type": "rgw", 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: "mfa_ids": [], 2024-09-12T17:46:21.805 INFO:tasks.workunit.client.0.smithi107.stdout: "account_id": "", 2024-09-12T17:46:21.806 INFO:tasks.workunit.client.0.smithi107.stdout: "path": "/", 2024-09-12T17:46:21.806 INFO:tasks.workunit.client.0.smithi107.stdout: "create_date": "2024-09-12T17:46:21.795840Z", 2024-09-12T17:46:21.806 INFO:tasks.workunit.client.0.smithi107.stdout: "tags": [], 2024-09-12T17:46:21.806 INFO:tasks.workunit.client.0.smithi107.stdout: "group_ids": [] 2024-09-12T17:46:21.806 INFO:tasks.workunit.client.0.smithi107.stdout:} 2024-09-12T17:46:21.806 INFO:tasks.workunit.client.0.smithi107.stdout: 2024-09-12T17:46:22.057 INFO:tasks.workunit.client.0.smithi107.stderr:5+0 records in 2024-09-12T17:46:22.058 INFO:tasks.workunit.client.0.smithi107.stderr:5+0 records out 2024-09-12T17:46:22.058 INFO:tasks.workunit.client.0.smithi107.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0146731 s, 357 MB/s 2024-09-12T17:46:23.172 INFO:tasks.workunit.client.0.smithi107.stdout:bucket nams is reupload-bkt-105451 2024-09-12T17:46:23.172 INFO:tasks.workunit.client.0.smithi107.stdout:endpoint is http://smithi107.front.sepia.ceph.com:80 2024-09-12T17:46:23.172 INFO:tasks.workunit.client.0.smithi107.stdout:start UploadId=2~rSCtwhQ5fXFxxQjSUnZUvOslrh_gO5Y 2024-09-12T17:46:23.172 INFO:tasks.workunit.client.0.smithi107.stdout:phase 1 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1} 2024-09-12T17:46:23.172 INFO:tasks.workunit.client.0.smithi107.stdout:phase 1 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 2} 2024-09-12T17:46:23.172 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1} 2024-09-12T17:46:23.173 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1} 2024-09-12T17:46:23.173 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1} 2024-09-12T17:46:23.173 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1} 2024-09-12T17:46:23.173 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1} 2024-09-12T17:46:23.173 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1} 2024-09-12T17:46:23.173 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1} 2024-09-12T17:46:23.173 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1} 2024-09-12T17:46:23.173 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1} 2024-09-12T17:46:23.173 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1} 2024-09-12T17:46:23.173 INFO:tasks.workunit.client.0.smithi107.stdout:phase 2 uploaded part {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1} 2024-09-12T17:46:23.173 INFO:tasks.workunit.client.0.smithi107.stdout:completing multipart upload, parts=[{'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 1}, {'ETag': '"c68653314c92b4974a4225af484d8d48"', 'PartNumber': 2}] 2024-09-12T17:46:24.742 INFO:tasks.workunit.client.0.smithi107.stdout:radosgw-admin bucket radoslist: 2024-09-12T17:46:24.743 INFO:tasks.workunit.client.0.smithi107.stdout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.4__:id3WblgNlfwvG5dBT386nYtIqf.C8GM_mpu_test4 2024-09-12T17:46:24.743 INFO:tasks.workunit.client.0.smithi107.stdout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.4_mpu_test4 2024-09-12T17:46:24.743 INFO:tasks.workunit.client.0.smithi107.stdout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.4__multipart_mpu_test4.2~rSCtwhQ5fXFxxQjSUnZUvOslrh_gO5Y.2 2024-09-12T17:46:24.743 INFO:tasks.workunit.client.0.smithi107.stdout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.4__multipart_mpu_test4.s-l1-zrXquNNLrTh7SU6Jp6OqNKxOoKJ.1 2024-09-12T17:46:24.802 INFO:tasks.workunit.client.0.smithi107.stdout:rados ls: 2024-09-12T17:46:24.802 INFO:tasks.workunit.client.0.smithi107.stdout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.4__:id3WblgNlfwvG5dBT386nYtIqf.C8GM_mpu_test4 2024-09-12T17:46:24.802 INFO:tasks.workunit.client.0.smithi107.stdout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.4_mpu_test4 2024-09-12T17:46:24.802 INFO:tasks.workunit.client.0.smithi107.stdout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.4__multipart_mpu_test4.2~rSCtwhQ5fXFxxQjSUnZUvOslrh_gO5Y.2 2024-09-12T17:46:24.802 INFO:tasks.workunit.client.0.smithi107.stdout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.4__multipart_mpu_test4.s-l1-zrXquNNLrTh7SU6Jp6OqNKxOoKJ.1 2024-09-12T17:46:24.806 INFO:tasks.workunit.client.0.smithi107.stdout:== PASSED == 2024-09-12T17:46:24.806 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:46:24.806 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:46:24.885 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T17:46:24.885 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:46:25.276 DEBUG:teuthology.parallel:result is None 2024-09-12T17:46:25.277 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:46:25.316 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:46:25.316 DEBUG:teuthology.orchestra.run.smithi107:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:46:25.385 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:46:25.385 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T17:46:25.401 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T17:46:25.402 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T17:46:25.402 INFO:tasks.ragweed:Using branch 'wip-rgw-meta-handlers' for ragweed 2024-09-12T17:46:25.402 DEBUG:teuthology.orchestra.run.smithi107:> git clone -b wip-rgw-meta-handlers https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:46:25.454 INFO:teuthology.orchestra.run.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:46:25.482 INFO:teuthology.orchestra.run.smithi107.stderr:fatal: Remote branch wip-rgw-meta-handlers not found in upstream origin 2024-09-12T17:46:25.482 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-12T17:46:25.483 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-12T17:46:25.484 DEBUG:teuthology.orchestra.run.smithi107:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:46:25.553 INFO:teuthology.orchestra.run.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:46:25.734 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T17:46:25.734 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T17:46:25.735 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key AEWABAFFNVXAKJVARPCT --secret kfW5s7SafPLp6YUKbgsoU3e88MnyiKBoln2A6VTXbyTzcbl7er+8WQ== --email ragweed.client.0+test@test.test --system false 2024-09-12T17:46:25.840 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:25.840 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.873+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.874+0000 7f898ce0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.874+0000 7f898ce0e800 20 realm 2024-09-12T17:46:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.874+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.874+0000 7f898ce0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.874+0000 7f898ce0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.874+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.875+0000 7f898ce0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.875+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.875+0000 7f898ce0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:25.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.875+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.876+0000 7f898ce0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:25.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.876+0000 7f898ce0e800 20 searching for the correct realm 2024-09-12T17:46:25.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.878+0000 7f8987d6a640 0 -- 172.21.15.107:0/1244007608 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x55ac1dae6cb0 msgr2=0x55ac1dae90c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:25.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.882+0000 7f8987d6a640 0 -- 172.21.15.107:0/1244007608 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x7f8850084fa0 msgr2=0x7f88500873d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:25.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.887+0000 7f898ce0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:25.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.887+0000 7f898ce0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:25.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.887+0000 7f898ce0e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:46:25.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.887+0000 7f898ce0e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:46:25.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.887+0000 7f898ce0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:25.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.887+0000 7f898ce0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:25.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.887+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:25.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:25.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:25.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 20 zone default found 2024-09-12T17:46:25.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 4 Realm: () 2024-09-12T17:46:25.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:46:25.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:46:25.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:25.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 20 zonegroup default 2024-09-12T17:46:25.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:25.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.888+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.889+0000 7f898ce0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:25.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.889+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.889+0000 7f898ce0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:25.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.889+0000 7f898ce0e800 20 started sync module instance, tier type = 2024-09-12T17:46:25.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.889+0000 7f898ce0e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:46:25.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.898+0000 7f898ce0e800 20 add_watcher() i=0 2024-09-12T17:46:25.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.898+0000 7f898ce0e800 20 add_watcher() i=1 2024-09-12T17:46:25.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.898+0000 7f898ce0e800 20 add_watcher() i=2 2024-09-12T17:46:25.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.898+0000 7f898ce0e800 20 add_watcher() i=3 2024-09-12T17:46:25.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.898+0000 7f898ce0e800 20 add_watcher() i=4 2024-09-12T17:46:25.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.898+0000 7f898ce0e800 20 add_watcher() i=5 2024-09-12T17:46:25.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.898+0000 7f898ce0e800 20 add_watcher() i=6 2024-09-12T17:46:25.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.899+0000 7f898ce0e800 20 add_watcher() i=7 2024-09-12T17:46:25.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.899+0000 7f898ce0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:25.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.901+0000 7f883e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:25.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.901+0000 7f898ce0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:25.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.901+0000 7f898ce0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:25.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.901+0000 7f898ce0e800 5 note: GC not initialized 2024-09-12T17:46:25.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.901+0000 7f883d7e2640 20 reqs_thread_entry: start 2024-09-12T17:46:25.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.901+0000 7f898ce0e800 20 init_complete bucket index max shards: 1 2024-09-12T17:46:25.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.901+0000 7f898ce0e800 20 Filter name: none 2024-09-12T17:46:25.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f87aeffd640 20 reqs_thread_entry: start 2024-09-12T17:46:25.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f898ce0e800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:46:25.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f898ce0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:25.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f898ce0e800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T17:46:25.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f898ce0e800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:46:25.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f898ce0e800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T17:46:25.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f898ce0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:25.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f898ce0e800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T17:46:25.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f898ce0e800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:46:25.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f898ce0e800 10 cache get: name=default.rgw.meta+users.keys+AEWABAFFNVXAKJVARPCT : miss 2024-09-12T17:46:25.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.902+0000 7f898ce0e800 20 rados->read ofs=0 len=0 2024-09-12T17:46:25.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.903+0000 7f898ce0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:25.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.903+0000 7f898ce0e800 10 cache put: name=default.rgw.meta+users.keys+AEWABAFFNVXAKJVARPCT info.flags=0x0 2024-09-12T17:46:25.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.903+0000 7f898ce0e800 10 adding default.rgw.meta+users.keys+AEWABAFFNVXAKJVARPCT to cache LRU end 2024-09-12T17:46:25.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.903+0000 7f898ce0e800 10 cache get: name=default.rgw.meta+users.keys+AEWABAFFNVXAKJVARPCT : hit (negative entry) 2024-09-12T17:46:25.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.903+0000 7f898ce0e800 10 cache get: name=default.rgw.meta+users.keys+AEWABAFFNVXAKJVARPCT : hit (negative entry) 2024-09-12T17:46:25.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.904+0000 7f898ce0e800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:46:25.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.904+0000 7f898ce0e800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:46:25.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.904+0000 7f898ce0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:46:25.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.905+0000 7f885f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725912 cookie 94197720750192 notifier 5874 bl.length()=675 2024-09-12T17:46:25.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.905+0000 7f885f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:46:25.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.905+0000 7f885f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:46:25.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.906+0000 7f898ce0e800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:46:25.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.906+0000 7f898ce0e800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:46:25.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.906+0000 7f898ce0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:46:25.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.907+0000 7f885f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725903 cookie 94197720743472 notifier 5874 bl.length()=202 2024-09-12T17:46:25.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.907+0000 7f885f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:46:25.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.907+0000 7f885f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:46:25.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.908+0000 7f898ce0e800 10 cache put: name=default.rgw.meta+users.keys+AEWABAFFNVXAKJVARPCT info.flags=0x7 2024-09-12T17:46:25.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.908+0000 7f898ce0e800 10 moving default.rgw.meta+users.keys+AEWABAFFNVXAKJVARPCT to cache LRU end 2024-09-12T17:46:25.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.908+0000 7f898ce0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:AEWABAFFNVXAKJVARPCT, ofs0, ns] 2024-09-12T17:46:25.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.909+0000 7f885f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725904 cookie 94197720743472 notifier 5874 bl.length()=190 2024-09-12T17:46:25.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.909+0000 7f885f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+AEWABAFFNVXAKJVARPCT info.flags=0x7 2024-09-12T17:46:25.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.909+0000 7f885f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+AEWABAFFNVXAKJVARPCT to cache LRU end 2024-09-12T17:46:25.910 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:46:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "user_id": "ragweed.client.0", 2024-09-12T17:46:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T17:46:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T17:46:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "suspended": 0, 2024-09-12T17:46:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "subusers": [], 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "keys": [ 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "user": "ragweed.client.0", 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "access_key": "AEWABAFFNVXAKJVARPCT", 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "secret_key": "kfW5s7SafPLp6YUKbgsoU3e88MnyiKBoln2A6VTXbyTzcbl7er+8WQ==", 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "active": true, 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:46:25.904155Z" 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "swift_keys": [], 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": [], 2024-09-12T17:46:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "default_placement": "", 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "placement_tags": [], 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "user_quota": { 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:46:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:46:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:46:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:46:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:46:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "rgw", 2024-09-12T17:46:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "mfa_ids": [], 2024-09-12T17:46:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "account_id": "", 2024-09-12T17:46:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2024-09-12T17:46:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:46:25.904144Z", 2024-09-12T17:46:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-09-12T17:46:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "group_ids": [] 2024-09-12T17:46:25.913 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:46:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:46:25.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.910+0000 7f883e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:25.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.912+0000 7f898ce0e800 20 remove_watcher() i=0 2024-09-12T17:46:25.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.912+0000 7f898ce0e800 2 removed watcher, disabling cache 2024-09-12T17:46:25.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.913+0000 7f898ce0e800 20 remove_watcher() i=1 2024-09-12T17:46:25.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.914+0000 7f898ce0e800 20 remove_watcher() i=2 2024-09-12T17:46:25.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.915+0000 7f898ce0e800 20 remove_watcher() i=3 2024-09-12T17:46:25.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.916+0000 7f898ce0e800 20 remove_watcher() i=4 2024-09-12T17:46:25.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.917+0000 7f898ce0e800 20 remove_watcher() i=5 2024-09-12T17:46:25.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.918+0000 7f898ce0e800 20 remove_watcher() i=6 2024-09-12T17:46:25.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:25.919+0000 7f898ce0e800 20 remove_watcher() i=7 2024-09-12T17:46:25.931 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T17:46:25.932 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key KSMQNZEOORRMAQBLYQRF --secret EB+EJyiO4E8j+G3svRlajouRUpnPJIkbUaQVp0D+9+2XHi/zstO3jw== --email sysuser.client.0+test@test.test --system true 2024-09-12T17:46:25.996 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:25.996 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:26.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.227+0000 7f27d842f640 0 --2- 172.21.15.107:0/3222560413 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55685a44e280 0x55685a44e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:46:26.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.231+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.232+0000 7f27e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:26.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.232+0000 7f27e3146800 20 realm 2024-09-12T17:46:26.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.232+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.233+0000 7f27e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:26.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.233+0000 7f27e3146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:26.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.233+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.233+0000 7f27e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:26.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.233+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.234+0000 7f27e3146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:26.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.234+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.235+0000 7f27e3146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:26.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.235+0000 7f27e3146800 20 searching for the correct realm 2024-09-12T17:46:26.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.237+0000 7f27d842f640 0 -- 172.21.15.107:0/2341960805 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f27c8082290 msgr2=0x7f27c805f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:26.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.442+0000 7f27e0c30640 0 -- 172.21.15.107:0/2341960805 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f27c805ed40 msgr2=0x7f27c8086740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:26.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.649+0000 7f27e3146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:26.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.649+0000 7f27e3146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:26.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.649+0000 7f27e3146800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:46:26.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.649+0000 7f27e3146800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:46:26.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.649+0000 7f27e3146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:26.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.649+0000 7f27e3146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:26.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.649+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.649+0000 7f27e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.649+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.650+0000 7f27e3146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.650+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.650+0000 7f27e3146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.650+0000 7f27e3146800 20 zone default found 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.650+0000 7f27e3146800 4 Realm: () 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.650+0000 7f27e3146800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.650+0000 7f27e3146800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.650+0000 7f27e3146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.650+0000 7f27e3146800 20 zonegroup default 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.650+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.651+0000 7f27e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.651+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.651+0000 7f27e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:26.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.651+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.651+0000 7f27e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:26.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.651+0000 7f27e3146800 20 started sync module instance, tier type = 2024-09-12T17:46:26.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.651+0000 7f27e3146800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:46:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.661+0000 7f27e3146800 20 add_watcher() i=0 2024-09-12T17:46:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.661+0000 7f27e3146800 20 add_watcher() i=1 2024-09-12T17:46:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.661+0000 7f27e3146800 20 add_watcher() i=2 2024-09-12T17:46:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.661+0000 7f27e3146800 20 add_watcher() i=3 2024-09-12T17:46:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.661+0000 7f27e3146800 20 add_watcher() i=4 2024-09-12T17:46:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.661+0000 7f27e3146800 20 add_watcher() i=5 2024-09-12T17:46:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.661+0000 7f27e3146800 20 add_watcher() i=6 2024-09-12T17:46:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.662+0000 7f27e3146800 20 add_watcher() i=7 2024-09-12T17:46:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.662+0000 7f27e3146800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:26.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.664+0000 7f26977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:26.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.664+0000 7f27e3146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:26.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.664+0000 7f27e3146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:26.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.664+0000 7f27e3146800 5 note: GC not initialized 2024-09-12T17:46:26.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.664+0000 7f26967e4640 20 reqs_thread_entry: start 2024-09-12T17:46:26.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.664+0000 7f27e3146800 20 init_complete bucket index max shards: 1 2024-09-12T17:46:26.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 20 Filter name: none 2024-09-12T17:46:26.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f268ffff640 20 reqs_thread_entry: start 2024-09-12T17:46:26.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:46:26.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T17:46:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:46:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T17:46:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T17:46:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:46:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 10 cache get: name=default.rgw.meta+users.keys+KSMQNZEOORRMAQBLYQRF : miss 2024-09-12T17:46:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.665+0000 7f27e3146800 20 rados->read ofs=0 len=0 2024-09-12T17:46:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.666+0000 7f27e3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.666+0000 7f27e3146800 10 cache put: name=default.rgw.meta+users.keys+KSMQNZEOORRMAQBLYQRF info.flags=0x0 2024-09-12T17:46:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.666+0000 7f27e3146800 10 adding default.rgw.meta+users.keys+KSMQNZEOORRMAQBLYQRF to cache LRU end 2024-09-12T17:46:26.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.666+0000 7f27e3146800 10 cache get: name=default.rgw.meta+users.keys+KSMQNZEOORRMAQBLYQRF : hit (negative entry) 2024-09-12T17:46:26.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.666+0000 7f27e3146800 10 cache get: name=default.rgw.meta+users.keys+KSMQNZEOORRMAQBLYQRF : hit (negative entry) 2024-09-12T17:46:26.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.667+0000 7f27e3146800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:46:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.667+0000 7f27e3146800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:46:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.667+0000 7f27e3146800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:46:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.667+0000 7f26b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725905 cookie 93906679604464 notifier 5892 bl.length()=675 2024-09-12T17:46:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.667+0000 7f26b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:46:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.667+0000 7f26b7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:46:26.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.669+0000 7f27e3146800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:46:26.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.669+0000 7f27e3146800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:46:26.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.669+0000 7f27e3146800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:46:26.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.669+0000 7f26b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725913 cookie 93906679609856 notifier 5892 bl.length()=202 2024-09-12T17:46:26.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.669+0000 7f26b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:46:26.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.669+0000 7f26b77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:46:26.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.671+0000 7f27e3146800 10 cache put: name=default.rgw.meta+users.keys+KSMQNZEOORRMAQBLYQRF info.flags=0x7 2024-09-12T17:46:26.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.671+0000 7f27e3146800 10 moving default.rgw.meta+users.keys+KSMQNZEOORRMAQBLYQRF to cache LRU end 2024-09-12T17:46:26.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.671+0000 7f27e3146800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:KSMQNZEOORRMAQBLYQRF, ofs0, ns] 2024-09-12T17:46:26.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.671+0000 7f26b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725906 cookie 93906679604464 notifier 5892 bl.length()=190 2024-09-12T17:46:26.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.671+0000 7f26b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KSMQNZEOORRMAQBLYQRF info.flags=0x7 2024-09-12T17:46:26.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.671+0000 7f26b7fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KSMQNZEOORRMAQBLYQRF to cache LRU end 2024-09-12T17:46:26.673 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:46:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: "user_id": "sysuser.client.0", 2024-09-12T17:46:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T17:46:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T17:46:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: "suspended": 0, 2024-09-12T17:46:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:46:26.673 INFO:teuthology.orchestra.run.smithi107.stdout: "subusers": [], 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "keys": [ 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "user": "sysuser.client.0", 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "access_key": "KSMQNZEOORRMAQBLYQRF", 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "secret_key": "EB+EJyiO4E8j+G3svRlajouRUpnPJIkbUaQVp0D+9+2XHi/zstO3jw==", 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "active": true, 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:46:26.667213Z" 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "swift_keys": [], 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": [], 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "system": true, 2024-09-12T17:46:26.674 INFO:teuthology.orchestra.run.smithi107.stdout: "default_placement": "", 2024-09-12T17:46:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:46:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "placement_tags": [], 2024-09-12T17:46:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:46:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:46:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:46:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:46:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:46:26.675 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "user_quota": { 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "rgw", 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "mfa_ids": [], 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "account_id": "", 2024-09-12T17:46:26.676 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2024-09-12T17:46:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:46:26.667199Z", 2024-09-12T17:46:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-09-12T17:46:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: "group_ids": [] 2024-09-12T17:46:26.677 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:46:26.677 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:46:26.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.672+0000 7f26977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:26.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.675+0000 7f27e3146800 20 remove_watcher() i=0 2024-09-12T17:46:26.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.675+0000 7f27e3146800 2 removed watcher, disabling cache 2024-09-12T17:46:26.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.676+0000 7f27e3146800 20 remove_watcher() i=1 2024-09-12T17:46:26.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.677+0000 7f27e3146800 20 remove_watcher() i=2 2024-09-12T17:46:26.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.678+0000 7f27e3146800 20 remove_watcher() i=3 2024-09-12T17:46:26.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.679+0000 7f27e3146800 20 remove_watcher() i=4 2024-09-12T17:46:26.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.680+0000 7f27e3146800 20 remove_watcher() i=5 2024-09-12T17:46:26.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.681+0000 7f27e3146800 20 remove_watcher() i=6 2024-09-12T17:46:26.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:26.682+0000 7f27e3146800 20 remove_watcher() i=7 2024-09-12T17:46:26.694 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T17:46:26.695 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:46:26.695 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T17:46:26.723 INFO:tasks.ragweed:Configuring boto... 2024-09-12T17:46:26.724 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:46:26.724 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T17:46:26.793 DEBUG:teuthology.orchestra.run.smithi107:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T17:46:27.140 INFO:teuthology.orchestra.run.smithi107.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T17:46:27.305 INFO:teuthology.orchestra.run.smithi107.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T17:46:27.852 INFO:teuthology.orchestra.run.smithi107.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:46:34.011 INFO:teuthology.orchestra.run.smithi107.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T17:46:37.350 INFO:teuthology.orchestra.run.smithi107.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=fdb8bb3cbba5a848735ba0a3c3734670543b7e2dcdc29b760f44c1ccef5a6bf7,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:46:37.350 INFO:teuthology.orchestra.run.smithi107.stdout:py run-test-pre: PYTHONHASHSEED='2665305492' 2024-09-12T17:46:37.351 INFO:teuthology.orchestra.run.smithi107.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T17:46:37.566 INFO:teuthology.orchestra.run.smithi107.stdout:============================= test session starts ============================== 2024-09-12T17:46:37.566 INFO:teuthology.orchestra.run.smithi107.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T17:46:37.566 INFO:teuthology.orchestra.run.smithi107.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:46:37.566 INFO:teuthology.orchestra.run.smithi107.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:46:37.566 INFO:teuthology.orchestra.run.smithi107.stdout:configfile: pytest.ini 2024-09-12T17:46:37.659 INFO:teuthology.orchestra.run.smithi107.stdout:collecting ... collected 9 items 2024-09-12T17:46:37.660 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:46:38.110 INFO:teuthology.orchestra.run.smithi107.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T17:46:38.596 INFO:teuthology.orchestra.run.smithi107.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T17:46:39.092 INFO:teuthology.orchestra.run.smithi107.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T17:46:39.615 INFO:teuthology.orchestra.run.smithi107.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T17:46:40.187 INFO:teuthology.orchestra.run.smithi107.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T17:46:46.587 INFO:teuthology.orchestra.run.smithi107.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T17:46:47.808 INFO:teuthology.orchestra.run.smithi107.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T17:46:48.927 INFO:teuthology.orchestra.run.smithi107.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T17:46:51.078 INFO:teuthology.orchestra.run.smithi107.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T17:46:51.079 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:46:51.079 INFO:teuthology.orchestra.run.smithi107.stdout:=============================== warnings summary =============================== 2024-09-12T17:46:51.079 INFO:teuthology.orchestra.run.smithi107.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T17:46:51.079 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T17:46:51.079 INFO:teuthology.orchestra.run.smithi107.stdout: import imp 2024-09-12T17:46:51.079 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:46:51.079 INFO:teuthology.orchestra.run.smithi107.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T17:46:51.079 INFO:teuthology.orchestra.run.smithi107.stdout:======================== 9 passed, 1 warning in 13.51s ========================= 2024-09-12T17:46:51.109 INFO:teuthology.orchestra.run.smithi107.stdout:___________________________________ summary ____________________________________ 2024-09-12T17:46:51.109 INFO:teuthology.orchestra.run.smithi107.stdout: py: commands succeeded 2024-09-12T17:46:51.109 INFO:teuthology.orchestra.run.smithi107.stdout: congratulations :) 2024-09-12T17:46:51.127 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T17:46:51.127 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T17:46:51.157 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T17:46:51.254 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:51.254 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:51.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.286+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.287+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.287+0000 7f74bbb39800 20 realm 2024-09-12T17:46:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.287+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.288+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.288+0000 7f74bbb39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.288+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.288+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.288+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.289+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:51.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.289+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.289+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:51.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.289+0000 7f74bbb39800 20 searching for the correct realm 2024-09-12T17:46:51.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.292+0000 7f74affff640 0 -- 172.21.15.107:0/3151316432 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f74a006e070 msgr2=0x7f74a0068df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:51.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.296+0000 7f74b77c7640 0 -- 172.21.15.107:0/3151316432 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f74a0072e70 msgr2=0x7f74a0080900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:51.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.502+0000 7f74bbb39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:51.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.502+0000 7f74bbb39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.502+0000 7f74bbb39800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.502+0000 7f74bbb39800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.502+0000 7f74bbb39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.502+0000 7f74bbb39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.502+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 20 zone default found 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 4 Realm: () 2024-09-12T17:46:51.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:46:51.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:46:51.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:51.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 20 zonegroup default 2024-09-12T17:46:51.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.503+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.504+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.504+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.504+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.504+0000 7f74bbb39800 20 started sync module instance, tier type = 2024-09-12T17:46:51.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.504+0000 7f74bbb39800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:46:51.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.513+0000 7f74bbb39800 20 add_watcher() i=0 2024-09-12T17:46:51.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.513+0000 7f74bbb39800 20 add_watcher() i=1 2024-09-12T17:46:51.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.513+0000 7f74bbb39800 20 add_watcher() i=2 2024-09-12T17:46:51.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.513+0000 7f74bbb39800 20 add_watcher() i=3 2024-09-12T17:46:51.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.513+0000 7f74bbb39800 20 add_watcher() i=4 2024-09-12T17:46:51.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.513+0000 7f74bbb39800 20 add_watcher() i=5 2024-09-12T17:46:51.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.513+0000 7f74bbb39800 20 add_watcher() i=6 2024-09-12T17:46:51.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.514+0000 7f74bbb39800 20 add_watcher() i=7 2024-09-12T17:46:51.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.514+0000 7f74bbb39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:51.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.516+0000 7f736dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:51.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.516+0000 7f74bbb39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:51.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.516+0000 7f74bbb39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:51.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.552+0000 7f736cfe1640 20 reqs_thread_entry: start 2024-09-12T17:46:51.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.552+0000 7f74bbb39800 20 init_complete bucket index max shards: 1 2024-09-12T17:46:51.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.552+0000 7f74bbb39800 20 Filter name: none 2024-09-12T17:46:51.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.552+0000 7f72e67fc640 20 reqs_thread_entry: start 2024-09-12T17:46:51.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.552+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:46:51.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.552+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.553+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:46:51.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.553+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T17:46:51.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.553+0000 7f74bbb39800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:46:51.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.553+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.554+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:35ed0db6-4f54-4e96-b306-71079c84e007.4596.5 : miss 2024-09-12T17:46:51.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.554+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.554+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T17:46:51.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.554+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:35ed0db6-4f54-4e96-b306-71079c84e007.4596.5 info.flags=0x17 2024-09-12T17:46:51.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.554+0000 7f74bbb39800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:35ed0db6-4f54-4e96-b306-71079c84e007.4596.5 to cache LRU end 2024-09-12T17:46:51.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.554+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.554+0000 7f74bbb39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:46:51.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.554+0000 7f74bbb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:35ed0db6-4f54-4e96-b306-71079c84e007.4596.5 2024-09-12T17:46:51.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.555+0000 7f74bbb39800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T17:46:51.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.555+0000 7f74bbb39800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T17:46:51.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.555+0000 7f74bbb39800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T17:46:51.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.555+0000 7f74bbb39800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T17:46:51.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.555+0000 7f74bbb39800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T17:46:51.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.555+0000 7f74bbb39800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T17:46:51.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.555+0000 7f74bbb39800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T17:46:51.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.555+0000 7f74bbb39800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:46:51.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.555+0000 7f74bbb39800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T17:46:51.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.555+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x563cbb9a4638 s->prefetch_data=0 2024-09-12T17:46:51.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.556+0000 7f74bbb39800 10 manifest: total_size = 13069 2024-09-12T17:46:51.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.556+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17563688374071380889 2024-09-12T17:46:51.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.556+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x563cbb9a4638 s->prefetch_data=0 2024-09-12T17:46:51.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.556+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb9a4638 2024-09-12T17:46:51.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.556+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.5.0 2024-09-12T17:46:51.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.558+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x563cbb92f208 s->prefetch_data=0 2024-09-12T17:46:51.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.559+0000 7f74bbb39800 10 manifest: total_size = 7657 2024-09-12T17:46:51.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.559+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.11218039401078032988 2024-09-12T17:46:51.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.559+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x563cbb92f208 s->prefetch_data=0 2024-09-12T17:46:51.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.559+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb92f208 2024-09-12T17:46:51.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.559+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.5.0 2024-09-12T17:46:51.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.561+0000 7f739affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T17:46:51.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.563+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x563cbb92f208 s->prefetch_data=0 2024-09-12T17:46:51.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.563+0000 7f74bbb39800 10 manifest: total_size = 12810 2024-09-12T17:46:51.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.563+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.5607571376840918845 2024-09-12T17:46:51.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.563+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x563cbb92f208 s->prefetch_data=0 2024-09-12T17:46:51.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.563+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb92f208 2024-09-12T17:46:51.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.563+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.5.0 2024-09-12T17:46:51.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.564+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T17:46:51.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.566+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x563cbb92f208 s->prefetch_data=0 2024-09-12T17:46:51.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.566+0000 7f74bbb39800 10 manifest: total_size = 4870 2024-09-12T17:46:51.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.566+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.6700720537644941635 2024-09-12T17:46:51.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.566+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x563cbb92f208 s->prefetch_data=0 2024-09-12T17:46:51.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.566+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb92f208 2024-09-12T17:46:51.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.566+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.5.0 2024-09-12T17:46:51.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.567+0000 7f739affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T17:46:51.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.569+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x563cbb92f208 s->prefetch_data=0 2024-09-12T17:46:51.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.569+0000 7f74bbb39800 10 manifest: total_size = 7534 2024-09-12T17:46:51.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.569+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.12659783132021953276 2024-09-12T17:46:51.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.569+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x563cbb92f208 s->prefetch_data=0 2024-09-12T17:46:51.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.569+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb92f208 2024-09-12T17:46:51.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.569+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.5.0 2024-09-12T17:46:51.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.570+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T17:46:51.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.571+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb92e250 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x563cbb931d88 s->prefetch_data=0 2024-09-12T17:46:51.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.572+0000 7f74bbb39800 10 manifest: total_size = 5254 2024-09-12T17:46:51.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.572+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.12019557085511598022 2024-09-12T17:46:51.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.572+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb92e250 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x563cbb931d88 s->prefetch_data=0 2024-09-12T17:46:51.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.572+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb931d88 2024-09-12T17:46:51.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.572+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.5.0 2024-09-12T17:46:51.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.573+0000 7f739affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T17:46:51.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.574+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb92e250 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x563cbb930d78 s->prefetch_data=0 2024-09-12T17:46:51.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.574+0000 7f74bbb39800 10 manifest: total_size = 14181 2024-09-12T17:46:51.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.574+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.4289335999785256327 2024-09-12T17:46:51.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.574+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb92e250 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x563cbb930d78 s->prefetch_data=0 2024-09-12T17:46:51.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.574+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930d78 2024-09-12T17:46:51.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.574+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.5.0 2024-09-12T17:46:51.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.575+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T17:46:51.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.577+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a8085eb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x563cbb931ff8 s->prefetch_data=0 2024-09-12T17:46:51.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.577+0000 7f74bbb39800 10 manifest: total_size = 15937 2024-09-12T17:46:51.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.577+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.4735046881984617665 2024-09-12T17:46:51.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.577+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a8085eb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x563cbb931ff8 s->prefetch_data=0 2024-09-12T17:46:51.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.577+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb931ff8 2024-09-12T17:46:51.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.577+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.5.0 2024-09-12T17:46:51.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.578+0000 7f739affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T17:46:51.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.579+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb92e3f0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x563cbb931a18 s->prefetch_data=0 2024-09-12T17:46:51.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.580+0000 7f74bbb39800 10 manifest: total_size = 7757 2024-09-12T17:46:51.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.580+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.2965302803153731937 2024-09-12T17:46:51.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.580+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb92e3f0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x563cbb931a18 s->prefetch_data=0 2024-09-12T17:46:51.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.580+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb931a18 2024-09-12T17:46:51.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.580+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.5.0 2024-09-12T17:46:51.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.581+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:46:51.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.583+0000 7f74bbb39800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:46:51.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.583+0000 7f74bbb39800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:46:51.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.584+0000 7f739affd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T17:46:51.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.584+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:46:51.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.584+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:46:51.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.584+0000 7f74bbb39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:46:51.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.584+0000 7f74bbb39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:46:51.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.584+0000 7f74bbb39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[35ed0db6-4f54-4e96-b306-71079c84e007.4596.5])"; uploads.size()=0; is_truncated=0 2024-09-12T17:46:51.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.585+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T17:46:51.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.585+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.586+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T17:46:51.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.586+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T17:46:51.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.586+0000 7f74bbb39800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T17:46:51.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.587+0000 7f74bbb39800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T17:46:51.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.587+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T17:46:51.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.587+0000 7f739a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529697 cookie 94818844697424 notifier 5633 bl.length()=162 2024-09-12T17:46:51.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.589+0000 7f74bbb39800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:35ed0db6-4f54-4e96-b306-71079c84e007.4596.5 from cache 2024-09-12T17:46:51.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.589+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:35ed0db6-4f54-4e96-b306-71079c84e007.4596.5, ofs0, ns] 2024-09-12T17:46:51.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.589+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529698 cookie 94818844697424 notifier 5633 bl.length()=219 2024-09-12T17:46:51.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.590+0000 7f74bbb39800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/35ed0db6-4f54-4e96-b306-71079c84e007.4596.5 : miss 2024-09-12T17:46:51.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.590+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.591+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.591+0000 7f74bbb39800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/35ed0db6-4f54-4e96-b306-71079c84e007.4596.5 info.flags=0x0 2024-09-12T17:46:51.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.591+0000 7f74bbb39800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/35ed0db6-4f54-4e96-b306-71079c84e007.4596.5 to cache LRU end 2024-09-12T17:46:51.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.593+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.12 : miss 2024-09-12T17:46:51.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.593+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.593+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T17:46:51.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.593+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.12 info.flags=0x17 2024-09-12T17:46:51.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.593+0000 7f74bbb39800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.12 to cache LRU end 2024-09-12T17:46:51.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.593+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.593+0000 7f74bbb39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:46:51.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.593+0000 7f74bbb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.12 2024-09-12T17:46:51.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.594+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:46:51.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.594+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a8085eb0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x563cbb928058 s->prefetch_data=0 2024-09-12T17:46:51.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.594+0000 7f74bbb39800 10 manifest: total_size = 886297 2024-09-12T17:46:51.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.594+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.12416093173032359872 2024-09-12T17:46:51.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.594+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a8085eb0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x563cbb928058 s->prefetch_data=0 2024-09-12T17:46:51.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.594+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb928058 2024-09-12T17:46:51.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.594+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.12.0 2024-09-12T17:46:51.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T17:46:51.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.12416093173032359872 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.12__multipart_foo.2~xwvzTHnClXLDAQMifyV-Y_VN985Z7-k.1 2024-09-12T17:46:51.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:46:51.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.12__multipart_foo.2~xwvzTHnClXLDAQMifyV-Y_VN985Z7-k.2 2024-09-12T17:46:51.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:46:51.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.12__multipart_foo.2~xwvzTHnClXLDAQMifyV-Y_VN985Z7-k.3 2024-09-12T17:46:51.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:46:51.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.12__multipart_foo.2~xwvzTHnClXLDAQMifyV-Y_VN985Z7-k.4 2024-09-12T17:46:51.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:46:51.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.597+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.12416093173032359872 2024-09-12T17:46:51.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.598+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:46:51.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.599+0000 7f74bbb39800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:46:51.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.599+0000 7f74bbb39800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:46:51.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.599+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:46:51.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.599+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:46:51.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.599+0000 7f74bbb39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:46:51.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.599+0000 7f74bbb39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:46:51.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.599+0000 7f74bbb39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[35ed0db6-4f54-4e96-b306-71079c84e007.4596.12])"; uploads.size()=0; is_truncated=0 2024-09-12T17:46:51.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.600+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T17:46:51.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.600+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.601+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T17:46:51.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.601+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T17:46:51.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.601+0000 7f74bbb39800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T17:46:51.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.602+0000 7f74bbb39800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T17:46:51.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.602+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T17:46:51.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.602+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529762 cookie 94818844703936 notifier 5633 bl.length()=191 2024-09-12T17:46:51.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.603+0000 7f74bbb39800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.12 from cache 2024-09-12T17:46:51.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.603+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.12, ofs0, ns] 2024-09-12T17:46:51.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.604+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529688 cookie 94818844705472 notifier 5633 bl.length()=249 2024-09-12T17:46:51.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.605+0000 7f74bbb39800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.12 : miss 2024-09-12T17:46:51.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.605+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.605+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.605+0000 7f74bbb39800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.12 info.flags=0x0 2024-09-12T17:46:51.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.605+0000 7f74bbb39800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.12 to cache LRU end 2024-09-12T17:46:51.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.607+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.13 : miss 2024-09-12T17:46:51.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.607+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.608+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T17:46:51.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.608+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.13 info.flags=0x17 2024-09-12T17:46:51.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.608+0000 7f74bbb39800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.13 to cache LRU end 2024-09-12T17:46:51.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.608+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.608+0000 7f74bbb39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:46:51.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.608+0000 7f74bbb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.13 2024-09-12T17:46:51.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.608+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:46:51.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.608+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb92dc10 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x563cbb932e38 s->prefetch_data=0 2024-09-12T17:46:51.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.609+0000 7f74bbb39800 10 manifest: total_size = 18874368 2024-09-12T17:46:51.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.609+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.1973942393552559803 2024-09-12T17:46:51.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.609+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb92dc10 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x563cbb932e38 s->prefetch_data=0 2024-09-12T17:46:51.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.609+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb932e38 2024-09-12T17:46:51.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.609+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.13.0 2024-09-12T17:46:51.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:46:51.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.1973942393552559803 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.13__multipart_foo.2~djhIa7KkauTFRn_CaPYRRkxUPKt1HBZ.1 2024-09-12T17:46:51.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:46:51.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.13__multipart_foo.2~djhIa7KkauTFRn_CaPYRRkxUPKt1HBZ.2 2024-09-12T17:46:51.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T17:46:51.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.13__multipart_foo.2~djhIa7KkauTFRn_CaPYRRkxUPKt1HBZ.3 2024-09-12T17:46:51.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T17:46:51.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.13__multipart_foo.2~djhIa7KkauTFRn_CaPYRRkxUPKt1HBZ.4 2024-09-12T17:46:51.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T17:46:51.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.611+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.1973942393552559803 2024-09-12T17:46:51.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.612+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:46:51.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.612+0000 7f74bbb39800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:46:51.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.612+0000 7f74bbb39800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:46:51.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.613+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:46:51.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.613+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:46:51.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.613+0000 7f74bbb39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:46:51.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.613+0000 7f74bbb39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:46:51.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.613+0000 7f74bbb39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[35ed0db6-4f54-4e96-b306-71079c84e007.4596.13])"; uploads.size()=0; is_truncated=0 2024-09-12T17:46:51.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.615+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T17:46:51.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.615+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.615+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T17:46:51.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.615+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T17:46:51.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.615+0000 7f74bbb39800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T17:46:51.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.616+0000 7f74bbb39800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T17:46:51.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.616+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T17:46:51.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.616+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529689 cookie 94818844705472 notifier 5633 bl.length()=198 2024-09-12T17:46:51.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.618+0000 7f74bbb39800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.13 from cache 2024-09-12T17:46:51.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.618+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.13, ofs0, ns] 2024-09-12T17:46:51.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.618+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529670 cookie 94818844714896 notifier 5633 bl.length()=256 2024-09-12T17:46:51.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.620+0000 7f74bbb39800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.13 : miss 2024-09-12T17:46:51.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.620+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.620+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.620+0000 7f74bbb39800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.13 info.flags=0x0 2024-09-12T17:46:51.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.620+0000 7f74bbb39800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.13 to cache LRU end 2024-09-12T17:46:51.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.622+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.11 : miss 2024-09-12T17:46:51.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.622+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.623+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T17:46:51.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.623+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.11 info.flags=0x17 2024-09-12T17:46:51.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.623+0000 7f74bbb39800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.11 to cache LRU end 2024-09-12T17:46:51.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.623+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.623+0000 7f74bbb39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:46:51.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.623+0000 7f74bbb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.11 2024-09-12T17:46:51.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.623+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo[7QB.i8ogWjC9lsJ8TvdSIMiwnF21Qfl] 2024-09-12T17:46:51.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.623+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.11.0 2024-09-12T17:46:51.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.623+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a006e8e0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x563cbb87eb18 s->prefetch_data=0 2024-09-12T17:46:51.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.624+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to elbnzg4tgs7fjwwh4v5d559k7kxg2kue 2024-09-12T17:46:51.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.624+0000 7f74bbb39800 20 get_obj_state_impl: setting s->olh_tag to 5mh04o8a1mjo1jzthczq4ja6x951kc5f 2024-09-12T17:46:51.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.624+0000 7f74bbb39800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5mh04o8a1mjo1jzthczq4ja6x951kc5f 2024-09-12T17:46:51.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.625+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.11.0 2024-09-12T17:46:51.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.626+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.11.0 2024-09-12T17:46:51.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.626+0000 7f74bbb39800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T17:46:51.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.626+0000 7f74bbb39800 20 olh_log_entry: epoch=3 op=3 key=foo[7QB.i8ogWjC9lsJ8TvdSIMiwnF21Qfl] 2024-09-12T17:46:51.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.626+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a006e8e0 obj=test-client.0-r-test-multipart-index-versioning.1:_:7QB.i8ogWjC9lsJ8TvdSIMiwnF21Qfl_foo state=0x563cbb9420a8 s->prefetch_data=0 2024-09-12T17:46:51.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.627+0000 7f74bbb39800 10 manifest: total_size = 26082 2024-09-12T17:46:51.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.627+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16813518975967515643 2024-09-12T17:46:51.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.627+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a006e8e0 obj=test-client.0-r-test-multipart-index-versioning.1:_:7QB.i8ogWjC9lsJ8TvdSIMiwnF21Qfl_foo state=0x563cbb9420a8 s->prefetch_data=0 2024-09-12T17:46:51.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.627+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb9420a8 2024-09-12T17:46:51.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.627+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.11.0 2024-09-12T17:46:51.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-12T17:46:51.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-09-12T17:46:51.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7673 2024-09-12T17:46:51.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=4 2024-09-12T17:46:51.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7673 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=15345 stripe_ofs=15345 part_ofs=15345 rule->part_size=7670 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6306801 part_ofs=15345 rule->part_size=7670 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=23015 stripe_ofs=23015 part_ofs=23015 rule->part_size=3067 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6314471 part_ofs=23015 rule->part_size=3067 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=26082 stripe_ofs=26082 part_ofs=26082 rule->part_size=3067 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16813518975967515643 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.11__multipart_foo.2~8qu0tORr0IHz1TFWVLinQAOzoslhWP5.1 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.11__multipart_foo.2~8qu0tORr0IHz1TFWVLinQAOzoslhWP5.2 2024-09-12T17:46:51.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:46:51.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.11__multipart_foo.2~8qu0tORr0IHz1TFWVLinQAOzoslhWP5.3 2024-09-12T17:46:51.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:46:51.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.11__multipart_foo.2~8qu0tORr0IHz1TFWVLinQAOzoslhWP5.4 2024-09-12T17:46:51.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:46:51.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.629+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16813518975967515643 2024-09-12T17:46:51.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.630+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo[7QB.i8ogWjC9lsJ8TvdSIMiwnF21Qfl] 2024-09-12T17:46:51.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.632+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a006e8e0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x563cbb87eb18 s->prefetch_data=0 2024-09-12T17:46:51.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.633+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.11.0 2024-09-12T17:46:51.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.634+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.11.0 2024-09-12T17:46:51.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.634+0000 7f74bbb39800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:46:51.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.634+0000 7f74bbb39800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:46:51.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.634+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:46:51.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.634+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:46:51.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.634+0000 7f74bbb39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:46:51.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.634+0000 7f74bbb39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:46:51.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.634+0000 7f74bbb39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[35ed0db6-4f54-4e96-b306-71079c84e007.4596.11])"; uploads.size()=0; is_truncated=0 2024-09-12T17:46:51.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.636+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T17:46:51.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.636+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.636+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T17:46:51.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.636+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T17:46:51.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.636+0000 7f74bbb39800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T17:46:51.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.637+0000 7f74bbb39800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T17:46:51.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.637+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T17:46:51.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.637+0000 7f739a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529690 cookie 94818844705472 notifier 5633 bl.length()=193 2024-09-12T17:46:51.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.639+0000 7f74bbb39800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.11 from cache 2024-09-12T17:46:51.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.639+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.11, ofs0, ns] 2024-09-12T17:46:51.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.639+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529683 cookie 94818844717232 notifier 5633 bl.length()=251 2024-09-12T17:46:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.641+0000 7f74bbb39800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.11 : miss 2024-09-12T17:46:51.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.641+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.641+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.641+0000 7f74bbb39800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.11 info.flags=0x0 2024-09-12T17:46:51.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.641+0000 7f74bbb39800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.11 to cache LRU end 2024-09-12T17:46:51.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.643+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.10 : miss 2024-09-12T17:46:51.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.643+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.643+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=449 2024-09-12T17:46:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.643+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.10 info.flags=0x17 2024-09-12T17:46:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.643+0000 7f74bbb39800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.10 to cache LRU end 2024-09-12T17:46:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.643+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.643+0000 7f74bbb39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:46:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.643+0000 7f74bbb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.10 2024-09-12T17:46:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.644+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:46:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.644+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a807bd90 obj=test-client.0-r-test-multipart-simple.1:foo state=0x563cbb947ef8 s->prefetch_data=0 2024-09-12T17:46:51.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.644+0000 7f74bbb39800 10 manifest: total_size = 74198 2024-09-12T17:46:51.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.644+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.9082211536334448067 2024-09-12T17:46:51.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.644+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a807bd90 obj=test-client.0-r-test-multipart-simple.1:foo state=0x563cbb947ef8 s->prefetch_data=0 2024-09-12T17:46:51.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.644+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb947ef8 2024-09-12T17:46:51.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.644+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.10.0 2024-09-12T17:46:51.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:46:51.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T17:46:51.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:46:51.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:46:51.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T17:46:51.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T17:46:51.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:46:51.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-12T17:46:51.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T17:46:51.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T17:46:51.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-12T17:46:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T17:46:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.9082211536334448067 2024-09-12T17:46:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.10__multipart_foo.2~wxtyZL4pVTrExWu983LKLt7rD4FclN5.1 2024-09-12T17:46:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:46:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.10__multipart_foo.2~wxtyZL4pVTrExWu983LKLt7rD4FclN5.2 2024-09-12T17:46:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T17:46:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.10__multipart_foo.2~wxtyZL4pVTrExWu983LKLt7rD4FclN5.3 2024-09-12T17:46:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T17:46:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.10__multipart_foo.2~wxtyZL4pVTrExWu983LKLt7rD4FclN5.4 2024-09-12T17:46:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T17:46:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.646+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.9082211536334448067 2024-09-12T17:46:51.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.648+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:46:51.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.648+0000 7f74bbb39800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:46:51.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.648+0000 7f74bbb39800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:46:51.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.649+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:46:51.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.649+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:46:51.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.649+0000 7f74bbb39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:46:51.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.649+0000 7f74bbb39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:46:51.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.649+0000 7f74bbb39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[35ed0db6-4f54-4e96-b306-71079c84e007.4596.10])"; uploads.size()=0; is_truncated=0 2024-09-12T17:46:51.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.650+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T17:46:51.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.650+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.650+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=227 2024-09-12T17:46:51.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.650+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T17:46:51.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.650+0000 7f74bbb39800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T17:46:51.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.651+0000 7f74bbb39800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T17:46:51.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.651+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T17:46:51.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.652+0000 7f739a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529699 cookie 94818844707488 notifier 5633 bl.length()=183 2024-09-12T17:46:51.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.653+0000 7f74bbb39800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.10 from cache 2024-09-12T17:46:51.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.653+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.10, ofs0, ns] 2024-09-12T17:46:51.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.653+0000 7f739a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529683 cookie 94818844709984 notifier 5633 bl.length()=241 2024-09-12T17:46:51.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.655+0000 7f74bbb39800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.10 : miss 2024-09-12T17:46:51.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.655+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.655+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.655+0000 7f74bbb39800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.10 info.flags=0x0 2024-09-12T17:46:51.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.655+0000 7f74bbb39800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.10 to cache LRU end 2024-09-12T17:46:51.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.657+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16 : miss 2024-09-12T17:46:51.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.657+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:46:51.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16 info.flags=0x17 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16 to cache LRU end 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:46:51.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:46:51.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:46:51.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:46:51.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:46:51.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x563cbb930d58 s->prefetch_data=0 2024-09-12T17:46:51.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 10 manifest: total_size = 5242880 2024-09-12T17:46:51.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.4872796393717837466 2024-09-12T17:46:51.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x563cbb930d58 s->prefetch_data=0 2024-09-12T17:46:51.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930d58 2024-09-12T17:46:51.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.658+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.16.0 2024-09-12T17:46:51.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.661+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.661+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.661+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.4872796393717837466 2024-09-12T17:46:51.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.661+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.661+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.cCP_OfPR859BtbYxU4zCg4ej1kgnJvy_0 2024-09-12T17:46:51.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.661+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T17:46:51.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.661+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.661+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.4872796393717837466 2024-09-12T17:46:51.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.662+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:46:51.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.662+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x563cbb930d58 s->prefetch_data=0 2024-09-12T17:46:51.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.663+0000 7f74bbb39800 10 manifest: total_size = 5242880 2024-09-12T17:46:51.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.663+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.3449314624372240933 2024-09-12T17:46:51.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.663+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x563cbb930d58 s->prefetch_data=0 2024-09-12T17:46:51.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.663+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930d58 2024-09-12T17:46:51.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.663+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.16.0 2024-09-12T17:46:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.665+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.665+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.665+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.3449314624372240933 2024-09-12T17:46:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.665+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.665+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.cCP_OfPR859BtbYxU4zCg4ej1kgnJvy_0 2024-09-12T17:46:51.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.665+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T17:46:51.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.665+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.665+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.3449314624372240933 2024-09-12T17:46:51.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.666+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:46:51.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.667+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x563cbb930d58 s->prefetch_data=0 2024-09-12T17:46:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.667+0000 7f74bbb39800 10 manifest: total_size = 5242880 2024-09-12T17:46:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.667+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _ux1ciiKfNIEmvEpf7KR3_CgNL7BN323 2024-09-12T17:46:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.667+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x563cbb930d58 s->prefetch_data=0 2024-09-12T17:46:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.667+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930d58 2024-09-12T17:46:51.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.667+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.16.0 2024-09-12T17:46:51.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.669+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.669+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.669+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: _ux1ciiKfNIEmvEpf7KR3_CgNL7BN323 2024-09-12T17:46:51.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.669+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.669+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.e2F1xWh_-ry5L0OE-jwR6rTtoJw4prv_0 2024-09-12T17:46:51.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.669+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:46:51.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.669+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.669+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _ux1ciiKfNIEmvEpf7KR3_CgNL7BN323 2024-09-12T17:46:51.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.670+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:46:51.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.670+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x563cbb930d58 s->prefetch_data=0 2024-09-12T17:46:51.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.671+0000 7f74bbb39800 10 manifest: total_size = 5242880 2024-09-12T17:46:51.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.671+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _woNUtibXW6-IuKvZT80VCRHGAVHBGE3 2024-09-12T17:46:51.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.671+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x563cbb930d58 s->prefetch_data=0 2024-09-12T17:46:51.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.671+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930d58 2024-09-12T17:46:51.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.671+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.16.0 2024-09-12T17:46:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.673+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.673+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.673+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: _woNUtibXW6-IuKvZT80VCRHGAVHBGE3 2024-09-12T17:46:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.673+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.673+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.HKBSryxYvljKztAP-9r4kOo2IeYu-Zc_1 2024-09-12T17:46:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.673+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:46:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.673+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.673+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _woNUtibXW6-IuKvZT80VCRHGAVHBGE3 2024-09-12T17:46:51.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.674+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:46:51.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.675+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x563cbb930d58 s->prefetch_data=0 2024-09-12T17:46:51.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.675+0000 7f74bbb39800 10 manifest: total_size = 5242880 2024-09-12T17:46:51.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.675+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7192970228584175042 2024-09-12T17:46:51.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.675+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb887560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x563cbb930d58 s->prefetch_data=0 2024-09-12T17:46:51.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.675+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930d58 2024-09-12T17:46:51.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.675+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.16.0 2024-09-12T17:46:51.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.678+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.678+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.678+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7192970228584175042 2024-09-12T17:46:51.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.678+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.678+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_._2BMb27Z-cnuZZE3Ck0pL8F9OVOspyr_0 2024-09-12T17:46:51.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.678+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:46:51.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.678+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.678+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7192970228584175042 2024-09-12T17:46:51.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.679+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:46:51.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.679+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb932000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.679+0000 7f74bbb39800 10 manifest: total_size = 5242880 2024-09-12T17:46:51.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.679+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _BaZyfvGawdF7IypLjc_6XBcKkw2Qy_B 2024-09-12T17:46:51.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.679+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb932000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.679+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930848 2024-09-12T17:46:51.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.679+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.16.0 2024-09-12T17:46:51.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.681+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.681+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.681+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: _BaZyfvGawdF7IypLjc_6XBcKkw2Qy_B 2024-09-12T17:46:51.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.681+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.681+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.u-LMCmzK_tEk6BuQZ1ifDUr_gLvkhJr_0 2024-09-12T17:46:51.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.681+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:46:51.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.681+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.681+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _BaZyfvGawdF7IypLjc_6XBcKkw2Qy_B 2024-09-12T17:46:51.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.683+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:46:51.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.683+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b008cb60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.683+0000 7f74bbb39800 10 manifest: total_size = 5242880 2024-09-12T17:46:51.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.683+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7361165882894158296 2024-09-12T17:46:51.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.683+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b008cb60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.683+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930848 2024-09-12T17:46:51.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.683+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.16.0 2024-09-12T17:46:51.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.686+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.686+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.686+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7361165882894158296 2024-09-12T17:46:51.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.686+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.686+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_._2BMb27Z-cnuZZE3Ck0pL8F9OVOspyr_0 2024-09-12T17:46:51.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.686+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:46:51.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.686+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.686+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7361165882894158296 2024-09-12T17:46:51.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.687+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:46:51.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.687+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.687+0000 7f74bbb39800 10 manifest: total_size = 5242880 2024-09-12T17:46:51.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.687+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _I7fmMcRFotc51JPFu24geHoBMFMy1O1 2024-09-12T17:46:51.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.687+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.687+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930848 2024-09-12T17:46:51.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.687+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.16.0 2024-09-12T17:46:51.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.690+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.690+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.690+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: _I7fmMcRFotc51JPFu24geHoBMFMy1O1 2024-09-12T17:46:51.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.690+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.690+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.NZsIhQ8BEdg-unpON1ejR6fcfmzNH-U_1 2024-09-12T17:46:51.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.690+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:46:51.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.690+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.690+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _I7fmMcRFotc51JPFu24geHoBMFMy1O1 2024-09-12T17:46:51.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.691+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:46:51.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.691+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b008cb60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.691+0000 7f74bbb39800 10 manifest: total_size = 27197 2024-09-12T17:46:51.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.691+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.5722265819781923585 2024-09-12T17:46:51.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.691+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b008cb60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.691+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930848 2024-09-12T17:46:51.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.691+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.16.0 2024-09-12T17:46:51.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.693+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.694+0000 7f74bbb39800 10 manifest: total_size = 27197 2024-09-12T17:46:51.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.694+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _xfF2jA-ORF7z_aVAOhJ6q7cSMjVIQHm 2024-09-12T17:46:51.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.694+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.694+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930848 2024-09-12T17:46:51.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.694+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.16.0 2024-09-12T17:46:51.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.695+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:46:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.697+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.697+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.697+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: _xfF2jA-ORF7z_aVAOhJ6q7cSMjVIQHm 2024-09-12T17:46:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.697+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.697+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.qlZ64ZAjVRsslEohBXMVVovNNRsjR8H_0 2024-09-12T17:46:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.697+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:46:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.697+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.697+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _xfF2jA-ORF7z_aVAOhJ6q7cSMjVIQHm 2024-09-12T17:46:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.698+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:46:51.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.699+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.699+0000 7f74bbb39800 10 manifest: total_size = 27197 2024-09-12T17:46:51.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.699+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _4_UB0bBwFYWHBYKfYa4-oayOqXM53iV 2024-09-12T17:46:51.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.699+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.699+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930848 2024-09-12T17:46:51.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.699+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.16.0 2024-09-12T17:46:51.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.702+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.702+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.702+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: _4_UB0bBwFYWHBYKfYa4-oayOqXM53iV 2024-09-12T17:46:51.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.702+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.702+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.y8OXGCrqwQH6_bvBQkX4l44dHhXgItl_0 2024-09-12T17:46:51.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.702+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:46:51.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.702+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.702+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _4_UB0bBwFYWHBYKfYa4-oayOqXM53iV 2024-09-12T17:46:51.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.703+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:46:51.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.703+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a000ae50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.704+0000 7f74bbb39800 10 manifest: total_size = 27197 2024-09-12T17:46:51.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.704+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _1e532EfSEeBuv-469bT7pe83RfRClHd 2024-09-12T17:46:51.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.704+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a000ae50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x563cbb930848 s->prefetch_data=0 2024-09-12T17:46:51.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.704+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb930848 2024-09-12T17:46:51.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.704+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.16.0 2024-09-12T17:46:51.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.706+0000 7f74bbb39800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:46:51.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.706+0000 7f74bbb39800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:46:51.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.707+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:46:51.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.707+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:46:51.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.707+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:46:51.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.707+0000 7f74bbb39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:46:51.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.707+0000 7f74bbb39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:46:51.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.707+0000 7f74bbb39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[35ed0db6-4f54-4e96-b306-71079c84e007.4596.16])"; uploads.size()=0; is_truncated=0 2024-09-12T17:46:51.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.709+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T17:46:51.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.709+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.709+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T17:46:51.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.709+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T17:46:51.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.709+0000 7f74bbb39800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T17:46:51.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.710+0000 7f74bbb39800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T17:46:51.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.710+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T17:46:51.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.710+0000 7f739a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529691 cookie 94818844705472 notifier 5633 bl.length()=189 2024-09-12T17:46:51.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.712+0000 7f74bbb39800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16 from cache 2024-09-12T17:46:51.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.712+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16, ofs0, ns] 2024-09-12T17:46:51.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.712+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529684 cookie 94818844717232 notifier 5633 bl.length()=247 2024-09-12T17:46:51.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.713+0000 7f74bbb39800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.16 : miss 2024-09-12T17:46:51.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.713+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.714+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.714+0000 7f74bbb39800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.16 info.flags=0x0 2024-09-12T17:46:51.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.714+0000 7f74bbb39800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.16 to cache LRU end 2024-09-12T17:46:51.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.716+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17 : miss 2024-09-12T17:46:51.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.716+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:46:51.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17 info.flags=0x17 2024-09-12T17:46:51.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17 to cache LRU end 2024-09-12T17:46:51.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:46:51.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17 2024-09-12T17:46:51.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:46:51.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:46:51.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:46:51.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:46:51.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:46:51.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:46:51.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:46:51.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:46:51.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:46:51.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:46:51.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:46:51.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:46:51.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.717+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb947540 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.718+0000 7f74bbb39800 10 manifest: total_size = 11534336 2024-09-12T17:46:51.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.718+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.6922757099240576655 2024-09-12T17:46:51.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.718+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb947540 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.718+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb943d38 2024-09-12T17:46:51.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.718+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.17.0 2024-09-12T17:46:51.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:46:51.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.6922757099240576655 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-FROZEN.2~I_kWuTQrDYOL0seH0YqGrPbBkvD_Oag.1 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-FROZEN.2~I_kWuTQrDYOL0seH0YqGrPbBkvD_Oag.2 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-FROZEN.2~I_kWuTQrDYOL0seH0YqGrPbBkvD_Oag.3 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.720+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.6922757099240576655 2024-09-12T17:46:51.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.721+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:46:51.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.721+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb947540 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x563cbb9379e8 s->prefetch_data=0 2024-09-12T17:46:51.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.722+0000 7f74bbb39800 10 manifest: total_size = 11534336 2024-09-12T17:46:51.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.722+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7791929279317029120 2024-09-12T17:46:51.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.722+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb947540 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x563cbb9379e8 s->prefetch_data=0 2024-09-12T17:46:51.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.722+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb9379e8 2024-09-12T17:46:51.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.722+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.17.0 2024-09-12T17:46:51.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:46:51.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:46:51.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:46:51.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:46:51.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:46:51.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7791929279317029120 2024-09-12T17:46:51.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-FROZEN.2~I_kWuTQrDYOL0seH0YqGrPbBkvD_Oag.1 2024-09-12T17:46:51.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:46:51.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-FROZEN.2~I_kWuTQrDYOL0seH0YqGrPbBkvD_Oag.2 2024-09-12T17:46:51.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T17:46:51.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-FROZEN.2~I_kWuTQrDYOL0seH0YqGrPbBkvD_Oag.3 2024-09-12T17:46:51.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T17:46:51.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.724+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7791929279317029120 2024-09-12T17:46:51.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.725+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:46:51.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.725+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb947540 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x563cbb937948 s->prefetch_data=0 2024-09-12T17:46:51.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.726+0000 7f74bbb39800 10 manifest: total_size = 11534336 2024-09-12T17:46:51.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.726+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _n5Sraxa8iJdQilR2ot8ozzOZwzh8Pvw 2024-09-12T17:46:51.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.726+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb947540 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x563cbb937948 s->prefetch_data=0 2024-09-12T17:46:51.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.726+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb937948 2024-09-12T17:46:51.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.726+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.17.0 2024-09-12T17:46:51.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.728+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.728+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.728+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.728+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.728+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: _n5Sraxa8iJdQilR2ot8ozzOZwzh8Pvw 2024-09-12T17:46:51.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.728+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.728+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.oE8dvVohiTK-IUVT9QXbvFVXoKhNgNL_0 2024-09-12T17:46:51.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.728+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:46:51.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.728+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.oE8dvVohiTK-IUVT9QXbvFVXoKhNgNL_1 2024-09-12T17:46:51.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.728+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:46:51.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.728+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.728+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _n5Sraxa8iJdQilR2ot8ozzOZwzh8Pvw 2024-09-12T17:46:51.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.729+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:46:51.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.729+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb947540 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x563cbb935488 s->prefetch_data=0 2024-09-12T17:46:51.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.730+0000 7f74bbb39800 10 manifest: total_size = 11534336 2024-09-12T17:46:51.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.730+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _bmc0_ixy1ubd4dubpNxyXzOjsUuueeF 2024-09-12T17:46:51.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.730+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb947540 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x563cbb935488 s->prefetch_data=0 2024-09-12T17:46:51.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.730+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb935488 2024-09-12T17:46:51.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.730+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.17.0 2024-09-12T17:46:51.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.732+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.732+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.732+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.732+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.732+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: _bmc0_ixy1ubd4dubpNxyXzOjsUuueeF 2024-09-12T17:46:51.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.732+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.732+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.VGU8siO2wSJ21Qt3qPcM1e7Ik7jG6G3_1 2024-09-12T17:46:51.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.732+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:46:51.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.732+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.VGU8siO2wSJ21Qt3qPcM1e7Ik7jG6G3_2 2024-09-12T17:46:51.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.732+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:46:51.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.732+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.732+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _bmc0_ixy1ubd4dubpNxyXzOjsUuueeF 2024-09-12T17:46:51.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.733+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:46:51.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.734+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a000ae50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x563cbb935488 s->prefetch_data=0 2024-09-12T17:46:51.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.734+0000 7f74bbb39800 10 manifest: total_size = 11534336 2024-09-12T17:46:51.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.734+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.421773847856051476 2024-09-12T17:46:51.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.734+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a000ae50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x563cbb935488 s->prefetch_data=0 2024-09-12T17:46:51.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.734+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb935488 2024-09-12T17:46:51.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.734+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.17.0 2024-09-12T17:46:51.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:46:51.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.421773847856051476 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-LUKEWARM.2~n_odkn2dowOpmWLvrc63ryAtiBvT-UR.1 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 372 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-LUKEWARM.2~n_odkn2dowOpmWLvrc63ryAtiBvT-UR.2 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T17:46:51.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-LUKEWARM.2~n_odkn2dowOpmWLvrc63ryAtiBvT-UR.3 2024-09-12T17:46:51.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T17:46:51.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.736+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.421773847856051476 2024-09-12T17:46:51.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.737+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:46:51.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.738+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb935220 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x563cbb9378a8 s->prefetch_data=0 2024-09-12T17:46:51.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.738+0000 7f74bbb39800 10 manifest: total_size = 11534336 2024-09-12T17:46:51.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.738+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _ukEb9nKODZ4xI-s0A5C6t49ggZmsb3S 2024-09-12T17:46:51.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.738+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb935220 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x563cbb9378a8 s->prefetch_data=0 2024-09-12T17:46:51.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.738+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb9378a8 2024-09-12T17:46:51.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.738+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.17.0 2024-09-12T17:46:51.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.740+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.740+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.740+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.740+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.740+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: _ukEb9nKODZ4xI-s0A5C6t49ggZmsb3S 2024-09-12T17:46:51.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.740+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.740+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.ZIsdT8UKBlW_fuIeHv4Rvhyez0YDZSq_0 2024-09-12T17:46:51.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.740+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:46:51.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.740+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.ZIsdT8UKBlW_fuIeHv4Rvhyez0YDZSq_1 2024-09-12T17:46:51.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.740+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:46:51.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.740+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.740+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _ukEb9nKODZ4xI-s0A5C6t49ggZmsb3S 2024-09-12T17:46:51.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.741+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:46:51.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.741+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a8076830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.742+0000 7f74bbb39800 10 manifest: total_size = 11534336 2024-09-12T17:46:51.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.742+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16734481621960305871 2024-09-12T17:46:51.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.742+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a8076830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.742+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb943d38 2024-09-12T17:46:51.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.742+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.17.0 2024-09-12T17:46:51.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:46:51.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16734481621960305871 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-LUKEWARM.2~n_odkn2dowOpmWLvrc63ryAtiBvT-UR.1 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-LUKEWARM.2~n_odkn2dowOpmWLvrc63ryAtiBvT-UR.2 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-LUKEWARM.2~n_odkn2dowOpmWLvrc63ryAtiBvT-UR.3 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.744+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16734481621960305871 2024-09-12T17:46:51.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.745+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:46:51.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.745+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a80744f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.746+0000 7f74bbb39800 10 manifest: total_size = 11534336 2024-09-12T17:46:51.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.746+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _pKnLRxeGtODqqY5dZ3tClmyvC1cAf6_ 2024-09-12T17:46:51.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.746+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a80744f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.746+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb943d38 2024-09-12T17:46:51.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.746+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.17.0 2024-09-12T17:46:51.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.748+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.748+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.748+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.748+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.748+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: _pKnLRxeGtODqqY5dZ3tClmyvC1cAf6_ 2024-09-12T17:46:51.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.748+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.748+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.HeYUOpbGfSWSdelNjV3HsQUxnC8ccYV_1 2024-09-12T17:46:51.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.748+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:46:51.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.748+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.HeYUOpbGfSWSdelNjV3HsQUxnC8ccYV_2 2024-09-12T17:46:51.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.748+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:46:51.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.748+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.748+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _pKnLRxeGtODqqY5dZ3tClmyvC1cAf6_ 2024-09-12T17:46:51.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.750+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:46:51.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.750+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.750+0000 7f74bbb39800 10 manifest: total_size = 45360 2024-09-12T17:46:51.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.750+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17506282431348491687 2024-09-12T17:46:51.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.750+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.750+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb943d38 2024-09-12T17:46:51.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.750+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.17.0 2024-09-12T17:46:51.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:46:51.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T17:46:51.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:46:51.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:46:51.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T17:46:51.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T17:46:51.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T17:46:51.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-12T17:46:51.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T17:46:51.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17506282431348491687 2024-09-12T17:46:51.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-STANDARD.2~s7egSJ-WD4mth_jdt8PCUPEovOasVpQ.1 2024-09-12T17:46:51.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T17:46:51.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-STANDARD.2~s7egSJ-WD4mth_jdt8PCUPEovOasVpQ.2 2024-09-12T17:46:51.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T17:46:51.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-STANDARD.2~s7egSJ-WD4mth_jdt8PCUPEovOasVpQ.3 2024-09-12T17:46:51.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T17:46:51.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.752+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17506282431348491687 2024-09-12T17:46:51.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.754+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:46:51.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.754+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a803a380 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.754+0000 7f74bbb39800 10 manifest: total_size = 45360 2024-09-12T17:46:51.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.754+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _xPsPJFNAj3lI48x3cuVGUdg3T63xI6I 2024-09-12T17:46:51.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.754+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a803a380 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.754+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb943d38 2024-09-12T17:46:51.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.754+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.17.0 2024-09-12T17:46:51.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.756+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.756+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.756+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: _xPsPJFNAj3lI48x3cuVGUdg3T63xI6I 2024-09-12T17:46:51.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.756+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.756+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.SSoG7ByIPv8bp5d1YkfPAcenCrT_ozJ_0 2024-09-12T17:46:51.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.756+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:46:51.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.756+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.756+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _xPsPJFNAj3lI48x3cuVGUdg3T63xI6I 2024-09-12T17:46:51.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.757+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:46:51.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.758+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.758+0000 7f74bbb39800 10 manifest: total_size = 45360 2024-09-12T17:46:51.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.758+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to _HiuvyWQyrZe2Gq2QLi5q-46vCvpt8x3 2024-09-12T17:46:51.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.758+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.758+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb943d38 2024-09-12T17:46:51.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.758+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.17.0 2024-09-12T17:46:51.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.761+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.761+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.761+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: _HiuvyWQyrZe2Gq2QLi5q-46vCvpt8x3 2024-09-12T17:46:51.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.761+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.761+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_._GBSCT3pqm7-0WM4tg__thEluOnaWZj_0 2024-09-12T17:46:51.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.761+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:46:51.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.761+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.761+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _HiuvyWQyrZe2Gq2QLi5q-46vCvpt8x3 2024-09-12T17:46:51.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.762+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:46:51.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.762+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b008cb60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.762+0000 7f74bbb39800 10 manifest: total_size = 45360 2024-09-12T17:46:51.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.762+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.1348128016423134779 2024-09-12T17:46:51.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.762+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b008cb60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x563cbb943d38 s->prefetch_data=0 2024-09-12T17:46:51.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.762+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb943d38 2024-09-12T17:46:51.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.762+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.17.0 2024-09-12T17:46:51.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:46:51.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T17:46:51.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:46:51.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:46:51.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T17:46:51.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T17:46:51.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T17:46:51.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-12T17:46:51.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T17:46:51.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.1348128016423134779 2024-09-12T17:46:51.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-STANDARD.2~s7egSJ-WD4mth_jdt8PCUPEovOasVpQ.1 2024-09-12T17:46:51.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:46:51.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-STANDARD.2~s7egSJ-WD4mth_jdt8PCUPEovOasVpQ.2 2024-09-12T17:46:51.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:46:51.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-STANDARD.2~s7egSJ-WD4mth_jdt8PCUPEovOasVpQ.3 2024-09-12T17:46:51.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:46:51.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.764+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.1348128016423134779 2024-09-12T17:46:51.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.765+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:46:51.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.766+0000 7f74bbb39800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:46:51.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.766+0000 7f74bbb39800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:46:51.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.766+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:46:51.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.766+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:46:51.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.766+0000 7f74bbb39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:46:51.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.766+0000 7f74bbb39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:46:51.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.766+0000 7f74bbb39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[35ed0db6-4f54-4e96-b306-71079c84e007.4596.17])"; uploads.size()=0; is_truncated=0 2024-09-12T17:46:51.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.767+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T17:46:51.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.767+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.768+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T17:46:51.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.768+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T17:46:51.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.768+0000 7f74bbb39800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T17:46:51.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.769+0000 7f74bbb39800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T17:46:51.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.769+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T17:46:51.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.769+0000 7f739a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529684 cookie 94818844709984 notifier 5633 bl.length()=199 2024-09-12T17:46:51.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.771+0000 7f74bbb39800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17 from cache 2024-09-12T17:46:51.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.771+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17, ofs0, ns] 2024-09-12T17:46:51.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.771+0000 7f739a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529700 cookie 94818844697424 notifier 5633 bl.length()=257 2024-09-12T17:46:51.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.773+0000 7f74bbb39800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.17 : miss 2024-09-12T17:46:51.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.773+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.773+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.773+0000 7f74bbb39800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.17 info.flags=0x0 2024-09-12T17:46:51.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.773+0000 7f74bbb39800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.17 to cache LRU end 2024-09-12T17:46:51.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.775+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15 : miss 2024-09-12T17:46:51.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.775+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:46:51.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15 info.flags=0x17 2024-09-12T17:46:51.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15 to cache LRU end 2024-09-12T17:46:51.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:46:51.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15 2024-09-12T17:46:51.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:46:51.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:46:51.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:46:51.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb931040 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x563cbb92fd38 s->prefetch_data=0 2024-09-12T17:46:51.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 10 manifest: total_size = 11534336 2024-09-12T17:46:51.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17141673587402005078 2024-09-12T17:46:51.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb931040 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x563cbb92fd38 s->prefetch_data=0 2024-09-12T17:46:51.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb92fd38 2024-09-12T17:46:51.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.776+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.15.0 2024-09-12T17:46:51.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:46:51.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:46:51.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:46:51.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:46:51.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:46:51.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17141673587402005078 2024-09-12T17:46:51.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-FROZEN.2~fQ61Q1NC-SyoLTjK1a8BuQpTwqDcuEu.1 2024-09-12T17:46:51.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T17:46:51.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-FROZEN.2~fQ61Q1NC-SyoLTjK1a8BuQpTwqDcuEu.2 2024-09-12T17:46:51.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T17:46:51.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-FROZEN.2~fQ61Q1NC-SyoLTjK1a8BuQpTwqDcuEu.3 2024-09-12T17:46:51.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T17:46:51.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.779+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.17141673587402005078 2024-09-12T17:46:51.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.780+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:46:51.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.780+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x563cbb92fd38 s->prefetch_data=0 2024-09-12T17:46:51.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.780+0000 7f74bbb39800 10 manifest: total_size = 11534336 2024-09-12T17:46:51.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.780+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7774804376258593416 2024-09-12T17:46:51.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.780+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x563cbb92fd38 s->prefetch_data=0 2024-09-12T17:46:51.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.780+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb92fd38 2024-09-12T17:46:51.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.780+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.15.0 2024-09-12T17:46:51.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7774804376258593416 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-LUKEWARM.2~o9_O4wSFpM0z-T1dLfdSNWGueMo2UDm.1 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-LUKEWARM.2~o9_O4wSFpM0z-T1dLfdSNWGueMo2UDm.2 2024-09-12T17:46:51.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-12T17:46:51.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-LUKEWARM.2~o9_O4wSFpM0z-T1dLfdSNWGueMo2UDm.3 2024-09-12T17:46:51.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-12T17:46:51.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.782+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.7774804376258593416 2024-09-12T17:46:51.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.783+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:46:51.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.786+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb946330 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x563cbb92fd38 s->prefetch_data=0 2024-09-12T17:46:51.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.786+0000 7f74bbb39800 10 manifest: total_size = 45360 2024-09-12T17:46:51.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.786+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.1373397216165039519 2024-09-12T17:46:51.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.786+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb946330 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x563cbb92fd38 s->prefetch_data=0 2024-09-12T17:46:51.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.786+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb92fd38 2024-09-12T17:46:51.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.786+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.15.0 2024-09-12T17:46:51.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:46:51.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T17:46:51.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:46:51.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:46:51.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T17:46:51.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T17:46:51.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T17:46:51.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-12T17:46:51.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T17:46:51.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.1373397216165039519 2024-09-12T17:46:51.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-STANDARD.2~VqtVRjMKLzCAbdHhnwQzPWJ6LsP5V9C.1 2024-09-12T17:46:51.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:46:51.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-STANDARD.2~VqtVRjMKLzCAbdHhnwQzPWJ6LsP5V9C.2 2024-09-12T17:46:51.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:46:51.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-STANDARD.2~VqtVRjMKLzCAbdHhnwQzPWJ6LsP5V9C.3 2024-09-12T17:46:51.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:46:51.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.789+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.1373397216165039519 2024-09-12T17:46:51.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.790+0000 7f74bbb39800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:46:51.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.790+0000 7f74bbb39800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:46:51.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.790+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:46:51.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.790+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:46:51.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.790+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:46:51.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.790+0000 7f74bbb39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:46:51.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.790+0000 7f74bbb39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:46:51.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.790+0000 7f74bbb39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[35ed0db6-4f54-4e96-b306-71079c84e007.4596.15])"; uploads.size()=0; is_truncated=0 2024-09-12T17:46:51.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.792+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T17:46:51.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.792+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.792+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T17:46:51.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.792+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T17:46:51.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.792+0000 7f74bbb39800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T17:46:51.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.794+0000 7f74bbb39800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T17:46:51.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.794+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T17:46:51.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.794+0000 7f739a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529685 cookie 94818844717232 notifier 5633 bl.length()=194 2024-09-12T17:46:51.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.795+0000 7f74bbb39800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15 from cache 2024-09-12T17:46:51.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.795+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15, ofs0, ns] 2024-09-12T17:46:51.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.796+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529701 cookie 94818844697424 notifier 5633 bl.length()=252 2024-09-12T17:46:51.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.797+0000 7f74bbb39800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.15 : miss 2024-09-12T17:46:51.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.797+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.797+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.797+0000 7f74bbb39800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.15 info.flags=0x0 2024-09-12T17:46:51.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.797+0000 7f74bbb39800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.15 to cache LRU end 2024-09-12T17:46:51.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.800+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.14 : miss 2024-09-12T17:46:51.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.800+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.800+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T17:46:51.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.800+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.14 info.flags=0x17 2024-09-12T17:46:51.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.800+0000 7f74bbb39800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.14 to cache LRU end 2024-09-12T17:46:51.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.800+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.800+0000 7f74bbb39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:46:51.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.800+0000 7f74bbb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.14 2024-09-12T17:46:51.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.801+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:46:51.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.801+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:46:51.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.801+0000 7f74bbb39800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:46:51.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.801+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb8c6430 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x563cbb9420a8 s->prefetch_data=0 2024-09-12T17:46:51.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.801+0000 7f74bbb39800 10 manifest: total_size = 10485760 2024-09-12T17:46:51.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.801+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.5172945724475597220 2024-09-12T17:46:51.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.801+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb8c6430 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x563cbb9420a8 s->prefetch_data=0 2024-09-12T17:46:51.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.801+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb9420a8 2024-09-12T17:46:51.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.801+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.14.0 2024-09-12T17:46:51.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.804+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.804+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.804+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.804+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.804+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.5172945724475597220 2024-09-12T17:46:51.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.804+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.804+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.14__shadow_.arMRBCGM6TdoFjUsvzdb_BwQriBkdun_0 2024-09-12T17:46:51.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.804+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T17:46:51.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.804+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.14__shadow_.arMRBCGM6TdoFjUsvzdb_BwQriBkdun_1 2024-09-12T17:46:51.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.804+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T17:46:51.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.804+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.804+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.5172945724475597220 2024-09-12T17:46:51.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.805+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:46:51.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.805+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b008cb60 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x563cbb9420a8 s->prefetch_data=0 2024-09-12T17:46:51.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.806+0000 7f74bbb39800 10 manifest: total_size = 10485760 2024-09-12T17:46:51.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.806+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.11534858072738097226 2024-09-12T17:46:51.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.806+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b008cb60 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x563cbb9420a8 s->prefetch_data=0 2024-09-12T17:46:51.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.806+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb9420a8 2024-09-12T17:46:51.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.806+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.14.0 2024-09-12T17:46:51.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.808+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.808+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.808+0000 7f74bbb39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:46:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.808+0000 7f74bbb39800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:46:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.808+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.11534858072738097226 2024-09-12T17:46:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.808+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:46:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.808+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.14__shadow_.dZFMKAiWzV8X4Qidc9ynvZI9RJGw0To_0 2024-09-12T17:46:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.808+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T17:46:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.808+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.14__shadow_.dZFMKAiWzV8X4Qidc9ynvZI9RJGw0To_1 2024-09-12T17:46:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.808+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T17:46:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.808+0000 7f74bbb39800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:46:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.808+0000 7f74bbb39800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.11534858072738097226 2024-09-12T17:46:51.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.809+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:46:51.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.809+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x563cbb9353d8 s->prefetch_data=0 2024-09-12T17:46:51.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.810+0000 7f74bbb39800 10 manifest: total_size = 649292 2024-09-12T17:46:51.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.810+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.2933944099586919793 2024-09-12T17:46:51.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.810+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x563cbb9353d8 s->prefetch_data=0 2024-09-12T17:46:51.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.810+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb9353d8 2024-09-12T17:46:51.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.810+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.14.0 2024-09-12T17:46:51.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.812+0000 7f74bbb39800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:46:51.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.812+0000 7f74bbb39800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:46:51.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.813+0000 7f739affd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:46:51.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.814+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:46:51.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.814+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:46:51.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.814+0000 7f74bbb39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:46:51.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.814+0000 7f74bbb39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:46:51.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.814+0000 7f74bbb39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[35ed0db6-4f54-4e96-b306-71079c84e007.4596.14])"; uploads.size()=0; is_truncated=0 2024-09-12T17:46:51.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.815+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T17:46:51.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.815+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.815+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T17:46:51.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.815+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T17:46:51.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.815+0000 7f74bbb39800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T17:46:51.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.816+0000 7f74bbb39800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T17:46:51.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.816+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T17:46:51.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.817+0000 7f739a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529692 cookie 94818844705472 notifier 5633 bl.length()=184 2024-09-12T17:46:51.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.819+0000 7f74bbb39800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.14 from cache 2024-09-12T17:46:51.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.819+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.14, ofs0, ns] 2024-09-12T17:46:51.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.819+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529671 cookie 94818844714896 notifier 5633 bl.length()=242 2024-09-12T17:46:51.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.820+0000 7f74bbb39800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.14 : miss 2024-09-12T17:46:51.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.820+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.821+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.821+0000 7f74bbb39800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.14 info.flags=0x0 2024-09-12T17:46:51.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.821+0000 7f74bbb39800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.14 to cache LRU end 2024-09-12T17:46:51.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.7 : miss 2024-09-12T17:46:51.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:46:51.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.7 info.flags=0x17 2024-09-12T17:46:51.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.7 to cache LRU end 2024-09-12T17:46:51.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:46:51.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.7 2024-09-12T17:46:51.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:46:51.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:46:51.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:46:51.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:46:51.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.823+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a8085060 obj=test-client.0-r-test-small-obj-data.1:__ state=0x563cbb92ebb8 s->prefetch_data=0 2024-09-12T17:46:51.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.824+0000 7f74bbb39800 10 manifest: total_size = 0 2024-09-12T17:46:51.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.824+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.15717523573897930371 2024-09-12T17:46:51.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.824+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a8085060 obj=test-client.0-r-test-small-obj-data.1:__ state=0x563cbb92ebb8 s->prefetch_data=0 2024-09-12T17:46:51.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.824+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb92ebb8 2024-09-12T17:46:51.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.824+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.7.0 2024-09-12T17:46:51.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.826+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a807bd90 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x563cbb92ebb8 s->prefetch_data=0 2024-09-12T17:46:51.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.827+0000 7f74bbb39800 10 manifest: total_size = 0 2024-09-12T17:46:51.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.827+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.3285638605958428540 2024-09-12T17:46:51.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.827+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a807bd90 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x563cbb92ebb8 s->prefetch_data=0 2024-09-12T17:46:51.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.827+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb92ebb8 2024-09-12T17:46:51.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.827+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.7.0 2024-09-12T17:46:51.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.827+0000 7f739affd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:46:51.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.829+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a807bd90 obj=test-client.0-r-test-small-obj-data.1:___ state=0x563cbb92ebb8 s->prefetch_data=0 2024-09-12T17:46:51.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.829+0000 7f74bbb39800 10 manifest: total_size = 0 2024-09-12T17:46:51.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.829+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.5705941227864858262 2024-09-12T17:46:51.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.829+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a807bd90 obj=test-client.0-r-test-small-obj-data.1:___ state=0x563cbb92ebb8 s->prefetch_data=0 2024-09-12T17:46:51.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.829+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb92ebb8 2024-09-12T17:46:51.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.829+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.7.0 2024-09-12T17:46:51.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.830+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:46:51.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.832+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-small-obj-data.1:obj state=0x563cbb92ebb8 s->prefetch_data=0 2024-09-12T17:46:51.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.832+0000 7f74bbb39800 10 manifest: total_size = 0 2024-09-12T17:46:51.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.832+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.3853799158682658672 2024-09-12T17:46:51.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.832+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-small-obj-data.1:obj state=0x563cbb92ebb8 s->prefetch_data=0 2024-09-12T17:46:51.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.832+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb92ebb8 2024-09-12T17:46:51.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.832+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.7.0 2024-09-12T17:46:51.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.833+0000 7f739affd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:46:51.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.834+0000 7f74bbb39800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:46:51.835 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.834+0000 7f74bbb39800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:46:51.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.835+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:46:51.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.836+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:46:51.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.836+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:46:51.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.836+0000 7f74bbb39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:46:51.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.836+0000 7f74bbb39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:46:51.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.836+0000 7f74bbb39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[35ed0db6-4f54-4e96-b306-71079c84e007.4596.7])"; uploads.size()=0; is_truncated=0 2024-09-12T17:46:51.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.837+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T17:46:51.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.837+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.837+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:46:51.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.837+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T17:46:51.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.837+0000 7f74bbb39800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T17:46:51.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.839+0000 7f74bbb39800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T17:46:51.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.839+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T17:46:51.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.839+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529763 cookie 94818844703936 notifier 5633 bl.length()=181 2024-09-12T17:46:51.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.840+0000 7f74bbb39800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.7 from cache 2024-09-12T17:46:51.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.840+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:35ed0db6-4f54-4e96-b306-71079c84e007.4596.7, ofs0, ns] 2024-09-12T17:46:51.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.840+0000 7f739a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529685 cookie 94818844709984 notifier 5633 bl.length()=238 2024-09-12T17:46:51.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.842+0000 7f74bbb39800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.7 : miss 2024-09-12T17:46:51.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.842+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.842+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.842+0000 7f74bbb39800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.7 info.flags=0x0 2024-09-12T17:46:51.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.842+0000 7f74bbb39800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/35ed0db6-4f54-4e96-b306-71079c84e007.4596.7 to cache LRU end 2024-09-12T17:46:51.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.844+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:35ed0db6-4f54-4e96-b306-71079c84e007.4596.8 : miss 2024-09-12T17:46:51.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.844+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:46:51.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:35ed0db6-4f54-4e96-b306-71079c84e007.4596.8 info.flags=0x17 2024-09-12T17:46:51.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:35ed0db6-4f54-4e96-b306-71079c84e007.4596.8 to cache LRU end 2024-09-12T17:46:51.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:46:51.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:35ed0db6-4f54-4e96-b306-71079c84e007.4596.8 2024-09-12T17:46:51.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:46:51.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:46:51.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:46:51.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:46:51.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a803c0b0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x563cbb9425b8 s->prefetch_data=0 2024-09-12T17:46:51.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 10 manifest: total_size = 38 2024-09-12T17:46:51.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.6648926507531181743 2024-09-12T17:46:51.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a803c0b0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x563cbb9425b8 s->prefetch_data=0 2024-09-12T17:46:51.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb9425b8 2024-09-12T17:46:51.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.845+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.8.0 2024-09-12T17:46:51.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.848+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a803c0b0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x563cbb9425b8 s->prefetch_data=0 2024-09-12T17:46:51.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.848+0000 7f74bbb39800 10 manifest: total_size = 527 2024-09-12T17:46:51.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.848+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.16191716488317105554 2024-09-12T17:46:51.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.848+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a803c0b0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x563cbb9425b8 s->prefetch_data=0 2024-09-12T17:46:51.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.848+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb9425b8 2024-09-12T17:46:51.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.848+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.8.0 2024-09-12T17:46:51.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.849+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:46:51.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.850+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0070e60 obj=test-client.0-r-test-small-obj-data.2:___ state=0x563cbb9425b8 s->prefetch_data=0 2024-09-12T17:46:51.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.851+0000 7f74bbb39800 10 manifest: total_size = 2078 2024-09-12T17:46:51.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.851+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.3129218720990683025 2024-09-12T17:46:51.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.851+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0070e60 obj=test-client.0-r-test-small-obj-data.2:___ state=0x563cbb9425b8 s->prefetch_data=0 2024-09-12T17:46:51.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.851+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb9425b8 2024-09-12T17:46:51.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.851+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.8.0 2024-09-12T17:46:51.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.852+0000 7f739affd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:46:51.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.853+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-small-obj-data.2:obj state=0x563cbb9425b8 s->prefetch_data=0 2024-09-12T17:46:51.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.854+0000 7f74bbb39800 10 manifest: total_size = 38 2024-09-12T17:46:51.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.854+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.8704372539101347704 2024-09-12T17:46:51.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.854+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b0061f30 obj=test-client.0-r-test-small-obj-data.2:obj state=0x563cbb9425b8 s->prefetch_data=0 2024-09-12T17:46:51.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.854+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb9425b8 2024-09-12T17:46:51.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.854+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.8.0 2024-09-12T17:46:51.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.855+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:46:51.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.856+0000 7f74bbb39800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:46:51.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.856+0000 7f74bbb39800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:46:51.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.857+0000 7f739affd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:46:51.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.857+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:46:51.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.857+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:46:51.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.857+0000 7f74bbb39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:46:51.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.857+0000 7f74bbb39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:46:51.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.857+0000 7f74bbb39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[35ed0db6-4f54-4e96-b306-71079c84e007.4596.8])"; uploads.size()=0; is_truncated=0 2024-09-12T17:46:51.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.859+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T17:46:51.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.859+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.859+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:46:51.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.859+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T17:46:51.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.859+0000 7f74bbb39800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T17:46:51.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.860+0000 7f74bbb39800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T17:46:51.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.860+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T17:46:51.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.860+0000 7f739a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529764 cookie 94818844703936 notifier 5633 bl.length()=181 2024-09-12T17:46:51.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.862+0000 7f74bbb39800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:35ed0db6-4f54-4e96-b306-71079c84e007.4596.8 from cache 2024-09-12T17:46:51.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.862+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:35ed0db6-4f54-4e96-b306-71079c84e007.4596.8, ofs0, ns] 2024-09-12T17:46:51.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.862+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529686 cookie 94818844709984 notifier 5633 bl.length()=238 2024-09-12T17:46:51.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.863+0000 7f74bbb39800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/35ed0db6-4f54-4e96-b306-71079c84e007.4596.8 : miss 2024-09-12T17:46:51.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.863+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.863+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.863+0000 7f74bbb39800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/35ed0db6-4f54-4e96-b306-71079c84e007.4596.8 info.flags=0x0 2024-09-12T17:46:51.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.863+0000 7f74bbb39800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/35ed0db6-4f54-4e96-b306-71079c84e007.4596.8 to cache LRU end 2024-09-12T17:46:51.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.866+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:35ed0db6-4f54-4e96-b306-71079c84e007.4596.9 : miss 2024-09-12T17:46:51.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.866+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.866+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:46:51.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.866+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:35ed0db6-4f54-4e96-b306-71079c84e007.4596.9 info.flags=0x17 2024-09-12T17:46:51.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.866+0000 7f74bbb39800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:35ed0db6-4f54-4e96-b306-71079c84e007.4596.9 to cache LRU end 2024-09-12T17:46:51.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.866+0000 7f74bbb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:51.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.866+0000 7f74bbb39800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:46:51.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.866+0000 7f74bbb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:35ed0db6-4f54-4e96-b306-71079c84e007.4596.9 2024-09-12T17:46:51.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.867+0000 7f74bbb39800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:46:51.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.867+0000 7f74bbb39800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:46:51.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.867+0000 7f74bbb39800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:46:51.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.867+0000 7f74bbb39800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:46:51.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.867+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b00462e0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x563cbb942ce8 s->prefetch_data=0 2024-09-12T17:46:51.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.867+0000 7f74bbb39800 10 manifest: total_size = 49187 2024-09-12T17:46:51.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.867+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.5554620258450512158 2024-09-12T17:46:51.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.867+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b00462e0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x563cbb942ce8 s->prefetch_data=0 2024-09-12T17:46:51.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.867+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb942ce8 2024-09-12T17:46:51.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.867+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.9.0 2024-09-12T17:46:51.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.870+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb928280 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x563cbb942ce8 s->prefetch_data=0 2024-09-12T17:46:51.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.870+0000 7f74bbb39800 10 manifest: total_size = 49187 2024-09-12T17:46:51.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.870+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.11363064914931510823 2024-09-12T17:46:51.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.870+0000 7f74bbb39800 20 get_obj_state: octx=0x563cbb928280 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x563cbb942ce8 s->prefetch_data=0 2024-09-12T17:46:51.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.870+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb942ce8 2024-09-12T17:46:51.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.870+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.9.0 2024-09-12T17:46:51.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.871+0000 7f739affd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:46:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.873+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b00462e0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x563cbb942ce8 s->prefetch_data=0 2024-09-12T17:46:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.873+0000 7f74bbb39800 10 manifest: total_size = 4134 2024-09-12T17:46:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.873+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.4978344445396421197 2024-09-12T17:46:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.873+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74b00462e0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x563cbb942ce8 s->prefetch_data=0 2024-09-12T17:46:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.873+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb942ce8 2024-09-12T17:46:51.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.873+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.9.0 2024-09-12T17:46:51.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.874+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:46:51.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.876+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a8074900 obj=test-client.0-r-test-small-obj-data.3:obj state=0x563cbb942ce8 s->prefetch_data=0 2024-09-12T17:46:51.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.876+0000 7f74bbb39800 10 manifest: total_size = 55 2024-09-12T17:46:51.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.876+0000 7f74bbb39800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.6738198073450347804 2024-09-12T17:46:51.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.876+0000 7f74bbb39800 20 get_obj_state: octx=0x7f74a8074900 obj=test-client.0-r-test-small-obj-data.3:obj state=0x563cbb942ce8 s->prefetch_data=0 2024-09-12T17:46:51.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.876+0000 7f74bbb39800 20 prepare_atomic_modification: state is not atomic. state=0x563cbb942ce8 2024-09-12T17:46:51.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.876+0000 7f74bbb39800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.9.0 2024-09-12T17:46:51.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.877+0000 7f739affd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:46:51.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.879+0000 7f74bbb39800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:46:51.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.879+0000 7f74bbb39800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:46:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.880+0000 7f739a7fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:46:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.880+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:46:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.880+0000 7f74bbb39800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:46:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.880+0000 7f74bbb39800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:46:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.880+0000 7f74bbb39800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:46:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.880+0000 7f74bbb39800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[35ed0db6-4f54-4e96-b306-71079c84e007.4596.9])"; uploads.size()=0; is_truncated=0 2024-09-12T17:46:51.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.881+0000 7f74bbb39800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T17:46:51.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.881+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.882+0000 7f74bbb39800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:46:51.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.882+0000 7f74bbb39800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T17:46:51.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.882+0000 7f74bbb39800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T17:46:51.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.883+0000 7f74bbb39800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T17:46:51.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.883+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T17:46:51.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.883+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529765 cookie 94818844703936 notifier 5633 bl.length()=181 2024-09-12T17:46:51.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.885+0000 7f74bbb39800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:35ed0db6-4f54-4e96-b306-71079c84e007.4596.9 from cache 2024-09-12T17:46:51.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.885+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:35ed0db6-4f54-4e96-b306-71079c84e007.4596.9, ofs0, ns] 2024-09-12T17:46:51.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.885+0000 7f739a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529687 cookie 94818844709984 notifier 5633 bl.length()=238 2024-09-12T17:46:51.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.887+0000 7f74bbb39800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/35ed0db6-4f54-4e96-b306-71079c84e007.4596.9 : miss 2024-09-12T17:46:51.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.887+0000 7f74bbb39800 20 rados->read ofs=0 len=0 2024-09-12T17:46:51.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.887+0000 7f74bbb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:51.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.887+0000 7f74bbb39800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/35ed0db6-4f54-4e96-b306-71079c84e007.4596.9 info.flags=0x0 2024-09-12T17:46:51.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.887+0000 7f74bbb39800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/35ed0db6-4f54-4e96-b306-71079c84e007.4596.9 to cache LRU end 2024-09-12T17:46:51.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.889+0000 7f74bbb39800 10 removing key index: AEWABAFFNVXAKJVARPCT 2024-09-12T17:46:51.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.890+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:AEWABAFFNVXAKJVARPCT, ofs0, ns] 2024-09-12T17:46:51.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.890+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529693 cookie 94818844705472 notifier 5633 bl.length()=170 2024-09-12T17:46:51.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.891+0000 7f74bbb39800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T17:46:51.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.892+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:46:51.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.892+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529694 cookie 94818844705472 notifier 5633 bl.length()=182 2024-09-12T17:46:51.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.892+0000 7f74bbb39800 10 removing user buckets index 2024-09-12T17:46:51.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.893+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T17:46:51.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.894+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529686 cookie 94818844717232 notifier 5633 bl.length()=173 2024-09-12T17:46:51.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.894+0000 7f74bbb39800 10 removing user index: ragweed.client.0 2024-09-12T17:46:51.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.895+0000 7f74bbb39800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T17:46:51.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.895+0000 7f74bbb39800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:46:51.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.896+0000 7f739affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529702 cookie 94818844707488 notifier 5633 bl.length()=165 2024-09-12T17:46:51.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.897+0000 7f736dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:51.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.899+0000 7f74bbb39800 20 remove_watcher() i=0 2024-09-12T17:46:51.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.899+0000 7f74bbb39800 2 removed watcher, disabling cache 2024-09-12T17:46:51.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.900+0000 7f74bbb39800 20 remove_watcher() i=1 2024-09-12T17:46:51.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.901+0000 7f74bbb39800 20 remove_watcher() i=2 2024-09-12T17:46:51.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.902+0000 7f74bbb39800 20 remove_watcher() i=3 2024-09-12T17:46:51.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.903+0000 7f74bbb39800 20 remove_watcher() i=4 2024-09-12T17:46:51.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.904+0000 7f74bbb39800 20 remove_watcher() i=5 2024-09-12T17:46:51.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.905+0000 7f74bbb39800 20 remove_watcher() i=6 2024-09-12T17:46:51.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:51.906+0000 7f74bbb39800 20 remove_watcher() i=7 2024-09-12T17:46:51.918 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T17:46:51.974 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:51.974 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:52.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.007+0000 7ff797f2a800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.008+0000 7ff797f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.008+0000 7ff797f2a800 20 realm 2024-09-12T17:46:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.008+0000 7ff797f2a800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.008+0000 7ff797f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.008+0000 7ff797f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.008+0000 7ff797f2a800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.009+0000 7ff797f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.009+0000 7ff797f2a800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.009+0000 7ff797f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.009+0000 7ff797f2a800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.010+0000 7ff797f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.010+0000 7ff797f2a800 20 searching for the correct realm 2024-09-12T17:46:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.012+0000 7ff78b4ac640 0 -- 172.21.15.107:0/3781371903 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7ff77c02f070 msgr2=0x7ff77c0a4530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.016+0000 7ff793cad640 0 -- 172.21.15.107:0/3781371903 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7ff77c0a65c0 msgr2=0x7ff77c0a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:52.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.223+0000 7ff797f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:52.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.223+0000 7ff797f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:52.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.223+0000 7ff797f2a800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:46:52.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.223+0000 7ff797f2a800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:46:52.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.223+0000 7ff797f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:52.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.223+0000 7ff797f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:52.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.223+0000 7ff797f2a800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.223+0000 7ff797f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:52.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.223+0000 7ff797f2a800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.223+0000 7ff797f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:52.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.223+0000 7ff797f2a800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:52.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 20 zone default found 2024-09-12T17:46:52.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 4 Realm: () 2024-09-12T17:46:52.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:46:52.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:46:52.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:52.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 20 zonegroup default 2024-09-12T17:46:52.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:52.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:52.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:52.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 20 started sync module instance, tier type = 2024-09-12T17:46:52.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.224+0000 7ff797f2a800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:46:52.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.234+0000 7ff797f2a800 20 add_watcher() i=0 2024-09-12T17:46:52.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.234+0000 7ff797f2a800 20 add_watcher() i=1 2024-09-12T17:46:52.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.234+0000 7ff797f2a800 20 add_watcher() i=2 2024-09-12T17:46:52.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.234+0000 7ff797f2a800 20 add_watcher() i=3 2024-09-12T17:46:52.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.234+0000 7ff797f2a800 20 add_watcher() i=4 2024-09-12T17:46:52.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.234+0000 7ff797f2a800 20 add_watcher() i=5 2024-09-12T17:46:52.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.234+0000 7ff797f2a800 20 add_watcher() i=6 2024-09-12T17:46:52.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.235+0000 7ff797f2a800 20 add_watcher() i=7 2024-09-12T17:46:52.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.235+0000 7ff797f2a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:52.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.236+0000 7ff649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:52.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.236+0000 7ff797f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:52.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.236+0000 7ff797f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:52.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.271+0000 7ff648fe1640 20 reqs_thread_entry: start 2024-09-12T17:46:52.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.271+0000 7ff797f2a800 20 init_complete bucket index max shards: 1 2024-09-12T17:46:52.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.271+0000 7ff797f2a800 20 Filter name: none 2024-09-12T17:46:52.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.271+0000 7ff5c27fc640 20 reqs_thread_entry: start 2024-09-12T17:46:52.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.271+0000 7ff797f2a800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:46:52.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.271+0000 7ff797f2a800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.272+0000 7ff797f2a800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:46:52.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.272+0000 7ff797f2a800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T17:46:52.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.272+0000 7ff797f2a800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:46:52.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.272+0000 7ff797f2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:52.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.272+0000 7ff797f2a800 10 removing key index: KSMQNZEOORRMAQBLYQRF 2024-09-12T17:46:52.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.273+0000 7ff797f2a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:KSMQNZEOORRMAQBLYQRF, ofs0, ns] 2024-09-12T17:46:52.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.274+0000 7ff672ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529695 cookie 94361817360320 notifier 5651 bl.length()=170 2024-09-12T17:46:52.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.274+0000 7ff797f2a800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T17:46:52.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.275+0000 7ff797f2a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:46:52.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.275+0000 7ff6727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529703 cookie 94361815952528 notifier 5651 bl.length()=182 2024-09-12T17:46:52.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.276+0000 7ff797f2a800 10 removing user buckets index 2024-09-12T17:46:52.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.277+0000 7ff797f2a800 10 removing user index: sysuser.client.0 2024-09-12T17:46:52.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.278+0000 7ff797f2a800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T17:46:52.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.278+0000 7ff797f2a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:46:52.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.278+0000 7ff672ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529696 cookie 94361817360320 notifier 5651 bl.length()=165 2024-09-12T17:46:52.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.279+0000 7ff649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:52.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.281+0000 7ff797f2a800 20 remove_watcher() i=0 2024-09-12T17:46:52.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.281+0000 7ff797f2a800 2 removed watcher, disabling cache 2024-09-12T17:46:52.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.282+0000 7ff797f2a800 20 remove_watcher() i=1 2024-09-12T17:46:52.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.284+0000 7ff797f2a800 20 remove_watcher() i=2 2024-09-12T17:46:52.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.284+0000 7ff797f2a800 20 remove_watcher() i=3 2024-09-12T17:46:52.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.285+0000 7ff797f2a800 20 remove_watcher() i=4 2024-09-12T17:46:52.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.287+0000 7ff797f2a800 20 remove_watcher() i=5 2024-09-12T17:46:52.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.287+0000 7ff797f2a800 20 remove_watcher() i=6 2024-09-12T17:46:52.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:46:52.289+0000 7ff797f2a800 20 remove_watcher() i=7 2024-09-12T17:46:52.300 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T17:46:52.300 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:46:52.372 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:46:52.389 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:46:52.390 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:46:52.390 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:46:52.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:46:52.418 INFO:teuthology.orchestra.run.smithi107.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:46:52.419 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:46:52.488 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:46:52.488 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:46:52.557 INFO:tasks.workunit:timeout=3h 2024-09-12T17:46:52.558 INFO:tasks.workunit:cleanup=True 2024-09-12T17:46:52.558 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:46:52.627 INFO:tasks.workunit.client.0.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:47:51.604 INFO:tasks.workunit.client.0.smithi107.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:47:51.604 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:47:51.604 INFO:tasks.workunit.client.0.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:47:51.604 INFO:tasks.workunit.client.0.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:47:51.604 INFO:tasks.workunit.client.0.smithi107.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr: git switch -c 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr:Or undo this operation with: 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr: git switch - 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:47:51.605 INFO:tasks.workunit.client.0.smithi107.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:47:51.608 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:47:51.677 INFO:tasks.workunit.client.0.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:47:51.679 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:47:51.679 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:47:51.727 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:47:51.775 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:47:51.814 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:47:51.816 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:47:51.816 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:47:51.854 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:47:51.857 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:47:51.858 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:47:51.927 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T17:47:51.928 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T17:47:51.928 DEBUG:teuthology.orchestra.run.smithi107:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:47:52.001 INFO:tasks.workunit.client.0.smithi107.stderr:+ ulimit -c 0 2024-09-12T17:47:52.001 INFO:tasks.workunit.client.0.smithi107.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:47:52.001 INFO:tasks.workunit.client.0.smithi107.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:47:52.001 INFO:tasks.workunit.client.0.smithi107.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:47:54.249 INFO:tasks.workunit.client.0.smithi107.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:47:54.249 INFO:tasks.workunit.client.0.smithi107.stderr:++ deactivate nondestructive 2024-09-12T17:47:54.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T17:47:54.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T17:47:54.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:47:54.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ hash -r 2024-09-12T17:47:54.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T17:47:54.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:47:54.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:47:54.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:47:54.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ export VIRTUAL_ENV 2024-09-12T17:47:54.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:47:54.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:47:54.250 INFO:tasks.workunit.client.0.smithi107.stderr:++ export PATH 2024-09-12T17:47:54.251 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T17:47:54.251 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -z '' ']' 2024-09-12T17:47:54.251 INFO:tasks.workunit.client.0.smithi107.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:47:54.251 INFO:tasks.workunit.client.0.smithi107.stderr:++ PS1='(rgw) ' 2024-09-12T17:47:54.251 INFO:tasks.workunit.client.0.smithi107.stderr:++ export PS1 2024-09-12T17:47:54.251 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:47:54.251 INFO:tasks.workunit.client.0.smithi107.stderr:++ hash -r 2024-09-12T17:47:54.251 INFO:tasks.workunit.client.0.smithi107.stderr:+ pip install pip --upgrade 2024-09-12T17:47:54.477 INFO:tasks.workunit.client.0.smithi107.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:47:54.652 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting pip 2024-09-12T17:47:54.657 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:47:54.701 INFO:tasks.workunit.client.0.smithi107.stdout:Installing collected packages: pip 2024-09-12T17:47:54.701 INFO:tasks.workunit.client.0.smithi107.stdout: Attempting uninstall: pip 2024-09-12T17:47:54.701 INFO:tasks.workunit.client.0.smithi107.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:47:54.854 INFO:tasks.workunit.client.0.smithi107.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:47:54.859 INFO:tasks.workunit.client.0.smithi107.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:47:55.585 INFO:tasks.workunit.client.0.smithi107.stdout:Successfully installed pip-24.2 2024-09-12T17:47:55.632 INFO:tasks.workunit.client.0.smithi107.stderr:+ pip install boto3 2024-09-12T17:47:56.403 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting boto3 2024-09-12T17:47:56.405 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:47:56.997 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:47:56.998 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:47:57.049 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:47:57.050 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:47:57.109 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:47:57.110 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:47:57.159 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:47:57.160 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:47:57.237 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:47:57.238 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:47:57.432 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:47:57.433 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:47:57.437 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:47:57.438 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:47:57.447 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:47:57.449 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:47:57.450 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:47:57.451 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:47:57.453 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:47:57.525 INFO:tasks.workunit.client.0.smithi107.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:47:58.535 INFO:tasks.workunit.client.0.smithi107.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:47:58.652 INFO:tasks.workunit.client.0.smithi107.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T17:47:58.774 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T17:47:58.811 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:58.811 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:58.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.846+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.848+0000 7f771a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:58.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.848+0000 7f771a00e800 20 realm 2024-09-12T17:47:58.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.848+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.848+0000 7f771a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:58.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.848+0000 7f771a00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:58.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.848+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.848+0000 7f771a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:58.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.848+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.849+0000 7f771a00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:58.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.849+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.849+0000 7f771a00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:58.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.849+0000 7f771a00e800 20 searching for the correct realm 2024-09-12T17:47:58.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.853+0000 7f7715e5a640 0 -- 172.21.15.107:0/1901522348 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x56036a1e8200 msgr2=0x56036a1ea6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:58.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.856+0000 7f7715659640 0 -- 172.21.15.107:0/1901522348 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f770c08f7d0 msgr2=0x7f770c015820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:58.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:58.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:58.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:47:58.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:47:58.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:58.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:58.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:58.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:58.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:58.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 zone default found 2024-09-12T17:47:58.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 4 Realm: () 2024-09-12T17:47:58.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:47:58.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:47:58.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:58.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 zonegroup default 2024-09-12T17:47:58.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.861+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.862+0000 7f771a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:58.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.862+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.862+0000 7f771a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:58.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.862+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.862+0000 7f771a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:58.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.862+0000 7f771a00e800 20 started sync module instance, tier type = 2024-09-12T17:47:58.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.862+0000 7f771a00e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:47:58.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.872+0000 7f771a00e800 20 add_watcher() i=0 2024-09-12T17:47:58.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.872+0000 7f771a00e800 20 add_watcher() i=1 2024-09-12T17:47:58.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.872+0000 7f771a00e800 20 add_watcher() i=2 2024-09-12T17:47:58.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.872+0000 7f771a00e800 20 add_watcher() i=3 2024-09-12T17:47:58.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.872+0000 7f771a00e800 20 add_watcher() i=4 2024-09-12T17:47:58.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.872+0000 7f771a00e800 20 add_watcher() i=5 2024-09-12T17:47:58.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.872+0000 7f771a00e800 20 add_watcher() i=6 2024-09-12T17:47:58.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.873+0000 7f771a00e800 20 add_watcher() i=7 2024-09-12T17:47:58.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.873+0000 7f771a00e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:58.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.874+0000 7f75cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:58.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.875+0000 7f771a00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:58.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.875+0000 7f771a00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:58.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.875+0000 7f771a00e800 5 note: GC not initialized 2024-09-12T17:47:58.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.875+0000 7f75cafe5640 20 reqs_thread_entry: start 2024-09-12T17:47:58.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.875+0000 7f771a00e800 20 init_complete bucket index max shards: 1 2024-09-12T17:47:58.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.875+0000 7f771a00e800 20 Filter name: none 2024-09-12T17:47:58.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.875+0000 7f75c8fe1640 20 reqs_thread_entry: start 2024-09-12T17:47:58.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.875+0000 7f771a00e800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T17:47:58.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.875+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.876+0000 7f771a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:58.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.876+0000 7f771a00e800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T17:47:58.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.876+0000 7f771a00e800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:47:58.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.876+0000 7f771a00e800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T17:47:58.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.876+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.876+0000 7f771a00e800 20 rados_obj.operate() r=0 bl.length=22 2024-09-12T17:47:58.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.876+0000 7f771a00e800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-12T17:47:58.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.876+0000 7f771a00e800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:47:58.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.876+0000 7f771a00e800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-12T17:47:58.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.876+0000 7f771a00e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:58.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.877+0000 7f771a00e800 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T17:47:58.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.877+0000 7f771a00e800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-12T17:47:58.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.877+0000 7f771a00e800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-12T17:47:58.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.877+0000 7f771a00e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:58.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.877+0000 7f771a00e800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-12T17:47:58.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.877+0000 7f771a00e800 20 get_user_info_from_index found 0 xattrs 2024-09-12T17:47:58.880 INFO:tasks.workunit.client.0.smithi107.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-12T17:47:58.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.877+0000 7f75cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:58.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.880+0000 7f771a00e800 20 remove_watcher() i=0 2024-09-12T17:47:58.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.880+0000 7f771a00e800 2 removed watcher, disabling cache 2024-09-12T17:47:58.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.881+0000 7f771a00e800 20 remove_watcher() i=1 2024-09-12T17:47:58.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.882+0000 7f771a00e800 20 remove_watcher() i=2 2024-09-12T17:47:58.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.883+0000 7f771a00e800 20 remove_watcher() i=3 2024-09-12T17:47:58.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.884+0000 7f771a00e800 20 remove_watcher() i=4 2024-09-12T17:47:58.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.885+0000 7f771a00e800 20 remove_watcher() i=5 2024-09-12T17:47:58.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.886+0000 7f771a00e800 20 remove_watcher() i=6 2024-09-12T17:47:58.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:58.887+0000 7f771a00e800 20 remove_watcher() i=7 2024-09-12T17:47:59.113 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard add 2024-09-12T17:47:59.113 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:47:59.114 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:47:59.142 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:59.142 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:59.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.178+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.179+0000 7ff068b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.179+0000 7ff068b39800 20 realm 2024-09-12T17:47:59.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.179+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.180+0000 7ff068b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.180+0000 7ff068b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:59.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.180+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.180+0000 7ff068b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.180+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.181+0000 7ff068b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:59.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.181+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.181+0000 7ff068b39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:59.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.181+0000 7ff068b39800 20 searching for the correct realm 2024-09-12T17:47:59.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.185+0000 7ff05bfc6640 0 -- 172.21.15.107:0/1145942929 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7ff04c082410 msgr2=0x7ff04c082870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:59.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.387+0000 7ff0647c7640 0 -- 172.21.15.107:0/1145942929 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7ff04c092040 msgr2=0x7ff04c094970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:59.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.393+0000 7ff068b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:59.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.393+0000 7ff068b39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:59.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.393+0000 7ff068b39800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:47:59.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.393+0000 7ff068b39800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:47:59.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.393+0000 7ff068b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:59.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.393+0000 7ff068b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:59.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.393+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.393+0000 7ff068b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.393+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.393+0000 7ff068b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:59.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.393+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:59.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 20 zone default found 2024-09-12T17:47:59.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 4 Realm: () 2024-09-12T17:47:59.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:47:59.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:47:59.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:59.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 20 zonegroup default 2024-09-12T17:47:59.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 20 started sync module instance, tier type = 2024-09-12T17:47:59.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.394+0000 7ff068b39800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:47:59.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.404+0000 7ff068b39800 20 add_watcher() i=0 2024-09-12T17:47:59.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.404+0000 7ff068b39800 20 add_watcher() i=1 2024-09-12T17:47:59.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.404+0000 7ff068b39800 20 add_watcher() i=2 2024-09-12T17:47:59.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.404+0000 7ff068b39800 20 add_watcher() i=3 2024-09-12T17:47:59.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.404+0000 7ff068b39800 20 add_watcher() i=4 2024-09-12T17:47:59.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.404+0000 7ff068b39800 20 add_watcher() i=5 2024-09-12T17:47:59.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.404+0000 7ff068b39800 20 add_watcher() i=6 2024-09-12T17:47:59.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.405+0000 7ff068b39800 20 add_watcher() i=7 2024-09-12T17:47:59.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.405+0000 7ff068b39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:59.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.407+0000 7fef1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:59.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.407+0000 7ff068b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:59.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.407+0000 7ff068b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:59.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.407+0000 7ff068b39800 5 note: GC not initialized 2024-09-12T17:47:59.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.408+0000 7fef19fdb640 20 reqs_thread_entry: start 2024-09-12T17:47:59.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.408+0000 7ff068b39800 20 init_complete bucket index max shards: 1 2024-09-12T17:47:59.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.408+0000 7ff068b39800 20 Filter name: none 2024-09-12T17:47:59.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.408+0000 7fee8b7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:59.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.408+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.408+0000 7ff068b39800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:59.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.408+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.409+0000 7ff068b39800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:59.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.409+0000 7ff068b39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:59.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.409+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.410+0000 7ff068b39800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:59.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.410+0000 7ff068b39800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.410+0000 7ff068b39800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:59.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.410+0000 7ff068b39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:47:59.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.412+0000 7fef1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:59.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.414+0000 7ff068b39800 20 remove_watcher() i=0 2024-09-12T17:47:59.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.414+0000 7ff068b39800 2 removed watcher, disabling cache 2024-09-12T17:47:59.416 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.416+0000 7ff068b39800 20 remove_watcher() i=1 2024-09-12T17:47:59.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.417+0000 7ff068b39800 20 remove_watcher() i=2 2024-09-12T17:47:59.418 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.418+0000 7ff068b39800 20 remove_watcher() i=3 2024-09-12T17:47:59.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.419+0000 7ff068b39800 20 remove_watcher() i=4 2024-09-12T17:47:59.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.420+0000 7ff068b39800 20 remove_watcher() i=5 2024-09-12T17:47:59.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.421+0000 7ff068b39800 20 remove_watcher() i=6 2024-09-12T17:47:59.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.422+0000 7ff068b39800 20 remove_watcher() i=7 2024-09-12T17:47:59.433 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:47:59.433 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:47:59.433 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: a-bucket id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T17:47:59.433 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:47:59.435 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-12T17:47:59.465 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:59.465 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:59.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.501+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.502+0000 7f71ee933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.502+0000 7f71ee933800 20 realm 2024-09-12T17:47:59.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.502+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.503+0000 7f71ee933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.503+0000 7f71ee933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:59.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.503+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.503+0000 7f71ee933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.503+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.504+0000 7f71ee933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:59.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.504+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.504+0000 7f71ee933800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:59.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.504+0000 7f71ee933800 20 searching for the correct realm 2024-09-12T17:47:59.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.508+0000 7f71e3fff640 0 -- 172.21.15.107:0/4065019716 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f71d4018070 msgr2=0x7f71d408a900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:59.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.511+0000 7f71eae77640 0 -- 172.21.15.107:0/4065019716 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7f71d406f030 msgr2=0x7f71d405fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:59.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.515+0000 7f71ee933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:59.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.515+0000 7f71ee933800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:59.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.515+0000 7f71ee933800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:47:59.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.515+0000 7f71ee933800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:47:59.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.515+0000 7f71ee933800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:59.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.515+0000 7f71ee933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:59.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.515+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.516+0000 7f71ee933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.516+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.516+0000 7f71ee933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:59.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.516+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.516+0000 7f71ee933800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:59.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.516+0000 7f71ee933800 20 zone default found 2024-09-12T17:47:59.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.516+0000 7f71ee933800 4 Realm: () 2024-09-12T17:47:59.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.516+0000 7f71ee933800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:47:59.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.516+0000 7f71ee933800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:47:59.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.516+0000 7f71ee933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:59.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.516+0000 7f71ee933800 20 zonegroup default 2024-09-12T17:47:59.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.516+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.517+0000 7f71ee933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.517+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.517+0000 7f71ee933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.517+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.517+0000 7f71ee933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.517+0000 7f71ee933800 20 started sync module instance, tier type = 2024-09-12T17:47:59.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.517+0000 7f71ee933800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:47:59.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.526+0000 7f71ee933800 20 add_watcher() i=0 2024-09-12T17:47:59.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.526+0000 7f71ee933800 20 add_watcher() i=1 2024-09-12T17:47:59.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.526+0000 7f71ee933800 20 add_watcher() i=2 2024-09-12T17:47:59.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.526+0000 7f71ee933800 20 add_watcher() i=3 2024-09-12T17:47:59.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.526+0000 7f71ee933800 20 add_watcher() i=4 2024-09-12T17:47:59.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.526+0000 7f71ee933800 20 add_watcher() i=5 2024-09-12T17:47:59.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.526+0000 7f71ee933800 20 add_watcher() i=6 2024-09-12T17:47:59.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.527+0000 7f71ee933800 20 add_watcher() i=7 2024-09-12T17:47:59.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.527+0000 7f71ee933800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.528+0000 7f70a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.529+0000 7f71ee933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.529+0000 7f71ee933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.529+0000 7f71ee933800 5 note: GC not initialized 2024-09-12T17:47:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.529+0000 7f701b7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.529+0000 7f71ee933800 20 init_complete bucket index max shards: 1 2024-09-12T17:47:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.529+0000 7f71ee933800 20 Filter name: none 2024-09-12T17:47:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.529+0000 7f70197fa640 20 reqs_thread_entry: start 2024-09-12T17:47:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.529+0000 7f71ee933800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:47:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.529+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.530+0000 7f71ee933800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.530+0000 7f71ee933800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:47:59.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.530+0000 7f71ee933800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:47:59.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.530+0000 7f71ee933800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:47:59.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.530+0000 7f71ee933800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.530+0000 7f71ee933800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:59.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.530+0000 7f71ee933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:47:59.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.530+0000 7f71ee933800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:47:59.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.530+0000 7f71ee933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:59.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.530+0000 7f71ee933800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:59.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.530+0000 7f71ee933800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:47:59.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.532+0000 7f70a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:59.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.534+0000 7f71ee933800 20 remove_watcher() i=0 2024-09-12T17:47:59.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.534+0000 7f71ee933800 2 removed watcher, disabling cache 2024-09-12T17:47:59.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.535+0000 7f71ee933800 20 remove_watcher() i=1 2024-09-12T17:47:59.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.536+0000 7f71ee933800 20 remove_watcher() i=2 2024-09-12T17:47:59.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.537+0000 7f71ee933800 20 remove_watcher() i=3 2024-09-12T17:47:59.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.538+0000 7f71ee933800 20 remove_watcher() i=4 2024-09-12T17:47:59.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.539+0000 7f71ee933800 20 remove_watcher() i=5 2024-09-12T17:47:59.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.540+0000 7f71ee933800 20 remove_watcher() i=6 2024-09-12T17:47:59.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.541+0000 7f71ee933800 20 remove_watcher() i=7 2024-09-12T17:47:59.554 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshard list 2024-09-12T17:47:59.580 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:59.580 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:59.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.617+0000 7f1422d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.618+0000 7f1422d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.619+0000 7f1422d2e800 20 realm 2024-09-12T17:47:59.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.619+0000 7f1422d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.619+0000 7f1422d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.619+0000 7f1422d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:59.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.619+0000 7f1422d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.619+0000 7f1422d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.620 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.619+0000 7f1422d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.620+0000 7f1422d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:59.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.620+0000 7f1422d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.620+0000 7f1422d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:59.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.620+0000 7f1422d2e800 20 searching for the correct realm 2024-09-12T17:47:59.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.622+0000 7f1417fff640 0 -- 172.21.15.107:0/91948984 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x556faa119270 msgr2=0x556faa11b660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:59.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.625+0000 7f1417fff640 0 -- 172.21.15.107:0/91948984 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x7f12e8086ba0 msgr2=0x7f12e8088fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:59.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.630+0000 7f1422d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:59.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.630+0000 7f1422d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:59.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.630+0000 7f1422d2e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:47:59.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.630+0000 7f1422d2e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:47:59.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.630+0000 7f1422d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:59.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.630+0000 7f1422d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:59.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.630+0000 7f1422d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:59.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 20 zone default found 2024-09-12T17:47:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 4 Realm: () 2024-09-12T17:47:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:47:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:47:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 20 zonegroup default 2024-09-12T17:47:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.631+0000 7f1422d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.632+0000 7f1422d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.632+0000 7f1422d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.632+0000 7f1422d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.632+0000 7f1422d2e800 20 started sync module instance, tier type = 2024-09-12T17:47:59.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.632+0000 7f1422d2e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:47:59.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.641+0000 7f1422d2e800 20 add_watcher() i=0 2024-09-12T17:47:59.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.641+0000 7f1422d2e800 20 add_watcher() i=1 2024-09-12T17:47:59.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.641+0000 7f1422d2e800 20 add_watcher() i=2 2024-09-12T17:47:59.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.641+0000 7f1422d2e800 20 add_watcher() i=3 2024-09-12T17:47:59.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.641+0000 7f1422d2e800 20 add_watcher() i=4 2024-09-12T17:47:59.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.641+0000 7f1422d2e800 20 add_watcher() i=5 2024-09-12T17:47:59.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.641+0000 7f1422d2e800 20 add_watcher() i=6 2024-09-12T17:47:59.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.642+0000 7f1422d2e800 20 add_watcher() i=7 2024-09-12T17:47:59.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.642+0000 7f1422d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:59.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.643+0000 7f12d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:59.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.644+0000 7f1422d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:59.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.644+0000 7f1422d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:59.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.644+0000 7f1422d2e800 5 note: GC not initialized 2024-09-12T17:47:59.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.644+0000 7f124ffff640 20 reqs_thread_entry: start 2024-09-12T17:47:59.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.644+0000 7f1422d2e800 20 init_complete bucket index max shards: 1 2024-09-12T17:47:59.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.644+0000 7f1422d2e800 20 Filter name: none 2024-09-12T17:47:59.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.644+0000 7f124dffb640 20 reqs_thread_entry: start 2024-09-12T17:47:59.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.650+0000 7f12d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:59.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.652+0000 7f1422d2e800 20 remove_watcher() i=0 2024-09-12T17:47:59.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.652+0000 7f1422d2e800 2 removed watcher, disabling cache 2024-09-12T17:47:59.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.653+0000 7f1422d2e800 20 remove_watcher() i=1 2024-09-12T17:47:59.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.654+0000 7f1422d2e800 20 remove_watcher() i=2 2024-09-12T17:47:59.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.655+0000 7f1422d2e800 20 remove_watcher() i=3 2024-09-12T17:47:59.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.656+0000 7f1422d2e800 20 remove_watcher() i=4 2024-09-12T17:47:59.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.657+0000 7f1422d2e800 20 remove_watcher() i=5 2024-09-12T17:47:59.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.658+0000 7f1422d2e800 20 remove_watcher() i=6 2024-09-12T17:47:59.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.659+0000 7f1422d2e800 20 remove_watcher() i=7 2024-09-12T17:47:59.671 INFO:tasks.workunit.client.0.smithi107.stderr:bucket name a-bucket 2024-09-12T17:47:59.671 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard process 2024-09-12T17:47:59.671 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:47:59.673 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshard process 2024-09-12T17:47:59.699 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:59.699 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:59.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.735+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.736+0000 7fe189f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.736+0000 7fe189f46800 20 realm 2024-09-12T17:47:59.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.736+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.736+0000 7fe189f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.736+0000 7fe189f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:59.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.736+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.736+0000 7fe189f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.736+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.737+0000 7fe189f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:59.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.737+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.738+0000 7fe189f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:59.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.738+0000 7fe189f46800 20 searching for the correct realm 2024-09-12T17:47:59.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.740+0000 7fe17ffff640 0 -- 172.21.15.107:0/1390490320 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fe17002ba80 msgr2=0x7fe170016410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:59.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.744+0000 7fe187a30640 0 -- 172.21.15.107:0/1390490320 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fe170043950 msgr2=0x7fe170052400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:59.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.950+0000 7fe189f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:59.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.950+0000 7fe189f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:59.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.950+0000 7fe189f46800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:47:59.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.950+0000 7fe189f46800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:47:59.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.950+0000 7fe189f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:59.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.950+0000 7fe189f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:59.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.950+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.950+0000 7fe189f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.950+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.951+0000 7fe189f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:59.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.951+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.951+0000 7fe189f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:59.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.951+0000 7fe189f46800 20 zone default found 2024-09-12T17:47:59.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.951+0000 7fe189f46800 4 Realm: () 2024-09-12T17:47:59.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.951+0000 7fe189f46800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:47:59.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.951+0000 7fe189f46800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:47:59.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.951+0000 7fe189f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:59.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.951+0000 7fe189f46800 20 zonegroup default 2024-09-12T17:47:59.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.951+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.951+0000 7fe189f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.951+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.952+0000 7fe189f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.952+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.952+0000 7fe189f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:59.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.952+0000 7fe189f46800 20 started sync module instance, tier type = 2024-09-12T17:47:59.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.952+0000 7fe189f46800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:47:59.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.961+0000 7fe189f46800 20 add_watcher() i=0 2024-09-12T17:47:59.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.961+0000 7fe189f46800 20 add_watcher() i=1 2024-09-12T17:47:59.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.961+0000 7fe189f46800 20 add_watcher() i=2 2024-09-12T17:47:59.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.961+0000 7fe189f46800 20 add_watcher() i=3 2024-09-12T17:47:59.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.961+0000 7fe189f46800 20 add_watcher() i=4 2024-09-12T17:47:59.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.961+0000 7fe189f46800 20 add_watcher() i=5 2024-09-12T17:47:59.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.961+0000 7fe189f46800 20 add_watcher() i=6 2024-09-12T17:47:59.963 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.961+0000 7fe189f46800 20 add_watcher() i=7 2024-09-12T17:47:59.963 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.961+0000 7fe189f46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:59.964 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.963+0000 7fe03e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:59.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.963+0000 7fe189f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:59.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.963+0000 7fe189f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:59.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.963+0000 7fe189f46800 5 note: GC not initialized 2024-09-12T17:47:59.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.963+0000 7fe03d7e2640 20 reqs_thread_entry: start 2024-09-12T17:47:59.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.964+0000 7fe189f46800 20 init_complete bucket index max shards: 1 2024-09-12T17:47:59.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.964+0000 7fe189f46800 20 Filter name: none 2024-09-12T17:47:59.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.964+0000 7fe0367fc640 20 reqs_thread_entry: start 2024-09-12T17:47:59.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.964+0000 7fe189f46800 20 processing logshard = reshard.0000000000 2024-09-12T17:47:59.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.966+0000 7fe189f46800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:47:59.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.966+0000 7fe189f46800 20 processing logshard = reshard.0000000001 2024-09-12T17:47:59.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.969+0000 7fe189f46800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:47:59.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.969+0000 7fe189f46800 20 processing logshard = reshard.0000000002 2024-09-12T17:47:59.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.971+0000 7fe189f46800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:47:59.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.971+0000 7fe189f46800 20 processing logshard = reshard.0000000003 2024-09-12T17:47:59.974 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.973+0000 7fe189f46800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:47:59.974 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.973+0000 7fe189f46800 20 processing logshard = reshard.0000000004 2024-09-12T17:47:59.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.975+0000 7fe189f46800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:47:59.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.975+0000 7fe189f46800 20 processing logshard = reshard.0000000005 2024-09-12T17:47:59.979 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.978+0000 7fe189f46800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:47:59.979 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.978+0000 7fe189f46800 20 processing logshard = reshard.0000000006 2024-09-12T17:47:59.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.979+0000 7fe189f46800 20 process_entry resharding a-bucket 2024-09-12T17:47:59.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.979+0000 7fe189f46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:47:59.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.979+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.979+0000 7fe189f46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:47:59.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.979+0000 7fe189f46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:47:59.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.979+0000 7fe189f46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:47:59.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.979+0000 7fe189f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:47:59.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.979+0000 7fe189f46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:59.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.980+0000 7fe189f46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:47:59.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.980+0000 7fe189f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:47:59.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.980+0000 7fe189f46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:47:59.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.980+0000 7fe189f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:59.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.980+0000 7fe189f46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:59.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.980+0000 7fe189f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:47:59.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.985+0000 7fe189f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:47:59.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.985+0000 7fe189f46800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:47:59.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.985+0000 7fe189f46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:59.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.985+0000 7fe189f46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:47:59.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.985+0000 7fe066ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 94678562346800 notifier 5732 bl.length()=911 2024-09-12T17:47:59.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.985+0000 7fe066ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:47:59.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.985+0000 7fe066ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:47:59.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.985+0000 7fe066ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:59.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.985+0000 7fe189f46800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:47:59.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.985+0000 7fe189f46800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:47:59.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.985+0000 7fe189f46800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:47:59.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.985+0000 7fe189f46800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:47:59.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.988+0000 7fe189f46800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.1.0 2024-09-12T17:47:59.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.988+0000 7fe189f46800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.1.0 2024-09-12T17:47:59.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.988+0000 7fe189f46800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.1.1 2024-09-12T17:47:59.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.988+0000 7fe189f46800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.1.1 2024-09-12T17:47:59.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.988+0000 7fe189f46800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.0 2024-09-12T17:47:59.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.988+0000 7fe189f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:47:59.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.988+0000 7fe189f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:47:59.990 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.990+0000 7fe189f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:47:59.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.990+0000 7fe189f46800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:47:59.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.990+0000 7fe189f46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:59.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.990+0000 7fe189f46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:47:59.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.990+0000 7fe066ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464291 cookie 94678562346800 notifier 5732 bl.length()=911 2024-09-12T17:47:59.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.990+0000 7fe066ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:47:59.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.990+0000 7fe066ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:47:59.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.990+0000 7fe066ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:59.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.990+0000 7fe189f46800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:47:59.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.990+0000 7fe189f46800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:47:59.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.990+0000 7fe189f46800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:47:59.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.990+0000 7fe189f46800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:47:59.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.991+0000 7fe189f46800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.0 2024-09-12T17:47:59.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.992+0000 7fe189f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:47:59.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.992+0000 7fe189f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:47:59.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.994+0000 7fe189f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:47:59.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.994+0000 7fe189f46800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:47:59.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.994+0000 7fe189f46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:59.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.994+0000 7fe189f46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:47:59.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.994+0000 7fe0667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94678562346800 notifier 5732 bl.length()=879 2024-09-12T17:47:59.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.994+0000 7fe0667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:47:59.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.994+0000 7fe0667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:47:59.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.994+0000 7fe0667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:47:59.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.994+0000 7fe189f46800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:47:59.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.994+0000 7fe189f46800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:47:59.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.994+0000 7fe189f46800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:47:59.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.994+0000 7fe189f46800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:47:59.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.996+0000 7fe189f46800 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-12T17:47:59.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.997+0000 7fe189f46800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:48:00.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.999+0000 7fe189f46800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:48:00.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:47:59.999+0000 7fe189f46800 20 processing logshard = reshard.0000000007 2024-09-12T17:48:00.003 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.002+0000 7fe189f46800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:48:00.003 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.002+0000 7fe189f46800 20 processing logshard = reshard.0000000008 2024-09-12T17:48:00.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.004+0000 7fe189f46800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:48:00.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.004+0000 7fe189f46800 20 processing logshard = reshard.0000000009 2024-09-12T17:48:00.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.006+0000 7fe189f46800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:48:00.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.006+0000 7fe189f46800 20 processing logshard = reshard.0000000010 2024-09-12T17:48:00.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.009+0000 7fe189f46800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:48:00.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.009+0000 7fe189f46800 20 processing logshard = reshard.0000000011 2024-09-12T17:48:00.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.011+0000 7fe189f46800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:48:00.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.011+0000 7fe189f46800 20 processing logshard = reshard.0000000012 2024-09-12T17:48:00.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.013+0000 7fe189f46800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:48:00.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.013+0000 7fe189f46800 20 processing logshard = reshard.0000000013 2024-09-12T17:48:00.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.015+0000 7fe189f46800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:48:00.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.015+0000 7fe189f46800 20 processing logshard = reshard.0000000014 2024-09-12T17:48:00.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.017+0000 7fe189f46800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:48:00.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.017+0000 7fe189f46800 20 processing logshard = reshard.0000000015 2024-09-12T17:48:00.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.020+0000 7fe189f46800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:48:00.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.021+0000 7fe03e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:00.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.023+0000 7fe189f46800 20 remove_watcher() i=0 2024-09-12T17:48:00.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.023+0000 7fe189f46800 2 removed watcher, disabling cache 2024-09-12T17:48:00.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.023+0000 7fe189f46800 20 remove_watcher() i=1 2024-09-12T17:48:00.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.024+0000 7fe189f46800 20 remove_watcher() i=2 2024-09-12T17:48:00.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.025+0000 7fe189f46800 20 remove_watcher() i=3 2024-09-12T17:48:00.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.026+0000 7fe189f46800 20 remove_watcher() i=4 2024-09-12T17:48:00.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.027+0000 7fe189f46800 20 remove_watcher() i=5 2024-09-12T17:48:00.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.028+0000 7fe189f46800 20 remove_watcher() i=6 2024-09-12T17:48:00.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:00.029+0000 7fe189f46800 20 remove_watcher() i=7 2024-09-12T17:48:05.043 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:48:05.079 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:05.079 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:05.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.119+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.121+0000 7f0540122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.121+0000 7f0540122800 20 realm 2024-09-12T17:48:05.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.121+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.121+0000 7f0540122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.121+0000 7f0540122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:05.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.121+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.121+0000 7f0540122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.123 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.121+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.123 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.122+0000 7f0540122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:05.123 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.122+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.123+0000 7f0540122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:05.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.123+0000 7f0540122800 20 searching for the correct realm 2024-09-12T17:48:05.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.126+0000 7f053c669640 0 -- 172.21.15.107:0/2705342850 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x558a028a62b0 msgr2=0x558a028a8730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:05.131 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.130+0000 7f053be68640 0 -- 172.21.15.107:0/2705342850 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f05300024e0 msgr2=0x7f0530002980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:05.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.134+0000 7f0540122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:05.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.134+0000 7f0540122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:05.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.134+0000 7f0540122800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:05.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.134+0000 7f0540122800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:05.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.134+0000 7f0540122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:05.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.134+0000 7f0540122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:05.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.134+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.134+0000 7f0540122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.134+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.135+0000 7f0540122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:05.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.135+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.135+0000 7f0540122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:05.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.135+0000 7f0540122800 20 zone default found 2024-09-12T17:48:05.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.135+0000 7f0540122800 4 Realm: () 2024-09-12T17:48:05.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.135+0000 7f0540122800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:05.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.135+0000 7f0540122800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:05.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.135+0000 7f0540122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:05.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.135+0000 7f0540122800 20 zonegroup default 2024-09-12T17:48:05.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.135+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.135+0000 7f0540122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.135+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.136+0000 7f0540122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.136+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.136+0000 7f0540122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.136+0000 7f0540122800 20 started sync module instance, tier type = 2024-09-12T17:48:05.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.136+0000 7f0540122800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:05.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.145+0000 7f0540122800 20 add_watcher() i=0 2024-09-12T17:48:05.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.145+0000 7f0540122800 20 add_watcher() i=1 2024-09-12T17:48:05.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.145+0000 7f0540122800 20 add_watcher() i=2 2024-09-12T17:48:05.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.145+0000 7f0540122800 20 add_watcher() i=3 2024-09-12T17:48:05.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.145+0000 7f0540122800 20 add_watcher() i=4 2024-09-12T17:48:05.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.145+0000 7f0540122800 20 add_watcher() i=5 2024-09-12T17:48:05.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.145+0000 7f0540122800 20 add_watcher() i=6 2024-09-12T17:48:05.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.146+0000 7f0540122800 20 add_watcher() i=7 2024-09-12T17:48:05.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.146+0000 7f0540122800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:05.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.148+0000 7f03f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:05.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.148+0000 7f0540122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:05.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.148+0000 7f0540122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:05.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.148+0000 7f0540122800 5 note: GC not initialized 2024-09-12T17:48:05.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.148+0000 7f03f0fe1640 20 reqs_thread_entry: start 2024-09-12T17:48:05.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.149+0000 7f0540122800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:05.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.149+0000 7f0540122800 20 Filter name: none 2024-09-12T17:48:05.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.149+0000 7f036a7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:05.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.149+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.149+0000 7f0540122800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:05.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.149+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.150+0000 7f0540122800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:05.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.150+0000 7f0540122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:05.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.150+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.150+0000 7f0540122800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:05.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.150+0000 7f0540122800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.151+0000 7f0540122800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:05.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.151+0000 7f0540122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:05.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.152+0000 7f03f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:05.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.154+0000 7f0540122800 20 remove_watcher() i=0 2024-09-12T17:48:05.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.154+0000 7f0540122800 2 removed watcher, disabling cache 2024-09-12T17:48:05.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.155+0000 7f0540122800 20 remove_watcher() i=1 2024-09-12T17:48:05.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.156+0000 7f0540122800 20 remove_watcher() i=2 2024-09-12T17:48:05.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.157+0000 7f0540122800 20 remove_watcher() i=3 2024-09-12T17:48:05.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.158+0000 7f0540122800 20 remove_watcher() i=4 2024-09-12T17:48:05.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.159+0000 7f0540122800 20 remove_watcher() i=5 2024-09-12T17:48:05.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.160+0000 7f0540122800 20 remove_watcher() i=6 2024-09-12T17:48:05.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.161+0000 7f0540122800 20 remove_watcher() i=7 2024-09-12T17:48:05.173 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:05.173 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:05.173 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: a-bucket id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T17:48:05.173 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:05.173 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard add non empty bucket 2024-09-12T17:48:05.173 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:05.249 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:48:05.277 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:05.278 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:05.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.313+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.314+0000 7f5384926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.314+0000 7f5384926800 20 realm 2024-09-12T17:48:05.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.314+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.315+0000 7f5384926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.315+0000 7f5384926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:05.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.315+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.315+0000 7f5384926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.315+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.316+0000 7f5384926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:05.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.316+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.316+0000 7f5384926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:05.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.316+0000 7f5384926800 20 searching for the correct realm 2024-09-12T17:48:05.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.318+0000 7f537fdd8640 0 -- 172.21.15.107:0/3634631513 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f537405d040 msgr2=0x7f53740bb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:05.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.524+0000 7f53805d9640 0 -- 172.21.15.107:0/3634631513 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f53740c7930 msgr2=0x7f53740ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:05.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.731+0000 7f5384926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:05.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.731+0000 7f5384926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:05.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.731+0000 7f5384926800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:05.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.731+0000 7f5384926800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:05.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.731+0000 7f5384926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:05.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.731+0000 7f5384926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:05.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.731+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.731+0000 7f5384926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.731+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.732+0000 7f5384926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:05.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.732+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.732+0000 7f5384926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.732+0000 7f5384926800 20 zone default found 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.732+0000 7f5384926800 4 Realm: () 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.732+0000 7f5384926800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.732+0000 7f5384926800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.732+0000 7f5384926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.732+0000 7f5384926800 20 zonegroup default 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.732+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.732+0000 7f5384926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.732+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.733+0000 7f5384926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.733+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.733+0000 7f5384926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.733+0000 7f5384926800 20 started sync module instance, tier type = 2024-09-12T17:48:05.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.733+0000 7f5384926800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:05.743 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.742+0000 7f5384926800 20 add_watcher() i=0 2024-09-12T17:48:05.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.742+0000 7f5384926800 20 add_watcher() i=1 2024-09-12T17:48:05.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.742+0000 7f5384926800 20 add_watcher() i=2 2024-09-12T17:48:05.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.742+0000 7f5384926800 20 add_watcher() i=3 2024-09-12T17:48:05.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.742+0000 7f5384926800 20 add_watcher() i=4 2024-09-12T17:48:05.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.742+0000 7f5384926800 20 add_watcher() i=5 2024-09-12T17:48:05.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.742+0000 7f5384926800 20 add_watcher() i=6 2024-09-12T17:48:05.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.743+0000 7f5384926800 20 add_watcher() i=7 2024-09-12T17:48:05.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.743+0000 7f5384926800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:05.747 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.746+0000 7f5236fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:05.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.746+0000 7f5384926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:05.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.746+0000 7f5384926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:05.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.746+0000 7f5384926800 5 note: GC not initialized 2024-09-12T17:48:05.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.746+0000 7f5235fdb640 20 reqs_thread_entry: start 2024-09-12T17:48:05.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.746+0000 7f5384926800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:05.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.746+0000 7f5384926800 20 Filter name: none 2024-09-12T17:48:05.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.747+0000 7f51a77fe640 20 reqs_thread_entry: start 2024-09-12T17:48:05.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.747+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.747+0000 7f5384926800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:05.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.747+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.748+0000 7f5384926800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:05.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.748+0000 7f5384926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:05.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.748+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.748+0000 7f5384926800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:05.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.748+0000 7f5384926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.748+0000 7f5384926800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:05.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.748+0000 7f5384926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:05.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.749+0000 7f5236fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:05.752 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.752+0000 7f5384926800 20 remove_watcher() i=0 2024-09-12T17:48:05.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.752+0000 7f5384926800 2 removed watcher, disabling cache 2024-09-12T17:48:05.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.753+0000 7f5384926800 20 remove_watcher() i=1 2024-09-12T17:48:05.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.754+0000 7f5384926800 20 remove_watcher() i=2 2024-09-12T17:48:05.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.755+0000 7f5384926800 20 remove_watcher() i=3 2024-09-12T17:48:05.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.756+0000 7f5384926800 20 remove_watcher() i=4 2024-09-12T17:48:05.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.757+0000 7f5384926800 20 remove_watcher() i=5 2024-09-12T17:48:05.758 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.757+0000 7f5384926800 20 remove_watcher() i=6 2024-09-12T17:48:05.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.758+0000 7f5384926800 20 remove_watcher() i=7 2024-09-12T17:48:05.769 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:05.769 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:05.770 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: a-bucket id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-12T17:48:05.770 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:05.771 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-12T17:48:05.802 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:05.802 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:05.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.837+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.839+0000 7f5a7372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.839+0000 7f5a7372e800 20 realm 2024-09-12T17:48:05.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.839+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.839+0000 7f5a7372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.839+0000 7f5a7372e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:05.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.839+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.839+0000 7f5a7372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:05.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.839+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.840+0000 7f5a7372e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:05.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.840+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:05.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.841+0000 7f5a7372e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:05.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.841+0000 7f5a7372e800 20 searching for the correct realm 2024-09-12T17:48:05.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.844+0000 7f5a6f364640 0 -- 172.21.15.107:0/4133671288 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f5a68069040 msgr2=0x7f5a6807fa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:05.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:05.847+0000 7f5a6f364640 0 -- 172.21.15.107:0/4133671288 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f5a640487f0 msgr2=0x7f5a64082380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:06.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.054+0000 7f5a7372e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:06.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.054+0000 7f5a7372e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:06.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.054+0000 7f5a7372e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:06.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.054+0000 7f5a7372e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:06.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.054+0000 7f5a7372e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:06.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.054+0000 7f5a7372e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:06.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.054+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.055+0000 7f5a7372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.055+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.055+0000 7f5a7372e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:06.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.055+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.056+0000 7f5a7372e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:06.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.056+0000 7f5a7372e800 20 zone default found 2024-09-12T17:48:06.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.056+0000 7f5a7372e800 4 Realm: () 2024-09-12T17:48:06.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.056+0000 7f5a7372e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:06.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.056+0000 7f5a7372e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:06.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.056+0000 7f5a7372e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:06.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.056+0000 7f5a7372e800 20 zonegroup default 2024-09-12T17:48:06.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.056+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.056+0000 7f5a7372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.056+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.056+0000 7f5a7372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.056+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.057+0000 7f5a7372e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.057+0000 7f5a7372e800 20 started sync module instance, tier type = 2024-09-12T17:48:06.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.057+0000 7f5a7372e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:06.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.065+0000 7f5a7372e800 20 add_watcher() i=0 2024-09-12T17:48:06.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.065+0000 7f5a7372e800 20 add_watcher() i=1 2024-09-12T17:48:06.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.065+0000 7f5a7372e800 20 add_watcher() i=2 2024-09-12T17:48:06.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.065+0000 7f5a7372e800 20 add_watcher() i=3 2024-09-12T17:48:06.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.065+0000 7f5a7372e800 20 add_watcher() i=4 2024-09-12T17:48:06.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.065+0000 7f5a7372e800 20 add_watcher() i=5 2024-09-12T17:48:06.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.065+0000 7f5a7372e800 20 add_watcher() i=6 2024-09-12T17:48:06.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.066+0000 7f5a7372e800 20 add_watcher() i=7 2024-09-12T17:48:06.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.066+0000 7f5a7372e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:06.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.068+0000 7f5925fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:06.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.068+0000 7f5a7372e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:06.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.068+0000 7f5a7372e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:06.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.068+0000 7f5a7372e800 5 note: GC not initialized 2024-09-12T17:48:06.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.069+0000 7f5924fe1640 20 reqs_thread_entry: start 2024-09-12T17:48:06.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.069+0000 7f5a7372e800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:06.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.069+0000 7f5a7372e800 20 Filter name: none 2024-09-12T17:48:06.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.069+0000 7f589e7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:06.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.069+0000 7f5a7372e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:48:06.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.069+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.069+0000 7f5a7372e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:06.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.069+0000 7f5a7372e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:48:06.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.069+0000 7f5a7372e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:48:06.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.069+0000 7f5a7372e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:48:06.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.069+0000 7f5a7372e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.070+0000 7f5a7372e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:06.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.070+0000 7f5a7372e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:48:06.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.070+0000 7f5a7372e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:48:06.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.070+0000 7f5a7372e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:06.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.070+0000 7f5a7372e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:06.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.070+0000 7f5a7372e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:48:06.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.072+0000 7f5925fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:06.075 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.074+0000 7f5a7372e800 20 remove_watcher() i=0 2024-09-12T17:48:06.075 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.074+0000 7f5a7372e800 2 removed watcher, disabling cache 2024-09-12T17:48:06.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.075+0000 7f5a7372e800 20 remove_watcher() i=1 2024-09-12T17:48:06.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.076+0000 7f5a7372e800 20 remove_watcher() i=2 2024-09-12T17:48:06.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.077+0000 7f5a7372e800 20 remove_watcher() i=3 2024-09-12T17:48:06.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.078+0000 7f5a7372e800 20 remove_watcher() i=4 2024-09-12T17:48:06.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.079+0000 7f5a7372e800 20 remove_watcher() i=5 2024-09-12T17:48:06.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.080+0000 7f5a7372e800 20 remove_watcher() i=6 2024-09-12T17:48:06.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.081+0000 7f5a7372e800 20 remove_watcher() i=7 2024-09-12T17:48:06.094 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshard list 2024-09-12T17:48:06.121 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:06.121 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:06.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.156+0000 7f0196d40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.157+0000 7f0196d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.157+0000 7f0196d40800 20 realm 2024-09-12T17:48:06.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.157+0000 7f0196d40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.158+0000 7f0196d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.158+0000 7f0196d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:06.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.158+0000 7f0196d40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.158+0000 7f0196d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.158+0000 7f0196d40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.159+0000 7f0196d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:06.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.159+0000 7f0196d40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.159+0000 7f0196d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:06.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.159+0000 7f0196d40800 20 searching for the correct realm 2024-09-12T17:48:06.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.162+0000 7f0193287640 0 -- 172.21.15.107:0/3862263168 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x559d300cef30 msgr2=0x559d300d1380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:06.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.166+0000 7f0192a86640 0 -- 172.21.15.107:0/3862263168 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f017c027410 msgr2=0x7f017c027890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:06.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.169+0000 7f0196d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:06.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.169+0000 7f0196d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:06.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.169+0000 7f0196d40800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:06.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.169+0000 7f0196d40800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:06.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.169+0000 7f0196d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:06.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.169+0000 7f0196d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:06.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.169+0000 7f0196d40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 20 zone default found 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 4 Realm: () 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 20 zonegroup default 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.170+0000 7f0196d40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.171+0000 7f0196d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.171+0000 7f0196d40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.171+0000 7f0196d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.171+0000 7f0196d40800 20 started sync module instance, tier type = 2024-09-12T17:48:06.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.171+0000 7f0196d40800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:06.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.180+0000 7f0196d40800 20 add_watcher() i=0 2024-09-12T17:48:06.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.180+0000 7f0196d40800 20 add_watcher() i=1 2024-09-12T17:48:06.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.180+0000 7f0196d40800 20 add_watcher() i=2 2024-09-12T17:48:06.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.180+0000 7f0196d40800 20 add_watcher() i=3 2024-09-12T17:48:06.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.180+0000 7f0196d40800 20 add_watcher() i=4 2024-09-12T17:48:06.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.180+0000 7f0196d40800 20 add_watcher() i=5 2024-09-12T17:48:06.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.180+0000 7f0196d40800 20 add_watcher() i=6 2024-09-12T17:48:06.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.181+0000 7f0196d40800 20 add_watcher() i=7 2024-09-12T17:48:06.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.181+0000 7f0196d40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:06.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.183+0000 7f00497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:06.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.183+0000 7f0196d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:06.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.183+0000 7f0196d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:06.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.183+0000 7f0196d40800 5 note: GC not initialized 2024-09-12T17:48:06.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.183+0000 7effc3fff640 20 reqs_thread_entry: start 2024-09-12T17:48:06.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.183+0000 7f0196d40800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:06.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.183+0000 7f0196d40800 20 Filter name: none 2024-09-12T17:48:06.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.183+0000 7effc1ffb640 20 reqs_thread_entry: start 2024-09-12T17:48:06.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.189+0000 7f00497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:06.192 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.191+0000 7f0196d40800 20 remove_watcher() i=0 2024-09-12T17:48:06.192 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.191+0000 7f0196d40800 2 removed watcher, disabling cache 2024-09-12T17:48:06.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.193+0000 7f0196d40800 20 remove_watcher() i=1 2024-09-12T17:48:06.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.194+0000 7f0196d40800 20 remove_watcher() i=2 2024-09-12T17:48:06.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.195+0000 7f0196d40800 20 remove_watcher() i=3 2024-09-12T17:48:06.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.196+0000 7f0196d40800 20 remove_watcher() i=4 2024-09-12T17:48:06.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.197+0000 7f0196d40800 20 remove_watcher() i=5 2024-09-12T17:48:06.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.198+0000 7f0196d40800 20 remove_watcher() i=6 2024-09-12T17:48:06.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.199+0000 7f0196d40800 20 remove_watcher() i=7 2024-09-12T17:48:06.210 INFO:tasks.workunit.client.0.smithi107.stderr:bucket name a-bucket 2024-09-12T17:48:06.210 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard process non empty bucket 2024-09-12T17:48:06.210 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:06.212 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshard process 2024-09-12T17:48:06.238 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:06.239 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:06.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.273+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.275+0000 7f0a9a775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.275+0000 7f0a9a775800 20 realm 2024-09-12T17:48:06.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.275+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.275+0000 7f0a9a775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.275+0000 7f0a9a775800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:06.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.275+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.275+0000 7f0a9a775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.275+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.276+0000 7f0a9a775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:06.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.276+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.278 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.276+0000 7f0a9a775800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:06.278 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.276+0000 7f0a9a775800 20 searching for the correct realm 2024-09-12T17:48:06.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.279+0000 7f0a97a5e640 0 -- 172.21.15.107:0/1065132478 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f0a8c06c030 msgr2=0x7f0a8c060ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:06.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.283+0000 7f0a97a5e640 0 -- 172.21.15.107:0/1065132478 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f0960086ba0 msgr2=0x7f0960088fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.287+0000 7f0a9a775800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.287+0000 7f0a9a775800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.287+0000 7f0a9a775800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.287+0000 7f0a9a775800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.287+0000 7f0a9a775800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.287+0000 7f0a9a775800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.287+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.287+0000 7f0a9a775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.287+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.287+0000 7f0a9a775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.287+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 20 zone default found 2024-09-12T17:48:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 4 Realm: () 2024-09-12T17:48:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 20 zonegroup default 2024-09-12T17:48:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 20 started sync module instance, tier type = 2024-09-12T17:48:06.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.288+0000 7f0a9a775800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:06.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.297+0000 7f0a9a775800 20 add_watcher() i=0 2024-09-12T17:48:06.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.297+0000 7f0a9a775800 20 add_watcher() i=1 2024-09-12T17:48:06.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.297+0000 7f0a9a775800 20 add_watcher() i=2 2024-09-12T17:48:06.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.297+0000 7f0a9a775800 20 add_watcher() i=3 2024-09-12T17:48:06.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.297+0000 7f0a9a775800 20 add_watcher() i=4 2024-09-12T17:48:06.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.297+0000 7f0a9a775800 20 add_watcher() i=5 2024-09-12T17:48:06.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.297+0000 7f0a9a775800 20 add_watcher() i=6 2024-09-12T17:48:06.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.298+0000 7f0a9a775800 20 add_watcher() i=7 2024-09-12T17:48:06.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.298+0000 7f0a9a775800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:06.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.300+0000 7f094f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:06.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.300+0000 7f0a9a775800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:06.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.300+0000 7f0a9a775800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:06.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.300+0000 7f0a9a775800 5 note: GC not initialized 2024-09-12T17:48:06.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.300+0000 7f094e7dc640 20 reqs_thread_entry: start 2024-09-12T17:48:06.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.300+0000 7f0a9a775800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:06.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.300+0000 7f0a9a775800 20 Filter name: none 2024-09-12T17:48:06.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.300+0000 7f09477fe640 20 reqs_thread_entry: start 2024-09-12T17:48:06.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.300+0000 7f0a9a775800 20 processing logshard = reshard.0000000000 2024-09-12T17:48:06.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.303+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:48:06.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.303+0000 7f0a9a775800 20 processing logshard = reshard.0000000001 2024-09-12T17:48:06.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.305+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:48:06.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.305+0000 7f0a9a775800 20 processing logshard = reshard.0000000002 2024-09-12T17:48:06.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.307+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:48:06.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.307+0000 7f0a9a775800 20 processing logshard = reshard.0000000003 2024-09-12T17:48:06.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.309+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:48:06.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.309+0000 7f0a9a775800 20 processing logshard = reshard.0000000004 2024-09-12T17:48:06.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.311+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:48:06.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.311+0000 7f0a9a775800 20 processing logshard = reshard.0000000005 2024-09-12T17:48:06.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.314+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:48:06.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.314+0000 7f0a9a775800 20 processing logshard = reshard.0000000006 2024-09-12T17:48:06.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.315+0000 7f0a9a775800 20 process_entry resharding a-bucket 2024-09-12T17:48:06.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.315+0000 7f0a9a775800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:48:06.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.315+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.315+0000 7f0a9a775800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:06.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.315+0000 7f0a9a775800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:48:06.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.315+0000 7f0a9a775800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:48:06.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.315+0000 7f0a9a775800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:48:06.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.315+0000 7f0a9a775800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.316+0000 7f0a9a775800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:06.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.316+0000 7f0a9a775800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:48:06.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.316+0000 7f0a9a775800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:48:06.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.316+0000 7f0a9a775800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:06.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.316+0000 7f0a9a775800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:06.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.316+0000 7f0a9a775800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:48:06.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.322+0000 7f0a9a775800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:48:06.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.322+0000 7f0a9a775800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:48:06.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.322+0000 7f0a9a775800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:06.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.322+0000 7f0a9a775800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:48:06.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.322+0000 7f096effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464293 cookie 94464072511456 notifier 6117 bl.length()=911 2024-09-12T17:48:06.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.322+0000 7f096effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:48:06.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.322+0000 7f096effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:48:06.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.322+0000 7f096effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:06.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.323+0000 7f0a9a775800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:48:06.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.323+0000 7f0a9a775800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:48:06.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.323+0000 7f0a9a775800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:48:06.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.323+0000 7f0a9a775800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:48:06.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.325+0000 7f0a9a775800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:48:06.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.325+0000 7f0a9a775800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:48:06.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.325+0000 7f0a9a775800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:48:06.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.325+0000 7f0a9a775800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:48:06.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.325+0000 7f0a9a775800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:48:06.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.325+0000 7f0a9a775800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:48:06.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.325+0000 7f0a9a775800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.1.0 2024-09-12T17:48:06.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.325+0000 7f0a9a775800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.1.0 2024-09-12T17:48:06.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.326+0000 7f0a9a775800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.1.1 2024-09-12T17:48:06.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.326+0000 7f0a9a775800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.1.1 2024-09-12T17:48:06.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.328+0000 7f0a9a775800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:06.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.328+0000 7f0a9a775800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:48:06.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.329+0000 7f0a9a775800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:48:06.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.329+0000 7f0a9a775800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:48:06.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.329+0000 7f0a9a775800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:06.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.329+0000 7f0a9a775800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:48:06.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.329+0000 7f096effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464294 cookie 94464072511456 notifier 6117 bl.length()=911 2024-09-12T17:48:06.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.329+0000 7f096effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:48:06.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.329+0000 7f096effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:48:06.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.329+0000 7f096effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:06.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.330+0000 7f0a9a775800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:48:06.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.330+0000 7f0a9a775800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:48:06.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.330+0000 7f0a9a775800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:48:06.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.330+0000 7f0a9a775800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:48:06.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.331+0000 7f0a9a775800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.1.0 2024-09-12T17:48:06.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.331+0000 7f0a9a775800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.1.0 2024-09-12T17:48:06.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.331+0000 7f0a9a775800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.1.1 2024-09-12T17:48:06.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.331+0000 7f0a9a775800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.1.1 2024-09-12T17:48:06.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.331+0000 7f0a9a775800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:06.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.331+0000 7f0a9a775800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:48:06.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.333+0000 7f0a9a775800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:48:06.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.333+0000 7f0a9a775800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:48:06.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.333+0000 7f0a9a775800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:06.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.333+0000 7f0a9a775800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:48:06.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.333+0000 7f096f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464295 cookie 94464072511456 notifier 6117 bl.length()=879 2024-09-12T17:48:06.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.333+0000 7f096f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:48:06.334 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.333+0000 7f096f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:48:06.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.333+0000 7f096f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:48:06.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.333+0000 7f0a9a775800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:48:06.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.333+0000 7f0a9a775800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:48:06.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.333+0000 7f0a9a775800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:48:06.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.333+0000 7f0a9a775800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:48:06.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.334+0000 7f0a9a775800 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-12T17:48:06.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.335+0000 7f0a9a775800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:48:06.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.337+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:48:06.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.337+0000 7f0a9a775800 20 processing logshard = reshard.0000000007 2024-09-12T17:48:06.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.340+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:48:06.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.340+0000 7f0a9a775800 20 processing logshard = reshard.0000000008 2024-09-12T17:48:06.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.342+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:48:06.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.342+0000 7f0a9a775800 20 processing logshard = reshard.0000000009 2024-09-12T17:48:06.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.344+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:48:06.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.344+0000 7f0a9a775800 20 processing logshard = reshard.0000000010 2024-09-12T17:48:06.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.346+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:48:06.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.346+0000 7f0a9a775800 20 processing logshard = reshard.0000000011 2024-09-12T17:48:06.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.349+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:48:06.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.349+0000 7f0a9a775800 20 processing logshard = reshard.0000000012 2024-09-12T17:48:06.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.352+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:48:06.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.352+0000 7f0a9a775800 20 processing logshard = reshard.0000000013 2024-09-12T17:48:06.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.354+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:48:06.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.354+0000 7f0a9a775800 20 processing logshard = reshard.0000000014 2024-09-12T17:48:06.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.356+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:48:06.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.356+0000 7f0a9a775800 20 processing logshard = reshard.0000000015 2024-09-12T17:48:06.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.359+0000 7f0a9a775800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:48:06.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.359+0000 7f094f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:06.362 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.361+0000 7f0a9a775800 20 remove_watcher() i=0 2024-09-12T17:48:06.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.361+0000 7f0a9a775800 2 removed watcher, disabling cache 2024-09-12T17:48:06.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.362+0000 7f0a9a775800 20 remove_watcher() i=1 2024-09-12T17:48:06.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.363+0000 7f0a9a775800 20 remove_watcher() i=2 2024-09-12T17:48:06.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.364+0000 7f0a9a775800 20 remove_watcher() i=3 2024-09-12T17:48:06.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.365+0000 7f0a9a775800 20 remove_watcher() i=4 2024-09-12T17:48:06.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.366+0000 7f0a9a775800 20 remove_watcher() i=5 2024-09-12T17:48:06.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.367+0000 7f0a9a775800 20 remove_watcher() i=6 2024-09-12T17:48:06.369 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.368+0000 7f0a9a775800 20 remove_watcher() i=7 2024-09-12T17:48:06.381 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:48:06.410 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:06.410 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:06.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.445+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.446+0000 7f95e4811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.446+0000 7f95e4811800 20 realm 2024-09-12T17:48:06.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.446+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.446+0000 7f95e4811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.446+0000 7f95e4811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:06.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.446+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.447+0000 7f95e4811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.447+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.447+0000 7f95e4811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:06.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.447+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.448+0000 7f95e4811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:06.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.448+0000 7f95e4811800 20 searching for the correct realm 2024-09-12T17:48:06.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.450+0000 7f95d7fff640 0 -- 172.21.15.107:0/3016908078 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f95c8038070 msgr2=0x7f95c801e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:06.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.454+0000 7f95dff92640 0 -- 172.21.15.107:0/3016908078 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f95c8054420 msgr2=0x7f95c80548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:06.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.660+0000 7f95e4811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:06.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.660+0000 7f95e4811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:06.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.660+0000 7f95e4811800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:06.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.660+0000 7f95e4811800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:06.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.660+0000 7f95e4811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:06.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.660+0000 7f95e4811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:06.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.660+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.660+0000 7f95e4811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.660+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:06.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:06.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 20 zone default found 2024-09-12T17:48:06.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 4 Realm: () 2024-09-12T17:48:06.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:06.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:06.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:06.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 20 zonegroup default 2024-09-12T17:48:06.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.661+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.662+0000 7f95e4811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:06.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.662+0000 7f95e4811800 20 started sync module instance, tier type = 2024-09-12T17:48:06.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.662+0000 7f95e4811800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:06.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.671+0000 7f95e4811800 20 add_watcher() i=0 2024-09-12T17:48:06.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.671+0000 7f95e4811800 20 add_watcher() i=1 2024-09-12T17:48:06.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.671+0000 7f95e4811800 20 add_watcher() i=2 2024-09-12T17:48:06.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.671+0000 7f95e4811800 20 add_watcher() i=3 2024-09-12T17:48:06.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.671+0000 7f95e4811800 20 add_watcher() i=4 2024-09-12T17:48:06.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.671+0000 7f95e4811800 20 add_watcher() i=5 2024-09-12T17:48:06.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.671+0000 7f95e4811800 20 add_watcher() i=6 2024-09-12T17:48:06.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.672+0000 7f95e4811800 20 add_watcher() i=7 2024-09-12T17:48:06.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.672+0000 7f95e4811800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:06.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.674+0000 7f9495fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:06.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.674+0000 7f95e4811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:06.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.674+0000 7f95e4811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:06.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.674+0000 7f95e4811800 5 note: GC not initialized 2024-09-12T17:48:06.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.675+0000 7f9494fe1640 20 reqs_thread_entry: start 2024-09-12T17:48:06.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.675+0000 7f95e4811800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:06.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.675+0000 7f95e4811800 20 Filter name: none 2024-09-12T17:48:06.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.675+0000 7f940e7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:06.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.675+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.675+0000 7f95e4811800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:06.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.676+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.676+0000 7f95e4811800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:06.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.676+0000 7f95e4811800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:06.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.676+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.677+0000 7f95e4811800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:48:06.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.677+0000 7f95e4811800 20 rados->read ofs=0 len=0 2024-09-12T17:48:06.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.677+0000 7f95e4811800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:48:06.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.677+0000 7f95e4811800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:06.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.679+0000 7f9495fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:06.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.681+0000 7f95e4811800 20 remove_watcher() i=0 2024-09-12T17:48:06.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.681+0000 7f95e4811800 2 removed watcher, disabling cache 2024-09-12T17:48:06.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.682+0000 7f95e4811800 20 remove_watcher() i=1 2024-09-12T17:48:06.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.683+0000 7f95e4811800 20 remove_watcher() i=2 2024-09-12T17:48:06.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.684+0000 7f95e4811800 20 remove_watcher() i=3 2024-09-12T17:48:06.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.685+0000 7f95e4811800 20 remove_watcher() i=4 2024-09-12T17:48:06.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.686+0000 7f95e4811800 20 remove_watcher() i=5 2024-09-12T17:48:06.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.687+0000 7f95e4811800 20 remove_watcher() i=6 2024-09-12T17:48:06.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:06.688+0000 7f95e4811800 20 remove_watcher() i=7 2024-09-12T17:48:06.699 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:06.699 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:06.699 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: a-bucket id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T17:48:06.699 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:06.699 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T17:48:06.699 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:06.882 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:48:06.911 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:06.911 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:07.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.148+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.149+0000 7f4df6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.150+0000 7f4df6746800 20 realm 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.150+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.150+0000 7f4df6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.150+0000 7f4df6746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.150+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.150+0000 7f4df6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.150+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.151+0000 7f4df6746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.151+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.151+0000 7f4df6746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:07.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.151+0000 7f4df6746800 20 searching for the correct realm 2024-09-12T17:48:07.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.154+0000 7f4df4237640 0 -- 172.21.15.107:0/2493620365 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f4dec017070 msgr2=0x7f4dec064af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:07.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.157+0000 7f4df4237640 0 -- 172.21.15.107:0/2493620365 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f4ddc064940 msgr2=0x7f4ddc096400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:07.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.363+0000 7f4df6746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:07.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.363+0000 7f4df6746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:07.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.363+0000 7f4df6746800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:07.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.363+0000 7f4df6746800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:07.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.363+0000 7f4df6746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:07.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.363+0000 7f4df6746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:07.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.363+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.363+0000 7f4df6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.363+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.364+0000 7f4df6746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.364+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.364+0000 7f4df6746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.364+0000 7f4df6746800 20 zone default found 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.364+0000 7f4df6746800 4 Realm: () 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.364+0000 7f4df6746800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.364+0000 7f4df6746800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.364+0000 7f4df6746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.364+0000 7f4df6746800 20 zonegroup default 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.364+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.365+0000 7f4df6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.365+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.365+0000 7f4df6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.365+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.365+0000 7f4df6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.365+0000 7f4df6746800 20 started sync module instance, tier type = 2024-09-12T17:48:07.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.365+0000 7f4df6746800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:07.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.374+0000 7f4df6746800 20 add_watcher() i=0 2024-09-12T17:48:07.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.374+0000 7f4df6746800 20 add_watcher() i=1 2024-09-12T17:48:07.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.374+0000 7f4df6746800 20 add_watcher() i=2 2024-09-12T17:48:07.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.374+0000 7f4df6746800 20 add_watcher() i=3 2024-09-12T17:48:07.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.374+0000 7f4df6746800 20 add_watcher() i=4 2024-09-12T17:48:07.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.374+0000 7f4df6746800 20 add_watcher() i=5 2024-09-12T17:48:07.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.374+0000 7f4df6746800 20 add_watcher() i=6 2024-09-12T17:48:07.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.375+0000 7f4df6746800 20 add_watcher() i=7 2024-09-12T17:48:07.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.375+0000 7f4df6746800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:07.378 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.377+0000 7f4caafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.377+0000 7f4df6746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.377+0000 7f4df6746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.377+0000 7f4df6746800 5 note: GC not initialized 2024-09-12T17:48:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.377+0000 7f4ca9fdb640 20 reqs_thread_entry: start 2024-09-12T17:48:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.377+0000 7f4df6746800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.378+0000 7f4df6746800 20 Filter name: none 2024-09-12T17:48:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.378+0000 7f4c1b7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.378+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.378+0000 7f4df6746800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.378+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.379+0000 7f4df6746800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.379+0000 7f4df6746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.379+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.379+0000 7f4df6746800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.379+0000 7f4df6746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.380+0000 7f4df6746800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.380+0000 7f4df6746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:07.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.381+0000 7f4caafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:07.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.383+0000 7f4df6746800 20 remove_watcher() i=0 2024-09-12T17:48:07.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.383+0000 7f4df6746800 2 removed watcher, disabling cache 2024-09-12T17:48:07.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.384+0000 7f4df6746800 20 remove_watcher() i=1 2024-09-12T17:48:07.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.385+0000 7f4df6746800 20 remove_watcher() i=2 2024-09-12T17:48:07.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.386+0000 7f4df6746800 20 remove_watcher() i=3 2024-09-12T17:48:07.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.387+0000 7f4df6746800 20 remove_watcher() i=4 2024-09-12T17:48:07.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.388+0000 7f4df6746800 20 remove_watcher() i=5 2024-09-12T17:48:07.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.389+0000 7f4df6746800 20 remove_watcher() i=6 2024-09-12T17:48:07.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.390+0000 7f4df6746800 20 remove_watcher() i=7 2024-09-12T17:48:07.402 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:07.402 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:07.402 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-init-index id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:48:07.402 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:07.403 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T17:48:07.437 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:07.437 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:07.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.473+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.474+0000 7fd6b3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.474+0000 7fd6b3013800 20 realm 2024-09-12T17:48:07.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.474+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.474+0000 7fd6b3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.474+0000 7fd6b3013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:07.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.474+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.474+0000 7fd6b3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.474+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.475+0000 7fd6b3013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.475+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.476+0000 7fd6b3013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:07.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.476+0000 7fd6b3013800 20 searching for the correct realm 2024-09-12T17:48:07.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.478+0000 7fd6adf91640 0 -- 172.21.15.107:0/4246435935 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fd6a4042040 msgr2=0x7fd6a404d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:07.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.481+0000 7fd6ae792640 0 -- 172.21.15.107:0/4246435935 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fd6a4066950 msgr2=0x7fd6a4065430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:07.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:07.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:07.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:07.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:07.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:07.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:07.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 zone default found 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 4 Realm: () 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 zonegroup default 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.687+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.688+0000 7fd6b3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.688+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.688+0000 7fd6b3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.688+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.688+0000 7fd6b3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.688+0000 7fd6b3013800 20 started sync module instance, tier type = 2024-09-12T17:48:07.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.688+0000 7fd6b3013800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:07.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.697+0000 7fd6b3013800 20 add_watcher() i=0 2024-09-12T17:48:07.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.697+0000 7fd6b3013800 20 add_watcher() i=1 2024-09-12T17:48:07.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.697+0000 7fd6b3013800 20 add_watcher() i=2 2024-09-12T17:48:07.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.697+0000 7fd6b3013800 20 add_watcher() i=3 2024-09-12T17:48:07.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.697+0000 7fd6b3013800 20 add_watcher() i=4 2024-09-12T17:48:07.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.697+0000 7fd6b3013800 20 add_watcher() i=5 2024-09-12T17:48:07.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.697+0000 7fd6b3013800 20 add_watcher() i=6 2024-09-12T17:48:07.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.698+0000 7fd6b3013800 20 add_watcher() i=7 2024-09-12T17:48:07.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.698+0000 7fd6b3013800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:07.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.699+0000 7fd564fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:07.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.700+0000 7fd6b3013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:07.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.700+0000 7fd6b3013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:07.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.700+0000 7fd6b3013800 5 note: GC not initialized 2024-09-12T17:48:07.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.700+0000 7fd4df7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:07.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.700+0000 7fd6b3013800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:07.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.700+0000 7fd6b3013800 20 Filter name: none 2024-09-12T17:48:07.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.700+0000 7fd4dd7fa640 20 reqs_thread_entry: start 2024-09-12T17:48:07.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.700+0000 7fd6b3013800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:48:07.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.700+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.701+0000 7fd6b3013800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:07.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.701+0000 7fd6b3013800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:48:07.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.701+0000 7fd6b3013800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:48:07.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.701+0000 7fd6b3013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 : miss 2024-09-12T17:48:07.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.701+0000 7fd6b3013800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.701+0000 7fd6b3013800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:07.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.701+0000 7fd6b3013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 info.flags=0x17 2024-09-12T17:48:07.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.701+0000 7fd6b3013800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 to cache LRU end 2024-09-12T17:48:07.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.701+0000 7fd6b3013800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:07.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.701+0000 7fd6b3013800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:07.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.701+0000 7fd6b3013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 2024-09-12T17:48:07.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.703+0000 7fd6b3013800 -1 Injecting error=-5 at location=init_index 2024-09-12T17:48:07.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.703+0000 7fd6b3013800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T17:48:07.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.704+0000 7fd564fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:07.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.706+0000 7fd6b3013800 20 remove_watcher() i=0 2024-09-12T17:48:07.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.706+0000 7fd6b3013800 2 removed watcher, disabling cache 2024-09-12T17:48:07.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.707+0000 7fd6b3013800 20 remove_watcher() i=1 2024-09-12T17:48:07.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.708+0000 7fd6b3013800 20 remove_watcher() i=2 2024-09-12T17:48:07.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.710+0000 7fd6b3013800 20 remove_watcher() i=3 2024-09-12T17:48:07.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.710+0000 7fd6b3013800 20 remove_watcher() i=4 2024-09-12T17:48:07.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.711+0000 7fd6b3013800 20 remove_watcher() i=5 2024-09-12T17:48:07.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.712+0000 7fd6b3013800 20 remove_watcher() i=6 2024-09-12T17:48:07.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.713+0000 7fd6b3013800 20 remove_watcher() i=7 2024-09-12T17:48:07.726 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:48:07.756 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:07.756 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:07.793 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.791+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.793+0000 7f38cca16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.793+0000 7f38cca16800 20 realm 2024-09-12T17:48:07.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.793+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.793+0000 7f38cca16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.793+0000 7f38cca16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:07.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.793+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.793+0000 7f38cca16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:07.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.793+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.794+0000 7f38cca16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:07.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.794+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:07.796 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.795+0000 7f38cca16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:07.796 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.795+0000 7f38cca16800 20 searching for the correct realm 2024-09-12T17:48:07.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:07.796+0000 7f38c81e7640 0 -- 172.21.15.107:0/4147164631 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f38c003d060 msgr2=0x7f38c0065aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:08.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.001+0000 7f38bf9e6640 0 -- 172.21.15.107:0/4147164631 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x564c22d94ed0 msgr2=0x564c22d972c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:08.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.006+0000 7f38cca16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:08.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.006+0000 7f38cca16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:08.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.006+0000 7f38cca16800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:08.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.006+0000 7f38cca16800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:08.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.006+0000 7f38cca16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:08.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.006+0000 7f38cca16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:08.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.006+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.006+0000 7f38cca16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.006+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 20 zone default found 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 4 Realm: () 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 20 zonegroup default 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.007+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.008+0000 7f38cca16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.008+0000 7f38cca16800 20 started sync module instance, tier type = 2024-09-12T17:48:08.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.008+0000 7f38cca16800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:08.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.016+0000 7f38cca16800 20 add_watcher() i=0 2024-09-12T17:48:08.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.016+0000 7f38cca16800 20 add_watcher() i=1 2024-09-12T17:48:08.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.016+0000 7f38cca16800 20 add_watcher() i=2 2024-09-12T17:48:08.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.016+0000 7f38cca16800 20 add_watcher() i=3 2024-09-12T17:48:08.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.016+0000 7f38cca16800 20 add_watcher() i=4 2024-09-12T17:48:08.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.016+0000 7f38cca16800 20 add_watcher() i=5 2024-09-12T17:48:08.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.016+0000 7f38cca16800 20 add_watcher() i=6 2024-09-12T17:48:08.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.017+0000 7f38cca16800 20 add_watcher() i=7 2024-09-12T17:48:08.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.017+0000 7f38cca16800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:08.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.019+0000 7f377efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:08.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.019+0000 7f38cca16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:08.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.019+0000 7f38cca16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:08.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.019+0000 7f38cca16800 5 note: GC not initialized 2024-09-12T17:48:08.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.019+0000 7f377dfdb640 20 reqs_thread_entry: start 2024-09-12T17:48:08.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.019+0000 7f38cca16800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:08.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.019+0000 7f38cca16800 20 Filter name: none 2024-09-12T17:48:08.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.020+0000 7f36ef7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:08.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.020+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.020+0000 7f38cca16800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:08.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.020+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.020+0000 7f38cca16800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:08.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.020+0000 7f38cca16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:08.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.020+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.021+0000 7f38cca16800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:08.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.021+0000 7f38cca16800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.021+0000 7f38cca16800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:08.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.021+0000 7f38cca16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:08.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.022+0000 7f377efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:08.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.024+0000 7f38cca16800 20 remove_watcher() i=0 2024-09-12T17:48:08.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.024+0000 7f38cca16800 2 removed watcher, disabling cache 2024-09-12T17:48:08.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.025+0000 7f38cca16800 20 remove_watcher() i=1 2024-09-12T17:48:08.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.026+0000 7f38cca16800 20 remove_watcher() i=2 2024-09-12T17:48:08.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.027+0000 7f38cca16800 20 remove_watcher() i=3 2024-09-12T17:48:08.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.028+0000 7f38cca16800 20 remove_watcher() i=4 2024-09-12T17:48:08.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.029+0000 7f38cca16800 20 remove_watcher() i=5 2024-09-12T17:48:08.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.030+0000 7f38cca16800 20 remove_watcher() i=6 2024-09-12T17:48:08.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.031+0000 7f38cca16800 20 remove_watcher() i=7 2024-09-12T17:48:08.042 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:08.042 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:08.042 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-init-index id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:48:08.042 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:08.095 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:48:08.127 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:08.127 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:08.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.163+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.164+0000 7f183a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.164+0000 7f183a926800 20 realm 2024-09-12T17:48:08.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.164+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.164+0000 7f183a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.164+0000 7f183a926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:08.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.164+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.164+0000 7f183a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.164+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.165+0000 7f183a926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:08.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.165+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.166+0000 7f183a926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:08.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.166+0000 7f183a926800 20 searching for the correct realm 2024-09-12T17:48:08.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.169+0000 7f1836d5e640 0 -- 172.21.15.107:0/1026023045 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55daf58d82e0 msgr2=0x55daf58da7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:08.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.172+0000 7f183655d640 0 -- 172.21.15.107:0/1026023045 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f182c002fb0 msgr2=0x7f182c067bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:08.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.177+0000 7f183a926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:08.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.177+0000 7f183a926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:08.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.177+0000 7f183a926800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:08.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.177+0000 7f183a926800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:08.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.177+0000 7f183a926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:08.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.177+0000 7f183a926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:08.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.177+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.177+0000 7f183a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.177+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.177+0000 7f183a926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:08.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.177+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.178+0000 7f183a926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:08.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.178+0000 7f183a926800 20 zone default found 2024-09-12T17:48:08.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.178+0000 7f183a926800 4 Realm: () 2024-09-12T17:48:08.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.178+0000 7f183a926800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:08.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.178+0000 7f183a926800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:08.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.178+0000 7f183a926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:08.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.178+0000 7f183a926800 20 zonegroup default 2024-09-12T17:48:08.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.178+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.178+0000 7f183a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.178+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.178+0000 7f183a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.178+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.179+0000 7f183a926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.179+0000 7f183a926800 20 started sync module instance, tier type = 2024-09-12T17:48:08.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.179+0000 7f183a926800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:08.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.188+0000 7f183a926800 20 add_watcher() i=0 2024-09-12T17:48:08.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.188+0000 7f183a926800 20 add_watcher() i=1 2024-09-12T17:48:08.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.188+0000 7f183a926800 20 add_watcher() i=2 2024-09-12T17:48:08.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.188+0000 7f183a926800 20 add_watcher() i=3 2024-09-12T17:48:08.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.188+0000 7f183a926800 20 add_watcher() i=4 2024-09-12T17:48:08.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.188+0000 7f183a926800 20 add_watcher() i=5 2024-09-12T17:48:08.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.188+0000 7f183a926800 20 add_watcher() i=6 2024-09-12T17:48:08.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.189+0000 7f183a926800 20 add_watcher() i=7 2024-09-12T17:48:08.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.189+0000 7f183a926800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:08.192 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.190+0000 7f16ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.190+0000 7f183a926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.190+0000 7f183a926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.191+0000 7f183a926800 5 note: GC not initialized 2024-09-12T17:48:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.191+0000 7f16677fe640 20 reqs_thread_entry: start 2024-09-12T17:48:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.191+0000 7f183a926800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.191+0000 7f183a926800 20 Filter name: none 2024-09-12T17:48:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.191+0000 7f16657fa640 20 reqs_thread_entry: start 2024-09-12T17:48:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.191+0000 7f183a926800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:48:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.191+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.191+0000 7f183a926800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.191+0000 7f183a926800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:48:08.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.191+0000 7f183a926800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:48:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.191+0000 7f183a926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 : miss 2024-09-12T17:48:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.191+0000 7f183a926800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.192+0000 7f183a926800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.192+0000 7f183a926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 info.flags=0x17 2024-09-12T17:48:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.192+0000 7f183a926800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 to cache LRU end 2024-09-12T17:48:08.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.192+0000 7f183a926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:08.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.192+0000 7f183a926800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:08.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.192+0000 7f183a926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 2024-09-12T17:48:08.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.195+0000 7f183a926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 info.flags=0x17 2024-09-12T17:48:08.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.195+0000 7f183a926800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 to cache LRU end 2024-09-12T17:48:08.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.195+0000 7f183a926800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:08.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.195+0000 7f183a926800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20, ofs0, ns] 2024-09-12T17:48:08.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.196+0000 7f1719ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 94398910942320 notifier 6207 bl.length()=995 2024-09-12T17:48:08.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.196+0000 7f1719ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 info.flags=0x17 2024-09-12T17:48:08.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.196+0000 7f1719ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 to cache LRU end 2024-09-12T17:48:08.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.196+0000 7f1719ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:08.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.196+0000 7f183a926800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.20]): orig_sources= new_sources= 2024-09-12T17:48:08.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.196+0000 7f183a926800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.20]): potential sources added=[] removed=[] 2024-09-12T17:48:08.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.196+0000 7f183a926800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.20]): orig_dests= new_dests= 2024-09-12T17:48:08.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.196+0000 7f183a926800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.20]): potential dests added=[] removed=[] 2024-09-12T17:48:08.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.198+0000 7f183a926800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.20.1.0 2024-09-12T17:48:08.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.198+0000 7f183a926800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.20.1.0 2024-09-12T17:48:08.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.198+0000 7f183a926800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.20.1.1 2024-09-12T17:48:08.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.198+0000 7f183a926800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.20.1.1 2024-09-12T17:48:08.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.198+0000 7f183a926800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.20.0 2024-09-12T17:48:08.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.200+0000 7f183a926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:08.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.200+0000 7f183a926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 2024-09-12T17:48:08.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.201+0000 7f183a926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 info.flags=0x17 2024-09-12T17:48:08.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.201+0000 7f183a926800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 to cache LRU end 2024-09-12T17:48:08.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.201+0000 7f183a926800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:08.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.201+0000 7f183a926800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20, ofs0, ns] 2024-09-12T17:48:08.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.202+0000 7f1719ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94398910942320 notifier 6207 bl.length()=995 2024-09-12T17:48:08.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.202+0000 7f1719ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 info.flags=0x17 2024-09-12T17:48:08.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.202+0000 7f1719ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 to cache LRU end 2024-09-12T17:48:08.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.202+0000 7f1719ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:08.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.202+0000 7f183a926800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.20]): orig_sources= new_sources= 2024-09-12T17:48:08.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.202+0000 7f183a926800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.20]): potential sources added=[] removed=[] 2024-09-12T17:48:08.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.202+0000 7f183a926800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.20]): orig_dests= new_dests= 2024-09-12T17:48:08.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.202+0000 7f183a926800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.20]): potential dests added=[] removed=[] 2024-09-12T17:48:08.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.203+0000 7f183a926800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.20.0 2024-09-12T17:48:08.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.203+0000 7f183a926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:08.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.203+0000 7f183a926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 2024-09-12T17:48:08.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.204+0000 7f183a926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 info.flags=0x17 2024-09-12T17:48:08.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.204+0000 7f183a926800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 to cache LRU end 2024-09-12T17:48:08.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.204+0000 7f183a926800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:08.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.204+0000 7f183a926800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20, ofs0, ns] 2024-09-12T17:48:08.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.205+0000 7f17197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 94398910942320 notifier 6207 bl.length()=963 2024-09-12T17:48:08.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.205+0000 7f17197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 info.flags=0x17 2024-09-12T17:48:08.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.205+0000 7f17197fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 to cache LRU end 2024-09-12T17:48:08.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.205+0000 7f17197fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:08.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.205+0000 7f183a926800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.20]): orig_sources= new_sources= 2024-09-12T17:48:08.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.205+0000 7f183a926800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.20]): potential sources added=[] removed=[] 2024-09-12T17:48:08.208 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.205+0000 7f183a926800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.20]): orig_dests= new_dests= 2024-09-12T17:48:08.208 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.205+0000 7f183a926800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.20]): potential dests added=[] removed=[] 2024-09-12T17:48:08.208 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.206+0000 7f183a926800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T17:48:08.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.208+0000 7f16ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:08.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.210+0000 7f183a926800 20 remove_watcher() i=0 2024-09-12T17:48:08.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.210+0000 7f183a926800 2 removed watcher, disabling cache 2024-09-12T17:48:08.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.211+0000 7f183a926800 20 remove_watcher() i=1 2024-09-12T17:48:08.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.212+0000 7f183a926800 20 remove_watcher() i=2 2024-09-12T17:48:08.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.213+0000 7f183a926800 20 remove_watcher() i=3 2024-09-12T17:48:08.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.213+0000 7f183a926800 20 remove_watcher() i=4 2024-09-12T17:48:08.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.214+0000 7f183a926800 20 remove_watcher() i=5 2024-09-12T17:48:08.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.215+0000 7f183a926800 20 remove_watcher() i=6 2024-09-12T17:48:08.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.216+0000 7f183a926800 20 remove_watcher() i=7 2024-09-12T17:48:08.230 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:48:08.258 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:08.258 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:08.294 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.293+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.296 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.295+0000 7fade142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.296 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.295+0000 7fade142f800 20 realm 2024-09-12T17:48:08.296 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.295+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.296 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.295+0000 7fade142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.296 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.295+0000 7fade142f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:08.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.295+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.295+0000 7fade142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.295+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.296+0000 7fade142f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:08.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.296+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.297+0000 7fade142f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:08.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.297+0000 7fade142f800 20 searching for the correct realm 2024-09-12T17:48:08.300 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.299+0000 7faddef19640 0 -- 172.21.15.107:0/2713419206 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fadd00453b0 msgr2=0x7fadd007dad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:08.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.303+0000 7faddef19640 0 -- 172.21.15.107:0/2713419206 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fadc80b35d0 msgr2=0x7fadc80a8c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:08.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:08.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:08.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:08.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:08.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:08.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:08.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 zone default found 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 4 Realm: () 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 zonegroup default 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.510+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.511+0000 7fade142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.511+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.511+0000 7fade142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.511+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.511+0000 7fade142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.511+0000 7fade142f800 20 started sync module instance, tier type = 2024-09-12T17:48:08.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.511+0000 7fade142f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:08.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.520+0000 7fade142f800 20 add_watcher() i=0 2024-09-12T17:48:08.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.520+0000 7fade142f800 20 add_watcher() i=1 2024-09-12T17:48:08.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.520+0000 7fade142f800 20 add_watcher() i=2 2024-09-12T17:48:08.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.520+0000 7fade142f800 20 add_watcher() i=3 2024-09-12T17:48:08.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.520+0000 7fade142f800 20 add_watcher() i=4 2024-09-12T17:48:08.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.520+0000 7fade142f800 20 add_watcher() i=5 2024-09-12T17:48:08.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.520+0000 7fade142f800 20 add_watcher() i=6 2024-09-12T17:48:08.522 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.521+0000 7fade142f800 20 add_watcher() i=7 2024-09-12T17:48:08.522 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.521+0000 7fade142f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:08.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.522+0000 7fac957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:08.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.523+0000 7fade142f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:08.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.523+0000 7fade142f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:08.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.523+0000 7fade142f800 5 note: GC not initialized 2024-09-12T17:48:08.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.523+0000 7fac0ffff640 20 reqs_thread_entry: start 2024-09-12T17:48:08.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.523+0000 7fade142f800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:08.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.523+0000 7fade142f800 20 Filter name: none 2024-09-12T17:48:08.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.523+0000 7fac0dffb640 20 reqs_thread_entry: start 2024-09-12T17:48:08.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.523+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.524+0000 7fade142f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:08.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.524+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.524+0000 7fade142f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:08.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.524+0000 7fade142f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.524+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.525+0000 7fade142f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.525+0000 7fade142f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.525+0000 7fade142f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.525+0000 7fade142f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.526+0000 7fac957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:08.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.528+0000 7fade142f800 20 remove_watcher() i=0 2024-09-12T17:48:08.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.528+0000 7fade142f800 2 removed watcher, disabling cache 2024-09-12T17:48:08.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.530+0000 7fade142f800 20 remove_watcher() i=1 2024-09-12T17:48:08.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.531+0000 7fade142f800 20 remove_watcher() i=2 2024-09-12T17:48:08.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.532+0000 7fade142f800 20 remove_watcher() i=3 2024-09-12T17:48:08.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.533+0000 7fade142f800 20 remove_watcher() i=4 2024-09-12T17:48:08.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.534+0000 7fade142f800 20 remove_watcher() i=5 2024-09-12T17:48:08.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.535+0000 7fade142f800 20 remove_watcher() i=6 2024-09-12T17:48:08.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.536+0000 7fade142f800 20 remove_watcher() i=7 2024-09-12T17:48:08.547 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:08.547 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:08.547 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-init-index id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.20 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:48:08.547 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:08.610 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T17:48:08.610 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:08.784 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:48:08.812 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:08.812 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:08.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.847+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.848+0000 7f0624498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.848+0000 7f0624498800 20 realm 2024-09-12T17:48:08.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.848+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.849+0000 7f0624498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.849+0000 7f0624498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:08.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.849+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.849+0000 7f0624498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.849+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.849+0000 7f0624498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:08.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.849+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.850+0000 7f0624498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:08.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.850+0000 7f0624498800 20 searching for the correct realm 2024-09-12T17:48:08.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.853+0000 7f0622783640 0 -- 172.21.15.107:0/2647825138 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x562e4ef1b4f0 msgr2=0x562e4ef1d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:08.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.856+0000 7f0621f82640 0 -- 172.21.15.107:0/2647825138 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f0618069910 msgr2=0x7f0618096720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:08.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.860+0000 7f0624498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:08.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.860+0000 7f0624498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:08.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.860+0000 7f0624498800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:08.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.860+0000 7f0624498800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:08.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.860+0000 7f0624498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:08.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.860+0000 7f0624498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:08.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.860+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:08.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:08.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 20 zone default found 2024-09-12T17:48:08.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 4 Realm: () 2024-09-12T17:48:08.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:08.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:08.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:08.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 20 zonegroup default 2024-09-12T17:48:08.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.861+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.862+0000 7f0624498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.862+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.862+0000 7f0624498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.862+0000 7f0624498800 20 started sync module instance, tier type = 2024-09-12T17:48:08.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.862+0000 7f0624498800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:08.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.873+0000 7f0624498800 20 add_watcher() i=0 2024-09-12T17:48:08.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.873+0000 7f0624498800 20 add_watcher() i=1 2024-09-12T17:48:08.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.873+0000 7f0624498800 20 add_watcher() i=2 2024-09-12T17:48:08.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.873+0000 7f0624498800 20 add_watcher() i=3 2024-09-12T17:48:08.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.873+0000 7f0624498800 20 add_watcher() i=4 2024-09-12T17:48:08.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.873+0000 7f0624498800 20 add_watcher() i=5 2024-09-12T17:48:08.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.873+0000 7f0624498800 20 add_watcher() i=6 2024-09-12T17:48:08.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.874+0000 7f0624498800 20 add_watcher() i=7 2024-09-12T17:48:08.876 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.874+0000 7f0624498800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:08.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.876+0000 7f04d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:08.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.876+0000 7f0624498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:08.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.876+0000 7f0624498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:08.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.876+0000 7f0624498800 5 note: GC not initialized 2024-09-12T17:48:08.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.876+0000 7f04d2ffd640 20 reqs_thread_entry: start 2024-09-12T17:48:08.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.876+0000 7f0624498800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:08.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.876+0000 7f0624498800 20 Filter name: none 2024-09-12T17:48:08.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.877+0000 7f04d0ff9640 20 reqs_thread_entry: start 2024-09-12T17:48:08.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.877+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.877+0000 7f0624498800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:08.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.877+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.878+0000 7f0624498800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:08.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.878+0000 7f0624498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:08.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.878+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.878+0000 7f0624498800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:08.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.878+0000 7f0624498800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.878+0000 7f0624498800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:08.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.878+0000 7f0624498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:08.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.879+0000 7f04d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:08.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.881+0000 7f0624498800 20 remove_watcher() i=0 2024-09-12T17:48:08.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.881+0000 7f0624498800 2 removed watcher, disabling cache 2024-09-12T17:48:08.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.882+0000 7f0624498800 20 remove_watcher() i=1 2024-09-12T17:48:08.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.884+0000 7f0624498800 20 remove_watcher() i=2 2024-09-12T17:48:08.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.885+0000 7f0624498800 20 remove_watcher() i=3 2024-09-12T17:48:08.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.886+0000 7f0624498800 20 remove_watcher() i=4 2024-09-12T17:48:08.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.887+0000 7f0624498800 20 remove_watcher() i=5 2024-09-12T17:48:08.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.888+0000 7f0624498800 20 remove_watcher() i=6 2024-09-12T17:48:08.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.889+0000 7f0624498800 20 remove_watcher() i=7 2024-09-12T17:48:08.901 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:08.901 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:08.902 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-init-index id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:48:08.902 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:08.902 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T17:48:08.938 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:08.939 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:08.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.974+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.975+0000 7fc6e8a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.975+0000 7fc6e8a14800 20 realm 2024-09-12T17:48:08.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.975+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.975+0000 7fc6e8a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.978 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.975+0000 7fc6e8a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:08.978 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.975+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.978 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.975+0000 7fc6e8a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.978 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.975+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.979 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.976+0000 7fc6e8a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:08.979 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.976+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.977+0000 7fc6e8a14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:08.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.977+0000 7fc6e8a14800 20 searching for the correct realm 2024-09-12T17:48:08.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.981+0000 7fc6e48cc640 0 -- 172.21.15.107:0/4083769493 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x56148ecd6b50 msgr2=0x56148ecd9010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:08.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.986+0000 7fc6e40cb640 0 -- 172.21.15.107:0/4083769493 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc6d8057040 msgr2=0x7fc6d8057420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:08.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.990+0000 7fc6e8a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:08.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.990+0000 7fc6e8a14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.990+0000 7fc6e8a14800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.990+0000 7fc6e8a14800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.990+0000 7fc6e8a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.990+0000 7fc6e8a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.990+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.990+0000 7fc6e8a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.990+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 20 zone default found 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 4 Realm: () 2024-09-12T17:48:08.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:08.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:08.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:08.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 20 zonegroup default 2024-09-12T17:48:08.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:08.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.991+0000 7fc6e8a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:08.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.992+0000 7fc6e8a14800 20 started sync module instance, tier type = 2024-09-12T17:48:08.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:08.992+0000 7fc6e8a14800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:09.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.003+0000 7fc6e8a14800 20 add_watcher() i=0 2024-09-12T17:48:09.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.003+0000 7fc6e8a14800 20 add_watcher() i=1 2024-09-12T17:48:09.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.003+0000 7fc6e8a14800 20 add_watcher() i=2 2024-09-12T17:48:09.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.003+0000 7fc6e8a14800 20 add_watcher() i=3 2024-09-12T17:48:09.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.003+0000 7fc6e8a14800 20 add_watcher() i=4 2024-09-12T17:48:09.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.003+0000 7fc6e8a14800 20 add_watcher() i=5 2024-09-12T17:48:09.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.003+0000 7fc6e8a14800 20 add_watcher() i=6 2024-09-12T17:48:09.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.004+0000 7fc6e8a14800 20 add_watcher() i=7 2024-09-12T17:48:09.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.004+0000 7fc6e8a14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:09.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.005+0000 7fc59afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:09.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.006+0000 7fc6e8a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:09.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.006+0000 7fc6e8a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:09.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.006+0000 7fc6e8a14800 5 note: GC not initialized 2024-09-12T17:48:09.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.006+0000 7fc599fdb640 20 reqs_thread_entry: start 2024-09-12T17:48:09.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.006+0000 7fc6e8a14800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:09.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.006+0000 7fc6e8a14800 20 Filter name: none 2024-09-12T17:48:09.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.006+0000 7fc50b7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.006+0000 7fc6e8a14800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.006+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.007+0000 7fc6e8a14800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.007+0000 7fc6e8a14800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.007+0000 7fc6e8a14800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.007+0000 7fc6e8a14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 : miss 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.007+0000 7fc6e8a14800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.007+0000 7fc6e8a14800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.007+0000 7fc6e8a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 info.flags=0x17 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.007+0000 7fc6e8a14800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 to cache LRU end 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.007+0000 7fc6e8a14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.007+0000 7fc6e8a14800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:09.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.007+0000 7fc6e8a14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 2024-09-12T17:48:09.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.009+0000 7fc6e8a14800 -1 Injecting error=-95 at location=init_index 2024-09-12T17:48:09.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.009+0000 7fc6e8a14800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:48:09.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.011+0000 7fc6e8a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 info.flags=0x17 2024-09-12T17:48:09.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.011+0000 7fc6e8a14800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 to cache LRU end 2024-09-12T17:48:09.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.011+0000 7fc6e8a14800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:09.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.011+0000 7fc6e8a14800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21, ofs0, ns] 2024-09-12T17:48:09.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.011+0000 7fc5bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464303 cookie 94646295182064 notifier 6261 bl.length()=995 2024-09-12T17:48:09.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.011+0000 7fc5bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 info.flags=0x17 2024-09-12T17:48:09.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.011+0000 7fc5bb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 to cache LRU end 2024-09-12T17:48:09.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.011+0000 7fc5bb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:09.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.012+0000 7fc6e8a14800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.21]): orig_sources= new_sources= 2024-09-12T17:48:09.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.012+0000 7fc6e8a14800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.21]): potential sources added=[] removed=[] 2024-09-12T17:48:09.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.012+0000 7fc6e8a14800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.21]): orig_dests= new_dests= 2024-09-12T17:48:09.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.012+0000 7fc6e8a14800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.21]): potential dests added=[] removed=[] 2024-09-12T17:48:09.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.013+0000 7fc6e8a14800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.21.1.0 2024-09-12T17:48:09.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.013+0000 7fc6e8a14800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.21.1.0 2024-09-12T17:48:09.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.013+0000 7fc6e8a14800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.21.1.1 2024-09-12T17:48:09.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.013+0000 7fc6e8a14800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.21.1.1 2024-09-12T17:48:09.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.013+0000 7fc6e8a14800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.21.0 2024-09-12T17:48:09.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.015+0000 7fc6e8a14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:09.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.015+0000 7fc6e8a14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 2024-09-12T17:48:09.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.016+0000 7fc6e8a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 info.flags=0x17 2024-09-12T17:48:09.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.016+0000 7fc6e8a14800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 to cache LRU end 2024-09-12T17:48:09.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.016+0000 7fc6e8a14800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:09.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.016+0000 7fc6e8a14800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21, ofs0, ns] 2024-09-12T17:48:09.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.016+0000 7fc5bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 94646295182064 notifier 6261 bl.length()=963 2024-09-12T17:48:09.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.016+0000 7fc5bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 info.flags=0x17 2024-09-12T17:48:09.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.016+0000 7fc5bb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 to cache LRU end 2024-09-12T17:48:09.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.016+0000 7fc5bb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:09.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.017+0000 7fc6e8a14800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.21]): orig_sources= new_sources= 2024-09-12T17:48:09.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.017+0000 7fc6e8a14800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.21]): potential sources added=[] removed=[] 2024-09-12T17:48:09.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.017+0000 7fc6e8a14800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.21]): orig_dests= new_dests= 2024-09-12T17:48:09.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.017+0000 7fc6e8a14800 20 handle_bi_update(): bucket=:error-at-init-index[35ed0db6-4f54-4e96-b306-71079c84e007.4596.21]): potential dests added=[] removed=[] 2024-09-12T17:48:09.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.018+0000 7fc6e8a14800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T17:48:09.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.020+0000 7fc59afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:09.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.021+0000 7fc6e8a14800 20 remove_watcher() i=0 2024-09-12T17:48:09.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.021+0000 7fc6e8a14800 2 removed watcher, disabling cache 2024-09-12T17:48:09.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.022+0000 7fc6e8a14800 20 remove_watcher() i=1 2024-09-12T17:48:09.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.023+0000 7fc6e8a14800 20 remove_watcher() i=2 2024-09-12T17:48:09.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.024+0000 7fc6e8a14800 20 remove_watcher() i=3 2024-09-12T17:48:09.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.025+0000 7fc6e8a14800 20 remove_watcher() i=4 2024-09-12T17:48:09.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.026+0000 7fc6e8a14800 20 remove_watcher() i=5 2024-09-12T17:48:09.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.027+0000 7fc6e8a14800 20 remove_watcher() i=6 2024-09-12T17:48:09.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.028+0000 7fc6e8a14800 20 remove_watcher() i=7 2024-09-12T17:48:09.041 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:48:09.069 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:09.070 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:09.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.105+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.106+0000 7fcb42325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.106+0000 7fcb42325800 20 realm 2024-09-12T17:48:09.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.106+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.107+0000 7fcb42325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.107+0000 7fcb42325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:09.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.107+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.107+0000 7fcb42325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.107+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.108+0000 7fcb42325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.108+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.108+0000 7fcb42325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.108+0000 7fcb42325800 20 searching for the correct realm 2024-09-12T17:48:09.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.109+0000 7fcb3dfae640 0 -- 172.21.15.107:0/2898716883 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fcb3801f060 msgr2=0x7fcb38058a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:09.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.315+0000 7fcb37fff640 0 -- 172.21.15.107:0/2898716883 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x55b8aecd33b0 msgr2=0x55b8aecd57a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:09.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.320+0000 7fcb42325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:09.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.320+0000 7fcb42325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:09.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.320+0000 7fcb42325800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:09.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.320+0000 7fcb42325800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:09.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.320+0000 7fcb42325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:09.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.320+0000 7fcb42325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:09.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.320+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:09.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:09.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 20 zone default found 2024-09-12T17:48:09.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 4 Realm: () 2024-09-12T17:48:09.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:09.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:09.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:09.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 20 zonegroup default 2024-09-12T17:48:09.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.321+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.322+0000 7fcb42325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.322+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.322+0000 7fcb42325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.322+0000 7fcb42325800 20 started sync module instance, tier type = 2024-09-12T17:48:09.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.322+0000 7fcb42325800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:09.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.330+0000 7fcb42325800 20 add_watcher() i=0 2024-09-12T17:48:09.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.330+0000 7fcb42325800 20 add_watcher() i=1 2024-09-12T17:48:09.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.330+0000 7fcb42325800 20 add_watcher() i=2 2024-09-12T17:48:09.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.330+0000 7fcb42325800 20 add_watcher() i=3 2024-09-12T17:48:09.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.330+0000 7fcb42325800 20 add_watcher() i=4 2024-09-12T17:48:09.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.330+0000 7fcb42325800 20 add_watcher() i=5 2024-09-12T17:48:09.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.330+0000 7fcb42325800 20 add_watcher() i=6 2024-09-12T17:48:09.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.331+0000 7fcb42325800 20 add_watcher() i=7 2024-09-12T17:48:09.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.331+0000 7fcb42325800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:09.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.332+0000 7fc9ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:09.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.333+0000 7fcb42325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:09.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.333+0000 7fcb42325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:09.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.333+0000 7fcb42325800 5 note: GC not initialized 2024-09-12T17:48:09.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.333+0000 7fc9ee7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:09.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.333+0000 7fcb42325800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:09.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.333+0000 7fcb42325800 20 Filter name: none 2024-09-12T17:48:09.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.333+0000 7fc963fff640 20 reqs_thread_entry: start 2024-09-12T17:48:09.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.333+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.334+0000 7fcb42325800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:09.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.334+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.334+0000 7fcb42325800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:09.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.334+0000 7fcb42325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:09.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.334+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.335+0000 7fcb42325800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:48:09.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.335+0000 7fcb42325800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.335+0000 7fcb42325800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:48:09.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.335+0000 7fcb42325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:09.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.336+0000 7fc9ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:09.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.338+0000 7fcb42325800 20 remove_watcher() i=0 2024-09-12T17:48:09.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.338+0000 7fcb42325800 2 removed watcher, disabling cache 2024-09-12T17:48:09.340 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.339+0000 7fcb42325800 20 remove_watcher() i=1 2024-09-12T17:48:09.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.340+0000 7fcb42325800 20 remove_watcher() i=2 2024-09-12T17:48:09.342 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.341+0000 7fcb42325800 20 remove_watcher() i=3 2024-09-12T17:48:09.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.342+0000 7fcb42325800 20 remove_watcher() i=4 2024-09-12T17:48:09.344 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.343+0000 7fcb42325800 20 remove_watcher() i=5 2024-09-12T17:48:09.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.344+0000 7fcb42325800 20 remove_watcher() i=6 2024-09-12T17:48:09.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.345+0000 7fcb42325800 20 remove_watcher() i=7 2024-09-12T17:48:09.356 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:09.356 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:09.356 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-init-index id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.21 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:48:09.357 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:09.418 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T17:48:09.418 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:09.597 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:48:09.626 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:09.626 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:09.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.660+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.662+0000 7f77cb20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.662+0000 7f77cb20e800 20 realm 2024-09-12T17:48:09.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.662+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.662+0000 7f77cb20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.662+0000 7f77cb20e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:09.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.662+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.662+0000 7f77cb20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.662+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.663+0000 7f77cb20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:09.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.663+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.664+0000 7f77cb20e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:09.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.664+0000 7f77cb20e800 20 searching for the correct realm 2024-09-12T17:48:09.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.666+0000 7f77c696b640 0 -- 172.21.15.107:0/3467223066 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f77c0065db0 msgr2=0x7f77c0064820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:09.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.669+0000 7f77c696b640 0 -- 172.21.15.107:0/3467223066 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f77b00a7790 msgr2=0x7f77b00a48e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:09.876 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.875+0000 7f77cb20e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:09.876 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.875+0000 7f77cb20e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:09.876 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.875+0000 7f77cb20e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:09.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.875+0000 7f77cb20e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:09.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.875+0000 7f77cb20e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:09.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.875+0000 7f77cb20e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:09.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.875+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.875+0000 7f77cb20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.875+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:09.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:09.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 20 zone default found 2024-09-12T17:48:09.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 4 Realm: () 2024-09-12T17:48:09.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:09.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:09.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:09.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 20 zonegroup default 2024-09-12T17:48:09.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.876+0000 7f77cb20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.877+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.877+0000 7f77cb20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.877+0000 7f77cb20e800 20 started sync module instance, tier type = 2024-09-12T17:48:09.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.877+0000 7f77cb20e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:09.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.885+0000 7f77cb20e800 20 add_watcher() i=0 2024-09-12T17:48:09.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.885+0000 7f77cb20e800 20 add_watcher() i=1 2024-09-12T17:48:09.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.885+0000 7f77cb20e800 20 add_watcher() i=2 2024-09-12T17:48:09.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.885+0000 7f77cb20e800 20 add_watcher() i=3 2024-09-12T17:48:09.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.885+0000 7f77cb20e800 20 add_watcher() i=4 2024-09-12T17:48:09.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.885+0000 7f77cb20e800 20 add_watcher() i=5 2024-09-12T17:48:09.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.885+0000 7f77cb20e800 20 add_watcher() i=6 2024-09-12T17:48:09.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.886+0000 7f77cb20e800 20 add_watcher() i=7 2024-09-12T17:48:09.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.886+0000 7f77cb20e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:09.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.888+0000 7f767d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:09.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.888+0000 7f77cb20e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:09.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.888+0000 7f77cb20e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:09.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.888+0000 7f77cb20e800 5 note: GC not initialized 2024-09-12T17:48:09.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.888+0000 7f75f7fff640 20 reqs_thread_entry: start 2024-09-12T17:48:09.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.888+0000 7f77cb20e800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:09.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.888+0000 7f77cb20e800 20 Filter name: none 2024-09-12T17:48:09.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.889+0000 7f75f5ffb640 20 reqs_thread_entry: start 2024-09-12T17:48:09.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.889+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.889+0000 7f77cb20e800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:48:09.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.889+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.890+0000 7f77cb20e800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:48:09.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.890+0000 7f77cb20e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:09.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.890+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.890+0000 7f77cb20e800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:48:09.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.890+0000 7f77cb20e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.890+0000 7f77cb20e800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:48:09.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.890+0000 7f77cb20e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:09.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.892+0000 7f767d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:09.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.894+0000 7f77cb20e800 20 remove_watcher() i=0 2024-09-12T17:48:09.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.894+0000 7f77cb20e800 2 removed watcher, disabling cache 2024-09-12T17:48:09.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.895+0000 7f77cb20e800 20 remove_watcher() i=1 2024-09-12T17:48:09.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.896+0000 7f77cb20e800 20 remove_watcher() i=2 2024-09-12T17:48:09.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.896+0000 7f77cb20e800 20 remove_watcher() i=3 2024-09-12T17:48:09.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.897+0000 7f77cb20e800 20 remove_watcher() i=4 2024-09-12T17:48:09.899 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.898+0000 7f77cb20e800 20 remove_watcher() i=5 2024-09-12T17:48:09.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.899+0000 7f77cb20e800 20 remove_watcher() i=6 2024-09-12T17:48:09.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.900+0000 7f77cb20e800 20 remove_watcher() i=7 2024-09-12T17:48:09.911 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:09.911 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:09.911 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-init-indext id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:48:09.912 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:09.913 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T17:48:09.947 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:09.947 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:09.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.982+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 realm 2024-09-12T17:48:09.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.984+0000 7f0eb7c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:09.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.985+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:09.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.985+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.986+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:09.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.986+0000 7f0eb7c20800 20 searching for the correct realm 2024-09-12T17:48:09.990 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.989+0000 7f0eaffff640 0 -- 172.21.15.107:0/1229575009 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f0ea0028040 msgr2=0x7f0ea0036460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:09.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.992+0000 7f0eaffff640 0 -- 172.21.15.107:0/1229575009 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f0d80086c20 msgr2=0x7f0d80089050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:09.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:09.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:09.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:09.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:09.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:09.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:09.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:09.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:09.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:09.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:09.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 zone default found 2024-09-12T17:48:09.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 4 Realm: () 2024-09-12T17:48:09.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:09.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:09.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:09.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 zonegroup default 2024-09-12T17:48:09.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 started sync module instance, tier type = 2024-09-12T17:48:10.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:10.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=0 2024-09-12T17:48:10.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=1 2024-09-12T17:48:10.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=2 2024-09-12T17:48:10.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=3 2024-09-12T17:48:10.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=4 2024-09-12T17:48:10.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=5 2024-09-12T17:48:10.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=6 2024-09-12T17:48:10.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.007+0000 7f0eb7c20800 20 add_watcher() i=7 2024-09-12T17:48:10.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.007+0000 7f0eb7c20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:10.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.008+0000 7f0d6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:10.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.008+0000 7f0eb7c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:10.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.008+0000 7f0eb7c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:10.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.009+0000 7f0eb7c20800 5 note: GC not initialized 2024-09-12T17:48:10.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.009+0000 7f0d6a7e4640 20 reqs_thread_entry: start 2024-09-12T17:48:10.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:10.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 Filter name: none 2024-09-12T17:48:10.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.009+0000 7f0cdbfff640 20 reqs_thread_entry: start 2024-09-12T17:48:10.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.009+0000 7f0eb7c20800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:48:10.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:48:10.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.009+0000 7f0eb7c20800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:48:10.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.009+0000 7f0eb7c20800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:48:10.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.009+0000 7f0eb7c20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 : miss 2024-09-12T17:48:10.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.010+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:48:10.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 info.flags=0x17 2024-09-12T17:48:10.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 to cache LRU end 2024-09-12T17:48:10.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:10.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:10.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 2024-09-12T17:48:10.040 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0eb7c20800 time 2024-09-12T17:48:10.012566+0000 2024-09-12T17:48:10.040 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:48:10.040 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0ebb18c71a] 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0ebb18c8d8] 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5591e666d841] 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd73b64) [0x5591e6b7ab64] 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5591e667d50d] 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0eb9e29590] 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f0eb7c20800 thread_name:radosgw-admin 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.012+0000 7f0eb7c20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0eb7c20800 time 2024-09-12T17:48:10.012566+0000 2024-09-12T17:48:10.041 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0ebb18c71a] 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0ebb18c8d8] 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5591e666d841] 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd73b64) [0x5591e6b7ab64] 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5591e667d50d] 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0eb9e29590] 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0eb9e3e6f0] 2024-09-12T17:48:10.042 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0eb9e8b99c] 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0ebb18c774] 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0ebb18c8d8] 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5591e666d841] 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd73b64) [0x5591e6b7ab64] 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5591e667d50d] 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0eb9e29590] 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.013+0000 7f0eb7c20800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f0eb7c20800 thread_name:radosgw-admin 2024-09-12T17:48:10.043 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0eb9e3e6f0] 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0eb9e8b99c] 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0ebb18c774] 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0ebb18c8d8] 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5591e666d841] 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd73b64) [0x5591e6b7ab64] 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5591e667d50d] 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0eb9e29590] 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:48:10.044 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:48:09.966+0000 7f0eaffff640 10 monclient(hunting): handle_auth_done global_id 5987 payload 274 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:48:09.966+0000 7f0eaffff640 10 monclient: _finish_hunting 0 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:48:09.966+0000 7f0eaffff640 1 monclient: found mon.noname-c 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:48:09.966+0000 7f0eaffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:48:09.966+0000 7f0eb5f12640 10 monclient: get_auth_request con 0x5591e72bb010 auth_method 0 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: dump: 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.045 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: _finish_auth 0 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: _check_auth_tickets 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:48:10.046 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: dump: 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:48:09.966+0000 7f0eb7c20800 5 monclient: authenticate success, global_id 5987 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:48:09.966+0000 7f0eb7c20800 10 monclient: get_monmap_and_config success 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:48:09.966+0000 7f0eb7c20800 4 set_mon_vals no callback set 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:48:09.966+0000 7f0eb7c20800 10 monclient: shutdown 2024-09-12T17:48:10.047 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 asok(0x5591e7149730) unregister_commands rotate-key 2024-09-12T17:48:10.048 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 10 monclient: build_initial_monmap 2024-09-12T17:48:10.048 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 1 build_initial for_mkfs: 0 2024-09-12T17:48:10.048 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 10 monclient: monmap: 2024-09-12T17:48:10.048 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:10.048 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:10.048 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:10.048 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:10.048 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:10.048 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.048 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:10.048 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:10.048 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding auth protocol: cephx 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding auth protocol: cephx 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding auth protocol: cephx 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: secure 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: crc 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: secure 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: crc 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: secure 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: crc 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: crc 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: secure 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: crc 2024-09-12T17:48:10.049 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: secure 2024-09-12T17:48:10.050 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: crc 2024-09-12T17:48:10.050 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: secure 2024-09-12T17:48:10.050 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.050 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 1 librados: starting msgr at 2024-09-12T17:48:10.050 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 1 librados: starting objecter 2024-09-12T17:48:10.050 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command objecter_requests hook 0x5591e7394fc0 2024-09-12T17:48:10.050 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 1 librados: setting wanted keys 2024-09-12T17:48:10.050 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 1 librados: calling monclient init 2024-09-12T17:48:10.050 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 10 monclient: init 2024-09-12T17:48:10.050 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding auth protocol: cephx 2024-09-12T17:48:10.051 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding auth protocol: cephx 2024-09-12T17:48:10.051 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding auth protocol: cephx 2024-09-12T17:48:10.051 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: secure 2024-09-12T17:48:10.051 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: crc 2024-09-12T17:48:10.051 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: secure 2024-09-12T17:48:10.051 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: crc 2024-09-12T17:48:10.051 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: secure 2024-09-12T17:48:10.051 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: crc 2024-09-12T17:48:10.051 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: crc 2024-09-12T17:48:10.051 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: secure 2024-09-12T17:48:10.051 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: crc 2024-09-12T17:48:10.052 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: secure 2024-09-12T17:48:10.052 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: crc 2024-09-12T17:48:10.052 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: secure 2024-09-12T17:48:10.052 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.052 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.052 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command rotate-key hook 0x5591e736bc08 2024-09-12T17:48:10.052 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:10.052 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:48:10.052 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-a con 0x5591e7219440 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:10.052 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-c con 0x5591e72b4ee0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:10.052 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-b con 0x5591e72bb010 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:10.052 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): authenticate will time out at 1894.514113s 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): get_auth_request con 0x5591e7219440 auth_method 0 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): get_auth_request con 0x5591e72b4ee0 auth_method 0 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.053 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:48:09.968+0000 7f0eb5f12640 10 monclient(hunting): get_auth_request con 0x5591e72bb010 auth_method 0 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:48:09.968+0000 7f0eb5f12640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:48:09.968+0000 7f0eb5f12640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:48:09.968+0000 7f0eb5f12640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): handle_auth_done global_id 6309 payload 824 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient: _finish_hunting 0 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:48:09.968+0000 7f0eb5711640 1 monclient: found mon.noname-a 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.054 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: dump: 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: _finish_auth 0 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: _check_auth_tickets 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:10.055 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: dump: 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.056 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 5 monclient: authenticate success, global_id 6309 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:48:09.968+0000 7f0da3606640 4 set_mon_vals no callback set 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient: _renew_subs 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient: _renew_subs 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 1 librados: init done 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:48:09.970+0000 7f0da1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:48:09.970+0000 7f0da1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:48:09.970+0000 7f0da1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:48:09.970+0000 7f0eaffff640 10 monclient: get_auth_request con 0x7f0d9c076470 auth_method 0 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:48:09.971+0000 7f0eb5f12640 10 monclient: get_auth_request con 0x5591e73ad920 auth_method 0 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:48:09.971+0000 7f0eb5711640 10 monclient: get_auth_request con 0x5591e73b70f0 auth_method 0 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:48:09.972+0000 7f0eaffff640 10 monclient: get_auth_request con 0x5591e73bb450 auth_method 0 2024-09-12T17:48:10.057 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 10 monclient: build_initial_monmap 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 1 build_initial for_mkfs: 0 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 10 monclient: monmap: 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding auth protocol: cephx 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding auth protocol: cephx 2024-09-12T17:48:10.058 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding auth protocol: cephx 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: secure 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: crc 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: secure 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: crc 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: secure 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: crc 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: crc 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: secure 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: crc 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: secure 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: crc 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: secure 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.059 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command objecter_requests cmddesc objecter_requests hook 0x5591e73c3c50 EEXIST 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient: init 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding auth protocol: cephx 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding auth protocol: cephx 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding auth protocol: cephx 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: secure 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: crc 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: secure 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: crc 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: secure 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: crc 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: crc 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: secure 2024-09-12T17:48:10.060 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: crc 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: secure 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: crc 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: secure 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command rotate-key cmddesc rotate-key hook 0x5591e73bea60 EEXIST 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-a con 0x5591e73e7940 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-c con 0x5591e73e9c10 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-b con 0x5591e73e6110 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.061 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): authenticate will time out at 1894.520583s 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): get_auth_request con 0x5591e73e7940 auth_method 0 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): get_auth_request con 0x5591e73e9c10 auth_method 0 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.062 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): handle_auth_done global_id 6312 payload 824 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient: _finish_hunting 0 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:48:09.974+0000 7f0eb5711640 1 monclient: found mon.noname-a 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: dump: 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.063 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: _finish_auth 0 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: _check_auth_tickets 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: dump: 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.064 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:48:09.975+0000 7f0eb7c20800 5 monclient: authenticate success, global_id 6312 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:48:09.975+0000 7f0eb7c20800 10 monclient: _renew_subs 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:48:09.975+0000 7f0eb7c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:48:09.975+0000 7f0eb6713640 4 set_mon_vals no callback set 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:48:09.975+0000 7f0eb7c20800 10 monclient: _renew_subs 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:48:09.975+0000 7f0eb7c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:48:09.976+0000 7f0d9affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:10.065 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:48:09.976+0000 7f0d9affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:48:09.976+0000 7f0d9affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:48:09.977+0000 7f0eaffff640 10 monclient: get_auth_request con 0x7f0d90076380 auth_method 0 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 10 monclient: get_monmap_and_config 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 10 monclient: build_initial_monmap 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 1 build_initial for_mkfs: 0 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 10 monclient: monmap: 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:10.066 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding auth protocol: cephx 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding auth protocol: cephx 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding auth protocol: cephx 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: secure 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: crc 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: secure 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: crc 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: secure 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: crc 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: crc 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: secure 2024-09-12T17:48:10.067 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: crc 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: secure 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: crc 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: secure 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 10 monclient: init 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding auth protocol: cephx 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding auth protocol: cephx 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding auth protocol: cephx 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: secure 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: crc 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: secure 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: crc 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: secure 2024-09-12T17:48:10.068 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: crc 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: crc 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: secure 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: crc 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: secure 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: crc 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: secure 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command rotate-key cmddesc rotate-key hook 0x7ffca24458b8 EEXIST 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-c con 0x5591e743bcd0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-b con 0x5591e740b830 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:10.069 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-a con 0x5591e7408760 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): authenticate will time out at 1894.524201s 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): get_auth_request con 0x5591e743bcd0 auth_method 0 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): get_auth_request con 0x5591e7408760 auth_method 0 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.070 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): get_auth_request con 0x5591e740b830 auth_method 0 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): handle_auth_done global_id 5996 payload 274 2024-09-12T17:48:10.071 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient: _finish_hunting 0 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:48:09.978+0000 7f0eb5711640 1 monclient: found mon.noname-c 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: dump: 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.072 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: _finish_auth 0 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: dump: 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.073 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 5 monclient: authenticate success, global_id 5996 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient: get_monmap_and_config success 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 4 set_mon_vals no callback set 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 10 monclient: shutdown 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 10 monclient: build_initial_monmap 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 1 build_initial for_mkfs: 0 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 10 monclient: monmap: 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:10.074 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding auth protocol: cephx 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding auth protocol: cephx 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding auth protocol: cephx 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: secure 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: crc 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: secure 2024-09-12T17:48:10.075 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: crc 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: secure 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: crc 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: crc 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: secure 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: crc 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: secure 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: crc 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: secure 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 1 librados: starting msgr at 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 1 librados: starting objecter 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command objecter_requests cmddesc objecter_requests hook 0x5591e73e97a0 EEXIST 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 1 librados: setting wanted keys 2024-09-12T17:48:10.076 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 1 librados: calling monclient init 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 10 monclient: init 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding auth protocol: cephx 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding auth protocol: cephx 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding auth protocol: cephx 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: secure 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: crc 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: secure 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: crc 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: secure 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: crc 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: crc 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: secure 2024-09-12T17:48:10.077 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: crc 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: secure 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: crc 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: secure 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command rotate-key cmddesc rotate-key hook 0x5591e73ff838 EEXIST 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-a con 0x5591e7408760 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-c con 0x5591e740b830 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-b con 0x5591e743bcd0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.078 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.079 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:10.079 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): authenticate will time out at 1894.526413s 2024-09-12T17:48:10.079 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): get_auth_request con 0x5591e7408760 auth_method 0 2024-09-12T17:48:10.079 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.079 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.079 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.079 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): get_auth_request con 0x5591e740b830 auth_method 0 2024-09-12T17:48:10.079 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.079 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.079 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.079 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): get_auth_request con 0x5591e743bcd0 auth_method 0 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.080 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): handle_auth_done global_id 6318 payload 824 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient: _finish_hunting 0 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:48:09.980+0000 7f0eb5711640 1 monclient: found mon.noname-a 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: dump: 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.081 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: _finish_auth 0 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: dump: 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.082 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 5 monclient: authenticate success, global_id 6318 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:48:09.981+0000 7f0d98ff9640 4 set_mon_vals no callback set 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 10 monclient: _renew_subs 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 10 monclient: _renew_subs 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 1 librados: init done 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command cr dump hook 0x5591e740bd08 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:48:09.982+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.083 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:48:09.983+0000 7f0d86ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:48:09.983+0000 7f0d86ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:48:09.983+0000 7f0d86ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:48:09.983+0000 7f0eaffff640 10 monclient: get_auth_request con 0x7f0d80076470 auth_method 0 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:48:09.983+0000 7f0eb5f12640 10 monclient: get_auth_request con 0x5591e7455790 auth_method 0 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 realm 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:48:09.984+0000 7f0eb5711640 10 monclient: get_auth_request con 0x5591e7459a00 auth_method 0 2024-09-12T17:48:10.084 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:48:09.985+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:48:09.985+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:48:09.985+0000 7f0eaffff640 10 monclient: get_auth_request con 0x5591e745d260 auth_method 0 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:48:09.986+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:48:09.986+0000 7f0eb7c20800 20 searching for the correct realm 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:48:09.986+0000 7f0eb5f12640 10 monclient: get_auth_request con 0x5591e7462020 auth_method 0 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:48:09.986+0000 7f0eb5711640 10 monclient: get_auth_request con 0x7f0eb0061040 auth_method 0 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:48:09.987+0000 7f0eaffff640 10 monclient: get_auth_request con 0x7f0ea0028040 auth_method 0 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:48:09.989+0000 7f0eaffff640 0 -- 172.21.15.107:0/1229575009 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f0ea0028040 msgr2=0x7f0ea0036460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:48:09.989+0000 7f0d86ffd640 1 client.6318.objecter ms_handle_reset 0x7f0ea0028040 session 0x7f0ea001c600 osd.4 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:48:09.989+0000 7f0d86ffd640 10 monclient: _renew_subs 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:48:09.989+0000 7f0d86ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:48:09.989+0000 7f0eaffff640 10 monclient: get_auth_request con 0x7f0d80086c20 auth_method 0 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:48:09.990+0000 7f0eb5f12640 10 monclient: get_auth_request con 0x7f0ea005f410 auth_method 0 2024-09-12T17:48:10.085 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:48:09.992+0000 7f0eb5711640 10 monclient: get_auth_request con 0x7f0ea000d8f0 auth_method 0 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:48:09.992+0000 7f0eaffff640 0 -- 172.21.15.107:0/1229575009 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f0d80086c20 msgr2=0x7f0d80089050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:48:09.992+0000 7f0d86ffd640 1 client.6318.objecter ms_handle_reset 0x7f0d80086c20 session 0x7f0ea001c600 osd.4 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:48:09.993+0000 7f0eaffff640 10 monclient: get_auth_request con 0x7f0ea0028040 auth_method 0 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:10.086 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 zone default found 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 4 Realm: () 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 zonegroup default 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.087 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 started sync module instance, tier type = 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=0 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=1 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=2 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=3 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=4 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=5 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=6 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:48:10.007+0000 7f0eb7c20800 20 add_watcher() i=7 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:48:10.007+0000 7f0eb7c20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding auth protocol: cephx 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding auth protocol: cephx 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding auth protocol: cephx 2024-09-12T17:48:10.088 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: secure 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: crc 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: secure 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: crc 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: secure 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: crc 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: crc 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: secure 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: crc 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: secure 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: crc 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: secure 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:48:10.008+0000 7f0d6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.089 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command cache list hook 0x5591e74348e0 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command cache inspect hook 0x5591e74348e0 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command cache erase hook 0x5591e74348e0 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command cache zap hook 0x5591e74348e0 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 5 note: GC not initialized 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:48:10.009+0000 7f0d6a7e4640 20 reqs_thread_entry: start 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command sync trace show hook 0x7f0ea807d030 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command sync trace history hook 0x7f0ea807d030 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command sync trace active hook 0x7f0ea807d030 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command sync trace active_short hook 0x7f0ea807d030 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 Filter name: none 2024-09-12T17:48:10.090 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:48:10.009+0000 7f0cdbfff640 20 reqs_thread_entry: start 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 : miss 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:48:10.010+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 info.flags=0x17 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 to cache LRU end 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 2024-09-12T17:48:10.091 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:48:10.012+0000 7f0eb7c20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0eb7c20800 time 2024-09-12T17:48:10.012566+0000 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0ebb18c71a] 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0ebb18c8d8] 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5591e666d841] 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd73b64) [0x5591e6b7ab64] 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5591e667d50d] 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0eb9e29590] 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:48:10.092 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:48:10.013+0000 7f0eb7c20800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f0eb7c20800 thread_name:radosgw-admin 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0eb9e3e6f0] 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0eb9e8b99c] 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0ebb18c774] 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0ebb18c8d8] 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5591e666d841] 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd73b64) [0x5591e6b7ab64] 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5591e667d50d] 2024-09-12T17:48:10.093 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0eb9e29590] 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:48:10.094 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:48:10.095 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:48:10.096 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:48:10.097 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:48:10.098 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:48:10.099 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:48:10.100 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0cdbfff640 / http_manager 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0d6a7e4640 / http_manager 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0d6b7e6640 / rgw_dt_lg_renew 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0d86ffd640 / ms_dispatch 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0d98ff9640 / io_context_pool 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0d9affd640 / ms_dispatch 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0da1e03640 / ms_dispatch 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0da3606640 / io_context_pool 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0eaffff640 / msgr-worker-2 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0eb5711640 / msgr-worker-1 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0eb5f12640 / msgr-worker-0 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0eb6713640 / io_context_pool 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0eb7c20800 / radosgw-admin 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:48:10.101 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/log/ceph/ceph-client.admin.90638.log 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:48:09.966+0000 7f0eaffff640 10 monclient(hunting): handle_auth_done global_id 5987 payload 274 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:48:09.966+0000 7f0eaffff640 10 monclient: _finish_hunting 0 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:48:09.966+0000 7f0eaffff640 1 monclient: found mon.noname-c 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:48:09.966+0000 7f0eaffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:48:09.966+0000 7f0eb5f12640 10 monclient: get_auth_request con 0x5591e72bb010 auth_method 0 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: dump: 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.102 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: _finish_auth 0 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: _check_auth_tickets 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:48:09.966+0000 7f0da3606640 10 monclient: dump: 2024-09-12T17:48:10.103 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:48:09.966+0000 7f0eb7c20800 5 monclient: authenticate success, global_id 5987 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:48:09.966+0000 7f0eb7c20800 10 monclient: get_monmap_and_config success 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:48:09.966+0000 7f0eb7c20800 4 set_mon_vals no callback set 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:48:09.966+0000 7f0eb7c20800 10 monclient: shutdown 2024-09-12T17:48:10.104 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 asok(0x5591e7149730) unregister_commands rotate-key 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 10 monclient: build_initial_monmap 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 1 build_initial for_mkfs: 0 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 10 monclient: monmap: 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:10.105 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding auth protocol: cephx 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding auth protocol: cephx 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding auth protocol: cephx 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: secure 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: crc 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: secure 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: crc 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: secure 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: crc 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: crc 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: secure 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: crc 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: secure 2024-09-12T17:48:10.106 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: crc 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e7371180) adding con mode: secure 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 1 librados: starting msgr at 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 1 librados: starting objecter 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command objecter_requests hook 0x5591e7394fc0 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 1 librados: setting wanted keys 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 1 librados: calling monclient init 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 10 monclient: init 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding auth protocol: cephx 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding auth protocol: cephx 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding auth protocol: cephx 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: secure 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: crc 2024-09-12T17:48:10.107 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: secure 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: crc 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: secure 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: crc 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: crc 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: secure 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: crc 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: secure 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: crc 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 5 AuthRegistry(0x5591e736bac0) adding con mode: secure 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:48:09.967+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command rotate-key hook 0x5591e736bc08 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:10.108 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-a con 0x5591e7219440 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-c con 0x5591e72b4ee0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-b con 0x5591e72bb010 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient(hunting): authenticate will time out at 1894.514113s 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): get_auth_request con 0x5591e7219440 auth_method 0 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): get_auth_request con 0x5591e72b4ee0 auth_method 0 2024-09-12T17:48:10.109 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:48:09.968+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:48:09.968+0000 7f0eb5f12640 10 monclient(hunting): get_auth_request con 0x5591e72bb010 auth_method 0 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:48:09.968+0000 7f0eb5f12640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:48:09.968+0000 7f0eb5f12640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:48:09.968+0000 7f0eb5f12640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient(hunting): handle_auth_done global_id 6309 payload 824 2024-09-12T17:48:10.110 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient: _finish_hunting 0 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:48:09.968+0000 7f0eb5711640 1 monclient: found mon.noname-a 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:48:09.968+0000 7f0eb5711640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: dump: 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.111 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: _finish_auth 0 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: _check_auth_tickets 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:48:09.968+0000 7f0da1e03640 10 monclient: dump: 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.112 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 5 monclient: authenticate success, global_id 6309 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:48:09.968+0000 7f0da3606640 4 set_mon_vals no callback set 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient: _renew_subs 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient: _renew_subs 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:48:09.968+0000 7f0eb7c20800 1 librados: init done 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:48:09.970+0000 7f0da1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:10.113 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:48:09.970+0000 7f0da1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:48:09.970+0000 7f0da1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:48:09.970+0000 7f0eaffff640 10 monclient: get_auth_request con 0x7f0d9c076470 auth_method 0 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:48:09.971+0000 7f0eb5f12640 10 monclient: get_auth_request con 0x5591e73ad920 auth_method 0 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:48:09.971+0000 7f0eb5711640 10 monclient: get_auth_request con 0x5591e73b70f0 auth_method 0 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:48:09.972+0000 7f0eaffff640 10 monclient: get_auth_request con 0x5591e73bb450 auth_method 0 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 10 monclient: build_initial_monmap 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 1 build_initial for_mkfs: 0 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 10 monclient: monmap: 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:10.114 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding auth protocol: cephx 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding auth protocol: cephx 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding auth protocol: cephx 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: secure 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: crc 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: secure 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: crc 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: secure 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: crc 2024-09-12T17:48:10.115 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: crc 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: secure 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: crc 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: secure 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: crc 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73c0240) adding con mode: secure 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:48:09.973+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command objecter_requests cmddesc objecter_requests hook 0x5591e73c3c50 EEXIST 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient: init 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding auth protocol: cephx 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding auth protocol: cephx 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding auth protocol: cephx 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: secure 2024-09-12T17:48:10.116 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: crc 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: secure 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: crc 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: secure 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: crc 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: crc 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: secure 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: crc 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: secure 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: crc 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73be918) adding con mode: secure 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command rotate-key cmddesc rotate-key hook 0x5591e73bea60 EEXIST 2024-09-12T17:48:10.117 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-a con 0x5591e73e7940 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-c con 0x5591e73e9c10 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-b con 0x5591e73e6110 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:48:09.974+0000 7f0eb7c20800 10 monclient(hunting): authenticate will time out at 1894.520583s 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): get_auth_request con 0x5591e73e7940 auth_method 0 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.118 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): get_auth_request con 0x5591e73e9c10 auth_method 0 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:48:09.974+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient(hunting): handle_auth_done global_id 6312 payload 824 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient: _finish_hunting 0 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:48:09.974+0000 7f0eb5711640 1 monclient: found mon.noname-a 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:48:09.974+0000 7f0eb5711640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.119 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: dump: 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: _finish_auth 0 2024-09-12T17:48:10.120 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: _check_auth_tickets 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:48:09.975+0000 7f0d9affd640 10 monclient: dump: 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.121 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:48:09.975+0000 7f0eb7c20800 5 monclient: authenticate success, global_id 6312 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:48:09.975+0000 7f0eb7c20800 10 monclient: _renew_subs 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:48:09.975+0000 7f0eb7c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:48:09.975+0000 7f0eb6713640 4 set_mon_vals no callback set 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:48:09.975+0000 7f0eb7c20800 10 monclient: _renew_subs 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:48:09.975+0000 7f0eb7c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:48:09.976+0000 7f0d9affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:48:09.976+0000 7f0d9affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:48:09.976+0000 7f0d9affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:48:09.977+0000 7f0eaffff640 10 monclient: get_auth_request con 0x7f0d90076380 auth_method 0 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 10 monclient: get_monmap_and_config 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 10 monclient: build_initial_monmap 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 1 build_initial for_mkfs: 0 2024-09-12T17:48:10.122 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 10 monclient: monmap: 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding auth protocol: cephx 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding auth protocol: cephx 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding auth protocol: cephx 2024-09-12T17:48:10.123 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: secure 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: crc 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: secure 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: crc 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: secure 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: crc 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: crc 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: secure 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: crc 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: secure 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: crc 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x5591e74077a0) adding con mode: secure 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.124 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 10 monclient: init 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding auth protocol: cephx 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding auth protocol: cephx 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding auth protocol: cephx 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: secure 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: crc 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: secure 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: crc 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: secure 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: crc 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: crc 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: secure 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: crc 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: secure 2024-09-12T17:48:10.125 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: crc 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445770) adding con mode: secure 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:48:09.977+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command rotate-key cmddesc rotate-key hook 0x7ffca24458b8 EEXIST 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-c con 0x5591e743bcd0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-b con 0x5591e740b830 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-a con 0x5591e7408760 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:10.126 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient(hunting): authenticate will time out at 1894.524201s 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): get_auth_request con 0x5591e743bcd0 auth_method 0 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): get_auth_request con 0x5591e7408760 auth_method 0 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): get_auth_request con 0x5591e740b830 auth_method 0 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.127 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:48:09.978+0000 7f0eb5f12640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:48:09.978+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient(hunting): handle_auth_done global_id 5996 payload 274 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient: _finish_hunting 0 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:48:09.978+0000 7f0eb5711640 1 monclient: found mon.noname-c 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:48:09.978+0000 7f0eb5711640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:48:10.128 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: dump: 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: _finish_auth 0 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:10.129 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:48:09.978+0000 7f0d98ff9640 10 monclient: dump: 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 5 monclient: authenticate success, global_id 5996 2024-09-12T17:48:10.130 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 10 monclient: get_monmap_and_config success 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:48:09.978+0000 7f0eb7c20800 4 set_mon_vals no callback set 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 10 monclient: shutdown 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 10 monclient: build_initial_monmap 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 1 build_initial for_mkfs: 0 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 10 monclient: monmap: 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:10.131 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding auth protocol: cephx 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding auth protocol: cephx 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding auth protocol: cephx 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: secure 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: crc 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: secure 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: crc 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: secure 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: crc 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: crc 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: secure 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: crc 2024-09-12T17:48:10.132 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: secure 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: crc 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e740c850) adding con mode: secure 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 1 librados: starting msgr at 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 1 librados: starting objecter 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command objecter_requests cmddesc objecter_requests hook 0x5591e73e97a0 EEXIST 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 1 librados: setting wanted keys 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 1 librados: calling monclient init 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 10 monclient: init 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding auth protocol: cephx 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding auth protocol: cephx 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding auth protocol: cephx 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: secure 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: crc 2024-09-12T17:48:10.133 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: secure 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: crc 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: secure 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: crc 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: crc 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: secure 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: crc 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: secure 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: crc 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:48:09.979+0000 7f0eb7c20800 5 AuthRegistry(0x5591e73ff6f0) adding con mode: secure 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command rotate-key cmddesc rotate-key hook 0x5591e73ff838 EEXIST 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:10.134 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-a con 0x5591e7408760 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-c con 0x5591e740b830 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): picked mon.noname-b con 0x5591e743bcd0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:48:09.980+0000 7f0eb7c20800 10 monclient(hunting): authenticate will time out at 1894.526413s 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): get_auth_request con 0x5591e7408760 auth_method 0 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): get_auth_request con 0x5591e740b830 auth_method 0 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.135 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:48:09.980+0000 7f0eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): get_auth_request con 0x5591e743bcd0 auth_method 0 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:10.136 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:48:09.980+0000 7f0eb5f12640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient(hunting): handle_auth_done global_id 6318 payload 824 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient: _finish_hunting 0 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:48:09.980+0000 7f0eb5711640 1 monclient: found mon.noname-a 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:48:09.980+0000 7f0eb5711640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: dump: 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.137 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: _finish_auth 0 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:48:09.981+0000 7f0d86ffd640 10 monclient: dump: 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:10.138 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 5 monclient: authenticate success, global_id 6318 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:48:09.981+0000 7f0d98ff9640 4 set_mon_vals no callback set 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 10 monclient: _renew_subs 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 10 monclient: _renew_subs 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 1 librados: init done 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:48:09.981+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command cr dump hook 0x5591e740bd08 2024-09-12T17:48:10.139 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:48:09.982+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:48:09.983+0000 7f0d86ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:48:09.983+0000 7f0d86ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:48:09.983+0000 7f0d86ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:48:09.983+0000 7f0eaffff640 10 monclient: get_auth_request con 0x7f0d80076470 auth_method 0 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:48:09.983+0000 7f0eb5f12640 10 monclient: get_auth_request con 0x5591e7455790 auth_method 0 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 realm 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.140 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:48:09.984+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:48:09.984+0000 7f0eb5711640 10 monclient: get_auth_request con 0x5591e7459a00 auth_method 0 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:48:09.985+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:48:09.985+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:48:09.985+0000 7f0eaffff640 10 monclient: get_auth_request con 0x5591e745d260 auth_method 0 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:48:09.986+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:48:09.986+0000 7f0eb7c20800 20 searching for the correct realm 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:48:09.986+0000 7f0eb5f12640 10 monclient: get_auth_request con 0x5591e7462020 auth_method 0 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:48:09.986+0000 7f0eb5711640 10 monclient: get_auth_request con 0x7f0eb0061040 auth_method 0 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:48:09.987+0000 7f0eaffff640 10 monclient: get_auth_request con 0x7f0ea0028040 auth_method 0 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:48:09.989+0000 7f0eaffff640 0 -- 172.21.15.107:0/1229575009 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f0ea0028040 msgr2=0x7f0ea0036460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:48:09.989+0000 7f0d86ffd640 1 client.6318.objecter ms_handle_reset 0x7f0ea0028040 session 0x7f0ea001c600 osd.4 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:48:09.989+0000 7f0d86ffd640 10 monclient: _renew_subs 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:48:09.989+0000 7f0d86ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:10.141 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:48:09.989+0000 7f0eaffff640 10 monclient: get_auth_request con 0x7f0d80086c20 auth_method 0 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:48:09.990+0000 7f0eb5f12640 10 monclient: get_auth_request con 0x7f0ea005f410 auth_method 0 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:48:09.992+0000 7f0eb5711640 10 monclient: get_auth_request con 0x7f0ea000d8f0 auth_method 0 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:48:09.992+0000 7f0eaffff640 0 -- 172.21.15.107:0/1229575009 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f0d80086c20 msgr2=0x7f0d80089050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:48:09.992+0000 7f0d86ffd640 1 client.6318.objecter ms_handle_reset 0x7f0d80086c20 session 0x7f0ea001c600 osd.4 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:48:09.993+0000 7f0eaffff640 10 monclient: get_auth_request con 0x7f0ea0028040 auth_method 0 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.142 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 zone default found 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 4 Realm: () 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 zonegroup default 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:48:09.996+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.143 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 started sync module instance, tier type = 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:48:09.997+0000 7f0eb7c20800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=0 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=1 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=2 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=3 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=4 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=5 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:48:10.006+0000 7f0eb7c20800 20 add_watcher() i=6 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:48:10.007+0000 7f0eb7c20800 20 add_watcher() i=7 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:48:10.007+0000 7f0eb7c20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:10.144 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding auth protocol: cephx 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding auth protocol: cephx 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding auth protocol: cephx 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: secure 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: crc 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: secure 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: crc 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: secure 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: crc 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: crc 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: secure 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: crc 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: secure 2024-09-12T17:48:10.145 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: crc 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 AuthRegistry(0x7ffca2445c40) adding con mode: secure 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:48:10.008+0000 7f0d6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command cache list hook 0x5591e74348e0 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command cache inspect hook 0x5591e74348e0 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command cache erase hook 0x5591e74348e0 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:48:10.008+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command cache zap hook 0x5591e74348e0 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 5 note: GC not initialized 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:48:10.009+0000 7f0d6a7e4640 20 reqs_thread_entry: start 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command sync trace show hook 0x7f0ea807d030 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command sync trace history hook 0x7f0ea807d030 2024-09-12T17:48:10.146 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command sync trace active hook 0x7f0ea807d030 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 5 asok(0x5591e7149730) register_command sync trace active_short hook 0x7f0ea807d030 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 Filter name: none 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:48:10.009+0000 7f0cdbfff640 20 reqs_thread_entry: start 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 : miss 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:48:10.009+0000 7f0eb7c20800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:48:10.010+0000 7f0eb7c20800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 info.flags=0x17 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 to cache LRU end 2024-09-12T17:48:10.147 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:48:10.010+0000 7f0eb7c20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:48:10.012+0000 7f0eb7c20800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0eb7c20800 time 2024-09-12T17:48:10.012566+0000 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0ebb18c71a] 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0ebb18c8d8] 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5591e666d841] 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd73b64) [0x5591e6b7ab64] 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5591e667d50d] 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:48:10.148 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0eb9e29590] 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:48:10.013+0000 7f0eb7c20800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f0eb7c20800 thread_name:radosgw-admin 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0eb9e3e6f0] 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0eb9e8b99c] 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0ebb18c774] 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0ebb18c8d8] 2024-09-12T17:48:10.149 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5591e666d841] 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd73b64) [0x5591e6b7ab64] 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5591e667d50d] 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0eb9e29590] 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:48:10.150 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:48:10.151 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:48:10.152 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:48:10.153 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:48:10.154 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:48:10.155 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:48:10.156 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0cdbfff640 / http_manager 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0d6a7e4640 / http_manager 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0d6b7e6640 / rgw_dt_lg_renew 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0d86ffd640 / ms_dispatch 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0d98ff9640 / io_context_pool 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0d9affd640 / ms_dispatch 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0da1e03640 / ms_dispatch 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0da3606640 / io_context_pool 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0eaffff640 / msgr-worker-2 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0eb5711640 / msgr-worker-1 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0eb5f12640 / msgr-worker-0 2024-09-12T17:48:10.157 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0eb6713640 / io_context_pool 2024-09-12T17:48:10.158 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0eb7c20800 / radosgw-admin 2024-09-12T17:48:10.158 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:48:10.158 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:48:10.158 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:48:10.014207Z_2f99f795-5d11-4df1-a218-577480853d44/log 2024-09-12T17:48:10.158 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:48:10.158 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:48:10.160 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:10.160 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:10.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.087+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.089+0000 7fec06d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.089+0000 7fec06d25800 20 realm 2024-09-12T17:48:10.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.089+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.089+0000 7fec06d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.089+0000 7fec06d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:10.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.089+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.089+0000 7fec06d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.089+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.090+0000 7fec06d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:10.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.090+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.091+0000 7fec06d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:10.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.091+0000 7fec06d25800 20 searching for the correct realm 2024-09-12T17:48:10.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.093+0000 7fec02132640 0 -- 172.21.15.107:0/3671685491 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7febf8068490 msgr2=0x7febf8066f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:10.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.096+0000 7fec02933640 0 -- 172.21.15.107:0/3671685491 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7febf806db80 msgr2=0x7febf8066600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:10.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:10.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:10.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:10.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:10.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:10.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 zone default found 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 4 Realm: () 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 zonegroup default 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.303+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.304+0000 7fec06d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.304+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.304+0000 7fec06d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.304+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.304+0000 7fec06d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.304+0000 7fec06d25800 20 started sync module instance, tier type = 2024-09-12T17:48:10.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.304+0000 7fec06d25800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:10.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.313+0000 7fec06d25800 20 add_watcher() i=0 2024-09-12T17:48:10.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.313+0000 7fec06d25800 20 add_watcher() i=1 2024-09-12T17:48:10.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.313+0000 7fec06d25800 20 add_watcher() i=2 2024-09-12T17:48:10.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.313+0000 7fec06d25800 20 add_watcher() i=3 2024-09-12T17:48:10.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.313+0000 7fec06d25800 20 add_watcher() i=4 2024-09-12T17:48:10.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.313+0000 7fec06d25800 20 add_watcher() i=5 2024-09-12T17:48:10.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.313+0000 7fec06d25800 20 add_watcher() i=6 2024-09-12T17:48:10.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.314+0000 7fec06d25800 20 add_watcher() i=7 2024-09-12T17:48:10.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.314+0000 7fec06d25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:10.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.316+0000 7feab97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:10.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.316+0000 7fec06d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:10.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.316+0000 7fec06d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:10.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.316+0000 7fec06d25800 5 note: GC not initialized 2024-09-12T17:48:10.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.316+0000 7fea33fff640 20 reqs_thread_entry: start 2024-09-12T17:48:10.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.316+0000 7fec06d25800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:10.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.316+0000 7fec06d25800 20 Filter name: none 2024-09-12T17:48:10.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.316+0000 7fea31ffb640 20 reqs_thread_entry: start 2024-09-12T17:48:10.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.316+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.317+0000 7fec06d25800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:48:10.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.317+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.317+0000 7fec06d25800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:48:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.317+0000 7fec06d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.317+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.317+0000 7fec06d25800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:48:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.317+0000 7fec06d25800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.318+0000 7fec06d25800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:48:10.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.318+0000 7fec06d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:10.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.319+0000 7feab97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:10.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.322+0000 7fec06d25800 20 remove_watcher() i=0 2024-09-12T17:48:10.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.322+0000 7fec06d25800 2 removed watcher, disabling cache 2024-09-12T17:48:10.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.323+0000 7fec06d25800 20 remove_watcher() i=1 2024-09-12T17:48:10.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.324+0000 7fec06d25800 20 remove_watcher() i=2 2024-09-12T17:48:10.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.325+0000 7fec06d25800 20 remove_watcher() i=3 2024-09-12T17:48:10.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.326+0000 7fec06d25800 20 remove_watcher() i=4 2024-09-12T17:48:10.328 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.327+0000 7fec06d25800 20 remove_watcher() i=5 2024-09-12T17:48:10.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.328+0000 7fec06d25800 20 remove_watcher() i=6 2024-09-12T17:48:10.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.329+0000 7fec06d25800 20 remove_watcher() i=7 2024-09-12T17:48:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.340 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:10.340 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-init-indext id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:48:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:10.391 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:48:10.424 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:10.424 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:10.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.459+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.460+0000 7f38830bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.460+0000 7f38830bb800 20 realm 2024-09-12T17:48:10.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.460+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.460+0000 7f38830bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.460+0000 7f38830bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:10.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.460+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.460+0000 7f38830bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.460+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.461+0000 7f38830bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:10.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.461+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.462+0000 7f38830bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:10.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.462+0000 7f38830bb800 20 searching for the correct realm 2024-09-12T17:48:10.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.464+0000 7f387bfff640 0 -- 172.21.15.107:0/3489559576 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f386c020070 msgr2=0x7f386c043420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:10.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.467+0000 7f3880ba5640 0 -- 172.21.15.107:0/3489559576 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f386c0363f0 msgr2=0x7f386c036870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:10.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.674+0000 7f38830bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:10.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.674+0000 7f38830bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:10.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.674+0000 7f38830bb800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.674+0000 7f38830bb800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.674+0000 7f38830bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.674+0000 7f38830bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.674+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.674+0000 7f38830bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.674+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 20 zone default found 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 4 Realm: () 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:10.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:10.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 20 zonegroup default 2024-09-12T17:48:10.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.675+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.676+0000 7f38830bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:10.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.676+0000 7f38830bb800 20 started sync module instance, tier type = 2024-09-12T17:48:10.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.676+0000 7f38830bb800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:10.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.684+0000 7f38830bb800 20 add_watcher() i=0 2024-09-12T17:48:10.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.684+0000 7f38830bb800 20 add_watcher() i=1 2024-09-12T17:48:10.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.684+0000 7f38830bb800 20 add_watcher() i=2 2024-09-12T17:48:10.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.684+0000 7f38830bb800 20 add_watcher() i=3 2024-09-12T17:48:10.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.684+0000 7f38830bb800 20 add_watcher() i=4 2024-09-12T17:48:10.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.684+0000 7f38830bb800 20 add_watcher() i=5 2024-09-12T17:48:10.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.684+0000 7f38830bb800 20 add_watcher() i=6 2024-09-12T17:48:10.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.685+0000 7f38830bb800 20 add_watcher() i=7 2024-09-12T17:48:10.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.685+0000 7f38830bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:10.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.686+0000 7f37377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:10.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.687+0000 7f38830bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:10.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.687+0000 7f38830bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:10.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.687+0000 7f38830bb800 5 note: GC not initialized 2024-09-12T17:48:10.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.687+0000 7f37367e4640 20 reqs_thread_entry: start 2024-09-12T17:48:10.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.687+0000 7f38830bb800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:10.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.687+0000 7f38830bb800 20 Filter name: none 2024-09-12T17:48:10.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.687+0000 7f372ffff640 20 reqs_thread_entry: start 2024-09-12T17:48:10.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:48:10.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:48:10.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:48:10.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:48:10.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 : miss 2024-09-12T17:48:10.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 20 rados->read ofs=0 len=0 2024-09-12T17:48:10.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:48:10.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 info.flags=0x17 2024-09-12T17:48:10.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 to cache LRU end 2024-09-12T17:48:10.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:10.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:10.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.688+0000 7f38830bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 2024-09-12T17:48:10.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.690+0000 7f38830bb800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 to be held by another RGW process; skipping for now 2024-09-12T17:48:10.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.690+0000 7f37377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:10.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.692+0000 7f38830bb800 20 remove_watcher() i=0 2024-09-12T17:48:10.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.692+0000 7f38830bb800 2 removed watcher, disabling cache 2024-09-12T17:48:10.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.693+0000 7f38830bb800 20 remove_watcher() i=1 2024-09-12T17:48:10.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.695+0000 7f38830bb800 20 remove_watcher() i=2 2024-09-12T17:48:10.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.696+0000 7f38830bb800 20 remove_watcher() i=3 2024-09-12T17:48:10.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.697+0000 7f38830bb800 20 remove_watcher() i=4 2024-09-12T17:48:10.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.697+0000 7f38830bb800 20 remove_watcher() i=5 2024-09-12T17:48:10.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.698+0000 7f38830bb800 20 remove_watcher() i=6 2024-09-12T17:48:10.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:10.699+0000 7f38830bb800 20 remove_watcher() i=7 2024-09-12T17:48:10.711 INFO:tasks.workunit.client.0.smithi107.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:48:40.744 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:48:40.780 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:40.781 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:40.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.822+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.824+0000 7f60e5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.824+0000 7f60e5746800 20 realm 2024-09-12T17:48:40.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.824+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.824+0000 7f60e5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.824+0000 7f60e5746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:40.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.824+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.824+0000 7f60e5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:40.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.824+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.825+0000 7f60e5746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:40.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.825+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:40.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.826+0000 7f60e5746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:40.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.826+0000 7f60e5746800 20 searching for the correct realm 2024-09-12T17:48:40.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.828+0000 7f60e3237640 0 -- 172.21.15.107:0/1646427093 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f60dc018040 msgr2=0x7f60dc018420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:40.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:40.833+0000 7f60e3237640 0 -- 172.21.15.107:0/1646427093 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f60cc07ffa0 msgr2=0x7f60cc06f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:41.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.039+0000 7f60e5746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:41.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.039+0000 7f60e5746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:41.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.039+0000 7f60e5746800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:41.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.039+0000 7f60e5746800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:41.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.039+0000 7f60e5746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:41.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.039+0000 7f60e5746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:41.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.039+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.040+0000 7f60e5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.040+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.040+0000 7f60e5746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:41.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.040+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:41.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 20 zone default found 2024-09-12T17:48:41.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 4 Realm: () 2024-09-12T17:48:41.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:41.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:41.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:41.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 20 zonegroup default 2024-09-12T17:48:41.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.041+0000 7f60e5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.042+0000 7f60e5746800 20 started sync module instance, tier type = 2024-09-12T17:48:41.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.042+0000 7f60e5746800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:41.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.051+0000 7f60e5746800 20 add_watcher() i=0 2024-09-12T17:48:41.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.051+0000 7f60e5746800 20 add_watcher() i=1 2024-09-12T17:48:41.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.051+0000 7f60e5746800 20 add_watcher() i=2 2024-09-12T17:48:41.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.051+0000 7f60e5746800 20 add_watcher() i=3 2024-09-12T17:48:41.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.051+0000 7f60e5746800 20 add_watcher() i=4 2024-09-12T17:48:41.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.051+0000 7f60e5746800 20 add_watcher() i=5 2024-09-12T17:48:41.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.051+0000 7f60e5746800 20 add_watcher() i=6 2024-09-12T17:48:41.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.052+0000 7f60e5746800 20 add_watcher() i=7 2024-09-12T17:48:41.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.052+0000 7f60e5746800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:41.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.054+0000 7f5f99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:41.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.054+0000 7f60e5746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:41.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.054+0000 7f60e5746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:41.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.054+0000 7f60e5746800 5 note: GC not initialized 2024-09-12T17:48:41.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.054+0000 7f5f98fe1640 20 reqs_thread_entry: start 2024-09-12T17:48:41.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.055+0000 7f60e5746800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:41.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.055+0000 7f60e5746800 20 Filter name: none 2024-09-12T17:48:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.055+0000 7f5f127fc640 20 reqs_thread_entry: start 2024-09-12T17:48:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.055+0000 7f60e5746800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:48:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.055+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.055+0000 7f60e5746800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:48:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.055+0000 7f60e5746800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:48:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.055+0000 7f60e5746800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:48:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.055+0000 7f60e5746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 : miss 2024-09-12T17:48:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.055+0000 7f60e5746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.056+0000 7f60e5746800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:48:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.056+0000 7f60e5746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 info.flags=0x17 2024-09-12T17:48:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.056+0000 7f60e5746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 to cache LRU end 2024-09-12T17:48:41.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.056+0000 7f60e5746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:41.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.056+0000 7f60e5746800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:41.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.056+0000 7f60e5746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 2024-09-12T17:48:41.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.060+0000 7f60e5746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 info.flags=0x17 2024-09-12T17:48:41.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.060+0000 7f60e5746800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 to cache LRU end 2024-09-12T17:48:41.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.060+0000 7f60e5746800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:41.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.060+0000 7f60e5746800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22, ofs0, ns] 2024-09-12T17:48:41.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.060+0000 7f5fc6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464307 cookie 94397294340096 notifier 6375 bl.length()=997 2024-09-12T17:48:41.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.060+0000 7f5fc6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 info.flags=0x17 2024-09-12T17:48:41.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.060+0000 7f5fc6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 to cache LRU end 2024-09-12T17:48:41.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.060+0000 7f5fc6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:41.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.060+0000 7f60e5746800 20 handle_bi_update(): bucket=:abort-at-init-indext[35ed0db6-4f54-4e96-b306-71079c84e007.4596.22]): orig_sources= new_sources= 2024-09-12T17:48:41.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.060+0000 7f60e5746800 20 handle_bi_update(): bucket=:abort-at-init-indext[35ed0db6-4f54-4e96-b306-71079c84e007.4596.22]): potential sources added=[] removed=[] 2024-09-12T17:48:41.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.060+0000 7f60e5746800 20 handle_bi_update(): bucket=:abort-at-init-indext[35ed0db6-4f54-4e96-b306-71079c84e007.4596.22]): orig_dests= new_dests= 2024-09-12T17:48:41.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.060+0000 7f60e5746800 20 handle_bi_update(): bucket=:abort-at-init-indext[35ed0db6-4f54-4e96-b306-71079c84e007.4596.22]): potential dests added=[] removed=[] 2024-09-12T17:48:41.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.063+0000 7f60e5746800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.22.1.0 2024-09-12T17:48:41.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.063+0000 7f60e5746800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.22.1.0 2024-09-12T17:48:41.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.063+0000 7f60e5746800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.22.1.1 2024-09-12T17:48:41.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.063+0000 7f60e5746800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.22.1.1 2024-09-12T17:48:41.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.063+0000 7f60e5746800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.22.0 2024-09-12T17:48:41.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.065+0000 7f60e5746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:41.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.065+0000 7f60e5746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 2024-09-12T17:48:41.066 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.066+0000 7f60e5746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 info.flags=0x17 2024-09-12T17:48:41.066 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.066+0000 7f60e5746800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 to cache LRU end 2024-09-12T17:48:41.066 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.066+0000 7f60e5746800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:41.066 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.066+0000 7f60e5746800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22, ofs0, ns] 2024-09-12T17:48:41.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.067+0000 7f5fc6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464308 cookie 94397294340096 notifier 6375 bl.length()=997 2024-09-12T17:48:41.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.067+0000 7f5fc6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 info.flags=0x17 2024-09-12T17:48:41.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.067+0000 7f5fc6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 to cache LRU end 2024-09-12T17:48:41.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.067+0000 7f5fc6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:41.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.067+0000 7f60e5746800 20 handle_bi_update(): bucket=:abort-at-init-indext[35ed0db6-4f54-4e96-b306-71079c84e007.4596.22]): orig_sources= new_sources= 2024-09-12T17:48:41.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.067+0000 7f60e5746800 20 handle_bi_update(): bucket=:abort-at-init-indext[35ed0db6-4f54-4e96-b306-71079c84e007.4596.22]): potential sources added=[] removed=[] 2024-09-12T17:48:41.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.067+0000 7f60e5746800 20 handle_bi_update(): bucket=:abort-at-init-indext[35ed0db6-4f54-4e96-b306-71079c84e007.4596.22]): orig_dests= new_dests= 2024-09-12T17:48:41.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.067+0000 7f60e5746800 20 handle_bi_update(): bucket=:abort-at-init-indext[35ed0db6-4f54-4e96-b306-71079c84e007.4596.22]): potential dests added=[] removed=[] 2024-09-12T17:48:41.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.068+0000 7f60e5746800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.22.0 2024-09-12T17:48:41.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.068+0000 7f60e5746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:41.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.068+0000 7f60e5746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 2024-09-12T17:48:41.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.070+0000 7f60e5746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 info.flags=0x17 2024-09-12T17:48:41.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.070+0000 7f60e5746800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 to cache LRU end 2024-09-12T17:48:41.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.070+0000 7f60e5746800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:41.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.070+0000 7f60e5746800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22, ofs0, ns] 2024-09-12T17:48:41.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.070+0000 7f5fc6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94397294340096 notifier 6375 bl.length()=965 2024-09-12T17:48:41.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.070+0000 7f5fc6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 info.flags=0x17 2024-09-12T17:48:41.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.070+0000 7f5fc6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 to cache LRU end 2024-09-12T17:48:41.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.070+0000 7f5fc6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:41.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.070+0000 7f60e5746800 20 handle_bi_update(): bucket=:abort-at-init-indext[35ed0db6-4f54-4e96-b306-71079c84e007.4596.22]): orig_sources= new_sources= 2024-09-12T17:48:41.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.070+0000 7f60e5746800 20 handle_bi_update(): bucket=:abort-at-init-indext[35ed0db6-4f54-4e96-b306-71079c84e007.4596.22]): potential sources added=[] removed=[] 2024-09-12T17:48:41.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.070+0000 7f60e5746800 20 handle_bi_update(): bucket=:abort-at-init-indext[35ed0db6-4f54-4e96-b306-71079c84e007.4596.22]): orig_dests= new_dests= 2024-09-12T17:48:41.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.070+0000 7f60e5746800 20 handle_bi_update(): bucket=:abort-at-init-indext[35ed0db6-4f54-4e96-b306-71079c84e007.4596.22]): potential dests added=[] removed=[] 2024-09-12T17:48:41.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.071+0000 7f60e5746800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-12T17:48:41.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.073+0000 7f5f99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:41.075 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.076+0000 7f60e5746800 20 remove_watcher() i=0 2024-09-12T17:48:41.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.076+0000 7f60e5746800 2 removed watcher, disabling cache 2024-09-12T17:48:41.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.077+0000 7f60e5746800 20 remove_watcher() i=1 2024-09-12T17:48:41.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.078+0000 7f60e5746800 20 remove_watcher() i=2 2024-09-12T17:48:41.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.079+0000 7f60e5746800 20 remove_watcher() i=3 2024-09-12T17:48:41.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.080+0000 7f60e5746800 20 remove_watcher() i=4 2024-09-12T17:48:41.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.081+0000 7f60e5746800 20 remove_watcher() i=5 2024-09-12T17:48:41.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.082+0000 7f60e5746800 20 remove_watcher() i=6 2024-09-12T17:48:41.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.082+0000 7f60e5746800 20 remove_watcher() i=7 2024-09-12T17:48:41.095 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:48:41.124 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:41.124 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:41.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.160+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.162+0000 7f1997746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.162+0000 7f1997746800 20 realm 2024-09-12T17:48:41.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.162+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.162+0000 7f1997746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.162+0000 7f1997746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:41.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.162+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.162+0000 7f1997746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.162+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.163+0000 7f1997746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:41.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.163+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.164+0000 7f1997746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:41.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.164+0000 7f1997746800 20 searching for the correct realm 2024-09-12T17:48:41.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.166+0000 7f1994a36640 0 -- 172.21.15.107:0/1915353316 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f198004c040 msgr2=0x7f198004c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:41.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.373+0000 7f1995237640 0 -- 172.21.15.107:0/1915353316 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f1980026920 msgr2=0x7f1980019410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:41.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.578+0000 7f1997746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:41.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.578+0000 7f1997746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:41.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.578+0000 7f1997746800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:41.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.578+0000 7f1997746800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:41.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.578+0000 7f1997746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:41.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.578+0000 7f1997746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:41.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.578+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:41.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:41.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 20 zone default found 2024-09-12T17:48:41.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 4 Realm: () 2024-09-12T17:48:41.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:41.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:41.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:41.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 20 zonegroup default 2024-09-12T17:48:41.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.579+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.580+0000 7f1997746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.580+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.580+0000 7f1997746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.580+0000 7f1997746800 20 started sync module instance, tier type = 2024-09-12T17:48:41.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.580+0000 7f1997746800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:41.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.590+0000 7f1997746800 20 add_watcher() i=0 2024-09-12T17:48:41.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.590+0000 7f1997746800 20 add_watcher() i=1 2024-09-12T17:48:41.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.590+0000 7f1997746800 20 add_watcher() i=2 2024-09-12T17:48:41.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.590+0000 7f1997746800 20 add_watcher() i=3 2024-09-12T17:48:41.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.590+0000 7f1997746800 20 add_watcher() i=4 2024-09-12T17:48:41.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.590+0000 7f1997746800 20 add_watcher() i=5 2024-09-12T17:48:41.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.590+0000 7f1997746800 20 add_watcher() i=6 2024-09-12T17:48:41.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.591+0000 7f1997746800 20 add_watcher() i=7 2024-09-12T17:48:41.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.591+0000 7f1997746800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:41.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.593+0000 7f184bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:41.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.594+0000 7f1997746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:41.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.594+0000 7f1997746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:41.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.594+0000 7f1997746800 5 note: GC not initialized 2024-09-12T17:48:41.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.594+0000 7f184afe5640 20 reqs_thread_entry: start 2024-09-12T17:48:41.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.594+0000 7f1997746800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:41.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.594+0000 7f1997746800 20 Filter name: none 2024-09-12T17:48:41.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.594+0000 7f1848fe1640 20 reqs_thread_entry: start 2024-09-12T17:48:41.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.594+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.594+0000 7f1997746800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:48:41.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.594+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.595+0000 7f1997746800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:48:41.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.595+0000 7f1997746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:41.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.595+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.595+0000 7f1997746800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:48:41.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.595+0000 7f1997746800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.596+0000 7f1997746800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:48:41.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.596+0000 7f1997746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:41.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.597+0000 7f184bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:41.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.599+0000 7f1997746800 20 remove_watcher() i=0 2024-09-12T17:48:41.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.599+0000 7f1997746800 2 removed watcher, disabling cache 2024-09-12T17:48:41.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.601+0000 7f1997746800 20 remove_watcher() i=1 2024-09-12T17:48:41.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.602+0000 7f1997746800 20 remove_watcher() i=2 2024-09-12T17:48:41.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.603+0000 7f1997746800 20 remove_watcher() i=3 2024-09-12T17:48:41.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.604+0000 7f1997746800 20 remove_watcher() i=4 2024-09-12T17:48:41.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.605+0000 7f1997746800 20 remove_watcher() i=5 2024-09-12T17:48:41.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.606+0000 7f1997746800 20 remove_watcher() i=6 2024-09-12T17:48:41.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.607+0000 7f1997746800 20 remove_watcher() i=7 2024-09-12T17:48:41.618 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-init-indext id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:48:41.619 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:41.680 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T17:48:41.680 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:41.858 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:48:41.886 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:41.887 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:41.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.922+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.923+0000 7f43ae40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.923+0000 7f43ae40e800 20 realm 2024-09-12T17:48:41.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.923+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.924+0000 7f43ae40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.924+0000 7f43ae40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:41.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.924+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.924+0000 7f43ae40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.924+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.925+0000 7f43ae40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:41.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.925+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.925+0000 7f43ae40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:41.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.925+0000 7f43ae40e800 20 searching for the correct realm 2024-09-12T17:48:41.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.928+0000 7f43aa25a640 0 -- 172.21.15.107:0/3013292613 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x559c9f752f30 msgr2=0x559c9f755360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:41.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.932+0000 7f43a9258640 0 -- 172.21.15.107:0/3013292613 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f43a008dc20 msgr2=0x7f43a007a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:41.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.935+0000 7f43ae40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:41.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.935+0000 7f43ae40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:41.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.935+0000 7f43ae40e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:41.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.935+0000 7f43ae40e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:41.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.935+0000 7f43ae40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:41.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.935+0000 7f43ae40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:41.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.935+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.938 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:41.938 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 20 zone default found 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 4 Realm: () 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 20 zonegroup default 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.936+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.937+0000 7f43ae40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.937+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.937+0000 7f43ae40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:41.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.937+0000 7f43ae40e800 20 started sync module instance, tier type = 2024-09-12T17:48:41.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.937+0000 7f43ae40e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:41.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.945+0000 7f43ae40e800 20 add_watcher() i=0 2024-09-12T17:48:41.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.945+0000 7f43ae40e800 20 add_watcher() i=1 2024-09-12T17:48:41.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.945+0000 7f43ae40e800 20 add_watcher() i=2 2024-09-12T17:48:41.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.945+0000 7f43ae40e800 20 add_watcher() i=3 2024-09-12T17:48:41.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.945+0000 7f43ae40e800 20 add_watcher() i=4 2024-09-12T17:48:41.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.945+0000 7f43ae40e800 20 add_watcher() i=5 2024-09-12T17:48:41.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.945+0000 7f43ae40e800 20 add_watcher() i=6 2024-09-12T17:48:41.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.946+0000 7f43ae40e800 20 add_watcher() i=7 2024-09-12T17:48:41.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.946+0000 7f43ae40e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:41.949 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.948+0000 7f425b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:41.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.948+0000 7f43ae40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:41.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.948+0000 7f43ae40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:41.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.948+0000 7f43ae40e800 5 note: GC not initialized 2024-09-12T17:48:41.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.948+0000 7f425a7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:41.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.949+0000 7f43ae40e800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:41.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.949+0000 7f43ae40e800 20 Filter name: none 2024-09-12T17:48:41.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.949+0000 7f41cbfff640 20 reqs_thread_entry: start 2024-09-12T17:48:41.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.949+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.949+0000 7f43ae40e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:41.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.949+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.950+0000 7f43ae40e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:41.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.950+0000 7f43ae40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:41.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.950+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.950+0000 7f43ae40e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:41.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.950+0000 7f43ae40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:41.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.950+0000 7f43ae40e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:41.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.951+0000 7f43ae40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:41.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.952+0000 7f425b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:41.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.953+0000 7f43ae40e800 20 remove_watcher() i=0 2024-09-12T17:48:41.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.953+0000 7f43ae40e800 2 removed watcher, disabling cache 2024-09-12T17:48:41.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.954+0000 7f43ae40e800 20 remove_watcher() i=1 2024-09-12T17:48:41.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.955+0000 7f43ae40e800 20 remove_watcher() i=2 2024-09-12T17:48:41.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.956+0000 7f43ae40e800 20 remove_watcher() i=3 2024-09-12T17:48:41.958 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.957+0000 7f43ae40e800 20 remove_watcher() i=4 2024-09-12T17:48:41.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.958+0000 7f43ae40e800 20 remove_watcher() i=5 2024-09-12T17:48:41.960 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.959+0000 7f43ae40e800 20 remove_watcher() i=6 2024-09-12T17:48:41.961 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:41.960+0000 7f43ae40e800 20 remove_watcher() i=7 2024-09-12T17:48:41.971 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:41.971 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:41.971 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-set-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:48:41.971 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:41.972 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T17:48:42.005 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:42.006 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:42.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.040+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.042+0000 7fda24f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.042+0000 7fda24f2c800 20 realm 2024-09-12T17:48:42.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.042+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.042+0000 7fda24f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.042+0000 7fda24f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:42.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.042+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.042+0000 7fda24f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.042+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.043+0000 7fda24f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:42.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.043+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.044+0000 7fda24f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:42.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.044+0000 7fda24f2c800 20 searching for the correct realm 2024-09-12T17:48:42.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.046+0000 7fda1844e640 0 -- 172.21.15.107:0/2206582206 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fda08079940 msgr2=0x7fda08093420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:42.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.050+0000 7fda20c4f640 0 -- 172.21.15.107:0/2206582206 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fda080b0960 msgr2=0x7fda08086420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:42.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.256+0000 7fda24f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:42.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.256+0000 7fda24f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:42.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.256+0000 7fda24f2c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:42.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.256+0000 7fda24f2c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:42.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.256+0000 7fda24f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:42.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.256+0000 7fda24f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:42.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.256+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.256+0000 7fda24f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.256+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:42.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:42.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 20 zone default found 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 4 Realm: () 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 20 zonegroup default 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.257+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.258+0000 7fda24f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.258+0000 7fda24f2c800 20 started sync module instance, tier type = 2024-09-12T17:48:42.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.258+0000 7fda24f2c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:42.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.266+0000 7fda24f2c800 20 add_watcher() i=0 2024-09-12T17:48:42.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.266+0000 7fda24f2c800 20 add_watcher() i=1 2024-09-12T17:48:42.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.266+0000 7fda24f2c800 20 add_watcher() i=2 2024-09-12T17:48:42.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.266+0000 7fda24f2c800 20 add_watcher() i=3 2024-09-12T17:48:42.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.266+0000 7fda24f2c800 20 add_watcher() i=4 2024-09-12T17:48:42.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.266+0000 7fda24f2c800 20 add_watcher() i=5 2024-09-12T17:48:42.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.266+0000 7fda24f2c800 20 add_watcher() i=6 2024-09-12T17:48:42.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.267+0000 7fda24f2c800 20 add_watcher() i=7 2024-09-12T17:48:42.268 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.267+0000 7fda24f2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:42.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.268+0000 7fd8d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:42.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.269+0000 7fda24f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:42.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.269+0000 7fda24f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:42.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.269+0000 7fda24f2c800 5 note: GC not initialized 2024-09-12T17:48:42.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.269+0000 7fd8d5fe3640 20 reqs_thread_entry: start 2024-09-12T17:48:42.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.269+0000 7fda24f2c800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:42.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.269+0000 7fda24f2c800 20 Filter name: none 2024-09-12T17:48:42.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.269+0000 7fd8477fe640 20 reqs_thread_entry: start 2024-09-12T17:48:42.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.269+0000 7fda24f2c800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:48:42.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.269+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.270+0000 7fda24f2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:42.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.270+0000 7fda24f2c800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:48:42.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.270+0000 7fda24f2c800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:48:42.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.270+0000 7fda24f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 : miss 2024-09-12T17:48:42.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.270+0000 7fda24f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.270+0000 7fda24f2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:42.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.270+0000 7fda24f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 info.flags=0x17 2024-09-12T17:48:42.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.270+0000 7fda24f2c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 to cache LRU end 2024-09-12T17:48:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.270+0000 7fda24f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.270+0000 7fda24f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.270+0000 7fda24f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 2024-09-12T17:48:42.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.273+0000 7fda24f2c800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T17:48:42.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.273+0000 7fda24f2c800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T17:48:42.278 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.277+0000 7fd8d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:42.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.279+0000 7fda24f2c800 20 remove_watcher() i=0 2024-09-12T17:48:42.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.279+0000 7fda24f2c800 2 removed watcher, disabling cache 2024-09-12T17:48:42.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.280+0000 7fda24f2c800 20 remove_watcher() i=1 2024-09-12T17:48:42.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.281+0000 7fda24f2c800 20 remove_watcher() i=2 2024-09-12T17:48:42.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.282+0000 7fda24f2c800 20 remove_watcher() i=3 2024-09-12T17:48:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.283+0000 7fda24f2c800 20 remove_watcher() i=4 2024-09-12T17:48:42.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.284+0000 7fda24f2c800 20 remove_watcher() i=5 2024-09-12T17:48:42.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.285+0000 7fda24f2c800 20 remove_watcher() i=6 2024-09-12T17:48:42.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.286+0000 7fda24f2c800 20 remove_watcher() i=7 2024-09-12T17:48:42.298 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:48:42.328 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:42.328 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:42.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.362+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.364+0000 7f010c72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.364+0000 7f010c72f800 20 realm 2024-09-12T17:48:42.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.364+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.364+0000 7f010c72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.364+0000 7f010c72f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:42.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.364+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.364+0000 7f010c72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.366 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.364+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.365+0000 7f010c72f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:42.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.365+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.366+0000 7f010c72f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:42.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.366+0000 7f010c72f800 20 searching for the correct realm 2024-09-12T17:48:42.369 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.368+0000 7f0107c19640 0 -- 172.21.15.107:0/2490542596 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f00fc001c20 msgr2=0x7f00fc067940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:42.372 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.371+0000 7f010841a640 0 -- 172.21.15.107:0/2490542596 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f00fc0719c0 msgr2=0x7f00fc08e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:42.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.577+0000 7f010c72f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:42.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.577+0000 7f010c72f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.577+0000 7f010c72f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.577+0000 7f010c72f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.577+0000 7f010c72f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.577+0000 7f010c72f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.577+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.577+0000 7f010c72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.577+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.578+0000 7f010c72f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.578+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.578+0000 7f010c72f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.578+0000 7f010c72f800 20 zone default found 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.578+0000 7f010c72f800 4 Realm: () 2024-09-12T17:48:42.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.578+0000 7f010c72f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:42.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.578+0000 7f010c72f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:42.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.578+0000 7f010c72f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:42.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.578+0000 7f010c72f800 20 zonegroup default 2024-09-12T17:48:42.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.578+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.578+0000 7f010c72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.578+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.579+0000 7f010c72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.579+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.579+0000 7f010c72f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.579+0000 7f010c72f800 20 started sync module instance, tier type = 2024-09-12T17:48:42.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.579+0000 7f010c72f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:42.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.588+0000 7f010c72f800 20 add_watcher() i=0 2024-09-12T17:48:42.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.588+0000 7f010c72f800 20 add_watcher() i=1 2024-09-12T17:48:42.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.588+0000 7f010c72f800 20 add_watcher() i=2 2024-09-12T17:48:42.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.588+0000 7f010c72f800 20 add_watcher() i=3 2024-09-12T17:48:42.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.588+0000 7f010c72f800 20 add_watcher() i=4 2024-09-12T17:48:42.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.588+0000 7f010c72f800 20 add_watcher() i=5 2024-09-12T17:48:42.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.588+0000 7f010c72f800 20 add_watcher() i=6 2024-09-12T17:48:42.590 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.589+0000 7f010c72f800 20 add_watcher() i=7 2024-09-12T17:48:42.590 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.589+0000 7f010c72f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:42.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.590+0000 7effbefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:42.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.590+0000 7f010c72f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:42.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.590+0000 7f010c72f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:42.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.590+0000 7f010c72f800 5 note: GC not initialized 2024-09-12T17:48:42.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.591+0000 7effbdfdb640 20 reqs_thread_entry: start 2024-09-12T17:48:42.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.591+0000 7f010c72f800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:42.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.591+0000 7f010c72f800 20 Filter name: none 2024-09-12T17:48:42.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.591+0000 7eff2f7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:42.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.591+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.591+0000 7f010c72f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:42.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.591+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.592+0000 7f010c72f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:42.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.592+0000 7f010c72f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:42.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.592+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.592+0000 7f010c72f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:42.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.592+0000 7f010c72f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.592+0000 7f010c72f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:42.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.592+0000 7f010c72f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:42.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.594+0000 7effbefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:42.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.596+0000 7f010c72f800 20 remove_watcher() i=0 2024-09-12T17:48:42.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.596+0000 7f010c72f800 2 removed watcher, disabling cache 2024-09-12T17:48:42.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.597+0000 7f010c72f800 20 remove_watcher() i=1 2024-09-12T17:48:42.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.597+0000 7f010c72f800 20 remove_watcher() i=2 2024-09-12T17:48:42.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.598+0000 7f010c72f800 20 remove_watcher() i=3 2024-09-12T17:48:42.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.600+0000 7f010c72f800 20 remove_watcher() i=4 2024-09-12T17:48:42.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.601+0000 7f010c72f800 20 remove_watcher() i=5 2024-09-12T17:48:42.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.602+0000 7f010c72f800 20 remove_watcher() i=6 2024-09-12T17:48:42.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.603+0000 7f010c72f800 20 remove_watcher() i=7 2024-09-12T17:48:42.614 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:42.614 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:42.614 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-set-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:48:42.614 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:42.665 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:48:42.697 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:42.697 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:42.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.733+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.734+0000 7f3186813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.734+0000 7f3186813800 20 realm 2024-09-12T17:48:42.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.734+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.734+0000 7f3186813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.734+0000 7f3186813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:42.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.734+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.734+0000 7f3186813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:42.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.734+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.735+0000 7f3186813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:42.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.735+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:42.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.736+0000 7f3186813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:42.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.736+0000 7f3186813800 20 searching for the correct realm 2024-09-12T17:48:42.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.738+0000 7f3181747640 0 -- 172.21.15.107:0/350114836 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f316c0962f0 msgr2=0x7f316c05f720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:42.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:42.944+0000 7f3181f48640 0 -- 172.21.15.107:0/350114836 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f316c082870 msgr2=0x7f316c08f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:43.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.151+0000 7f3186813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:43.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.151+0000 7f3186813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:43.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.151+0000 7f3186813800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:43.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.151+0000 7f3186813800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:43.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.151+0000 7f3186813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:43.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.151+0000 7f3186813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.151+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.151+0000 7f3186813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.151+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.152+0000 7f3186813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.152+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.152+0000 7f3186813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.152+0000 7f3186813800 20 zone default found 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.152+0000 7f3186813800 4 Realm: () 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.152+0000 7f3186813800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.152+0000 7f3186813800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.152+0000 7f3186813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.152+0000 7f3186813800 20 zonegroup default 2024-09-12T17:48:43.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.152+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.152+0000 7f3186813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.152+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.153+0000 7f3186813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.153+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.153+0000 7f3186813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.153+0000 7f3186813800 20 started sync module instance, tier type = 2024-09-12T17:48:43.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.153+0000 7f3186813800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:43.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.162+0000 7f3186813800 20 add_watcher() i=0 2024-09-12T17:48:43.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.162+0000 7f3186813800 20 add_watcher() i=1 2024-09-12T17:48:43.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.162+0000 7f3186813800 20 add_watcher() i=2 2024-09-12T17:48:43.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.162+0000 7f3186813800 20 add_watcher() i=3 2024-09-12T17:48:43.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.162+0000 7f3186813800 20 add_watcher() i=4 2024-09-12T17:48:43.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.162+0000 7f3186813800 20 add_watcher() i=5 2024-09-12T17:48:43.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.162+0000 7f3186813800 20 add_watcher() i=6 2024-09-12T17:48:43.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.163+0000 7f3186813800 20 add_watcher() i=7 2024-09-12T17:48:43.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.163+0000 7f3186813800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:43.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.164+0000 7f30337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:43.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.164+0000 7f3186813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:43.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.164+0000 7f3186813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:43.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.164+0000 7f3186813800 5 note: GC not initialized 2024-09-12T17:48:43.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.165+0000 7f30327fc640 20 reqs_thread_entry: start 2024-09-12T17:48:43.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.165+0000 7f3186813800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:43.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.165+0000 7f3186813800 20 Filter name: none 2024-09-12T17:48:43.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.165+0000 7f2fa3fff640 20 reqs_thread_entry: start 2024-09-12T17:48:43.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.165+0000 7f3186813800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:48:43.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.165+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.165+0000 7f3186813800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:43.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.165+0000 7f3186813800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:48:43.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.165+0000 7f3186813800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:48:43.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.165+0000 7f3186813800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 : miss 2024-09-12T17:48:43.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.165+0000 7f3186813800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.166+0000 7f3186813800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:43.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.166+0000 7f3186813800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 info.flags=0x17 2024-09-12T17:48:43.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.166+0000 7f3186813800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 to cache LRU end 2024-09-12T17:48:43.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.166+0000 7f3186813800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:43.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.166+0000 7f3186813800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:43.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.166+0000 7f3186813800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 2024-09-12T17:48:43.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.169+0000 7f3186813800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 info.flags=0x17 2024-09-12T17:48:43.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.169+0000 7f3186813800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 to cache LRU end 2024-09-12T17:48:43.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.169+0000 7f3186813800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:43.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.169+0000 7f3186813800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23, ofs0, ns] 2024-09-12T17:48:43.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.169+0000 7f30657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464297 cookie 94414412640576 notifier 6471 bl.length()=1009 2024-09-12T17:48:43.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.169+0000 7f30657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 info.flags=0x17 2024-09-12T17:48:43.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.169+0000 7f30657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 to cache LRU end 2024-09-12T17:48:43.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.169+0000 7f30657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:43.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.170+0000 7f3186813800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.23]): orig_sources= new_sources= 2024-09-12T17:48:43.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.170+0000 7f3186813800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.23]): potential sources added=[] removed=[] 2024-09-12T17:48:43.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.170+0000 7f3186813800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.23]): orig_dests= new_dests= 2024-09-12T17:48:43.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.170+0000 7f3186813800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.23]): potential dests added=[] removed=[] 2024-09-12T17:48:43.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.172+0000 7f3186813800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.23.1.0 2024-09-12T17:48:43.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.172+0000 7f3186813800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.23.1.0 2024-09-12T17:48:43.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.172+0000 7f3186813800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.23.1.1 2024-09-12T17:48:43.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.172+0000 7f3186813800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.23.1.1 2024-09-12T17:48:43.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.172+0000 7f3186813800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.23.0 2024-09-12T17:48:43.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.174+0000 7f3186813800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:43.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.174+0000 7f3186813800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 2024-09-12T17:48:43.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.176+0000 7f3186813800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 info.flags=0x17 2024-09-12T17:48:43.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.176+0000 7f3186813800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 to cache LRU end 2024-09-12T17:48:43.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.176+0000 7f3186813800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:43.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.176+0000 7f3186813800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23, ofs0, ns] 2024-09-12T17:48:43.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.176+0000 7f30657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 94414412640576 notifier 6471 bl.length()=1009 2024-09-12T17:48:43.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.176+0000 7f30657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 info.flags=0x17 2024-09-12T17:48:43.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.176+0000 7f30657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 to cache LRU end 2024-09-12T17:48:43.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.176+0000 7f30657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:43.178 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.176+0000 7f3186813800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.23]): orig_sources= new_sources= 2024-09-12T17:48:43.178 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.176+0000 7f3186813800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.23]): potential sources added=[] removed=[] 2024-09-12T17:48:43.178 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.176+0000 7f3186813800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.23]): orig_dests= new_dests= 2024-09-12T17:48:43.178 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.176+0000 7f3186813800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.23]): potential dests added=[] removed=[] 2024-09-12T17:48:43.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.178+0000 7f3186813800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.23.0 2024-09-12T17:48:43.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.178+0000 7f3186813800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:43.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.178+0000 7f3186813800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 2024-09-12T17:48:43.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.179+0000 7f3186813800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 info.flags=0x17 2024-09-12T17:48:43.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.179+0000 7f3186813800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 to cache LRU end 2024-09-12T17:48:43.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.179+0000 7f3186813800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:43.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.179+0000 7f3186813800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23, ofs0, ns] 2024-09-12T17:48:43.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.180+0000 7f3064ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94414412640576 notifier 6471 bl.length()=977 2024-09-12T17:48:43.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.180+0000 7f3064ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 info.flags=0x17 2024-09-12T17:48:43.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.180+0000 7f3064ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 to cache LRU end 2024-09-12T17:48:43.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.180+0000 7f3064ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:43.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.180+0000 7f3186813800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.23]): orig_sources= new_sources= 2024-09-12T17:48:43.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.180+0000 7f3186813800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.23]): potential sources added=[] removed=[] 2024-09-12T17:48:43.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.180+0000 7f3186813800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.23]): orig_dests= new_dests= 2024-09-12T17:48:43.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.180+0000 7f3186813800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.23]): potential dests added=[] removed=[] 2024-09-12T17:48:43.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.181+0000 7f3186813800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:48:43.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.183+0000 7f30337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:43.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.185+0000 7f3186813800 20 remove_watcher() i=0 2024-09-12T17:48:43.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.185+0000 7f3186813800 2 removed watcher, disabling cache 2024-09-12T17:48:43.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.186+0000 7f3186813800 20 remove_watcher() i=1 2024-09-12T17:48:43.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.187+0000 7f3186813800 20 remove_watcher() i=2 2024-09-12T17:48:43.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.188+0000 7f3186813800 20 remove_watcher() i=3 2024-09-12T17:48:43.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.189+0000 7f3186813800 20 remove_watcher() i=4 2024-09-12T17:48:43.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.190+0000 7f3186813800 20 remove_watcher() i=5 2024-09-12T17:48:43.192 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.191+0000 7f3186813800 20 remove_watcher() i=6 2024-09-12T17:48:43.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.192+0000 7f3186813800 20 remove_watcher() i=7 2024-09-12T17:48:43.205 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:48:43.233 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:43.233 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:43.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.268+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.270+0000 7f5f65698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.270+0000 7f5f65698800 20 realm 2024-09-12T17:48:43.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.270+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.270+0000 7f5f65698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.270+0000 7f5f65698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:43.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.270+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.270+0000 7f5f65698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.270+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.271+0000 7f5f65698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:43.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.271+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.272+0000 7f5f65698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:43.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.272+0000 7f5f65698800 20 searching for the correct realm 2024-09-12T17:48:43.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.274+0000 7f5f62981640 0 -- 172.21.15.107:0/4278178572 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f5f580b7070 msgr2=0x7f5f580af990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:43.278 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.277+0000 7f5f63182640 0 -- 172.21.15.107:0/4278178572 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f5f5805ac20 msgr2=0x7f5f580a8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:43.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.483+0000 7f5f65698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:43.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.483+0000 7f5f65698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:43.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.483+0000 7f5f65698800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:43.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.483+0000 7f5f65698800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:43.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.483+0000 7f5f65698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:43.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.483+0000 7f5f65698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:43.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.483+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.483+0000 7f5f65698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.483+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.484+0000 7f5f65698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:43.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.484+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.484+0000 7f5f65698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.484+0000 7f5f65698800 20 zone default found 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.484+0000 7f5f65698800 4 Realm: () 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.484+0000 7f5f65698800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.484+0000 7f5f65698800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.484+0000 7f5f65698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.484+0000 7f5f65698800 20 zonegroup default 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.484+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.484+0000 7f5f65698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.484+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.485+0000 7f5f65698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.485+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.485+0000 7f5f65698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.485+0000 7f5f65698800 20 started sync module instance, tier type = 2024-09-12T17:48:43.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.485+0000 7f5f65698800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:43.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.494+0000 7f5f65698800 20 add_watcher() i=0 2024-09-12T17:48:43.495 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.494+0000 7f5f65698800 20 add_watcher() i=1 2024-09-12T17:48:43.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.494+0000 7f5f65698800 20 add_watcher() i=2 2024-09-12T17:48:43.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.494+0000 7f5f65698800 20 add_watcher() i=3 2024-09-12T17:48:43.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.494+0000 7f5f65698800 20 add_watcher() i=4 2024-09-12T17:48:43.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.494+0000 7f5f65698800 20 add_watcher() i=5 2024-09-12T17:48:43.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.494+0000 7f5f65698800 20 add_watcher() i=6 2024-09-12T17:48:43.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.495+0000 7f5f65698800 20 add_watcher() i=7 2024-09-12T17:48:43.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.495+0000 7f5f65698800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:43.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.497+0000 7f5e19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:43.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.497+0000 7f5f65698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:43.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.497+0000 7f5f65698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:43.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.497+0000 7f5f65698800 5 note: GC not initialized 2024-09-12T17:48:43.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.497+0000 7f5e18fe1640 20 reqs_thread_entry: start 2024-09-12T17:48:43.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.497+0000 7f5f65698800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:43.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.498+0000 7f5f65698800 20 Filter name: none 2024-09-12T17:48:43.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.498+0000 7f5d927fc640 20 reqs_thread_entry: start 2024-09-12T17:48:43.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.498+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.498+0000 7f5f65698800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:43.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.498+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.499+0000 7f5f65698800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:43.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.499+0000 7f5f65698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:43.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.499+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.499+0000 7f5f65698800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:43.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.499+0000 7f5f65698800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.499+0000 7f5f65698800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:43.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.499+0000 7f5f65698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:43.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.501+0000 7f5e19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:43.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.503+0000 7f5f65698800 20 remove_watcher() i=0 2024-09-12T17:48:43.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.503+0000 7f5f65698800 2 removed watcher, disabling cache 2024-09-12T17:48:43.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.504+0000 7f5f65698800 20 remove_watcher() i=1 2024-09-12T17:48:43.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.505+0000 7f5f65698800 20 remove_watcher() i=2 2024-09-12T17:48:43.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.506+0000 7f5f65698800 20 remove_watcher() i=3 2024-09-12T17:48:43.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.507+0000 7f5f65698800 20 remove_watcher() i=4 2024-09-12T17:48:43.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.508+0000 7f5f65698800 20 remove_watcher() i=5 2024-09-12T17:48:43.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.509+0000 7f5f65698800 20 remove_watcher() i=6 2024-09-12T17:48:43.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.510+0000 7f5f65698800 20 remove_watcher() i=7 2024-09-12T17:48:43.521 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:43.521 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:43.521 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-set-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.23 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:48:43.521 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:43.584 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T17:48:43.584 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:43.752 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:48:43.780 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:43.780 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:43.816 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.815+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.817+0000 7f1fdee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.817+0000 7f1fdee40800 20 realm 2024-09-12T17:48:43.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.817+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.817+0000 7f1fdee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.817+0000 7f1fdee40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:43.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.817+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.817+0000 7f1fdee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:43.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.817+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.818+0000 7f1fdee40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:43.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.818+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:43.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.819+0000 7f1fdee40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:43.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.819+0000 7f1fdee40800 20 searching for the correct realm 2024-09-12T17:48:43.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.821+0000 7f1fd7fff640 0 -- 172.21.15.107:0/1519535207 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f1fc8021020 msgr2=0x7f1fc8060310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:43.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:43.825+0000 7f1fdc931640 0 -- 172.21.15.107:0/1519535207 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f1fc80901a0 msgr2=0x7f1fc80628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.032+0000 7f1fdee40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.032+0000 7f1fdee40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.032+0000 7f1fdee40800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.032+0000 7f1fdee40800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.032+0000 7f1fdee40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.032+0000 7f1fdee40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.032+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.032+0000 7f1fdee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.032+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.032+0000 7f1fdee40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.032+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.032+0000 7f1fdee40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 20 zone default found 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 4 Realm: () 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 20 zonegroup default 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 20 started sync module instance, tier type = 2024-09-12T17:48:44.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.033+0000 7f1fdee40800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:44.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.042+0000 7f1fdee40800 20 add_watcher() i=0 2024-09-12T17:48:44.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.042+0000 7f1fdee40800 20 add_watcher() i=1 2024-09-12T17:48:44.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.042+0000 7f1fdee40800 20 add_watcher() i=2 2024-09-12T17:48:44.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.042+0000 7f1fdee40800 20 add_watcher() i=3 2024-09-12T17:48:44.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.042+0000 7f1fdee40800 20 add_watcher() i=4 2024-09-12T17:48:44.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.042+0000 7f1fdee40800 20 add_watcher() i=5 2024-09-12T17:48:44.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.042+0000 7f1fdee40800 20 add_watcher() i=6 2024-09-12T17:48:44.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.043+0000 7f1fdee40800 20 add_watcher() i=7 2024-09-12T17:48:44.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.043+0000 7f1fdee40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:44.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.045+0000 7f1e92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:44.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.045+0000 7f1fdee40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:44.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.045+0000 7f1fdee40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:44.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.045+0000 7f1fdee40800 5 note: GC not initialized 2024-09-12T17:48:44.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.045+0000 7f1e91fe3640 20 reqs_thread_entry: start 2024-09-12T17:48:44.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.045+0000 7f1fdee40800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:44.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.045+0000 7f1fdee40800 20 Filter name: none 2024-09-12T17:48:44.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.045+0000 7f1e037fe640 20 reqs_thread_entry: start 2024-09-12T17:48:44.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.046+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.046+0000 7f1fdee40800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:44.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.046+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.047+0000 7f1fdee40800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:44.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.047+0000 7f1fdee40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:44.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.047+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.047+0000 7f1fdee40800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:44.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.047+0000 7f1fdee40800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.047+0000 7f1fdee40800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:44.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.047+0000 7f1fdee40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:44.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.048+0000 7f1e92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:44.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.051+0000 7f1fdee40800 20 remove_watcher() i=0 2024-09-12T17:48:44.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.051+0000 7f1fdee40800 2 removed watcher, disabling cache 2024-09-12T17:48:44.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.052+0000 7f1fdee40800 20 remove_watcher() i=1 2024-09-12T17:48:44.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.053+0000 7f1fdee40800 20 remove_watcher() i=2 2024-09-12T17:48:44.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.054+0000 7f1fdee40800 20 remove_watcher() i=3 2024-09-12T17:48:44.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.054+0000 7f1fdee40800 20 remove_watcher() i=4 2024-09-12T17:48:44.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.055+0000 7f1fdee40800 20 remove_watcher() i=5 2024-09-12T17:48:44.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.056+0000 7f1fdee40800 20 remove_watcher() i=6 2024-09-12T17:48:44.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.057+0000 7f1fdee40800 20 remove_watcher() i=7 2024-09-12T17:48:44.068 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:44.068 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:44.069 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-set-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:48:44.069 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:44.070 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T17:48:44.106 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:44.106 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:44.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.141+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.143+0000 7f33e1c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.143+0000 7f33e1c2f800 20 realm 2024-09-12T17:48:44.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.143+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.143+0000 7f33e1c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.143+0000 7f33e1c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:44.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.143+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.143+0000 7f33e1c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.143+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.144+0000 7f33e1c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:44.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.144+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.144+0000 7f33e1c2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:44.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.144+0000 7f33e1c2f800 20 searching for the correct realm 2024-09-12T17:48:44.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.147+0000 7f33dff1a640 0 -- 172.21.15.107:0/813092164 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x563a6bb6ef10 msgr2=0x563a6bb713d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:44.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.151+0000 7f33df719640 0 -- 172.21.15.107:0/813092164 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f33d40e6b60 msgr2=0x7f33d40ca520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:44.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:44.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:44.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:44.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:44.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:44.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:44.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:44.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:44.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 zone default found 2024-09-12T17:48:44.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 4 Realm: () 2024-09-12T17:48:44.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:44.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:44.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:44.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 zonegroup default 2024-09-12T17:48:44.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.155+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.156+0000 7f33e1c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.156+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.156+0000 7f33e1c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.156+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.156+0000 7f33e1c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.156+0000 7f33e1c2f800 20 started sync module instance, tier type = 2024-09-12T17:48:44.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.156+0000 7f33e1c2f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:44.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.165+0000 7f33e1c2f800 20 add_watcher() i=0 2024-09-12T17:48:44.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.165+0000 7f33e1c2f800 20 add_watcher() i=1 2024-09-12T17:48:44.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.165+0000 7f33e1c2f800 20 add_watcher() i=2 2024-09-12T17:48:44.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.165+0000 7f33e1c2f800 20 add_watcher() i=3 2024-09-12T17:48:44.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.165+0000 7f33e1c2f800 20 add_watcher() i=4 2024-09-12T17:48:44.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.165+0000 7f33e1c2f800 20 add_watcher() i=5 2024-09-12T17:48:44.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.165+0000 7f33e1c2f800 20 add_watcher() i=6 2024-09-12T17:48:44.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.166+0000 7f33e1c2f800 20 add_watcher() i=7 2024-09-12T17:48:44.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.166+0000 7f33e1c2f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:44.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.167+0000 7f32967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:44.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.168+0000 7f33e1c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:44.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.168+0000 7f33e1c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:44.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.168+0000 7f33e1c2f800 5 note: GC not initialized 2024-09-12T17:48:44.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.168+0000 7f32957e2640 20 reqs_thread_entry: start 2024-09-12T17:48:44.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.168+0000 7f33e1c2f800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:44.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.168+0000 7f33e1c2f800 20 Filter name: none 2024-09-12T17:48:44.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.168+0000 7f328e7fc640 20 reqs_thread_entry: start 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.168+0000 7f33e1c2f800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.168+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.169+0000 7f33e1c2f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.169+0000 7f33e1c2f800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.169+0000 7f33e1c2f800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.169+0000 7f33e1c2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 : miss 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.169+0000 7f33e1c2f800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.169+0000 7f33e1c2f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.169+0000 7f33e1c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 info.flags=0x17 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.169+0000 7f33e1c2f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 to cache LRU end 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.169+0000 7f33e1c2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.169+0000 7f33e1c2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:44.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.169+0000 7f33e1c2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 2024-09-12T17:48:44.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.172+0000 7f33e1c2f800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T17:48:44.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.173+0000 7f33e1c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 info.flags=0x17 2024-09-12T17:48:44.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.173+0000 7f33e1c2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 to cache LRU end 2024-09-12T17:48:44.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.173+0000 7f33e1c2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:44.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.173+0000 7f33e1c2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24, ofs0, ns] 2024-09-12T17:48:44.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.173+0000 7f32c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464302 cookie 94808915255408 notifier 6179 bl.length()=1009 2024-09-12T17:48:44.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.173+0000 7f32c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 info.flags=0x17 2024-09-12T17:48:44.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.173+0000 7f32c2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 to cache LRU end 2024-09-12T17:48:44.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.173+0000 7f32c2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:44.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.174+0000 7f33e1c2f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.24]): orig_sources= new_sources= 2024-09-12T17:48:44.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.174+0000 7f33e1c2f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.24]): potential sources added=[] removed=[] 2024-09-12T17:48:44.176 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.174+0000 7f33e1c2f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.24]): orig_dests= new_dests= 2024-09-12T17:48:44.176 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.174+0000 7f33e1c2f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.24]): potential dests added=[] removed=[] 2024-09-12T17:48:44.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.176+0000 7f33e1c2f800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.24.1.0 2024-09-12T17:48:44.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.176+0000 7f33e1c2f800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.24.1.0 2024-09-12T17:48:44.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.176+0000 7f33e1c2f800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.24.1.1 2024-09-12T17:48:44.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.176+0000 7f33e1c2f800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.24.1.1 2024-09-12T17:48:44.177 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.176+0000 7f33e1c2f800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.24.0 2024-09-12T17:48:44.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.178+0000 7f33e1c2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:44.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.178+0000 7f33e1c2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 2024-09-12T17:48:44.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.179+0000 7f33e1c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 info.flags=0x17 2024-09-12T17:48:44.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.179+0000 7f33e1c2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 to cache LRU end 2024-09-12T17:48:44.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.179+0000 7f33e1c2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:44.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.179+0000 7f33e1c2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24, ofs0, ns] 2024-09-12T17:48:44.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.179+0000 7f32c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464303 cookie 94808915255408 notifier 6179 bl.length()=1009 2024-09-12T17:48:44.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.179+0000 7f32c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 info.flags=0x17 2024-09-12T17:48:44.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.179+0000 7f32c2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 to cache LRU end 2024-09-12T17:48:44.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.179+0000 7f32c2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:44.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.180+0000 7f33e1c2f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.24]): orig_sources= new_sources= 2024-09-12T17:48:44.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.180+0000 7f33e1c2f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.24]): potential sources added=[] removed=[] 2024-09-12T17:48:44.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.180+0000 7f33e1c2f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.24]): orig_dests= new_dests= 2024-09-12T17:48:44.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.180+0000 7f33e1c2f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.24]): potential dests added=[] removed=[] 2024-09-12T17:48:44.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.181+0000 7f33e1c2f800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.24.0 2024-09-12T17:48:44.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.181+0000 7f33e1c2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:48:44.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.181+0000 7f33e1c2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 2024-09-12T17:48:44.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.182+0000 7f33e1c2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 info.flags=0x17 2024-09-12T17:48:44.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.182+0000 7f33e1c2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 to cache LRU end 2024-09-12T17:48:44.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.182+0000 7f33e1c2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:44.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.182+0000 7f33e1c2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24, ofs0, ns] 2024-09-12T17:48:44.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.183+0000 7f32c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 94808915255408 notifier 6179 bl.length()=977 2024-09-12T17:48:44.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.183+0000 7f32c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 info.flags=0x17 2024-09-12T17:48:44.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.183+0000 7f32c27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 to cache LRU end 2024-09-12T17:48:44.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.183+0000 7f32c27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:44.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.183+0000 7f33e1c2f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.24]): orig_sources= new_sources= 2024-09-12T17:48:44.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.183+0000 7f33e1c2f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.24]): potential sources added=[] removed=[] 2024-09-12T17:48:44.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.183+0000 7f33e1c2f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.24]): orig_dests= new_dests= 2024-09-12T17:48:44.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.183+0000 7f33e1c2f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.24]): potential dests added=[] removed=[] 2024-09-12T17:48:44.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.184+0000 7f33e1c2f800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:48:44.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.186+0000 7f32967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:44.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.188+0000 7f33e1c2f800 20 remove_watcher() i=0 2024-09-12T17:48:44.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.188+0000 7f33e1c2f800 2 removed watcher, disabling cache 2024-09-12T17:48:44.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.189+0000 7f33e1c2f800 20 remove_watcher() i=1 2024-09-12T17:48:44.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.190+0000 7f33e1c2f800 20 remove_watcher() i=2 2024-09-12T17:48:44.192 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.191+0000 7f33e1c2f800 20 remove_watcher() i=3 2024-09-12T17:48:44.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.192+0000 7f33e1c2f800 20 remove_watcher() i=4 2024-09-12T17:48:44.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.193+0000 7f33e1c2f800 20 remove_watcher() i=5 2024-09-12T17:48:44.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.194+0000 7f33e1c2f800 20 remove_watcher() i=6 2024-09-12T17:48:44.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.195+0000 7f33e1c2f800 20 remove_watcher() i=7 2024-09-12T17:48:44.208 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:48:44.236 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:44.237 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:44.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.271+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.273+0000 7fa34a40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.273+0000 7fa34a40e800 20 realm 2024-09-12T17:48:44.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.273+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.273+0000 7fa34a40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.273+0000 7fa34a40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:44.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.273+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.274+0000 7fa34a40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.274+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.274+0000 7fa34a40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:44.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.274+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.275+0000 7fa34a40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:44.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.275+0000 7fa34a40e800 20 searching for the correct realm 2024-09-12T17:48:44.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.479+0000 7fa34625a640 0 -- 172.21.15.107:0/537790929 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5569be24a540 msgr2=0x5569be24ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:44.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.482+0000 7fa345a59640 0 -- 172.21.15.107:0/537790929 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fa3300d3180 msgr2=0x7fa3300b7040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:44.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:44.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:44.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:44.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:44.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:44.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:44.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:44.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:44.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 zone default found 2024-09-12T17:48:44.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 4 Realm: () 2024-09-12T17:48:44.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:44.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:44.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:44.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 zonegroup default 2024-09-12T17:48:44.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.486+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.487+0000 7fa34a40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.487+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.487+0000 7fa34a40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.487+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.487+0000 7fa34a40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:44.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.487+0000 7fa34a40e800 20 started sync module instance, tier type = 2024-09-12T17:48:44.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.487+0000 7fa34a40e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:44.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.496+0000 7fa34a40e800 20 add_watcher() i=0 2024-09-12T17:48:44.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.496+0000 7fa34a40e800 20 add_watcher() i=1 2024-09-12T17:48:44.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.496+0000 7fa34a40e800 20 add_watcher() i=2 2024-09-12T17:48:44.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.496+0000 7fa34a40e800 20 add_watcher() i=3 2024-09-12T17:48:44.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.496+0000 7fa34a40e800 20 add_watcher() i=4 2024-09-12T17:48:44.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.496+0000 7fa34a40e800 20 add_watcher() i=5 2024-09-12T17:48:44.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.496+0000 7fa34a40e800 20 add_watcher() i=6 2024-09-12T17:48:44.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.497+0000 7fa34a40e800 20 add_watcher() i=7 2024-09-12T17:48:44.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.497+0000 7fa34a40e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:44.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.499+0000 7fa1f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:44.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.499+0000 7fa34a40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:44.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.499+0000 7fa34a40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:44.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.499+0000 7fa34a40e800 5 note: GC not initialized 2024-09-12T17:48:44.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.499+0000 7fa1f67fc640 20 reqs_thread_entry: start 2024-09-12T17:48:44.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.499+0000 7fa34a40e800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:44.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.499+0000 7fa34a40e800 20 Filter name: none 2024-09-12T17:48:44.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.499+0000 7fa167fff640 20 reqs_thread_entry: start 2024-09-12T17:48:44.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.499+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.500+0000 7fa34a40e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:44.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.500+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.500+0000 7fa34a40e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:44.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.500+0000 7fa34a40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:44.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.500+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.501+0000 7fa34a40e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:44.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.501+0000 7fa34a40e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:44.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.501+0000 7fa34a40e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:44.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.501+0000 7fa34a40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:44.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.502+0000 7fa1f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:44.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.504+0000 7fa34a40e800 20 remove_watcher() i=0 2024-09-12T17:48:44.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.504+0000 7fa34a40e800 2 removed watcher, disabling cache 2024-09-12T17:48:44.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.506+0000 7fa34a40e800 20 remove_watcher() i=1 2024-09-12T17:48:44.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.507+0000 7fa34a40e800 20 remove_watcher() i=2 2024-09-12T17:48:44.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.508+0000 7fa34a40e800 20 remove_watcher() i=3 2024-09-12T17:48:44.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.508+0000 7fa34a40e800 20 remove_watcher() i=4 2024-09-12T17:48:44.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.509+0000 7fa34a40e800 20 remove_watcher() i=5 2024-09-12T17:48:44.511 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.510+0000 7fa34a40e800 20 remove_watcher() i=6 2024-09-12T17:48:44.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:44.511+0000 7fa34a40e800 20 remove_watcher() i=7 2024-09-12T17:48:44.523 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:44.523 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:44.523 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-set-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.24 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:48:44.523 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:44.585 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T17:48:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:44.767 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:48:44.795 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:44.795 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:45.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.028+0000 7fd446c4e640 0 --2- 172.21.15.107:0/3582517398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca612b550 0x55bca612b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:48:45.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.033+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.035+0000 7fd44b72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.035+0000 7fd44b72c800 20 realm 2024-09-12T17:48:45.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.035+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.035+0000 7fd44b72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.035+0000 7fd44b72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:45.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.035+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.035+0000 7fd44b72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.035+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.036+0000 7fd44b72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:45.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.036+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.037+0000 7fd44b72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:45.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.037+0000 7fd44b72c800 20 searching for the correct realm 2024-09-12T17:48:45.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.038+0000 7fd44744f640 0 -- 172.21.15.107:0/3737178838 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fd440071040 msgr2=0x7fd4400a8af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:45.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.244+0000 7fd446c4e640 0 -- 172.21.15.107:0/3737178838 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x55bca615ca90 msgr2=0x55bca615ee80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:45.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.249+0000 7fd44b72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:45.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.249+0000 7fd44b72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:45.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.249+0000 7fd44b72c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:45.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.249+0000 7fd44b72c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:45.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.249+0000 7fd44b72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:45.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.249+0000 7fd44b72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:45.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.249+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.249+0000 7fd44b72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.249+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.249+0000 7fd44b72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:45.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.249+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:45.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 20 zone default found 2024-09-12T17:48:45.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 4 Realm: () 2024-09-12T17:48:45.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:45.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:45.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:45.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 20 zonegroup default 2024-09-12T17:48:45.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 20 started sync module instance, tier type = 2024-09-12T17:48:45.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.250+0000 7fd44b72c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:45.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.259+0000 7fd44b72c800 20 add_watcher() i=0 2024-09-12T17:48:45.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.259+0000 7fd44b72c800 20 add_watcher() i=1 2024-09-12T17:48:45.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.259+0000 7fd44b72c800 20 add_watcher() i=2 2024-09-12T17:48:45.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.259+0000 7fd44b72c800 20 add_watcher() i=3 2024-09-12T17:48:45.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.259+0000 7fd44b72c800 20 add_watcher() i=4 2024-09-12T17:48:45.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.259+0000 7fd44b72c800 20 add_watcher() i=5 2024-09-12T17:48:45.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.259+0000 7fd44b72c800 20 add_watcher() i=6 2024-09-12T17:48:45.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.259+0000 7fd44b72c800 20 add_watcher() i=7 2024-09-12T17:48:45.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.259+0000 7fd44b72c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:45.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.261+0000 7fd2fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:45.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.261+0000 7fd44b72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:45.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.261+0000 7fd44b72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:45.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.262+0000 7fd44b72c800 5 note: GC not initialized 2024-09-12T17:48:45.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.262+0000 7fd2fcfe1640 20 reqs_thread_entry: start 2024-09-12T17:48:45.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.262+0000 7fd44b72c800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:45.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.262+0000 7fd44b72c800 20 Filter name: none 2024-09-12T17:48:45.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.262+0000 7fd2767fc640 20 reqs_thread_entry: start 2024-09-12T17:48:45.264 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.262+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.263+0000 7fd44b72c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:45.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.263+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.264+0000 7fd44b72c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:45.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.264+0000 7fd44b72c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:45.265 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.264+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.266 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.264+0000 7fd44b72c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:45.266 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.264+0000 7fd44b72c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.266 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.264+0000 7fd44b72c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:45.266 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.264+0000 7fd44b72c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:45.267 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.266+0000 7fd2fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:45.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.268+0000 7fd44b72c800 20 remove_watcher() i=0 2024-09-12T17:48:45.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.268+0000 7fd44b72c800 2 removed watcher, disabling cache 2024-09-12T17:48:45.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.269+0000 7fd44b72c800 20 remove_watcher() i=1 2024-09-12T17:48:45.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.270+0000 7fd44b72c800 20 remove_watcher() i=2 2024-09-12T17:48:45.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.271+0000 7fd44b72c800 20 remove_watcher() i=3 2024-09-12T17:48:45.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.272+0000 7fd44b72c800 20 remove_watcher() i=4 2024-09-12T17:48:45.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.273+0000 7fd44b72c800 20 remove_watcher() i=5 2024-09-12T17:48:45.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.274+0000 7fd44b72c800 20 remove_watcher() i=6 2024-09-12T17:48:45.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.275+0000 7fd44b72c800 20 remove_watcher() i=7 2024-09-12T17:48:45.286 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.286 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:45.286 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-set-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:48:45.286 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.288 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T17:48:45.321 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:45.321 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:45.358 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.356+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 realm 2024-09-12T17:48:45.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.358+0000 7fc8d8f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:45.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.359+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:45.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.359+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.361 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.360+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:45.361 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.360+0000 7fc8d8f2c800 20 searching for the correct realm 2024-09-12T17:48:45.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.362+0000 7fc8cffff640 0 -- 172.21.15.107:0/189702249 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fc8c00a6040 msgr2=0x7fc8c005f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:45.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.366+0000 7fc8d4b61640 0 -- 172.21.15.107:0/189702249 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc8c00a6420 msgr2=0x7fc8c0061950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:45.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:45.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:45.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:45.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:45.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:45.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 zone default found 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 4 Realm: () 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 zonegroup default 2024-09-12T17:48:45.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 started sync module instance, tier type = 2024-09-12T17:48:45.578 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:45.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.582+0000 7fc8d8f2c800 20 add_watcher() i=0 2024-09-12T17:48:45.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.582+0000 7fc8d8f2c800 20 add_watcher() i=1 2024-09-12T17:48:45.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.582+0000 7fc8d8f2c800 20 add_watcher() i=2 2024-09-12T17:48:45.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.582+0000 7fc8d8f2c800 20 add_watcher() i=3 2024-09-12T17:48:45.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.583+0000 7fc8d8f2c800 20 add_watcher() i=4 2024-09-12T17:48:45.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.583+0000 7fc8d8f2c800 20 add_watcher() i=5 2024-09-12T17:48:45.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.583+0000 7fc8d8f2c800 20 add_watcher() i=6 2024-09-12T17:48:45.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.583+0000 7fc8d8f2c800 20 add_watcher() i=7 2024-09-12T17:48:45.585 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.583+0000 7fc8d8f2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:45.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.585+0000 7fc78afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:45.587 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.585+0000 7fc8d8f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:45.587 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.585+0000 7fc8d8f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:45.587 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 note: GC not initialized 2024-09-12T17:48:45.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.585+0000 7fc789fe3640 20 reqs_thread_entry: start 2024-09-12T17:48:45.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:45.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 Filter name: none 2024-09-12T17:48:45.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.586+0000 7fc6fb7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:45.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.586+0000 7fc8d8f2c800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:48:45.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:45.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.586+0000 7fc8d8f2c800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:48:45.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.586+0000 7fc8d8f2c800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:48:45.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.586+0000 7fc8d8f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 : miss 2024-09-12T17:48:45.588 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.587+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:45.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 info.flags=0x17 2024-09-12T17:48:45.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 to cache LRU end 2024-09-12T17:48:45.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:45.590 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:45.590 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 2024-09-12T17:48:45.590 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc8d8f2c800 time 2024-09-12T17:48:45.590468+0000 2024-09-12T17:48:45.590 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:48:45.591 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:45.591 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc8da58c71a] 2024-09-12T17:48:45.591 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc8da58c8d8] 2024-09-12T17:48:45.591 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559901a04841] 2024-09-12T17:48:45.591 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd73ca8) [0x559901f11ca8] 2024-09-12T17:48:45.591 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559901a1450d] 2024-09-12T17:48:45.591 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:48:45.591 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc8d9229590] 2024-09-12T17:48:45.591 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:48:45.592 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:48:45.592 INFO:tasks.workunit.client.0.smithi107.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:48:45.592 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7fc8d8f2c800 thread_name:radosgw-admin 2024-09-12T17:48:45.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.590+0000 7fc8d8f2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc8d8f2c800 time 2024-09-12T17:48:45.590468+0000 2024-09-12T17:48:45.592 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:48:45.592 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.592 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:45.592 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc8da58c71a] 2024-09-12T17:48:45.592 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc8da58c8d8] 2024-09-12T17:48:45.592 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559901a04841] 2024-09-12T17:48:45.592 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd73ca8) [0x559901f11ca8] 2024-09-12T17:48:45.593 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559901a1450d] 2024-09-12T17:48:45.593 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:48:45.593 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc8d9229590] 2024-09-12T17:48:45.593 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:48:45.593 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:48:45.593 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.613 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:45.613 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc8d923e6f0] 2024-09-12T17:48:45.613 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc8d928b99c] 2024-09-12T17:48:45.614 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:48:45.614 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:48:45.614 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc8da58c774] 2024-09-12T17:48:45.614 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc8da58c8d8] 2024-09-12T17:48:45.614 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559901a04841] 2024-09-12T17:48:45.614 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd73ca8) [0x559901f11ca8] 2024-09-12T17:48:45.614 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559901a1450d] 2024-09-12T17:48:45.614 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:48:45.614 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc8d9229590] 2024-09-12T17:48:45.614 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:48:45.614 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:48:45.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.591+0000 7fc8d8f2c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:48:45.615 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7fc8d8f2c800 thread_name:radosgw-admin 2024-09-12T17:48:45.615 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.615 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:45.615 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc8d923e6f0] 2024-09-12T17:48:45.615 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc8d928b99c] 2024-09-12T17:48:45.615 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:48:45.615 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:48:45.615 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc8da58c774] 2024-09-12T17:48:45.615 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc8da58c8d8] 2024-09-12T17:48:45.615 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559901a04841] 2024-09-12T17:48:45.616 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd73ca8) [0x559901f11ca8] 2024-09-12T17:48:45.616 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559901a1450d] 2024-09-12T17:48:45.616 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:48:45.616 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc8d9229590] 2024-09-12T17:48:45.616 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:48:45.616 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:48:45.616 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:48:45.616 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.616 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:48:45.616 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:45.617 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: dump: 2024-09-12T17:48:45.617 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.617 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.617 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.617 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.617 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.617 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.617 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.617 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.617 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.617 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.617 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: _finish_auth 0 2024-09-12T17:48:45.618 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: _check_auth_tickets 2024-09-12T17:48:45.618 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:45.618 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:48:45.340+0000 7fc8d8f2c800 5 monclient: authenticate success, global_id 6570 2024-09-12T17:48:45.618 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:48:45.340+0000 7fc8d8f2c800 10 monclient: get_monmap_and_config success 2024-09-12T17:48:45.618 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:48:45.340+0000 7fc8d8f2c800 4 set_mon_vals no callback set 2024-09-12T17:48:45.618 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.618 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:45.618 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: dump: 2024-09-12T17:48:45.618 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.618 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.618 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.619 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.619 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.619 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.619 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.619 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.619 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.619 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.619 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:48:45.340+0000 7fc8d8f2c800 10 monclient: shutdown 2024-09-12T17:48:45.619 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:48:45.340+0000 7fc8d8f2c800 5 asok(0x55990317b730) unregister_commands rotate-key 2024-09-12T17:48:45.619 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 10 monclient: build_initial_monmap 2024-09-12T17:48:45.619 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:48:45.619 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 10 monclient: monmap: 2024-09-12T17:48:45.620 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:45.620 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:45.620 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:45.620 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:45.620 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:45.620 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.620 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:45.620 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:45.620 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:45.620 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.620 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding auth protocol: cephx 2024-09-12T17:48:45.620 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding auth protocol: cephx 2024-09-12T17:48:45.621 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding auth protocol: cephx 2024-09-12T17:48:45.621 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: secure 2024-09-12T17:48:45.621 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: crc 2024-09-12T17:48:45.621 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: secure 2024-09-12T17:48:45.621 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: crc 2024-09-12T17:48:45.621 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: secure 2024-09-12T17:48:45.621 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: crc 2024-09-12T17:48:45.621 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: crc 2024-09-12T17:48:45.621 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: secure 2024-09-12T17:48:45.621 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: crc 2024-09-12T17:48:45.621 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: secure 2024-09-12T17:48:45.622 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: crc 2024-09-12T17:48:45.622 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: secure 2024-09-12T17:48:45.622 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.622 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 1 librados: starting msgr at 2024-09-12T17:48:45.622 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 1 librados: starting objecter 2024-09-12T17:48:45.622 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command objecter_requests hook 0x5599033a44c0 2024-09-12T17:48:45.622 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 1 librados: setting wanted keys 2024-09-12T17:48:45.622 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 1 librados: calling monclient init 2024-09-12T17:48:45.622 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 10 monclient: init 2024-09-12T17:48:45.622 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding auth protocol: cephx 2024-09-12T17:48:45.622 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding auth protocol: cephx 2024-09-12T17:48:45.622 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding auth protocol: cephx 2024-09-12T17:48:45.623 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: secure 2024-09-12T17:48:45.623 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: crc 2024-09-12T17:48:45.623 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: secure 2024-09-12T17:48:45.623 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: crc 2024-09-12T17:48:45.623 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: secure 2024-09-12T17:48:45.623 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: crc 2024-09-12T17:48:45.623 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: crc 2024-09-12T17:48:45.623 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: secure 2024-09-12T17:48:45.623 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: crc 2024-09-12T17:48:45.623 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: secure 2024-09-12T17:48:45.623 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: crc 2024-09-12T17:48:45.623 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: secure 2024-09-12T17:48:45.624 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.624 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.624 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command rotate-key hook 0x55990339cc78 2024-09-12T17:48:45.624 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:45.624 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:48:45.624 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-b con 0x559903254a90 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:45.625 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-a con 0x5599032dfbd0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:45.625 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-c con 0x5599032dfff0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:45.625 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.625 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.625 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.625 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:45.625 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): authenticate will time out at 1929.888147s 2024-09-12T17:48:45.625 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): get_auth_request con 0x5599032dfbd0 auth_method 0 2024-09-12T17:48:45.625 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.625 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.625 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.625 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): get_auth_request con 0x5599032dfff0 auth_method 0 2024-09-12T17:48:45.626 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.626 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.626 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.626 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.626 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.626 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.626 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.626 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.626 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.626 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request con 0x559903254a90 auth_method 0 2024-09-12T17:48:45.626 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.626 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.627 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.627 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.627 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.627 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.627 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): handle_auth_done global_id 6573 payload 824 2024-09-12T17:48:45.627 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient: _finish_hunting 0 2024-09-12T17:48:45.627 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:48:45.342+0000 7fc8cffff640 1 monclient: found mon.noname-a 2024-09-12T17:48:45.627 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.627 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.627 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:45.627 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: dump: 2024-09-12T17:48:45.628 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.628 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.628 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.628 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.628 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.628 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.628 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.628 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.628 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.628 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.628 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: _finish_auth 0 2024-09-12T17:48:45.628 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: _check_auth_tickets 2024-09-12T17:48:45.629 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:45.629 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.629 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:45.629 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: dump: 2024-09-12T17:48:45.629 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.629 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.629 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.629 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.629 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.629 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.629 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.630 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.630 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.630 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.630 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 5 monclient: authenticate success, global_id 6573 2024-09-12T17:48:45.630 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient: _renew_subs 2024-09-12T17:48:45.630 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.630 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:48:45.342+0000 7fc7c2e05640 4 set_mon_vals no callback set 2024-09-12T17:48:45.630 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient: _renew_subs 2024-09-12T17:48:45.630 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.630 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 1 librados: init done 2024-09-12T17:48:45.630 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:48:45.344+0000 7fc7c1602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:45.631 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:48:45.344+0000 7fc7c1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:45.631 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:48:45.344+0000 7fc7c1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:45.631 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:48:45.344+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x7fc7bc076470 auth_method 0 2024-09-12T17:48:45.631 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:48:45.344+0000 7fc8d5362640 10 monclient: get_auth_request con 0x5599033c4fc0 auth_method 0 2024-09-12T17:48:45.631 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:48:45.345+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x5599033e9550 auth_method 0 2024-09-12T17:48:45.631 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:48:45.346+0000 7fc8cffff640 10 monclient: get_auth_request con 0x5599033ed740 auth_method 0 2024-09-12T17:48:45.631 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 10 monclient: build_initial_monmap 2024-09-12T17:48:45.631 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:48:45.631 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 10 monclient: monmap: 2024-09-12T17:48:45.631 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:45.631 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:45.632 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:45.632 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:45.632 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:45.632 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.632 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:45.632 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:45.632 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:45.632 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.632 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding auth protocol: cephx 2024-09-12T17:48:45.632 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding auth protocol: cephx 2024-09-12T17:48:45.632 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding auth protocol: cephx 2024-09-12T17:48:45.633 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: secure 2024-09-12T17:48:45.633 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: crc 2024-09-12T17:48:45.633 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: secure 2024-09-12T17:48:45.633 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: crc 2024-09-12T17:48:45.633 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: secure 2024-09-12T17:48:45.633 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: crc 2024-09-12T17:48:45.633 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: crc 2024-09-12T17:48:45.633 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: secure 2024-09-12T17:48:45.633 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: crc 2024-09-12T17:48:45.633 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: secure 2024-09-12T17:48:45.633 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: crc 2024-09-12T17:48:45.633 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: secure 2024-09-12T17:48:45.634 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.634 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command objecter_requests cmddesc objecter_requests hook 0x5599033f5be0 EEXIST 2024-09-12T17:48:45.634 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient: init 2024-09-12T17:48:45.634 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding auth protocol: cephx 2024-09-12T17:48:45.634 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding auth protocol: cephx 2024-09-12T17:48:45.634 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding auth protocol: cephx 2024-09-12T17:48:45.634 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: secure 2024-09-12T17:48:45.634 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: crc 2024-09-12T17:48:45.634 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: secure 2024-09-12T17:48:45.634 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: crc 2024-09-12T17:48:45.634 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: secure 2024-09-12T17:48:45.635 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: crc 2024-09-12T17:48:45.635 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: crc 2024-09-12T17:48:45.635 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: secure 2024-09-12T17:48:45.635 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: crc 2024-09-12T17:48:45.635 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: secure 2024-09-12T17:48:45.635 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: crc 2024-09-12T17:48:45.635 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: secure 2024-09-12T17:48:45.635 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.635 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.635 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command rotate-key cmddesc rotate-key hook 0x5599033f0ab0 EEXIST 2024-09-12T17:48:45.635 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:45.635 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:48:45.636 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-a con 0x5599034198d0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:45.636 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-b con 0x55990341bba0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:45.636 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-c con 0x5599034180a0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:45.636 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.636 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.636 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.636 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:45.636 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): authenticate will time out at 1929.894722s 2024-09-12T17:48:45.636 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request con 0x5599034198d0 auth_method 0 2024-09-12T17:48:45.636 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.636 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.636 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.637 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): get_auth_request con 0x5599034180a0 auth_method 0 2024-09-12T17:48:45.637 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.637 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.637 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.637 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.637 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.637 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.637 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:48:45.348+0000 7fc8cffff640 10 monclient(hunting): get_auth_request con 0x55990341bba0 auth_method 0 2024-09-12T17:48:45.637 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:48:45.348+0000 7fc8cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.637 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:48:45.348+0000 7fc8cffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.637 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:48:45.348+0000 7fc8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.637 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.638 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.638 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.638 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:48:45.348+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.638 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:48:45.348+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.638 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:48:45.349+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.638 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:48:45.349+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_done global_id 6576 payload 824 2024-09-12T17:48:45.638 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:48:45.349+0000 7fc8d4b61640 10 monclient: _finish_hunting 0 2024-09-12T17:48:45.638 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:48:45.349+0000 7fc8d4b61640 1 monclient: found mon.noname-a 2024-09-12T17:48:45.638 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:48:45.349+0000 7fc8d4b61640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.638 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.638 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:45.639 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: dump: 2024-09-12T17:48:45.639 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.639 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.639 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.639 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.639 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.639 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.639 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.639 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.639 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.639 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.639 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: _finish_auth 0 2024-09-12T17:48:45.640 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:48:45.640 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:48:45.349+0000 7fc8d8f2c800 5 monclient: authenticate success, global_id 6576 2024-09-12T17:48:45.640 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:45.640 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.640 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:45.640 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: dump: 2024-09-12T17:48:45.640 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.640 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.640 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.640 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.640 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.641 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.641 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.641 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.641 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.641 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.641 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:48:45.349+0000 7fc8d8f2c800 10 monclient: _renew_subs 2024-09-12T17:48:45.641 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:48:45.349+0000 7fc8d5b63640 4 set_mon_vals no callback set 2024-09-12T17:48:45.641 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:48:45.349+0000 7fc8d8f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.641 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:48:45.349+0000 7fc8d8f2c800 10 monclient: _renew_subs 2024-09-12T17:48:45.641 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:48:45.349+0000 7fc8d8f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.641 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:48:45.351+0000 7fc7ba7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:45.642 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:48:45.351+0000 7fc7ba7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:45.642 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:48:45.351+0000 7fc7ba7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:45.642 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 10 monclient: get_monmap_and_config 2024-09-12T17:48:45.642 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 10 monclient: build_initial_monmap 2024-09-12T17:48:45.642 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:48:45.642 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 10 monclient: monmap: 2024-09-12T17:48:45.642 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:45.642 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:45.642 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:45.642 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:45.642 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:45.642 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.643 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:45.643 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:45.643 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:45.643 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.643 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:48:45.351+0000 7fc8cffff640 10 monclient: get_auth_request con 0x7fc7ac076380 auth_method 0 2024-09-12T17:48:45.643 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding auth protocol: cephx 2024-09-12T17:48:45.643 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding auth protocol: cephx 2024-09-12T17:48:45.643 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding auth protocol: cephx 2024-09-12T17:48:45.643 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: secure 2024-09-12T17:48:45.643 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: crc 2024-09-12T17:48:45.643 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: secure 2024-09-12T17:48:45.644 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: crc 2024-09-12T17:48:45.644 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: secure 2024-09-12T17:48:45.644 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: crc 2024-09-12T17:48:45.644 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: crc 2024-09-12T17:48:45.644 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: secure 2024-09-12T17:48:45.644 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: crc 2024-09-12T17:48:45.644 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: secure 2024-09-12T17:48:45.644 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: crc 2024-09-12T17:48:45.644 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: secure 2024-09-12T17:48:45.644 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.644 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 10 monclient: init 2024-09-12T17:48:45.644 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding auth protocol: cephx 2024-09-12T17:48:45.645 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding auth protocol: cephx 2024-09-12T17:48:45.645 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding auth protocol: cephx 2024-09-12T17:48:45.645 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: secure 2024-09-12T17:48:45.645 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: crc 2024-09-12T17:48:45.645 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: secure 2024-09-12T17:48:45.645 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: crc 2024-09-12T17:48:45.645 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: secure 2024-09-12T17:48:45.645 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: crc 2024-09-12T17:48:45.645 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: crc 2024-09-12T17:48:45.645 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: secure 2024-09-12T17:48:45.645 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: crc 2024-09-12T17:48:45.645 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: secure 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: crc 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: secure 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command rotate-key cmddesc rotate-key hook 0x7ffd6fb6ffb8 EEXIST 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-c con 0x55990346dd50 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-b con 0x5599034682f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-a con 0x55990343db90 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.646 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.647 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:45.647 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): authenticate will time out at 1929.898498s 2024-09-12T17:48:45.647 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request con 0x55990346dd50 auth_method 0 2024-09-12T17:48:45.647 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.647 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.647 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.647 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): get_auth_request con 0x55990343db90 auth_method 0 2024-09-12T17:48:45.647 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.647 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.647 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.647 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.648 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.648 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.648 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.648 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.648 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.648 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): get_auth_request con 0x5599034682f0 auth_method 0 2024-09-12T17:48:45.648 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.648 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.648 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.648 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.648 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.649 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.649 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_done global_id 6227 payload 274 2024-09-12T17:48:45.649 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient: _finish_hunting 0 2024-09-12T17:48:45.649 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 1 monclient: found mon.noname-c 2024-09-12T17:48:45.649 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:48:45.649 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.649 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:48:45.649 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: dump: 2024-09-12T17:48:45.649 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.649 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.649 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.649 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: _finish_auth 0 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: _check_auth_tickets 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: dump: 2024-09-12T17:48:45.650 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 monclient: authenticate success, global_id 6227 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 10 monclient: get_monmap_and_config success 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 4 set_mon_vals no callback set 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 10 monclient: shutdown 2024-09-12T17:48:45.651 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 10 monclient: build_initial_monmap 2024-09-12T17:48:45.652 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:48:45.652 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 10 monclient: monmap: 2024-09-12T17:48:45.652 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:45.652 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:45.652 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:45.652 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:45.652 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:45.652 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.652 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:45.652 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:45.652 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:45.653 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.653 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding auth protocol: cephx 2024-09-12T17:48:45.653 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding auth protocol: cephx 2024-09-12T17:48:45.653 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding auth protocol: cephx 2024-09-12T17:48:45.653 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: secure 2024-09-12T17:48:45.653 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: crc 2024-09-12T17:48:45.653 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: secure 2024-09-12T17:48:45.653 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: crc 2024-09-12T17:48:45.653 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: secure 2024-09-12T17:48:45.653 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: crc 2024-09-12T17:48:45.653 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: crc 2024-09-12T17:48:45.654 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: secure 2024-09-12T17:48:45.654 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: crc 2024-09-12T17:48:45.654 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: secure 2024-09-12T17:48:45.654 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: crc 2024-09-12T17:48:45.654 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: secure 2024-09-12T17:48:45.654 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.654 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 1 librados: starting msgr at 2024-09-12T17:48:45.654 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 1 librados: starting objecter 2024-09-12T17:48:45.654 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command objecter_requests cmddesc objecter_requests hook 0x55990345f7f0 EEXIST 2024-09-12T17:48:45.654 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 1 librados: setting wanted keys 2024-09-12T17:48:45.654 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 1 librados: calling monclient init 2024-09-12T17:48:45.654 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient: init 2024-09-12T17:48:45.655 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding auth protocol: cephx 2024-09-12T17:48:45.655 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding auth protocol: cephx 2024-09-12T17:48:45.655 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding auth protocol: cephx 2024-09-12T17:48:45.655 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: secure 2024-09-12T17:48:45.655 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: crc 2024-09-12T17:48:45.655 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: secure 2024-09-12T17:48:45.655 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: crc 2024-09-12T17:48:45.655 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: secure 2024-09-12T17:48:45.655 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: crc 2024-09-12T17:48:45.655 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: crc 2024-09-12T17:48:45.655 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: secure 2024-09-12T17:48:45.655 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: crc 2024-09-12T17:48:45.656 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: secure 2024-09-12T17:48:45.656 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: crc 2024-09-12T17:48:45.656 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: secure 2024-09-12T17:48:45.656 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.656 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.656 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command rotate-key cmddesc rotate-key hook 0x5599034317c8 EEXIST 2024-09-12T17:48:45.656 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:45.656 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:48:45.656 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-c con 0x55990343db90 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:45.656 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-a con 0x5599034682f0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:45.656 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-b con 0x55990346dd50 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:45.657 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.657 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.657 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.657 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:45.657 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): authenticate will time out at 1929.900754s 2024-09-12T17:48:45.657 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request con 0x55990343db90 auth_method 0 2024-09-12T17:48:45.657 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.657 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.657 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.657 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): get_auth_request con 0x5599034682f0 auth_method 0 2024-09-12T17:48:45.657 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.657 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.658 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.658 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.658 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.658 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.658 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.658 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.658 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.658 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:48:45.354+0000 7fc8d5362640 10 monclient(hunting): get_auth_request con 0x55990346dd50 auth_method 0 2024-09-12T17:48:45.658 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:48:45.354+0000 7fc8d5362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.658 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:48:45.354+0000 7fc8d5362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.658 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:48:45.354+0000 7fc8d5362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.659 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:48:45.355+0000 7fc8cffff640 10 monclient(hunting): handle_auth_done global_id 6582 payload 824 2024-09-12T17:48:45.659 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:48:45.355+0000 7fc8cffff640 10 monclient: _finish_hunting 0 2024-09-12T17:48:45.659 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:48:45.355+0000 7fc8cffff640 1 monclient: found mon.noname-a 2024-09-12T17:48:45.659 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:48:45.355+0000 7fc8cffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.659 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.659 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:45.659 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: dump: 2024-09-12T17:48:45.659 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.659 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.659 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.659 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.660 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.660 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.660 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.660 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.660 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.660 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.660 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: _finish_auth 0 2024-09-12T17:48:45.660 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:48:45.660 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 5 monclient: authenticate success, global_id 6582 2024-09-12T17:48:45.660 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 10 monclient: _renew_subs 2024-09-12T17:48:45.660 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.660 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:45.661 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.661 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:45.661 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: dump: 2024-09-12T17:48:45.661 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.661 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.661 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.661 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.662 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.662 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.662 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.662 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.662 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.662 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.662 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:48:45.355+0000 7fc7abfff640 4 set_mon_vals no callback set 2024-09-12T17:48:45.662 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 10 monclient: _renew_subs 2024-09-12T17:48:45.662 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.662 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 1 librados: init done 2024-09-12T17:48:45.662 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command cr dump hook 0x55990343b728 2024-09-12T17:48:45.662 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:48:45.356+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.663 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:48:45.357+0000 7fc7aa7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:45.663 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:48:45.357+0000 7fc7aa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:45.663 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:48:45.357+0000 7fc7aa7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:45.663 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:48:45.357+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x7fc7a00764a0 auth_method 0 2024-09-12T17:48:45.663 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:48:45.357+0000 7fc8d5362640 10 monclient: get_auth_request con 0x559903487da0 auth_method 0 2024-09-12T17:48:45.663 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.663 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 realm 2024-09-12T17:48:45.663 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.663 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.663 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:45.663 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.664 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.664 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.664 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:48:45.358+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x55990348c160 auth_method 0 2024-09-12T17:48:45.664 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:48:45.359+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:45.664 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:48:45.359+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.664 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:48:45.359+0000 7fc8cffff640 10 monclient: get_auth_request con 0x55990348f880 auth_method 0 2024-09-12T17:48:45.664 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:48:45.360+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:45.664 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:48:45.360+0000 7fc8d8f2c800 20 searching for the correct realm 2024-09-12T17:48:45.664 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:48:45.360+0000 7fc8d5362640 10 monclient: get_auth_request con 0x559903494600 auth_method 0 2024-09-12T17:48:45.664 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:48:45.361+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x7fc8d004dc20 auth_method 0 2024-09-12T17:48:45.664 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:48:45.361+0000 7fc8cffff640 10 monclient: get_auth_request con 0x7fc8c00a6040 auth_method 0 2024-09-12T17:48:45.665 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:48:45.362+0000 7fc8cffff640 0 -- 172.21.15.107:0/189702249 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fc8c00a6040 msgr2=0x7fc8c005f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:45.665 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:48:45.362+0000 7fc7aa7fc640 1 client.6582.objecter ms_handle_reset 0x7fc8c00a6040 session 0x7fc8c000a0f0 osd.4 2024-09-12T17:48:45.665 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:48:45.362+0000 7fc7aa7fc640 10 monclient: _renew_subs 2024-09-12T17:48:45.665 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:48:45.362+0000 7fc7aa7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.665 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:48:45.362+0000 7fc8cffff640 10 monclient: get_auth_request con 0x7fc7a0086b50 auth_method 0 2024-09-12T17:48:45.665 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:48:45.364+0000 7fc8d5362640 10 monclient: get_auth_request con 0x7fc8c0080040 auth_method 0 2024-09-12T17:48:45.665 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:48:45.366+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x7fc8c00a6420 auth_method 0 2024-09-12T17:48:45.665 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:48:45.366+0000 7fc8d4b61640 0 -- 172.21.15.107:0/189702249 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc8c00a6420 msgr2=0x7fc8c0061950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:45.665 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:48:45.568+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x7fc8c00a6420 auth_method 0 2024-09-12T17:48:45.665 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:45.665 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:45.666 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:45.666 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:45.666 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:45.666 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:45.666 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.666 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.666 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.666 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:45.666 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.666 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:45.666 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 zone default found 2024-09-12T17:48:45.666 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 4 Realm: () 2024-09-12T17:48:45.667 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:45.667 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:45.667 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:45.667 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 zonegroup default 2024-09-12T17:48:45.667 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.667 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.667 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.667 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.667 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.667 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.667 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 started sync module instance, tier type = 2024-09-12T17:48:45.668 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:45.668 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:48:45.582+0000 7fc8d8f2c800 20 add_watcher() i=0 2024-09-12T17:48:45.668 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:48:45.582+0000 7fc8d8f2c800 20 add_watcher() i=1 2024-09-12T17:48:45.668 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:48:45.582+0000 7fc8d8f2c800 20 add_watcher() i=2 2024-09-12T17:48:45.668 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:48:45.582+0000 7fc8d8f2c800 20 add_watcher() i=3 2024-09-12T17:48:45.668 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:48:45.583+0000 7fc8d8f2c800 20 add_watcher() i=4 2024-09-12T17:48:45.668 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:48:45.583+0000 7fc8d8f2c800 20 add_watcher() i=5 2024-09-12T17:48:45.668 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:48:45.583+0000 7fc8d8f2c800 20 add_watcher() i=6 2024-09-12T17:48:45.668 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:48:45.583+0000 7fc8d8f2c800 20 add_watcher() i=7 2024-09-12T17:48:45.668 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:48:45.583+0000 7fc8d8f2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:45.668 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding auth protocol: cephx 2024-09-12T17:48:45.668 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding auth protocol: cephx 2024-09-12T17:48:45.669 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding auth protocol: cephx 2024-09-12T17:48:45.669 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: secure 2024-09-12T17:48:45.669 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: crc 2024-09-12T17:48:45.669 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: secure 2024-09-12T17:48:45.669 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: crc 2024-09-12T17:48:45.669 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: secure 2024-09-12T17:48:45.669 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: crc 2024-09-12T17:48:45.669 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: crc 2024-09-12T17:48:45.669 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: secure 2024-09-12T17:48:45.669 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: crc 2024-09-12T17:48:45.669 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: secure 2024-09-12T17:48:45.669 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: crc 2024-09-12T17:48:45.670 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: secure 2024-09-12T17:48:45.670 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:48:45.585+0000 7fc78afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:45.670 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.670 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:45.670 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:45.670 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command cache list hook 0x55990343b230 2024-09-12T17:48:45.670 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command cache inspect hook 0x55990343b230 2024-09-12T17:48:45.670 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command cache erase hook 0x55990343b230 2024-09-12T17:48:45.670 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command cache zap hook 0x55990343b230 2024-09-12T17:48:45.670 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 note: GC not initialized 2024-09-12T17:48:45.670 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:48:45.585+0000 7fc789fe3640 20 reqs_thread_entry: start 2024-09-12T17:48:45.670 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command sync trace show hook 0x7fc8c0001350 2024-09-12T17:48:45.671 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command sync trace history hook 0x7fc8c0001350 2024-09-12T17:48:45.671 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command sync trace active hook 0x7fc8c0001350 2024-09-12T17:48:45.671 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command sync trace active_short hook 0x7fc8c0001350 2024-09-12T17:48:45.671 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:45.671 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 Filter name: none 2024-09-12T17:48:45.671 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:48:45.586+0000 7fc6fb7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:45.671 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:48:45.671 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.671 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:45.671 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:48:45.671 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:48:45.671 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 : miss 2024-09-12T17:48:45.672 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.672 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:48:45.587+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:45.672 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 info.flags=0x17 2024-09-12T17:48:45.672 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 to cache LRU end 2024-09-12T17:48:45.672 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:45.672 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:45.672 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 2024-09-12T17:48:45.672 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:48:45.590+0000 7fc8d8f2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc8d8f2c800 time 2024-09-12T17:48:45.590468+0000 2024-09-12T17:48:45.672 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:48:45.672 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.672 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:45.673 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc8da58c71a] 2024-09-12T17:48:45.673 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc8da58c8d8] 2024-09-12T17:48:45.673 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559901a04841] 2024-09-12T17:48:45.673 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd73ca8) [0x559901f11ca8] 2024-09-12T17:48:45.673 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559901a1450d] 2024-09-12T17:48:45.673 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:48:45.673 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc8d9229590] 2024-09-12T17:48:45.673 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:48:45.673 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:48:45.673 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.673 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:48:45.591+0000 7fc8d8f2c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:48:45.673 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7fc8d8f2c800 thread_name:radosgw-admin 2024-09-12T17:48:45.674 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.674 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:45.674 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc8d923e6f0] 2024-09-12T17:48:45.674 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc8d928b99c] 2024-09-12T17:48:45.674 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:48:45.674 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:48:45.674 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc8da58c774] 2024-09-12T17:48:45.674 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc8da58c8d8] 2024-09-12T17:48:45.674 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559901a04841] 2024-09-12T17:48:45.674 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd73ca8) [0x559901f11ca8] 2024-09-12T17:48:45.674 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559901a1450d] 2024-09-12T17:48:45.674 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:48:45.675 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc8d9229590] 2024-09-12T17:48:45.675 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:48:45.675 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:48:45.675 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:48:45.675 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.675 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:48:45.675 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:48:45.675 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:48:45.675 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:48:45.675 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:48:45.675 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:48:45.676 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:48:45.676 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:48:45.676 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:48:45.676 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:48:45.676 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:48:45.676 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:48:45.676 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:48:45.676 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:48:45.676 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:48:45.676 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:48:45.676 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:48:45.676 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:48:45.677 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:48:45.678 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:48:45.678 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:48:45.678 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:48:45.678 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:48:45.678 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:48:45.678 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:48:45.678 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:48:45.678 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:48:45.678 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:48:45.678 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:48:45.678 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:48:45.678 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:48:45.679 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:48:45.679 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:48:45.679 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:48:45.679 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:48:45.679 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:48:45.679 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:48:45.679 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:48:45.679 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:48:45.679 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:48:45.679 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:48:45.679 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:48:45.679 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:48:45.680 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:48:45.680 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:48:45.680 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:48:45.680 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:48:45.680 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:48:45.680 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:48:45.680 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:48:45.680 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:48:45.680 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:48:45.680 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:48:45.680 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:48:45.681 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:48:45.681 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:48:45.681 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:48:45.681 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:48:45.681 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:48:45.681 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:48:45.681 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:48:45.681 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:48:45.681 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:48:45.681 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:48:45.681 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:48:45.682 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:48:45.683 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:48:45.683 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:48:45.683 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:48:45.683 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:48:45.683 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc6fb7fe640 / http_manager 2024-09-12T17:48:45.683 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc789fe3640 / http_manager 2024-09-12T17:48:45.683 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc78afe5640 / rgw_dt_lg_renew 2024-09-12T17:48:45.683 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc7aa7fc640 / ms_dispatch 2024-09-12T17:48:45.683 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc7abfff640 / io_context_pool 2024-09-12T17:48:45.683 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc7ba7fc640 / ms_dispatch 2024-09-12T17:48:45.683 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc7c1602640 / ms_dispatch 2024-09-12T17:48:45.683 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc7c2e05640 / io_context_pool 2024-09-12T17:48:45.684 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc8cffff640 / msgr-worker-2 2024-09-12T17:48:45.684 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc8d4b61640 / msgr-worker-1 2024-09-12T17:48:45.684 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc8d5362640 / msgr-worker-0 2024-09-12T17:48:45.684 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc8d5b63640 / io_context_pool 2024-09-12T17:48:45.684 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc8d8f2c800 / radosgw-admin 2024-09-12T17:48:45.684 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:48:45.684 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:48:45.684 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/log/ceph/ceph-client.admin.98884.log 2024-09-12T17:48:45.684 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:48:45.684 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:48:45.684 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:45.684 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: dump: 2024-09-12T17:48:45.685 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.685 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.685 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.685 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.685 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.685 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.685 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.685 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.685 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.685 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.685 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: _finish_auth 0 2024-09-12T17:48:45.685 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: _check_auth_tickets 2024-09-12T17:48:45.686 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:45.686 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:48:45.340+0000 7fc8d8f2c800 5 monclient: authenticate success, global_id 6570 2024-09-12T17:48:45.686 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:48:45.340+0000 7fc8d8f2c800 10 monclient: get_monmap_and_config success 2024-09-12T17:48:45.686 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:48:45.340+0000 7fc8d8f2c800 4 set_mon_vals no callback set 2024-09-12T17:48:45.686 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.686 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:45.686 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:48:45.340+0000 7fc7c2e05640 10 monclient: dump: 2024-09-12T17:48:45.686 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.686 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.686 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.686 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:48:45.340+0000 7fc8d8f2c800 10 monclient: shutdown 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:48:45.340+0000 7fc8d8f2c800 5 asok(0x55990317b730) unregister_commands rotate-key 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 10 monclient: build_initial_monmap 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 10 monclient: monmap: 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:45.687 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:45.688 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:45.688 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.688 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding auth protocol: cephx 2024-09-12T17:48:45.688 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding auth protocol: cephx 2024-09-12T17:48:45.688 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding auth protocol: cephx 2024-09-12T17:48:45.689 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: secure 2024-09-12T17:48:45.689 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: crc 2024-09-12T17:48:45.689 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: secure 2024-09-12T17:48:45.689 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: crc 2024-09-12T17:48:45.689 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: secure 2024-09-12T17:48:45.689 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: crc 2024-09-12T17:48:45.689 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: crc 2024-09-12T17:48:45.689 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: secure 2024-09-12T17:48:45.689 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: crc 2024-09-12T17:48:45.689 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: secure 2024-09-12T17:48:45.689 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: crc 2024-09-12T17:48:45.689 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033a2230) adding con mode: secure 2024-09-12T17:48:45.690 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.690 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 1 librados: starting msgr at 2024-09-12T17:48:45.690 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 1 librados: starting objecter 2024-09-12T17:48:45.690 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command objecter_requests hook 0x5599033a44c0 2024-09-12T17:48:45.690 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 1 librados: setting wanted keys 2024-09-12T17:48:45.690 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 1 librados: calling monclient init 2024-09-12T17:48:45.690 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 10 monclient: init 2024-09-12T17:48:45.690 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding auth protocol: cephx 2024-09-12T17:48:45.690 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding auth protocol: cephx 2024-09-12T17:48:45.690 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding auth protocol: cephx 2024-09-12T17:48:45.690 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: secure 2024-09-12T17:48:45.691 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: crc 2024-09-12T17:48:45.691 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: secure 2024-09-12T17:48:45.691 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: crc 2024-09-12T17:48:45.691 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: secure 2024-09-12T17:48:45.691 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: crc 2024-09-12T17:48:45.691 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: crc 2024-09-12T17:48:45.691 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: secure 2024-09-12T17:48:45.691 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: crc 2024-09-12T17:48:45.691 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: secure 2024-09-12T17:48:45.691 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: crc 2024-09-12T17:48:45.691 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 5 AuthRegistry(0x55990339cb30) adding con mode: secure 2024-09-12T17:48:45.691 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:48:45.341+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.692 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.692 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command rotate-key hook 0x55990339cc78 2024-09-12T17:48:45.692 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:45.692 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:48:45.692 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-b con 0x559903254a90 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:45.692 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-a con 0x5599032dfbd0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:45.692 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-c con 0x5599032dfff0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:45.692 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.692 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.692 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.692 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:45.693 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient(hunting): authenticate will time out at 1929.888147s 2024-09-12T17:48:45.693 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): get_auth_request con 0x5599032dfbd0 auth_method 0 2024-09-12T17:48:45.693 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.693 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.693 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.693 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): get_auth_request con 0x5599032dfff0 auth_method 0 2024-09-12T17:48:45.693 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.693 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.693 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.693 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.693 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.694 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.694 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.694 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.694 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:48:45.342+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.694 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request con 0x559903254a90 auth_method 0 2024-09-12T17:48:45.694 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.694 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.694 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.694 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.694 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.694 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:48:45.342+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.695 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient(hunting): handle_auth_done global_id 6573 payload 824 2024-09-12T17:48:45.695 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient: _finish_hunting 0 2024-09-12T17:48:45.695 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:48:45.342+0000 7fc8cffff640 1 monclient: found mon.noname-a 2024-09-12T17:48:45.695 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:48:45.342+0000 7fc8cffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.695 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.695 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:45.695 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: dump: 2024-09-12T17:48:45.695 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.695 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.695 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.695 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.695 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.696 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.696 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.696 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.696 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.696 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.696 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: _finish_auth 0 2024-09-12T17:48:45.696 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: _check_auth_tickets 2024-09-12T17:48:45.696 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:45.696 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.696 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:45.696 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:48:45.342+0000 7fc7c1602640 10 monclient: dump: 2024-09-12T17:48:45.696 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.697 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.697 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.697 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.697 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.697 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.697 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.697 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.697 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.697 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.697 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 5 monclient: authenticate success, global_id 6573 2024-09-12T17:48:45.697 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient: _renew_subs 2024-09-12T17:48:45.697 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.698 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:48:45.342+0000 7fc7c2e05640 4 set_mon_vals no callback set 2024-09-12T17:48:45.698 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient: _renew_subs 2024-09-12T17:48:45.698 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.698 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:48:45.342+0000 7fc8d8f2c800 1 librados: init done 2024-09-12T17:48:45.698 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:48:45.344+0000 7fc7c1602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:45.698 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:48:45.344+0000 7fc7c1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:45.698 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:48:45.344+0000 7fc7c1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:45.698 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:48:45.344+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x7fc7bc076470 auth_method 0 2024-09-12T17:48:45.698 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:48:45.344+0000 7fc8d5362640 10 monclient: get_auth_request con 0x5599033c4fc0 auth_method 0 2024-09-12T17:48:45.698 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:48:45.345+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x5599033e9550 auth_method 0 2024-09-12T17:48:45.698 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:48:45.346+0000 7fc8cffff640 10 monclient: get_auth_request con 0x5599033ed740 auth_method 0 2024-09-12T17:48:45.699 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 10 monclient: build_initial_monmap 2024-09-12T17:48:45.699 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:48:45.699 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 10 monclient: monmap: 2024-09-12T17:48:45.699 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:45.699 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:45.699 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:45.699 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:45.699 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:45.699 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.699 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:45.699 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:45.699 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:45.700 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.700 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding auth protocol: cephx 2024-09-12T17:48:45.700 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding auth protocol: cephx 2024-09-12T17:48:45.700 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding auth protocol: cephx 2024-09-12T17:48:45.700 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: secure 2024-09-12T17:48:45.700 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: crc 2024-09-12T17:48:45.700 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: secure 2024-09-12T17:48:45.700 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: crc 2024-09-12T17:48:45.700 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: secure 2024-09-12T17:48:45.700 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: crc 2024-09-12T17:48:45.700 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: crc 2024-09-12T17:48:45.701 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: secure 2024-09-12T17:48:45.701 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: crc 2024-09-12T17:48:45.701 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: secure 2024-09-12T17:48:45.701 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: crc 2024-09-12T17:48:45.701 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f21f0) adding con mode: secure 2024-09-12T17:48:45.701 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:48:45.347+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.701 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command objecter_requests cmddesc objecter_requests hook 0x5599033f5be0 EEXIST 2024-09-12T17:48:45.701 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient: init 2024-09-12T17:48:45.701 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding auth protocol: cephx 2024-09-12T17:48:45.701 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding auth protocol: cephx 2024-09-12T17:48:45.701 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding auth protocol: cephx 2024-09-12T17:48:45.701 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: secure 2024-09-12T17:48:45.702 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: crc 2024-09-12T17:48:45.702 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: secure 2024-09-12T17:48:45.702 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: crc 2024-09-12T17:48:45.702 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: secure 2024-09-12T17:48:45.702 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: crc 2024-09-12T17:48:45.702 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: crc 2024-09-12T17:48:45.702 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: secure 2024-09-12T17:48:45.702 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: crc 2024-09-12T17:48:45.702 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: secure 2024-09-12T17:48:45.702 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: crc 2024-09-12T17:48:45.702 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 AuthRegistry(0x5599033f0968) adding con mode: secure 2024-09-12T17:48:45.703 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.703 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.703 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command rotate-key cmddesc rotate-key hook 0x5599033f0ab0 EEXIST 2024-09-12T17:48:45.703 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:45.703 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:48:45.703 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-a con 0x5599034198d0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:45.703 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-b con 0x55990341bba0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:45.703 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-c con 0x5599034180a0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:45.703 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.703 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.703 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.704 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:45.704 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:48:45.348+0000 7fc8d8f2c800 10 monclient(hunting): authenticate will time out at 1929.894722s 2024-09-12T17:48:45.704 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request con 0x5599034198d0 auth_method 0 2024-09-12T17:48:45.704 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.704 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.704 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.704 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): get_auth_request con 0x5599034180a0 auth_method 0 2024-09-12T17:48:45.704 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.704 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.704 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.704 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.704 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.705 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:48:45.348+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.705 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:48:45.348+0000 7fc8cffff640 10 monclient(hunting): get_auth_request con 0x55990341bba0 auth_method 0 2024-09-12T17:48:45.705 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:48:45.348+0000 7fc8cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.705 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:48:45.348+0000 7fc8cffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.705 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:48:45.348+0000 7fc8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.705 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.705 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.705 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:48:45.348+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.705 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:48:45.348+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.705 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:48:45.348+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.705 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:48:45.349+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.705 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:48:45.349+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_done global_id 6576 payload 824 2024-09-12T17:48:45.706 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:48:45.349+0000 7fc8d4b61640 10 monclient: _finish_hunting 0 2024-09-12T17:48:45.706 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:48:45.349+0000 7fc8d4b61640 1 monclient: found mon.noname-a 2024-09-12T17:48:45.706 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:48:45.349+0000 7fc8d4b61640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.706 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.706 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:45.706 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: dump: 2024-09-12T17:48:45.706 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.706 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.706 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.706 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.706 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.706 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.707 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.707 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.707 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.707 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.707 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: _finish_auth 0 2024-09-12T17:48:45.707 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:48:45.707 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:48:45.349+0000 7fc8d8f2c800 5 monclient: authenticate success, global_id 6576 2024-09-12T17:48:45.707 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:45.707 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.707 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:45.707 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:48:45.349+0000 7fc7ba7fc640 10 monclient: dump: 2024-09-12T17:48:45.707 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.708 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.708 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.708 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.708 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.708 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.708 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.708 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.708 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.708 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.708 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:48:45.349+0000 7fc8d8f2c800 10 monclient: _renew_subs 2024-09-12T17:48:45.708 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:48:45.349+0000 7fc8d5b63640 4 set_mon_vals no callback set 2024-09-12T17:48:45.709 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:48:45.349+0000 7fc8d8f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.709 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:48:45.349+0000 7fc8d8f2c800 10 monclient: _renew_subs 2024-09-12T17:48:45.709 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:48:45.349+0000 7fc8d8f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.709 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:48:45.351+0000 7fc7ba7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:45.709 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:48:45.351+0000 7fc7ba7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:45.709 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:48:45.351+0000 7fc7ba7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:45.709 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 10 monclient: get_monmap_and_config 2024-09-12T17:48:45.709 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 10 monclient: build_initial_monmap 2024-09-12T17:48:45.709 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:48:45.709 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 10 monclient: monmap: 2024-09-12T17:48:45.709 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:45.709 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:45.710 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:45.710 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:45.710 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:45.710 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.710 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:45.710 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:45.710 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:45.710 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.710 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:48:45.351+0000 7fc8cffff640 10 monclient: get_auth_request con 0x7fc7ac076380 auth_method 0 2024-09-12T17:48:45.710 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding auth protocol: cephx 2024-09-12T17:48:45.710 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding auth protocol: cephx 2024-09-12T17:48:45.711 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding auth protocol: cephx 2024-09-12T17:48:45.711 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: secure 2024-09-12T17:48:45.711 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: crc 2024-09-12T17:48:45.711 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: secure 2024-09-12T17:48:45.711 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: crc 2024-09-12T17:48:45.711 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: secure 2024-09-12T17:48:45.711 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: crc 2024-09-12T17:48:45.711 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: crc 2024-09-12T17:48:45.711 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: secure 2024-09-12T17:48:45.711 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: crc 2024-09-12T17:48:45.711 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: secure 2024-09-12T17:48:45.711 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: crc 2024-09-12T17:48:45.712 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x559903439770) adding con mode: secure 2024-09-12T17:48:45.712 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.712 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 10 monclient: init 2024-09-12T17:48:45.712 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding auth protocol: cephx 2024-09-12T17:48:45.712 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding auth protocol: cephx 2024-09-12T17:48:45.712 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding auth protocol: cephx 2024-09-12T17:48:45.712 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: secure 2024-09-12T17:48:45.712 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: crc 2024-09-12T17:48:45.712 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: secure 2024-09-12T17:48:45.712 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: crc 2024-09-12T17:48:45.712 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: secure 2024-09-12T17:48:45.713 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: crc 2024-09-12T17:48:45.713 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: crc 2024-09-12T17:48:45.713 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: secure 2024-09-12T17:48:45.713 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: crc 2024-09-12T17:48:45.713 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: secure 2024-09-12T17:48:45.713 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: crc 2024-09-12T17:48:45.713 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:48:45.351+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb6fe70) adding con mode: secure 2024-09-12T17:48:45.713 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.713 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.713 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command rotate-key cmddesc rotate-key hook 0x7ffd6fb6ffb8 EEXIST 2024-09-12T17:48:45.713 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:45.713 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:48:45.714 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-c con 0x55990346dd50 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:45.714 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-b con 0x5599034682f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:45.714 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-a con 0x55990343db90 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:45.714 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.714 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.714 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.714 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:45.714 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:48:45.352+0000 7fc8d8f2c800 10 monclient(hunting): authenticate will time out at 1929.898498s 2024-09-12T17:48:45.714 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request con 0x55990346dd50 auth_method 0 2024-09-12T17:48:45.714 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.714 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.714 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.715 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): get_auth_request con 0x55990343db90 auth_method 0 2024-09-12T17:48:45.715 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.715 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.715 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.715 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.715 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.715 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.715 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.715 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.715 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:48:45.352+0000 7fc8d5362640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.715 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): get_auth_request con 0x5599034682f0 auth_method 0 2024-09-12T17:48:45.715 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.716 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.716 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.716 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.716 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.716 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:48:45.352+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.716 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_done global_id 6227 payload 274 2024-09-12T17:48:45.716 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient: _finish_hunting 0 2024-09-12T17:48:45.716 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 1 monclient: found mon.noname-c 2024-09-12T17:48:45.716 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:48:45.352+0000 7fc8d4b61640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:48:45.716 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.716 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:48:45.716 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: dump: 2024-09-12T17:48:45.717 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.717 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.717 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.717 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.717 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.717 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.717 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.717 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.717 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.717 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.717 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: _finish_auth 0 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: _check_auth_tickets 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:48:45.353+0000 7fc7abfff640 10 monclient: dump: 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.718 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.719 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.719 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.719 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 monclient: authenticate success, global_id 6227 2024-09-12T17:48:45.719 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 10 monclient: get_monmap_and_config success 2024-09-12T17:48:45.719 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 4 set_mon_vals no callback set 2024-09-12T17:48:45.719 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 10 monclient: shutdown 2024-09-12T17:48:45.719 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 10 monclient: build_initial_monmap 2024-09-12T17:48:45.719 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 1 build_initial for_mkfs: 0 2024-09-12T17:48:45.719 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 10 monclient: monmap: 2024-09-12T17:48:45.719 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:48:45.719 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:48:45.719 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:48:45.720 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:48:45.720 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:48:45.720 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.720 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:48:45.720 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:48:45.720 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:48:45.720 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.720 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding auth protocol: cephx 2024-09-12T17:48:45.720 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding auth protocol: cephx 2024-09-12T17:48:45.720 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding auth protocol: cephx 2024-09-12T17:48:45.720 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: secure 2024-09-12T17:48:45.720 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: crc 2024-09-12T17:48:45.721 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: secure 2024-09-12T17:48:45.721 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: crc 2024-09-12T17:48:45.721 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: secure 2024-09-12T17:48:45.721 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: crc 2024-09-12T17:48:45.721 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: crc 2024-09-12T17:48:45.721 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: secure 2024-09-12T17:48:45.721 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: crc 2024-09-12T17:48:45.721 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: secure 2024-09-12T17:48:45.721 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: crc 2024-09-12T17:48:45.721 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:48:45.353+0000 7fc8d8f2c800 5 AuthRegistry(0x5599034692b0) adding con mode: secure 2024-09-12T17:48:45.721 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.721 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 1 librados: starting msgr at 2024-09-12T17:48:45.722 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 1 librados: starting objecter 2024-09-12T17:48:45.722 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command objecter_requests cmddesc objecter_requests hook 0x55990345f7f0 EEXIST 2024-09-12T17:48:45.722 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 1 librados: setting wanted keys 2024-09-12T17:48:45.722 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 1 librados: calling monclient init 2024-09-12T17:48:45.722 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient: init 2024-09-12T17:48:45.722 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding auth protocol: cephx 2024-09-12T17:48:45.722 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding auth protocol: cephx 2024-09-12T17:48:45.722 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding auth protocol: cephx 2024-09-12T17:48:45.722 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: secure 2024-09-12T17:48:45.722 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: crc 2024-09-12T17:48:45.722 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: secure 2024-09-12T17:48:45.722 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: crc 2024-09-12T17:48:45.723 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: secure 2024-09-12T17:48:45.723 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: crc 2024-09-12T17:48:45.723 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: crc 2024-09-12T17:48:45.723 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: secure 2024-09-12T17:48:45.723 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: crc 2024-09-12T17:48:45.723 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: secure 2024-09-12T17:48:45.723 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: crc 2024-09-12T17:48:45.723 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 AuthRegistry(0x559903431680) adding con mode: secure 2024-09-12T17:48:45.723 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.723 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.723 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command rotate-key cmddesc rotate-key hook 0x5599034317c8 EEXIST 2024-09-12T17:48:45.723 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient: _reopen_session rank -1 2024-09-12T17:48:45.724 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:48:45.724 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-c con 0x55990343db90 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:48:45.724 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-a con 0x5599034682f0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:48:45.724 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): picked mon.noname-b con 0x55990346dd50 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:48:45.724 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.724 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.724 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:48:45.724 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): _renew_subs 2024-09-12T17:48:45.724 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:48:45.354+0000 7fc8d8f2c800 10 monclient(hunting): authenticate will time out at 1929.900754s 2024-09-12T17:48:45.725 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request con 0x55990343db90 auth_method 0 2024-09-12T17:48:45.725 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.725 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.725 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.725 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): get_auth_request con 0x5599034682f0 auth_method 0 2024-09-12T17:48:45.725 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.725 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.725 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.725 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.726 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.726 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:48:45.354+0000 7fc8d4b61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.726 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:48:45.726 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:48:45.726 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:48:45.354+0000 7fc8cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:48:45.726 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:48:45.354+0000 7fc8d5362640 10 monclient(hunting): get_auth_request con 0x55990346dd50 auth_method 0 2024-09-12T17:48:45.726 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:48:45.354+0000 7fc8d5362640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:48:45.726 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:48:45.354+0000 7fc8d5362640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:48:45.726 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:48:45.354+0000 7fc8d5362640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:48:45.726 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:48:45.355+0000 7fc8cffff640 10 monclient(hunting): handle_auth_done global_id 6582 payload 824 2024-09-12T17:48:45.726 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:48:45.355+0000 7fc8cffff640 10 monclient: _finish_hunting 0 2024-09-12T17:48:45.726 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:48:45.355+0000 7fc8cffff640 1 monclient: found mon.noname-a 2024-09-12T17:48:45.727 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:48:45.355+0000 7fc8cffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.727 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.727 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:48:45.727 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: dump: 2024-09-12T17:48:45.727 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.727 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.727 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.727 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.727 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.727 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.727 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.728 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.728 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.728 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.728 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: _finish_auth 0 2024-09-12T17:48:45.728 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:48:45.728 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 5 monclient: authenticate success, global_id 6582 2024-09-12T17:48:45.728 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 10 monclient: _renew_subs 2024-09-12T17:48:45.728 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.728 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:48:45.728 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:48:45.728 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:48:45.728 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:48:45.355+0000 7fc7aa7fc640 10 monclient: dump: 2024-09-12T17:48:45.729 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:48:45.729 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:48:45.729 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.729 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:48:45.729 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:48:45.729 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:48:45.729 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:48:45.729 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:48:45.729 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:48:45.729 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.729 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:48:45.355+0000 7fc7abfff640 4 set_mon_vals no callback set 2024-09-12T17:48:45.730 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 10 monclient: _renew_subs 2024-09-12T17:48:45.730 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.730 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 1 librados: init done 2024-09-12T17:48:45.730 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:48:45.355+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command cr dump hook 0x55990343b728 2024-09-12T17:48:45.730 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:48:45.356+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.730 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:48:45.357+0000 7fc7aa7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:48:45.730 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:48:45.357+0000 7fc7aa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:45.730 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:48:45.357+0000 7fc7aa7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:48:45.730 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:48:45.357+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x7fc7a00764a0 auth_method 0 2024-09-12T17:48:45.730 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:48:45.357+0000 7fc8d5362640 10 monclient: get_auth_request con 0x559903487da0 auth_method 0 2024-09-12T17:48:45.730 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.730 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 realm 2024-09-12T17:48:45.731 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.731 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.731 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:45.731 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.731 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.731 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:48:45.358+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.731 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:48:45.358+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x55990348c160 auth_method 0 2024-09-12T17:48:45.731 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:48:45.359+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:45.731 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:48:45.359+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.731 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:48:45.359+0000 7fc8cffff640 10 monclient: get_auth_request con 0x55990348f880 auth_method 0 2024-09-12T17:48:45.731 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:48:45.360+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:45.731 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:48:45.360+0000 7fc8d8f2c800 20 searching for the correct realm 2024-09-12T17:48:45.732 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:48:45.360+0000 7fc8d5362640 10 monclient: get_auth_request con 0x559903494600 auth_method 0 2024-09-12T17:48:45.732 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:48:45.361+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x7fc8d004dc20 auth_method 0 2024-09-12T17:48:45.732 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:48:45.361+0000 7fc8cffff640 10 monclient: get_auth_request con 0x7fc8c00a6040 auth_method 0 2024-09-12T17:48:45.732 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:48:45.362+0000 7fc8cffff640 0 -- 172.21.15.107:0/189702249 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fc8c00a6040 msgr2=0x7fc8c005f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:45.732 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:48:45.362+0000 7fc7aa7fc640 1 client.6582.objecter ms_handle_reset 0x7fc8c00a6040 session 0x7fc8c000a0f0 osd.4 2024-09-12T17:48:45.732 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:48:45.362+0000 7fc7aa7fc640 10 monclient: _renew_subs 2024-09-12T17:48:45.732 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:48:45.362+0000 7fc7aa7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:48:45.732 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:48:45.362+0000 7fc8cffff640 10 monclient: get_auth_request con 0x7fc7a0086b50 auth_method 0 2024-09-12T17:48:45.732 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:48:45.364+0000 7fc8d5362640 10 monclient: get_auth_request con 0x7fc8c0080040 auth_method 0 2024-09-12T17:48:45.732 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:48:45.366+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x7fc8c00a6420 auth_method 0 2024-09-12T17:48:45.732 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:48:45.366+0000 7fc8d4b61640 0 -- 172.21.15.107:0/189702249 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc8c00a6420 msgr2=0x7fc8c0061950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:45.732 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:48:45.568+0000 7fc8d4b61640 10 monclient: get_auth_request con 0x7fc8c00a6420 auth_method 0 2024-09-12T17:48:45.733 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:45.733 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:45.733 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:45.733 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:45.733 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:45.733 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:45.733 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.733 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.733 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.733 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:45.733 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.734 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:45.734 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 zone default found 2024-09-12T17:48:45.734 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 4 Realm: () 2024-09-12T17:48:45.734 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:45.734 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:45.734 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:45.734 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 zonegroup default 2024-09-12T17:48:45.734 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:48:45.573+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.734 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.734 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.734 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.734 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.735 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.735 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 started sync module instance, tier type = 2024-09-12T17:48:45.735 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:48:45.574+0000 7fc8d8f2c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:45.735 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:48:45.582+0000 7fc8d8f2c800 20 add_watcher() i=0 2024-09-12T17:48:45.735 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:48:45.582+0000 7fc8d8f2c800 20 add_watcher() i=1 2024-09-12T17:48:45.735 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:48:45.582+0000 7fc8d8f2c800 20 add_watcher() i=2 2024-09-12T17:48:45.735 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:48:45.582+0000 7fc8d8f2c800 20 add_watcher() i=3 2024-09-12T17:48:45.735 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:48:45.583+0000 7fc8d8f2c800 20 add_watcher() i=4 2024-09-12T17:48:45.735 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:48:45.583+0000 7fc8d8f2c800 20 add_watcher() i=5 2024-09-12T17:48:45.735 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:48:45.583+0000 7fc8d8f2c800 20 add_watcher() i=6 2024-09-12T17:48:45.735 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:48:45.583+0000 7fc8d8f2c800 20 add_watcher() i=7 2024-09-12T17:48:45.735 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:48:45.583+0000 7fc8d8f2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:45.736 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding auth protocol: cephx 2024-09-12T17:48:45.736 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding auth protocol: cephx 2024-09-12T17:48:45.736 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding auth protocol: cephx 2024-09-12T17:48:45.736 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: secure 2024-09-12T17:48:45.736 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: crc 2024-09-12T17:48:45.736 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: secure 2024-09-12T17:48:45.736 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: crc 2024-09-12T17:48:45.736 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: secure 2024-09-12T17:48:45.736 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: crc 2024-09-12T17:48:45.736 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: crc 2024-09-12T17:48:45.736 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: secure 2024-09-12T17:48:45.736 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: crc 2024-09-12T17:48:45.737 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: secure 2024-09-12T17:48:45.737 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: crc 2024-09-12T17:48:45.737 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 AuthRegistry(0x7ffd6fb70340) adding con mode: secure 2024-09-12T17:48:45.737 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:48:45.585+0000 7fc78afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:45.737 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:48:45.737 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:45.737 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:45.737 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command cache list hook 0x55990343b230 2024-09-12T17:48:45.737 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command cache inspect hook 0x55990343b230 2024-09-12T17:48:45.737 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command cache erase hook 0x55990343b230 2024-09-12T17:48:45.737 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command cache zap hook 0x55990343b230 2024-09-12T17:48:45.737 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:48:45.585+0000 7fc8d8f2c800 5 note: GC not initialized 2024-09-12T17:48:45.738 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:48:45.585+0000 7fc789fe3640 20 reqs_thread_entry: start 2024-09-12T17:48:45.738 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command sync trace show hook 0x7fc8c0001350 2024-09-12T17:48:45.738 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command sync trace history hook 0x7fc8c0001350 2024-09-12T17:48:45.738 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command sync trace active hook 0x7fc8c0001350 2024-09-12T17:48:45.738 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 5 asok(0x55990317b730) register_command sync trace active_short hook 0x7fc8c0001350 2024-09-12T17:48:45.738 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:45.738 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 Filter name: none 2024-09-12T17:48:45.738 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:48:45.586+0000 7fc6fb7fe640 20 reqs_thread_entry: start 2024-09-12T17:48:45.738 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:48:45.738 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.738 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:45.738 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:48:45.739 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:48:45.739 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 : miss 2024-09-12T17:48:45.739 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:48:45.586+0000 7fc8d8f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.739 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:48:45.587+0000 7fc8d8f2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:45.739 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 info.flags=0x17 2024-09-12T17:48:45.739 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 to cache LRU end 2024-09-12T17:48:45.739 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:45.739 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:45.739 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:48:45.587+0000 7fc8d8f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 2024-09-12T17:48:45.739 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:48:45.590+0000 7fc8d8f2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc8d8f2c800 time 2024-09-12T17:48:45.590468+0000 2024-09-12T17:48:45.739 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:48:45.740 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.740 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:45.740 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc8da58c71a] 2024-09-12T17:48:45.740 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc8da58c8d8] 2024-09-12T17:48:45.740 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559901a04841] 2024-09-12T17:48:45.740 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd73ca8) [0x559901f11ca8] 2024-09-12T17:48:45.740 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559901a1450d] 2024-09-12T17:48:45.740 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:48:45.740 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc8d9229590] 2024-09-12T17:48:45.740 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:48:45.740 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:48:45.741 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.741 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:48:45.591+0000 7fc8d8f2c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:48:45.741 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7fc8d8f2c800 thread_name:radosgw-admin 2024-09-12T17:48:45.741 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.741 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:48:45.741 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc8d923e6f0] 2024-09-12T17:48:45.741 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc8d928b99c] 2024-09-12T17:48:45.741 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:48:45.741 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:48:45.741 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc8da58c774] 2024-09-12T17:48:45.741 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc8da58c8d8] 2024-09-12T17:48:45.741 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559901a04841] 2024-09-12T17:48:45.742 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd73ca8) [0x559901f11ca8] 2024-09-12T17:48:45.742 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559901a1450d] 2024-09-12T17:48:45.742 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:48:45.742 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc8d9229590] 2024-09-12T17:48:45.742 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:48:45.742 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:48:45.742 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:48:45.742 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.742 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:48:45.742 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:48:45.742 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:48:45.742 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:48:45.743 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:48:45.743 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:48:45.743 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:48:45.743 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:48:45.743 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:48:45.743 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:48:45.743 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:48:45.743 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:48:45.743 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:48:45.743 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:48:45.743 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:48:45.743 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:48:45.744 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:48:45.745 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:48:45.745 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:48:45.745 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:48:45.745 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:48:45.745 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:48:45.745 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:48:45.745 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:48:45.745 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:48:45.745 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:48:45.745 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:48:45.745 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:48:45.745 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:48:45.746 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:48:45.746 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:48:45.746 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:48:45.746 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:48:45.746 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:48:45.746 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:48:45.746 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:48:45.746 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:48:45.746 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:48:45.746 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:48:45.746 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:48:45.746 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:48:45.747 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:48:45.748 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:48:45.748 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:48:45.748 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:48:45.748 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:48:45.748 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:48:45.748 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:48:45.748 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:48:45.748 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:48:45.748 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:48:45.748 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:48:45.748 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:48:45.748 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:48:45.749 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:48:45.750 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:48:45.750 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:48:45.750 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:48:45.750 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc6fb7fe640 / http_manager 2024-09-12T17:48:45.750 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc789fe3640 / http_manager 2024-09-12T17:48:45.750 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc78afe5640 / rgw_dt_lg_renew 2024-09-12T17:48:45.750 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc7aa7fc640 / ms_dispatch 2024-09-12T17:48:45.750 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc7abfff640 / io_context_pool 2024-09-12T17:48:45.750 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc7ba7fc640 / ms_dispatch 2024-09-12T17:48:45.750 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc7c1602640 / ms_dispatch 2024-09-12T17:48:45.750 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc7c2e05640 / io_context_pool 2024-09-12T17:48:45.750 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc8cffff640 / msgr-worker-2 2024-09-12T17:48:45.751 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc8d4b61640 / msgr-worker-1 2024-09-12T17:48:45.751 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc8d5362640 / msgr-worker-0 2024-09-12T17:48:45.751 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc8d5b63640 / io_context_pool 2024-09-12T17:48:45.751 INFO:tasks.workunit.client.0.smithi107.stderr: 7fc8d8f2c800 / radosgw-admin 2024-09-12T17:48:45.751 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:48:45.751 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:48:45.751 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:48:45.592099Z_a5ea6c99-c536-44e1-8c54-19d40fce43e3/log 2024-09-12T17:48:45.751 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:48:45.751 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:48:45.753 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:45.753 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:45.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.665+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.666+0000 7f836f50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.666+0000 7f836f50c800 20 realm 2024-09-12T17:48:45.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.666+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.667+0000 7f836f50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.667+0000 7f836f50c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:45.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.667+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.667+0000 7f836f50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.667+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.668+0000 7f836f50c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:45.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.668+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.668+0000 7f836f50c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:45.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.668+0000 7f836f50c800 20 searching for the correct realm 2024-09-12T17:48:45.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.672+0000 7f836d7f7640 0 -- 172.21.15.107:0/3357511982 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7f8358027040 msgr2=0x7f83580830c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:45.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.878+0000 7f836cff6640 0 -- 172.21.15.107:0/3357511982 >> [v2:172.21.15.148:6800/18671776,v1:172.21.15.148:6801/18671776] conn(0x557c1febf520 msgr2=0x557c1fec19e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:45.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.880+0000 7f836f50c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:45.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.880+0000 7f836f50c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:45.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.880+0000 7f836f50c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:45.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.880+0000 7f836f50c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:45.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.880+0000 7f836f50c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:45.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.880+0000 7f836f50c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:45.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.880+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.881+0000 7f836f50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.881+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.881+0000 7f836f50c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.881+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.881+0000 7f836f50c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.881+0000 7f836f50c800 20 zone default found 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.881+0000 7f836f50c800 4 Realm: () 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.881+0000 7f836f50c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.881+0000 7f836f50c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.881+0000 7f836f50c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.881+0000 7f836f50c800 20 zonegroup default 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.881+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.882+0000 7f836f50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.882+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.882+0000 7f836f50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.882+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.882+0000 7f836f50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:45.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.882+0000 7f836f50c800 20 started sync module instance, tier type = 2024-09-12T17:48:45.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.882+0000 7f836f50c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:45.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.898+0000 7f836f50c800 20 add_watcher() i=0 2024-09-12T17:48:45.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.898+0000 7f836f50c800 20 add_watcher() i=1 2024-09-12T17:48:45.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.898+0000 7f836f50c800 20 add_watcher() i=2 2024-09-12T17:48:45.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.898+0000 7f836f50c800 20 add_watcher() i=3 2024-09-12T17:48:45.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.898+0000 7f836f50c800 20 add_watcher() i=4 2024-09-12T17:48:45.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.898+0000 7f836f50c800 20 add_watcher() i=5 2024-09-12T17:48:45.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.898+0000 7f836f50c800 20 add_watcher() i=6 2024-09-12T17:48:45.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.899+0000 7f836f50c800 20 add_watcher() i=7 2024-09-12T17:48:45.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.899+0000 7f836f50c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.901+0000 7f82237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.901+0000 7f836f50c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.901+0000 7f836f50c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.901+0000 7f836f50c800 5 note: GC not initialized 2024-09-12T17:48:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.902+0000 7f82227e4640 20 reqs_thread_entry: start 2024-09-12T17:48:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.902+0000 7f836f50c800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.902+0000 7f836f50c800 20 Filter name: none 2024-09-12T17:48:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.902+0000 7f821bfff640 20 reqs_thread_entry: start 2024-09-12T17:48:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.902+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.902+0000 7f836f50c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.902+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.903+0000 7f836f50c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.903+0000 7f836f50c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.903+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.903+0000 7f836f50c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.903+0000 7f836f50c800 20 rados->read ofs=0 len=0 2024-09-12T17:48:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.904+0000 7f836f50c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.904+0000 7f836f50c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:48:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.905+0000 7f82237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.907+0000 7f836f50c800 20 remove_watcher() i=0 2024-09-12T17:48:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.907+0000 7f836f50c800 2 removed watcher, disabling cache 2024-09-12T17:48:45.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.908+0000 7f836f50c800 20 remove_watcher() i=1 2024-09-12T17:48:45.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.909+0000 7f836f50c800 20 remove_watcher() i=2 2024-09-12T17:48:45.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.909+0000 7f836f50c800 20 remove_watcher() i=3 2024-09-12T17:48:45.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.910+0000 7f836f50c800 20 remove_watcher() i=4 2024-09-12T17:48:45.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.911+0000 7f836f50c800 20 remove_watcher() i=5 2024-09-12T17:48:45.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.912+0000 7f836f50c800 20 remove_watcher() i=6 2024-09-12T17:48:45.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:45.913+0000 7f836f50c800 20 remove_watcher() i=7 2024-09-12T17:48:45.925 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.925 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:48:45.925 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-set-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:48:45.925 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:48:45.976 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:48:46.009 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:48:46.009 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:48:46.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.044+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.046+0000 7f3eba72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:46.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.046+0000 7f3eba72e800 20 realm 2024-09-12T17:48:46.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.046+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.046+0000 7f3eba72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:46.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.046+0000 7f3eba72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:48:46.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.046+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.046+0000 7f3eba72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:46.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.046+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.047+0000 7f3eba72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:46.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.047+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.047+0000 7f3eba72e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:48:46.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.047+0000 7f3eba72e800 20 searching for the correct realm 2024-09-12T17:48:46.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.050+0000 7f3eaffff640 0 -- 172.21.15.107:0/1003488768 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f3ea0090020 msgr2=0x7f3ea0085420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:48:46.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.053+0000 7f3eb64b0640 0 -- 172.21.15.107:0/1003488768 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f3ea0090400 msgr2=0x7f3ea0090880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:48:46.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.258+0000 7f3eba72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:48:46.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.258+0000 7f3eba72e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:48:46.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.258+0000 7f3eba72e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:48:46.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.258+0000 7f3eba72e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:48:46.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.258+0000 7f3eba72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:48:46.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.258+0000 7f3eba72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:48:46.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:46.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:48:46.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:48:46.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 20 zone default found 2024-09-12T17:48:46.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 4 Realm: () 2024-09-12T17:48:46.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:48:46.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:48:46.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:48:46.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 20 zonegroup default 2024-09-12T17:48:46.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.259+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.260+0000 7f3eba72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:46.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.260+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.260+0000 7f3eba72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:46.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.260+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.260+0000 7f3eba72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:48:46.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.260+0000 7f3eba72e800 20 started sync module instance, tier type = 2024-09-12T17:48:46.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.260+0000 7f3eba72e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:48:46.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.269+0000 7f3eba72e800 20 add_watcher() i=0 2024-09-12T17:48:46.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.269+0000 7f3eba72e800 20 add_watcher() i=1 2024-09-12T17:48:46.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.269+0000 7f3eba72e800 20 add_watcher() i=2 2024-09-12T17:48:46.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.269+0000 7f3eba72e800 20 add_watcher() i=3 2024-09-12T17:48:46.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.269+0000 7f3eba72e800 20 add_watcher() i=4 2024-09-12T17:48:46.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.269+0000 7f3eba72e800 20 add_watcher() i=5 2024-09-12T17:48:46.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.269+0000 7f3eba72e800 20 add_watcher() i=6 2024-09-12T17:48:46.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.270+0000 7f3eba72e800 20 add_watcher() i=7 2024-09-12T17:48:46.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.270+0000 7f3eba72e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:48:46.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.272+0000 7f3d6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:46.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.272+0000 7f3eba72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:48:46.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.272+0000 7f3eba72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:48:46.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.272+0000 7f3eba72e800 5 note: GC not initialized 2024-09-12T17:48:46.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.272+0000 7f3ce77fe640 20 reqs_thread_entry: start 2024-09-12T17:48:46.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.273+0000 7f3eba72e800 20 init_complete bucket index max shards: 1 2024-09-12T17:48:46.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.273+0000 7f3eba72e800 20 Filter name: none 2024-09-12T17:48:46.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.273+0000 7f3ce57fa640 20 reqs_thread_entry: start 2024-09-12T17:48:46.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.273+0000 7f3eba72e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:48:46.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.273+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.273+0000 7f3eba72e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:48:46.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.273+0000 7f3eba72e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:48:46.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.273+0000 7f3eba72e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:48:46.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.273+0000 7f3eba72e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 : miss 2024-09-12T17:48:46.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.273+0000 7f3eba72e800 20 rados->read ofs=0 len=0 2024-09-12T17:48:46.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.274+0000 7f3eba72e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:48:46.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.274+0000 7f3eba72e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 info.flags=0x17 2024-09-12T17:48:46.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.274+0000 7f3eba72e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 to cache LRU end 2024-09-12T17:48:46.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.274+0000 7f3eba72e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:48:46.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.274+0000 7f3eba72e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:48:46.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.274+0000 7f3eba72e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 2024-09-12T17:48:46.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.275+0000 7f3eba72e800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 to be held by another RGW process; skipping for now 2024-09-12T17:48:46.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.276+0000 7f3d6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:48:46.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.278+0000 7f3eba72e800 20 remove_watcher() i=0 2024-09-12T17:48:46.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.278+0000 7f3eba72e800 2 removed watcher, disabling cache 2024-09-12T17:48:46.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.279+0000 7f3eba72e800 20 remove_watcher() i=1 2024-09-12T17:48:46.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.280+0000 7f3eba72e800 20 remove_watcher() i=2 2024-09-12T17:48:46.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.281+0000 7f3eba72e800 20 remove_watcher() i=3 2024-09-12T17:48:46.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.282+0000 7f3eba72e800 20 remove_watcher() i=4 2024-09-12T17:48:46.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.283+0000 7f3eba72e800 20 remove_watcher() i=5 2024-09-12T17:48:46.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.284+0000 7f3eba72e800 20 remove_watcher() i=6 2024-09-12T17:48:46.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:48:46.285+0000 7f3eba72e800 20 remove_watcher() i=7 2024-09-12T17:48:46.296 INFO:tasks.workunit.client.0.smithi107.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:49:16.327 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:49:16.363 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:16.363 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:16.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.404+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.405+0000 7f263b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.405+0000 7f263b528800 20 realm 2024-09-12T17:49:16.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.405+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.405+0000 7f263b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.405+0000 7f263b528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:16.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.405+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.406+0000 7f263b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.406+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.407+0000 7f263b528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:16.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.407+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.407+0000 7f263b528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:16.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.407+0000 7f263b528800 20 searching for the correct realm 2024-09-12T17:49:16.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.411+0000 7f2637a70640 0 -- 172.21.15.107:0/4246317925 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x563ce93f63a0 msgr2=0x563ce93f8860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:16.416 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.414+0000 7f263726f640 0 -- 172.21.15.107:0/4246317925 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f2620054040 msgr2=0x7f2620084a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:16.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.419+0000 7f263b528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:16.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.419+0000 7f263b528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:16.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.419+0000 7f263b528800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:16.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.419+0000 7f263b528800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:16.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.419+0000 7f263b528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:16.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.419+0000 7f263b528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:16.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.419+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.419+0000 7f263b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.419+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.420+0000 7f263b528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:16.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.420+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.420+0000 7f263b528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:16.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.420+0000 7f263b528800 20 zone default found 2024-09-12T17:49:16.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.420+0000 7f263b528800 4 Realm: () 2024-09-12T17:49:16.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.420+0000 7f263b528800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:16.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.420+0000 7f263b528800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:16.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.420+0000 7f263b528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:16.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.420+0000 7f263b528800 20 zonegroup default 2024-09-12T17:49:16.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.420+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.420+0000 7f263b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.420+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.421+0000 7f263b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.421+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.421+0000 7f263b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.421+0000 7f263b528800 20 started sync module instance, tier type = 2024-09-12T17:49:16.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.421+0000 7f263b528800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:16.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.431+0000 7f263b528800 20 add_watcher() i=0 2024-09-12T17:49:16.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.431+0000 7f263b528800 20 add_watcher() i=1 2024-09-12T17:49:16.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.431+0000 7f263b528800 20 add_watcher() i=2 2024-09-12T17:49:16.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.431+0000 7f263b528800 20 add_watcher() i=3 2024-09-12T17:49:16.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.431+0000 7f263b528800 20 add_watcher() i=4 2024-09-12T17:49:16.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.431+0000 7f263b528800 20 add_watcher() i=5 2024-09-12T17:49:16.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.431+0000 7f263b528800 20 add_watcher() i=6 2024-09-12T17:49:16.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.432+0000 7f263b528800 20 add_watcher() i=7 2024-09-12T17:49:16.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.432+0000 7f263b528800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:16.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.434+0000 7f24edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:16.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.434+0000 7f263b528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:16.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.434+0000 7f263b528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:16.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.434+0000 7f263b528800 5 note: GC not initialized 2024-09-12T17:49:16.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.434+0000 7f24ecfe1640 20 reqs_thread_entry: start 2024-09-12T17:49:16.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.434+0000 7f263b528800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:16.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.434+0000 7f263b528800 20 Filter name: none 2024-09-12T17:49:16.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.434+0000 7f24667fc640 20 reqs_thread_entry: start 2024-09-12T17:49:16.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.434+0000 7f263b528800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:49:16.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.434+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.435+0000 7f263b528800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:49:16.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.435+0000 7f263b528800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:49:16.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.435+0000 7f263b528800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:49:16.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.435+0000 7f263b528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 : miss 2024-09-12T17:49:16.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.435+0000 7f263b528800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.435+0000 7f263b528800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:49:16.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.435+0000 7f263b528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 info.flags=0x17 2024-09-12T17:49:16.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.435+0000 7f263b528800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 to cache LRU end 2024-09-12T17:49:16.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.435+0000 7f263b528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:16.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.435+0000 7f263b528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:16.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.435+0000 7f263b528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 2024-09-12T17:49:16.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.440+0000 7f263b528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 info.flags=0x17 2024-09-12T17:49:16.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.440+0000 7f263b528800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 to cache LRU end 2024-09-12T17:49:16.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.440+0000 7f263b528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:16.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.440+0000 7f263b528800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25, ofs0, ns] 2024-09-12T17:49:16.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.440+0000 7f251affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464269 cookie 94819611304528 notifier 6278 bl.length()=1009 2024-09-12T17:49:16.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.440+0000 7f251affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 info.flags=0x17 2024-09-12T17:49:16.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.440+0000 7f251affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 to cache LRU end 2024-09-12T17:49:16.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.440+0000 7f251affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:16.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.441+0000 7f263b528800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.25]): orig_sources= new_sources= 2024-09-12T17:49:16.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.441+0000 7f263b528800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.25]): potential sources added=[] removed=[] 2024-09-12T17:49:16.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.441+0000 7f263b528800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.25]): orig_dests= new_dests= 2024-09-12T17:49:16.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.441+0000 7f263b528800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.25]): potential dests added=[] removed=[] 2024-09-12T17:49:16.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.443+0000 7f263b528800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.25.1.0 2024-09-12T17:49:16.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.443+0000 7f263b528800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.25.1.0 2024-09-12T17:49:16.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.443+0000 7f263b528800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.25.1.1 2024-09-12T17:49:16.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.443+0000 7f263b528800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.25.1.1 2024-09-12T17:49:16.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.443+0000 7f263b528800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.25.0 2024-09-12T17:49:16.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.446+0000 7f263b528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:16.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.446+0000 7f263b528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 2024-09-12T17:49:16.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.447+0000 7f263b528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 info.flags=0x17 2024-09-12T17:49:16.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.447+0000 7f263b528800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 to cache LRU end 2024-09-12T17:49:16.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.447+0000 7f263b528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:16.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.447+0000 7f263b528800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25, ofs0, ns] 2024-09-12T17:49:16.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.447+0000 7f251a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464270 cookie 94819611304528 notifier 6278 bl.length()=1009 2024-09-12T17:49:16.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.447+0000 7f251a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 info.flags=0x17 2024-09-12T17:49:16.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.447+0000 7f251a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 to cache LRU end 2024-09-12T17:49:16.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.447+0000 7f251a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:16.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.447+0000 7f263b528800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.25]): orig_sources= new_sources= 2024-09-12T17:49:16.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.447+0000 7f263b528800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.25]): potential sources added=[] removed=[] 2024-09-12T17:49:16.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.447+0000 7f263b528800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.25]): orig_dests= new_dests= 2024-09-12T17:49:16.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.447+0000 7f263b528800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.25]): potential dests added=[] removed=[] 2024-09-12T17:49:16.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.449+0000 7f263b528800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.25.0 2024-09-12T17:49:16.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.449+0000 7f263b528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:16.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.449+0000 7f263b528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 2024-09-12T17:49:16.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.450+0000 7f263b528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 info.flags=0x17 2024-09-12T17:49:16.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.450+0000 7f263b528800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 to cache LRU end 2024-09-12T17:49:16.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.450+0000 7f263b528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:16.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.450+0000 7f263b528800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25, ofs0, ns] 2024-09-12T17:49:16.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.450+0000 7f251affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464271 cookie 94819611304528 notifier 6278 bl.length()=977 2024-09-12T17:49:16.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.450+0000 7f251affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 info.flags=0x17 2024-09-12T17:49:16.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.450+0000 7f251affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 to cache LRU end 2024-09-12T17:49:16.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.450+0000 7f251affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:16.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.451+0000 7f263b528800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.25]): orig_sources= new_sources= 2024-09-12T17:49:16.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.451+0000 7f263b528800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.25]): potential sources added=[] removed=[] 2024-09-12T17:49:16.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.451+0000 7f263b528800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.25]): orig_dests= new_dests= 2024-09-12T17:49:16.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.451+0000 7f263b528800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.25]): potential dests added=[] removed=[] 2024-09-12T17:49:16.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.452+0000 7f263b528800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:49:16.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.454+0000 7f24edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:16.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.456+0000 7f263b528800 20 remove_watcher() i=0 2024-09-12T17:49:16.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.456+0000 7f263b528800 2 removed watcher, disabling cache 2024-09-12T17:49:16.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.458+0000 7f263b528800 20 remove_watcher() i=1 2024-09-12T17:49:16.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.458+0000 7f263b528800 20 remove_watcher() i=2 2024-09-12T17:49:16.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.460+0000 7f263b528800 20 remove_watcher() i=3 2024-09-12T17:49:16.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.461+0000 7f263b528800 20 remove_watcher() i=4 2024-09-12T17:49:16.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.462+0000 7f263b528800 20 remove_watcher() i=5 2024-09-12T17:49:16.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.463+0000 7f263b528800 20 remove_watcher() i=6 2024-09-12T17:49:16.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.464+0000 7f263b528800 20 remove_watcher() i=7 2024-09-12T17:49:16.477 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:49:16.506 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:16.506 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:16.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.541+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.542+0000 7f9706b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.542+0000 7f9706b2e800 20 realm 2024-09-12T17:49:16.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.542+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.543+0000 7f9706b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.543+0000 7f9706b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:16.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.543+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.543+0000 7f9706b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.543+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.544+0000 7f9706b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:16.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.544+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.544+0000 7f9706b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:16.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.544+0000 7f9706b2e800 20 searching for the correct realm 2024-09-12T17:49:16.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.548+0000 7f97020dc640 0 -- 172.21.15.107:0/1021380426 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x56414794a510 msgr2=0x56414794c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:16.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.551+0000 7f97020dc640 0 -- 172.21.15.107:0/1021380426 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f96f8069b10 msgr2=0x7f96f805f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:16.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.555+0000 7f9706b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:16.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.555+0000 7f9706b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:16.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.555+0000 7f9706b2e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:16.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.555+0000 7f9706b2e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:16.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.555+0000 7f9706b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:16.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.555+0000 7f9706b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:16.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.555+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.555+0000 7f9706b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.555+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:16.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:16.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 20 zone default found 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 4 Realm: () 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 20 zonegroup default 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.556+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.557+0000 7f9706b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.557+0000 7f9706b2e800 20 started sync module instance, tier type = 2024-09-12T17:49:16.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.557+0000 7f9706b2e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:16.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.565+0000 7f9706b2e800 20 add_watcher() i=0 2024-09-12T17:49:16.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.565+0000 7f9706b2e800 20 add_watcher() i=1 2024-09-12T17:49:16.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.565+0000 7f9706b2e800 20 add_watcher() i=2 2024-09-12T17:49:16.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.565+0000 7f9706b2e800 20 add_watcher() i=3 2024-09-12T17:49:16.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.565+0000 7f9706b2e800 20 add_watcher() i=4 2024-09-12T17:49:16.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.565+0000 7f9706b2e800 20 add_watcher() i=5 2024-09-12T17:49:16.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.565+0000 7f9706b2e800 20 add_watcher() i=6 2024-09-12T17:49:16.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.566+0000 7f9706b2e800 20 add_watcher() i=7 2024-09-12T17:49:16.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.566+0000 7f9706b2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:16.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.568+0000 7f95b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:16.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.568+0000 7f9706b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:16.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.568+0000 7f9706b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:16.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.568+0000 7f9706b2e800 5 note: GC not initialized 2024-09-12T17:49:16.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.568+0000 7f9533fff640 20 reqs_thread_entry: start 2024-09-12T17:49:16.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.568+0000 7f9706b2e800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:16.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.568+0000 7f9706b2e800 20 Filter name: none 2024-09-12T17:49:16.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.568+0000 7f9531ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:16.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.568+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.569+0000 7f9706b2e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:49:16.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.569+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.569+0000 7f9706b2e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:49:16.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.569+0000 7f9706b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:16.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.569+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.570+0000 7f9706b2e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:49:16.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.570+0000 7f9706b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.570+0000 7f9706b2e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:49:16.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.570+0000 7f9706b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:16.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.571+0000 7f95b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:16.574 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.574+0000 7f9706b2e800 20 remove_watcher() i=0 2024-09-12T17:49:16.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.574+0000 7f9706b2e800 2 removed watcher, disabling cache 2024-09-12T17:49:16.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.575+0000 7f9706b2e800 20 remove_watcher() i=1 2024-09-12T17:49:16.576 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.575+0000 7f9706b2e800 20 remove_watcher() i=2 2024-09-12T17:49:16.577 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.576+0000 7f9706b2e800 20 remove_watcher() i=3 2024-09-12T17:49:16.578 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.577+0000 7f9706b2e800 20 remove_watcher() i=4 2024-09-12T17:49:16.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.578+0000 7f9706b2e800 20 remove_watcher() i=5 2024-09-12T17:49:16.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.579+0000 7f9706b2e800 20 remove_watcher() i=6 2024-09-12T17:49:16.581 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.580+0000 7f9706b2e800 20 remove_watcher() i=7 2024-09-12T17:49:16.591 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:16.592 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:16.592 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-set-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:49:16.592 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:16.653 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T17:49:16.654 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:16.837 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:49:16.865 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:16.865 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:16.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.900+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.902+0000 7f9f20b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.902+0000 7f9f20b25800 20 realm 2024-09-12T17:49:16.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.902+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.902+0000 7f9f20b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.902+0000 7f9f20b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:16.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.902+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.902+0000 7f9f20b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:16.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.902+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.903+0000 7f9f20b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:16.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.903+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:16.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.904+0000 7f9f20b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:16.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.904+0000 7f9f20b25800 20 searching for the correct realm 2024-09-12T17:49:16.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.906+0000 7f9f13f32640 0 -- 172.21.15.107:0/3764503277 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f9f04065420 msgr2=0x7f9f040658a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:16.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:16.909+0000 7f9f1c733640 0 -- 172.21.15.107:0/3764503277 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f9f0409a3a0 msgr2=0x7f9f0409a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:17.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.116+0000 7f9f20b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:17.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.116+0000 7f9f20b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:17.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.116+0000 7f9f20b25800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:17.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.116+0000 7f9f20b25800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:17.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.116+0000 7f9f20b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:17.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.116+0000 7f9f20b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:17.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.116+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.116+0000 7f9f20b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.116+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.116+0000 7f9f20b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:17.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.116+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.117+0000 7f9f20b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.117+0000 7f9f20b25800 20 zone default found 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.117+0000 7f9f20b25800 4 Realm: () 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.117+0000 7f9f20b25800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.117+0000 7f9f20b25800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.117+0000 7f9f20b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.117+0000 7f9f20b25800 20 zonegroup default 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.117+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.117+0000 7f9f20b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.117+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.117+0000 7f9f20b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.117+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.118+0000 7f9f20b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.118+0000 7f9f20b25800 20 started sync module instance, tier type = 2024-09-12T17:49:17.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.118+0000 7f9f20b25800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:17.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.126+0000 7f9f20b25800 20 add_watcher() i=0 2024-09-12T17:49:17.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.126+0000 7f9f20b25800 20 add_watcher() i=1 2024-09-12T17:49:17.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.126+0000 7f9f20b25800 20 add_watcher() i=2 2024-09-12T17:49:17.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.126+0000 7f9f20b25800 20 add_watcher() i=3 2024-09-12T17:49:17.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.126+0000 7f9f20b25800 20 add_watcher() i=4 2024-09-12T17:49:17.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.126+0000 7f9f20b25800 20 add_watcher() i=5 2024-09-12T17:49:17.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.126+0000 7f9f20b25800 20 add_watcher() i=6 2024-09-12T17:49:17.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.127+0000 7f9f20b25800 20 add_watcher() i=7 2024-09-12T17:49:17.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.127+0000 7f9f20b25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:17.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.128+0000 7f9dd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:17.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.128+0000 7f9f20b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:17.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.128+0000 7f9f20b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:17.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.129+0000 7f9f20b25800 5 note: GC not initialized 2024-09-12T17:49:17.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.129+0000 7f9dd1fdb640 20 reqs_thread_entry: start 2024-09-12T17:49:17.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.129+0000 7f9f20b25800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:17.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.129+0000 7f9f20b25800 20 Filter name: none 2024-09-12T17:49:17.131 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.129+0000 7f9d437fe640 20 reqs_thread_entry: start 2024-09-12T17:49:17.131 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.129+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.130+0000 7f9f20b25800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:17.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.130+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.130+0000 7f9f20b25800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:17.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.130+0000 7f9f20b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:17.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.130+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.131+0000 7f9f20b25800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:17.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.131+0000 7f9f20b25800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.131+0000 7f9f20b25800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:17.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.131+0000 7f9f20b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:17.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.132+0000 7f9dd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:17.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.134+0000 7f9f20b25800 20 remove_watcher() i=0 2024-09-12T17:49:17.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.134+0000 7f9f20b25800 2 removed watcher, disabling cache 2024-09-12T17:49:17.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.135+0000 7f9f20b25800 20 remove_watcher() i=1 2024-09-12T17:49:17.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.136+0000 7f9f20b25800 20 remove_watcher() i=2 2024-09-12T17:49:17.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.137+0000 7f9f20b25800 20 remove_watcher() i=3 2024-09-12T17:49:17.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.138+0000 7f9f20b25800 20 remove_watcher() i=4 2024-09-12T17:49:17.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.139+0000 7f9f20b25800 20 remove_watcher() i=5 2024-09-12T17:49:17.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.141+0000 7f9f20b25800 20 remove_watcher() i=6 2024-09-12T17:49:17.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.141+0000 7f9f20b25800 20 remove_watcher() i=7 2024-09-12T17:49:17.153 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:17.153 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:17.153 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-trim-reshard-log-entries id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:49:17.153 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:17.154 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T17:49:17.189 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:17.189 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:17.225 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.224+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.225+0000 7f96ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.225+0000 7f96ddf2c800 20 realm 2024-09-12T17:49:17.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.225+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.225+0000 7f96ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.225+0000 7f96ddf2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:17.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.225+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.225+0000 7f96ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.225+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.226+0000 7f96ddf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:17.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.226+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.227+0000 7f96ddf2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:17.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.227+0000 7f96ddf2c800 20 searching for the correct realm 2024-09-12T17:49:17.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.229+0000 7f96d144e640 0 -- 172.21.15.107:0/2351440618 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f96c40242a0 msgr2=0x7f96c407e490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:17.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.232+0000 7f96d9c4f640 0 -- 172.21.15.107:0/2351440618 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f96c409fbc0 msgr2=0x7f96c4077020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:17.439 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.437+0000 7f96ddf2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:17.439 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.437+0000 7f96ddf2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:17.439 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.437+0000 7f96ddf2c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:17.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.437+0000 7f96ddf2c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:17.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.437+0000 7f96ddf2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:17.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.437+0000 7f96ddf2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:17.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.437+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:17.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:17.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 20 zone default found 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 4 Realm: () 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 20 zonegroup default 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.438+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.439+0000 7f96ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.439+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.439+0000 7f96ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.439+0000 7f96ddf2c800 20 started sync module instance, tier type = 2024-09-12T17:49:17.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.439+0000 7f96ddf2c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:17.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.448+0000 7f96ddf2c800 20 add_watcher() i=0 2024-09-12T17:49:17.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.448+0000 7f96ddf2c800 20 add_watcher() i=1 2024-09-12T17:49:17.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.448+0000 7f96ddf2c800 20 add_watcher() i=2 2024-09-12T17:49:17.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.448+0000 7f96ddf2c800 20 add_watcher() i=3 2024-09-12T17:49:17.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.448+0000 7f96ddf2c800 20 add_watcher() i=4 2024-09-12T17:49:17.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.448+0000 7f96ddf2c800 20 add_watcher() i=5 2024-09-12T17:49:17.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.448+0000 7f96ddf2c800 20 add_watcher() i=6 2024-09-12T17:49:17.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.449+0000 7f96ddf2c800 20 add_watcher() i=7 2024-09-12T17:49:17.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.449+0000 7f96ddf2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:17.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.450+0000 7f958bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:17.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.451+0000 7f96ddf2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:17.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.451+0000 7f96ddf2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:17.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.451+0000 7f96ddf2c800 5 note: GC not initialized 2024-09-12T17:49:17.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.451+0000 7f958affd640 20 reqs_thread_entry: start 2024-09-12T17:49:17.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.451+0000 7f96ddf2c800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:17.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.451+0000 7f96ddf2c800 20 Filter name: none 2024-09-12T17:49:17.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.451+0000 7f9588ff9640 20 reqs_thread_entry: start 2024-09-12T17:49:17.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.451+0000 7f96ddf2c800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:49:17.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.451+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.452+0000 7f96ddf2c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:17.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.452+0000 7f96ddf2c800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:49:17.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.452+0000 7f96ddf2c800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:49:17.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.452+0000 7f96ddf2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 : miss 2024-09-12T17:49:17.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.452+0000 7f96ddf2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.452+0000 7f96ddf2c800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:17.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.452+0000 7f96ddf2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 info.flags=0x17 2024-09-12T17:49:17.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.452+0000 7f96ddf2c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 to cache LRU end 2024-09-12T17:49:17.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.452+0000 7f96ddf2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:17.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.452+0000 7f96ddf2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:17.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.452+0000 7f96ddf2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 2024-09-12T17:49:17.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.455+0000 7f96ddf2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 info.flags=0x17 2024-09-12T17:49:17.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.455+0000 7f96ddf2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 to cache LRU end 2024-09-12T17:49:17.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.456+0000 7f96ddf2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:17.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.456+0000 7f96ddf2c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26, ofs0, ns] 2024-09-12T17:49:17.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.456+0000 7f95bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464312 cookie 94228110891536 notifier 6690 bl.length()=1023 2024-09-12T17:49:17.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.456+0000 7f95bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 info.flags=0x17 2024-09-12T17:49:17.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.456+0000 7f95bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 to cache LRU end 2024-09-12T17:49:17.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.456+0000 7f95bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:17.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.456+0000 7f96ddf2c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): orig_sources= new_sources= 2024-09-12T17:49:17.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.456+0000 7f96ddf2c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): potential sources added=[] removed=[] 2024-09-12T17:49:17.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.456+0000 7f96ddf2c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): orig_dests= new_dests= 2024-09-12T17:49:17.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.456+0000 7f96ddf2c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): potential dests added=[] removed=[] 2024-09-12T17:49:17.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.456+0000 7f96ddf2c800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T17:49:17.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.456+0000 7f96ddf2c800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T17:49:17.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.458+0000 7f958bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:17.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.461+0000 7f96ddf2c800 20 remove_watcher() i=0 2024-09-12T17:49:17.462 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.461+0000 7f96ddf2c800 2 removed watcher, disabling cache 2024-09-12T17:49:17.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.462+0000 7f96ddf2c800 20 remove_watcher() i=1 2024-09-12T17:49:17.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.463+0000 7f96ddf2c800 20 remove_watcher() i=2 2024-09-12T17:49:17.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.464+0000 7f96ddf2c800 20 remove_watcher() i=3 2024-09-12T17:49:17.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.465+0000 7f96ddf2c800 20 remove_watcher() i=4 2024-09-12T17:49:17.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.466+0000 7f96ddf2c800 20 remove_watcher() i=5 2024-09-12T17:49:17.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.467+0000 7f96ddf2c800 20 remove_watcher() i=6 2024-09-12T17:49:17.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.468+0000 7f96ddf2c800 20 remove_watcher() i=7 2024-09-12T17:49:17.480 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:49:17.509 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:17.509 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:17.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.544+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.546+0000 7f2fff896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.546+0000 7f2fff896800 20 realm 2024-09-12T17:49:17.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.546+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.546+0000 7f2fff896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.546+0000 7f2fff896800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:17.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.546+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.546+0000 7f2fff896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.546+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.547+0000 7f2fff896800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:17.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.547+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.547+0000 7f2fff896800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:17.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.547+0000 7f2fff896800 20 searching for the correct realm 2024-09-12T17:49:17.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.550+0000 7f2ffd380640 0 -- 172.21.15.107:0/241172387 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f2ff8061040 msgr2=0x7f2ff8055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:17.554 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.553+0000 7f2ffd380640 0 -- 172.21.15.107:0/241172387 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f2ff40838d0 msgr2=0x7f2ff406a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:17.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.759+0000 7f2fff896800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:17.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.759+0000 7f2fff896800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:17.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.759+0000 7f2fff896800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:17.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.759+0000 7f2fff896800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:17.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.759+0000 7f2fff896800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.759+0000 7f2fff896800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.759+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.759+0000 7f2fff896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.759+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.759+0000 7f2fff896800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.759+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 20 zone default found 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 4 Realm: () 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:17.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 20 zonegroup default 2024-09-12T17:49:17.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 20 started sync module instance, tier type = 2024-09-12T17:49:17.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.760+0000 7f2fff896800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:17.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.769+0000 7f2fff896800 20 add_watcher() i=0 2024-09-12T17:49:17.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.769+0000 7f2fff896800 20 add_watcher() i=1 2024-09-12T17:49:17.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.769+0000 7f2fff896800 20 add_watcher() i=2 2024-09-12T17:49:17.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.769+0000 7f2fff896800 20 add_watcher() i=3 2024-09-12T17:49:17.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.769+0000 7f2fff896800 20 add_watcher() i=4 2024-09-12T17:49:17.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.769+0000 7f2fff896800 20 add_watcher() i=5 2024-09-12T17:49:17.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.769+0000 7f2fff896800 20 add_watcher() i=6 2024-09-12T17:49:17.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.770+0000 7f2fff896800 20 add_watcher() i=7 2024-09-12T17:49:17.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.770+0000 7f2fff896800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:17.773 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.772+0000 7f2eb3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:17.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.772+0000 7f2fff896800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:17.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.772+0000 7f2fff896800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:17.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.772+0000 7f2fff896800 5 note: GC not initialized 2024-09-12T17:49:17.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.773+0000 7f2eb2fe5640 20 reqs_thread_entry: start 2024-09-12T17:49:17.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.773+0000 7f2fff896800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:17.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.773+0000 7f2fff896800 20 Filter name: none 2024-09-12T17:49:17.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.773+0000 7f2eb0fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:17.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.773+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.774+0000 7f2fff896800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:17.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.774+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.774+0000 7f2fff896800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:49:17.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.774+0000 7f2fff896800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:17.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.774+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.775+0000 7f2fff896800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:17.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.775+0000 7f2fff896800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.775+0000 7f2fff896800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:49:17.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.775+0000 7f2fff896800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:17.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.776+0000 7f2eb3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:17.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.778+0000 7f2fff896800 20 remove_watcher() i=0 2024-09-12T17:49:17.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.778+0000 7f2fff896800 2 removed watcher, disabling cache 2024-09-12T17:49:17.780 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.779+0000 7f2fff896800 20 remove_watcher() i=1 2024-09-12T17:49:17.781 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.780+0000 7f2fff896800 20 remove_watcher() i=2 2024-09-12T17:49:17.782 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.781+0000 7f2fff896800 20 remove_watcher() i=3 2024-09-12T17:49:17.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.783+0000 7f2fff896800 20 remove_watcher() i=4 2024-09-12T17:49:17.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.784+0000 7f2fff896800 20 remove_watcher() i=5 2024-09-12T17:49:17.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.785+0000 7f2fff896800 20 remove_watcher() i=6 2024-09-12T17:49:17.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.786+0000 7f2fff896800 20 remove_watcher() i=7 2024-09-12T17:49:17.797 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:17.797 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:17.797 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-trim-reshard-log-entries id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:49:17.797 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:17.848 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:49:17.879 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:17.879 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:17.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.914+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.916+0000 7f0edef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.916+0000 7f0edef2e800 20 realm 2024-09-12T17:49:17.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.916+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.916+0000 7f0edef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.916+0000 7f0edef2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:17.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.916+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.916+0000 7f0edef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:17.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.916+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.917+0000 7f0edef2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:17.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.917+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:17.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.917+0000 7f0edef2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:17.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.917+0000 7f0edef2e800 20 searching for the correct realm 2024-09-12T17:49:17.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.920+0000 7f0edab64640 0 -- 172.21.15.107:0/1069472931 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f0ed4024040 msgr2=0x7f0ed4024930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:17.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:17.924+0000 7f0edab64640 0 -- 172.21.15.107:0/1069472931 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f0ec40ac250 msgr2=0x7f0ec40aa3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:18.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.131+0000 7f0edef2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:18.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.131+0000 7f0edef2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:18.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.131+0000 7f0edef2e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:18.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.131+0000 7f0edef2e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:18.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.131+0000 7f0edef2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:18.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.131+0000 7f0edef2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:18.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.131+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.131+0000 7f0edef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.131+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.131+0000 7f0edef2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:18.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.131+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.132+0000 7f0edef2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:18.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.132+0000 7f0edef2e800 20 zone default found 2024-09-12T17:49:18.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.132+0000 7f0edef2e800 4 Realm: () 2024-09-12T17:49:18.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.132+0000 7f0edef2e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:18.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.132+0000 7f0edef2e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:18.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.132+0000 7f0edef2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:18.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.132+0000 7f0edef2e800 20 zonegroup default 2024-09-12T17:49:18.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.132+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.132+0000 7f0edef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.132+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.132+0000 7f0edef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.132+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.133+0000 7f0edef2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.133+0000 7f0edef2e800 20 started sync module instance, tier type = 2024-09-12T17:49:18.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.133+0000 7f0edef2e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:18.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.142+0000 7f0edef2e800 20 add_watcher() i=0 2024-09-12T17:49:18.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.142+0000 7f0edef2e800 20 add_watcher() i=1 2024-09-12T17:49:18.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.142+0000 7f0edef2e800 20 add_watcher() i=2 2024-09-12T17:49:18.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.142+0000 7f0edef2e800 20 add_watcher() i=3 2024-09-12T17:49:18.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.142+0000 7f0edef2e800 20 add_watcher() i=4 2024-09-12T17:49:18.143 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.142+0000 7f0edef2e800 20 add_watcher() i=5 2024-09-12T17:49:18.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.142+0000 7f0edef2e800 20 add_watcher() i=6 2024-09-12T17:49:18.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.143+0000 7f0edef2e800 20 add_watcher() i=7 2024-09-12T17:49:18.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.143+0000 7f0edef2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:18.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.145+0000 7f0d917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:18.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.145+0000 7f0edef2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:18.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.145+0000 7f0edef2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:18.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.145+0000 7f0edef2e800 5 note: GC not initialized 2024-09-12T17:49:18.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.145+0000 7f0d0bfff640 20 reqs_thread_entry: start 2024-09-12T17:49:18.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.145+0000 7f0edef2e800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:18.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.145+0000 7f0edef2e800 20 Filter name: none 2024-09-12T17:49:18.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.145+0000 7f0d09ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:18.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.146+0000 7f0edef2e800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:49:18.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.146+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.146+0000 7f0edef2e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:18.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.146+0000 7f0edef2e800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:49:18.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.146+0000 7f0edef2e800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:49:18.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.146+0000 7f0edef2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 : miss 2024-09-12T17:49:18.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.146+0000 7f0edef2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.146+0000 7f0edef2e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:49:18.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.147+0000 7f0edef2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 info.flags=0x17 2024-09-12T17:49:18.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.147+0000 7f0edef2e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 to cache LRU end 2024-09-12T17:49:18.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.147+0000 7f0edef2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:18.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.147+0000 7f0edef2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:18.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.147+0000 7f0edef2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 2024-09-12T17:49:18.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.148+0000 7f0edef2e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:49:18.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.151+0000 7f0edef2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 info.flags=0x17 2024-09-12T17:49:18.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.151+0000 7f0edef2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 to cache LRU end 2024-09-12T17:49:18.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.151+0000 7f0edef2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:18.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.151+0000 7f0edef2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26, ofs0, ns] 2024-09-12T17:49:18.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.152+0000 7f0dbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464313 cookie 94562947699040 notifier 6726 bl.length()=1023 2024-09-12T17:49:18.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.152+0000 7f0dbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 info.flags=0x17 2024-09-12T17:49:18.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.152+0000 7f0dbe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 to cache LRU end 2024-09-12T17:49:18.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.152+0000 7f0dbe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:18.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.152+0000 7f0edef2e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): orig_sources= new_sources= 2024-09-12T17:49:18.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.152+0000 7f0edef2e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): potential sources added=[] removed=[] 2024-09-12T17:49:18.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.152+0000 7f0edef2e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): orig_dests= new_dests= 2024-09-12T17:49:18.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.152+0000 7f0edef2e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): potential dests added=[] removed=[] 2024-09-12T17:49:18.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.154+0000 7f0edef2e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.26.2.0 2024-09-12T17:49:18.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.154+0000 7f0edef2e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.26.2.0 2024-09-12T17:49:18.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.154+0000 7f0edef2e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.26.2.1 2024-09-12T17:49:18.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.154+0000 7f0edef2e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.26.2.1 2024-09-12T17:49:18.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.154+0000 7f0edef2e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.26.0 2024-09-12T17:49:18.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.156+0000 7f0edef2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:18.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.156+0000 7f0edef2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 2024-09-12T17:49:18.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.158+0000 7f0edef2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 info.flags=0x17 2024-09-12T17:49:18.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.158+0000 7f0edef2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 to cache LRU end 2024-09-12T17:49:18.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.158+0000 7f0edef2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:18.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.158+0000 7f0edef2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26, ofs0, ns] 2024-09-12T17:49:18.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.158+0000 7f0dbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464314 cookie 94562947699040 notifier 6726 bl.length()=1023 2024-09-12T17:49:18.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.158+0000 7f0dbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 info.flags=0x17 2024-09-12T17:49:18.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.158+0000 7f0dbe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 to cache LRU end 2024-09-12T17:49:18.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.158+0000 7f0dbe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:18.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.158+0000 7f0edef2e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): orig_sources= new_sources= 2024-09-12T17:49:18.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.158+0000 7f0edef2e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): potential sources added=[] removed=[] 2024-09-12T17:49:18.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.158+0000 7f0edef2e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): orig_dests= new_dests= 2024-09-12T17:49:18.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.158+0000 7f0edef2e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): potential dests added=[] removed=[] 2024-09-12T17:49:18.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.159+0000 7f0edef2e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.26.0 2024-09-12T17:49:18.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.160+0000 7f0edef2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:18.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.160+0000 7f0edef2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 2024-09-12T17:49:18.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.161+0000 7f0edef2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 info.flags=0x17 2024-09-12T17:49:18.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.161+0000 7f0edef2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 to cache LRU end 2024-09-12T17:49:18.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.161+0000 7f0edef2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:18.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.161+0000 7f0edef2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26, ofs0, ns] 2024-09-12T17:49:18.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.161+0000 7f0dbdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464315 cookie 94562947699040 notifier 6726 bl.length()=991 2024-09-12T17:49:18.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.161+0000 7f0dbdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 info.flags=0x17 2024-09-12T17:49:18.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.161+0000 7f0dbdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 to cache LRU end 2024-09-12T17:49:18.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.161+0000 7f0dbdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:18.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.162+0000 7f0edef2e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): orig_sources= new_sources= 2024-09-12T17:49:18.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.162+0000 7f0edef2e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): potential sources added=[] removed=[] 2024-09-12T17:49:18.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.162+0000 7f0edef2e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): orig_dests= new_dests= 2024-09-12T17:49:18.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.162+0000 7f0edef2e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.26]): potential dests added=[] removed=[] 2024-09-12T17:49:18.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.163+0000 7f0edef2e800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T17:49:18.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.165+0000 7f0d917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:18.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.167+0000 7f0edef2e800 20 remove_watcher() i=0 2024-09-12T17:49:18.168 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.167+0000 7f0edef2e800 2 removed watcher, disabling cache 2024-09-12T17:49:18.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.168+0000 7f0edef2e800 20 remove_watcher() i=1 2024-09-12T17:49:18.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.169+0000 7f0edef2e800 20 remove_watcher() i=2 2024-09-12T17:49:18.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.170+0000 7f0edef2e800 20 remove_watcher() i=3 2024-09-12T17:49:18.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.171+0000 7f0edef2e800 20 remove_watcher() i=4 2024-09-12T17:49:18.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.172+0000 7f0edef2e800 20 remove_watcher() i=5 2024-09-12T17:49:18.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.173+0000 7f0edef2e800 20 remove_watcher() i=6 2024-09-12T17:49:18.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.174+0000 7f0edef2e800 20 remove_watcher() i=7 2024-09-12T17:49:18.187 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:49:18.215 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:18.216 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:18.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.250+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.252+0000 7f5a3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.252+0000 7f5a3d531800 20 realm 2024-09-12T17:49:18.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.252+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.252+0000 7f5a3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.252+0000 7f5a3d531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:18.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.252+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.252+0000 7f5a3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.252+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.253+0000 7f5a3d531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:18.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.253+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.254+0000 7f5a3d531800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:18.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.254+0000 7f5a3d531800 20 searching for the correct realm 2024-09-12T17:49:18.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.256+0000 7f5a30a75640 0 -- 172.21.15.107:0/2393622783 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f5a240b4090 msgr2=0x7f5a240aa010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:18.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.260+0000 7f5a39276640 0 -- 172.21.15.107:0/2393622783 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f5a24056760 msgr2=0x7f5a240a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:18.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.466+0000 7f5a3d531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:18.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.466+0000 7f5a3d531800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:18.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.466+0000 7f5a3d531800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:18.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.466+0000 7f5a3d531800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:18.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.466+0000 7f5a3d531800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:18.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.466+0000 7f5a3d531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:18.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.466+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:18.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 20 zone default found 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 4 Realm: () 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 20 zonegroup default 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.467+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.468+0000 7f5a3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.468+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.468+0000 7f5a3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.468+0000 7f5a3d531800 20 started sync module instance, tier type = 2024-09-12T17:49:18.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.468+0000 7f5a3d531800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:18.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.477+0000 7f5a3d531800 20 add_watcher() i=0 2024-09-12T17:49:18.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.477+0000 7f5a3d531800 20 add_watcher() i=1 2024-09-12T17:49:18.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.477+0000 7f5a3d531800 20 add_watcher() i=2 2024-09-12T17:49:18.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.477+0000 7f5a3d531800 20 add_watcher() i=3 2024-09-12T17:49:18.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.477+0000 7f5a3d531800 20 add_watcher() i=4 2024-09-12T17:49:18.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.477+0000 7f5a3d531800 20 add_watcher() i=5 2024-09-12T17:49:18.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.477+0000 7f5a3d531800 20 add_watcher() i=6 2024-09-12T17:49:18.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.478+0000 7f5a3d531800 20 add_watcher() i=7 2024-09-12T17:49:18.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.478+0000 7f5a3d531800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:18.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.479+0000 7f58ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:18.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.480+0000 7f5a3d531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:18.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.480+0000 7f5a3d531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:18.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.480+0000 7f5a3d531800 5 note: GC not initialized 2024-09-12T17:49:18.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.480+0000 7f58ee7e4640 20 reqs_thread_entry: start 2024-09-12T17:49:18.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.480+0000 7f5a3d531800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:18.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.480+0000 7f5a3d531800 20 Filter name: none 2024-09-12T17:49:18.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.480+0000 7f585ffff640 20 reqs_thread_entry: start 2024-09-12T17:49:18.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.480+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.481+0000 7f5a3d531800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:18.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.481+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.482+0000 7f5a3d531800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:18.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.482+0000 7f5a3d531800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:18.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.482+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.482+0000 7f5a3d531800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:18.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.482+0000 7f5a3d531800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.483+0000 7f5a3d531800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:18.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.483+0000 7f5a3d531800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:18.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.484+0000 7f58ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:18.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.486+0000 7f5a3d531800 20 remove_watcher() i=0 2024-09-12T17:49:18.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.486+0000 7f5a3d531800 2 removed watcher, disabling cache 2024-09-12T17:49:18.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.487+0000 7f5a3d531800 20 remove_watcher() i=1 2024-09-12T17:49:18.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.488+0000 7f5a3d531800 20 remove_watcher() i=2 2024-09-12T17:49:18.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.489+0000 7f5a3d531800 20 remove_watcher() i=3 2024-09-12T17:49:18.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.489+0000 7f5a3d531800 20 remove_watcher() i=4 2024-09-12T17:49:18.491 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.490+0000 7f5a3d531800 20 remove_watcher() i=5 2024-09-12T17:49:18.492 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.491+0000 7f5a3d531800 20 remove_watcher() i=6 2024-09-12T17:49:18.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.492+0000 7f5a3d531800 20 remove_watcher() i=7 2024-09-12T17:49:18.503 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:18.503 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:18.503 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-trim-reshard-log-entries id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.26 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:49:18.503 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:18.565 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T17:49:18.565 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:18.767 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:49:18.795 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:18.795 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:18.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.830+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.832+0000 7fb63e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.832+0000 7fb63e775800 20 realm 2024-09-12T17:49:18.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.832+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.833+0000 7fb63e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.833+0000 7fb63e775800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:18.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.833+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.833+0000 7fb63e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:18.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.833+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.834+0000 7fb63e775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:18.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.834+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:18.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.834+0000 7fb63e775800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:18.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.834+0000 7fb63e775800 20 searching for the correct realm 2024-09-12T17:49:18.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.837+0000 7fb63ca60640 0 -- 172.21.15.107:0/3550750572 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5643f4275000 msgr2=0x5643f42774a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:18.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:18.840+0000 7fb63c25f640 0 -- 172.21.15.107:0/3550750572 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fb624020940 msgr2=0x7fb62401f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:19.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.046+0000 7fb63e775800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:19.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.046+0000 7fb63e775800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:19.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.046+0000 7fb63e775800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:19.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.046+0000 7fb63e775800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:19.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.046+0000 7fb63e775800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:19.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.046+0000 7fb63e775800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:19.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.046+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.046+0000 7fb63e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.046+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.046+0000 7fb63e775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:19.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.046+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.046+0000 7fb63e775800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:19.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 20 zone default found 2024-09-12T17:49:19.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 4 Realm: () 2024-09-12T17:49:19.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:19.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:19.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:19.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 20 zonegroup default 2024-09-12T17:49:19.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 20 started sync module instance, tier type = 2024-09-12T17:49:19.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.047+0000 7fb63e775800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:19.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.056+0000 7fb63e775800 20 add_watcher() i=0 2024-09-12T17:49:19.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.056+0000 7fb63e775800 20 add_watcher() i=1 2024-09-12T17:49:19.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.056+0000 7fb63e775800 20 add_watcher() i=2 2024-09-12T17:49:19.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.056+0000 7fb63e775800 20 add_watcher() i=3 2024-09-12T17:49:19.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.056+0000 7fb63e775800 20 add_watcher() i=4 2024-09-12T17:49:19.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.056+0000 7fb63e775800 20 add_watcher() i=5 2024-09-12T17:49:19.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.056+0000 7fb63e775800 20 add_watcher() i=6 2024-09-12T17:49:19.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.057+0000 7fb63e775800 20 add_watcher() i=7 2024-09-12T17:49:19.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.057+0000 7fb63e775800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:19.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.058+0000 7fb4f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:19.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.058+0000 7fb63e775800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:19.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.058+0000 7fb63e775800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:19.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.058+0000 7fb63e775800 5 note: GC not initialized 2024-09-12T17:49:19.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.059+0000 7fb4f1fdb640 20 reqs_thread_entry: start 2024-09-12T17:49:19.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.059+0000 7fb63e775800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:19.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.059+0000 7fb63e775800 20 Filter name: none 2024-09-12T17:49:19.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.059+0000 7fb4637fe640 20 reqs_thread_entry: start 2024-09-12T17:49:19.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.059+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.060+0000 7fb63e775800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:19.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.060+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.061+0000 7fb63e775800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:19.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.061+0000 7fb63e775800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:19.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.061+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.061+0000 7fb63e775800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:19.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.061+0000 7fb63e775800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.061+0000 7fb63e775800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:19.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.061+0000 7fb63e775800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:19.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.063+0000 7fb4f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:19.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.064+0000 7fb63e775800 20 remove_watcher() i=0 2024-09-12T17:49:19.066 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.064+0000 7fb63e775800 2 removed watcher, disabling cache 2024-09-12T17:49:19.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.066+0000 7fb63e775800 20 remove_watcher() i=1 2024-09-12T17:49:19.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.067+0000 7fb63e775800 20 remove_watcher() i=2 2024-09-12T17:49:19.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.068+0000 7fb63e775800 20 remove_watcher() i=3 2024-09-12T17:49:19.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.069+0000 7fb63e775800 20 remove_watcher() i=4 2024-09-12T17:49:19.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.070+0000 7fb63e775800 20 remove_watcher() i=5 2024-09-12T17:49:19.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.070+0000 7fb63e775800 20 remove_watcher() i=6 2024-09-12T17:49:19.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.071+0000 7fb63e775800 20 remove_watcher() i=7 2024-09-12T17:49:19.082 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:19.082 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:19.082 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-trim-reshard-log-entries id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:49:19.082 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:19.084 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T17:49:19.120 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:19.120 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:19.156 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.155+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.157+0000 7f23f3d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.157+0000 7f23f3d75800 20 realm 2024-09-12T17:49:19.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.157+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.157+0000 7f23f3d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.157+0000 7f23f3d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:19.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.157+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.157+0000 7f23f3d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.157+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.158+0000 7f23f3d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:19.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.158+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.158+0000 7f23f3d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:19.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.158+0000 7f23f3d75800 20 searching for the correct realm 2024-09-12T17:49:19.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.159+0000 7f23f1866640 0 -- 172.21.15.107:0/2077462237 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f23ec035060 msgr2=0x7f23ec0642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:19.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.364+0000 7f23f1065640 0 -- 172.21.15.107:0/2077462237 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x55cafd22b270 msgr2=0x55cafd22d660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:19.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:19.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:19.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:19.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:19.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:19.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:19.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.372 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 zone default found 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 4 Realm: () 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 zonegroup default 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.370+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.371+0000 7f23f3d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.371+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.371+0000 7f23f3d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.373 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.371+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.371+0000 7f23f3d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.371+0000 7f23f3d75800 20 started sync module instance, tier type = 2024-09-12T17:49:19.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.371+0000 7f23f3d75800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:19.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.380+0000 7f23f3d75800 20 add_watcher() i=0 2024-09-12T17:49:19.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.380+0000 7f23f3d75800 20 add_watcher() i=1 2024-09-12T17:49:19.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.380+0000 7f23f3d75800 20 add_watcher() i=2 2024-09-12T17:49:19.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.380+0000 7f23f3d75800 20 add_watcher() i=3 2024-09-12T17:49:19.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.380+0000 7f23f3d75800 20 add_watcher() i=4 2024-09-12T17:49:19.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.380+0000 7f23f3d75800 20 add_watcher() i=5 2024-09-12T17:49:19.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.380+0000 7f23f3d75800 20 add_watcher() i=6 2024-09-12T17:49:19.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.381+0000 7f23f3d75800 20 add_watcher() i=7 2024-09-12T17:49:19.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.381+0000 7f23f3d75800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:19.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.382+0000 7f22a3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:19.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.383+0000 7f23f3d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:19.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.383+0000 7f23f3d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:19.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.383+0000 7f23f3d75800 5 note: GC not initialized 2024-09-12T17:49:19.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.383+0000 7f22a2ffd640 20 reqs_thread_entry: start 2024-09-12T17:49:19.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.383+0000 7f23f3d75800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:19.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.383+0000 7f23f3d75800 20 Filter name: none 2024-09-12T17:49:19.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.383+0000 7f22a0ff9640 20 reqs_thread_entry: start 2024-09-12T17:49:19.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.383+0000 7f23f3d75800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:49:19.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.383+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.384+0000 7f23f3d75800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:19.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.384+0000 7f23f3d75800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:49:19.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.384+0000 7f23f3d75800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:49:19.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.384+0000 7f23f3d75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 : miss 2024-09-12T17:49:19.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.384+0000 7f23f3d75800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.384+0000 7f23f3d75800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:19.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.384+0000 7f23f3d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 info.flags=0x17 2024-09-12T17:49:19.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.384+0000 7f23f3d75800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 to cache LRU end 2024-09-12T17:49:19.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.384+0000 7f23f3d75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:19.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.384+0000 7f23f3d75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:19.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.384+0000 7f23f3d75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 2024-09-12T17:49:19.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f23f3d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 info.flags=0x17 2024-09-12T17:49:19.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f23f3d75800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 to cache LRU end 2024-09-12T17:49:19.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f23f3d75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:19.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f23f3d75800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27, ofs0, ns] 2024-09-12T17:49:19.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f22d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464318 cookie 94330318672224 notifier 6410 bl.length()=1023 2024-09-12T17:49:19.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f22d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 info.flags=0x17 2024-09-12T17:49:19.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f22d57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 to cache LRU end 2024-09-12T17:49:19.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f22d57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:19.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f23f3d75800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.27]): orig_sources= new_sources= 2024-09-12T17:49:19.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f23f3d75800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.27]): potential sources added=[] removed=[] 2024-09-12T17:49:19.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f23f3d75800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.27]): orig_dests= new_dests= 2024-09-12T17:49:19.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f23f3d75800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.27]): potential dests added=[] removed=[] 2024-09-12T17:49:19.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f23f3d75800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T17:49:19.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.389+0000 7f23f3d75800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:49:19.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.390+0000 7f23f3d75800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.27.1.0 2024-09-12T17:49:19.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.390+0000 7f23f3d75800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.27.1.0 2024-09-12T17:49:19.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.390+0000 7f23f3d75800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.27.1.1 2024-09-12T17:49:19.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.390+0000 7f23f3d75800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.27.1.1 2024-09-12T17:49:19.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.390+0000 7f23f3d75800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.27.0 2024-09-12T17:49:19.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.393+0000 7f23f3d75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:19.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.393+0000 7f23f3d75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 2024-09-12T17:49:19.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.394+0000 7f23f3d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 info.flags=0x17 2024-09-12T17:49:19.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.394+0000 7f23f3d75800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 to cache LRU end 2024-09-12T17:49:19.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.394+0000 7f23f3d75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:19.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.394+0000 7f23f3d75800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27, ofs0, ns] 2024-09-12T17:49:19.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.395+0000 7f22d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94330318672224 notifier 6410 bl.length()=991 2024-09-12T17:49:19.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.395+0000 7f22d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 info.flags=0x17 2024-09-12T17:49:19.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.395+0000 7f22d57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 to cache LRU end 2024-09-12T17:49:19.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.395+0000 7f22d57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:19.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.395+0000 7f23f3d75800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.27]): orig_sources= new_sources= 2024-09-12T17:49:19.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.395+0000 7f23f3d75800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.27]): potential sources added=[] removed=[] 2024-09-12T17:49:19.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.395+0000 7f23f3d75800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.27]): orig_dests= new_dests= 2024-09-12T17:49:19.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.395+0000 7f23f3d75800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.27]): potential dests added=[] removed=[] 2024-09-12T17:49:19.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.396+0000 7f23f3d75800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T17:49:19.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.398+0000 7f22a3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:19.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.400+0000 7f23f3d75800 20 remove_watcher() i=0 2024-09-12T17:49:19.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.400+0000 7f23f3d75800 2 removed watcher, disabling cache 2024-09-12T17:49:19.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.401+0000 7f23f3d75800 20 remove_watcher() i=1 2024-09-12T17:49:19.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.402+0000 7f23f3d75800 20 remove_watcher() i=2 2024-09-12T17:49:19.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.403+0000 7f23f3d75800 20 remove_watcher() i=3 2024-09-12T17:49:19.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.404+0000 7f23f3d75800 20 remove_watcher() i=4 2024-09-12T17:49:19.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.405+0000 7f23f3d75800 20 remove_watcher() i=5 2024-09-12T17:49:19.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.406+0000 7f23f3d75800 20 remove_watcher() i=6 2024-09-12T17:49:19.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.407+0000 7f23f3d75800 20 remove_watcher() i=7 2024-09-12T17:49:19.420 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:49:19.449 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:19.449 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:19.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.484+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.485+0000 7f73b2f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.485+0000 7f73b2f2d800 20 realm 2024-09-12T17:49:19.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.485+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.486+0000 7f73b2f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.486+0000 7f73b2f2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:19.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.486+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.486+0000 7f73b2f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.486+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.487+0000 7f73b2f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:19.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.487+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.487+0000 7f73b2f2d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:19.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.487+0000 7f73b2f2d800 20 searching for the correct realm 2024-09-12T17:49:19.491 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.491+0000 7f73a6475640 0 -- 172.21.15.107:0/3976658524 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f739806b100 msgr2=0x7f7398061080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:19.494 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.493+0000 7f73a6475640 0 -- 172.21.15.107:0/3976658524 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f7278086ba0 msgr2=0x7f7278088fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:19.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.497+0000 7f73b2f2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:19.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.497+0000 7f73b2f2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:19.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.497+0000 7f73b2f2d800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:19.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.497+0000 7f73b2f2d800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:19.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.497+0000 7f73b2f2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:19.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.497+0000 7f73b2f2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:19.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.497+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.497+0000 7f73b2f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.497+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.497+0000 7f73b2f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:19.499 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.497+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:19.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 20 zone default found 2024-09-12T17:49:19.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 4 Realm: () 2024-09-12T17:49:19.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:19.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:19.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:19.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 20 zonegroup default 2024-09-12T17:49:19.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 20 started sync module instance, tier type = 2024-09-12T17:49:19.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.498+0000 7f73b2f2d800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:19.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.507+0000 7f73b2f2d800 20 add_watcher() i=0 2024-09-12T17:49:19.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.507+0000 7f73b2f2d800 20 add_watcher() i=1 2024-09-12T17:49:19.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.507+0000 7f73b2f2d800 20 add_watcher() i=2 2024-09-12T17:49:19.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.507+0000 7f73b2f2d800 20 add_watcher() i=3 2024-09-12T17:49:19.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.507+0000 7f73b2f2d800 20 add_watcher() i=4 2024-09-12T17:49:19.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.507+0000 7f73b2f2d800 20 add_watcher() i=5 2024-09-12T17:49:19.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.507+0000 7f73b2f2d800 20 add_watcher() i=6 2024-09-12T17:49:19.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.508+0000 7f73b2f2d800 20 add_watcher() i=7 2024-09-12T17:49:19.509 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.508+0000 7f73b2f2d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:19.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.510+0000 7f72657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:19.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.510+0000 7f73b2f2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:19.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.510+0000 7f73b2f2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:19.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.510+0000 7f73b2f2d800 5 note: GC not initialized 2024-09-12T17:49:19.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.510+0000 7f71dffff640 20 reqs_thread_entry: start 2024-09-12T17:49:19.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.510+0000 7f73b2f2d800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:19.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.510+0000 7f73b2f2d800 20 Filter name: none 2024-09-12T17:49:19.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.511+0000 7f71ddffb640 20 reqs_thread_entry: start 2024-09-12T17:49:19.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.511+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.511+0000 7f73b2f2d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:19.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.511+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.511+0000 7f73b2f2d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:19.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.511+0000 7f73b2f2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:19.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.511+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.512+0000 7f73b2f2d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:19.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.512+0000 7f73b2f2d800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.512+0000 7f73b2f2d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:19.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.512+0000 7f73b2f2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:19.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.514+0000 7f72657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:19.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.516+0000 7f73b2f2d800 20 remove_watcher() i=0 2024-09-12T17:49:19.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.516+0000 7f73b2f2d800 2 removed watcher, disabling cache 2024-09-12T17:49:19.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.517+0000 7f73b2f2d800 20 remove_watcher() i=1 2024-09-12T17:49:19.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.517+0000 7f73b2f2d800 20 remove_watcher() i=2 2024-09-12T17:49:19.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.518+0000 7f73b2f2d800 20 remove_watcher() i=3 2024-09-12T17:49:19.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.519+0000 7f73b2f2d800 20 remove_watcher() i=4 2024-09-12T17:49:19.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.520+0000 7f73b2f2d800 20 remove_watcher() i=5 2024-09-12T17:49:19.522 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.521+0000 7f73b2f2d800 20 remove_watcher() i=6 2024-09-12T17:49:19.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.522+0000 7f73b2f2d800 20 remove_watcher() i=7 2024-09-12T17:49:19.533 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:19.533 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:19.533 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-trim-reshard-log-entries id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.27 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:49:19.534 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:19.552 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-09-12T17:49:19.551+0000 7fc7e3733640 -1 reset not still connected to 0x55eb1ab13d40 2024-09-12T17:49:19.595 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T17:49:19.595 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:19.780 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:49:19.808 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:19.809 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:19.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.843+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.845+0000 7f93ab213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.845+0000 7f93ab213800 20 realm 2024-09-12T17:49:19.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.845+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.845+0000 7f93ab213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.845+0000 7f93ab213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:19.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.845+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.845+0000 7f93ab213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.845+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.846+0000 7f93ab213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:19.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.846+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.847+0000 7f93ab213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:19.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.847+0000 7f93ab213800 20 searching for the correct realm 2024-09-12T17:49:19.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.849+0000 7f93a7149640 0 -- 172.21.15.107:0/3758987536 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x56237318a9a0 msgr2=0x56237318cdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:19.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.853+0000 7f93a6948640 0 -- 172.21.15.107:0/3758987536 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f93900a4240 msgr2=0x7f939006a2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:19.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.857+0000 7f93ab213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:19.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.857+0000 7f93ab213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.857+0000 7f93ab213800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.857+0000 7f93ab213800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.857+0000 7f93ab213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.857+0000 7f93ab213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.857+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.857+0000 7f93ab213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.857+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.857+0000 7f93ab213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.857+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 20 zone default found 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 4 Realm: () 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:19.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:19.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:19.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 20 zonegroup default 2024-09-12T17:49:19.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 20 started sync module instance, tier type = 2024-09-12T17:49:19.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.858+0000 7f93ab213800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:19.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.867+0000 7f93ab213800 20 add_watcher() i=0 2024-09-12T17:49:19.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.867+0000 7f93ab213800 20 add_watcher() i=1 2024-09-12T17:49:19.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.867+0000 7f93ab213800 20 add_watcher() i=2 2024-09-12T17:49:19.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.867+0000 7f93ab213800 20 add_watcher() i=3 2024-09-12T17:49:19.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.867+0000 7f93ab213800 20 add_watcher() i=4 2024-09-12T17:49:19.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.867+0000 7f93ab213800 20 add_watcher() i=5 2024-09-12T17:49:19.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.867+0000 7f93ab213800 20 add_watcher() i=6 2024-09-12T17:49:19.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.868+0000 7f93ab213800 20 add_watcher() i=7 2024-09-12T17:49:19.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.868+0000 7f93ab213800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:19.871 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.870+0000 7f925d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:19.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.870+0000 7f93ab213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:19.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.870+0000 7f93ab213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:19.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.870+0000 7f93ab213800 5 note: GC not initialized 2024-09-12T17:49:19.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.870+0000 7f91d7fff640 20 reqs_thread_entry: start 2024-09-12T17:49:19.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.870+0000 7f93ab213800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:19.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.870+0000 7f93ab213800 20 Filter name: none 2024-09-12T17:49:19.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.870+0000 7f91d5ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:19.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.871+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.871+0000 7f93ab213800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:19.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.871+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.872+0000 7f93ab213800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:19.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.872+0000 7f93ab213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:19.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.872+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.872+0000 7f93ab213800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:19.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.872+0000 7f93ab213800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.872+0000 7f93ab213800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:19.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.872+0000 7f93ab213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:19.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.873+0000 7f925d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:19.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.876+0000 7f93ab213800 20 remove_watcher() i=0 2024-09-12T17:49:19.877 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.876+0000 7f93ab213800 2 removed watcher, disabling cache 2024-09-12T17:49:19.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.877+0000 7f93ab213800 20 remove_watcher() i=1 2024-09-12T17:49:19.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.878+0000 7f93ab213800 20 remove_watcher() i=2 2024-09-12T17:49:19.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.879+0000 7f93ab213800 20 remove_watcher() i=3 2024-09-12T17:49:19.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.880+0000 7f93ab213800 20 remove_watcher() i=4 2024-09-12T17:49:19.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.881+0000 7f93ab213800 20 remove_watcher() i=5 2024-09-12T17:49:19.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.882+0000 7f93ab213800 20 remove_watcher() i=6 2024-09-12T17:49:19.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.883+0000 7f93ab213800 20 remove_watcher() i=7 2024-09-12T17:49:19.894 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:19.894 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:19.894 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-trim-reshard-log-entries id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:49:19.895 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:19.896 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T17:49:19.930 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:19.931 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:19.968 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.966+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 realm 2024-09-12T17:49:19.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.967+0000 7f66b6b3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:19.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.968+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.968+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.969+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:19.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.969+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.969+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:19.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.969+0000 7f66b6b3b800 20 searching for the correct realm 2024-09-12T17:49:19.973 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.972+0000 7f66b30bc640 0 -- 172.21.15.107:0/263125028 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x5585a6f1d940 msgr2=0x5585a6f1fe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:19.977 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.976+0000 7f66b28bb640 0 -- 172.21.15.107:0/263125028 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f66a802db90 msgr2=0x7f66a8051980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:19.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:19.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:19.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:19.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 zone default found 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 4 Realm: () 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:19.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 zonegroup default 2024-09-12T17:49:19.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.981+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.981+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:19.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.981+0000 7f66b6b3b800 20 started sync module instance, tier type = 2024-09-12T17:49:19.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.981+0000 7f66b6b3b800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:19.990 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=0 2024-09-12T17:49:19.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=1 2024-09-12T17:49:19.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=2 2024-09-12T17:49:19.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=3 2024-09-12T17:49:19.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=4 2024-09-12T17:49:19.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=5 2024-09-12T17:49:19.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=6 2024-09-12T17:49:19.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.990+0000 7f66b6b3b800 20 add_watcher() i=7 2024-09-12T17:49:19.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.990+0000 7f66b6b3b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:19.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.992+0000 7f65697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:19.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.992+0000 7f66b6b3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:19.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.992+0000 7f66b6b3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:19.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 note: GC not initialized 2024-09-12T17:49:19.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.992+0000 7f64e3fff640 20 reqs_thread_entry: start 2024-09-12T17:49:19.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:19.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 Filter name: none 2024-09-12T17:49:19.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.993+0000 7f64e1ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:19.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.993+0000 7f66b6b3b800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:49:19.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:19.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.993+0000 7f66b6b3b800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:49:19.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.993+0000 7f66b6b3b800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:49:19.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.993+0000 7f66b6b3b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 : miss 2024-09-12T17:49:19.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:19.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.994+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:19.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:19.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:19.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:19.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:19.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 2024-09-12T17:49:19.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.997+0000 7f66b6b3b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:19.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.997+0000 7f66b6b3b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:19.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.997+0000 7f66b6b3b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:19.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.997+0000 7f66b6b3b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28, ofs0, ns] 2024-09-12T17:49:19.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.998+0000 7f65967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 94032519957568 notifier 6834 bl.length()=1023 2024-09-12T17:49:19.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.998+0000 7f65967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:19.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.998+0000 7f65967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:19.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.998+0000 7f65967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:20.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.998+0000 7f66b6b3b800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): orig_sources= new_sources= 2024-09-12T17:49:20.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.998+0000 7f66b6b3b800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): potential sources added=[] removed=[] 2024-09-12T17:49:20.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.998+0000 7f66b6b3b800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): orig_dests= new_dests= 2024-09-12T17:49:20.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.998+0000 7f66b6b3b800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): potential dests added=[] removed=[] 2024-09-12T17:49:20.001 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f66b6b3b800 time 2024-09-12T17:49:19.999432+0000 2024-09-12T17:49:20.001 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:49:20.001 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:20.001 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f66b838c71a] 2024-09-12T17:49:20.001 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f66b838c8d8] 2024-09-12T17:49:20.001 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5585a4da7841] 2024-09-12T17:49:20.001 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd7489e) [0x5585a52b589e] 2024-09-12T17:49:20.001 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5585a4db750d] 2024-09-12T17:49:20.001 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:49:20.002 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f66b7029590] 2024-09-12T17:49:20.002 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:49:20.002 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:49:20.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:19.999+0000 7f66b6b3b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f66b6b3b800 time 2024-09-12T17:49:19.999432+0000 2024-09-12T17:49:20.002 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:49:20.002 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.002 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:20.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f66b838c71a] 2024-09-12T17:49:20.002 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f66b838c8d8] 2024-09-12T17:49:20.002 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5585a4da7841] 2024-09-12T17:49:20.002 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd7489e) [0x5585a52b589e] 2024-09-12T17:49:20.002 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5585a4db750d] 2024-09-12T17:49:20.003 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:49:20.003 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f66b7029590] 2024-09-12T17:49:20.003 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:49:20.003 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:49:20.003 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.003 INFO:tasks.workunit.client.0.smithi107.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:49:20.003 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f66b6b3b800 thread_name:radosgw-admin 2024-09-12T17:49:20.030 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:20.030 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f66b703e6f0] 2024-09-12T17:49:20.030 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f66b708b99c] 2024-09-12T17:49:20.030 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:49:20.030 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:49:20.030 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f66b838c774] 2024-09-12T17:49:20.031 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f66b838c8d8] 2024-09-12T17:49:20.031 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5585a4da7841] 2024-09-12T17:49:20.031 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd7489e) [0x5585a52b589e] 2024-09-12T17:49:20.031 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5585a4db750d] 2024-09-12T17:49:20.031 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:49:20.031 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f66b7029590] 2024-09-12T17:49:20.031 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:49:20.031 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:49:20.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.000+0000 7f66b6b3b800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:49:20.031 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f66b6b3b800 thread_name:radosgw-admin 2024-09-12T17:49:20.031 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.031 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:20.032 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f66b703e6f0] 2024-09-12T17:49:20.032 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f66b708b99c] 2024-09-12T17:49:20.032 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:49:20.032 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:49:20.032 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f66b838c774] 2024-09-12T17:49:20.032 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f66b838c8d8] 2024-09-12T17:49:20.032 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5585a4da7841] 2024-09-12T17:49:20.032 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd7489e) [0x5585a52b589e] 2024-09-12T17:49:20.032 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5585a4db750d] 2024-09-12T17:49:20.032 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:49:20.032 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f66b7029590] 2024-09-12T17:49:20.033 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:49:20.033 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:49:20.033 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:49:20.033 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.033 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:49:20.033 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:49:20.033 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: dump: 2024-09-12T17:49:20.033 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.034 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.034 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.034 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.034 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.034 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.034 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.034 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.034 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.035 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.035 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: _finish_auth 0 2024-09-12T17:49:20.035 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: _check_auth_tickets 2024-09-12T17:49:20.035 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:20.035 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.035 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:49:20.035 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: dump: 2024-09-12T17:49:20.035 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.035 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.035 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.035 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.035 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.036 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.036 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.036 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.036 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.036 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.036 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:49:19.949+0000 7f66b6b3b800 5 monclient: authenticate success, global_id 6449 2024-09-12T17:49:20.036 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:49:19.949+0000 7f66b6b3b800 10 monclient: get_monmap_and_config success 2024-09-12T17:49:20.036 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:49:19.949+0000 7f66b6b3b800 4 set_mon_vals no callback set 2024-09-12T17:49:20.036 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 10 monclient: shutdown 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 asok(0x5585a6c11730) unregister_commands rotate-key 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 10 monclient: build_initial_monmap 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 1 build_initial for_mkfs: 0 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 10 monclient: monmap: 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:20.037 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding auth protocol: cephx 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding auth protocol: cephx 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding auth protocol: cephx 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: secure 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: crc 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: secure 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: crc 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: secure 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: crc 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: crc 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: secure 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: crc 2024-09-12T17:49:20.038 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: secure 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: crc 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: secure 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 1 librados: starting msgr at 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 1 librados: starting objecter 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command objecter_requests hook 0x5585a6e609e0 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 1 librados: setting wanted keys 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 1 librados: calling monclient init 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 10 monclient: init 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding auth protocol: cephx 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding auth protocol: cephx 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding auth protocol: cephx 2024-09-12T17:49:20.039 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: secure 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: crc 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: secure 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: crc 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: secure 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: crc 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: crc 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: secure 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: crc 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: secure 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: crc 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: secure 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.040 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command rotate-key hook 0x5585a6e32b68 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-a con 0x5585a6ce0510 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-b con 0x5585a6d75f80 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-c con 0x5585a6d7c4a0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): authenticate will time out at 1964.497361s 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): get_auth_request con 0x5585a6ce0510 auth_method 0 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.041 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): get_auth_request con 0x5585a6d7c4a0 auth_method 0 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): handle_auth_done global_id 6452 payload 824 2024-09-12T17:49:20.042 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient: _finish_hunting 0 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:49:19.951+0000 7f66b30bc640 1 monclient: found mon.noname-c 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:49:19.951+0000 7f66b20ba640 10 monclient: get_auth_request con 0x5585a6d75f80 auth_method 0 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:49:19.951+0000 7f659f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:49:19.951+0000 7f659f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:49:19.951+0000 7f659f606640 10 monclient: dump: 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.043 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:49:19.951+0000 7f659f606640 10 monclient: _finish_auth 0 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:49:19.951+0000 7f659f606640 10 monclient: _check_auth_tickets 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:49:19.951+0000 7f659f606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:49:19.952+0000 7f659f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:49:19.952+0000 7f659f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:49:19.952+0000 7f659f606640 10 monclient: dump: 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.044 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.045 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.045 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.045 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.045 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.045 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.045 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:49:19.952+0000 7f66b6b3b800 5 monclient: authenticate success, global_id 6452 2024-09-12T17:49:20.045 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:49:19.952+0000 7f66b6b3b800 10 monclient: _renew_subs 2024-09-12T17:49:20.045 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:49:19.952+0000 7f65a0e09640 4 set_mon_vals no callback set 2024-09-12T17:49:20.045 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:49:19.952+0000 7f66b6b3b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:20.045 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:49:19.952+0000 7f66b6b3b800 10 monclient: _renew_subs 2024-09-12T17:49:20.045 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:49:19.952+0000 7f66b6b3b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:20.045 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:49:19.952+0000 7f66b6b3b800 1 librados: init done 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:49:19.953+0000 7f659f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:49:19.953+0000 7f659f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:49:19.953+0000 7f659f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:49:19.954+0000 7f66b28bb640 10 monclient: get_auth_request con 0x7f65980764a0 auth_method 0 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:49:19.954+0000 7f66b20ba640 10 monclient: get_auth_request con 0x5585a6e5a7a0 auth_method 0 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:49:19.954+0000 7f66b28bb640 10 monclient: get_auth_request con 0x5585a6e7ea60 auth_method 0 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:49:19.955+0000 7f66b20ba640 10 monclient: get_auth_request con 0x5585a6e83100 auth_method 0 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 10 monclient: build_initial_monmap 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 1 build_initial for_mkfs: 0 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 10 monclient: monmap: 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:20.046 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding auth protocol: cephx 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding auth protocol: cephx 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding auth protocol: cephx 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: secure 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: crc 2024-09-12T17:49:20.047 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: secure 2024-09-12T17:49:20.048 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: crc 2024-09-12T17:49:20.048 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: secure 2024-09-12T17:49:20.048 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: crc 2024-09-12T17:49:20.048 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: crc 2024-09-12T17:49:20.048 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: secure 2024-09-12T17:49:20.048 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: crc 2024-09-12T17:49:20.048 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: secure 2024-09-12T17:49:20.048 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: crc 2024-09-12T17:49:20.048 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: secure 2024-09-12T17:49:20.048 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.048 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command objecter_requests cmddesc objecter_requests hook 0x5585a6e8b330 EEXIST 2024-09-12T17:49:20.048 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 10 monclient: init 2024-09-12T17:49:20.049 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding auth protocol: cephx 2024-09-12T17:49:20.049 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding auth protocol: cephx 2024-09-12T17:49:20.049 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding auth protocol: cephx 2024-09-12T17:49:20.049 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: secure 2024-09-12T17:49:20.049 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: crc 2024-09-12T17:49:20.049 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: secure 2024-09-12T17:49:20.049 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: crc 2024-09-12T17:49:20.049 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: secure 2024-09-12T17:49:20.049 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: crc 2024-09-12T17:49:20.049 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: crc 2024-09-12T17:49:20.049 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: secure 2024-09-12T17:49:20.049 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: crc 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: secure 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: crc 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: secure 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command rotate-key cmddesc rotate-key hook 0x5585a6e86640 EEXIST 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-a con 0x5585a6eaf650 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-c con 0x5585a6eafa30 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-b con 0x5585a6eae360 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.050 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): authenticate will time out at 1964.504267s 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): get_auth_request con 0x5585a6eaf650 auth_method 0 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): get_auth_request con 0x5585a6eafa30 auth_method 0 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.051 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): get_auth_request con 0x5585a6eae360 auth_method 0 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): handle_auth_done global_id 6828 payload 824 2024-09-12T17:49:20.052 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient: _finish_hunting 0 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:49:19.958+0000 7f66b28bb640 1 monclient: found mon.noname-a 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: dump: 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.053 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: _finish_auth 0 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: _check_auth_tickets 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: dump: 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.054 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.055 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.055 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.055 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.055 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.055 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.055 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 5 monclient: authenticate success, global_id 6828 2024-09-12T17:49:20.055 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient: _renew_subs 2024-09-12T17:49:20.055 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.055 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:49:19.958+0000 7f66b38bd640 4 set_mon_vals no callback set 2024-09-12T17:49:20.055 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient: _renew_subs 2024-09-12T17:49:20.055 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.055 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:49:19.960+0000 7f659ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:49:19.960+0000 7f659ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:49:19.960+0000 7f659ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:49:19.960+0000 7f66b20ba640 10 monclient: get_auth_request con 0x7f658c076380 auth_method 0 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 10 monclient: get_monmap_and_config 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 10 monclient: build_initial_monmap 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 1 build_initial for_mkfs: 0 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 10 monclient: monmap: 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:20.056 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding auth protocol: cephx 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding auth protocol: cephx 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding auth protocol: cephx 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: secure 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: crc 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: secure 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: crc 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: secure 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: crc 2024-09-12T17:49:20.057 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: crc 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: secure 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: crc 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: secure 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: crc 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: secure 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 10 monclient: init 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding auth protocol: cephx 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding auth protocol: cephx 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding auth protocol: cephx 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: secure 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: crc 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: secure 2024-09-12T17:49:20.058 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: crc 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: secure 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: crc 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: crc 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: secure 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: crc 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: secure 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: crc 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: secure 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command rotate-key cmddesc rotate-key hook 0x7ffd71611e68 EEXIST 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:49:20.059 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-a con 0x5585a6f03bc0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:20.060 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-b con 0x5585a6ed4bd0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:20.060 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-c con 0x5585a6eff0a0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:20.060 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.060 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.060 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.060 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:20.060 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): authenticate will time out at 1964.508072s 2024-09-12T17:49:20.060 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): get_auth_request con 0x5585a6f03bc0 auth_method 0 2024-09-12T17:49:20.060 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.060 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.060 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.060 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): get_auth_request con 0x5585a6eff0a0 auth_method 0 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): handle_auth_done global_id 6831 payload 274 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient: _finish_hunting 0 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:49:19.962+0000 7f66b28bb640 1 monclient: found mon.noname-a 2024-09-12T17:49:20.061 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.062 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.062 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:49:20.062 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: dump: 2024-09-12T17:49:20.062 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.062 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.062 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.062 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.062 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.062 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.062 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.062 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.062 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: _finish_auth 0 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: _check_auth_tickets 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: dump: 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.063 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 5 monclient: authenticate success, global_id 6831 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient: get_monmap_and_config success 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 4 set_mon_vals no callback set 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 10 monclient: shutdown 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 10 monclient: build_initial_monmap 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 1 build_initial for_mkfs: 0 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 10 monclient: monmap: 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:20.064 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:20.065 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:20.065 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:20.065 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:20.065 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.065 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:20.065 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:20.065 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:20.065 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.065 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding auth protocol: cephx 2024-09-12T17:49:20.065 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding auth protocol: cephx 2024-09-12T17:49:20.066 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding auth protocol: cephx 2024-09-12T17:49:20.066 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: secure 2024-09-12T17:49:20.066 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: crc 2024-09-12T17:49:20.066 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: secure 2024-09-12T17:49:20.066 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: crc 2024-09-12T17:49:20.066 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: secure 2024-09-12T17:49:20.066 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: crc 2024-09-12T17:49:20.066 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: crc 2024-09-12T17:49:20.066 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: secure 2024-09-12T17:49:20.066 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: crc 2024-09-12T17:49:20.066 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: secure 2024-09-12T17:49:20.066 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: crc 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: secure 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 1 librados: starting msgr at 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 1 librados: starting objecter 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command objecter_requests cmddesc objecter_requests hook 0x5585a6eb1430 EEXIST 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 1 librados: setting wanted keys 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 1 librados: calling monclient init 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 10 monclient: init 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding auth protocol: cephx 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding auth protocol: cephx 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding auth protocol: cephx 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: secure 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: crc 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: secure 2024-09-12T17:49:20.067 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: crc 2024-09-12T17:49:20.068 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: secure 2024-09-12T17:49:20.068 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: crc 2024-09-12T17:49:20.068 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: crc 2024-09-12T17:49:20.068 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: secure 2024-09-12T17:49:20.068 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: crc 2024-09-12T17:49:20.068 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: secure 2024-09-12T17:49:20.068 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: crc 2024-09-12T17:49:20.068 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: secure 2024-09-12T17:49:20.068 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.068 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.068 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command rotate-key cmddesc rotate-key hook 0x5585a6ec4058 EEXIST 2024-09-12T17:49:20.068 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-a con 0x5585a6ed4bd0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-c con 0x5585a6eff0a0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-b con 0x5585a6f03bc0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): authenticate will time out at 1964.510301s 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): get_auth_request con 0x5585a6ed4bd0 auth_method 0 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.069 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.070 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.070 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.070 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.070 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): get_auth_request con 0x5585a6eff0a0 auth_method 0 2024-09-12T17:49:20.070 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.070 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.070 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.070 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:49:19.964+0000 7f66b30bc640 10 monclient(hunting): get_auth_request con 0x5585a6f03bc0 auth_method 0 2024-09-12T17:49:20.070 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:49:19.964+0000 7f66b30bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.070 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:49:19.964+0000 7f66b30bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.070 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:49:19.964+0000 7f66b30bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.070 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.071 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.071 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.071 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): handle_auth_done global_id 6834 payload 824 2024-09-12T17:49:20.071 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient: _finish_hunting 0 2024-09-12T17:49:20.071 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:49:19.964+0000 7f66b28bb640 1 monclient: found mon.noname-a 2024-09-12T17:49:20.071 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.071 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.071 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:49:20.071 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: dump: 2024-09-12T17:49:20.071 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.071 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.071 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: _finish_auth 0 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 5 monclient: authenticate success, global_id 6834 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.072 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: dump: 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient: _renew_subs 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:49:19.964+0000 7f65967fc640 4 set_mon_vals no callback set 2024-09-12T17:49:20.073 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient: _renew_subs 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:49:19.965+0000 7f66b6b3b800 1 librados: init done 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:49:19.965+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command cr dump hook 0x5585a6ef07b8 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:49:19.966+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:49:19.966+0000 7f6594ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:49:19.966+0000 7f6594ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:49:19.966+0000 7f6594ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:49:19.967+0000 7f66b20ba640 10 monclient: get_auth_request con 0x7f657c0764a0 auth_method 0 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:49:19.967+0000 7f66b30bc640 10 monclient: get_auth_request con 0x5585a6f1d940 auth_method 0 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 realm 2024-09-12T17:49:20.074 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:49:19.967+0000 7f66b6b3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:49:19.968+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:49:19.968+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:49:19.968+0000 7f66b28bb640 10 monclient: get_auth_request con 0x5585a6f21bb0 auth_method 0 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:49:19.969+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:49:19.969+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:49:19.969+0000 7f66b20ba640 10 monclient: get_auth_request con 0x5585a6f25410 auth_method 0 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:49:19.969+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:49:19.969+0000 7f66b6b3b800 20 searching for the correct realm 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:49:19.969+0000 7f66b30bc640 10 monclient: get_auth_request con 0x5585a6f2a080 auth_method 0 2024-09-12T17:49:20.075 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:49:19.970+0000 7f66b28bb640 10 monclient: get_auth_request con 0x7f66ac022070 auth_method 0 2024-09-12T17:49:20.076 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:49:19.971+0000 7f66b20ba640 10 monclient: get_auth_request con 0x7f66a803a040 auth_method 0 2024-09-12T17:49:20.076 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:49:19.972+0000 7f66b30bc640 0 -- 172.21.15.107:0/263125028 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x5585a6f1d940 msgr2=0x5585a6f1fe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:20.076 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:49:19.972+0000 7f6594ff9640 1 client.6834.objecter ms_handle_reset 0x5585a6f1d940 session 0x5585a6f1d270 osd.1 2024-09-12T17:49:20.076 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:49:19.972+0000 7f6594ff9640 10 monclient: _renew_subs 2024-09-12T17:49:20.076 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:49:19.972+0000 7f6594ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.076 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:49:19.972+0000 7f66b30bc640 10 monclient: get_auth_request con 0x7f657c086bd0 auth_method 0 2024-09-12T17:49:20.076 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:49:19.973+0000 7f66b30bc640 10 monclient: get_auth_request con 0x7f66a802d050 auth_method 0 2024-09-12T17:49:20.076 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:49:19.975+0000 7f66b28bb640 10 monclient: get_auth_request con 0x7f66a802db90 auth_method 0 2024-09-12T17:49:20.076 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:49:19.976+0000 7f66b28bb640 0 -- 172.21.15.107:0/263125028 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f66a802db90 msgr2=0x7f66a8051980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:49:19.976+0000 7f6594ff9640 1 client.6834.objecter ms_handle_reset 0x7f66a802db90 session 0x7f66a803ae70 osd.0 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:49:19.976+0000 7f66b28bb640 10 monclient: get_auth_request con 0x5585a6f1d940 auth_method 0 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:20.077 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.078 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:20.078 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 zone default found 2024-09-12T17:49:20.078 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 4 Realm: () 2024-09-12T17:49:20.078 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:20.078 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:20.078 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:20.078 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 zonegroup default 2024-09-12T17:49:20.078 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.078 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.078 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.078 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:49:19.981+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:49:19.981+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:49:19.981+0000 7f66b6b3b800 20 started sync module instance, tier type = 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:49:19.981+0000 7f66b6b3b800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=0 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=1 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=2 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=3 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=4 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=5 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=6 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:49:19.990+0000 7f66b6b3b800 20 add_watcher() i=7 2024-09-12T17:49:20.079 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:49:19.990+0000 7f66b6b3b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding auth protocol: cephx 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding auth protocol: cephx 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding auth protocol: cephx 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: secure 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: crc 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: secure 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: crc 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: secure 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: crc 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: crc 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: secure 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: crc 2024-09-12T17:49:20.080 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: secure 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: crc 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:49:19.992+0000 7f65697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: secure 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command cache list hook 0x5585a6ef1fe0 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command cache inspect hook 0x5585a6ef1fe0 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command cache erase hook 0x5585a6ef1fe0 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command cache zap hook 0x5585a6ef1fe0 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 note: GC not initialized 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:49:19.992+0000 7f64e3fff640 20 reqs_thread_entry: start 2024-09-12T17:49:20.081 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command sync trace show hook 0x7f66a4087020 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command sync trace history hook 0x7f66a4087020 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command sync trace active hook 0x7f66a4087020 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command sync trace active_short hook 0x7f66a4087020 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 Filter name: none 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:49:19.993+0000 7f64e1ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 : miss 2024-09-12T17:49:20.082 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:49:19.994+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:49:19.997+0000 7f66b6b3b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:49:19.997+0000 7f66b6b3b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:49:19.997+0000 7f66b6b3b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:49:19.997+0000 7f66b6b3b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28, ofs0, ns] 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:49:19.998+0000 7f65967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 94032519957568 notifier 6834 bl.length()=1023 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:49:19.998+0000 7f65967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:20.083 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:49:19.998+0000 7f65967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:49:19.998+0000 7f65967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:49:19.998+0000 7f66b6b3b800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): orig_sources= new_sources= 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:49:19.998+0000 7f66b6b3b800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): potential sources added=[] removed=[] 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:49:19.998+0000 7f66b6b3b800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): orig_dests= new_dests= 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:49:19.998+0000 7f66b6b3b800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): potential dests added=[] removed=[] 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:49:19.999+0000 7f66b6b3b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f66b6b3b800 time 2024-09-12T17:49:19.999432+0000 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f66b838c71a] 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f66b838c8d8] 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5585a4da7841] 2024-09-12T17:49:20.084 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd7489e) [0x5585a52b589e] 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5585a4db750d] 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f66b7029590] 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:49:20.000+0000 7f66b6b3b800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f66b6b3b800 thread_name:radosgw-admin 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f66b703e6f0] 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f66b708b99c] 2024-09-12T17:49:20.085 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f66b838c774] 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f66b838c8d8] 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5585a4da7841] 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd7489e) [0x5585a52b589e] 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5585a4db750d] 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f66b7029590] 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:49:20.086 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:49:20.087 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:49:20.088 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:49:20.089 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:49:20.090 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:49:20.091 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:49:20.092 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:49:20.093 INFO:tasks.workunit.client.0.smithi107.stderr: 7f64e1ffb640 / http_manager 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: 7f64e3fff640 / http_manager 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: 7f65697e2640 / rgw_dt_lg_renew 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: 7f6594ff9640 / ms_dispatch 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: 7f65967fc640 / io_context_pool 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: 7f659ce01640 / ms_dispatch 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: 7f659f606640 / ms_dispatch 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: 7f65a0e09640 / io_context_pool 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: 7f66b20ba640 / msgr-worker-2 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: 7f66b28bb640 / msgr-worker-1 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: 7f66b30bc640 / msgr-worker-0 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: 7f66b38bd640 / io_context_pool 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: 7f66b6b3b800 / radosgw-admin 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:49:20.094 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/log/ceph/ceph-client.admin.107131.log 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: dump: 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.095 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: _finish_auth 0 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: _check_auth_tickets 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:49:19.949+0000 7f65a0e09640 10 monclient: dump: 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.096 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:49:19.949+0000 7f66b6b3b800 5 monclient: authenticate success, global_id 6449 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:49:19.949+0000 7f66b6b3b800 10 monclient: get_monmap_and_config success 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:49:19.949+0000 7f66b6b3b800 4 set_mon_vals no callback set 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 10 monclient: shutdown 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 asok(0x5585a6c11730) unregister_commands rotate-key 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 10 monclient: build_initial_monmap 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 1 build_initial for_mkfs: 0 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 10 monclient: monmap: 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:20.097 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:20.098 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:20.098 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:20.098 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:20.098 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.098 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:20.098 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:20.098 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:20.098 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.098 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding auth protocol: cephx 2024-09-12T17:49:20.098 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding auth protocol: cephx 2024-09-12T17:49:20.098 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding auth protocol: cephx 2024-09-12T17:49:20.098 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: secure 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: crc 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: secure 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: crc 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: secure 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: crc 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: crc 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: secure 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: crc 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: secure 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: crc 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e381c0) adding con mode: secure 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.099 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 1 librados: starting msgr at 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 1 librados: starting objecter 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command objecter_requests hook 0x5585a6e609e0 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 1 librados: setting wanted keys 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 1 librados: calling monclient init 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 10 monclient: init 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding auth protocol: cephx 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding auth protocol: cephx 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding auth protocol: cephx 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: secure 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: crc 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: secure 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: crc 2024-09-12T17:49:20.100 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: secure 2024-09-12T17:49:20.101 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: crc 2024-09-12T17:49:20.101 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: crc 2024-09-12T17:49:20.101 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: secure 2024-09-12T17:49:20.101 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: crc 2024-09-12T17:49:20.101 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: secure 2024-09-12T17:49:20.101 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: crc 2024-09-12T17:49:20.101 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:49:19.950+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e32a20) adding con mode: secure 2024-09-12T17:49:20.101 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.101 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.101 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command rotate-key hook 0x5585a6e32b68 2024-09-12T17:49:20.101 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:20.101 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-a con 0x5585a6ce0510 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-b con 0x5585a6d75f80 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-c con 0x5585a6d7c4a0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:49:19.951+0000 7f66b6b3b800 10 monclient(hunting): authenticate will time out at 1964.497361s 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): get_auth_request con 0x5585a6ce0510 auth_method 0 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): get_auth_request con 0x5585a6d7c4a0 auth_method 0 2024-09-12T17:49:20.102 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:49:19.951+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient(hunting): handle_auth_done global_id 6452 payload 824 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient: _finish_hunting 0 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:49:19.951+0000 7f66b30bc640 1 monclient: found mon.noname-c 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:49:19.951+0000 7f66b30bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:49:19.951+0000 7f66b20ba640 10 monclient: get_auth_request con 0x5585a6d75f80 auth_method 0 2024-09-12T17:49:20.103 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:49:19.951+0000 7f659f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.104 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:49:19.951+0000 7f659f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:49:20.104 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:49:19.951+0000 7f659f606640 10 monclient: dump: 2024-09-12T17:49:20.104 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.104 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.104 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.104 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.104 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.104 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.104 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.104 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.104 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.104 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:49:19.951+0000 7f659f606640 10 monclient: _finish_auth 0 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:49:19.951+0000 7f659f606640 10 monclient: _check_auth_tickets 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:49:19.951+0000 7f659f606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:49:19.952+0000 7f659f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:49:19.952+0000 7f659f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:49:19.952+0000 7f659f606640 10 monclient: dump: 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.105 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:49:19.952+0000 7f66b6b3b800 5 monclient: authenticate success, global_id 6452 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:49:19.952+0000 7f66b6b3b800 10 monclient: _renew_subs 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:49:19.952+0000 7f65a0e09640 4 set_mon_vals no callback set 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:49:19.952+0000 7f66b6b3b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:49:19.952+0000 7f66b6b3b800 10 monclient: _renew_subs 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:49:19.952+0000 7f66b6b3b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:49:19.952+0000 7f66b6b3b800 1 librados: init done 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:49:19.953+0000 7f659f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:49:19.953+0000 7f659f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:49:19.953+0000 7f659f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:49:19.954+0000 7f66b28bb640 10 monclient: get_auth_request con 0x7f65980764a0 auth_method 0 2024-09-12T17:49:20.106 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:49:19.954+0000 7f66b20ba640 10 monclient: get_auth_request con 0x5585a6e5a7a0 auth_method 0 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:49:19.954+0000 7f66b28bb640 10 monclient: get_auth_request con 0x5585a6e7ea60 auth_method 0 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:49:19.955+0000 7f66b20ba640 10 monclient: get_auth_request con 0x5585a6e83100 auth_method 0 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 10 monclient: build_initial_monmap 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 1 build_initial for_mkfs: 0 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 10 monclient: monmap: 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:20.107 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding auth protocol: cephx 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding auth protocol: cephx 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding auth protocol: cephx 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: secure 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: crc 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: secure 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: crc 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: secure 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: crc 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: crc 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: secure 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: crc 2024-09-12T17:49:20.108 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: secure 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: crc 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:49:19.956+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e87e20) adding con mode: secure 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command objecter_requests cmddesc objecter_requests hook 0x5585a6e8b330 EEXIST 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 10 monclient: init 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding auth protocol: cephx 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding auth protocol: cephx 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding auth protocol: cephx 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: secure 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: crc 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: secure 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: crc 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: secure 2024-09-12T17:49:20.109 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: crc 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: crc 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: secure 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: crc 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: secure 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: crc 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6e864f8) adding con mode: secure 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:49:19.957+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command rotate-key cmddesc rotate-key hook 0x5585a6e86640 EEXIST 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-a con 0x5585a6eaf650 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-c con 0x5585a6eafa30 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-b con 0x5585a6eae360 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:20.110 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient(hunting): authenticate will time out at 1964.504267s 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): get_auth_request con 0x5585a6eaf650 auth_method 0 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): get_auth_request con 0x5585a6eafa30 auth_method 0 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.111 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:49:19.958+0000 7f66b20ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): get_auth_request con 0x5585a6eae360 auth_method 0 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:49:19.958+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient(hunting): handle_auth_done global_id 6828 payload 824 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient: _finish_hunting 0 2024-09-12T17:49:20.112 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:49:19.958+0000 7f66b28bb640 1 monclient: found mon.noname-a 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:49:19.958+0000 7f66b28bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: dump: 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.113 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: _finish_auth 0 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: _check_auth_tickets 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:49:19.958+0000 7f659ce01640 10 monclient: dump: 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.114 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 5 monclient: authenticate success, global_id 6828 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient: _renew_subs 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:49:19.958+0000 7f66b38bd640 4 set_mon_vals no callback set 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient: _renew_subs 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:49:19.958+0000 7f66b6b3b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:49:19.960+0000 7f659ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:49:19.960+0000 7f659ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:49:19.960+0000 7f659ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:20.115 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:49:19.960+0000 7f66b20ba640 10 monclient: get_auth_request con 0x7f658c076380 auth_method 0 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 10 monclient: get_monmap_and_config 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 10 monclient: build_initial_monmap 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 1 build_initial for_mkfs: 0 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 10 monclient: monmap: 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:20.116 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding auth protocol: cephx 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding auth protocol: cephx 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding auth protocol: cephx 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: secure 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: crc 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: secure 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: crc 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: secure 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: crc 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: crc 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: secure 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: crc 2024-09-12T17:49:20.117 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: secure 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: crc 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ecf560) adding con mode: secure 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 10 monclient: init 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding auth protocol: cephx 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding auth protocol: cephx 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding auth protocol: cephx 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: secure 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: crc 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: secure 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: crc 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: secure 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: crc 2024-09-12T17:49:20.118 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: crc 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: secure 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: crc 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: secure 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: crc 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd71611d20) adding con mode: secure 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:49:19.961+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command rotate-key cmddesc rotate-key hook 0x7ffd71611e68 EEXIST 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-a con 0x5585a6f03bc0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-b con 0x5585a6ed4bd0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:20.119 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-c con 0x5585a6eff0a0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient(hunting): authenticate will time out at 1964.508072s 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): get_auth_request con 0x5585a6f03bc0 auth_method 0 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): get_auth_request con 0x5585a6eff0a0 auth_method 0 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.120 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:49:19.962+0000 7f66b30bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient(hunting): handle_auth_done global_id 6831 payload 274 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient: _finish_hunting 0 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:49:19.962+0000 7f66b28bb640 1 monclient: found mon.noname-a 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:49:19.962+0000 7f66b28bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: dump: 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.121 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: _finish_auth 0 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: _check_auth_tickets 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:49:20.122 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:49:19.962+0000 7f65967fc640 10 monclient: dump: 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 5 monclient: authenticate success, global_id 6831 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 10 monclient: get_monmap_and_config success 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:49:19.962+0000 7f66b6b3b800 4 set_mon_vals no callback set 2024-09-12T17:49:20.123 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 10 monclient: shutdown 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 10 monclient: build_initial_monmap 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 1 build_initial for_mkfs: 0 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 10 monclient: monmap: 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.124 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding auth protocol: cephx 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding auth protocol: cephx 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding auth protocol: cephx 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: secure 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: crc 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: secure 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: crc 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: secure 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: crc 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: crc 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: secure 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: crc 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: secure 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: crc 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ef57f0) adding con mode: secure 2024-09-12T17:49:20.125 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 1 librados: starting msgr at 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 1 librados: starting objecter 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command objecter_requests cmddesc objecter_requests hook 0x5585a6eb1430 EEXIST 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 1 librados: setting wanted keys 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 1 librados: calling monclient init 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 10 monclient: init 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding auth protocol: cephx 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding auth protocol: cephx 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding auth protocol: cephx 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: secure 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: crc 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: secure 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: crc 2024-09-12T17:49:20.126 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: secure 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: crc 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: crc 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: secure 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: crc 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: secure 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: crc 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 5 AuthRegistry(0x5585a6ec3f10) adding con mode: secure 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:49:19.963+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command rotate-key cmddesc rotate-key hook 0x5585a6ec4058 EEXIST 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-a con 0x5585a6ed4bd0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-c con 0x5585a6eff0a0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:20.127 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): picked mon.noname-b con 0x5585a6f03bc0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient(hunting): authenticate will time out at 1964.510301s 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): get_auth_request con 0x5585a6ed4bd0 auth_method 0 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.128 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): get_auth_request con 0x5585a6eff0a0 auth_method 0 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:49:19.964+0000 7f66b30bc640 10 monclient(hunting): get_auth_request con 0x5585a6f03bc0 auth_method 0 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:49:19.964+0000 7f66b30bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:49:19.964+0000 7f66b30bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:49:19.964+0000 7f66b30bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:49:19.964+0000 7f66b20ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient(hunting): handle_auth_done global_id 6834 payload 824 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient: _finish_hunting 0 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:49:19.964+0000 7f66b28bb640 1 monclient: found mon.noname-a 2024-09-12T17:49:20.129 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:49:19.964+0000 7f66b28bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: dump: 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.130 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: _finish_auth 0 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 5 monclient: authenticate success, global_id 6834 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:49:19.964+0000 7f6594ff9640 10 monclient: dump: 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:20.131 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient: _renew_subs 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:49:19.964+0000 7f65967fc640 4 set_mon_vals no callback set 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient: _renew_subs 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:49:19.964+0000 7f66b6b3b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:49:19.965+0000 7f66b6b3b800 1 librados: init done 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:49:19.965+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command cr dump hook 0x5585a6ef07b8 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:49:19.966+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:49:19.966+0000 7f6594ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:49:19.966+0000 7f6594ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:20.132 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:49:19.966+0000 7f6594ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:49:19.967+0000 7f66b20ba640 10 monclient: get_auth_request con 0x7f657c0764a0 auth_method 0 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:49:19.967+0000 7f66b30bc640 10 monclient: get_auth_request con 0x5585a6f1d940 auth_method 0 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 realm 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:49:19.967+0000 7f66b6b3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:49:19.967+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:49:19.968+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:49:19.968+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:49:19.968+0000 7f66b28bb640 10 monclient: get_auth_request con 0x5585a6f21bb0 auth_method 0 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:49:19.969+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:49:19.969+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.133 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:49:19.969+0000 7f66b20ba640 10 monclient: get_auth_request con 0x5585a6f25410 auth_method 0 2024-09-12T17:49:20.134 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:49:19.969+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:20.134 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:49:19.969+0000 7f66b6b3b800 20 searching for the correct realm 2024-09-12T17:49:20.134 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:49:19.969+0000 7f66b30bc640 10 monclient: get_auth_request con 0x5585a6f2a080 auth_method 0 2024-09-12T17:49:20.134 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:49:19.970+0000 7f66b28bb640 10 monclient: get_auth_request con 0x7f66ac022070 auth_method 0 2024-09-12T17:49:20.134 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:49:19.971+0000 7f66b20ba640 10 monclient: get_auth_request con 0x7f66a803a040 auth_method 0 2024-09-12T17:49:20.134 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:49:19.972+0000 7f66b30bc640 0 -- 172.21.15.107:0/263125028 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x5585a6f1d940 msgr2=0x5585a6f1fe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:20.134 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:49:19.972+0000 7f6594ff9640 1 client.6834.objecter ms_handle_reset 0x5585a6f1d940 session 0x5585a6f1d270 osd.1 2024-09-12T17:49:20.134 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:49:19.972+0000 7f6594ff9640 10 monclient: _renew_subs 2024-09-12T17:49:20.134 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:49:19.972+0000 7f6594ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:20.134 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:49:19.972+0000 7f66b30bc640 10 monclient: get_auth_request con 0x7f657c086bd0 auth_method 0 2024-09-12T17:49:20.134 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:49:19.973+0000 7f66b30bc640 10 monclient: get_auth_request con 0x7f66a802d050 auth_method 0 2024-09-12T17:49:20.134 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:49:19.975+0000 7f66b28bb640 10 monclient: get_auth_request con 0x7f66a802db90 auth_method 0 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:49:19.976+0000 7f66b28bb640 0 -- 172.21.15.107:0/263125028 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f66a802db90 msgr2=0x7f66a8051980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:49:19.976+0000 7f6594ff9640 1 client.6834.objecter ms_handle_reset 0x7f66a802db90 session 0x7f66a803ae70 osd.0 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:49:19.976+0000 7f66b28bb640 10 monclient: get_auth_request con 0x5585a6f1d940 auth_method 0 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:49:19.979+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:20.135 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 zone default found 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 4 Realm: () 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 zonegroup default 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:49:19.980+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:49:19.981+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:49:19.981+0000 7f66b6b3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.136 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:49:19.981+0000 7f66b6b3b800 20 started sync module instance, tier type = 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:49:19.981+0000 7f66b6b3b800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=0 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=1 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=2 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=3 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=4 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=5 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:49:19.989+0000 7f66b6b3b800 20 add_watcher() i=6 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:49:19.990+0000 7f66b6b3b800 20 add_watcher() i=7 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:49:19.990+0000 7f66b6b3b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding auth protocol: cephx 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding auth protocol: cephx 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding auth protocol: cephx 2024-09-12T17:49:20.137 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: secure 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: crc 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: secure 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: crc 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: secure 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: crc 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: crc 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: secure 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: crc 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: secure 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: crc 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:49:19.992+0000 7f65697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 AuthRegistry(0x7ffd716121f0) adding con mode: secure 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:20.138 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command cache list hook 0x5585a6ef1fe0 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command cache inspect hook 0x5585a6ef1fe0 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command cache erase hook 0x5585a6ef1fe0 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command cache zap hook 0x5585a6ef1fe0 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:49:19.992+0000 7f66b6b3b800 5 note: GC not initialized 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:49:19.992+0000 7f64e3fff640 20 reqs_thread_entry: start 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command sync trace show hook 0x7f66a4087020 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command sync trace history hook 0x7f66a4087020 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command sync trace active hook 0x7f66a4087020 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 5 asok(0x5585a6c11730) register_command sync trace active_short hook 0x7f66a4087020 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 Filter name: none 2024-09-12T17:49:20.139 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:49:19.993+0000 7f64e1ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:20.140 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:49:20.140 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.140 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:20.140 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:49:20.140 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:49:20.140 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 : miss 2024-09-12T17:49:20.140 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:49:19.993+0000 7f66b6b3b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.140 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:49:19.994+0000 7f66b6b3b800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:20.140 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:20.140 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:49:19.994+0000 7f66b6b3b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:49:19.997+0000 7f66b6b3b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:49:19.997+0000 7f66b6b3b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:49:19.997+0000 7f66b6b3b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:49:19.997+0000 7f66b6b3b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28, ofs0, ns] 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:49:19.998+0000 7f65967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 94032519957568 notifier 6834 bl.length()=1023 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:49:19.998+0000 7f65967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:49:19.998+0000 7f65967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:49:19.998+0000 7f65967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:49:19.998+0000 7f66b6b3b800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): orig_sources= new_sources= 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:49:19.998+0000 7f66b6b3b800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): potential sources added=[] removed=[] 2024-09-12T17:49:20.141 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:49:19.998+0000 7f66b6b3b800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): orig_dests= new_dests= 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:49:19.998+0000 7f66b6b3b800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): potential dests added=[] removed=[] 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:49:19.999+0000 7f66b6b3b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f66b6b3b800 time 2024-09-12T17:49:19.999432+0000 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f66b838c71a] 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f66b838c8d8] 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5585a4da7841] 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd7489e) [0x5585a52b589e] 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5585a4db750d] 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f66b7029590] 2024-09-12T17:49:20.142 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:49:20.000+0000 7f66b6b3b800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f66b6b3b800 thread_name:radosgw-admin 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f66b703e6f0] 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f66b708b99c] 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f66b838c774] 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f66b838c8d8] 2024-09-12T17:49:20.143 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5585a4da7841] 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd7489e) [0x5585a52b589e] 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5585a4db750d] 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f66b7029590] 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:49:20.144 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:49:20.145 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:49:20.146 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:49:20.147 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:49:20.148 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:49:20.149 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:49:20.150 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: 7f64e1ffb640 / http_manager 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: 7f64e3fff640 / http_manager 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: 7f65697e2640 / rgw_dt_lg_renew 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: 7f6594ff9640 / ms_dispatch 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: 7f65967fc640 / io_context_pool 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: 7f659ce01640 / ms_dispatch 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: 7f659f606640 / ms_dispatch 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: 7f65a0e09640 / io_context_pool 2024-09-12T17:49:20.151 INFO:tasks.workunit.client.0.smithi107.stderr: 7f66b20ba640 / msgr-worker-2 2024-09-12T17:49:20.152 INFO:tasks.workunit.client.0.smithi107.stderr: 7f66b28bb640 / msgr-worker-1 2024-09-12T17:49:20.152 INFO:tasks.workunit.client.0.smithi107.stderr: 7f66b30bc640 / msgr-worker-0 2024-09-12T17:49:20.152 INFO:tasks.workunit.client.0.smithi107.stderr: 7f66b38bd640 / io_context_pool 2024-09-12T17:49:20.152 INFO:tasks.workunit.client.0.smithi107.stderr: 7f66b6b3b800 / radosgw-admin 2024-09-12T17:49:20.152 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:49:20.152 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:49:20.152 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:49:20.001083Z_776c7c44-dc68-421b-9977-3b3128655b14/log 2024-09-12T17:49:20.152 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:49:20.152 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:49:20.153 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:20.153 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:20.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.074+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.076+0000 7f5640739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.076+0000 7f5640739800 20 realm 2024-09-12T17:49:20.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.076+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.076+0000 7f5640739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.076+0000 7f5640739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:20.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.076+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.077+0000 7f5640739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.077+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.077+0000 7f5640739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:20.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.077+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.279+0000 7f5640739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:20.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.279+0000 7f5640739800 20 searching for the correct realm 2024-09-12T17:49:20.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.280+0000 7f563c3ce640 0 -- 172.21.15.107:0/3429083120 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f5634033070 msgr2=0x7f5634066140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:20.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.284+0000 7f563c3ce640 0 -- 172.21.15.107:0/3429083120 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x55b180d21ae0 msgr2=0x7f550408bd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:20.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.289+0000 7f5640739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:20.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.289+0000 7f5640739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:20.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.289+0000 7f5640739800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:20.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.289+0000 7f5640739800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:20.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.289+0000 7f5640739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:20.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.289+0000 7f5640739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:20.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.289+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.289+0000 7f5640739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.289+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.289+0000 7f5640739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:20.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.289+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:20.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 20 zone default found 2024-09-12T17:49:20.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 4 Realm: () 2024-09-12T17:49:20.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:20.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:20.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:20.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 20 zonegroup default 2024-09-12T17:49:20.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 20 started sync module instance, tier type = 2024-09-12T17:49:20.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.290+0000 7f5640739800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:20.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.299+0000 7f5640739800 20 add_watcher() i=0 2024-09-12T17:49:20.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.299+0000 7f5640739800 20 add_watcher() i=1 2024-09-12T17:49:20.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.299+0000 7f5640739800 20 add_watcher() i=2 2024-09-12T17:49:20.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.299+0000 7f5640739800 20 add_watcher() i=3 2024-09-12T17:49:20.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.299+0000 7f5640739800 20 add_watcher() i=4 2024-09-12T17:49:20.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.299+0000 7f5640739800 20 add_watcher() i=5 2024-09-12T17:49:20.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.299+0000 7f5640739800 20 add_watcher() i=6 2024-09-12T17:49:20.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.300+0000 7f5640739800 20 add_watcher() i=7 2024-09-12T17:49:20.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.300+0000 7f5640739800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:20.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.301+0000 7f54f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:20.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.302+0000 7f5640739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:20.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.302+0000 7f5640739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:20.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.302+0000 7f5640739800 5 note: GC not initialized 2024-09-12T17:49:20.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.302+0000 7f54f1fdb640 20 reqs_thread_entry: start 2024-09-12T17:49:20.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.302+0000 7f5640739800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:20.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.302+0000 7f5640739800 20 Filter name: none 2024-09-12T17:49:20.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.302+0000 7f54637fe640 20 reqs_thread_entry: start 2024-09-12T17:49:20.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.302+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.303+0000 7f5640739800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:20.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.303+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.303+0000 7f5640739800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:49:20.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.303+0000 7f5640739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:20.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.303+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.304+0000 7f5640739800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:20.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.304+0000 7f5640739800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.304+0000 7f5640739800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:49:20.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.304+0000 7f5640739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:20.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.305+0000 7f54f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:20.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.308+0000 7f5640739800 20 remove_watcher() i=0 2024-09-12T17:49:20.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.308+0000 7f5640739800 2 removed watcher, disabling cache 2024-09-12T17:49:20.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.309+0000 7f5640739800 20 remove_watcher() i=1 2024-09-12T17:49:20.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.310+0000 7f5640739800 20 remove_watcher() i=2 2024-09-12T17:49:20.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.311+0000 7f5640739800 20 remove_watcher() i=3 2024-09-12T17:49:20.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.313+0000 7f5640739800 20 remove_watcher() i=4 2024-09-12T17:49:20.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.314+0000 7f5640739800 20 remove_watcher() i=5 2024-09-12T17:49:20.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.315+0000 7f5640739800 20 remove_watcher() i=6 2024-09-12T17:49:20.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.316+0000 7f5640739800 20 remove_watcher() i=7 2024-09-12T17:49:20.327 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.328 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:20.328 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-trim-reshard-log-entries id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:49:20.328 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:20.378 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:49:20.409 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:20.409 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:20.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.444+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.445+0000 7ff2bbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.445+0000 7ff2bbd2c800 20 realm 2024-09-12T17:49:20.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.445+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.446+0000 7ff2bbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.446+0000 7ff2bbd2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:20.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.446+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.446+0000 7ff2bbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.446+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.447+0000 7ff2bbd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:20.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.447+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.447+0000 7ff2bbd2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:20.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.447+0000 7ff2bbd2c800 20 searching for the correct realm 2024-09-12T17:49:20.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.450+0000 7ff2b8250640 0 -- 172.21.15.107:0/847121365 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x555cfa7e49b0 msgr2=0x555cfa7e6e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:20.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.453+0000 7ff2b7a4f640 0 -- 172.21.15.107:0/847121365 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7ff2a006b420 msgr2=0x7ff2a006a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:20.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:20.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:20.660 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:20.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:20.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:20.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:20.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:20.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:20.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 zone default found 2024-09-12T17:49:20.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 4 Realm: () 2024-09-12T17:49:20.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:20.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:20.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:20.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 zonegroup default 2024-09-12T17:49:20.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.659+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.660+0000 7ff2bbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.660+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.660+0000 7ff2bbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.660+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.660+0000 7ff2bbd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:20.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.660+0000 7ff2bbd2c800 20 started sync module instance, tier type = 2024-09-12T17:49:20.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.660+0000 7ff2bbd2c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:20.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.669+0000 7ff2bbd2c800 20 add_watcher() i=0 2024-09-12T17:49:20.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.669+0000 7ff2bbd2c800 20 add_watcher() i=1 2024-09-12T17:49:20.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.669+0000 7ff2bbd2c800 20 add_watcher() i=2 2024-09-12T17:49:20.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.669+0000 7ff2bbd2c800 20 add_watcher() i=3 2024-09-12T17:49:20.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.669+0000 7ff2bbd2c800 20 add_watcher() i=4 2024-09-12T17:49:20.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.669+0000 7ff2bbd2c800 20 add_watcher() i=5 2024-09-12T17:49:20.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.670+0000 7ff2bbd2c800 20 add_watcher() i=6 2024-09-12T17:49:20.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.671+0000 7ff2bbd2c800 20 add_watcher() i=7 2024-09-12T17:49:20.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.671+0000 7ff2bbd2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:20.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.673+0000 7ff16dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:20.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.674+0000 7ff2bbd2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:20.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.674+0000 7ff2bbd2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:20.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.674+0000 7ff2bbd2c800 5 note: GC not initialized 2024-09-12T17:49:20.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.674+0000 7ff16cfe1640 20 reqs_thread_entry: start 2024-09-12T17:49:20.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.674+0000 7ff2bbd2c800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:20.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.674+0000 7ff2bbd2c800 20 Filter name: none 2024-09-12T17:49:20.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.674+0000 7ff0e67fc640 20 reqs_thread_entry: start 2024-09-12T17:49:20.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.674+0000 7ff2bbd2c800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:49:20.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.674+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.675+0000 7ff2bbd2c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:20.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.675+0000 7ff2bbd2c800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:49:20.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.675+0000 7ff2bbd2c800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:49:20.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.675+0000 7ff2bbd2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 : miss 2024-09-12T17:49:20.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.675+0000 7ff2bbd2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:20.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.675+0000 7ff2bbd2c800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:49:20.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.675+0000 7ff2bbd2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:20.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.675+0000 7ff2bbd2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:20.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.675+0000 7ff2bbd2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:20.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.675+0000 7ff2bbd2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:20.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.675+0000 7ff2bbd2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 2024-09-12T17:49:20.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.676+0000 7ff2bbd2c800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to be held by another RGW process; skipping for now 2024-09-12T17:49:20.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.677+0000 7ff16dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:20.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.679+0000 7ff2bbd2c800 20 remove_watcher() i=0 2024-09-12T17:49:20.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.679+0000 7ff2bbd2c800 2 removed watcher, disabling cache 2024-09-12T17:49:20.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.680+0000 7ff2bbd2c800 20 remove_watcher() i=1 2024-09-12T17:49:20.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.681+0000 7ff2bbd2c800 20 remove_watcher() i=2 2024-09-12T17:49:20.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.683+0000 7ff2bbd2c800 20 remove_watcher() i=3 2024-09-12T17:49:20.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.684+0000 7ff2bbd2c800 20 remove_watcher() i=4 2024-09-12T17:49:20.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.685+0000 7ff2bbd2c800 20 remove_watcher() i=5 2024-09-12T17:49:20.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.686+0000 7ff2bbd2c800 20 remove_watcher() i=6 2024-09-12T17:49:20.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:20.687+0000 7ff2bbd2c800 20 remove_watcher() i=7 2024-09-12T17:49:20.698 INFO:tasks.workunit.client.0.smithi107.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:49:50.709 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:49:50.744 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:50.745 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:50.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.785+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.787+0000 7f8e0f325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.787+0000 7f8e0f325800 20 realm 2024-09-12T17:49:50.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.787+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.787+0000 7f8e0f325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.787+0000 7f8e0f325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:50.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.787+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.788+0000 7f8e0f325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.788+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.789+0000 7f8e0f325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:50.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.789+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.789+0000 7f8e0f325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:50.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.789+0000 7f8e0f325800 20 searching for the correct realm 2024-09-12T17:49:50.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.793+0000 7f8e0b7af640 0 -- 172.21.15.107:0/2963982888 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55bda9502670 msgr2=0x55bda9504b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:50.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.796+0000 7f8e0afae640 0 -- 172.21.15.107:0/2963982888 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f8df406d120 msgr2=0x7f8df407a8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:50.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.801+0000 7f8e0f325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:50.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.801+0000 7f8e0f325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:50.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.801+0000 7f8e0f325800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:50.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.801+0000 7f8e0f325800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:50.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.801+0000 7f8e0f325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:50.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.801+0000 7f8e0f325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:50.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.801+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:50.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:50.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 20 zone default found 2024-09-12T17:49:50.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 4 Realm: () 2024-09-12T17:49:50.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:50.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:50.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:50.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 20 zonegroup default 2024-09-12T17:49:50.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.802+0000 7f8e0f325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.803+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.803+0000 7f8e0f325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.803+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.803+0000 7f8e0f325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.803+0000 7f8e0f325800 20 started sync module instance, tier type = 2024-09-12T17:49:50.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.803+0000 7f8e0f325800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:50.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.813+0000 7f8e0f325800 20 add_watcher() i=0 2024-09-12T17:49:50.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.813+0000 7f8e0f325800 20 add_watcher() i=1 2024-09-12T17:49:50.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.813+0000 7f8e0f325800 20 add_watcher() i=2 2024-09-12T17:49:50.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.813+0000 7f8e0f325800 20 add_watcher() i=3 2024-09-12T17:49:50.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.813+0000 7f8e0f325800 20 add_watcher() i=4 2024-09-12T17:49:50.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.813+0000 7f8e0f325800 20 add_watcher() i=5 2024-09-12T17:49:50.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.813+0000 7f8e0f325800 20 add_watcher() i=6 2024-09-12T17:49:50.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.813+0000 7f8e0f325800 20 add_watcher() i=7 2024-09-12T17:49:50.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.813+0000 7f8e0f325800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:50.816 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.815+0000 7f8cc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:50.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.816+0000 7f8e0f325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:50.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.816+0000 7f8e0f325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:50.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.816+0000 7f8e0f325800 5 note: GC not initialized 2024-09-12T17:49:50.817 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.816+0000 7f8c3bfff640 20 reqs_thread_entry: start 2024-09-12T17:49:50.818 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.816+0000 7f8e0f325800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:50.818 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.816+0000 7f8e0f325800 20 Filter name: none 2024-09-12T17:49:50.818 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.816+0000 7f8c39ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:50.818 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.816+0000 7f8e0f325800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:49:50.818 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.816+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.817+0000 7f8e0f325800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:50.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.817+0000 7f8e0f325800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:49:50.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.817+0000 7f8e0f325800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:49:50.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.817+0000 7f8e0f325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 : miss 2024-09-12T17:49:50.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.817+0000 7f8e0f325800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.817+0000 7f8e0f325800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:49:50.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.817+0000 7f8e0f325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:50.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.817+0000 7f8e0f325800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:50.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.817+0000 7f8e0f325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:50.819 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.817+0000 7f8e0f325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:50.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.817+0000 7f8e0f325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 2024-09-12T17:49:50.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.818+0000 7f8e0f325800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:49:50.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.822+0000 7f8e0f325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:50.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.822+0000 7f8e0f325800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:50.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.822+0000 7f8e0f325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:50.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.822+0000 7f8e0f325800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28, ofs0, ns] 2024-09-12T17:49:50.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.822+0000 7f8cee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464275 cookie 94273077812304 notifier 6888 bl.length()=1023 2024-09-12T17:49:50.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.822+0000 7f8cee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:50.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.822+0000 7f8cee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:50.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.822+0000 7f8cee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:50.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.823+0000 7f8e0f325800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): orig_sources= new_sources= 2024-09-12T17:49:50.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.823+0000 7f8e0f325800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): potential sources added=[] removed=[] 2024-09-12T17:49:50.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.823+0000 7f8e0f325800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): orig_dests= new_dests= 2024-09-12T17:49:50.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.823+0000 7f8e0f325800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): potential dests added=[] removed=[] 2024-09-12T17:49:50.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.825+0000 7f8e0f325800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.28.2.0 2024-09-12T17:49:50.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.825+0000 7f8e0f325800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.28.2.0 2024-09-12T17:49:50.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.825+0000 7f8e0f325800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.28.2.1 2024-09-12T17:49:50.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.825+0000 7f8e0f325800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.28.2.1 2024-09-12T17:49:50.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.825+0000 7f8e0f325800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.28.0 2024-09-12T17:49:50.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.828+0000 7f8e0f325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:50.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.828+0000 7f8e0f325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 2024-09-12T17:49:50.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.829+0000 7f8e0f325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:50.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.829+0000 7f8e0f325800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:50.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.829+0000 7f8e0f325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:50.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.829+0000 7f8e0f325800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28, ofs0, ns] 2024-09-12T17:49:50.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.829+0000 7f8cee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464276 cookie 94273077812304 notifier 6888 bl.length()=1023 2024-09-12T17:49:50.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.829+0000 7f8cee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:50.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.829+0000 7f8cee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:50.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.829+0000 7f8cee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:50.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.830+0000 7f8e0f325800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): orig_sources= new_sources= 2024-09-12T17:49:50.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.830+0000 7f8e0f325800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): potential sources added=[] removed=[] 2024-09-12T17:49:50.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.830+0000 7f8e0f325800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): orig_dests= new_dests= 2024-09-12T17:49:50.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.830+0000 7f8e0f325800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): potential dests added=[] removed=[] 2024-09-12T17:49:50.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.831+0000 7f8e0f325800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.28.0 2024-09-12T17:49:50.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.831+0000 7f8e0f325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:50.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.831+0000 7f8e0f325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 2024-09-12T17:49:50.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.832+0000 7f8e0f325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:50.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.832+0000 7f8e0f325800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:50.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.832+0000 7f8e0f325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:50.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.832+0000 7f8e0f325800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28, ofs0, ns] 2024-09-12T17:49:50.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.832+0000 7f8cee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 94273077812304 notifier 6888 bl.length()=991 2024-09-12T17:49:50.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.832+0000 7f8cee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 info.flags=0x17 2024-09-12T17:49:50.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.832+0000 7f8cee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 to cache LRU end 2024-09-12T17:49:50.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.832+0000 7f8cee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:50.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.833+0000 7f8e0f325800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): orig_sources= new_sources= 2024-09-12T17:49:50.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.833+0000 7f8e0f325800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): potential sources added=[] removed=[] 2024-09-12T17:49:50.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.833+0000 7f8e0f325800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): orig_dests= new_dests= 2024-09-12T17:49:50.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.833+0000 7f8e0f325800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[35ed0db6-4f54-4e96-b306-71079c84e007.4596.28]): potential dests added=[] removed=[] 2024-09-12T17:49:50.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.834+0000 7f8e0f325800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T17:49:50.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.836+0000 7f8cc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:50.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.838+0000 7f8e0f325800 20 remove_watcher() i=0 2024-09-12T17:49:50.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.838+0000 7f8e0f325800 2 removed watcher, disabling cache 2024-09-12T17:49:50.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.839+0000 7f8e0f325800 20 remove_watcher() i=1 2024-09-12T17:49:50.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.840+0000 7f8e0f325800 20 remove_watcher() i=2 2024-09-12T17:49:50.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.841+0000 7f8e0f325800 20 remove_watcher() i=3 2024-09-12T17:49:50.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.843+0000 7f8e0f325800 20 remove_watcher() i=4 2024-09-12T17:49:50.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.843+0000 7f8e0f325800 20 remove_watcher() i=5 2024-09-12T17:49:50.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.844+0000 7f8e0f325800 20 remove_watcher() i=6 2024-09-12T17:49:50.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.845+0000 7f8e0f325800 20 remove_watcher() i=7 2024-09-12T17:49:50.859 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:49:50.887 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:50.888 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:50.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.922+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.924+0000 7fef6b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.924+0000 7fef6b12f800 20 realm 2024-09-12T17:49:50.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.924+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.924+0000 7fef6b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.924+0000 7fef6b12f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:50.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.924+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.924+0000 7fef6b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.924+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.925+0000 7fef6b12f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:50.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.925+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.927 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.926+0000 7fef6b12f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:50.927 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.926+0000 7fef6b12f800 20 searching for the correct realm 2024-09-12T17:49:50.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.929+0000 7fef6761b640 0 -- 172.21.15.107:0/957072139 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x55d00f1f4270 msgr2=0x55d00f1f6710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:50.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.932+0000 7fef5e619640 0 -- 172.21.15.107:0/957072139 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fef50032060 msgr2=0x7fef5009dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:50.938 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.936+0000 7fef6b12f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.936+0000 7fef6b12f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.936+0000 7fef6b12f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.936+0000 7fef6b12f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.936+0000 7fef6b12f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.936+0000 7fef6b12f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.936+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.936+0000 7fef6b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.936+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 20 zone default found 2024-09-12T17:49:50.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 4 Realm: () 2024-09-12T17:49:50.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:50.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:50.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:50.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 20 zonegroup default 2024-09-12T17:49:50.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.937+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.938+0000 7fef6b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:50.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.938+0000 7fef6b12f800 20 started sync module instance, tier type = 2024-09-12T17:49:50.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.938+0000 7fef6b12f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:50.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.947+0000 7fef6b12f800 20 add_watcher() i=0 2024-09-12T17:49:50.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.947+0000 7fef6b12f800 20 add_watcher() i=1 2024-09-12T17:49:50.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.947+0000 7fef6b12f800 20 add_watcher() i=2 2024-09-12T17:49:50.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.947+0000 7fef6b12f800 20 add_watcher() i=3 2024-09-12T17:49:50.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.947+0000 7fef6b12f800 20 add_watcher() i=4 2024-09-12T17:49:50.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.947+0000 7fef6b12f800 20 add_watcher() i=5 2024-09-12T17:49:50.948 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.947+0000 7fef6b12f800 20 add_watcher() i=6 2024-09-12T17:49:50.949 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.948+0000 7fef6b12f800 20 add_watcher() i=7 2024-09-12T17:49:50.949 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.948+0000 7fef6b12f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:50.950 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.949+0000 7fee1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:50.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.949+0000 7fef6b12f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:50.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.949+0000 7fef6b12f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:50.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.950+0000 7fef6b12f800 5 note: GC not initialized 2024-09-12T17:49:50.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.950+0000 7fed97fff640 20 reqs_thread_entry: start 2024-09-12T17:49:50.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.950+0000 7fef6b12f800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:50.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.950+0000 7fef6b12f800 20 Filter name: none 2024-09-12T17:49:50.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.950+0000 7fed95ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:50.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.950+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.951+0000 7fef6b12f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:50.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.951+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.951+0000 7fef6b12f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:50.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.951+0000 7fef6b12f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:50.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.951+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.951+0000 7fef6b12f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:49:50.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.951+0000 7fef6b12f800 20 rados->read ofs=0 len=0 2024-09-12T17:49:50.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.952+0000 7fef6b12f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:49:50.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.952+0000 7fef6b12f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:50.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.953+0000 7fee1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:50.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.955+0000 7fef6b12f800 20 remove_watcher() i=0 2024-09-12T17:49:50.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.955+0000 7fef6b12f800 2 removed watcher, disabling cache 2024-09-12T17:49:50.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.956+0000 7fef6b12f800 20 remove_watcher() i=1 2024-09-12T17:49:50.958 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.957+0000 7fef6b12f800 20 remove_watcher() i=2 2024-09-12T17:49:50.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.958+0000 7fef6b12f800 20 remove_watcher() i=3 2024-09-12T17:49:50.960 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.959+0000 7fef6b12f800 20 remove_watcher() i=4 2024-09-12T17:49:50.961 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.960+0000 7fef6b12f800 20 remove_watcher() i=5 2024-09-12T17:49:50.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.961+0000 7fef6b12f800 20 remove_watcher() i=6 2024-09-12T17:49:50.963 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:50.962+0000 7fef6b12f800 20 remove_watcher() i=7 2024-09-12T17:49:50.973 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:50.973 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:50.973 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-trim-reshard-log-entries id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:49:50.973 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:51.036 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T17:49:51.037 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:51.221 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:49:51.248 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:51.249 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:51.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.283+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.285+0000 7fc7c7f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.285+0000 7fc7c7f35800 20 realm 2024-09-12T17:49:51.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.285+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.285+0000 7fc7c7f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.285+0000 7fc7c7f35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:51.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.285+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.285+0000 7fc7c7f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.285+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.286+0000 7fc7c7f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:51.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.286+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.287+0000 7fc7c7f35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:51.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.287+0000 7fc7c7f35800 20 searching for the correct realm 2024-09-12T17:49:51.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.289+0000 7fc7c3ce4640 0 -- 172.21.15.107:0/3994547476 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fc7bc070410 msgr2=0x7fc7bc070890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:51.294 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.293+0000 7fc7c3ce4640 0 -- 172.21.15.107:0/3994547476 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc7ac025040 msgr2=0x7fc7ac035450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:51.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:51.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:51.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:51.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:51.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:51.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:51.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:51.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:51.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 zone default found 2024-09-12T17:49:51.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 4 Realm: () 2024-09-12T17:49:51.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:51.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:51.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:51.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 zonegroup default 2024-09-12T17:49:51.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.500+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.501+0000 7fc7c7f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.501+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.501+0000 7fc7c7f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.501+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.501+0000 7fc7c7f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.501+0000 7fc7c7f35800 20 started sync module instance, tier type = 2024-09-12T17:49:51.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.501+0000 7fc7c7f35800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:51.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.510+0000 7fc7c7f35800 20 add_watcher() i=0 2024-09-12T17:49:51.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.511+0000 7fc7c7f35800 20 add_watcher() i=1 2024-09-12T17:49:51.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.511+0000 7fc7c7f35800 20 add_watcher() i=2 2024-09-12T17:49:51.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.511+0000 7fc7c7f35800 20 add_watcher() i=3 2024-09-12T17:49:51.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.511+0000 7fc7c7f35800 20 add_watcher() i=4 2024-09-12T17:49:51.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.511+0000 7fc7c7f35800 20 add_watcher() i=5 2024-09-12T17:49:51.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.511+0000 7fc7c7f35800 20 add_watcher() i=6 2024-09-12T17:49:51.512 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.511+0000 7fc7c7f35800 20 add_watcher() i=7 2024-09-12T17:49:51.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.511+0000 7fc7c7f35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:51.514 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.513+0000 7fc679fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:51.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.513+0000 7fc7c7f35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:51.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.513+0000 7fc7c7f35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:51.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.513+0000 7fc7c7f35800 5 note: GC not initialized 2024-09-12T17:49:51.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.514+0000 7fc678fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:51.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.514+0000 7fc7c7f35800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:51.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.514+0000 7fc7c7f35800 20 Filter name: none 2024-09-12T17:49:51.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.514+0000 7fc5f27fc640 20 reqs_thread_entry: start 2024-09-12T17:49:51.515 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.514+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.514+0000 7fc7c7f35800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:51.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.514+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.515+0000 7fc7c7f35800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:51.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.515+0000 7fc7c7f35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:51.516 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.515+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.515+0000 7fc7c7f35800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:51.517 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.515+0000 7fc7c7f35800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.516+0000 7fc7c7f35800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:51.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.516+0000 7fc7c7f35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:51.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.517+0000 7fc679fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:51.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.519+0000 7fc7c7f35800 20 remove_watcher() i=0 2024-09-12T17:49:51.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.519+0000 7fc7c7f35800 2 removed watcher, disabling cache 2024-09-12T17:49:51.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.520+0000 7fc7c7f35800 20 remove_watcher() i=1 2024-09-12T17:49:51.522 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.521+0000 7fc7c7f35800 20 remove_watcher() i=2 2024-09-12T17:49:51.523 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.522+0000 7fc7c7f35800 20 remove_watcher() i=3 2024-09-12T17:49:51.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.523+0000 7fc7c7f35800 20 remove_watcher() i=4 2024-09-12T17:49:51.525 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.524+0000 7fc7c7f35800 20 remove_watcher() i=5 2024-09-12T17:49:51.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.525+0000 7fc7c7f35800 20 remove_watcher() i=6 2024-09-12T17:49:51.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.526+0000 7fc7c7f35800 20 remove_watcher() i=7 2024-09-12T17:49:51.537 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:51.537 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:51.537 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-block-writes id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:49:51.537 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:51.538 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T17:49:51.573 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:51.573 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:51.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.608+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.609+0000 7f0f39b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.609+0000 7f0f39b2e800 20 realm 2024-09-12T17:49:51.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.609+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.609+0000 7f0f39b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.609+0000 7f0f39b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:51.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.609+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.609+0000 7f0f39b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.609+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.610+0000 7f0f39b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:51.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.610+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.611+0000 7f0f39b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:51.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.611+0000 7f0f39b2e800 20 searching for the correct realm 2024-09-12T17:49:51.614 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.613+0000 7f0f35764640 0 -- 172.21.15.107:0/4097468408 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f0f30036040 msgr2=0x7f0f30036930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:51.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.617+0000 7f0f35764640 0 -- 172.21.15.107:0/4097468408 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f0f20038d80 msgr2=0x7f0f20073940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:51.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.823+0000 7f0f39b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:51.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.823+0000 7f0f39b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:51.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.823+0000 7f0f39b2e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.823+0000 7f0f39b2e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.823+0000 7f0f39b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.823+0000 7f0f39b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.823+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.823+0000 7f0f39b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.823+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.824+0000 7f0f39b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.824+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.824+0000 7f0f39b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.824+0000 7f0f39b2e800 20 zone default found 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.824+0000 7f0f39b2e800 4 Realm: () 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.824+0000 7f0f39b2e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:51.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.824+0000 7f0f39b2e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:51.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.824+0000 7f0f39b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:51.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.824+0000 7f0f39b2e800 20 zonegroup default 2024-09-12T17:49:51.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.824+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.824+0000 7f0f39b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.824+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.825+0000 7f0f39b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.825+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.825+0000 7f0f39b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.825+0000 7f0f39b2e800 20 started sync module instance, tier type = 2024-09-12T17:49:51.828 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.825+0000 7f0f39b2e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:51.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.835+0000 7f0f39b2e800 20 add_watcher() i=0 2024-09-12T17:49:51.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.835+0000 7f0f39b2e800 20 add_watcher() i=1 2024-09-12T17:49:51.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.835+0000 7f0f39b2e800 20 add_watcher() i=2 2024-09-12T17:49:51.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.835+0000 7f0f39b2e800 20 add_watcher() i=3 2024-09-12T17:49:51.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.835+0000 7f0f39b2e800 20 add_watcher() i=4 2024-09-12T17:49:51.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.835+0000 7f0f39b2e800 20 add_watcher() i=5 2024-09-12T17:49:51.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.835+0000 7f0f39b2e800 20 add_watcher() i=6 2024-09-12T17:49:51.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.836+0000 7f0f39b2e800 20 add_watcher() i=7 2024-09-12T17:49:51.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.836+0000 7f0f39b2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:51.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.838+0000 7f0debfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:51.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.838+0000 7f0f39b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:51.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.838+0000 7f0f39b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:51.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.838+0000 7f0f39b2e800 5 note: GC not initialized 2024-09-12T17:49:51.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.838+0000 7f0deafe5640 20 reqs_thread_entry: start 2024-09-12T17:49:51.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.838+0000 7f0f39b2e800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:51.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.838+0000 7f0f39b2e800 20 Filter name: none 2024-09-12T17:49:51.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.838+0000 7f0de8fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:51.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.838+0000 7f0f39b2e800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:49:51.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.839+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.839+0000 7f0f39b2e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:51.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.839+0000 7f0f39b2e800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:49:51.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.839+0000 7f0f39b2e800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:49:51.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.839+0000 7f0f39b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 : miss 2024-09-12T17:49:51.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.839+0000 7f0f39b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.839+0000 7f0f39b2e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:51.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.839+0000 7f0f39b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:51.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.839+0000 7f0f39b2e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:51.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.839+0000 7f0f39b2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:51.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.839+0000 7f0f39b2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:51.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.839+0000 7f0f39b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 2024-09-12T17:49:51.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.843+0000 7f0f39b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:51.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.843+0000 7f0f39b2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:51.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.843+0000 7f0f39b2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:51.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.843+0000 7f0f39b2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29, ofs0, ns] 2024-09-12T17:49:51.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.843+0000 7f0e18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464324 cookie 93978711121936 notifier 6942 bl.length()=999 2024-09-12T17:49:51.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.843+0000 7f0e18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:51.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.843+0000 7f0e18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:51.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.843+0000 7f0e18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:51.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.844+0000 7f0f39b2e800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): orig_sources= new_sources= 2024-09-12T17:49:51.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.844+0000 7f0f39b2e800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): potential sources added=[] removed=[] 2024-09-12T17:49:51.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.844+0000 7f0f39b2e800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): orig_dests= new_dests= 2024-09-12T17:49:51.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.844+0000 7f0f39b2e800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): potential dests added=[] removed=[] 2024-09-12T17:49:51.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.845+0000 7f0f39b2e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.29.1.0 2024-09-12T17:49:51.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.845+0000 7f0f39b2e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.29.1.0 2024-09-12T17:49:51.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.845+0000 7f0f39b2e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.29.1.1 2024-09-12T17:49:51.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.845+0000 7f0f39b2e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.29.1.1 2024-09-12T17:49:51.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.845+0000 7f0f39b2e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.29.0 2024-09-12T17:49:51.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.847+0000 7f0f39b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:51.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.847+0000 7f0f39b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 2024-09-12T17:49:51.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0f39b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:51.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0f39b2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:51.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0f39b2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:51.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0f39b2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29, ofs0, ns] 2024-09-12T17:49:51.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0e07fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464325 cookie 93978711121936 notifier 6942 bl.length()=999 2024-09-12T17:49:51.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0e07fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:51.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0e07fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:51.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0e07fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:51.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0f39b2e800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): orig_sources= new_sources= 2024-09-12T17:49:51.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0f39b2e800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): potential sources added=[] removed=[] 2024-09-12T17:49:51.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0f39b2e800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): orig_dests= new_dests= 2024-09-12T17:49:51.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0f39b2e800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): potential dests added=[] removed=[] 2024-09-12T17:49:51.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0f39b2e800 -1 Injecting error=-5 at location=block_writes 2024-09-12T17:49:51.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.849+0000 7f0f39b2e800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:49:51.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.851+0000 7f0f39b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:51.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.851+0000 7f0f39b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 2024-09-12T17:49:51.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.853+0000 7f0f39b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:51.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.853+0000 7f0f39b2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:51.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.853+0000 7f0f39b2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:51.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.853+0000 7f0f39b2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29, ofs0, ns] 2024-09-12T17:49:51.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.853+0000 7f0e18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464326 cookie 93978711121936 notifier 6942 bl.length()=967 2024-09-12T17:49:51.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.853+0000 7f0e18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:51.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.853+0000 7f0e18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:51.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.853+0000 7f0e18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:51.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.853+0000 7f0f39b2e800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): orig_sources= new_sources= 2024-09-12T17:49:51.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.853+0000 7f0f39b2e800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): potential sources added=[] removed=[] 2024-09-12T17:49:51.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.853+0000 7f0f39b2e800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): orig_dests= new_dests= 2024-09-12T17:49:51.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.853+0000 7f0f39b2e800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): potential dests added=[] removed=[] 2024-09-12T17:49:51.856 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.854+0000 7f0f39b2e800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T17:49:51.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.856+0000 7f0debfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:51.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.858+0000 7f0f39b2e800 20 remove_watcher() i=0 2024-09-12T17:49:51.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.858+0000 7f0f39b2e800 2 removed watcher, disabling cache 2024-09-12T17:49:51.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.859+0000 7f0f39b2e800 20 remove_watcher() i=1 2024-09-12T17:49:51.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.860+0000 7f0f39b2e800 20 remove_watcher() i=2 2024-09-12T17:49:51.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.861+0000 7f0f39b2e800 20 remove_watcher() i=3 2024-09-12T17:49:51.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.862+0000 7f0f39b2e800 20 remove_watcher() i=4 2024-09-12T17:49:51.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.863+0000 7f0f39b2e800 20 remove_watcher() i=5 2024-09-12T17:49:51.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.864+0000 7f0f39b2e800 20 remove_watcher() i=6 2024-09-12T17:49:51.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.865+0000 7f0f39b2e800 20 remove_watcher() i=7 2024-09-12T17:49:51.878 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:49:51.907 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:51.907 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:51.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.942+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.945 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.944+0000 7fbda1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.945 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.944+0000 7fbda1d2c800 20 realm 2024-09-12T17:49:51.945 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.944+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.945 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.944+0000 7fbda1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.944+0000 7fbda1d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:51.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.944+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.944+0000 7fbda1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:51.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.944+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.945+0000 7fbda1d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:51.946 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.945+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:51.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.945+0000 7fbda1d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:51.947 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.945+0000 7fbda1d2c800 20 searching for the correct realm 2024-09-12T17:49:51.949 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.948+0000 7fbd97fff640 0 -- 172.21.15.107:0/1851813792 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fbd8806d060 msgr2=0x7fbd8806f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:51.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:51.951+0000 7fbd9d945640 0 -- 172.21.15.107:0/1851813792 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fbd880a3620 msgr2=0x7fbd880c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:52.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:52.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:52.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:52.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:52.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:52.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:52.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:52.160 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:52.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 zone default found 2024-09-12T17:49:52.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 4 Realm: () 2024-09-12T17:49:52.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:52.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:52.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:52.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 zonegroup default 2024-09-12T17:49:52.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.158+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.161 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.159+0000 7fbda1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.159+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.159+0000 7fbda1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.159+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.159+0000 7fbda1d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.159+0000 7fbda1d2c800 20 started sync module instance, tier type = 2024-09-12T17:49:52.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.159+0000 7fbda1d2c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:52.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.168+0000 7fbda1d2c800 20 add_watcher() i=0 2024-09-12T17:49:52.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.168+0000 7fbda1d2c800 20 add_watcher() i=1 2024-09-12T17:49:52.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.168+0000 7fbda1d2c800 20 add_watcher() i=2 2024-09-12T17:49:52.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.168+0000 7fbda1d2c800 20 add_watcher() i=3 2024-09-12T17:49:52.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.168+0000 7fbda1d2c800 20 add_watcher() i=4 2024-09-12T17:49:52.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.168+0000 7fbda1d2c800 20 add_watcher() i=5 2024-09-12T17:49:52.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.168+0000 7fbda1d2c800 20 add_watcher() i=6 2024-09-12T17:49:52.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.169+0000 7fbda1d2c800 20 add_watcher() i=7 2024-09-12T17:49:52.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.169+0000 7fbda1d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:52.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.171+0000 7fbc4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:52.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.171+0000 7fbda1d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:52.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.171+0000 7fbda1d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:52.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.171+0000 7fbda1d2c800 5 note: GC not initialized 2024-09-12T17:49:52.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.171+0000 7fbc4e7fc640 20 reqs_thread_entry: start 2024-09-12T17:49:52.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.171+0000 7fbda1d2c800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:52.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.172+0000 7fbda1d2c800 20 Filter name: none 2024-09-12T17:49:52.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.172+0000 7fbbbffff640 20 reqs_thread_entry: start 2024-09-12T17:49:52.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.172+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.172+0000 7fbda1d2c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:52.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.172+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.173+0000 7fbda1d2c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:52.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.173+0000 7fbda1d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:52.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.173+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.173+0000 7fbda1d2c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:52.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.173+0000 7fbda1d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.173+0000 7fbda1d2c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:52.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.173+0000 7fbda1d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:52.176 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.174+0000 7fbc4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:52.178 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.177+0000 7fbda1d2c800 20 remove_watcher() i=0 2024-09-12T17:49:52.178 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.177+0000 7fbda1d2c800 2 removed watcher, disabling cache 2024-09-12T17:49:52.179 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.178+0000 7fbda1d2c800 20 remove_watcher() i=1 2024-09-12T17:49:52.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.179+0000 7fbda1d2c800 20 remove_watcher() i=2 2024-09-12T17:49:52.180 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.180+0000 7fbda1d2c800 20 remove_watcher() i=3 2024-09-12T17:49:52.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.181+0000 7fbda1d2c800 20 remove_watcher() i=4 2024-09-12T17:49:52.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.182+0000 7fbda1d2c800 20 remove_watcher() i=5 2024-09-12T17:49:52.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.183+0000 7fbda1d2c800 20 remove_watcher() i=6 2024-09-12T17:49:52.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.184+0000 7fbda1d2c800 20 remove_watcher() i=7 2024-09-12T17:49:52.195 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:52.195 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:52.195 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-block-writes id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:49:52.195 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:52.246 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:49:52.276 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:52.277 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:52.314 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.313+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.314+0000 7fd1cd4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.314+0000 7fd1cd4bb800 20 realm 2024-09-12T17:49:52.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.314+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.315+0000 7fd1cd4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.315+0000 7fd1cd4bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:52.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.315+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.315+0000 7fd1cd4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.316 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.315+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.316+0000 7fd1cd4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:52.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.316+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.316+0000 7fd1cd4bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:52.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.316+0000 7fd1cd4bb800 20 searching for the correct realm 2024-09-12T17:49:52.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.319+0000 7fd1cb7a6640 0 -- 172.21.15.107:0/3475430352 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55882135c990 msgr2=0x55882135ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:52.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.322+0000 7fd1cafa5640 0 -- 172.21.15.107:0/3475430352 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fd1b409bb80 msgr2=0x7fd1b4075040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:52.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.529+0000 7fd1cd4bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:52.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.529+0000 7fd1cd4bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:52.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.529+0000 7fd1cd4bb800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:52.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.529+0000 7fd1cd4bb800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:52.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.529+0000 7fd1cd4bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:52.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.529+0000 7fd1cd4bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:52.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.529+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.529+0000 7fd1cd4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.529+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.530+0000 7fd1cd4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:52.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.530+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.530+0000 7fd1cd4bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:52.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.530+0000 7fd1cd4bb800 20 zone default found 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.530+0000 7fd1cd4bb800 4 Realm: () 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.530+0000 7fd1cd4bb800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.530+0000 7fd1cd4bb800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.530+0000 7fd1cd4bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.530+0000 7fd1cd4bb800 20 zonegroup default 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.530+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.531+0000 7fd1cd4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.531+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.531+0000 7fd1cd4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.531+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.531+0000 7fd1cd4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.531+0000 7fd1cd4bb800 20 started sync module instance, tier type = 2024-09-12T17:49:52.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.531+0000 7fd1cd4bb800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:52.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.540+0000 7fd1cd4bb800 20 add_watcher() i=0 2024-09-12T17:49:52.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.540+0000 7fd1cd4bb800 20 add_watcher() i=1 2024-09-12T17:49:52.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.540+0000 7fd1cd4bb800 20 add_watcher() i=2 2024-09-12T17:49:52.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.540+0000 7fd1cd4bb800 20 add_watcher() i=3 2024-09-12T17:49:52.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.540+0000 7fd1cd4bb800 20 add_watcher() i=4 2024-09-12T17:49:52.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.540+0000 7fd1cd4bb800 20 add_watcher() i=5 2024-09-12T17:49:52.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.540+0000 7fd1cd4bb800 20 add_watcher() i=6 2024-09-12T17:49:52.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.541+0000 7fd1cd4bb800 20 add_watcher() i=7 2024-09-12T17:49:52.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.541+0000 7fd1cd4bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:52.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.544+0000 7fd0817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:52.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.544+0000 7fd1cd4bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:52.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.544+0000 7fd1cd4bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:52.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.544+0000 7fd1cd4bb800 5 note: GC not initialized 2024-09-12T17:49:52.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.544+0000 7fcffbfff640 20 reqs_thread_entry: start 2024-09-12T17:49:52.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.544+0000 7fd1cd4bb800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:52.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.545+0000 7fd1cd4bb800 20 Filter name: none 2024-09-12T17:49:52.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.545+0000 7fcff9ffb640 20 reqs_thread_entry: start 2024-09-12T17:49:52.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.545+0000 7fd1cd4bb800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:49:52.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.545+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.545+0000 7fd1cd4bb800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:52.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.545+0000 7fd1cd4bb800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:49:52.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.545+0000 7fd1cd4bb800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:49:52.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.545+0000 7fd1cd4bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 : miss 2024-09-12T17:49:52.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.545+0000 7fd1cd4bb800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.546+0000 7fd1cd4bb800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:52.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.546+0000 7fd1cd4bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:52.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.546+0000 7fd1cd4bb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:52.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.546+0000 7fd1cd4bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:52.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.546+0000 7fd1cd4bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:52.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.546+0000 7fd1cd4bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 2024-09-12T17:49:52.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.549+0000 7fd1cd4bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.549+0000 7fd1cd4bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.549+0000 7fd1cd4bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.549+0000 7fd1cd4bb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29, ofs0, ns] 2024-09-12T17:49:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.550+0000 7fd0ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464327 cookie 94043161094480 notifier 6975 bl.length()=999 2024-09-12T17:49:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.550+0000 7fd0ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.550+0000 7fd0ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.550+0000 7fd0ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.550+0000 7fd1cd4bb800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): orig_sources= new_sources= 2024-09-12T17:49:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.550+0000 7fd1cd4bb800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): potential sources added=[] removed=[] 2024-09-12T17:49:52.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.550+0000 7fd1cd4bb800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): orig_dests= new_dests= 2024-09-12T17:49:52.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.550+0000 7fd1cd4bb800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): potential dests added=[] removed=[] 2024-09-12T17:49:52.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.552+0000 7fd1cd4bb800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.29.1.0 2024-09-12T17:49:52.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.552+0000 7fd1cd4bb800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.29.1.0 2024-09-12T17:49:52.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.552+0000 7fd1cd4bb800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.29.1.1 2024-09-12T17:49:52.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.552+0000 7fd1cd4bb800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.29.1.1 2024-09-12T17:49:52.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.552+0000 7fd1cd4bb800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.29.0 2024-09-12T17:49:52.555 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.554+0000 7fd1cd4bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:52.555 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.554+0000 7fd1cd4bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 2024-09-12T17:49:52.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.555+0000 7fd1cd4bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:52.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.555+0000 7fd1cd4bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:52.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.555+0000 7fd1cd4bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:52.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.555+0000 7fd1cd4bb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29, ofs0, ns] 2024-09-12T17:49:52.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.555+0000 7fd0adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464328 cookie 94043161094480 notifier 6975 bl.length()=999 2024-09-12T17:49:52.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.555+0000 7fd0adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:52.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.555+0000 7fd0adffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:52.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.555+0000 7fd0adffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:52.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.556+0000 7fd1cd4bb800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): orig_sources= new_sources= 2024-09-12T17:49:52.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.556+0000 7fd1cd4bb800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): potential sources added=[] removed=[] 2024-09-12T17:49:52.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.556+0000 7fd1cd4bb800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): orig_dests= new_dests= 2024-09-12T17:49:52.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.556+0000 7fd1cd4bb800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): potential dests added=[] removed=[] 2024-09-12T17:49:52.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.557+0000 7fd1cd4bb800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.29.0 2024-09-12T17:49:52.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.557+0000 7fd1cd4bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:52.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.557+0000 7fd1cd4bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 2024-09-12T17:49:52.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.558+0000 7fd1cd4bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:52.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.558+0000 7fd1cd4bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:52.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.558+0000 7fd1cd4bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:52.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.558+0000 7fd1cd4bb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29, ofs0, ns] 2024-09-12T17:49:52.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.559+0000 7fd0ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 94043161094480 notifier 6975 bl.length()=967 2024-09-12T17:49:52.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.559+0000 7fd0ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 info.flags=0x17 2024-09-12T17:49:52.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.559+0000 7fd0ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 to cache LRU end 2024-09-12T17:49:52.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.559+0000 7fd0ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:52.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.559+0000 7fd1cd4bb800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): orig_sources= new_sources= 2024-09-12T17:49:52.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.559+0000 7fd1cd4bb800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): potential sources added=[] removed=[] 2024-09-12T17:49:52.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.559+0000 7fd1cd4bb800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): orig_dests= new_dests= 2024-09-12T17:49:52.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.559+0000 7fd1cd4bb800 20 handle_bi_update(): bucket=:error-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.29]): potential dests added=[] removed=[] 2024-09-12T17:49:52.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.560+0000 7fd1cd4bb800 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T17:49:52.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.562+0000 7fd0817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:52.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.564+0000 7fd1cd4bb800 20 remove_watcher() i=0 2024-09-12T17:49:52.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.564+0000 7fd1cd4bb800 2 removed watcher, disabling cache 2024-09-12T17:49:52.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.565+0000 7fd1cd4bb800 20 remove_watcher() i=1 2024-09-12T17:49:52.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.566+0000 7fd1cd4bb800 20 remove_watcher() i=2 2024-09-12T17:49:52.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.567+0000 7fd1cd4bb800 20 remove_watcher() i=3 2024-09-12T17:49:52.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.568+0000 7fd1cd4bb800 20 remove_watcher() i=4 2024-09-12T17:49:52.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.569+0000 7fd1cd4bb800 20 remove_watcher() i=5 2024-09-12T17:49:52.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.570+0000 7fd1cd4bb800 20 remove_watcher() i=6 2024-09-12T17:49:52.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.571+0000 7fd1cd4bb800 20 remove_watcher() i=7 2024-09-12T17:49:52.584 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:49:52.613 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:52.613 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:52.648 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.647+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.649+0000 7f3cca21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.649+0000 7f3cca21b800 20 realm 2024-09-12T17:49:52.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.649+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.649+0000 7f3cca21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.649+0000 7f3cca21b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:52.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.649+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.649+0000 7f3cca21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.649+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.650+0000 7f3cca21b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:52.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.650+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.651+0000 7f3cca21b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:52.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.651+0000 7f3cca21b800 20 searching for the correct realm 2024-09-12T17:49:52.654 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.653+0000 7f3cc59eb640 0 -- 172.21.15.107:0/2859309494 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f3cc002a030 msgr2=0x7f3cc0061f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:52.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.656+0000 7f3cc59eb640 0 -- 172.21.15.107:0/2859309494 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f3cb00b4d40 msgr2=0x7f3cb00c37d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:52.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:52.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:52.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:52.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:52.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:52.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:52.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:52.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:52.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 zone default found 2024-09-12T17:49:52.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 4 Realm: () 2024-09-12T17:49:52.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:52.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:52.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:52.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 zonegroup default 2024-09-12T17:49:52.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.864+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.865+0000 7f3cca21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.865+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.865+0000 7f3cca21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.865+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.865+0000 7f3cca21b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:52.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.865+0000 7f3cca21b800 20 started sync module instance, tier type = 2024-09-12T17:49:52.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.865+0000 7f3cca21b800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:52.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.874+0000 7f3cca21b800 20 add_watcher() i=0 2024-09-12T17:49:52.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.874+0000 7f3cca21b800 20 add_watcher() i=1 2024-09-12T17:49:52.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.874+0000 7f3cca21b800 20 add_watcher() i=2 2024-09-12T17:49:52.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.874+0000 7f3cca21b800 20 add_watcher() i=3 2024-09-12T17:49:52.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.874+0000 7f3cca21b800 20 add_watcher() i=4 2024-09-12T17:49:52.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.874+0000 7f3cca21b800 20 add_watcher() i=5 2024-09-12T17:49:52.875 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.874+0000 7f3cca21b800 20 add_watcher() i=6 2024-09-12T17:49:52.876 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.875+0000 7f3cca21b800 20 add_watcher() i=7 2024-09-12T17:49:52.876 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.875+0000 7f3cca21b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:52.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.876+0000 7f3b777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:52.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.877+0000 7f3cca21b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:52.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.877+0000 7f3cca21b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:52.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.877+0000 7f3cca21b800 5 note: GC not initialized 2024-09-12T17:49:52.878 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.877+0000 7f3b767fc640 20 reqs_thread_entry: start 2024-09-12T17:49:52.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.877+0000 7f3cca21b800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:52.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.877+0000 7f3cca21b800 20 Filter name: none 2024-09-12T17:49:52.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.877+0000 7f3ae7fff640 20 reqs_thread_entry: start 2024-09-12T17:49:52.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.877+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.878+0000 7f3cca21b800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:52.879 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.878+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.879+0000 7f3cca21b800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:52.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.879+0000 7f3cca21b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:52.880 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.879+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.879+0000 7f3cca21b800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:52.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.879+0000 7f3cca21b800 20 rados->read ofs=0 len=0 2024-09-12T17:49:52.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.880+0000 7f3cca21b800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:52.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.880+0000 7f3cca21b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:52.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.881+0000 7f3b777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:52.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.883+0000 7f3cca21b800 20 remove_watcher() i=0 2024-09-12T17:49:52.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.883+0000 7f3cca21b800 2 removed watcher, disabling cache 2024-09-12T17:49:52.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.884+0000 7f3cca21b800 20 remove_watcher() i=1 2024-09-12T17:49:52.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.885+0000 7f3cca21b800 20 remove_watcher() i=2 2024-09-12T17:49:52.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.886+0000 7f3cca21b800 20 remove_watcher() i=3 2024-09-12T17:49:52.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.887+0000 7f3cca21b800 20 remove_watcher() i=4 2024-09-12T17:49:52.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.888+0000 7f3cca21b800 20 remove_watcher() i=5 2024-09-12T17:49:52.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.889+0000 7f3cca21b800 20 remove_watcher() i=6 2024-09-12T17:49:52.890 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:52.889+0000 7f3cca21b800 20 remove_watcher() i=7 2024-09-12T17:49:52.900 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:52.900 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:52.901 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-block-writes id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:49:52.901 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:52.962 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T17:49:52.962 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.147 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:49:53.175 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:53.175 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:53.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.210+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.211+0000 7fe1d9332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.211+0000 7fe1d9332800 20 realm 2024-09-12T17:49:53.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.211+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.212+0000 7fe1d9332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.212+0000 7fe1d9332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:53.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.212+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.212+0000 7fe1d9332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.212+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.213+0000 7fe1d9332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:53.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.213+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.213+0000 7fe1d9332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:53.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.213+0000 7fe1d9332800 20 searching for the correct realm 2024-09-12T17:49:53.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.216+0000 7fe1d47bb640 0 -- 172.21.15.107:0/2274305928 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fe1c802a970 msgr2=0x7fe1c8039430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:53.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.220+0000 7fe1d4fbc640 0 -- 172.21.15.107:0/2274305928 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fe1c8048410 msgr2=0x7fe1c8048870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:49:53.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.426+0000 7fe1d9332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:53.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.426+0000 7fe1d9332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:53.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.426+0000 7fe1d9332800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:53.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.426+0000 7fe1d9332800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:53.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.426+0000 7fe1d9332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:53.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.426+0000 7fe1d9332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:53.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.426+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.426+0000 7fe1d9332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.426+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.427+0000 7fe1d9332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:53.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.427+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.427+0000 7fe1d9332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:53.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.427+0000 7fe1d9332800 20 zone default found 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.427+0000 7fe1d9332800 4 Realm: () 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.427+0000 7fe1d9332800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.427+0000 7fe1d9332800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.427+0000 7fe1d9332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.427+0000 7fe1d9332800 20 zonegroup default 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.427+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.427+0000 7fe1d9332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.427+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.428+0000 7fe1d9332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.428+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.428+0000 7fe1d9332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.428+0000 7fe1d9332800 20 started sync module instance, tier type = 2024-09-12T17:49:53.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.428+0000 7fe1d9332800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:53.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.436+0000 7fe1d9332800 20 add_watcher() i=0 2024-09-12T17:49:53.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.436+0000 7fe1d9332800 20 add_watcher() i=1 2024-09-12T17:49:53.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.436+0000 7fe1d9332800 20 add_watcher() i=2 2024-09-12T17:49:53.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.436+0000 7fe1d9332800 20 add_watcher() i=3 2024-09-12T17:49:53.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.436+0000 7fe1d9332800 20 add_watcher() i=4 2024-09-12T17:49:53.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.436+0000 7fe1d9332800 20 add_watcher() i=5 2024-09-12T17:49:53.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.436+0000 7fe1d9332800 20 add_watcher() i=6 2024-09-12T17:49:53.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.437+0000 7fe1d9332800 20 add_watcher() i=7 2024-09-12T17:49:53.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.437+0000 7fe1d9332800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:53.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.439+0000 7fe08afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:53.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.439+0000 7fe1d9332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:53.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.439+0000 7fe1d9332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:53.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.439+0000 7fe1d9332800 5 note: GC not initialized 2024-09-12T17:49:53.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.440+0000 7fe089fe3640 20 reqs_thread_entry: start 2024-09-12T17:49:53.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.440+0000 7fe1d9332800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:53.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.440+0000 7fe1d9332800 20 Filter name: none 2024-09-12T17:49:53.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.440+0000 7fdffb7fe640 20 reqs_thread_entry: start 2024-09-12T17:49:53.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.440+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.440+0000 7fe1d9332800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:53.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.440+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.441+0000 7fe1d9332800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:53.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.441+0000 7fe1d9332800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:53.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.441+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.441+0000 7fe1d9332800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:53.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.441+0000 7fe1d9332800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.442+0000 7fe1d9332800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:53.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.442+0000 7fe1d9332800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:53.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.443+0000 7fe08afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:53.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.445+0000 7fe1d9332800 20 remove_watcher() i=0 2024-09-12T17:49:53.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.445+0000 7fe1d9332800 2 removed watcher, disabling cache 2024-09-12T17:49:53.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.445+0000 7fe1d9332800 20 remove_watcher() i=1 2024-09-12T17:49:53.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.446+0000 7fe1d9332800 20 remove_watcher() i=2 2024-09-12T17:49:53.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.447+0000 7fe1d9332800 20 remove_watcher() i=3 2024-09-12T17:49:53.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.448+0000 7fe1d9332800 20 remove_watcher() i=4 2024-09-12T17:49:53.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.449+0000 7fe1d9332800 20 remove_watcher() i=5 2024-09-12T17:49:53.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.450+0000 7fe1d9332800 20 remove_watcher() i=6 2024-09-12T17:49:53.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.451+0000 7fe1d9332800 20 remove_watcher() i=7 2024-09-12T17:49:53.463 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.463 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:53.463 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-block-writes id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:49:53.463 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.464 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T17:49:53.498 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:53.498 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:53.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.535+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.536+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.536+0000 7f9bb2b23800 20 realm 2024-09-12T17:49:53.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.536+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.537+0000 7f9bb2b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:53.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:53.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.538+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:53.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.538+0000 7f9bb2b23800 20 searching for the correct realm 2024-09-12T17:49:53.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.539+0000 7f9baf014640 0 -- 172.21.15.107:0/3397757735 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55c639502c00 msgr2=0x55c6395050c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:53.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.542+0000 7f9baf014640 0 -- 172.21.15.107:0/3397757735 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7f9b9805f8c0 msgr2=0x7f9b980893a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:53.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:53.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:53.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:53.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:53.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:53.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:53.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:53.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 zone default found 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.752+0000 7f9bb2b23800 4 Realm: () 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.752+0000 7f9bb2b23800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.752+0000 7f9bb2b23800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.752+0000 7f9bb2b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 zonegroup default 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 started sync module instance, tier type = 2024-09-12T17:49:53.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:53.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=0 2024-09-12T17:49:53.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=1 2024-09-12T17:49:53.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=2 2024-09-12T17:49:53.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=3 2024-09-12T17:49:53.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=4 2024-09-12T17:49:53.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=5 2024-09-12T17:49:53.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=6 2024-09-12T17:49:53.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.763+0000 7f9bb2b23800 20 add_watcher() i=7 2024-09-12T17:49:53.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.763+0000 7f9bb2b23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:53.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.765+0000 7f9a65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:53.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.765+0000 7f9bb2b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:53.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.765+0000 7f9bb2b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:53.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 note: GC not initialized 2024-09-12T17:49:53.767 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.765+0000 7f9a64fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.765+0000 7f9bb2b23800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.765+0000 7f9bb2b23800 20 Filter name: none 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9a5dffb640 20 reqs_thread_entry: start 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 : miss 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:53.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 2024-09-12T17:49:53.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.770+0000 7f9bb2b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.770+0000 7f9bb2b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.770+0000 7f9bb2b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.770+0000 7f9bb2b23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30, ofs0, ns] 2024-09-12T17:49:53.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.770+0000 7f9a927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94309853468992 notifier 6650 bl.length()=999 2024-09-12T17:49:53.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.770+0000 7f9a927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.770+0000 7f9a927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.770+0000 7f9a927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.770+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_sources= new_sources= 2024-09-12T17:49:53.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.770+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential sources added=[] removed=[] 2024-09-12T17:49:53.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.770+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_dests= new_dests= 2024-09-12T17:49:53.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.770+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential dests added=[] removed=[] 2024-09-12T17:49:53.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.773+0000 7f9bb2b23800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.1.0 2024-09-12T17:49:53.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.773+0000 7f9bb2b23800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.1.0 2024-09-12T17:49:53.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.773+0000 7f9bb2b23800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.1.1 2024-09-12T17:49:53.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.773+0000 7f9bb2b23800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.1.1 2024-09-12T17:49:53.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.773+0000 7f9bb2b23800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.0 2024-09-12T17:49:53.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.775+0000 7f9bb2b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:53.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.775+0000 7f9bb2b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 2024-09-12T17:49:53.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.776+0000 7f9bb2b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.776+0000 7f9bb2b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.776+0000 7f9bb2b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.776+0000 7f9bb2b23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30, ofs0, ns] 2024-09-12T17:49:53.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.776+0000 7f9a91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94309853468992 notifier 6650 bl.length()=999 2024-09-12T17:49:53.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.776+0000 7f9a91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.776+0000 7f9a91ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.776+0000 7f9a91ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.777+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_sources= new_sources= 2024-09-12T17:49:53.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.777+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential sources added=[] removed=[] 2024-09-12T17:49:53.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.777+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_dests= new_dests= 2024-09-12T17:49:53.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.777+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential dests added=[] removed=[] 2024-09-12T17:49:53.778 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9bb2b23800 time 2024-09-12T17:49:53.778254+0000 2024-09-12T17:49:53.779 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:49:53.779 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:53.779 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9bb418c71a] 2024-09-12T17:49:53.779 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9bb418c8d8] 2024-09-12T17:49:53.779 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c637b0a841] 2024-09-12T17:49:53.779 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55c637b1979e] 2024-09-12T17:49:53.779 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c637b1a5d4] 2024-09-12T17:49:53.779 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9bb2e29590] 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.777+0000 7f9bb2b23800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9bb2b23800 time 2024-09-12T17:49:53.778254+0000 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9bb418c71a] 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9bb418c8d8] 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c637b0a841] 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55c637b1979e] 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c637b1a5d4] 2024-09-12T17:49:53.780 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:49:53.781 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9bb2e29590] 2024-09-12T17:49:53.781 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:49:53.781 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:49:53.781 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.781 INFO:tasks.workunit.client.0.smithi107.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:49:53.781 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f9bb2b23800 thread_name:radosgw-admin 2024-09-12T17:49:53.796 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:53.796 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9bb2e3e6f0] 2024-09-12T17:49:53.796 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9bb2e8b99c] 2024-09-12T17:49:53.796 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:49:53.796 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:49:53.796 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9bb418c774] 2024-09-12T17:49:53.796 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9bb418c8d8] 2024-09-12T17:49:53.796 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c637b0a841] 2024-09-12T17:49:53.796 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55c637b1979e] 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c637b1a5d4] 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9bb2e29590] 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.778+0000 7f9bb2b23800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f9bb2b23800 thread_name:radosgw-admin 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9bb2e3e6f0] 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9bb2e8b99c] 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:49:53.797 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9bb418c774] 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9bb418c8d8] 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c637b0a841] 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55c637b1979e] 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c637b1a5d4] 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9bb2e29590] 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c639414310) adding con mode: crc 2024-09-12T17:49:53.798 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c639414310) adding con mode: secure 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c639414310) adding con mode: crc 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c639414310) adding con mode: secure 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c639414310) adding con mode: crc 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c639414310) adding con mode: secure 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 1 librados: starting msgr at 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 1 librados: starting objecter 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command objecter_requests hook 0x55c639412570 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 1 librados: setting wanted keys 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 1 librados: calling monclient init 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 10 monclient: init 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding auth protocol: cephx 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding auth protocol: cephx 2024-09-12T17:49:53.799 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding auth protocol: cephx 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: secure 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: crc 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: secure 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: crc 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: secure 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: crc 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: crc 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: secure 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: crc 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: secure 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: crc 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: secure 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.800 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command rotate-key hook 0x55c63940ed78 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-c con 0x55c639411c70 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-a con 0x55c639440690 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-b con 0x7f9b9c0030f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): authenticate will time out at 1998.066187s 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): get_auth_request con 0x55c639411c70 auth_method 0 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.801 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request con 0x55c639440690 auth_method 0 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): get_auth_request con 0x7f9b9c0030f0 auth_method 0 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.802 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): handle_auth_done global_id 6641 payload 824 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient: _finish_hunting 0 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:49:53.520+0000 7f9bae813640 1 monclient: found mon.noname-c 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: dump: 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.803 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: _finish_auth 0 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: _check_auth_tickets 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:49:53.804 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: dump: 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 5 monclient: authenticate success, global_id 6641 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient: _renew_subs 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.805 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:49:53.520+0000 7f9a9ce09640 4 set_mon_vals no callback set 2024-09-12T17:49:53.806 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient: _renew_subs 2024-09-12T17:49:53.806 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.806 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 1 librados: init done 2024-09-12T17:49:53.806 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:49:53.522+0000 7f9a9b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:49:53.806 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:49:53.522+0000 7f9a9b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:53.806 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:49:53.522+0000 7f9a9b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:53.806 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:49:53.522+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x7f9a94076470 auth_method 0 2024-09-12T17:49:53.806 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:49:53.523+0000 7f9baf014640 10 monclient: get_auth_request con 0x55c63943c030 auth_method 0 2024-09-12T17:49:53.806 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:49:53.523+0000 7f9bae813640 10 monclient: get_auth_request con 0x55c63945a9c0 auth_method 0 2024-09-12T17:49:53.806 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:49:53.524+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x55c63945ebb0 auth_method 0 2024-09-12T17:49:53.806 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:49:53.524+0000 7f9a9b606640 1 client.6641.objecter ms_handle_reset 0x55c63945ebb0 session 0x55c63943c580 osd.2 2024-09-12T17:49:53.806 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:49:53.524+0000 7f9a9b606640 10 monclient: _renew_subs 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:49:53.524+0000 7f9a9b606640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:49:53.524+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x7f9a94086ba0 auth_method 0 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 10 monclient: build_initial_monmap 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 1 build_initial for_mkfs: 0 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 10 monclient: monmap: 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:53.807 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding auth protocol: cephx 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding auth protocol: cephx 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding auth protocol: cephx 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: secure 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: crc 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: secure 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: crc 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: secure 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: crc 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: crc 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: secure 2024-09-12T17:49:53.808 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: crc 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: secure 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: crc 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: secure 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command objecter_requests cmddesc objecter_requests hook 0x55c639464d20 EEXIST 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 10 monclient: init 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding auth protocol: cephx 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding auth protocol: cephx 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding auth protocol: cephx 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: secure 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: crc 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: secure 2024-09-12T17:49:53.809 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: crc 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: secure 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: crc 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: crc 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: secure 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: crc 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: secure 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: crc 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: secure 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command rotate-key cmddesc rotate-key hook 0x55c63945f630 EEXIST 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-a con 0x55c639488a10 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:53.810 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-b con 0x55c63948ace0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-c con 0x55c6394871e0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): authenticate will time out at 1998.073254s 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): get_auth_request con 0x55c639488a10 auth_method 0 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): get_auth_request con 0x55c6394871e0 auth_method 0 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.811 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:49:53.527+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request con 0x55c63948ace0 auth_method 0 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:49:53.527+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:49:53.527+0000 7f9ba7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:49:53.527+0000 7f9ba7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): handle_auth_done global_id 7023 payload 824 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient: _finish_hunting 0 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:49:53.527+0000 7f9bae813640 1 monclient: found mon.noname-a 2024-09-12T17:49:53.812 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: dump: 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.813 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: _finish_auth 0 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: _check_auth_tickets 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: dump: 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.814 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 5 monclient: authenticate success, global_id 7023 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:49:53.527+0000 7f9baf815640 4 set_mon_vals no callback set 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient: _renew_subs 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient: _renew_subs 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:49:53.529+0000 7f9a98e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:49:53.529+0000 7f9a98e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:49:53.529+0000 7f9a98e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:49:53.529+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x7f9a88076380 auth_method 0 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 10 monclient: get_monmap_and_config 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 10 monclient: build_initial_monmap 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 1 build_initial for_mkfs: 0 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 10 monclient: monmap: 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:53.815 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding auth protocol: cephx 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding auth protocol: cephx 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding auth protocol: cephx 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: secure 2024-09-12T17:49:53.816 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: crc 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: secure 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: crc 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: secure 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: crc 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: crc 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: secure 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: crc 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: secure 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: crc 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: secure 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient: init 2024-09-12T17:49:53.817 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding auth protocol: cephx 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding auth protocol: cephx 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding auth protocol: cephx 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: secure 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: crc 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: secure 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: crc 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: secure 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: crc 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: crc 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: secure 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: crc 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: secure 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: crc 2024-09-12T17:49:53.818 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: secure 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command rotate-key cmddesc rotate-key hook 0x7ffe69d833f8 EEXIST 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-c con 0x55c6394dccc0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-a con 0x55c6394d7260 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-b con 0x55c6394acb00 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): authenticate will time out at 1998.076919s 2024-09-12T17:49:53.819 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): get_auth_request con 0x55c6394dccc0 auth_method 0 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request con 0x55c6394d7260 auth_method 0 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.820 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:49:53.531+0000 7f9baf014640 10 monclient(hunting): get_auth_request con 0x55c6394acb00 auth_method 0 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:49:53.531+0000 7f9baf014640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:49:53.531+0000 7f9baf014640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:49:53.531+0000 7f9baf014640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): handle_auth_done global_id 6647 payload 274 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient: _finish_hunting 0 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:49:53.531+0000 7f9bae813640 1 monclient: found mon.noname-c 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: dump: 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.821 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: _finish_auth 0 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: _check_auth_tickets 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: dump: 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.822 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:49:53.531+0000 7f9bb2b23800 5 monclient: authenticate success, global_id 6647 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:49:53.531+0000 7f9bb2b23800 10 monclient: get_monmap_and_config success 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:49:53.531+0000 7f9bb2b23800 4 set_mon_vals no callback set 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:49:53.531+0000 7f9bb2b23800 10 monclient: shutdown 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 10 monclient: build_initial_monmap 2024-09-12T17:49:53.823 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 1 build_initial for_mkfs: 0 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 10 monclient: monmap: 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding auth protocol: cephx 2024-09-12T17:49:53.824 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding auth protocol: cephx 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding auth protocol: cephx 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: secure 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: crc 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: secure 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: crc 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: secure 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: crc 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: crc 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: secure 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: crc 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: secure 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: crc 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: secure 2024-09-12T17:49:53.825 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 1 librados: starting msgr at 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 1 librados: starting objecter 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command objecter_requests cmddesc objecter_requests hook 0x55c6394aec60 EEXIST 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 1 librados: setting wanted keys 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 1 librados: calling monclient init 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 10 monclient: init 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding auth protocol: cephx 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding auth protocol: cephx 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding auth protocol: cephx 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: secure 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: crc 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: secure 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: crc 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: secure 2024-09-12T17:49:53.826 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: crc 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: crc 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: secure 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: crc 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: secure 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: crc 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: secure 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command rotate-key cmddesc rotate-key hook 0x55c6394a0908 EEXIST 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-c con 0x55c6394acb00 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-a con 0x55c6394d7260 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:53.827 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-b con 0x55c6394dccc0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): authenticate will time out at 1998.079070s 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): get_auth_request con 0x55c6394acb00 auth_method 0 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request con 0x55c6394d7260 auth_method 0 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.828 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): handle_auth_done global_id 6650 payload 824 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient: _finish_hunting 0 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:49:53.533+0000 7f9bae813640 1 monclient: found mon.noname-c 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: dump: 2024-09-12T17:49:53.829 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: _finish_auth 0 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:53.830 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: dump: 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.831 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 5 monclient: authenticate success, global_id 6650 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient: _renew_subs 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:49:53.533+0000 7f9a927fc640 4 set_mon_vals no callback set 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient: _renew_subs 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 1 librados: init done 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command cr dump hook 0x55c6394d5e08 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:49:53.535+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:49:53.535+0000 7f9a90ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:49:53.535+0000 7f9a90ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:49:53.535+0000 7f9a90ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:49:53.536+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x7f9a780764a0 auth_method 0 2024-09-12T17:49:53.832 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:49:53.536+0000 7f9baf014640 10 monclient: get_auth_request con 0x55c6394f6380 auth_method 0 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:49:53.536+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:49:53.536+0000 7f9bb2b23800 20 realm 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:49:53.536+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:49:53.537+0000 7f9bae813640 10 monclient: get_auth_request con 0x55c6394fa760 auth_method 0 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:49:53.538+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x55c6394fde80 auth_method 0 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:49:53.538+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:53.833 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:49:53.538+0000 7f9bb2b23800 20 searching for the correct realm 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:49:53.538+0000 7f9baf014640 10 monclient: get_auth_request con 0x55c639502c00 auth_method 0 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:49:53.539+0000 7f9baf014640 0 -- 172.21.15.107:0/3397757735 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55c639502c00 msgr2=0x55c6395050c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:49:53.539+0000 7f9a90ff9640 1 client.6650.objecter ms_handle_reset 0x55c639502c00 session 0x55c639502580 osd.3 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:49:53.539+0000 7f9a90ff9640 10 monclient: _renew_subs 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:49:53.539+0000 7f9a90ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:49:53.539+0000 7f9baf014640 10 monclient: get_auth_request con 0x7f9a78086bd0 auth_method 0 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:49:53.539+0000 7f9bae813640 10 monclient: get_auth_request con 0x55c639351da0 auth_method 0 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:49:53.540+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x7f9b98060070 auth_method 0 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:49:53.542+0000 7f9baf014640 10 monclient: get_auth_request con 0x7f9b9805f8c0 auth_method 0 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:49:53.542+0000 7f9baf014640 0 -- 172.21.15.107:0/3397757735 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7f9b9805f8c0 msgr2=0x7f9b980893a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:49:53.744+0000 7f9baf014640 10 monclient: get_auth_request con 0x7f9b9805f8c0 auth_method 0 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:49:53.746+0000 7f9bae813640 10 monclient: get_auth_request con 0x7f9b98054390 auth_method 0 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:53.834 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 zone default found 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 4 Realm: () 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:53.835 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 zonegroup default 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 started sync module instance, tier type = 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=0 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=1 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=2 2024-09-12T17:49:53.836 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=3 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=4 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=5 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=6 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:49:53.763+0000 7f9bb2b23800 20 add_watcher() i=7 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:49:53.763+0000 7f9bb2b23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding auth protocol: cephx 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding auth protocol: cephx 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding auth protocol: cephx 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: secure 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: crc 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: secure 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: crc 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: secure 2024-09-12T17:49:53.837 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:49:53.765+0000 7f9a65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: crc 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: crc 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: secure 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: crc 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: secure 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: crc 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: secure 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command cache list hook 0x55c6394d2a90 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command cache inspect hook 0x55c6394d2a90 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command cache erase hook 0x55c6394d2a90 2024-09-12T17:49:53.838 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command cache zap hook 0x55c6394d2a90 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 note: GC not initialized 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:49:53.765+0000 7f9a64fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command sync trace show hook 0x7f9b980043a0 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command sync trace history hook 0x7f9b980043a0 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command sync trace active hook 0x7f9b980043a0 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command sync trace active_short hook 0x7f9b980043a0 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 20 Filter name: none 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:49:53.766+0000 7f9a5dffb640 20 reqs_thread_entry: start 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:49:53.839 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:49:53.840 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 : miss 2024-09-12T17:49:53.840 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.840 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:53.840 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.840 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.840 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:53.840 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.840 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 2024-09-12T17:49:53.840 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.840 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.840 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.840 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30, ofs0, ns] 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:49:53.770+0000 7f9a927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94309853468992 notifier 6650 bl.length()=999 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:49:53.770+0000 7f9a927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:49:53.770+0000 7f9a927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:49:53.770+0000 7f9a927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_sources= new_sources= 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential sources added=[] removed=[] 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_dests= new_dests= 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential dests added=[] removed=[] 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:49:53.773+0000 7f9bb2b23800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.1.0 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:49:53.773+0000 7f9bb2b23800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.1.0 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:49:53.773+0000 7f9bb2b23800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.1.1 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:49:53.773+0000 7f9bb2b23800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.1.1 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:49:53.773+0000 7f9bb2b23800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.0 2024-09-12T17:49:53.841 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:49:53.775+0000 7f9bb2b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:49:53.775+0000 7f9bb2b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:49:53.776+0000 7f9bb2b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:49:53.776+0000 7f9bb2b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:49:53.776+0000 7f9bb2b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:49:53.776+0000 7f9bb2b23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30, ofs0, ns] 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:49:53.776+0000 7f9a91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94309853468992 notifier 6650 bl.length()=999 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:49:53.776+0000 7f9a91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:49:53.776+0000 7f9a91ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:49:53.776+0000 7f9a91ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:49:53.777+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_sources= new_sources= 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:49:53.777+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential sources added=[] removed=[] 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:49:53.777+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_dests= new_dests= 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:49:53.777+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential dests added=[] removed=[] 2024-09-12T17:49:53.842 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:49:53.777+0000 7f9bb2b23800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9bb2b23800 time 2024-09-12T17:49:53.778254+0000 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9bb418c71a] 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9bb418c8d8] 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c637b0a841] 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55c637b1979e] 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c637b1a5d4] 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9bb2e29590] 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:49:53.778+0000 7f9bb2b23800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:49:53.843 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f9bb2b23800 thread_name:radosgw-admin 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9bb2e3e6f0] 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9bb2e8b99c] 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9bb418c774] 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9bb418c8d8] 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c637b0a841] 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55c637b1979e] 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c637b1a5d4] 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:49:53.844 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9bb2e29590] 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:49:53.845 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:49:53.846 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:49:53.847 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:49:53.848 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:49:53.849 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:49:53.850 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a5dffb640 / http_manager 2024-09-12T17:49:53.851 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a64fe1640 / http_manager 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a65fe3640 / rgw_dt_lg_renew 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a90ff9640 / ms_dispatch 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a91ffb640 / io_context_pool 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a927fc640 / io_context_pool 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a98e01640 / ms_dispatch 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a9b606640 / ms_dispatch 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a9ce09640 / io_context_pool 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9ba7fff640 / msgr-worker-2 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9bae813640 / msgr-worker-1 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9baf014640 / msgr-worker-0 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9baf815640 / io_context_pool 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9bb2b23800 / radosgw-admin 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:49:53.852 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/log/ceph/ceph-client.admin.113610.log 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c639414310) adding con mode: crc 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c639414310) adding con mode: secure 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c639414310) adding con mode: crc 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c639414310) adding con mode: secure 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c639414310) adding con mode: crc 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c639414310) adding con mode: secure 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 1 librados: starting msgr at 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 1 librados: starting objecter 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command objecter_requests hook 0x55c639412570 2024-09-12T17:49:53.853 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 1 librados: setting wanted keys 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 1 librados: calling monclient init 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 10 monclient: init 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding auth protocol: cephx 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding auth protocol: cephx 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding auth protocol: cephx 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: secure 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: crc 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: secure 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: crc 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: secure 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: crc 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: crc 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: secure 2024-09-12T17:49:53.854 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: crc 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: secure 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: crc 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 5 AuthRegistry(0x55c63940ec30) adding con mode: secure 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:49:53.519+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command rotate-key hook 0x55c63940ed78 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-c con 0x55c639411c70 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-a con 0x55c639440690 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-b con 0x7f9b9c0030f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.855 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient(hunting): authenticate will time out at 1998.066187s 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): get_auth_request con 0x55c639411c70 auth_method 0 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request con 0x55c639440690 auth_method 0 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.856 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:49:53.520+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): get_auth_request con 0x7f9b9c0030f0 auth_method 0 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:49:53.520+0000 7f9baf014640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient(hunting): handle_auth_done global_id 6641 payload 824 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient: _finish_hunting 0 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:49:53.520+0000 7f9bae813640 1 monclient: found mon.noname-c 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:49:53.520+0000 7f9bae813640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.857 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: dump: 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: _finish_auth 0 2024-09-12T17:49:53.858 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: _check_auth_tickets 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:49:53.520+0000 7f9a9b606640 10 monclient: dump: 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.859 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 5 monclient: authenticate success, global_id 6641 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient: _renew_subs 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:49:53.520+0000 7f9a9ce09640 4 set_mon_vals no callback set 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient: _renew_subs 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:49:53.520+0000 7f9bb2b23800 1 librados: init done 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:49:53.522+0000 7f9a9b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:49:53.522+0000 7f9a9b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:49:53.522+0000 7f9a9b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:49:53.522+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x7f9a94076470 auth_method 0 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:49:53.523+0000 7f9baf014640 10 monclient: get_auth_request con 0x55c63943c030 auth_method 0 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:49:53.523+0000 7f9bae813640 10 monclient: get_auth_request con 0x55c63945a9c0 auth_method 0 2024-09-12T17:49:53.860 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:49:53.524+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x55c63945ebb0 auth_method 0 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:49:53.524+0000 7f9a9b606640 1 client.6641.objecter ms_handle_reset 0x55c63945ebb0 session 0x55c63943c580 osd.2 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:49:53.524+0000 7f9a9b606640 10 monclient: _renew_subs 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:49:53.524+0000 7f9a9b606640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:49:53.524+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x7f9a94086ba0 auth_method 0 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 10 monclient: build_initial_monmap 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 1 build_initial for_mkfs: 0 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 10 monclient: monmap: 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.861 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding auth protocol: cephx 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding auth protocol: cephx 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding auth protocol: cephx 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: secure 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: crc 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: secure 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: crc 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: secure 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: crc 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: crc 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: secure 2024-09-12T17:49:53.862 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: crc 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: secure 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: crc 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c639460d70) adding con mode: secure 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command objecter_requests cmddesc objecter_requests hook 0x55c639464d20 EEXIST 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 10 monclient: init 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding auth protocol: cephx 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding auth protocol: cephx 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding auth protocol: cephx 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: secure 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: crc 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: secure 2024-09-12T17:49:53.863 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: crc 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: secure 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: crc 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: crc 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: secure 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: crc 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: secure 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: crc 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 5 AuthRegistry(0x55c63945f4e8) adding con mode: secure 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:49:53.526+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command rotate-key cmddesc rotate-key hook 0x55c63945f630 EEXIST 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:49:53.864 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-a con 0x55c639488a10 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-b con 0x55c63948ace0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-c con 0x55c6394871e0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient(hunting): authenticate will time out at 1998.073254s 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): get_auth_request con 0x55c639488a10 auth_method 0 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): get_auth_request con 0x55c6394871e0 auth_method 0 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.865 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:49:53.527+0000 7f9baf014640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:49:53.527+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request con 0x55c63948ace0 auth_method 0 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:49:53.527+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:49:53.527+0000 7f9ba7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:49:53.527+0000 7f9ba7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient(hunting): handle_auth_done global_id 7023 payload 824 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient: _finish_hunting 0 2024-09-12T17:49:53.866 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:49:53.527+0000 7f9bae813640 1 monclient: found mon.noname-a 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:49:53.527+0000 7f9bae813640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: dump: 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.867 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: _finish_auth 0 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: _check_auth_tickets 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:49:53.527+0000 7f9a98e01640 10 monclient: dump: 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.868 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.869 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.869 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 5 monclient: authenticate success, global_id 7023 2024-09-12T17:49:53.869 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:49:53.527+0000 7f9baf815640 4 set_mon_vals no callback set 2024-09-12T17:49:53.869 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient: _renew_subs 2024-09-12T17:49:53.869 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:53.869 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient: _renew_subs 2024-09-12T17:49:53.869 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:49:53.527+0000 7f9bb2b23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:49:53.869 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:49:53.529+0000 7f9a98e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:49:53.869 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:49:53.529+0000 7f9a98e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:53.869 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:49:53.529+0000 7f9a98e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:49:53.529+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x7f9a88076380 auth_method 0 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 10 monclient: get_monmap_and_config 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 10 monclient: build_initial_monmap 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 1 build_initial for_mkfs: 0 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 10 monclient: monmap: 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:53.870 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding auth protocol: cephx 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding auth protocol: cephx 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding auth protocol: cephx 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: secure 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: crc 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: secure 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: crc 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: secure 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: crc 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: crc 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: secure 2024-09-12T17:49:53.871 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: crc 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: secure 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: crc 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:49:53.529+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a8740) adding con mode: secure 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient: init 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding auth protocol: cephx 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding auth protocol: cephx 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding auth protocol: cephx 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: secure 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: crc 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: secure 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: crc 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: secure 2024-09-12T17:49:53.872 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: crc 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: crc 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: secure 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: crc 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: secure 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: crc 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d832b0) adding con mode: secure 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command rotate-key cmddesc rotate-key hook 0x7ffe69d833f8 EEXIST 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-c con 0x55c6394dccc0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-a con 0x55c6394d7260 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:53.873 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-b con 0x55c6394acb00 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:49:53.530+0000 7f9bb2b23800 10 monclient(hunting): authenticate will time out at 1998.076919s 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): get_auth_request con 0x55c6394dccc0 auth_method 0 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request con 0x55c6394d7260 auth_method 0 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.874 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:49:53.531+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:49:53.531+0000 7f9baf014640 10 monclient(hunting): get_auth_request con 0x55c6394acb00 auth_method 0 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:49:53.531+0000 7f9baf014640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:49:53.531+0000 7f9baf014640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:49:53.531+0000 7f9baf014640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient(hunting): handle_auth_done global_id 6647 payload 274 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient: _finish_hunting 0 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:49:53.531+0000 7f9bae813640 1 monclient: found mon.noname-c 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:49:53.531+0000 7f9bae813640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.875 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: dump: 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: _finish_auth 0 2024-09-12T17:49:53.876 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: _check_auth_tickets 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:49:53.531+0000 7f9a927fc640 10 monclient: dump: 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.877 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:49:53.531+0000 7f9bb2b23800 5 monclient: authenticate success, global_id 6647 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:49:53.531+0000 7f9bb2b23800 10 monclient: get_monmap_and_config success 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:49:53.531+0000 7f9bb2b23800 4 set_mon_vals no callback set 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:49:53.531+0000 7f9bb2b23800 10 monclient: shutdown 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 10 monclient: build_initial_monmap 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 1 build_initial for_mkfs: 0 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 10 monclient: monmap: 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.878 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding auth protocol: cephx 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding auth protocol: cephx 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding auth protocol: cephx 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: secure 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: crc 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: secure 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: crc 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: secure 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: crc 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: crc 2024-09-12T17:49:53.879 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: secure 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: crc 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: secure 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: crc 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394d80e0) adding con mode: secure 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 1 librados: starting msgr at 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 1 librados: starting objecter 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command objecter_requests cmddesc objecter_requests hook 0x55c6394aec60 EEXIST 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 1 librados: setting wanted keys 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 1 librados: calling monclient init 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 10 monclient: init 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding auth protocol: cephx 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding auth protocol: cephx 2024-09-12T17:49:53.880 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding auth protocol: cephx 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: secure 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: crc 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: secure 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: crc 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: secure 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: crc 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: crc 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: secure 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: crc 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: secure 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: crc 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 5 AuthRegistry(0x55c6394a07c0) adding con mode: secure 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.881 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:49:53.532+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command rotate-key cmddesc rotate-key hook 0x55c6394a0908 EEXIST 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient: _reopen_session rank -1 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-c con 0x55c6394acb00 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-a con 0x55c6394d7260 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): picked mon.noname-b con 0x55c6394dccc0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): start opening mon connection 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): _renew_subs 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient(hunting): authenticate will time out at 1998.079070s 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): get_auth_request con 0x55c6394acb00 auth_method 0 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.882 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request con 0x55c6394d7260 auth_method 0 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:49:53.533+0000 7f9ba7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient(hunting): handle_auth_done global_id 6650 payload 824 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient: _finish_hunting 0 2024-09-12T17:49:53.883 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:49:53.533+0000 7f9bae813640 1 monclient: found mon.noname-c 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:49:53.533+0000 7f9bae813640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: dump: 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.884 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: _finish_auth 0 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:49:53.533+0000 7f9a90ff9640 10 monclient: dump: 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:49:53.885 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 5 monclient: authenticate success, global_id 6650 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient: _renew_subs 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:49:53.533+0000 7f9a927fc640 4 set_mon_vals no callback set 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient: _renew_subs 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 1 librados: init done 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:49:53.533+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command cr dump hook 0x55c6394d5e08 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:49:53.535+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:49:53.535+0000 7f9a90ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:49:53.886 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:49:53.535+0000 7f9a90ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:49:53.535+0000 7f9a90ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:49:53.536+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x7f9a780764a0 auth_method 0 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:49:53.536+0000 7f9baf014640 10 monclient: get_auth_request con 0x55c6394f6380 auth_method 0 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:49:53.536+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:49:53.536+0000 7f9bb2b23800 20 realm 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:49:53.536+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:49:53.537+0000 7f9bae813640 10 monclient: get_auth_request con 0x55c6394fa760 auth_method 0 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:53.887 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:49:53.537+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:49:53.538+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x55c6394fde80 auth_method 0 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:49:53.538+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:49:53.538+0000 7f9bb2b23800 20 searching for the correct realm 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:49:53.538+0000 7f9baf014640 10 monclient: get_auth_request con 0x55c639502c00 auth_method 0 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:49:53.539+0000 7f9baf014640 0 -- 172.21.15.107:0/3397757735 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55c639502c00 msgr2=0x55c6395050c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:49:53.539+0000 7f9a90ff9640 1 client.6650.objecter ms_handle_reset 0x55c639502c00 session 0x55c639502580 osd.3 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:49:53.539+0000 7f9a90ff9640 10 monclient: _renew_subs 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:49:53.539+0000 7f9a90ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:49:53.539+0000 7f9baf014640 10 monclient: get_auth_request con 0x7f9a78086bd0 auth_method 0 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:49:53.539+0000 7f9bae813640 10 monclient: get_auth_request con 0x55c639351da0 auth_method 0 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:49:53.540+0000 7f9ba7fff640 10 monclient: get_auth_request con 0x7f9b98060070 auth_method 0 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:49:53.542+0000 7f9baf014640 10 monclient: get_auth_request con 0x7f9b9805f8c0 auth_method 0 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:49:53.542+0000 7f9baf014640 0 -- 172.21.15.107:0/3397757735 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7f9b9805f8c0 msgr2=0x7f9b980893a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:53.888 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:49:53.744+0000 7f9baf014640 10 monclient: get_auth_request con 0x7f9b9805f8c0 auth_method 0 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:49:53.746+0000 7f9bae813640 10 monclient: get_auth_request con 0x7f9b98054390 auth_method 0 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:49:53.751+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.889 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 zone default found 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 4 Realm: () 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 zonegroup default 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:49:53.752+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 started sync module instance, tier type = 2024-09-12T17:49:53.890 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:49:53.753+0000 7f9bb2b23800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=0 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=1 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=2 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=3 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=4 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=5 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:49:53.762+0000 7f9bb2b23800 20 add_watcher() i=6 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:49:53.763+0000 7f9bb2b23800 20 add_watcher() i=7 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:49:53.763+0000 7f9bb2b23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding auth protocol: cephx 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding auth protocol: cephx 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding auth protocol: cephx 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: secure 2024-09-12T17:49:53.891 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: crc 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: secure 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: crc 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: secure 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:49:53.765+0000 7f9a65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: crc 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: crc 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: secure 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: crc 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: secure 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: crc 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 AuthRegistry(0x7ffe69d83780) adding con mode: secure 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:53.892 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command cache list hook 0x55c6394d2a90 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command cache inspect hook 0x55c6394d2a90 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command cache erase hook 0x55c6394d2a90 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command cache zap hook 0x55c6394d2a90 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 note: GC not initialized 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:49:53.765+0000 7f9a64fe1640 20 reqs_thread_entry: start 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command sync trace show hook 0x7f9b980043a0 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command sync trace history hook 0x7f9b980043a0 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command sync trace active hook 0x7f9b980043a0 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 5 asok(0x55c6391ea730) register_command sync trace active_short hook 0x7f9b980043a0 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:49:53.765+0000 7f9bb2b23800 20 Filter name: none 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:49:53.766+0000 7f9a5dffb640 20 reqs_thread_entry: start 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:49:53.893 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 : miss 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:49:53.766+0000 7f9bb2b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.894 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30, ofs0, ns] 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:49:53.770+0000 7f9a927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94309853468992 notifier 6650 bl.length()=999 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:49:53.770+0000 7f9a927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:49:53.770+0000 7f9a927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:49:53.770+0000 7f9a927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_sources= new_sources= 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential sources added=[] removed=[] 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_dests= new_dests= 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:49:53.770+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential dests added=[] removed=[] 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:49:53.773+0000 7f9bb2b23800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.1.0 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:49:53.773+0000 7f9bb2b23800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.1.0 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:49:53.773+0000 7f9bb2b23800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.1.1 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:49:53.773+0000 7f9bb2b23800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.1.1 2024-09-12T17:49:53.895 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:49:53.773+0000 7f9bb2b23800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.0 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:49:53.775+0000 7f9bb2b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:49:53.775+0000 7f9bb2b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:49:53.776+0000 7f9bb2b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:49:53.776+0000 7f9bb2b23800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:49:53.776+0000 7f9bb2b23800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:49:53.776+0000 7f9bb2b23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30, ofs0, ns] 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:49:53.776+0000 7f9a91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94309853468992 notifier 6650 bl.length()=999 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:49:53.776+0000 7f9a91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:49:53.776+0000 7f9a91ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:49:53.776+0000 7f9a91ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:49:53.777+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_sources= new_sources= 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:49:53.777+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential sources added=[] removed=[] 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:49:53.777+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_dests= new_dests= 2024-09-12T17:49:53.896 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:49:53.777+0000 7f9bb2b23800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential dests added=[] removed=[] 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:49:53.777+0000 7f9bb2b23800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9bb2b23800 time 2024-09-12T17:49:53.778254+0000 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9bb418c71a] 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9bb418c8d8] 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c637b0a841] 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55c637b1979e] 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c637b1a5d4] 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9bb2e29590] 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:49:53.897 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:49:53.778+0000 7f9bb2b23800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f9bb2b23800 thread_name:radosgw-admin 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9bb2e3e6f0] 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9bb2e8b99c] 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9bb418c774] 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9bb418c8d8] 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c637b0a841] 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55c637b1979e] 2024-09-12T17:49:53.898 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c637b1a5d4] 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9bb2e29590] 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:49:53.899 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:49:53.900 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:49:53.901 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:49:53.902 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:49:53.903 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:49:53.904 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:49:53.905 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a5dffb640 / http_manager 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a64fe1640 / http_manager 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a65fe3640 / rgw_dt_lg_renew 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a90ff9640 / ms_dispatch 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a91ffb640 / io_context_pool 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a927fc640 / io_context_pool 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a98e01640 / ms_dispatch 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a9b606640 / ms_dispatch 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9a9ce09640 / io_context_pool 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9ba7fff640 / msgr-worker-2 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9bae813640 / msgr-worker-1 2024-09-12T17:49:53.906 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9baf014640 / msgr-worker-0 2024-09-12T17:49:53.907 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9baf815640 / io_context_pool 2024-09-12T17:49:53.907 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9bb2b23800 / radosgw-admin 2024-09-12T17:49:53.907 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:49:53.907 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:49:53.907 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:49:53.779853Z_acac11e0-e844-485e-8f10-5780f5b851ce/log 2024-09-12T17:49:53.907 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:49:53.907 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:49:53.912 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:53.912 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:53.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.853+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.855+0000 7f9bf9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.855+0000 7f9bf9e32800 20 realm 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.855+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.855+0000 7f9bf9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.855+0000 7f9bf9e32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.855+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.855+0000 7f9bf9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.855+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.856+0000 7f9bf9e32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.856+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.856+0000 7f9bf9e32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.856+0000 7f9bf9e32800 20 searching for the correct realm 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.859+0000 7f9bf5954640 0 -- 172.21.15.107:0/3592649570 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x557c4560ea00 msgr2=0x557c45610ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:53.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.862+0000 7f9bf5153640 0 -- 172.21.15.107:0/3592649570 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f9be0072100 msgr2=0x7f9be009f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.866+0000 7f9bf9e32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.866+0000 7f9bf9e32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.866+0000 7f9bf9e32800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.866+0000 7f9bf9e32800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.866+0000 7f9bf9e32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.866+0000 7f9bf9e32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.866+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.866+0000 7f9bf9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.866+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.866+0000 7f9bf9e32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.866+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 20 zone default found 2024-09-12T17:49:53.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 4 Realm: () 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 20 zonegroup default 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 20 started sync module instance, tier type = 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.867+0000 7f9bf9e32800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.876+0000 7f9bf9e32800 20 add_watcher() i=0 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.876+0000 7f9bf9e32800 20 add_watcher() i=1 2024-09-12T17:49:53.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.876+0000 7f9bf9e32800 20 add_watcher() i=2 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.876+0000 7f9bf9e32800 20 add_watcher() i=3 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.876+0000 7f9bf9e32800 20 add_watcher() i=4 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.876+0000 7f9bf9e32800 20 add_watcher() i=5 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.876+0000 7f9bf9e32800 20 add_watcher() i=6 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.877+0000 7f9bf9e32800 20 add_watcher() i=7 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.877+0000 7f9bf9e32800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.878+0000 7f9aab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.879+0000 7f9bf9e32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.879+0000 7f9bf9e32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.879+0000 7f9bf9e32800 5 note: GC not initialized 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.879+0000 7f9aaa7e4640 20 reqs_thread_entry: start 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.879+0000 7f9bf9e32800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.879+0000 7f9bf9e32800 20 Filter name: none 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.879+0000 7f9a1bfff640 20 reqs_thread_entry: start 2024-09-12T17:49:53.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.879+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.879+0000 7f9bf9e32800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.879+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.880+0000 7f9bf9e32800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.880+0000 7f9bf9e32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.880+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.880+0000 7f9bf9e32800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.880+0000 7f9bf9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.881+0000 7f9bf9e32800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.881+0000 7f9bf9e32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.882+0000 7f9aab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.884+0000 7f9bf9e32800 20 remove_watcher() i=0 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.884+0000 7f9bf9e32800 2 removed watcher, disabling cache 2024-09-12T17:49:53.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.885+0000 7f9bf9e32800 20 remove_watcher() i=1 2024-09-12T17:49:53.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.886+0000 7f9bf9e32800 20 remove_watcher() i=2 2024-09-12T17:49:53.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.887+0000 7f9bf9e32800 20 remove_watcher() i=3 2024-09-12T17:49:53.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.888+0000 7f9bf9e32800 20 remove_watcher() i=4 2024-09-12T17:49:53.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.889+0000 7f9bf9e32800 20 remove_watcher() i=5 2024-09-12T17:49:53.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.890+0000 7f9bf9e32800 20 remove_watcher() i=6 2024-09-12T17:49:53.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:53.891+0000 7f9bf9e32800 20 remove_watcher() i=7 2024-09-12T17:49:53.918 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.918 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:49:53.918 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-block-writes id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:49:53.918 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:49:53.953 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:49:53.985 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:49:53.985 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:49:54.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.020+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.021+0000 7ffac730c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.021+0000 7ffac730c800 20 realm 2024-09-12T17:49:54.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.021+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.022+0000 7ffac730c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.022+0000 7ffac730c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:49:54.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.022+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.022+0000 7ffac730c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.022+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.022+0000 7ffac730c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:54.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.022+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.023+0000 7ffac730c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:49:54.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.023+0000 7ffac730c800 20 searching for the correct realm 2024-09-12T17:49:54.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.027+0000 7ffac45f5640 0 -- 172.21.15.107:0/1968764349 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7ffaac01f040 msgr2=0x7ffaac036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:54.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.030+0000 7ffac55f7640 0 -- 172.21.15.107:0/1968764349 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7ffaac056040 msgr2=0x7ffaac013920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:49:54.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.033+0000 7ffac730c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:49:54.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.033+0000 7ffac730c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:49:54.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.033+0000 7ffac730c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:49:54.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.033+0000 7ffac730c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.033+0000 7ffac730c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.033+0000 7ffac730c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.033+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 20 zone default found 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 4 Realm: () 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:49:54.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 20 zonegroup default 2024-09-12T17:49:54.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.034+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.035+0000 7ffac730c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.035+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.035+0000 7ffac730c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:49:54.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.035+0000 7ffac730c800 20 started sync module instance, tier type = 2024-09-12T17:49:54.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.035+0000 7ffac730c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:49:54.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.044+0000 7ffac730c800 20 add_watcher() i=0 2024-09-12T17:49:54.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.044+0000 7ffac730c800 20 add_watcher() i=1 2024-09-12T17:49:54.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.044+0000 7ffac730c800 20 add_watcher() i=2 2024-09-12T17:49:54.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.044+0000 7ffac730c800 20 add_watcher() i=3 2024-09-12T17:49:54.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.044+0000 7ffac730c800 20 add_watcher() i=4 2024-09-12T17:49:54.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.044+0000 7ffac730c800 20 add_watcher() i=5 2024-09-12T17:49:54.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.044+0000 7ffac730c800 20 add_watcher() i=6 2024-09-12T17:49:54.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.045+0000 7ffac730c800 20 add_watcher() i=7 2024-09-12T17:49:54.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.045+0000 7ffac730c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:49:54.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.046+0000 7ff97b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.047+0000 7ffac730c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:49:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.047+0000 7ffac730c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:49:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.047+0000 7ffac730c800 5 note: GC not initialized 2024-09-12T17:49:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.047+0000 7ff97a7e4640 20 reqs_thread_entry: start 2024-09-12T17:49:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.047+0000 7ffac730c800 20 init_complete bucket index max shards: 1 2024-09-12T17:49:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.047+0000 7ffac730c800 20 Filter name: none 2024-09-12T17:49:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.047+0000 7ff973fff640 20 reqs_thread_entry: start 2024-09-12T17:49:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.047+0000 7ffac730c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:49:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.047+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.048+0000 7ffac730c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:49:54.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.048+0000 7ffac730c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:49:54.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.048+0000 7ffac730c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:49:54.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.048+0000 7ffac730c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 : miss 2024-09-12T17:49:54.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.048+0000 7ffac730c800 20 rados->read ofs=0 len=0 2024-09-12T17:49:54.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.048+0000 7ffac730c800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:49:54.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.048+0000 7ffac730c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:49:54.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.048+0000 7ffac730c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:49:54.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.048+0000 7ffac730c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:49:54.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.048+0000 7ffac730c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:49:54.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.048+0000 7ffac730c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 2024-09-12T17:49:54.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.050+0000 7ffac730c800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to be held by another RGW process; skipping for now 2024-09-12T17:49:54.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.050+0000 7ff97b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:49:54.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.052+0000 7ffac730c800 20 remove_watcher() i=0 2024-09-12T17:49:54.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.052+0000 7ffac730c800 2 removed watcher, disabling cache 2024-09-12T17:49:54.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.054+0000 7ffac730c800 20 remove_watcher() i=1 2024-09-12T17:49:54.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.055+0000 7ffac730c800 20 remove_watcher() i=2 2024-09-12T17:49:54.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.056+0000 7ffac730c800 20 remove_watcher() i=3 2024-09-12T17:49:54.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.057+0000 7ffac730c800 20 remove_watcher() i=4 2024-09-12T17:49:54.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.057+0000 7ffac730c800 20 remove_watcher() i=5 2024-09-12T17:49:54.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.058+0000 7ffac730c800 20 remove_watcher() i=6 2024-09-12T17:49:54.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:49:54.059+0000 7ffac730c800 20 remove_watcher() i=7 2024-09-12T17:49:54.071 INFO:tasks.workunit.client.0.smithi107.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:50:24.104 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:50:24.139 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:24.139 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:24.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.180+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.182+0000 7f826660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.182+0000 7f826660f800 20 realm 2024-09-12T17:50:24.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.182+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.182+0000 7f826660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.182+0000 7f826660f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:24.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.182+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.182+0000 7f826660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.182+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.183+0000 7f826660f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:24.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.183+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.184+0000 7f826660f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:24.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.184+0000 7f826660f800 20 searching for the correct realm 2024-09-12T17:50:24.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.187+0000 7f8262593640 0 -- 172.21.15.107:0/1435562157 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x562bf9a546b0 msgr2=0x562bf9a56b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:24.192 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.191+0000 7f8261d92640 0 -- 172.21.15.107:0/1435562157 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f824c0e1350 msgr2=0x7f824c0e39e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:50:24.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.196+0000 7f826660f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:24.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.196+0000 7f826660f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:24.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.196+0000 7f826660f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:24.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.196+0000 7f826660f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:24.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.196+0000 7f826660f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:24.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.196+0000 7f826660f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:24.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.196+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.197+0000 7f826660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.197+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.197+0000 7f826660f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:24.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.197+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.197+0000 7f826660f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:24.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.197+0000 7f826660f800 20 zone default found 2024-09-12T17:50:24.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.197+0000 7f826660f800 4 Realm: () 2024-09-12T17:50:24.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.197+0000 7f826660f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:24.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.197+0000 7f826660f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:24.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.197+0000 7f826660f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:24.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.197+0000 7f826660f800 20 zonegroup default 2024-09-12T17:50:24.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.197+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.198+0000 7f826660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.198+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.198+0000 7f826660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.198+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.198+0000 7f826660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.198+0000 7f826660f800 20 started sync module instance, tier type = 2024-09-12T17:50:24.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.198+0000 7f826660f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:24.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.208+0000 7f826660f800 20 add_watcher() i=0 2024-09-12T17:50:24.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.208+0000 7f826660f800 20 add_watcher() i=1 2024-09-12T17:50:24.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.208+0000 7f826660f800 20 add_watcher() i=2 2024-09-12T17:50:24.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.208+0000 7f826660f800 20 add_watcher() i=3 2024-09-12T17:50:24.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.208+0000 7f826660f800 20 add_watcher() i=4 2024-09-12T17:50:24.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.208+0000 7f826660f800 20 add_watcher() i=5 2024-09-12T17:50:24.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.208+0000 7f826660f800 20 add_watcher() i=6 2024-09-12T17:50:24.210 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.209+0000 7f826660f800 20 add_watcher() i=7 2024-09-12T17:50:24.210 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.209+0000 7f826660f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:24.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.211+0000 7f8117fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:24.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.211+0000 7f826660f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:24.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.211+0000 7f826660f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:24.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.211+0000 7f826660f800 5 note: GC not initialized 2024-09-12T17:50:24.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.211+0000 7f8116fe5640 20 reqs_thread_entry: start 2024-09-12T17:50:24.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.211+0000 7f826660f800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:24.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.211+0000 7f826660f800 20 Filter name: none 2024-09-12T17:50:24.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.211+0000 7f8114fe1640 20 reqs_thread_entry: start 2024-09-12T17:50:24.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:50:24.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:50:24.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:50:24.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:50:24.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 : miss 2024-09-12T17:50:24.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:50:24.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:50:24.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:50:24.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:50:24.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:24.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.212+0000 7f826660f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 2024-09-12T17:50:24.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.214+0000 7f826660f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:50:24.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.218+0000 7f826660f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:50:24.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.218+0000 7f826660f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:50:24.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.218+0000 7f826660f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:24.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.218+0000 7f826660f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30, ofs0, ns] 2024-09-12T17:50:24.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.218+0000 7f81457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94746871968320 notifier 6698 bl.length()=999 2024-09-12T17:50:24.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.218+0000 7f81457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:50:24.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.218+0000 7f81457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:50:24.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.218+0000 7f81457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:24.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.219+0000 7f826660f800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_sources= new_sources= 2024-09-12T17:50:24.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.219+0000 7f826660f800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential sources added=[] removed=[] 2024-09-12T17:50:24.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.219+0000 7f826660f800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_dests= new_dests= 2024-09-12T17:50:24.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.219+0000 7f826660f800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential dests added=[] removed=[] 2024-09-12T17:50:24.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.222+0000 7f826660f800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.2.0 2024-09-12T17:50:24.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.222+0000 7f826660f800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.2.0 2024-09-12T17:50:24.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.222+0000 7f826660f800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.2.1 2024-09-12T17:50:24.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.222+0000 7f826660f800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.2.1 2024-09-12T17:50:24.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.222+0000 7f826660f800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.0 2024-09-12T17:50:24.225 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.224+0000 7f826660f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:24.225 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.224+0000 7f826660f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 2024-09-12T17:50:24.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.225+0000 7f826660f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:50:24.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.225+0000 7f826660f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:50:24.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.225+0000 7f826660f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:24.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.225+0000 7f826660f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30, ofs0, ns] 2024-09-12T17:50:24.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.226+0000 7f81457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94746871968320 notifier 6698 bl.length()=999 2024-09-12T17:50:24.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.226+0000 7f81457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:50:24.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.226+0000 7f81457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:50:24.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.226+0000 7f81457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:24.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.226+0000 7f826660f800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_sources= new_sources= 2024-09-12T17:50:24.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.226+0000 7f826660f800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential sources added=[] removed=[] 2024-09-12T17:50:24.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.226+0000 7f826660f800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_dests= new_dests= 2024-09-12T17:50:24.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.226+0000 7f826660f800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential dests added=[] removed=[] 2024-09-12T17:50:24.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.227+0000 7f826660f800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.30.0 2024-09-12T17:50:24.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.228+0000 7f826660f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:24.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.228+0000 7f826660f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 2024-09-12T17:50:24.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.229+0000 7f826660f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:50:24.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.229+0000 7f826660f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:50:24.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.229+0000 7f826660f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:24.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.229+0000 7f826660f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30, ofs0, ns] 2024-09-12T17:50:24.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.229+0000 7f81457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94746871968320 notifier 6698 bl.length()=967 2024-09-12T17:50:24.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.229+0000 7f81457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 info.flags=0x17 2024-09-12T17:50:24.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.229+0000 7f81457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 to cache LRU end 2024-09-12T17:50:24.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.229+0000 7f81457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:24.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.230+0000 7f826660f800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_sources= new_sources= 2024-09-12T17:50:24.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.230+0000 7f826660f800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential sources added=[] removed=[] 2024-09-12T17:50:24.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.230+0000 7f826660f800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): orig_dests= new_dests= 2024-09-12T17:50:24.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.230+0000 7f826660f800 20 handle_bi_update(): bucket=:abort-at-block-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.30]): potential dests added=[] removed=[] 2024-09-12T17:50:24.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.231+0000 7f826660f800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T17:50:24.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.233+0000 7f8117fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:24.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.235+0000 7f826660f800 20 remove_watcher() i=0 2024-09-12T17:50:24.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.235+0000 7f826660f800 2 removed watcher, disabling cache 2024-09-12T17:50:24.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.236+0000 7f826660f800 20 remove_watcher() i=1 2024-09-12T17:50:24.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.237+0000 7f826660f800 20 remove_watcher() i=2 2024-09-12T17:50:24.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.239+0000 7f826660f800 20 remove_watcher() i=3 2024-09-12T17:50:24.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.240+0000 7f826660f800 20 remove_watcher() i=4 2024-09-12T17:50:24.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.241+0000 7f826660f800 20 remove_watcher() i=5 2024-09-12T17:50:24.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.242+0000 7f826660f800 20 remove_watcher() i=6 2024-09-12T17:50:24.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.243+0000 7f826660f800 20 remove_watcher() i=7 2024-09-12T17:50:24.256 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:50:24.285 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:24.285 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:24.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.320+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.322+0000 7fcbfb315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.322+0000 7fcbfb315800 20 realm 2024-09-12T17:50:24.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.322+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.322+0000 7fcbfb315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.322+0000 7fcbfb315800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:24.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.322+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.323+0000 7fcbfb315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.323+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.323+0000 7fcbfb315800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:24.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.323+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.324+0000 7fcbfb315800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:24.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.324+0000 7fcbfb315800 20 searching for the correct realm 2024-09-12T17:50:24.328 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.328+0000 7fcbf05fe640 0 -- 172.21.15.107:0/4048236219 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fcbe0062cf0 msgr2=0x7fcbe00617c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:24.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.331+0000 7fcbf9600640 0 -- 172.21.15.107:0/4048236219 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7fcbe006b890 msgr2=0x7fcbe00694a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:24.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.334+0000 7fcbfb315800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:24.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.334+0000 7fcbfb315800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:24.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.334+0000 7fcbfb315800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:24.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.334+0000 7fcbfb315800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:24.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.334+0000 7fcbfb315800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:24.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.334+0000 7fcbfb315800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:24.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.334+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.334+0000 7fcbfb315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.334+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.335+0000 7fcbfb315800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:24.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.335+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.335+0000 7fcbfb315800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:24.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.335+0000 7fcbfb315800 20 zone default found 2024-09-12T17:50:24.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.335+0000 7fcbfb315800 4 Realm: () 2024-09-12T17:50:24.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.335+0000 7fcbfb315800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:24.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.335+0000 7fcbfb315800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:24.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.335+0000 7fcbfb315800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:24.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.335+0000 7fcbfb315800 20 zonegroup default 2024-09-12T17:50:24.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.335+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.335+0000 7fcbfb315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.335+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.336+0000 7fcbfb315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.336+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.336+0000 7fcbfb315800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.336+0000 7fcbfb315800 20 started sync module instance, tier type = 2024-09-12T17:50:24.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.336+0000 7fcbfb315800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:24.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.345+0000 7fcbfb315800 20 add_watcher() i=0 2024-09-12T17:50:24.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.345+0000 7fcbfb315800 20 add_watcher() i=1 2024-09-12T17:50:24.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.345+0000 7fcbfb315800 20 add_watcher() i=2 2024-09-12T17:50:24.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.345+0000 7fcbfb315800 20 add_watcher() i=3 2024-09-12T17:50:24.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.345+0000 7fcbfb315800 20 add_watcher() i=4 2024-09-12T17:50:24.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.345+0000 7fcbfb315800 20 add_watcher() i=5 2024-09-12T17:50:24.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.345+0000 7fcbfb315800 20 add_watcher() i=6 2024-09-12T17:50:24.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.346+0000 7fcbfb315800 20 add_watcher() i=7 2024-09-12T17:50:24.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.346+0000 7fcbfb315800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:24.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.347+0000 7fcaaefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:24.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.348+0000 7fcbfb315800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:24.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.348+0000 7fcbfb315800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:24.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.348+0000 7fcbfb315800 5 note: GC not initialized 2024-09-12T17:50:24.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.348+0000 7fcaadfe3640 20 reqs_thread_entry: start 2024-09-12T17:50:24.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.348+0000 7fcbfb315800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:24.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.348+0000 7fcbfb315800 20 Filter name: none 2024-09-12T17:50:24.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.348+0000 7fca1f7fe640 20 reqs_thread_entry: start 2024-09-12T17:50:24.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.348+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.349+0000 7fcbfb315800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:50:24.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.349+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.349+0000 7fcbfb315800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:50:24.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.349+0000 7fcbfb315800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:24.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.349+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.349+0000 7fcbfb315800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:50:24.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.350+0000 7fcbfb315800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.350+0000 7fcbfb315800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:50:24.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.350+0000 7fcbfb315800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:24.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.352+0000 7fcaaefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:24.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.354+0000 7fcbfb315800 20 remove_watcher() i=0 2024-09-12T17:50:24.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.354+0000 7fcbfb315800 2 removed watcher, disabling cache 2024-09-12T17:50:24.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.355+0000 7fcbfb315800 20 remove_watcher() i=1 2024-09-12T17:50:24.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.356+0000 7fcbfb315800 20 remove_watcher() i=2 2024-09-12T17:50:24.358 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.357+0000 7fcbfb315800 20 remove_watcher() i=3 2024-09-12T17:50:24.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.358+0000 7fcbfb315800 20 remove_watcher() i=4 2024-09-12T17:50:24.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.359+0000 7fcbfb315800 20 remove_watcher() i=5 2024-09-12T17:50:24.361 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.360+0000 7fcbfb315800 20 remove_watcher() i=6 2024-09-12T17:50:24.362 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.361+0000 7fcbfb315800 20 remove_watcher() i=7 2024-09-12T17:50:24.372 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:24.372 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:50:24.372 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-block-writes id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:50:24.372 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:24.433 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T17:50:24.434 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:24.615 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:50:24.643 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:24.643 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:24.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.678+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.680+0000 7f55fb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.680+0000 7f55fb50c800 20 realm 2024-09-12T17:50:24.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.680+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.680+0000 7f55fb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.680+0000 7f55fb50c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:24.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.680+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.681+0000 7f55fb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.681+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.681+0000 7f55fb50c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:24.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.681+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.682+0000 7f55fb50c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:24.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.682+0000 7f55fb50c800 20 searching for the correct realm 2024-09-12T17:50:24.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.685+0000 7f55f3fff640 0 -- 172.21.15.107:0/1902047562 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f55e40b34a0 msgr2=0x7f55e40a9370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:24.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.689+0000 7f55f97f7640 0 -- 172.21.15.107:0/1902047562 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7f55e40b3b80 msgr2=0x7f55e406b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:24.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.692+0000 7f55fb50c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:24.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.692+0000 7f55fb50c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:24.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.692+0000 7f55fb50c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:24.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.692+0000 7f55fb50c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:24.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.692+0000 7f55fb50c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:24.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.692+0000 7f55fb50c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:24.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.692+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.692+0000 7f55fb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.692+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.692+0000 7f55fb50c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.692+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 20 zone default found 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 4 Realm: () 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 20 zonegroup default 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 20 started sync module instance, tier type = 2024-09-12T17:50:24.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.693+0000 7f55fb50c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:24.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.702+0000 7f55fb50c800 20 add_watcher() i=0 2024-09-12T17:50:24.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.702+0000 7f55fb50c800 20 add_watcher() i=1 2024-09-12T17:50:24.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.702+0000 7f55fb50c800 20 add_watcher() i=2 2024-09-12T17:50:24.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.702+0000 7f55fb50c800 20 add_watcher() i=3 2024-09-12T17:50:24.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.702+0000 7f55fb50c800 20 add_watcher() i=4 2024-09-12T17:50:24.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.702+0000 7f55fb50c800 20 add_watcher() i=5 2024-09-12T17:50:24.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.702+0000 7f55fb50c800 20 add_watcher() i=6 2024-09-12T17:50:24.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.703+0000 7f55fb50c800 20 add_watcher() i=7 2024-09-12T17:50:24.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.703+0000 7f55fb50c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:24.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.704+0000 7f54af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:24.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.705+0000 7f55fb50c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:24.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.705+0000 7f55fb50c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:24.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.705+0000 7f55fb50c800 5 note: GC not initialized 2024-09-12T17:50:24.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.705+0000 7f54ae7e4640 20 reqs_thread_entry: start 2024-09-12T17:50:24.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.705+0000 7f55fb50c800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:24.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.705+0000 7f55fb50c800 20 Filter name: none 2024-09-12T17:50:24.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.705+0000 7f54a7fff640 20 reqs_thread_entry: start 2024-09-12T17:50:24.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.705+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.706+0000 7f55fb50c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:24.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.706+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.706+0000 7f55fb50c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:24.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.706+0000 7f55fb50c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:24.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.706+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.707+0000 7f55fb50c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:24.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.707+0000 7f55fb50c800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.707+0000 7f55fb50c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:24.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.707+0000 7f55fb50c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:24.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.708+0000 7f54af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:24.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.710+0000 7f55fb50c800 20 remove_watcher() i=0 2024-09-12T17:50:24.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.710+0000 7f55fb50c800 2 removed watcher, disabling cache 2024-09-12T17:50:24.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.711+0000 7f55fb50c800 20 remove_watcher() i=1 2024-09-12T17:50:24.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.712+0000 7f55fb50c800 20 remove_watcher() i=2 2024-09-12T17:50:24.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.713+0000 7f55fb50c800 20 remove_watcher() i=3 2024-09-12T17:50:24.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.714+0000 7f55fb50c800 20 remove_watcher() i=4 2024-09-12T17:50:24.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.715+0000 7f55fb50c800 20 remove_watcher() i=5 2024-09-12T17:50:24.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.716+0000 7f55fb50c800 20 remove_watcher() i=6 2024-09-12T17:50:24.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.717+0000 7f55fb50c800 20 remove_watcher() i=7 2024-09-12T17:50:24.728 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:24.728 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:50:24.728 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-commit-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:50:24.728 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:24.729 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T17:50:24.763 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:24.763 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:24.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.798+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.799+0000 7fded7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.799+0000 7fded7a87800 20 realm 2024-09-12T17:50:24.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.799+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.800+0000 7fded7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.800+0000 7fded7a87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:24.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.800+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.800+0000 7fded7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.800+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.800+0000 7fded7a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:24.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.800+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.801+0000 7fded7a87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:24.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.801+0000 7fded7a87800 20 searching for the correct realm 2024-09-12T17:50:24.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.804+0000 7fded5d72640 0 -- 172.21.15.107:0/3995726764 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55b9e9767e60 msgr2=0x55b9e976a320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:24.808 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.807+0000 7fded5571640 0 -- 172.21.15.107:0/3995726764 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fdecc09bc10 msgr2=0x7fdecc08e570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:24.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.811+0000 7fded7a87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:24.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.811+0000 7fded7a87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:24.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.811+0000 7fded7a87800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:24.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.811+0000 7fded7a87800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:24.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.811+0000 7fded7a87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:24.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.811+0000 7fded7a87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:24.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.811+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.811+0000 7fded7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.813 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.811+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.811+0000 7fded7a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:24.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.811+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:24.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 20 zone default found 2024-09-12T17:50:24.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 4 Realm: () 2024-09-12T17:50:24.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:24.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:24.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:24.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 20 zonegroup default 2024-09-12T17:50:24.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.814 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 20 started sync module instance, tier type = 2024-09-12T17:50:24.815 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.812+0000 7fded7a87800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:24.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.821+0000 7fded7a87800 20 add_watcher() i=0 2024-09-12T17:50:24.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.821+0000 7fded7a87800 20 add_watcher() i=1 2024-09-12T17:50:24.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.821+0000 7fded7a87800 20 add_watcher() i=2 2024-09-12T17:50:24.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.821+0000 7fded7a87800 20 add_watcher() i=3 2024-09-12T17:50:24.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.821+0000 7fded7a87800 20 add_watcher() i=4 2024-09-12T17:50:24.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.821+0000 7fded7a87800 20 add_watcher() i=5 2024-09-12T17:50:24.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.821+0000 7fded7a87800 20 add_watcher() i=6 2024-09-12T17:50:24.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.821+0000 7fded7a87800 20 add_watcher() i=7 2024-09-12T17:50:24.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.821+0000 7fded7a87800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:24.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.823+0000 7fdd8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:24.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.823+0000 7fded7a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:24.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.823+0000 7fded7a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:24.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.823+0000 7fded7a87800 5 note: GC not initialized 2024-09-12T17:50:24.825 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.824+0000 7fdd8a7e4640 20 reqs_thread_entry: start 2024-09-12T17:50:24.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.824+0000 7fded7a87800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:24.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.824+0000 7fded7a87800 20 Filter name: none 2024-09-12T17:50:24.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.824+0000 7fdcfbfff640 20 reqs_thread_entry: start 2024-09-12T17:50:24.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.824+0000 7fded7a87800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:50:24.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.824+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.825+0000 7fded7a87800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:24.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.825+0000 7fded7a87800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:50:24.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.825+0000 7fded7a87800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:50:24.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.825+0000 7fded7a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 : miss 2024-09-12T17:50:24.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.825+0000 7fded7a87800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.825+0000 7fded7a87800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:24.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.825+0000 7fded7a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 info.flags=0x17 2024-09-12T17:50:24.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.825+0000 7fded7a87800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 to cache LRU end 2024-09-12T17:50:24.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.825+0000 7fded7a87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:50:24.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.825+0000 7fded7a87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:24.827 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.825+0000 7fded7a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 2024-09-12T17:50:24.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.830+0000 7fded7a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 info.flags=0x17 2024-09-12T17:50:24.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.830+0000 7fded7a87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 to cache LRU end 2024-09-12T17:50:24.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.830+0000 7fded7a87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:24.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.830+0000 7fded7a87800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31, ofs0, ns] 2024-09-12T17:50:24.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.830+0000 7fddb8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464294 cookie 94256974172432 notifier 7140 bl.length()=1015 2024-09-12T17:50:24.831 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.830+0000 7fddb8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 info.flags=0x17 2024-09-12T17:50:24.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.830+0000 7fddb8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 to cache LRU end 2024-09-12T17:50:24.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.830+0000 7fddb8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:24.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.830+0000 7fded7a87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): orig_sources= new_sources= 2024-09-12T17:50:24.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.830+0000 7fded7a87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): potential sources added=[] removed=[] 2024-09-12T17:50:24.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.830+0000 7fded7a87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): orig_dests= new_dests= 2024-09-12T17:50:24.832 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.830+0000 7fded7a87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): potential dests added=[] removed=[] 2024-09-12T17:50:24.833 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.832+0000 7fded7a87800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.31.1.0 2024-09-12T17:50:24.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.832+0000 7fded7a87800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.31.1.0 2024-09-12T17:50:24.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.832+0000 7fded7a87800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.31.1.1 2024-09-12T17:50:24.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.832+0000 7fded7a87800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.31.1.1 2024-09-12T17:50:24.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.832+0000 7fded7a87800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.31.0 2024-09-12T17:50:24.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.835+0000 7fded7a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:24.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.835+0000 7fded7a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 2024-09-12T17:50:24.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.836+0000 7fded7a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 info.flags=0x17 2024-09-12T17:50:24.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.836+0000 7fded7a87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 to cache LRU end 2024-09-12T17:50:24.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.836+0000 7fded7a87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:24.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.836+0000 7fded7a87800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31, ofs0, ns] 2024-09-12T17:50:24.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.836+0000 7fdda7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464295 cookie 94256974172432 notifier 7140 bl.length()=1015 2024-09-12T17:50:24.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.836+0000 7fdda7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 info.flags=0x17 2024-09-12T17:50:24.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.836+0000 7fdda7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 to cache LRU end 2024-09-12T17:50:24.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.836+0000 7fdda7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:24.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.837+0000 7fded7a87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): orig_sources= new_sources= 2024-09-12T17:50:24.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.837+0000 7fded7a87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): potential sources added=[] removed=[] 2024-09-12T17:50:24.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.837+0000 7fded7a87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): orig_dests= new_dests= 2024-09-12T17:50:24.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.837+0000 7fded7a87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): potential dests added=[] removed=[] 2024-09-12T17:50:24.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.838+0000 7fded7a87800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.31.0 2024-09-12T17:50:24.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.838+0000 7fded7a87800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T17:50:24.839 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.838+0000 7fded7a87800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T17:50:24.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.841+0000 7fdd8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:24.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.843+0000 7fded7a87800 20 remove_watcher() i=0 2024-09-12T17:50:24.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.843+0000 7fded7a87800 2 removed watcher, disabling cache 2024-09-12T17:50:24.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.844+0000 7fded7a87800 20 remove_watcher() i=1 2024-09-12T17:50:24.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.845+0000 7fded7a87800 20 remove_watcher() i=2 2024-09-12T17:50:24.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.846+0000 7fded7a87800 20 remove_watcher() i=3 2024-09-12T17:50:24.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.847+0000 7fded7a87800 20 remove_watcher() i=4 2024-09-12T17:50:24.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.848+0000 7fded7a87800 20 remove_watcher() i=5 2024-09-12T17:50:24.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.849+0000 7fded7a87800 20 remove_watcher() i=6 2024-09-12T17:50:24.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.850+0000 7fded7a87800 20 remove_watcher() i=7 2024-09-12T17:50:24.863 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:50:24.892 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:24.892 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:24.928 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.926+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.928+0000 7f2ded414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.928+0000 7f2ded414800 20 realm 2024-09-12T17:50:24.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.928+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.928+0000 7f2ded414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.928+0000 7f2ded414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:24.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.928+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.928+0000 7f2ded414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.928+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.929+0000 7f2ded414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:24.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.929+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.930+0000 7f2ded414800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:24.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.930+0000 7f2ded414800 20 searching for the correct realm 2024-09-12T17:50:24.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.933+0000 7f2de92cc640 0 -- 172.21.15.107:0/1864384613 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x561978c29470 msgr2=0x561978c2b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:24.937 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.936+0000 7f2de8acb640 0 -- 172.21.15.107:0/1864384613 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f2ddc07d8c0 msgr2=0x7f2ddc06ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:24.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:24.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:24.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:24.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:24.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:24.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:24.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:24.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:24.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 zone default found 2024-09-12T17:50:24.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 4 Realm: () 2024-09-12T17:50:24.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:24.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:24.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:24.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 zonegroup default 2024-09-12T17:50:24.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.940+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.941+0000 7f2ded414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.941+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.941+0000 7f2ded414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.941+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.941+0000 7f2ded414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:24.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.941+0000 7f2ded414800 20 started sync module instance, tier type = 2024-09-12T17:50:24.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.941+0000 7f2ded414800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:24.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.950+0000 7f2ded414800 20 add_watcher() i=0 2024-09-12T17:50:24.951 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.950+0000 7f2ded414800 20 add_watcher() i=1 2024-09-12T17:50:24.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.950+0000 7f2ded414800 20 add_watcher() i=2 2024-09-12T17:50:24.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.950+0000 7f2ded414800 20 add_watcher() i=3 2024-09-12T17:50:24.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.950+0000 7f2ded414800 20 add_watcher() i=4 2024-09-12T17:50:24.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.950+0000 7f2ded414800 20 add_watcher() i=5 2024-09-12T17:50:24.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.950+0000 7f2ded414800 20 add_watcher() i=6 2024-09-12T17:50:24.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.951+0000 7f2ded414800 20 add_watcher() i=7 2024-09-12T17:50:24.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.951+0000 7f2ded414800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:24.953 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.952+0000 7f2c9efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:24.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.953+0000 7f2ded414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:24.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.953+0000 7f2ded414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:24.954 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.953+0000 7f2ded414800 5 note: GC not initialized 2024-09-12T17:50:24.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.953+0000 7f2c9dfe3640 20 reqs_thread_entry: start 2024-09-12T17:50:24.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.953+0000 7f2ded414800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:24.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.953+0000 7f2ded414800 20 Filter name: none 2024-09-12T17:50:24.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.953+0000 7f2c0f7fe640 20 reqs_thread_entry: start 2024-09-12T17:50:24.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.953+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.954+0000 7f2ded414800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:24.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.954+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.954+0000 7f2ded414800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:50:24.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.954+0000 7f2ded414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:24.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.954+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.955+0000 7f2ded414800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:24.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.955+0000 7f2ded414800 20 rados->read ofs=0 len=0 2024-09-12T17:50:24.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.955+0000 7f2ded414800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:50:24.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.955+0000 7f2ded414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:24.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.956+0000 7f2c9efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:24.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.958+0000 7f2ded414800 20 remove_watcher() i=0 2024-09-12T17:50:24.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.958+0000 7f2ded414800 2 removed watcher, disabling cache 2024-09-12T17:50:24.960 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.959+0000 7f2ded414800 20 remove_watcher() i=1 2024-09-12T17:50:24.961 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.960+0000 7f2ded414800 20 remove_watcher() i=2 2024-09-12T17:50:24.962 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.961+0000 7f2ded414800 20 remove_watcher() i=3 2024-09-12T17:50:24.963 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.962+0000 7f2ded414800 20 remove_watcher() i=4 2024-09-12T17:50:24.964 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.963+0000 7f2ded414800 20 remove_watcher() i=5 2024-09-12T17:50:24.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.964+0000 7f2ded414800 20 remove_watcher() i=6 2024-09-12T17:50:24.966 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:24.965+0000 7f2ded414800 20 remove_watcher() i=7 2024-09-12T17:50:24.976 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:24.976 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:50:24.976 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-commit-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:50:24.976 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:25.027 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:50:25.058 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:25.058 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:25.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.093+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.095+0000 7fd93c53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.095+0000 7fd93c53d800 20 realm 2024-09-12T17:50:25.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.095+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.095+0000 7fd93c53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.095+0000 7fd93c53d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:25.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.095+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.095+0000 7fd93c53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.095+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.096+0000 7fd93c53d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:25.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.096+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.096+0000 7fd93c53d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:25.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.096+0000 7fd93c53d800 20 searching for the correct realm 2024-09-12T17:50:25.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.100+0000 7fd938a2b640 0 -- 172.21.15.107:0/3519323517 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7fd920016930 msgr2=0x7fd920070a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:25.307 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.306+0000 7fd93822a640 0 -- 172.21.15.107:0/3519323517 >> [v2:172.21.15.148:6800/18671776,v1:172.21.15.148:6801/18671776] conn(0x5559935f3400 msgr2=0x5559935f5810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:25.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.308+0000 7fd93c53d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:25.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.308+0000 7fd93c53d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:25.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.308+0000 7fd93c53d800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:25.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.308+0000 7fd93c53d800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:25.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.308+0000 7fd93c53d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:25.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.308+0000 7fd93c53d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:25.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.308+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.308+0000 7fd93c53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.308+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.309+0000 7fd93c53d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:25.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.309+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.309+0000 7fd93c53d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:25.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.309+0000 7fd93c53d800 20 zone default found 2024-09-12T17:50:25.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.309+0000 7fd93c53d800 4 Realm: () 2024-09-12T17:50:25.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.309+0000 7fd93c53d800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:25.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.309+0000 7fd93c53d800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:25.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.309+0000 7fd93c53d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:25.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.309+0000 7fd93c53d800 20 zonegroup default 2024-09-12T17:50:25.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.309+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.309+0000 7fd93c53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.310+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.310+0000 7fd93c53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.310+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.310+0000 7fd93c53d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.310+0000 7fd93c53d800 20 started sync module instance, tier type = 2024-09-12T17:50:25.312 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.310+0000 7fd93c53d800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:25.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.319+0000 7fd93c53d800 20 add_watcher() i=0 2024-09-12T17:50:25.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.319+0000 7fd93c53d800 20 add_watcher() i=1 2024-09-12T17:50:25.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.319+0000 7fd93c53d800 20 add_watcher() i=2 2024-09-12T17:50:25.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.319+0000 7fd93c53d800 20 add_watcher() i=3 2024-09-12T17:50:25.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.319+0000 7fd93c53d800 20 add_watcher() i=4 2024-09-12T17:50:25.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.319+0000 7fd93c53d800 20 add_watcher() i=5 2024-09-12T17:50:25.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.319+0000 7fd93c53d800 20 add_watcher() i=6 2024-09-12T17:50:25.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.320+0000 7fd93c53d800 20 add_watcher() i=7 2024-09-12T17:50:25.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.320+0000 7fd93c53d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:25.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.322+0000 7fd7eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:25.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.322+0000 7fd93c53d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:25.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.322+0000 7fd93c53d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:25.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.322+0000 7fd93c53d800 5 note: GC not initialized 2024-09-12T17:50:25.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.322+0000 7fd7edfdb640 20 reqs_thread_entry: start 2024-09-12T17:50:25.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.322+0000 7fd93c53d800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:25.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.322+0000 7fd93c53d800 20 Filter name: none 2024-09-12T17:50:25.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.322+0000 7fd75f7fe640 20 reqs_thread_entry: start 2024-09-12T17:50:25.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.322+0000 7fd93c53d800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:50:25.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.322+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.323+0000 7fd93c53d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:25.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.323+0000 7fd93c53d800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:50:25.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.323+0000 7fd93c53d800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:50:25.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.323+0000 7fd93c53d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 : miss 2024-09-12T17:50:25.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.323+0000 7fd93c53d800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.323+0000 7fd93c53d800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:50:25.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.323+0000 7fd93c53d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 info.flags=0x17 2024-09-12T17:50:25.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.323+0000 7fd93c53d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 to cache LRU end 2024-09-12T17:50:25.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.323+0000 7fd93c53d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:50:25.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.323+0000 7fd93c53d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:25.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.323+0000 7fd93c53d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 2024-09-12T17:50:25.326 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.324+0000 7fd93c53d800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:50:25.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.328+0000 7fd93c53d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 info.flags=0x17 2024-09-12T17:50:25.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.328+0000 7fd93c53d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 to cache LRU end 2024-09-12T17:50:25.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.328+0000 7fd93c53d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:25.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.328+0000 7fd93c53d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31, ofs0, ns] 2024-09-12T17:50:25.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.328+0000 7fd80effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464296 cookie 93843212988048 notifier 6773 bl.length()=1015 2024-09-12T17:50:25.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.328+0000 7fd80effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 info.flags=0x17 2024-09-12T17:50:25.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.328+0000 7fd80effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 to cache LRU end 2024-09-12T17:50:25.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.328+0000 7fd80effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:25.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.328+0000 7fd93c53d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): orig_sources= new_sources= 2024-09-12T17:50:25.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.328+0000 7fd93c53d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): potential sources added=[] removed=[] 2024-09-12T17:50:25.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.328+0000 7fd93c53d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): orig_dests= new_dests= 2024-09-12T17:50:25.330 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.328+0000 7fd93c53d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): potential dests added=[] removed=[] 2024-09-12T17:50:25.331 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.330+0000 7fd93c53d800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.31.2.0 2024-09-12T17:50:25.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.330+0000 7fd93c53d800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.31.2.0 2024-09-12T17:50:25.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.330+0000 7fd93c53d800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.31.2.1 2024-09-12T17:50:25.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.330+0000 7fd93c53d800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.31.2.1 2024-09-12T17:50:25.332 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.330+0000 7fd93c53d800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.31.0 2024-09-12T17:50:25.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.332+0000 7fd93c53d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:25.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.332+0000 7fd93c53d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 2024-09-12T17:50:25.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.333+0000 7fd93c53d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 info.flags=0x17 2024-09-12T17:50:25.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.334+0000 7fd93c53d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 to cache LRU end 2024-09-12T17:50:25.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.334+0000 7fd93c53d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:25.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.334+0000 7fd93c53d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31, ofs0, ns] 2024-09-12T17:50:25.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.334+0000 7fd80f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464297 cookie 93843212988048 notifier 6773 bl.length()=1015 2024-09-12T17:50:25.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.334+0000 7fd80f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 info.flags=0x17 2024-09-12T17:50:25.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.334+0000 7fd80f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 to cache LRU end 2024-09-12T17:50:25.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.334+0000 7fd80f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:25.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.334+0000 7fd93c53d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): orig_sources= new_sources= 2024-09-12T17:50:25.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.334+0000 7fd93c53d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): potential sources added=[] removed=[] 2024-09-12T17:50:25.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.334+0000 7fd93c53d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): orig_dests= new_dests= 2024-09-12T17:50:25.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.334+0000 7fd93c53d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): potential dests added=[] removed=[] 2024-09-12T17:50:25.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.335+0000 7fd93c53d800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.31.0 2024-09-12T17:50:25.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.335+0000 7fd93c53d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:25.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.336+0000 7fd93c53d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 2024-09-12T17:50:25.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.337+0000 7fd93c53d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 info.flags=0x17 2024-09-12T17:50:25.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.337+0000 7fd93c53d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 to cache LRU end 2024-09-12T17:50:25.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.337+0000 7fd93c53d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:25.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.337+0000 7fd93c53d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31, ofs0, ns] 2024-09-12T17:50:25.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.337+0000 7fd80f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 93843212988048 notifier 6773 bl.length()=983 2024-09-12T17:50:25.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.337+0000 7fd80f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 info.flags=0x17 2024-09-12T17:50:25.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.337+0000 7fd80f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 to cache LRU end 2024-09-12T17:50:25.338 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.337+0000 7fd80f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:25.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.337+0000 7fd93c53d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): orig_sources= new_sources= 2024-09-12T17:50:25.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.337+0000 7fd93c53d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): potential sources added=[] removed=[] 2024-09-12T17:50:25.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.337+0000 7fd93c53d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): orig_dests= new_dests= 2024-09-12T17:50:25.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.337+0000 7fd93c53d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.31]): potential dests added=[] removed=[] 2024-09-12T17:50:25.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.338+0000 7fd93c53d800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:50:25.341 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.340+0000 7fd7eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:25.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.342+0000 7fd93c53d800 20 remove_watcher() i=0 2024-09-12T17:50:25.343 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.342+0000 7fd93c53d800 2 removed watcher, disabling cache 2024-09-12T17:50:25.344 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.343+0000 7fd93c53d800 20 remove_watcher() i=1 2024-09-12T17:50:25.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.344+0000 7fd93c53d800 20 remove_watcher() i=2 2024-09-12T17:50:25.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.345+0000 7fd93c53d800 20 remove_watcher() i=3 2024-09-12T17:50:25.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.347+0000 7fd93c53d800 20 remove_watcher() i=4 2024-09-12T17:50:25.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.348+0000 7fd93c53d800 20 remove_watcher() i=5 2024-09-12T17:50:25.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.349+0000 7fd93c53d800 20 remove_watcher() i=6 2024-09-12T17:50:25.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.350+0000 7fd93c53d800 20 remove_watcher() i=7 2024-09-12T17:50:25.363 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:50:25.391 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:25.392 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:25.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.426+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.428+0000 7fc66c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.428+0000 7fc66c126800 20 realm 2024-09-12T17:50:25.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.428+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.428+0000 7fc66c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.428+0000 7fc66c126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:25.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.428+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.429+0000 7fc66c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.429+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.429+0000 7fc66c126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:25.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.429+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.430+0000 7fc66c126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:25.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.430+0000 7fc66c126800 20 searching for the correct realm 2024-09-12T17:50:25.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.432+0000 7fc6675d8640 0 -- 172.21.15.107:0/1365452167 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fc650018070 msgr2=0x7fc65008a8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:25.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.436+0000 7fc667dd9640 0 -- 172.21.15.107:0/1365452167 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc650061a10 msgr2=0x7fc6500430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:25.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.641+0000 7fc66c126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:25.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.641+0000 7fc66c126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:25.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.641+0000 7fc66c126800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:25.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.641+0000 7fc66c126800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:25.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.641+0000 7fc66c126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:25.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.641+0000 7fc66c126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:25.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.641+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.641+0000 7fc66c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.641+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.641+0000 7fc66c126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:25.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.641+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.642+0000 7fc66c126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:25.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.642+0000 7fc66c126800 20 zone default found 2024-09-12T17:50:25.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.642+0000 7fc66c126800 4 Realm: () 2024-09-12T17:50:25.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.642+0000 7fc66c126800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:25.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.642+0000 7fc66c126800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:25.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.642+0000 7fc66c126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:25.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.642+0000 7fc66c126800 20 zonegroup default 2024-09-12T17:50:25.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.642+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.642+0000 7fc66c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.642+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.642+0000 7fc66c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.642+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.643+0000 7fc66c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.643+0000 7fc66c126800 20 started sync module instance, tier type = 2024-09-12T17:50:25.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.643+0000 7fc66c126800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:25.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.651+0000 7fc66c126800 20 add_watcher() i=0 2024-09-12T17:50:25.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.651+0000 7fc66c126800 20 add_watcher() i=1 2024-09-12T17:50:25.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.651+0000 7fc66c126800 20 add_watcher() i=2 2024-09-12T17:50:25.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.651+0000 7fc66c126800 20 add_watcher() i=3 2024-09-12T17:50:25.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.651+0000 7fc66c126800 20 add_watcher() i=4 2024-09-12T17:50:25.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.651+0000 7fc66c126800 20 add_watcher() i=5 2024-09-12T17:50:25.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.651+0000 7fc66c126800 20 add_watcher() i=6 2024-09-12T17:50:25.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.652+0000 7fc66c126800 20 add_watcher() i=7 2024-09-12T17:50:25.653 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.652+0000 7fc66c126800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:25.655 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.654+0000 7fc51dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:25.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.654+0000 7fc66c126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:25.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.654+0000 7fc66c126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:25.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.654+0000 7fc66c126800 5 note: GC not initialized 2024-09-12T17:50:25.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.654+0000 7fc51cfe1640 20 reqs_thread_entry: start 2024-09-12T17:50:25.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.655+0000 7fc66c126800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:25.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.655+0000 7fc66c126800 20 Filter name: none 2024-09-12T17:50:25.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.655+0000 7fc4967fc640 20 reqs_thread_entry: start 2024-09-12T17:50:25.656 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.655+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.655+0000 7fc66c126800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:25.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.655+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.656+0000 7fc66c126800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:25.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.656+0000 7fc66c126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:25.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.656+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.656+0000 7fc66c126800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:25.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.656+0000 7fc66c126800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.657+0000 7fc66c126800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:25.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.657+0000 7fc66c126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:25.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.658+0000 7fc51dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:25.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.660+0000 7fc66c126800 20 remove_watcher() i=0 2024-09-12T17:50:25.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.660+0000 7fc66c126800 2 removed watcher, disabling cache 2024-09-12T17:50:25.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.661+0000 7fc66c126800 20 remove_watcher() i=1 2024-09-12T17:50:25.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.662+0000 7fc66c126800 20 remove_watcher() i=2 2024-09-12T17:50:25.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.663+0000 7fc66c126800 20 remove_watcher() i=3 2024-09-12T17:50:25.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.664+0000 7fc66c126800 20 remove_watcher() i=4 2024-09-12T17:50:25.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.665+0000 7fc66c126800 20 remove_watcher() i=5 2024-09-12T17:50:25.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.665+0000 7fc66c126800 20 remove_watcher() i=6 2024-09-12T17:50:25.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.666+0000 7fc66c126800 20 remove_watcher() i=7 2024-09-12T17:50:25.678 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:25.678 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:50:25.678 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-commit-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.31 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:50:25.678 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:25.738 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T17:50:25.738 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:25.909 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:50:25.937 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:25.937 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:25.973 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.972+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.973+0000 7f7c5291f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.973+0000 7f7c5291f800 20 realm 2024-09-12T17:50:25.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.973+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.974+0000 7f7c5291f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.974+0000 7f7c5291f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:25.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.974+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.974+0000 7f7c5291f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:25.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.974+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.975+0000 7f7c5291f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:25.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.975+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:25.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.975+0000 7f7c5291f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:25.976 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.975+0000 7f7c5291f800 20 searching for the correct realm 2024-09-12T17:50:25.978 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:25.977+0000 7f7c47fff640 0 -- 172.21.15.107:0/2495803389 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f7c38020040 msgr2=0x7f7c38020930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:26.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.182+0000 7f7c4e60c640 0 -- 172.21.15.107:0/2495803389 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f7c3804eaa0 msgr2=0x7f7c3802f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:26.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.389+0000 7f7c5291f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:26.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.389+0000 7f7c5291f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:26.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.389+0000 7f7c5291f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:26.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.389+0000 7f7c5291f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:26.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.389+0000 7f7c5291f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:26.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.389+0000 7f7c5291f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:26.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.389+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.389+0000 7f7c5291f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.389+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.389+0000 7f7c5291f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:26.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.389+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.390+0000 7f7c5291f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:26.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.390+0000 7f7c5291f800 20 zone default found 2024-09-12T17:50:26.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.390+0000 7f7c5291f800 4 Realm: () 2024-09-12T17:50:26.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.390+0000 7f7c5291f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:26.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.390+0000 7f7c5291f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:26.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.390+0000 7f7c5291f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:26.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.390+0000 7f7c5291f800 20 zonegroup default 2024-09-12T17:50:26.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.390+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.390+0000 7f7c5291f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.390+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.390+0000 7f7c5291f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.390+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.391+0000 7f7c5291f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.391+0000 7f7c5291f800 20 started sync module instance, tier type = 2024-09-12T17:50:26.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.391+0000 7f7c5291f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:26.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.401+0000 7f7c5291f800 20 add_watcher() i=0 2024-09-12T17:50:26.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.401+0000 7f7c5291f800 20 add_watcher() i=1 2024-09-12T17:50:26.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.401+0000 7f7c5291f800 20 add_watcher() i=2 2024-09-12T17:50:26.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.401+0000 7f7c5291f800 20 add_watcher() i=3 2024-09-12T17:50:26.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.401+0000 7f7c5291f800 20 add_watcher() i=4 2024-09-12T17:50:26.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.401+0000 7f7c5291f800 20 add_watcher() i=5 2024-09-12T17:50:26.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.401+0000 7f7c5291f800 20 add_watcher() i=6 2024-09-12T17:50:26.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.402+0000 7f7c5291f800 20 add_watcher() i=7 2024-09-12T17:50:26.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.402+0000 7f7c5291f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:26.405 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.404+0000 7f7b04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:26.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.405+0000 7f7c5291f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:26.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.405+0000 7f7c5291f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:26.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.405+0000 7f7c5291f800 5 note: GC not initialized 2024-09-12T17:50:26.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.405+0000 7f7a7f7fe640 20 reqs_thread_entry: start 2024-09-12T17:50:26.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.405+0000 7f7c5291f800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:26.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.405+0000 7f7c5291f800 20 Filter name: none 2024-09-12T17:50:26.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.405+0000 7f7a7d7fa640 20 reqs_thread_entry: start 2024-09-12T17:50:26.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.405+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.406+0000 7f7c5291f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:26.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.406+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.406+0000 7f7c5291f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:26.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.406+0000 7f7c5291f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:26.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.406+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.407+0000 7f7c5291f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:26.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.407+0000 7f7c5291f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.407+0000 7f7c5291f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:26.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.407+0000 7f7c5291f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:26.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.409+0000 7f7b04fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:26.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.411+0000 7f7c5291f800 20 remove_watcher() i=0 2024-09-12T17:50:26.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.411+0000 7f7c5291f800 2 removed watcher, disabling cache 2024-09-12T17:50:26.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.412+0000 7f7c5291f800 20 remove_watcher() i=1 2024-09-12T17:50:26.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.413+0000 7f7c5291f800 20 remove_watcher() i=2 2024-09-12T17:50:26.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.414+0000 7f7c5291f800 20 remove_watcher() i=3 2024-09-12T17:50:26.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.415+0000 7f7c5291f800 20 remove_watcher() i=4 2024-09-12T17:50:26.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.416+0000 7f7c5291f800 20 remove_watcher() i=5 2024-09-12T17:50:26.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.417+0000 7f7c5291f800 20 remove_watcher() i=6 2024-09-12T17:50:26.418 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.418+0000 7f7c5291f800 20 remove_watcher() i=7 2024-09-12T17:50:26.429 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:26.430 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:50:26.430 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-commit-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:50:26.430 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:26.431 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T17:50:26.468 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:26.468 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:26.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.503+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.504+0000 7fdf3e742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.504+0000 7fdf3e742800 20 realm 2024-09-12T17:50:26.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.504+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.504+0000 7fdf3e742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.504+0000 7fdf3e742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:26.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.504+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.505+0000 7fdf3e742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.505+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.506+0000 7fdf3e742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:26.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.506+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.506+0000 7fdf3e742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:26.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.506+0000 7fdf3e742800 20 searching for the correct realm 2024-09-12T17:50:26.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.509+0000 7fdf3ac87640 0 -- 172.21.15.107:0/4198867186 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55d77897dee0 msgr2=0x55d7789803a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:50:26.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.512+0000 7fdf3a486640 0 -- 172.21.15.107:0/4198867186 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fdf24051420 msgr2=0x7fdf240a4220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:26.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:26.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:26.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:26.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:26.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:26.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:26.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:26.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:26.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 zone default found 2024-09-12T17:50:26.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 4 Realm: () 2024-09-12T17:50:26.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:26.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:26.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:26.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 zonegroup default 2024-09-12T17:50:26.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.517+0000 7fdf3e742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.518+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.518+0000 7fdf3e742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.518+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.518+0000 7fdf3e742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.518+0000 7fdf3e742800 20 started sync module instance, tier type = 2024-09-12T17:50:26.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.518+0000 7fdf3e742800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:26.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.527+0000 7fdf3e742800 20 add_watcher() i=0 2024-09-12T17:50:26.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.527+0000 7fdf3e742800 20 add_watcher() i=1 2024-09-12T17:50:26.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.527+0000 7fdf3e742800 20 add_watcher() i=2 2024-09-12T17:50:26.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.527+0000 7fdf3e742800 20 add_watcher() i=3 2024-09-12T17:50:26.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.527+0000 7fdf3e742800 20 add_watcher() i=4 2024-09-12T17:50:26.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.527+0000 7fdf3e742800 20 add_watcher() i=5 2024-09-12T17:50:26.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.527+0000 7fdf3e742800 20 add_watcher() i=6 2024-09-12T17:50:26.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.528+0000 7fdf3e742800 20 add_watcher() i=7 2024-09-12T17:50:26.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.528+0000 7fdf3e742800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:26.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.530+0000 7fddf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:26.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.530+0000 7fdf3e742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:26.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.530+0000 7fdf3e742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:26.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.530+0000 7fdf3e742800 5 note: GC not initialized 2024-09-12T17:50:26.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.531+0000 7fdd6b7fe640 20 reqs_thread_entry: start 2024-09-12T17:50:26.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.531+0000 7fdf3e742800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:26.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.531+0000 7fdf3e742800 20 Filter name: none 2024-09-12T17:50:26.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.531+0000 7fdd697fa640 20 reqs_thread_entry: start 2024-09-12T17:50:26.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.531+0000 7fdf3e742800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:50:26.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.531+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.531+0000 7fdf3e742800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:26.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.531+0000 7fdf3e742800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:50:26.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.531+0000 7fdf3e742800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:50:26.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.531+0000 7fdf3e742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 : miss 2024-09-12T17:50:26.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.531+0000 7fdf3e742800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.532+0000 7fdf3e742800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:26.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.532+0000 7fdf3e742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 info.flags=0x17 2024-09-12T17:50:26.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.532+0000 7fdf3e742800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 to cache LRU end 2024-09-12T17:50:26.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.532+0000 7fdf3e742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:50:26.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.532+0000 7fdf3e742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:26.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.532+0000 7fdf3e742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 2024-09-12T17:50:26.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.535+0000 7fdf3e742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 info.flags=0x17 2024-09-12T17:50:26.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.535+0000 7fdf3e742800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 to cache LRU end 2024-09-12T17:50:26.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.535+0000 7fdf3e742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:26.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.535+0000 7fdf3e742800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32, ofs0, ns] 2024-09-12T17:50:26.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.535+0000 7fde1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464301 cookie 94383929566896 notifier 6827 bl.length()=1015 2024-09-12T17:50:26.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.535+0000 7fde1dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 info.flags=0x17 2024-09-12T17:50:26.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.535+0000 7fde1dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 to cache LRU end 2024-09-12T17:50:26.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.535+0000 7fde1dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:26.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.536+0000 7fdf3e742800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.32]): orig_sources= new_sources= 2024-09-12T17:50:26.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.536+0000 7fdf3e742800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.32]): potential sources added=[] removed=[] 2024-09-12T17:50:26.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.536+0000 7fdf3e742800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.32]): orig_dests= new_dests= 2024-09-12T17:50:26.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.536+0000 7fdf3e742800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.32]): potential dests added=[] removed=[] 2024-09-12T17:50:26.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.538+0000 7fdf3e742800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.32.1.0 2024-09-12T17:50:26.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.538+0000 7fdf3e742800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.32.1.0 2024-09-12T17:50:26.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.538+0000 7fdf3e742800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.32.1.1 2024-09-12T17:50:26.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.538+0000 7fdf3e742800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.32.1.1 2024-09-12T17:50:26.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.538+0000 7fdf3e742800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.32.0 2024-09-12T17:50:26.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.540+0000 7fdf3e742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:26.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.540+0000 7fdf3e742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 2024-09-12T17:50:26.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.542+0000 7fdf3e742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 info.flags=0x17 2024-09-12T17:50:26.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.542+0000 7fdf3e742800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 to cache LRU end 2024-09-12T17:50:26.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.542+0000 7fdf3e742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:26.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.542+0000 7fdf3e742800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32, ofs0, ns] 2024-09-12T17:50:26.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.542+0000 7fde1d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464302 cookie 94383929566896 notifier 6827 bl.length()=1015 2024-09-12T17:50:26.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.542+0000 7fde1d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 info.flags=0x17 2024-09-12T17:50:26.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.542+0000 7fde1d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 to cache LRU end 2024-09-12T17:50:26.543 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.542+0000 7fde1d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:26.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.542+0000 7fdf3e742800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.32]): orig_sources= new_sources= 2024-09-12T17:50:26.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.542+0000 7fdf3e742800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.32]): potential sources added=[] removed=[] 2024-09-12T17:50:26.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.542+0000 7fdf3e742800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.32]): orig_dests= new_dests= 2024-09-12T17:50:26.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.542+0000 7fdf3e742800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.32]): potential dests added=[] removed=[] 2024-09-12T17:50:26.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.544+0000 7fdf3e742800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.32.0 2024-09-12T17:50:26.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.544+0000 7fdf3e742800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T17:50:26.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.544+0000 7fdf3e742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:26.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.544+0000 7fdf3e742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 2024-09-12T17:50:26.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.545+0000 7fdf3e742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 info.flags=0x17 2024-09-12T17:50:26.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.545+0000 7fdf3e742800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 to cache LRU end 2024-09-12T17:50:26.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.545+0000 7fdf3e742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:26.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.545+0000 7fdf3e742800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32, ofs0, ns] 2024-09-12T17:50:26.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.545+0000 7fde1d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464303 cookie 94383929566896 notifier 6827 bl.length()=983 2024-09-12T17:50:26.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.546+0000 7fde1d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 info.flags=0x17 2024-09-12T17:50:26.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.546+0000 7fde1d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 to cache LRU end 2024-09-12T17:50:26.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.546+0000 7fde1d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:26.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.546+0000 7fdf3e742800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.32]): orig_sources= new_sources= 2024-09-12T17:50:26.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.546+0000 7fdf3e742800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.32]): potential sources added=[] removed=[] 2024-09-12T17:50:26.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.546+0000 7fdf3e742800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.32]): orig_dests= new_dests= 2024-09-12T17:50:26.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.546+0000 7fdf3e742800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.32]): potential dests added=[] removed=[] 2024-09-12T17:50:26.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.547+0000 7fdf3e742800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:50:26.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.550+0000 7fddf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:26.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.552+0000 7fdf3e742800 20 remove_watcher() i=0 2024-09-12T17:50:26.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.552+0000 7fdf3e742800 2 removed watcher, disabling cache 2024-09-12T17:50:26.553 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.553+0000 7fdf3e742800 20 remove_watcher() i=1 2024-09-12T17:50:26.554 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.553+0000 7fdf3e742800 20 remove_watcher() i=2 2024-09-12T17:50:26.555 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.554+0000 7fdf3e742800 20 remove_watcher() i=3 2024-09-12T17:50:26.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.555+0000 7fdf3e742800 20 remove_watcher() i=4 2024-09-12T17:50:26.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.556+0000 7fdf3e742800 20 remove_watcher() i=5 2024-09-12T17:50:26.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.557+0000 7fdf3e742800 20 remove_watcher() i=6 2024-09-12T17:50:26.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.558+0000 7fdf3e742800 20 remove_watcher() i=7 2024-09-12T17:50:26.571 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:50:26.600 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:26.600 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:26.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.635+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.637+0000 7f464611f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.637+0000 7f464611f800 20 realm 2024-09-12T17:50:26.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.637+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.637+0000 7f464611f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.637+0000 7f464611f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:26.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.637+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.637+0000 7f464611f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:26.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.637+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.638+0000 7f464611f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:26.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.638+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:26.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.639+0000 7f464611f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:26.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.639+0000 7f464611f800 20 searching for the correct realm 2024-09-12T17:50:26.843 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.842+0000 7f4641ea2640 0 -- 172.21.15.107:0/306665519 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f463c070040 msgr2=0x7f463c061930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:26.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:26.846+0000 7f4641ea2640 0 -- 172.21.15.107:0/306665519 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f462c03d420 msgr2=0x7f462c03d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:27.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.052+0000 7f464611f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:27.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.052+0000 7f464611f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:27.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.052+0000 7f464611f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:27.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.052+0000 7f464611f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:27.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.052+0000 7f464611f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:27.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.052+0000 7f464611f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:27.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.052+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.052+0000 7f464611f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.052+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.052+0000 7f464611f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:27.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.052+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:27.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 20 zone default found 2024-09-12T17:50:27.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 4 Realm: () 2024-09-12T17:50:27.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:27.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:27.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:27.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 20 zonegroup default 2024-09-12T17:50:27.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 20 started sync module instance, tier type = 2024-09-12T17:50:27.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.053+0000 7f464611f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:27.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.062+0000 7f464611f800 20 add_watcher() i=0 2024-09-12T17:50:27.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.062+0000 7f464611f800 20 add_watcher() i=1 2024-09-12T17:50:27.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.062+0000 7f464611f800 20 add_watcher() i=2 2024-09-12T17:50:27.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.062+0000 7f464611f800 20 add_watcher() i=3 2024-09-12T17:50:27.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.062+0000 7f464611f800 20 add_watcher() i=4 2024-09-12T17:50:27.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.062+0000 7f464611f800 20 add_watcher() i=5 2024-09-12T17:50:27.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.062+0000 7f464611f800 20 add_watcher() i=6 2024-09-12T17:50:27.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.063+0000 7f464611f800 20 add_watcher() i=7 2024-09-12T17:50:27.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.063+0000 7f464611f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:27.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.065+0000 7f44f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:27.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.065+0000 7f464611f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:27.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.065+0000 7f464611f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:27.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.065+0000 7f464611f800 5 note: GC not initialized 2024-09-12T17:50:27.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.065+0000 7f44f27fc640 20 reqs_thread_entry: start 2024-09-12T17:50:27.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.065+0000 7f464611f800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:27.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.066+0000 7f464611f800 20 Filter name: none 2024-09-12T17:50:27.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.066+0000 7f4463fff640 20 reqs_thread_entry: start 2024-09-12T17:50:27.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.066+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.066+0000 7f464611f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:27.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.066+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.067+0000 7f464611f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:27.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.067+0000 7f464611f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:27.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.067+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.067+0000 7f464611f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:27.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.067+0000 7f464611f800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.067+0000 7f464611f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:27.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.067+0000 7f464611f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:27.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.069+0000 7f44f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:27.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.071+0000 7f464611f800 20 remove_watcher() i=0 2024-09-12T17:50:27.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.071+0000 7f464611f800 2 removed watcher, disabling cache 2024-09-12T17:50:27.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.072+0000 7f464611f800 20 remove_watcher() i=1 2024-09-12T17:50:27.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.072+0000 7f464611f800 20 remove_watcher() i=2 2024-09-12T17:50:27.074 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.073+0000 7f464611f800 20 remove_watcher() i=3 2024-09-12T17:50:27.075 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.074+0000 7f464611f800 20 remove_watcher() i=4 2024-09-12T17:50:27.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.075+0000 7f464611f800 20 remove_watcher() i=5 2024-09-12T17:50:27.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.076+0000 7f464611f800 20 remove_watcher() i=6 2024-09-12T17:50:27.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.077+0000 7f464611f800 20 remove_watcher() i=7 2024-09-12T17:50:27.088 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.088 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:50:27.088 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-commit-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.32 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:50:27.088 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.151 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T17:50:27.151 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.333 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:50:27.361 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:27.361 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:27.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.396+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.398+0000 7fc321526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.398+0000 7fc321526800 20 realm 2024-09-12T17:50:27.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.398+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.398+0000 7fc321526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.398+0000 7fc321526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:27.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.398+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.398+0000 7fc321526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.398+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.399+0000 7fc321526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:27.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.399+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.400+0000 7fc321526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:27.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.400+0000 7fc321526800 20 searching for the correct realm 2024-09-12T17:50:27.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.402+0000 7fc31d109640 0 -- 172.21.15.107:0/795448217 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fc318030040 msgr2=0x7fc318032440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:27.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.405+0000 7fc31d109640 0 -- 172.21.15.107:0/795448217 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc308091170 msgr2=0x7fc3080e2560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:27.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.409+0000 7fc321526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:27.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.409+0000 7fc321526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:27.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.409+0000 7fc321526800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:27.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.409+0000 7fc321526800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:27.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.409+0000 7fc321526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:27.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.409+0000 7fc321526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:27.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.409+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:27.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:27.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 20 zone default found 2024-09-12T17:50:27.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 4 Realm: () 2024-09-12T17:50:27.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:27.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:27.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:27.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 20 zonegroup default 2024-09-12T17:50:27.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.410+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.411+0000 7fc321526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.411+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.411+0000 7fc321526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.411+0000 7fc321526800 20 started sync module instance, tier type = 2024-09-12T17:50:27.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.411+0000 7fc321526800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:27.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.419+0000 7fc321526800 20 add_watcher() i=0 2024-09-12T17:50:27.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.419+0000 7fc321526800 20 add_watcher() i=1 2024-09-12T17:50:27.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.419+0000 7fc321526800 20 add_watcher() i=2 2024-09-12T17:50:27.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.419+0000 7fc321526800 20 add_watcher() i=3 2024-09-12T17:50:27.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.419+0000 7fc321526800 20 add_watcher() i=4 2024-09-12T17:50:27.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.419+0000 7fc321526800 20 add_watcher() i=5 2024-09-12T17:50:27.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.420+0000 7fc321526800 20 add_watcher() i=6 2024-09-12T17:50:27.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.420+0000 7fc321526800 20 add_watcher() i=7 2024-09-12T17:50:27.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.420+0000 7fc321526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:27.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.422+0000 7fc1d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:27.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.422+0000 7fc321526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:27.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.422+0000 7fc321526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:27.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.422+0000 7fc321526800 5 note: GC not initialized 2024-09-12T17:50:27.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.422+0000 7fc1d27e4640 20 reqs_thread_entry: start 2024-09-12T17:50:27.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.423+0000 7fc321526800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:27.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.423+0000 7fc321526800 20 Filter name: none 2024-09-12T17:50:27.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.423+0000 7fc143fff640 20 reqs_thread_entry: start 2024-09-12T17:50:27.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.423+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.423+0000 7fc321526800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:27.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.423+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.424+0000 7fc321526800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:27.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.424+0000 7fc321526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:27.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.424+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.424+0000 7fc321526800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:27.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.424+0000 7fc321526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.424+0000 7fc321526800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:27.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.424+0000 7fc321526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:27.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.426+0000 7fc1d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:27.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.428+0000 7fc321526800 20 remove_watcher() i=0 2024-09-12T17:50:27.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.428+0000 7fc321526800 2 removed watcher, disabling cache 2024-09-12T17:50:27.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.430+0000 7fc321526800 20 remove_watcher() i=1 2024-09-12T17:50:27.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.431+0000 7fc321526800 20 remove_watcher() i=2 2024-09-12T17:50:27.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.432+0000 7fc321526800 20 remove_watcher() i=3 2024-09-12T17:50:27.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.432+0000 7fc321526800 20 remove_watcher() i=4 2024-09-12T17:50:27.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.433+0000 7fc321526800 20 remove_watcher() i=5 2024-09-12T17:50:27.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.434+0000 7fc321526800 20 remove_watcher() i=6 2024-09-12T17:50:27.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.435+0000 7fc321526800 20 remove_watcher() i=7 2024-09-12T17:50:27.446 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.446 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:50:27.446 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-commit-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:50:27.446 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.448 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T17:50:27.482 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:27.482 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:27.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.517+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.518+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.518+0000 7fd395526800 20 realm 2024-09-12T17:50:27.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.518+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.518+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.518+0000 7fd395526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:27.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.518+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.519+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.519+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.519+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:27.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.519+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.520+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:27.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.520+0000 7fd395526800 20 searching for the correct realm 2024-09-12T17:50:27.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.523+0000 7fd3919da640 0 -- 172.21.15.107:0/1765430077 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5644f3ef3c90 msgr2=0x5644f3ef6150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:27.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.526+0000 7fd3911d9640 0 -- 172.21.15.107:0/1765430077 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fd37c0b1860 msgr2=0x7fd37c0c51e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:27.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:27.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:27.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:27.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:27.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:27.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:27.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 zone default found 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 4 Realm: () 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 zonegroup default 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.530+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.531+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.531+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.531+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.531+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.531+0000 7fd395526800 20 started sync module instance, tier type = 2024-09-12T17:50:27.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.531+0000 7fd395526800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:27.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=0 2024-09-12T17:50:27.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=1 2024-09-12T17:50:27.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=2 2024-09-12T17:50:27.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=3 2024-09-12T17:50:27.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=4 2024-09-12T17:50:27.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=5 2024-09-12T17:50:27.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=6 2024-09-12T17:50:27.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.541+0000 7fd395526800 20 add_watcher() i=7 2024-09-12T17:50:27.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.541+0000 7fd395526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:27.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.542+0000 7fd247fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:27.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd395526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:27.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd395526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:27.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd395526800 5 note: GC not initialized 2024-09-12T17:50:27.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd246fe5640 20 reqs_thread_entry: start 2024-09-12T17:50:27.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd395526800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:27.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd395526800 20 Filter name: none 2024-09-12T17:50:27.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd244fe1640 20 reqs_thread_entry: start 2024-09-12T17:50:27.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd395526800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:50:27.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:27.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd395526800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:50:27.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd395526800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:50:27.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd395526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 : miss 2024-09-12T17:50:27.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.543+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.544+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:27.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.544+0000 7fd395526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.544+0000 7fd395526800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.544+0000 7fd395526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:50:27.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.544+0000 7fd395526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.544+0000 7fd395526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 2024-09-12T17:50:27.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.548+0000 7fd395526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.548+0000 7fd395526800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.548+0000 7fd395526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.548+0000 7fd395526800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33, ofs0, ns] 2024-09-12T17:50:27.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.548+0000 7fd263fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94854150314832 notifier 7287 bl.length()=1015 2024-09-12T17:50:27.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.548+0000 7fd263fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.548+0000 7fd263fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.548+0000 7fd263fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.548+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_sources= new_sources= 2024-09-12T17:50:27.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.548+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential sources added=[] removed=[] 2024-09-12T17:50:27.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.548+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_dests= new_dests= 2024-09-12T17:50:27.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.548+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential dests added=[] removed=[] 2024-09-12T17:50:27.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.550+0000 7fd395526800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.0 2024-09-12T17:50:27.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.550+0000 7fd395526800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.0 2024-09-12T17:50:27.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.550+0000 7fd395526800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.1 2024-09-12T17:50:27.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.550+0000 7fd395526800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.1 2024-09-12T17:50:27.552 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.550+0000 7fd395526800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.0 2024-09-12T17:50:27.554 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.553+0000 7fd395526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:27.554 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.553+0000 7fd395526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 2024-09-12T17:50:27.555 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.554+0000 7fd395526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.555 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.554+0000 7fd395526800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.555 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.554+0000 7fd395526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.554+0000 7fd395526800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33, ofs0, ns] 2024-09-12T17:50:27.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.554+0000 7fd263fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464310 cookie 94854150314832 notifier 7287 bl.length()=1015 2024-09-12T17:50:27.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.554+0000 7fd263fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.554+0000 7fd263fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.554+0000 7fd263fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.555+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_sources= new_sources= 2024-09-12T17:50:27.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.555+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential sources added=[] removed=[] 2024-09-12T17:50:27.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.555+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_dests= new_dests= 2024-09-12T17:50:27.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.555+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential dests added=[] removed=[] 2024-09-12T17:50:27.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.556+0000 7fd395526800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.0 2024-09-12T17:50:27.557 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd395526800 time 2024-09-12T17:50:27.557445+0000 2024-09-12T17:50:27.557 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd396b8c71a] 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd396b8c8d8] 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644f1d52841] 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5644f1d62827] 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd395829590] 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.557+0000 7fd395526800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd395526800 time 2024-09-12T17:50:27.557445+0000 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.558 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:50:27.559 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd396b8c71a] 2024-09-12T17:50:27.559 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd396b8c8d8] 2024-09-12T17:50:27.559 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644f1d52841] 2024-09-12T17:50:27.559 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5644f1d62827] 2024-09-12T17:50:27.559 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:50:27.559 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd395829590] 2024-09-12T17:50:27.559 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:50:27.559 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:50:27.559 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.559 INFO:tasks.workunit.client.0.smithi107.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:50:27.559 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7fd395526800 thread_name:radosgw-admin 2024-09-12T17:50:27.581 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:50:27.581 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd39583e6f0] 2024-09-12T17:50:27.581 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd39588b99c] 2024-09-12T17:50:27.581 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:50:27.581 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:50:27.581 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd396b8c774] 2024-09-12T17:50:27.581 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd396b8c8d8] 2024-09-12T17:50:27.581 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644f1d52841] 2024-09-12T17:50:27.581 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5644f1d62827] 2024-09-12T17:50:27.581 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:50:27.581 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd395829590] 2024-09-12T17:50:27.581 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.557+0000 7fd395526800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7fd395526800 thread_name:radosgw-admin 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd39583e6f0] 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd39588b99c] 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd396b8c774] 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd396b8c8d8] 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644f1d52841] 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5644f1d62827] 2024-09-12T17:50:27.582 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd395829590] 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:50:27.501+0000 7fd395526800 5 AuthRegistry(0x5644f3e02590) adding con mode: crc 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:50:27.501+0000 7fd395526800 5 AuthRegistry(0x5644f3e02590) adding con mode: secure 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:50:27.501+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:50:27.502+0000 7fd395526800 1 librados: starting msgr at 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:50:27.502+0000 7fd395526800 1 librados: starting objecter 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:50:27.502+0000 7fd395526800 5 asok(0x5644f3bda730) register_command objecter_requests hook 0x5644f3e002d0 2024-09-12T17:50:27.583 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:50:27.502+0000 7fd395526800 1 librados: setting wanted keys 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:50:27.502+0000 7fd395526800 1 librados: calling monclient init 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient: init 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding auth protocol: cephx 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding auth protocol: cephx 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding auth protocol: cephx 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: secure 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: crc 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: secure 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: crc 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: secure 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: crc 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: crc 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: secure 2024-09-12T17:50:27.584 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: crc 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: secure 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: crc 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: secure 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:50:27.502+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:50:27.502+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:50:27.502+0000 7fd395526800 5 asok(0x5644f3bda730) register_command rotate-key hook 0x5644f3dfcf88 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient: _reopen_session rank -1 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): picked mon.noname-a con 0x5644f3cb3a90 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): picked mon.noname-c con 0x5644f3d3f110 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): picked mon.noname-b con 0x5644f3d42410 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.585 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): _renew_subs 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): authenticate will time out at 2032.048707s 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): get_auth_request con 0x5644f3cb3a90 auth_method 0 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): get_auth_request con 0x5644f3d3f110 auth_method 0 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.586 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:50:27.503+0000 7fd3911d9640 10 monclient(hunting): handle_auth_done global_id 7278 payload 824 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:50:27.503+0000 7fd3911d9640 10 monclient: _finish_hunting 0 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:50:27.503+0000 7fd3911d9640 1 monclient: found mon.noname-a 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:50:27.503+0000 7fd3911d9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: dump: 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.587 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: _finish_auth 0 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: _check_auth_tickets 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: dump: 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.588 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:50:27.503+0000 7fd395526800 5 monclient: authenticate success, global_id 7278 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:50:27.503+0000 7fd395526800 10 monclient: _renew_subs 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:50:27.503+0000 7fd395526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:50:27.503+0000 7fd27f606640 4 set_mon_vals no callback set 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:50:27.503+0000 7fd395526800 10 monclient: _renew_subs 2024-09-12T17:50:27.589 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:50:27.503+0000 7fd395526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:50:27.503+0000 7fd395526800 1 librados: init done 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:50:27.505+0000 7fd27de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:50:27.505+0000 7fd27de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:50:27.505+0000 7fd27de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:50:27.505+0000 7fd3889d8640 10 monclient: get_auth_request con 0x7fd278076470 auth_method 0 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:50:27.505+0000 7fd3919da640 10 monclient: get_auth_request con 0x5644f3e2f6c0 auth_method 0 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:50:27.506+0000 7fd3911d9640 10 monclient: get_auth_request con 0x5644f3e47c90 auth_method 0 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:50:27.507+0000 7fd3889d8640 10 monclient: get_auth_request con 0x5644f3e4c330 auth_method 0 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:50:27.508+0000 7fd395526800 10 monclient: build_initial_monmap 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:50:27.508+0000 7fd395526800 1 build_initial for_mkfs: 0 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:50:27.508+0000 7fd395526800 10 monclient: monmap: 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:50:27.590 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding auth protocol: cephx 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding auth protocol: cephx 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding auth protocol: cephx 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: secure 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: crc 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: secure 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: crc 2024-09-12T17:50:27.591 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: secure 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: crc 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: crc 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: secure 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: crc 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: secure 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: crc 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: secure 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:50:27.508+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:50:27.508+0000 7fd395526800 5 asok(0x5644f3bda730) register_command objecter_requests cmddesc objecter_requests hook 0x5644f3e54580 EEXIST 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:50:27.508+0000 7fd395526800 10 monclient: init 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding auth protocol: cephx 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding auth protocol: cephx 2024-09-12T17:50:27.592 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding auth protocol: cephx 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: secure 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: crc 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: secure 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: crc 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: secure 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: crc 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: crc 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: secure 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: crc 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: secure 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: crc 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: secure 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:50:27.508+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.593 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:50:27.509+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:50:27.509+0000 7fd395526800 5 asok(0x5644f3bda730) register_command rotate-key cmddesc rotate-key hook 0x5644f3e4f820 EEXIST 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient: _reopen_session rank -1 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): picked mon.noname-b con 0x5644f3e788a0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): picked mon.noname-c con 0x5644f3e78c80 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): picked mon.noname-a con 0x5644f3e775b0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): _renew_subs 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): authenticate will time out at 2032.055165s 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): get_auth_request con 0x5644f3e78c80 auth_method 0 2024-09-12T17:50:27.594 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): get_auth_request con 0x5644f3e775b0 auth_method 0 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): get_auth_request con 0x5644f3e788a0 auth_method 0 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.595 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): handle_auth_done global_id 6872 payload 824 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient: _finish_hunting 0 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:50:27.509+0000 7fd3889d8640 1 monclient: found mon.noname-c 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: dump: 2024-09-12T17:50:27.596 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: _finish_auth 0 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:50:27.509+0000 7fd395526800 5 monclient: authenticate success, global_id 6872 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient: _renew_subs 2024-09-12T17:50:27.597 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: dump: 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.598 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:50:27.509+0000 7fd3921db640 4 set_mon_vals no callback set 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient: _renew_subs 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:50:27.511+0000 7fd276ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:50:27.511+0000 7fd276ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:50:27.511+0000 7fd276ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:50:27.511+0000 7fd3911d9640 10 monclient: get_auth_request con 0x7fd26c076380 auth_method 0 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:50:27.511+0000 7fd395526800 10 monclient: get_monmap_and_config 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:50:27.511+0000 7fd395526800 10 monclient: build_initial_monmap 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:50:27.511+0000 7fd395526800 1 build_initial for_mkfs: 0 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:50:27.511+0000 7fd395526800 10 monclient: monmap: 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:50:27.599 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding auth protocol: cephx 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding auth protocol: cephx 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding auth protocol: cephx 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: secure 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: crc 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: secure 2024-09-12T17:50:27.600 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: crc 2024-09-12T17:50:27.601 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: secure 2024-09-12T17:50:27.601 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: crc 2024-09-12T17:50:27.601 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: crc 2024-09-12T17:50:27.601 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: secure 2024-09-12T17:50:27.601 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: crc 2024-09-12T17:50:27.601 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: secure 2024-09-12T17:50:27.601 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: crc 2024-09-12T17:50:27.601 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: secure 2024-09-12T17:50:27.601 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:50:27.512+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient: init 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding auth protocol: cephx 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding auth protocol: cephx 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding auth protocol: cephx 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: secure 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: crc 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: secure 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: crc 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: secure 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: crc 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: crc 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: secure 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: crc 2024-09-12T17:50:27.602 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: secure 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: crc 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: secure 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:50:27.512+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:50:27.512+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:50:27.512+0000 7fd395526800 5 asok(0x5644f3bda730) register_command rotate-key cmddesc rotate-key hook 0x7fff6b7dbac8 EEXIST 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient: _reopen_session rank -1 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): picked mon.noname-c con 0x5644f3e9c780 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): picked mon.noname-b con 0x5644f3ec71f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): picked mon.noname-a con 0x5644f3ec85a0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): _renew_subs 2024-09-12T17:50:27.603 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): authenticate will time out at 2032.058910s 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): get_auth_request con 0x5644f3e9c780 auth_method 0 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): get_auth_request con 0x5644f3ec85a0 auth_method 0 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): get_auth_request con 0x5644f3ec71f0 auth_method 0 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.604 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): handle_auth_done global_id 6875 payload 274 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient: _finish_hunting 0 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:50:27.513+0000 7fd3911d9640 1 monclient: found mon.noname-c 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: dump: 2024-09-12T17:50:27.605 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: _finish_auth 0 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.606 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: dump: 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:50:27.513+0000 7fd395526800 5 monclient: authenticate success, global_id 6875 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:50:27.513+0000 7fd395526800 10 monclient: get_monmap_and_config success 2024-09-12T17:50:27.607 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:50:27.513+0000 7fd395526800 4 set_mon_vals no callback set 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:50:27.513+0000 7fd395526800 10 monclient: shutdown 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:50:27.514+0000 7fd395526800 10 monclient: build_initial_monmap 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:50:27.514+0000 7fd395526800 1 build_initial for_mkfs: 0 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:50:27.514+0000 7fd395526800 10 monclient: monmap: 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:50:27.608 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding auth protocol: cephx 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding auth protocol: cephx 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding auth protocol: cephx 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: secure 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: crc 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: secure 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: crc 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: secure 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: crc 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: crc 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: secure 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: crc 2024-09-12T17:50:27.609 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: secure 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: crc 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: secure 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:50:27.514+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:50:27.514+0000 7fd395526800 1 librados: starting msgr at 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:50:27.514+0000 7fd395526800 1 librados: starting objecter 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:50:27.514+0000 7fd395526800 5 asok(0x5644f3bda730) register_command objecter_requests cmddesc objecter_requests hook 0x5644f3ebf9d0 EEXIST 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:50:27.514+0000 7fd395526800 1 librados: setting wanted keys 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:50:27.514+0000 7fd395526800 1 librados: calling monclient init 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:50:27.514+0000 7fd395526800 10 monclient: init 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding auth protocol: cephx 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding auth protocol: cephx 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding auth protocol: cephx 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: secure 2024-09-12T17:50:27.610 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: crc 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: secure 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: crc 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: secure 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: crc 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: crc 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: secure 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: crc 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: secure 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: crc 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: secure 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:50:27.514+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:50:27.514+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.611 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:50:27.514+0000 7fd395526800 5 asok(0x5644f3bda730) register_command rotate-key cmddesc rotate-key hook 0x5644f3e8d2a8 EEXIST 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:50:27.514+0000 7fd395526800 10 monclient: _reopen_session rank -1 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): picked mon.noname-a con 0x5644f3e9c780 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): picked mon.noname-c con 0x5644f3ec85a0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): picked mon.noname-b con 0x5644f3ec4f50 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): _renew_subs 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): authenticate will time out at 2032.061048s 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): get_auth_request con 0x5644f3e9c780 auth_method 0 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.612 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): get_auth_request con 0x5644f3ec85a0 auth_method 0 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): get_auth_request con 0x5644f3ec4f50 auth_method 0 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.613 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): handle_auth_done global_id 7287 payload 824 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient: _finish_hunting 0 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:50:27.515+0000 7fd3911d9640 1 monclient: found mon.noname-a 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: dump: 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.614 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: _finish_auth 0 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: dump: 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.615 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:50:27.515+0000 7fd274ff9640 4 set_mon_vals no callback set 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:50:27.515+0000 7fd395526800 5 monclient: authenticate success, global_id 7287 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient: _renew_subs 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient: _renew_subs 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.616 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:50:27.515+0000 7fd395526800 1 librados: init done 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:50:27.515+0000 7fd395526800 5 asok(0x5644f3bda730) register_command cr dump hook 0x5644f3ebae88 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:50:27.517+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:50:27.517+0000 7fd262ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:50:27.517+0000 7fd262ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:50:27.517+0000 7fd262ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:50:27.518+0000 7fd3889d8640 10 monclient: get_auth_request con 0x7fd25c0764a0 auth_method 0 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:50:27.518+0000 7fd3919da640 10 monclient: get_auth_request con 0x5644f3ee73f0 auth_method 0 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:50:27.518+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:50:27.518+0000 7fd395526800 20 realm 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:50:27.518+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:50:27.518+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:50:27.518+0000 7fd395526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:27.617 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:50:27.518+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:50:27.519+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:50:27.519+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:50:27.519+0000 7fd3911d9640 10 monclient: get_auth_request con 0x5644f3eeb650 auth_method 0 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:50:27.519+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:50:27.519+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:50:27.520+0000 7fd3889d8640 10 monclient: get_auth_request con 0x5644f3eeeed0 auth_method 0 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:50:27.520+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:50:27.520+0000 7fd395526800 20 searching for the correct realm 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:50:27.520+0000 7fd3919da640 10 monclient: get_auth_request con 0x5644f3ef3c90 auth_method 0 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:50:27.521+0000 7fd3911d9640 10 monclient: get_auth_request con 0x7fd38c018070 auth_method 0 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:50:27.522+0000 7fd3889d8640 10 monclient: get_auth_request con 0x7fd37c063070 auth_method 0 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:50:27.523+0000 7fd3919da640 0 -- 172.21.15.107:0/1765430077 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5644f3ef3c90 msgr2=0x5644f3ef6150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:50:27.523+0000 7fd262ffd640 1 client.7287.objecter ms_handle_reset 0x5644f3ef3c90 session 0x5644f3ef3610 osd.3 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:50:27.523+0000 7fd262ffd640 10 monclient: _renew_subs 2024-09-12T17:50:27.618 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:50:27.523+0000 7fd262ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:50:27.523+0000 7fd3919da640 10 monclient: get_auth_request con 0x7fd25c086b50 auth_method 0 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:50:27.524+0000 7fd3919da640 10 monclient: get_auth_request con 0x7fd37c0b4c60 auth_method 0 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:50:27.525+0000 7fd3911d9640 10 monclient: get_auth_request con 0x7fd37c0b1860 auth_method 0 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:50:27.526+0000 7fd3911d9640 0 -- 172.21.15.107:0/1765430077 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fd37c0b1860 msgr2=0x7fd37c0c51e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:50:27.526+0000 7fd262ffd640 1 client.7287.objecter ms_handle_reset 0x7fd37c0b1860 session 0x7fd37c0a8180 osd.0 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:50:27.526+0000 7fd3911d9640 10 monclient: get_auth_request con 0x5644f3ef3c90 auth_method 0 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.619 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:50:27.530+0000 7fd395526800 20 zone default found 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:50:27.530+0000 7fd395526800 4 Realm: () 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:50:27.530+0000 7fd395526800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:50:27.530+0000 7fd395526800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:50:27.530+0000 7fd395526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:50:27.530+0000 7fd395526800 20 zonegroup default 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:50:27.531+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.620 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:50:27.531+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:50:27.531+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:50:27.531+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:50:27.531+0000 7fd395526800 20 started sync module instance, tier type = 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:50:27.531+0000 7fd395526800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=0 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=1 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=2 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=3 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=4 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=5 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=6 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:50:27.541+0000 7fd395526800 20 add_watcher() i=7 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:50:27.541+0000 7fd395526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:27.621 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding auth protocol: cephx 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding auth protocol: cephx 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding auth protocol: cephx 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: secure 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: crc 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: secure 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: crc 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: secure 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: crc 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: crc 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:50:27.542+0000 7fd247fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: secure 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: crc 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: secure 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: crc 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: secure 2024-09-12T17:50:27.622 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:50:27.543+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:50:27.543+0000 7fd395526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:50:27.543+0000 7fd395526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command cache list hook 0x5644f3ec32d0 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command cache inspect hook 0x5644f3ec32d0 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command cache erase hook 0x5644f3ec32d0 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command cache zap hook 0x5644f3ec32d0 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:50:27.543+0000 7fd395526800 5 note: GC not initialized 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:50:27.543+0000 7fd246fe5640 20 reqs_thread_entry: start 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command sync trace show hook 0x7fd38c004720 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command sync trace history hook 0x7fd38c004720 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command sync trace active hook 0x7fd38c004720 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command sync trace active_short hook 0x7fd38c004720 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:50:27.543+0000 7fd395526800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:50:27.543+0000 7fd395526800 20 Filter name: none 2024-09-12T17:50:27.623 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:50:27.543+0000 7fd244fe1640 20 reqs_thread_entry: start 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:50:27.543+0000 7fd395526800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:50:27.543+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:50:27.543+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:50:27.543+0000 7fd395526800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:50:27.543+0000 7fd395526800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:50:27.543+0000 7fd395526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 : miss 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:50:27.543+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:50:27.544+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:50:27.544+0000 7fd395526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:50:27.544+0000 7fd395526800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:50:27.544+0000 7fd395526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:50:27.544+0000 7fd395526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:50:27.544+0000 7fd395526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 2024-09-12T17:50:27.624 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:50:27.548+0000 7fd395526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:50:27.548+0000 7fd395526800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:50:27.548+0000 7fd395526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:50:27.548+0000 7fd395526800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33, ofs0, ns] 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:50:27.548+0000 7fd263fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94854150314832 notifier 7287 bl.length()=1015 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:50:27.548+0000 7fd263fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:50:27.548+0000 7fd263fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:50:27.548+0000 7fd263fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:50:27.548+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_sources= new_sources= 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:50:27.548+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential sources added=[] removed=[] 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:50:27.548+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_dests= new_dests= 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:50:27.548+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential dests added=[] removed=[] 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:50:27.550+0000 7fd395526800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.0 2024-09-12T17:50:27.625 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:50:27.550+0000 7fd395526800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.0 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:50:27.550+0000 7fd395526800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.1 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:50:27.550+0000 7fd395526800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.1 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:50:27.550+0000 7fd395526800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.0 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:50:27.553+0000 7fd395526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:50:27.553+0000 7fd395526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:50:27.554+0000 7fd395526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:50:27.554+0000 7fd395526800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:50:27.554+0000 7fd395526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:50:27.554+0000 7fd395526800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33, ofs0, ns] 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:50:27.554+0000 7fd263fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464310 cookie 94854150314832 notifier 7287 bl.length()=1015 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:50:27.554+0000 7fd263fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:50:27.554+0000 7fd263fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.626 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:50:27.554+0000 7fd263fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:50:27.555+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_sources= new_sources= 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:50:27.555+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential sources added=[] removed=[] 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:50:27.555+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_dests= new_dests= 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:50:27.555+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential dests added=[] removed=[] 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:50:27.556+0000 7fd395526800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.0 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:50:27.557+0000 7fd395526800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd395526800 time 2024-09-12T17:50:27.557445+0000 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd396b8c71a] 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd396b8c8d8] 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644f1d52841] 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5644f1d62827] 2024-09-12T17:50:27.627 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd395829590] 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:50:27.557+0000 7fd395526800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7fd395526800 thread_name:radosgw-admin 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd39583e6f0] 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd39588b99c] 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:50:27.628 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd396b8c774] 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd396b8c8d8] 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644f1d52841] 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5644f1d62827] 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd395829590] 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:50:27.629 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:50:27.630 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:50:27.631 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:50:27.632 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:50:27.633 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:50:27.634 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:50:27.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd244fe1640 / http_manager 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd246fe5640 / http_manager 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd247fe7640 / rgw_dt_lg_renew 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd262ffd640 / ms_dispatch 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd263fff640 / io_context_pool 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd274ff9640 / io_context_pool 2024-09-12T17:50:27.636 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd276ffd640 / ms_dispatch 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd27de03640 / ms_dispatch 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd27f606640 / io_context_pool 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd3889d8640 / msgr-worker-2 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd3911d9640 / msgr-worker-1 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd3919da640 / msgr-worker-0 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd3921db640 / io_context_pool 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd395526800 / radosgw-admin 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/log/ceph/ceph-client.admin.121859.log 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:50:27.501+0000 7fd395526800 5 AuthRegistry(0x5644f3e02590) adding con mode: crc 2024-09-12T17:50:27.637 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:50:27.501+0000 7fd395526800 5 AuthRegistry(0x5644f3e02590) adding con mode: secure 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:50:27.501+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:50:27.502+0000 7fd395526800 1 librados: starting msgr at 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:50:27.502+0000 7fd395526800 1 librados: starting objecter 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:50:27.502+0000 7fd395526800 5 asok(0x5644f3bda730) register_command objecter_requests hook 0x5644f3e002d0 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:50:27.502+0000 7fd395526800 1 librados: setting wanted keys 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:50:27.502+0000 7fd395526800 1 librados: calling monclient init 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient: init 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding auth protocol: cephx 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding auth protocol: cephx 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding auth protocol: cephx 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: secure 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: crc 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: secure 2024-09-12T17:50:27.638 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: crc 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: secure 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: crc 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: crc 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: secure 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: crc 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: secure 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: crc 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:50:27.502+0000 7fd395526800 5 AuthRegistry(0x5644f3dfce40) adding con mode: secure 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:50:27.502+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:50:27.502+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:50:27.502+0000 7fd395526800 5 asok(0x5644f3bda730) register_command rotate-key hook 0x5644f3dfcf88 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient: _reopen_session rank -1 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): picked mon.noname-a con 0x5644f3cb3a90 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:50:27.639 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): picked mon.noname-c con 0x5644f3d3f110 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): picked mon.noname-b con 0x5644f3d42410 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): _renew_subs 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:50:27.502+0000 7fd395526800 10 monclient(hunting): authenticate will time out at 2032.048707s 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): get_auth_request con 0x5644f3cb3a90 auth_method 0 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): get_auth_request con 0x5644f3d3f110 auth_method 0 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.640 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:50:27.502+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:50:27.502+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:50:27.503+0000 7fd3911d9640 10 monclient(hunting): handle_auth_done global_id 7278 payload 824 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:50:27.503+0000 7fd3911d9640 10 monclient: _finish_hunting 0 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:50:27.503+0000 7fd3911d9640 1 monclient: found mon.noname-a 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:50:27.503+0000 7fd3911d9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: dump: 2024-09-12T17:50:27.641 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: _finish_auth 0 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: _check_auth_tickets 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.642 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:50:27.503+0000 7fd27de03640 10 monclient: dump: 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:50:27.503+0000 7fd395526800 5 monclient: authenticate success, global_id 7278 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:50:27.503+0000 7fd395526800 10 monclient: _renew_subs 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:50:27.503+0000 7fd395526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.643 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:50:27.503+0000 7fd27f606640 4 set_mon_vals no callback set 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:50:27.503+0000 7fd395526800 10 monclient: _renew_subs 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:50:27.503+0000 7fd395526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:50:27.503+0000 7fd395526800 1 librados: init done 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:50:27.505+0000 7fd27de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:50:27.505+0000 7fd27de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:50:27.505+0000 7fd27de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:50:27.505+0000 7fd3889d8640 10 monclient: get_auth_request con 0x7fd278076470 auth_method 0 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:50:27.505+0000 7fd3919da640 10 monclient: get_auth_request con 0x5644f3e2f6c0 auth_method 0 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:50:27.506+0000 7fd3911d9640 10 monclient: get_auth_request con 0x5644f3e47c90 auth_method 0 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:50:27.507+0000 7fd3889d8640 10 monclient: get_auth_request con 0x5644f3e4c330 auth_method 0 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:50:27.508+0000 7fd395526800 10 monclient: build_initial_monmap 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:50:27.508+0000 7fd395526800 1 build_initial for_mkfs: 0 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:50:27.508+0000 7fd395526800 10 monclient: monmap: 2024-09-12T17:50:27.644 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding auth protocol: cephx 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding auth protocol: cephx 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding auth protocol: cephx 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: secure 2024-09-12T17:50:27.645 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: crc 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: secure 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: crc 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: secure 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: crc 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: crc 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: secure 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: crc 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: secure 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: crc 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e51050) adding con mode: secure 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:50:27.508+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:50:27.508+0000 7fd395526800 5 asok(0x5644f3bda730) register_command objecter_requests cmddesc objecter_requests hook 0x5644f3e54580 EEXIST 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:50:27.508+0000 7fd395526800 10 monclient: init 2024-09-12T17:50:27.646 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding auth protocol: cephx 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding auth protocol: cephx 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding auth protocol: cephx 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: secure 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: crc 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: secure 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: crc 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: secure 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: crc 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: crc 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: secure 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: crc 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: secure 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: crc 2024-09-12T17:50:27.647 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:50:27.508+0000 7fd395526800 5 AuthRegistry(0x5644f3e4f6d8) adding con mode: secure 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:50:27.508+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:50:27.509+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:50:27.509+0000 7fd395526800 5 asok(0x5644f3bda730) register_command rotate-key cmddesc rotate-key hook 0x5644f3e4f820 EEXIST 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient: _reopen_session rank -1 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): picked mon.noname-b con 0x5644f3e788a0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): picked mon.noname-c con 0x5644f3e78c80 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): picked mon.noname-a con 0x5644f3e775b0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): _renew_subs 2024-09-12T17:50:27.648 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient(hunting): authenticate will time out at 2032.055165s 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): get_auth_request con 0x5644f3e78c80 auth_method 0 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): get_auth_request con 0x5644f3e775b0 auth_method 0 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): get_auth_request con 0x5644f3e788a0 auth_method 0 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.649 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:50:27.509+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:50:27.509+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient(hunting): handle_auth_done global_id 6872 payload 824 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient: _finish_hunting 0 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:50:27.509+0000 7fd3889d8640 1 monclient: found mon.noname-c 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:50:27.509+0000 7fd3889d8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:50:27.650 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: dump: 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: _finish_auth 0 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:50:27.509+0000 7fd395526800 5 monclient: authenticate success, global_id 6872 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient: _renew_subs 2024-09-12T17:50:27.651 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:50:27.509+0000 7fd276ffd640 10 monclient: dump: 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.652 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:50:27.509+0000 7fd3921db640 4 set_mon_vals no callback set 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient: _renew_subs 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:50:27.509+0000 7fd395526800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:50:27.511+0000 7fd276ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:50:27.511+0000 7fd276ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:50:27.511+0000 7fd276ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:50:27.511+0000 7fd3911d9640 10 monclient: get_auth_request con 0x7fd26c076380 auth_method 0 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:50:27.511+0000 7fd395526800 10 monclient: get_monmap_and_config 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:50:27.511+0000 7fd395526800 10 monclient: build_initial_monmap 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:50:27.511+0000 7fd395526800 1 build_initial for_mkfs: 0 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:50:27.511+0000 7fd395526800 10 monclient: monmap: 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:50:27.653 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding auth protocol: cephx 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding auth protocol: cephx 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding auth protocol: cephx 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: secure 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: crc 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: secure 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: crc 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: secure 2024-09-12T17:50:27.654 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: crc 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: crc 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: secure 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: crc 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: secure 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: crc 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:50:27.511+0000 7fd395526800 5 AuthRegistry(0x5644f3e98630) adding con mode: secure 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:50:27.512+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient: init 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding auth protocol: cephx 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding auth protocol: cephx 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding auth protocol: cephx 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: secure 2024-09-12T17:50:27.655 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: crc 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: secure 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: crc 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: secure 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: crc 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: crc 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: secure 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: crc 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: secure 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: crc 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:50:27.512+0000 7fd395526800 5 AuthRegistry(0x7fff6b7db980) adding con mode: secure 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:50:27.512+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:50:27.512+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:50:27.512+0000 7fd395526800 5 asok(0x5644f3bda730) register_command rotate-key cmddesc rotate-key hook 0x7fff6b7dbac8 EEXIST 2024-09-12T17:50:27.656 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient: _reopen_session rank -1 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): picked mon.noname-c con 0x5644f3e9c780 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): picked mon.noname-b con 0x5644f3ec71f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): picked mon.noname-a con 0x5644f3ec85a0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): _renew_subs 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:50:27.512+0000 7fd395526800 10 monclient(hunting): authenticate will time out at 2032.058910s 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): get_auth_request con 0x5644f3e9c780 auth_method 0 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.657 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): get_auth_request con 0x5644f3ec85a0 auth_method 0 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): get_auth_request con 0x5644f3ec71f0 auth_method 0 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:50:27.513+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.658 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:50:27.513+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient(hunting): handle_auth_done global_id 6875 payload 274 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient: _finish_hunting 0 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:50:27.513+0000 7fd3911d9640 1 monclient: found mon.noname-c 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:50:27.513+0000 7fd3911d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: dump: 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.659 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: _finish_auth 0 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:50:27.513+0000 7fd274ff9640 10 monclient: dump: 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.660 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:50:27.513+0000 7fd395526800 5 monclient: authenticate success, global_id 6875 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:50:27.513+0000 7fd395526800 10 monclient: get_monmap_and_config success 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:50:27.513+0000 7fd395526800 4 set_mon_vals no callback set 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:50:27.513+0000 7fd395526800 10 monclient: shutdown 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:50:27.514+0000 7fd395526800 10 monclient: build_initial_monmap 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:50:27.514+0000 7fd395526800 1 build_initial for_mkfs: 0 2024-09-12T17:50:27.661 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:50:27.514+0000 7fd395526800 10 monclient: monmap: 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding auth protocol: cephx 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding auth protocol: cephx 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding auth protocol: cephx 2024-09-12T17:50:27.662 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: secure 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: crc 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: secure 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: crc 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: secure 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: crc 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: crc 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: secure 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: crc 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: secure 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: crc 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e9d360) adding con mode: secure 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:50:27.514+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:50:27.514+0000 7fd395526800 1 librados: starting msgr at 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:50:27.514+0000 7fd395526800 1 librados: starting objecter 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:50:27.514+0000 7fd395526800 5 asok(0x5644f3bda730) register_command objecter_requests cmddesc objecter_requests hook 0x5644f3ebf9d0 EEXIST 2024-09-12T17:50:27.663 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:50:27.514+0000 7fd395526800 1 librados: setting wanted keys 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:50:27.514+0000 7fd395526800 1 librados: calling monclient init 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:50:27.514+0000 7fd395526800 10 monclient: init 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding auth protocol: cephx 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding auth protocol: cephx 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding auth protocol: cephx 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: secure 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: crc 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: secure 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: crc 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: secure 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: crc 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: crc 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: secure 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: crc 2024-09-12T17:50:27.664 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: secure 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: crc 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:50:27.514+0000 7fd395526800 5 AuthRegistry(0x5644f3e8d160) adding con mode: secure 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:50:27.514+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:50:27.514+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:50:27.514+0000 7fd395526800 5 asok(0x5644f3bda730) register_command rotate-key cmddesc rotate-key hook 0x5644f3e8d2a8 EEXIST 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:50:27.514+0000 7fd395526800 10 monclient: _reopen_session rank -1 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): picked mon.noname-a con 0x5644f3e9c780 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): picked mon.noname-c con 0x5644f3ec85a0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): picked mon.noname-b con 0x5644f3ec4f50 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): start opening mon connection 2024-09-12T17:50:27.665 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): _renew_subs 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient(hunting): authenticate will time out at 2032.061048s 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): get_auth_request con 0x5644f3e9c780 auth_method 0 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): get_auth_request con 0x5644f3ec85a0 auth_method 0 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.666 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:50:27.515+0000 7fd3889d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): get_auth_request con 0x5644f3ec4f50 auth_method 0 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:50:27.515+0000 7fd3919da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient(hunting): handle_auth_done global_id 7287 payload 824 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient: _finish_hunting 0 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:50:27.515+0000 7fd3911d9640 1 monclient: found mon.noname-a 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:50:27.515+0000 7fd3911d9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:50:27.667 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: dump: 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: _finish_auth 0 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:50:27.668 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:50:27.515+0000 7fd262ffd640 10 monclient: dump: 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:50:27.515+0000 7fd274ff9640 4 set_mon_vals no callback set 2024-09-12T17:50:27.669 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:50:27.515+0000 7fd395526800 5 monclient: authenticate success, global_id 7287 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient: _renew_subs 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient: _renew_subs 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:50:27.515+0000 7fd395526800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:50:27.515+0000 7fd395526800 1 librados: init done 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:50:27.515+0000 7fd395526800 5 asok(0x5644f3bda730) register_command cr dump hook 0x5644f3ebae88 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:50:27.517+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:50:27.517+0000 7fd262ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:50:27.517+0000 7fd262ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:50:27.517+0000 7fd262ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:50:27.518+0000 7fd3889d8640 10 monclient: get_auth_request con 0x7fd25c0764a0 auth_method 0 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:50:27.518+0000 7fd3919da640 10 monclient: get_auth_request con 0x5644f3ee73f0 auth_method 0 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:50:27.518+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.670 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:50:27.518+0000 7fd395526800 20 realm 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:50:27.518+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:50:27.518+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:50:27.518+0000 7fd395526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:50:27.518+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:50:27.519+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:50:27.519+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:50:27.519+0000 7fd3911d9640 10 monclient: get_auth_request con 0x5644f3eeb650 auth_method 0 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:50:27.519+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:50:27.519+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:50:27.520+0000 7fd3889d8640 10 monclient: get_auth_request con 0x5644f3eeeed0 auth_method 0 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:50:27.520+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:50:27.520+0000 7fd395526800 20 searching for the correct realm 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:50:27.520+0000 7fd3919da640 10 monclient: get_auth_request con 0x5644f3ef3c90 auth_method 0 2024-09-12T17:50:27.671 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:50:27.521+0000 7fd3911d9640 10 monclient: get_auth_request con 0x7fd38c018070 auth_method 0 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:50:27.522+0000 7fd3889d8640 10 monclient: get_auth_request con 0x7fd37c063070 auth_method 0 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:50:27.523+0000 7fd3919da640 0 -- 172.21.15.107:0/1765430077 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5644f3ef3c90 msgr2=0x5644f3ef6150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:50:27.523+0000 7fd262ffd640 1 client.7287.objecter ms_handle_reset 0x5644f3ef3c90 session 0x5644f3ef3610 osd.3 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:50:27.523+0000 7fd262ffd640 10 monclient: _renew_subs 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:50:27.523+0000 7fd262ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:50:27.523+0000 7fd3919da640 10 monclient: get_auth_request con 0x7fd25c086b50 auth_method 0 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:50:27.524+0000 7fd3919da640 10 monclient: get_auth_request con 0x7fd37c0b4c60 auth_method 0 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:50:27.525+0000 7fd3911d9640 10 monclient: get_auth_request con 0x7fd37c0b1860 auth_method 0 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:50:27.526+0000 7fd3911d9640 0 -- 172.21.15.107:0/1765430077 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fd37c0b1860 msgr2=0x7fd37c0c51e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:50:27.526+0000 7fd262ffd640 1 client.7287.objecter ms_handle_reset 0x7fd37c0b1860 session 0x7fd37c0a8180 osd.0 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:50:27.526+0000 7fd3911d9640 10 monclient: get_auth_request con 0x5644f3ef3c90 auth_method 0 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:27.672 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:50:27.530+0000 7fd395526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:50:27.530+0000 7fd395526800 20 zone default found 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:50:27.530+0000 7fd395526800 4 Realm: () 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:50:27.530+0000 7fd395526800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:50:27.530+0000 7fd395526800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:27.673 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:50:27.530+0000 7fd395526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:50:27.530+0000 7fd395526800 20 zonegroup default 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:50:27.530+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:50:27.531+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:50:27.531+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:50:27.531+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:50:27.531+0000 7fd395526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:50:27.531+0000 7fd395526800 20 started sync module instance, tier type = 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:50:27.531+0000 7fd395526800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=0 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=1 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=2 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=3 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=4 2024-09-12T17:50:27.674 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=5 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:50:27.540+0000 7fd395526800 20 add_watcher() i=6 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:50:27.541+0000 7fd395526800 20 add_watcher() i=7 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:50:27.541+0000 7fd395526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding auth protocol: cephx 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding auth protocol: cephx 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding auth protocol: cephx 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: secure 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: crc 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: secure 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: crc 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: secure 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: crc 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: crc 2024-09-12T17:50:27.675 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:50:27.542+0000 7fd247fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: secure 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: crc 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: secure 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: crc 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:50:27.542+0000 7fd395526800 5 AuthRegistry(0x7fff6b7dbe50) adding con mode: secure 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:50:27.543+0000 7fd395526800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:50:27.543+0000 7fd395526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:50:27.543+0000 7fd395526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command cache list hook 0x5644f3ec32d0 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command cache inspect hook 0x5644f3ec32d0 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command cache erase hook 0x5644f3ec32d0 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command cache zap hook 0x5644f3ec32d0 2024-09-12T17:50:27.676 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:50:27.543+0000 7fd395526800 5 note: GC not initialized 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:50:27.543+0000 7fd246fe5640 20 reqs_thread_entry: start 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command sync trace show hook 0x7fd38c004720 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command sync trace history hook 0x7fd38c004720 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command sync trace active hook 0x7fd38c004720 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:50:27.543+0000 7fd395526800 5 asok(0x5644f3bda730) register_command sync trace active_short hook 0x7fd38c004720 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:50:27.543+0000 7fd395526800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:50:27.543+0000 7fd395526800 20 Filter name: none 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:50:27.543+0000 7fd244fe1640 20 reqs_thread_entry: start 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:50:27.543+0000 7fd395526800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:50:27.543+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:50:27.543+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:50:27.543+0000 7fd395526800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:50:27.543+0000 7fd395526800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:50:27.677 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:50:27.543+0000 7fd395526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 : miss 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:50:27.543+0000 7fd395526800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:50:27.544+0000 7fd395526800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:50:27.544+0000 7fd395526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:50:27.544+0000 7fd395526800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:50:27.544+0000 7fd395526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:50:27.544+0000 7fd395526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:50:27.544+0000 7fd395526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:50:27.548+0000 7fd395526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:50:27.548+0000 7fd395526800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:50:27.548+0000 7fd395526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:50:27.548+0000 7fd395526800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33, ofs0, ns] 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:50:27.548+0000 7fd263fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94854150314832 notifier 7287 bl.length()=1015 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:50:27.548+0000 7fd263fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.678 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:50:27.548+0000 7fd263fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:50:27.548+0000 7fd263fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:50:27.548+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_sources= new_sources= 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:50:27.548+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential sources added=[] removed=[] 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:50:27.548+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_dests= new_dests= 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:50:27.548+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential dests added=[] removed=[] 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:50:27.550+0000 7fd395526800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.0 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:50:27.550+0000 7fd395526800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.0 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:50:27.550+0000 7fd395526800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.1 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:50:27.550+0000 7fd395526800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.1 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:50:27.550+0000 7fd395526800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.0 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:50:27.553+0000 7fd395526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:50:27.553+0000 7fd395526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:50:27.554+0000 7fd395526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.679 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:50:27.554+0000 7fd395526800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:50:27.554+0000 7fd395526800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:50:27.554+0000 7fd395526800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33, ofs0, ns] 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:50:27.554+0000 7fd263fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464310 cookie 94854150314832 notifier 7287 bl.length()=1015 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:50:27.554+0000 7fd263fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:50:27.554+0000 7fd263fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:50:27.554+0000 7fd263fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:50:27.555+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_sources= new_sources= 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:50:27.555+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential sources added=[] removed=[] 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:50:27.555+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_dests= new_dests= 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:50:27.555+0000 7fd395526800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential dests added=[] removed=[] 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:50:27.556+0000 7fd395526800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.0 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:50:27.557+0000 7fd395526800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd395526800 time 2024-09-12T17:50:27.557445+0000 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:50:27.680 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd396b8c71a] 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd396b8c8d8] 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644f1d52841] 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5644f1d62827] 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd395829590] 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:50:27.557+0000 7fd395526800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7fd395526800 thread_name:radosgw-admin 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.681 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd39583e6f0] 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd39588b99c] 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd396b8c774] 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd396b8c8d8] 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644f1d52841] 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5644f1d62827] 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd395829590] 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.682 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:50:27.683 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:50:27.684 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:50:27.685 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:50:27.686 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:50:27.686 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:50:27.686 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:50:27.686 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:50:27.686 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:50:27.686 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:50:27.686 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:50:27.686 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:50:27.686 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:50:27.686 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:50:27.686 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:50:27.686 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:50:27.687 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:50:27.688 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd244fe1640 / http_manager 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd246fe5640 / http_manager 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd247fe7640 / rgw_dt_lg_renew 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd262ffd640 / ms_dispatch 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd263fff640 / io_context_pool 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd274ff9640 / io_context_pool 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd276ffd640 / ms_dispatch 2024-09-12T17:50:27.689 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd27de03640 / ms_dispatch 2024-09-12T17:50:27.690 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd27f606640 / io_context_pool 2024-09-12T17:50:27.690 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd3889d8640 / msgr-worker-2 2024-09-12T17:50:27.690 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd3911d9640 / msgr-worker-1 2024-09-12T17:50:27.690 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd3919da640 / msgr-worker-0 2024-09-12T17:50:27.690 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd3921db640 / io_context_pool 2024-09-12T17:50:27.690 INFO:tasks.workunit.client.0.smithi107.stderr: 7fd395526800 / radosgw-admin 2024-09-12T17:50:27.690 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:50:27.690 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:50:27.690 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:50:27.558831Z_989766fa-5348-43fd-9873-acb56c69ed27/log 2024-09-12T17:50:27.690 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:50:27.690 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:50:27.692 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:27.692 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:27.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.632+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.634+0000 7f186160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.634+0000 7f186160e800 20 realm 2024-09-12T17:50:27.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.634+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.634+0000 7f186160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.634+0000 7f186160e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:27.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.634+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.634+0000 7f186160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.634+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.635+0000 7f186160e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:27.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.635+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.636+0000 7f186160e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:27.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.636+0000 7f186160e800 20 searching for the correct realm 2024-09-12T17:50:27.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.638+0000 7f185cdbc640 0 -- 172.21.15.107:0/670242239 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f18580da350 msgr2=0x7f18580c4860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:27.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.641+0000 7f185cdbc640 0 -- 172.21.15.107:0/670242239 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f184800bc20 msgr2=0x7f1848045960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:27.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.847+0000 7f186160e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:27.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.847+0000 7f186160e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:27.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.847+0000 7f186160e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:27.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.847+0000 7f186160e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:27.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.847+0000 7f186160e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:27.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.847+0000 7f186160e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:27.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.847+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:27.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:27.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 20 zone default found 2024-09-12T17:50:27.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 4 Realm: () 2024-09-12T17:50:27.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:27.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:27.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:27.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 20 zonegroup default 2024-09-12T17:50:27.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.848+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.849+0000 7f186160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.849+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.849+0000 7f186160e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:27.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.849+0000 7f186160e800 20 started sync module instance, tier type = 2024-09-12T17:50:27.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.849+0000 7f186160e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:27.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.858+0000 7f186160e800 20 add_watcher() i=0 2024-09-12T17:50:27.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.858+0000 7f186160e800 20 add_watcher() i=1 2024-09-12T17:50:27.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.858+0000 7f186160e800 20 add_watcher() i=2 2024-09-12T17:50:27.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.858+0000 7f186160e800 20 add_watcher() i=3 2024-09-12T17:50:27.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.858+0000 7f186160e800 20 add_watcher() i=4 2024-09-12T17:50:27.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.858+0000 7f186160e800 20 add_watcher() i=5 2024-09-12T17:50:27.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.858+0000 7f186160e800 20 add_watcher() i=6 2024-09-12T17:50:27.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.859+0000 7f186160e800 20 add_watcher() i=7 2024-09-12T17:50:27.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.859+0000 7f186160e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:27.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.860+0000 7f17137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:27.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.861+0000 7f186160e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:27.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.861+0000 7f186160e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:27.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.861+0000 7f186160e800 5 note: GC not initialized 2024-09-12T17:50:27.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.861+0000 7f17127e4640 20 reqs_thread_entry: start 2024-09-12T17:50:27.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.861+0000 7f186160e800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:27.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.861+0000 7f186160e800 20 Filter name: none 2024-09-12T17:50:27.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.861+0000 7f170b7fe640 20 reqs_thread_entry: start 2024-09-12T17:50:27.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.861+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.862+0000 7f186160e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:27.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.862+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.862+0000 7f186160e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:50:27.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.862+0000 7f186160e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:27.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.862+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.862+0000 7f186160e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:27.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.862+0000 7f186160e800 20 rados->read ofs=0 len=0 2024-09-12T17:50:27.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.863+0000 7f186160e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:50:27.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.863+0000 7f186160e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:27.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.864+0000 7f17137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:27.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.866+0000 7f186160e800 20 remove_watcher() i=0 2024-09-12T17:50:27.867 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.866+0000 7f186160e800 2 removed watcher, disabling cache 2024-09-12T17:50:27.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.867+0000 7f186160e800 20 remove_watcher() i=1 2024-09-12T17:50:27.869 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.868+0000 7f186160e800 20 remove_watcher() i=2 2024-09-12T17:50:27.870 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.869+0000 7f186160e800 20 remove_watcher() i=3 2024-09-12T17:50:27.871 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.870+0000 7f186160e800 20 remove_watcher() i=4 2024-09-12T17:50:27.872 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.871+0000 7f186160e800 20 remove_watcher() i=5 2024-09-12T17:50:27.873 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.872+0000 7f186160e800 20 remove_watcher() i=6 2024-09-12T17:50:27.874 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:27.873+0000 7f186160e800 20 remove_watcher() i=7 2024-09-12T17:50:27.884 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:27.884 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:50:27.884 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-commit-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:50:27.884 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:57.964 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:50:58.001 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:58.001 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:58.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.041+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.042+0000 7ff8e6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.042+0000 7ff8e6a14800 20 realm 2024-09-12T17:50:58.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.042+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.043+0000 7ff8e6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.043+0000 7ff8e6a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:58.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.043+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.043+0000 7ff8e6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.043+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.044+0000 7ff8e6a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:58.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.044+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.044+0000 7ff8e6a14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:58.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.044+0000 7ff8e6a14800 20 searching for the correct realm 2024-09-12T17:50:58.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.047+0000 7ff8dbfff640 0 -- 172.21.15.107:0/1984623444 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7ff8cc08dbf0 msgr2=0x7ff8cc046470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:58.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.051+0000 7ff8e20cb640 0 -- 172.21.15.107:0/1984623444 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7ff8cc071580 msgr2=0x7ff8cc0829e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:58.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.258+0000 7ff8e6a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:58.260 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.258+0000 7ff8e6a14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:58.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.258+0000 7ff8e6a14800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:58.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.258+0000 7ff8e6a14800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:58.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.258+0000 7ff8e6a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:58.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.258+0000 7ff8e6a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:58.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.258+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.259+0000 7ff8e6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.259+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.259+0000 7ff8e6a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:58.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.259+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.260+0000 7ff8e6a14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:58.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.260+0000 7ff8e6a14800 20 zone default found 2024-09-12T17:50:58.262 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.260+0000 7ff8e6a14800 4 Realm: () 2024-09-12T17:50:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.260+0000 7ff8e6a14800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.260+0000 7ff8e6a14800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.260+0000 7ff8e6a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.260+0000 7ff8e6a14800 20 zonegroup default 2024-09-12T17:50:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.260+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.260+0000 7ff8e6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.260+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.260+0000 7ff8e6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.260+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.261+0000 7ff8e6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.261+0000 7ff8e6a14800 20 started sync module instance, tier type = 2024-09-12T17:50:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.261+0000 7ff8e6a14800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:58.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.270+0000 7ff8e6a14800 20 add_watcher() i=0 2024-09-12T17:50:58.271 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.270+0000 7ff8e6a14800 20 add_watcher() i=1 2024-09-12T17:50:58.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.270+0000 7ff8e6a14800 20 add_watcher() i=2 2024-09-12T17:50:58.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.270+0000 7ff8e6a14800 20 add_watcher() i=3 2024-09-12T17:50:58.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.270+0000 7ff8e6a14800 20 add_watcher() i=4 2024-09-12T17:50:58.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.270+0000 7ff8e6a14800 20 add_watcher() i=5 2024-09-12T17:50:58.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.270+0000 7ff8e6a14800 20 add_watcher() i=6 2024-09-12T17:50:58.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.271+0000 7ff8e6a14800 20 add_watcher() i=7 2024-09-12T17:50:58.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.271+0000 7ff8e6a14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:58.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.273+0000 7ff798fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:58.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.274+0000 7ff8e6a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:58.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.274+0000 7ff8e6a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:58.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.274+0000 7ff8e6a14800 5 note: GC not initialized 2024-09-12T17:50:58.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.274+0000 7ff7137fe640 20 reqs_thread_entry: start 2024-09-12T17:50:58.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.274+0000 7ff8e6a14800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:58.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.274+0000 7ff8e6a14800 20 Filter name: none 2024-09-12T17:50:58.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.274+0000 7ff7117fa640 20 reqs_thread_entry: start 2024-09-12T17:50:58.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.274+0000 7ff8e6a14800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:50:58.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.274+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.275+0000 7ff8e6a14800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:58.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.275+0000 7ff8e6a14800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:50:58.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.275+0000 7ff8e6a14800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:50:58.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.275+0000 7ff8e6a14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 : miss 2024-09-12T17:50:58.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.275+0000 7ff8e6a14800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.275+0000 7ff8e6a14800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:58.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.275+0000 7ff8e6a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:58.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.275+0000 7ff8e6a14800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:58.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.275+0000 7ff8e6a14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:50:58.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.275+0000 7ff8e6a14800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:58.277 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.275+0000 7ff8e6a14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 2024-09-12T17:50:58.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.279+0000 7ff8e6a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:58.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.279+0000 7ff8e6a14800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:58.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.279+0000 7ff8e6a14800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:58.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.279+0000 7ff8e6a14800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33, ofs0, ns] 2024-09-12T17:50:58.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.279+0000 7ff7c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464312 cookie 94024985091328 notifier 7329 bl.length()=1015 2024-09-12T17:50:58.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.279+0000 7ff7c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:58.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.279+0000 7ff7c5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:58.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.279+0000 7ff7c5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:58.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.280+0000 7ff8e6a14800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_sources= new_sources= 2024-09-12T17:50:58.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.280+0000 7ff8e6a14800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential sources added=[] removed=[] 2024-09-12T17:50:58.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.280+0000 7ff8e6a14800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_dests= new_dests= 2024-09-12T17:50:58.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.280+0000 7ff8e6a14800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential dests added=[] removed=[] 2024-09-12T17:50:58.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.282+0000 7ff8e6a14800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.0 2024-09-12T17:50:58.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.282+0000 7ff8e6a14800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.0 2024-09-12T17:50:58.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.282+0000 7ff8e6a14800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.1 2024-09-12T17:50:58.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.282+0000 7ff8e6a14800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.1.1 2024-09-12T17:50:58.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.282+0000 7ff8e6a14800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.0 2024-09-12T17:50:58.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.285+0000 7ff8e6a14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:58.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.285+0000 7ff8e6a14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 2024-09-12T17:50:58.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.287+0000 7ff8e6a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:58.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.287+0000 7ff8e6a14800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:58.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.287+0000 7ff8e6a14800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:58.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.287+0000 7ff8e6a14800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33, ofs0, ns] 2024-09-12T17:50:58.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.288+0000 7ff7c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464313 cookie 94024985091328 notifier 7329 bl.length()=1015 2024-09-12T17:50:58.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.288+0000 7ff7c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:58.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.288+0000 7ff7c5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:58.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.288+0000 7ff7c5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:58.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.288+0000 7ff8e6a14800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_sources= new_sources= 2024-09-12T17:50:58.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.288+0000 7ff8e6a14800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential sources added=[] removed=[] 2024-09-12T17:50:58.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.288+0000 7ff8e6a14800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_dests= new_dests= 2024-09-12T17:50:58.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.288+0000 7ff8e6a14800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential dests added=[] removed=[] 2024-09-12T17:50:58.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.289+0000 7ff8e6a14800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.33.0 2024-09-12T17:50:58.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.289+0000 7ff8e6a14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:58.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.290+0000 7ff8e6a14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 2024-09-12T17:50:58.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.291+0000 7ff8e6a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:58.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.291+0000 7ff8e6a14800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:58.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.291+0000 7ff8e6a14800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:58.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.291+0000 7ff8e6a14800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33, ofs0, ns] 2024-09-12T17:50:58.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.291+0000 7ff7c57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464314 cookie 94024985091328 notifier 7329 bl.length()=983 2024-09-12T17:50:58.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.292+0000 7ff7c57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 info.flags=0x17 2024-09-12T17:50:58.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.292+0000 7ff7c57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 to cache LRU end 2024-09-12T17:50:58.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.292+0000 7ff7c57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:58.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.292+0000 7ff8e6a14800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_sources= new_sources= 2024-09-12T17:50:58.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.292+0000 7ff8e6a14800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential sources added=[] removed=[] 2024-09-12T17:50:58.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.292+0000 7ff8e6a14800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): orig_dests= new_dests= 2024-09-12T17:50:58.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.292+0000 7ff8e6a14800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[35ed0db6-4f54-4e96-b306-71079c84e007.4596.33]): potential dests added=[] removed=[] 2024-09-12T17:50:58.294 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.293+0000 7ff8e6a14800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:50:58.295 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.295+0000 7ff798fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:58.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.297+0000 7ff8e6a14800 20 remove_watcher() i=0 2024-09-12T17:50:58.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.297+0000 7ff8e6a14800 2 removed watcher, disabling cache 2024-09-12T17:50:58.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.299+0000 7ff8e6a14800 20 remove_watcher() i=1 2024-09-12T17:50:58.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.300+0000 7ff8e6a14800 20 remove_watcher() i=2 2024-09-12T17:50:58.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.301+0000 7ff8e6a14800 20 remove_watcher() i=3 2024-09-12T17:50:58.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.302+0000 7ff8e6a14800 20 remove_watcher() i=4 2024-09-12T17:50:58.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.303+0000 7ff8e6a14800 20 remove_watcher() i=5 2024-09-12T17:50:58.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.304+0000 7ff8e6a14800 20 remove_watcher() i=6 2024-09-12T17:50:58.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.305+0000 7ff8e6a14800 20 remove_watcher() i=7 2024-09-12T17:50:58.318 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:50:58.347 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:58.347 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:58.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.382+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.384+0000 7f4558c19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.384+0000 7f4558c19800 20 realm 2024-09-12T17:50:58.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.384+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.384+0000 7f4558c19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.384+0000 7f4558c19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:58.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.384+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.384+0000 7f4558c19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.384+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.385+0000 7f4558c19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:58.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.385+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.386+0000 7f4558c19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:58.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.386+0000 7f4558c19800 20 searching for the correct realm 2024-09-12T17:50:58.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.388+0000 7f4553bea640 0 -- 172.21.15.107:0/2189631749 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x55a04a31b6d0 msgr2=0x55a04a31dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:58.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.391+0000 7f45543eb640 0 -- 172.21.15.107:0/2189631749 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f454c067030 msgr2=0x7f454c0a7af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:58.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.396+0000 7f4558c19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:58.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.396+0000 7f4558c19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:58.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.396+0000 7f4558c19800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:58.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.396+0000 7f4558c19800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:58.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.396+0000 7f4558c19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:58.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.396+0000 7f4558c19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:58.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.396+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.396+0000 7f4558c19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.396+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.397+0000 7f4558c19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:58.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.397+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.397+0000 7f4558c19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:58.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.397+0000 7f4558c19800 20 zone default found 2024-09-12T17:50:58.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.397+0000 7f4558c19800 4 Realm: () 2024-09-12T17:50:58.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.397+0000 7f4558c19800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:58.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.397+0000 7f4558c19800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:58.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.397+0000 7f4558c19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:58.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.397+0000 7f4558c19800 20 zonegroup default 2024-09-12T17:50:58.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.397+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.398+0000 7f4558c19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.398+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.398+0000 7f4558c19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.398+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.398+0000 7f4558c19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.398+0000 7f4558c19800 20 started sync module instance, tier type = 2024-09-12T17:50:58.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.398+0000 7f4558c19800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:58.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.408+0000 7f4558c19800 20 add_watcher() i=0 2024-09-12T17:50:58.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.408+0000 7f4558c19800 20 add_watcher() i=1 2024-09-12T17:50:58.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.408+0000 7f4558c19800 20 add_watcher() i=2 2024-09-12T17:50:58.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.408+0000 7f4558c19800 20 add_watcher() i=3 2024-09-12T17:50:58.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.408+0000 7f4558c19800 20 add_watcher() i=4 2024-09-12T17:50:58.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.408+0000 7f4558c19800 20 add_watcher() i=5 2024-09-12T17:50:58.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.408+0000 7f4558c19800 20 add_watcher() i=6 2024-09-12T17:50:58.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.408+0000 7f4558c19800 20 add_watcher() i=7 2024-09-12T17:50:58.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.408+0000 7f4558c19800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:58.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.410+0000 7f440a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:58.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.410+0000 7f4558c19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:58.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.410+0000 7f4558c19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:58.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.410+0000 7f4558c19800 5 note: GC not initialized 2024-09-12T17:50:58.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.411+0000 7f44097e2640 20 reqs_thread_entry: start 2024-09-12T17:50:58.412 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.411+0000 7f4558c19800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:58.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.411+0000 7f4558c19800 20 Filter name: none 2024-09-12T17:50:58.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.411+0000 7f437affd640 20 reqs_thread_entry: start 2024-09-12T17:50:58.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.411+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.411+0000 7f4558c19800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:58.413 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.411+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.412+0000 7f4558c19800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:58.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.412+0000 7f4558c19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:58.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.412+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.412+0000 7f4558c19800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:50:58.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.412+0000 7f4558c19800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.412+0000 7f4558c19800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:50:58.414 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.412+0000 7f4558c19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:58.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.414+0000 7f440a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:58.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.416+0000 7f4558c19800 20 remove_watcher() i=0 2024-09-12T17:50:58.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.416+0000 7f4558c19800 2 removed watcher, disabling cache 2024-09-12T17:50:58.418 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.417+0000 7f4558c19800 20 remove_watcher() i=1 2024-09-12T17:50:58.419 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.418+0000 7f4558c19800 20 remove_watcher() i=2 2024-09-12T17:50:58.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.419+0000 7f4558c19800 20 remove_watcher() i=3 2024-09-12T17:50:58.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.420+0000 7f4558c19800 20 remove_watcher() i=4 2024-09-12T17:50:58.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.421+0000 7f4558c19800 20 remove_watcher() i=5 2024-09-12T17:50:58.423 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.422+0000 7f4558c19800 20 remove_watcher() i=6 2024-09-12T17:50:58.424 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.423+0000 7f4558c19800 20 remove_watcher() i=7 2024-09-12T17:50:58.434 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:58.434 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:50:58.434 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-commit-target-layout id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:50:58.434 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:58.498 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T17:50:58.498 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:58.711 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:50:58.739 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:58.739 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:58.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.774+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.776+0000 7f8e0d735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.776+0000 7f8e0d735800 20 realm 2024-09-12T17:50:58.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.776+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.776+0000 7f8e0d735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.776+0000 7f8e0d735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:58.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.776+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.776+0000 7f8e0d735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.776+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.777+0000 7f8e0d735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:58.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.777+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.778+0000 7f8e0d735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:58.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.778+0000 7f8e0d735800 20 searching for the correct realm 2024-09-12T17:50:58.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.779+0000 7f8e094e4640 0 -- 172.21.15.107:0/962939580 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f8e0401e040 msgr2=0x7f8e0401e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:58.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.984+0000 7f8e08ce3640 0 -- 172.21.15.107:0/962939580 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x562c1a675da0 msgr2=0x562c1a678190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:58.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.992+0000 7f8e0d735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:58.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.992+0000 7f8e0d735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:58.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.992+0000 7f8e0d735800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:58.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.992+0000 7f8e0d735800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:58.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.992+0000 7f8e0d735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:58.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.992+0000 7f8e0d735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:58.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.992+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.992+0000 7f8e0d735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.992+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.993+0000 7f8e0d735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:58.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.993+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.993+0000 7f8e0d735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:58.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.993+0000 7f8e0d735800 20 zone default found 2024-09-12T17:50:58.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.993+0000 7f8e0d735800 4 Realm: () 2024-09-12T17:50:58.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.993+0000 7f8e0d735800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:58.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.993+0000 7f8e0d735800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:58.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.993+0000 7f8e0d735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:58.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.993+0000 7f8e0d735800 20 zonegroup default 2024-09-12T17:50:58.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.993+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.993+0000 7f8e0d735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.993+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.994+0000 7f8e0d735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.994+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:58.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.994+0000 7f8e0d735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:58.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.994+0000 7f8e0d735800 20 started sync module instance, tier type = 2024-09-12T17:50:58.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:58.994+0000 7f8e0d735800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:59.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.003+0000 7f8e0d735800 20 add_watcher() i=0 2024-09-12T17:50:59.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.003+0000 7f8e0d735800 20 add_watcher() i=1 2024-09-12T17:50:59.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.003+0000 7f8e0d735800 20 add_watcher() i=2 2024-09-12T17:50:59.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.003+0000 7f8e0d735800 20 add_watcher() i=3 2024-09-12T17:50:59.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.003+0000 7f8e0d735800 20 add_watcher() i=4 2024-09-12T17:50:59.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.003+0000 7f8e0d735800 20 add_watcher() i=5 2024-09-12T17:50:59.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.003+0000 7f8e0d735800 20 add_watcher() i=6 2024-09-12T17:50:59.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.004+0000 7f8e0d735800 20 add_watcher() i=7 2024-09-12T17:50:59.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.004+0000 7f8e0d735800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:59.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.005+0000 7f8cbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:59.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.006+0000 7f8e0d735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:59.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.006+0000 7f8e0d735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:59.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.006+0000 7f8e0d735800 5 note: GC not initialized 2024-09-12T17:50:59.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.006+0000 7f8cbe7e4640 20 reqs_thread_entry: start 2024-09-12T17:50:59.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.006+0000 7f8e0d735800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:59.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.006+0000 7f8e0d735800 20 Filter name: none 2024-09-12T17:50:59.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.006+0000 7f8c2ffff640 20 reqs_thread_entry: start 2024-09-12T17:50:59.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.006+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.007+0000 7f8e0d735800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:50:59.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.007+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.007+0000 7f8e0d735800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:50:59.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.007+0000 7f8e0d735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:59.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.007+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.007+0000 7f8e0d735800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:50:59.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.007+0000 7f8e0d735800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.008+0000 7f8e0d735800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:50:59.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.008+0000 7f8e0d735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:59.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.009+0000 7f8cbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:59.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.011+0000 7f8e0d735800 20 remove_watcher() i=0 2024-09-12T17:50:59.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.011+0000 7f8e0d735800 2 removed watcher, disabling cache 2024-09-12T17:50:59.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.012+0000 7f8e0d735800 20 remove_watcher() i=1 2024-09-12T17:50:59.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.013+0000 7f8e0d735800 20 remove_watcher() i=2 2024-09-12T17:50:59.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.014+0000 7f8e0d735800 20 remove_watcher() i=3 2024-09-12T17:50:59.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.015+0000 7f8e0d735800 20 remove_watcher() i=4 2024-09-12T17:50:59.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.016+0000 7f8e0d735800 20 remove_watcher() i=5 2024-09-12T17:50:59.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.017+0000 7f8e0d735800 20 remove_watcher() i=6 2024-09-12T17:50:59.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.018+0000 7f8e0d735800 20 remove_watcher() i=7 2024-09-12T17:50:59.029 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:59.029 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:50:59.029 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-do-reshard id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:50:59.029 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:59.031 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T17:50:59.065 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:59.065 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:59.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.100+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.101+0000 7f8561210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.101+0000 7f8561210800 20 realm 2024-09-12T17:50:59.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.101+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.102+0000 7f8561210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.102+0000 7f8561210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:59.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.102+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.102+0000 7f8561210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.102+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.103+0000 7f8561210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:59.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.103+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.103+0000 7f8561210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:59.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.103+0000 7f8561210800 20 searching for the correct realm 2024-09-12T17:50:59.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.106+0000 7f855c8cb640 0 -- 172.21.15.107:0/1099539081 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f8558070040 msgr2=0x7f8558061420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.109+0000 7f855c8cb640 0 -- 172.21.15.107:0/1099539081 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f8544057930 msgr2=0x7f854403c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:59.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.114+0000 7f8561210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:59.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.114+0000 7f8561210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:59.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.114+0000 7f8561210800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:59.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.114+0000 7f8561210800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:59.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.114+0000 7f8561210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:59.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.114+0000 7f8561210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:59.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.114+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.114+0000 7f8561210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.114+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:59.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:59.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 20 zone default found 2024-09-12T17:50:59.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 4 Realm: () 2024-09-12T17:50:59.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 20 zonegroup default 2024-09-12T17:50:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.115+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.116+0000 7f8561210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.116+0000 7f8561210800 20 started sync module instance, tier type = 2024-09-12T17:50:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.116+0000 7f8561210800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:59.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.124+0000 7f8561210800 20 add_watcher() i=0 2024-09-12T17:50:59.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.124+0000 7f8561210800 20 add_watcher() i=1 2024-09-12T17:50:59.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.124+0000 7f8561210800 20 add_watcher() i=2 2024-09-12T17:50:59.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.124+0000 7f8561210800 20 add_watcher() i=3 2024-09-12T17:50:59.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.124+0000 7f8561210800 20 add_watcher() i=4 2024-09-12T17:50:59.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.124+0000 7f8561210800 20 add_watcher() i=5 2024-09-12T17:50:59.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.124+0000 7f8561210800 20 add_watcher() i=6 2024-09-12T17:50:59.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.125+0000 7f8561210800 20 add_watcher() i=7 2024-09-12T17:50:59.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.125+0000 7f8561210800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:59.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.127+0000 7f8412fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:59.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.127+0000 7f8561210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:59.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.127+0000 7f8561210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:59.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.127+0000 7f8561210800 5 note: GC not initialized 2024-09-12T17:50:59.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.127+0000 7f8411fe3640 20 reqs_thread_entry: start 2024-09-12T17:50:59.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.127+0000 7f8561210800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:59.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.127+0000 7f8561210800 20 Filter name: none 2024-09-12T17:50:59.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.127+0000 7f83837fe640 20 reqs_thread_entry: start 2024-09-12T17:50:59.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.127+0000 7f8561210800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:50:59.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.127+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.128+0000 7f8561210800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:50:59.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.128+0000 7f8561210800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:50:59.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.128+0000 7f8561210800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:50:59.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.128+0000 7f8561210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 : miss 2024-09-12T17:50:59.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.128+0000 7f8561210800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.128+0000 7f8561210800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:50:59.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.128+0000 7f8561210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 info.flags=0x17 2024-09-12T17:50:59.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.128+0000 7f8561210800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 to cache LRU end 2024-09-12T17:50:59.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.128+0000 7f8561210800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:50:59.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.128+0000 7f8561210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:59.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.128+0000 7f8561210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 2024-09-12T17:50:59.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.132+0000 7f8561210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 info.flags=0x17 2024-09-12T17:50:59.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.132+0000 7f8561210800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 to cache LRU end 2024-09-12T17:50:59.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.132+0000 7f8561210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:59.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.132+0000 7f8561210800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34, ofs0, ns] 2024-09-12T17:50:59.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.132+0000 7f8433fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94712452073776 notifier 6956 bl.length()=995 2024-09-12T17:50:59.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.132+0000 7f8433fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 info.flags=0x17 2024-09-12T17:50:59.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.132+0000 7f8433fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 to cache LRU end 2024-09-12T17:50:59.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.132+0000 7f8433fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:59.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.133+0000 7f8561210800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): orig_sources= new_sources= 2024-09-12T17:50:59.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.133+0000 7f8561210800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): potential sources added=[] removed=[] 2024-09-12T17:50:59.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.133+0000 7f8561210800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): orig_dests= new_dests= 2024-09-12T17:50:59.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.133+0000 7f8561210800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): potential dests added=[] removed=[] 2024-09-12T17:50:59.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.135+0000 7f8561210800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T17:50:59.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.138+0000 7f8561210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:50:59.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.138+0000 7f8561210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 2024-09-12T17:50:59.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.139+0000 7f8561210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 info.flags=0x17 2024-09-12T17:50:59.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.139+0000 7f8561210800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 to cache LRU end 2024-09-12T17:50:59.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.139+0000 7f8561210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:59.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.139+0000 7f8561210800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34, ofs0, ns] 2024-09-12T17:50:59.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.139+0000 7f84337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94712452073776 notifier 6956 bl.length()=963 2024-09-12T17:50:59.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.139+0000 7f84337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 info.flags=0x17 2024-09-12T17:50:59.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.139+0000 7f84337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 to cache LRU end 2024-09-12T17:50:59.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.139+0000 7f84337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:50:59.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.140+0000 7f8561210800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): orig_sources= new_sources= 2024-09-12T17:50:59.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.140+0000 7f8561210800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): potential sources added=[] removed=[] 2024-09-12T17:50:59.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.140+0000 7f8561210800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): orig_dests= new_dests= 2024-09-12T17:50:59.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.140+0000 7f8561210800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): potential dests added=[] removed=[] 2024-09-12T17:50:59.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.140+0000 7f8561210800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T17:50:59.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.142+0000 7f8412fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:59.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.144+0000 7f8561210800 20 remove_watcher() i=0 2024-09-12T17:50:59.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.144+0000 7f8561210800 2 removed watcher, disabling cache 2024-09-12T17:50:59.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.145+0000 7f8561210800 20 remove_watcher() i=1 2024-09-12T17:50:59.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.145+0000 7f8561210800 20 remove_watcher() i=2 2024-09-12T17:50:59.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.146+0000 7f8561210800 20 remove_watcher() i=3 2024-09-12T17:50:59.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.147+0000 7f8561210800 20 remove_watcher() i=4 2024-09-12T17:50:59.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.148+0000 7f8561210800 20 remove_watcher() i=5 2024-09-12T17:50:59.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.149+0000 7f8561210800 20 remove_watcher() i=6 2024-09-12T17:50:59.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.150+0000 7f8561210800 20 remove_watcher() i=7 2024-09-12T17:50:59.162 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:50:59.191 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:59.192 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:59.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.226+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.228+0000 7fad74d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.228+0000 7fad74d40800 20 realm 2024-09-12T17:50:59.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.228+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.228+0000 7fad74d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.228+0000 7fad74d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:59.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.228+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.229+0000 7fad74d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.229+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.229+0000 7fad74d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:59.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.229+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.230+0000 7fad74d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:59.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.230+0000 7fad74d40800 20 searching for the correct realm 2024-09-12T17:50:59.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.234+0000 7fad712c1640 0 -- 172.21.15.107:0/1446536013 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7fad5c00b040 msgr2=0x7fad5c06b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:50:59.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.440+0000 7fad70ac0640 0 -- 172.21.15.107:0/1446536013 >> [v2:172.21.15.148:6800/18671776,v1:172.21.15.148:6801/18671776] conn(0x55747e47fe30 msgr2=0x55747e482220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:59.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.443+0000 7fad74d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:59.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.443+0000 7fad74d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:59.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.443+0000 7fad74d40800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:50:59.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.443+0000 7fad74d40800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:50:59.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.443+0000 7fad74d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:59.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.443+0000 7fad74d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:59.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.443+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.443+0000 7fad74d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.443+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.444+0000 7fad74d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.444+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.444+0000 7fad74d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.444+0000 7fad74d40800 20 zone default found 2024-09-12T17:50:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.444+0000 7fad74d40800 4 Realm: () 2024-09-12T17:50:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.444+0000 7fad74d40800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:50:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.444+0000 7fad74d40800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:50:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.444+0000 7fad74d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.444+0000 7fad74d40800 20 zonegroup default 2024-09-12T17:50:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.444+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.444+0000 7fad74d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.445+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.445+0000 7fad74d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.445+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.445+0000 7fad74d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.445+0000 7fad74d40800 20 started sync module instance, tier type = 2024-09-12T17:50:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.445+0000 7fad74d40800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:50:59.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.454+0000 7fad74d40800 20 add_watcher() i=0 2024-09-12T17:50:59.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.454+0000 7fad74d40800 20 add_watcher() i=1 2024-09-12T17:50:59.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.454+0000 7fad74d40800 20 add_watcher() i=2 2024-09-12T17:50:59.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.454+0000 7fad74d40800 20 add_watcher() i=3 2024-09-12T17:50:59.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.454+0000 7fad74d40800 20 add_watcher() i=4 2024-09-12T17:50:59.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.454+0000 7fad74d40800 20 add_watcher() i=5 2024-09-12T17:50:59.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.454+0000 7fad74d40800 20 add_watcher() i=6 2024-09-12T17:50:59.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.455+0000 7fad74d40800 20 add_watcher() i=7 2024-09-12T17:50:59.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.455+0000 7fad74d40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:59.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.456+0000 7fac26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:59.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.457+0000 7fad74d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:59.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.457+0000 7fad74d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:59.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.457+0000 7fad74d40800 5 note: GC not initialized 2024-09-12T17:50:59.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.457+0000 7fac25fe3640 20 reqs_thread_entry: start 2024-09-12T17:50:59.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.457+0000 7fad74d40800 20 init_complete bucket index max shards: 1 2024-09-12T17:50:59.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.457+0000 7fad74d40800 20 Filter name: none 2024-09-12T17:50:59.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.457+0000 7fab977fe640 20 reqs_thread_entry: start 2024-09-12T17:50:59.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.457+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.457+0000 7fad74d40800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:50:59.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.457+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.458+0000 7fad74d40800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:50:59.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.458+0000 7fad74d40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:59.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.458+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.458+0000 7fad74d40800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:50:59.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.458+0000 7fad74d40800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.459+0000 7fad74d40800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:50:59.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.459+0000 7fad74d40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:50:59.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.460+0000 7fac26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:59.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.462+0000 7fad74d40800 20 remove_watcher() i=0 2024-09-12T17:50:59.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.462+0000 7fad74d40800 2 removed watcher, disabling cache 2024-09-12T17:50:59.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.463+0000 7fad74d40800 20 remove_watcher() i=1 2024-09-12T17:50:59.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.463+0000 7fad74d40800 20 remove_watcher() i=2 2024-09-12T17:50:59.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.464+0000 7fad74d40800 20 remove_watcher() i=3 2024-09-12T17:50:59.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.466+0000 7fad74d40800 20 remove_watcher() i=4 2024-09-12T17:50:59.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.466+0000 7fad74d40800 20 remove_watcher() i=5 2024-09-12T17:50:59.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.467+0000 7fad74d40800 20 remove_watcher() i=6 2024-09-12T17:50:59.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.468+0000 7fad74d40800 20 remove_watcher() i=7 2024-09-12T17:50:59.479 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:59.479 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:50:59.479 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-do-reshard id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:50:59.480 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:50:59.531 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:50:59.562 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:59.562 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:59.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.597+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.599+0000 7fb766a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.599+0000 7fb766a98800 20 realm 2024-09-12T17:50:59.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.599+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.599+0000 7fb766a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.599+0000 7fb766a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:59.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.599+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.599+0000 7fb766a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:59.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.599+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.600+0000 7fb766a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:59.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.600+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:50:59.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.601+0000 7fb766a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:59.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.601+0000 7fb766a98800 20 searching for the correct realm 2024-09-12T17:50:59.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.604+0000 7fb763d81640 0 -- 172.21.15.107:0/1812571608 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fb75808e060 msgr2=0x7fb7580b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:50:59.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:50:59.809+0000 7fb764582640 0 -- 172.21.15.107:0/1812571608 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fb7580b4c10 msgr2=0x7fb7580b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:00.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.016+0000 7fb766a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:00.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.016+0000 7fb766a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:00.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.016+0000 7fb766a98800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:00.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.016+0000 7fb766a98800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:00.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.016+0000 7fb766a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:00.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.016+0000 7fb766a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:00.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.016+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.016+0000 7fb766a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.016+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.016+0000 7fb766a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.016+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.017+0000 7fb766a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:00.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.017+0000 7fb766a98800 20 zone default found 2024-09-12T17:51:00.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.017+0000 7fb766a98800 4 Realm: () 2024-09-12T17:51:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.017+0000 7fb766a98800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.017+0000 7fb766a98800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.017+0000 7fb766a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.017+0000 7fb766a98800 20 zonegroup default 2024-09-12T17:51:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.017+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.017+0000 7fb766a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.017+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.017+0000 7fb766a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.017+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.018+0000 7fb766a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.018+0000 7fb766a98800 20 started sync module instance, tier type = 2024-09-12T17:51:00.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.018+0000 7fb766a98800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:00.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.028+0000 7fb766a98800 20 add_watcher() i=0 2024-09-12T17:51:00.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.028+0000 7fb766a98800 20 add_watcher() i=1 2024-09-12T17:51:00.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.028+0000 7fb766a98800 20 add_watcher() i=2 2024-09-12T17:51:00.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.028+0000 7fb766a98800 20 add_watcher() i=3 2024-09-12T17:51:00.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.028+0000 7fb766a98800 20 add_watcher() i=4 2024-09-12T17:51:00.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.028+0000 7fb766a98800 20 add_watcher() i=5 2024-09-12T17:51:00.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.028+0000 7fb766a98800 20 add_watcher() i=6 2024-09-12T17:51:00.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.029+0000 7fb766a98800 20 add_watcher() i=7 2024-09-12T17:51:00.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.029+0000 7fb766a98800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:00.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.031+0000 7fb61b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.031+0000 7fb766a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:00.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.031+0000 7fb766a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:00.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.031+0000 7fb766a98800 5 note: GC not initialized 2024-09-12T17:51:00.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.031+0000 7fb61a7dc640 20 reqs_thread_entry: start 2024-09-12T17:51:00.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:00.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 20 Filter name: none 2024-09-12T17:51:00.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb6137fe640 20 reqs_thread_entry: start 2024-09-12T17:51:00.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:51:00.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:00.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:51:00.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:51:00.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 : miss 2024-09-12T17:51:00.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:51:00.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 info.flags=0x17 2024-09-12T17:51:00.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 to cache LRU end 2024-09-12T17:51:00.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:00.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.032+0000 7fb766a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 2024-09-12T17:51:00.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.036+0000 7fb766a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 info.flags=0x17 2024-09-12T17:51:00.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.036+0000 7fb766a98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 to cache LRU end 2024-09-12T17:51:00.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.036+0000 7fb766a98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.036+0000 7fb766a98800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34, ofs0, ns] 2024-09-12T17:51:00.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.036+0000 7fb63b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 94445862375984 notifier 7422 bl.length()=995 2024-09-12T17:51:00.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.036+0000 7fb63b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 info.flags=0x17 2024-09-12T17:51:00.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.036+0000 7fb63b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 to cache LRU end 2024-09-12T17:51:00.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.036+0000 7fb63b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.037+0000 7fb766a98800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): orig_sources= new_sources= 2024-09-12T17:51:00.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.037+0000 7fb766a98800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): potential sources added=[] removed=[] 2024-09-12T17:51:00.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.037+0000 7fb766a98800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): orig_dests= new_dests= 2024-09-12T17:51:00.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.037+0000 7fb766a98800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): potential dests added=[] removed=[] 2024-09-12T17:51:00.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.039+0000 7fb766a98800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.34.1.0 2024-09-12T17:51:00.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.039+0000 7fb766a98800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.34.1.0 2024-09-12T17:51:00.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.039+0000 7fb766a98800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.34.1.1 2024-09-12T17:51:00.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.039+0000 7fb766a98800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.34.1.1 2024-09-12T17:51:00.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.039+0000 7fb766a98800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.34.0 2024-09-12T17:51:00.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.042+0000 7fb766a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:51:00.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.042+0000 7fb766a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 2024-09-12T17:51:00.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.043+0000 7fb766a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 info.flags=0x17 2024-09-12T17:51:00.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.043+0000 7fb766a98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 to cache LRU end 2024-09-12T17:51:00.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.043+0000 7fb766a98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.043+0000 7fb766a98800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34, ofs0, ns] 2024-09-12T17:51:00.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.043+0000 7fb63affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 94445862375984 notifier 7422 bl.length()=995 2024-09-12T17:51:00.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.043+0000 7fb63affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 info.flags=0x17 2024-09-12T17:51:00.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.043+0000 7fb63affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 to cache LRU end 2024-09-12T17:51:00.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.043+0000 7fb63affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.043+0000 7fb766a98800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): orig_sources= new_sources= 2024-09-12T17:51:00.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.043+0000 7fb766a98800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): potential sources added=[] removed=[] 2024-09-12T17:51:00.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.043+0000 7fb766a98800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): orig_dests= new_dests= 2024-09-12T17:51:00.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.043+0000 7fb766a98800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): potential dests added=[] removed=[] 2024-09-12T17:51:00.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.045+0000 7fb766a98800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.34.0 2024-09-12T17:51:00.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.045+0000 7fb766a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:51:00.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.045+0000 7fb766a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 2024-09-12T17:51:00.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.046+0000 7fb766a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 info.flags=0x17 2024-09-12T17:51:00.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.046+0000 7fb766a98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 to cache LRU end 2024-09-12T17:51:00.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.046+0000 7fb766a98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.046+0000 7fb766a98800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34, ofs0, ns] 2024-09-12T17:51:00.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.047+0000 7fb63affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464291 cookie 94445862375984 notifier 7422 bl.length()=963 2024-09-12T17:51:00.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.047+0000 7fb63affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 info.flags=0x17 2024-09-12T17:51:00.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.047+0000 7fb63affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 to cache LRU end 2024-09-12T17:51:00.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.047+0000 7fb63affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.047+0000 7fb766a98800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): orig_sources= new_sources= 2024-09-12T17:51:00.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.047+0000 7fb766a98800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): potential sources added=[] removed=[] 2024-09-12T17:51:00.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.047+0000 7fb766a98800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): orig_dests= new_dests= 2024-09-12T17:51:00.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.047+0000 7fb766a98800 20 handle_bi_update(): bucket=:error-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.34]): potential dests added=[] removed=[] 2024-09-12T17:51:00.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.048+0000 7fb766a98800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T17:51:00.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.050+0000 7fb61b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.052+0000 7fb766a98800 20 remove_watcher() i=0 2024-09-12T17:51:00.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.052+0000 7fb766a98800 2 removed watcher, disabling cache 2024-09-12T17:51:00.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.053+0000 7fb766a98800 20 remove_watcher() i=1 2024-09-12T17:51:00.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.054+0000 7fb766a98800 20 remove_watcher() i=2 2024-09-12T17:51:00.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.055+0000 7fb766a98800 20 remove_watcher() i=3 2024-09-12T17:51:00.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.056+0000 7fb766a98800 20 remove_watcher() i=4 2024-09-12T17:51:00.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.057+0000 7fb766a98800 20 remove_watcher() i=5 2024-09-12T17:51:00.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.058+0000 7fb766a98800 20 remove_watcher() i=6 2024-09-12T17:51:00.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.059+0000 7fb766a98800 20 remove_watcher() i=7 2024-09-12T17:51:00.073 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:51:00.102 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:00.102 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:00.138 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.137+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.139+0000 7f9593498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.139+0000 7f9593498800 20 realm 2024-09-12T17:51:00.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.139+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.139+0000 7f9593498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.139+0000 7f9593498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:00.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.139+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.139+0000 7f9593498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.139+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.140+0000 7f9593498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.140+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.140+0000 7f9593498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:00.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.140+0000 7f9593498800 20 searching for the correct realm 2024-09-12T17:51:00.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.144+0000 7f958bfff640 0 -- 172.21.15.107:0/472227388 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x55a3852c5970 msgr2=0x55a3852c7d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:00.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.147+0000 7f958bfff640 0 -- 172.21.15.107:0/472227388 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f957c01f040 msgr2=0x7f957c02ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:00.152 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.150+0000 7f9593498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:00.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.150+0000 7f9593498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:00.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.150+0000 7f9593498800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:00.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.150+0000 7f9593498800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:00.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.150+0000 7f9593498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:00.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.150+0000 7f9593498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:00.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.150+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:00.153 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 20 zone default found 2024-09-12T17:51:00.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 4 Realm: () 2024-09-12T17:51:00.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:00.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:00.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:00.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 20 zonegroup default 2024-09-12T17:51:00.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.151+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.152+0000 7f9593498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.154 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.152+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.152+0000 7f9593498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.152+0000 7f9593498800 20 started sync module instance, tier type = 2024-09-12T17:51:00.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.152+0000 7f9593498800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:00.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.161+0000 7f9593498800 20 add_watcher() i=0 2024-09-12T17:51:00.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.161+0000 7f9593498800 20 add_watcher() i=1 2024-09-12T17:51:00.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.161+0000 7f9593498800 20 add_watcher() i=2 2024-09-12T17:51:00.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.161+0000 7f9593498800 20 add_watcher() i=3 2024-09-12T17:51:00.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.161+0000 7f9593498800 20 add_watcher() i=4 2024-09-12T17:51:00.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.161+0000 7f9593498800 20 add_watcher() i=5 2024-09-12T17:51:00.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.161+0000 7f9593498800 20 add_watcher() i=6 2024-09-12T17:51:00.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.162+0000 7f9593498800 20 add_watcher() i=7 2024-09-12T17:51:00.163 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.162+0000 7f9593498800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:00.164 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.163+0000 7f94477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.163+0000 7f9593498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:00.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.163+0000 7f9593498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:00.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.163+0000 7f9593498800 5 note: GC not initialized 2024-09-12T17:51:00.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.163+0000 7f94467e4640 20 reqs_thread_entry: start 2024-09-12T17:51:00.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.164+0000 7f9593498800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:00.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.164+0000 7f9593498800 20 Filter name: none 2024-09-12T17:51:00.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.164+0000 7f943f7fe640 20 reqs_thread_entry: start 2024-09-12T17:51:00.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.164+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.164+0000 7f9593498800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:00.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.164+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.165+0000 7f9593498800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:51:00.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.165+0000 7f9593498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:00.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.165+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.165+0000 7f9593498800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:00.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.165+0000 7f9593498800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.165+0000 7f9593498800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:51:00.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.165+0000 7f9593498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:00.167 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.166+0000 7f94477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.168+0000 7f9593498800 20 remove_watcher() i=0 2024-09-12T17:51:00.169 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.168+0000 7f9593498800 2 removed watcher, disabling cache 2024-09-12T17:51:00.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.169+0000 7f9593498800 20 remove_watcher() i=1 2024-09-12T17:51:00.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.170+0000 7f9593498800 20 remove_watcher() i=2 2024-09-12T17:51:00.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.171+0000 7f9593498800 20 remove_watcher() i=3 2024-09-12T17:51:00.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.172+0000 7f9593498800 20 remove_watcher() i=4 2024-09-12T17:51:00.174 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.173+0000 7f9593498800 20 remove_watcher() i=5 2024-09-12T17:51:00.175 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.174+0000 7f9593498800 20 remove_watcher() i=6 2024-09-12T17:51:00.176 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.175+0000 7f9593498800 20 remove_watcher() i=7 2024-09-12T17:51:00.186 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.186 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:51:00.187 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-do-reshard id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:51:00.187 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.251 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T17:51:00.251 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.431 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:51:00.459 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:00.459 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:00.494 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.493+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.495+0000 7f67e6933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.495+0000 7f67e6933800 20 realm 2024-09-12T17:51:00.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.495+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.495+0000 7f67e6933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.495+0000 7f67e6933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:00.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.495+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.495+0000 7f67e6933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.495+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.496+0000 7f67e6933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.497 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.496+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.497+0000 7f67e6933800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:00.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.497+0000 7f67e6933800 20 searching for the correct realm 2024-09-12T17:51:00.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.499+0000 7f67e1e19640 0 -- 172.21.15.107:0/4215185421 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f67d806b020 msgr2=0x7f67d80ad040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:00.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.503+0000 7f67e261a640 0 -- 172.21.15.107:0/4215185421 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f67d80ee250 msgr2=0x7f67d80b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:00.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.709+0000 7f67e6933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:00.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.709+0000 7f67e6933800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:00.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.709+0000 7f67e6933800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:00.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.709+0000 7f67e6933800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.709+0000 7f67e6933800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.709+0000 7f67e6933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.709+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.709+0000 7f67e6933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.709+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.709+0000 7f67e6933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.709+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 20 zone default found 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 4 Realm: () 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:00.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:00.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 20 zonegroup default 2024-09-12T17:51:00.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 20 started sync module instance, tier type = 2024-09-12T17:51:00.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.710+0000 7f67e6933800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:00.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.720+0000 7f67e6933800 20 add_watcher() i=0 2024-09-12T17:51:00.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.720+0000 7f67e6933800 20 add_watcher() i=1 2024-09-12T17:51:00.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.720+0000 7f67e6933800 20 add_watcher() i=2 2024-09-12T17:51:00.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.720+0000 7f67e6933800 20 add_watcher() i=3 2024-09-12T17:51:00.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.720+0000 7f67e6933800 20 add_watcher() i=4 2024-09-12T17:51:00.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.720+0000 7f67e6933800 20 add_watcher() i=5 2024-09-12T17:51:00.722 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.721+0000 7f67e6933800 20 add_watcher() i=6 2024-09-12T17:51:00.722 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.721+0000 7f67e6933800 20 add_watcher() i=7 2024-09-12T17:51:00.722 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.721+0000 7f67e6933800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:00.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.723+0000 7f66997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.723+0000 7f67e6933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:00.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.723+0000 7f67e6933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:00.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.723+0000 7f67e6933800 5 note: GC not initialized 2024-09-12T17:51:00.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.724+0000 7f66937fe640 20 reqs_thread_entry: start 2024-09-12T17:51:00.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.724+0000 7f67e6933800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:00.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.724+0000 7f67e6933800 20 Filter name: none 2024-09-12T17:51:00.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.724+0000 7f66917fa640 20 reqs_thread_entry: start 2024-09-12T17:51:00.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.724+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.725+0000 7f67e6933800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:00.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.725+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.725+0000 7f67e6933800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:51:00.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.725+0000 7f67e6933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:00.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.725+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.726+0000 7f67e6933800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:00.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.726+0000 7f67e6933800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.726+0000 7f67e6933800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:51:00.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.726+0000 7f67e6933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:00.728 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.727+0000 7f66997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.729+0000 7f67e6933800 20 remove_watcher() i=0 2024-09-12T17:51:00.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.729+0000 7f67e6933800 2 removed watcher, disabling cache 2024-09-12T17:51:00.731 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.730+0000 7f67e6933800 20 remove_watcher() i=1 2024-09-12T17:51:00.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.731+0000 7f67e6933800 20 remove_watcher() i=2 2024-09-12T17:51:00.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.732+0000 7f67e6933800 20 remove_watcher() i=3 2024-09-12T17:51:00.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.733+0000 7f67e6933800 20 remove_watcher() i=4 2024-09-12T17:51:00.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.734+0000 7f67e6933800 20 remove_watcher() i=5 2024-09-12T17:51:00.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.735+0000 7f67e6933800 20 remove_watcher() i=6 2024-09-12T17:51:00.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.736+0000 7f67e6933800 20 remove_watcher() i=7 2024-09-12T17:51:00.747 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.747 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:51:00.747 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-do-reshard id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:51:00.747 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.749 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:51:00.782 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:00.783 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:00.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.819+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.820+0000 7f03ed13c800 20 realm 2024-09-12T17:51:00.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.821 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.820+0000 7f03ed13c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:00.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.821+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.821+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.822+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:00.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.822+0000 7f03ed13c800 20 searching for the correct realm 2024-09-12T17:51:00.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.825+0000 7f03e9682640 0 -- 172.21.15.107:0/1503616224 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x559142e9db20 msgr2=0x559142e9ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:00.829 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.828+0000 7f03e0680640 0 -- 172.21.15.107:0/1503616224 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f03d0071050 msgr2=0x7f03d0066fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:00.834 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.832+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 20 zone default found 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 4 Realm: () 2024-09-12T17:51:00.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:00.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:00.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:00.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 20 zonegroup default 2024-09-12T17:51:00.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.834+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.834+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.834+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.834+0000 7f03ed13c800 20 started sync module instance, tier type = 2024-09-12T17:51:00.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.834+0000 7f03ed13c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:00.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=0 2024-09-12T17:51:00.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=1 2024-09-12T17:51:00.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=2 2024-09-12T17:51:00.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=3 2024-09-12T17:51:00.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=4 2024-09-12T17:51:00.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=5 2024-09-12T17:51:00.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=6 2024-09-12T17:51:00.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.845+0000 7f03ed13c800 20 add_watcher() i=7 2024-09-12T17:51:00.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.845+0000 7f03ed13c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:00.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.846+0000 7f029f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.847+0000 7f03ed13c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:00.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.847+0000 7f03ed13c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:00.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.847+0000 7f03ed13c800 5 note: GC not initialized 2024-09-12T17:51:00.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.847+0000 7f029e7e4640 20 reqs_thread_entry: start 2024-09-12T17:51:00.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.847+0000 7f03ed13c800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:00.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.847+0000 7f03ed13c800 20 Filter name: none 2024-09-12T17:51:00.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.847+0000 7f0297fff640 20 reqs_thread_entry: start 2024-09-12T17:51:00.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.847+0000 7f03ed13c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:51:00.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.847+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.848+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:00.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.848+0000 7f03ed13c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:51:00.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.848+0000 7f03ed13c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:51:00.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.848+0000 7f03ed13c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 : miss 2024-09-12T17:51:00.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.848+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.848+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:51:00.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.848+0000 7f03ed13c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:00.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.848+0000 7f03ed13c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:00.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.848+0000 7f03ed13c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:00.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.848+0000 7f03ed13c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.848+0000 7f03ed13c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 2024-09-12T17:51:00.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.852+0000 7f03ed13c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:00.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.852+0000 7f03ed13c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:00.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.852+0000 7f03ed13c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.852+0000 7f03ed13c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35, ofs0, ns] 2024-09-12T17:51:00.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.852+0000 7f02bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94082381309024 notifier 7479 bl.length()=995 2024-09-12T17:51:00.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.852+0000 7f02bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:00.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.852+0000 7f02bffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:00.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.852+0000 7f02bffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.853+0000 7f03ed13c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): orig_sources= new_sources= 2024-09-12T17:51:00.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.853+0000 7f03ed13c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): potential sources added=[] removed=[] 2024-09-12T17:51:00.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.853+0000 7f03ed13c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): orig_dests= new_dests= 2024-09-12T17:51:00.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.853+0000 7f03ed13c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): potential dests added=[] removed=[] 2024-09-12T17:51:00.856 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f03ed13c800 time 2024-09-12T17:51:00.856199+0000 2024-09-12T17:51:00.856 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:51:00.856 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:00.856 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03ee98c71a] 2024-09-12T17:51:00.857 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f03ee98c8d8] 2024-09-12T17:51:00.857 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559142040841] 2024-09-12T17:51:00.857 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55914205057a] 2024-09-12T17:51:00.857 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:51:00.857 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f03ed629590] 2024-09-12T17:51:00.858 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:51:00.858 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:51:00.858 INFO:tasks.workunit.client.0.smithi107.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:51:00.858 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f03ed13c800 thread_name:radosgw-admin 2024-09-12T17:51:00.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.855+0000 7f03ed13c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f03ed13c800 time 2024-09-12T17:51:00.856199+0000 2024-09-12T17:51:00.858 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:51:00.858 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.858 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:00.859 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03ee98c71a] 2024-09-12T17:51:00.859 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f03ee98c8d8] 2024-09-12T17:51:00.859 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559142040841] 2024-09-12T17:51:00.859 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55914205057a] 2024-09-12T17:51:00.859 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:51:00.859 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f03ed629590] 2024-09-12T17:51:00.859 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:51:00.859 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:51:00.859 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.881 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:00.881 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f03ed63e6f0] 2024-09-12T17:51:00.881 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f03ed68b99c] 2024-09-12T17:51:00.881 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:51:00.881 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:51:00.882 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03ee98c774] 2024-09-12T17:51:00.882 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f03ee98c8d8] 2024-09-12T17:51:00.882 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559142040841] 2024-09-12T17:51:00.882 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55914205057a] 2024-09-12T17:51:00.882 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:51:00.882 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f03ed629590] 2024-09-12T17:51:00.882 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:51:00.882 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:51:00.882 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.856+0000 7f03ed13c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:51:00.882 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f03ed13c800 thread_name:radosgw-admin 2024-09-12T17:51:00.882 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.883 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:00.883 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f03ed63e6f0] 2024-09-12T17:51:00.883 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f03ed68b99c] 2024-09-12T17:51:00.883 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:51:00.883 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:51:00.883 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03ee98c774] 2024-09-12T17:51:00.883 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f03ee98c8d8] 2024-09-12T17:51:00.883 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559142040841] 2024-09-12T17:51:00.883 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55914205057a] 2024-09-12T17:51:00.883 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:51:00.883 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f03ed629590] 2024-09-12T17:51:00.884 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:51:00.884 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:51:00.884 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:51:00.884 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.884 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:51:00.884 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:51:00.802+0000 7f02d6e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:00.884 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:51:00.802+0000 7f03ed13c800 10 monclient: get_monmap_and_config success 2024-09-12T17:51:00.884 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:51:00.802+0000 7f03ed13c800 4 set_mon_vals no callback set 2024-09-12T17:51:00.884 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:51:00.802+0000 7f02d6e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.884 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:51:00.802+0000 7f02d6e0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:51:00.885 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:51:00.802+0000 7f02d6e0d640 10 monclient: dump: 2024-09-12T17:51:00.885 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.885 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.885 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.885 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.885 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.885 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.885 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.885 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.885 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.885 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.885 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:51:00.802+0000 7f03ed13c800 10 monclient: shutdown 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:51:00.802+0000 7f03ed13c800 5 asok(0x559142b91730) unregister_commands rotate-key 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:51:00.803+0000 7f03ed13c800 10 monclient: build_initial_monmap 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:51:00.803+0000 7f03ed13c800 1 build_initial for_mkfs: 0 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:51:00.803+0000 7f03ed13c800 10 monclient: monmap: 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:00.886 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:00.887 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.887 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding auth protocol: cephx 2024-09-12T17:51:00.887 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding auth protocol: cephx 2024-09-12T17:51:00.887 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding auth protocol: cephx 2024-09-12T17:51:00.887 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: secure 2024-09-12T17:51:00.887 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: crc 2024-09-12T17:51:00.887 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: secure 2024-09-12T17:51:00.887 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: crc 2024-09-12T17:51:00.887 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: secure 2024-09-12T17:51:00.887 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: crc 2024-09-12T17:51:00.887 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: crc 2024-09-12T17:51:00.887 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: secure 2024-09-12T17:51:00.888 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: crc 2024-09-12T17:51:00.888 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: secure 2024-09-12T17:51:00.888 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: crc 2024-09-12T17:51:00.888 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: secure 2024-09-12T17:51:00.888 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:51:00.803+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.888 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:51:00.803+0000 7f03ed13c800 1 librados: starting msgr at 2024-09-12T17:51:00.888 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:51:00.803+0000 7f03ed13c800 1 librados: starting objecter 2024-09-12T17:51:00.888 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 asok(0x559142b91730) register_command objecter_requests hook 0x559142db8e00 2024-09-12T17:51:00.888 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:51:00.803+0000 7f03ed13c800 1 librados: setting wanted keys 2024-09-12T17:51:00.888 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:51:00.803+0000 7f03ed13c800 1 librados: calling monclient init 2024-09-12T17:51:00.888 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:51:00.803+0000 7f03ed13c800 10 monclient: init 2024-09-12T17:51:00.888 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding auth protocol: cephx 2024-09-12T17:51:00.889 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding auth protocol: cephx 2024-09-12T17:51:00.889 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding auth protocol: cephx 2024-09-12T17:51:00.889 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: secure 2024-09-12T17:51:00.889 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: crc 2024-09-12T17:51:00.889 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: secure 2024-09-12T17:51:00.889 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: crc 2024-09-12T17:51:00.889 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: secure 2024-09-12T17:51:00.889 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: crc 2024-09-12T17:51:00.889 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: crc 2024-09-12T17:51:00.889 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: secure 2024-09-12T17:51:00.890 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: crc 2024-09-12T17:51:00.890 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: secure 2024-09-12T17:51:00.890 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: crc 2024-09-12T17:51:00.890 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: secure 2024-09-12T17:51:00.890 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:51:00.803+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.890 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:51:00.803+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.890 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:51:00.804+0000 7f03ed13c800 5 asok(0x559142b91730) register_command rotate-key hook 0x559142db3ec8 2024-09-12T17:51:00.890 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:00.890 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:51:00.890 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-a con 0x559142cf6b00 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:00.891 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-c con 0x559142cf9a70 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:00.891 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-b con 0x559142cfa3f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:00.891 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.891 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.891 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.891 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:00.891 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): authenticate will time out at 2065.350068s 2024-09-12T17:51:00.891 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): get_auth_request con 0x559142cf6b00 auth_method 0 2024-09-12T17:51:00.891 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.891 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): get_auth_request con 0x559142cf9a70 auth_method 0 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): handle_auth_done global_id 7470 payload 824 2024-09-12T17:51:00.892 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient: _finish_hunting 0 2024-09-12T17:51:00.893 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:51:00.804+0000 7f03e8e81640 1 monclient: found mon.noname-a 2024-09-12T17:51:00.893 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.893 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.893 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:51:00.893 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: dump: 2024-09-12T17:51:00.893 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.893 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.893 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.893 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.893 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.893 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.893 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: _finish_auth 0 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: _check_auth_tickets 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: dump: 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.894 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:51:00.804+0000 7f03ed13c800 5 monclient: authenticate success, global_id 7470 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient: _renew_subs 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:51:00.804+0000 7f02d6e0d640 4 set_mon_vals no callback set 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient: _renew_subs 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:51:00.804+0000 7f03ed13c800 1 librados: init done 2024-09-12T17:51:00.895 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:51:00.806+0000 7f02d560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:51:00.806+0000 7f02d560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:51:00.806+0000 7f02d560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:51:00.806+0000 7f03e0680640 10 monclient: get_auth_request con 0x7f02d0076470 auth_method 0 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:51:00.807+0000 7f03e9682640 10 monclient: get_auth_request con 0x559142dfc080 auth_method 0 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:51:00.807+0000 7f03e8e81640 10 monclient: get_auth_request con 0x559142dff260 auth_method 0 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:51:00.808+0000 7f03e0680640 10 monclient: get_auth_request con 0x559142e034e0 auth_method 0 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:51:00.809+0000 7f03ed13c800 10 monclient: build_initial_monmap 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:51:00.809+0000 7f03ed13c800 1 build_initial for_mkfs: 0 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:51:00.809+0000 7f03ed13c800 10 monclient: monmap: 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:00.896 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:00.897 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:00.897 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.897 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:00.897 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:00.897 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:00.897 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.897 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding auth protocol: cephx 2024-09-12T17:51:00.897 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding auth protocol: cephx 2024-09-12T17:51:00.897 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding auth protocol: cephx 2024-09-12T17:51:00.897 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: secure 2024-09-12T17:51:00.897 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: crc 2024-09-12T17:51:00.897 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: secure 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: crc 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: secure 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: crc 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: crc 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: secure 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: crc 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: secure 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: crc 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: secure 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:51:00.810+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 asok(0x559142b91730) register_command objecter_requests cmddesc objecter_requests hook 0x559142e0b790 EEXIST 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient: init 2024-09-12T17:51:00.898 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding auth protocol: cephx 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding auth protocol: cephx 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding auth protocol: cephx 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: secure 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: crc 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: secure 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: crc 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: secure 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: crc 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: crc 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: secure 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: crc 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: secure 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: crc 2024-09-12T17:51:00.899 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: secure 2024-09-12T17:51:00.900 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:51:00.810+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.900 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:51:00.810+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.900 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 asok(0x559142b91730) register_command rotate-key cmddesc rotate-key hook 0x559142e06b30 EEXIST 2024-09-12T17:51:00.900 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:00.900 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:51:00.900 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-b con 0x559142e2fab0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:00.900 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-a con 0x559142e2fe90 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:00.900 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-c con 0x559142e2e7c0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:00.900 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.900 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.900 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.900 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): authenticate will time out at 2065.356819s 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:51:00.810+0000 7f03e0680640 10 monclient(hunting): get_auth_request con 0x559142e2fe90 auth_method 0 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:51:00.810+0000 7f03e0680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:51:00.810+0000 7f03e0680640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:51:00.810+0000 7f03e0680640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:51:00.810+0000 7f03e9682640 10 monclient(hunting): get_auth_request con 0x559142e2e7c0 auth_method 0 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:51:00.810+0000 7f03e9682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:51:00.810+0000 7f03e9682640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:51:00.810+0000 7f03e9682640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:51:00.810+0000 7f03e8e81640 10 monclient(hunting): get_auth_request con 0x559142e2fab0 auth_method 0 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:51:00.810+0000 7f03e8e81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:51:00.810+0000 7f03e8e81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:51:00.810+0000 7f03e8e81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.901 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:51:00.811+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:51:00.811+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:51:00.811+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:51:00.811+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:51:00.811+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:51:00.811+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:51:00.811+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:51:00.811+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:51:00.811+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:51:00.811+0000 7f03e0680640 10 monclient(hunting): handle_auth_done global_id 7473 payload 824 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:51:00.811+0000 7f03e0680640 10 monclient: _finish_hunting 0 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:51:00.811+0000 7f03e0680640 1 monclient: found mon.noname-a 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:51:00.811+0000 7f03e0680640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.902 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: dump: 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.903 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: _finish_auth 0 2024-09-12T17:51:00.904 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:51:00.904 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:00.904 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.904 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:51:00.904 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: dump: 2024-09-12T17:51:00.904 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.904 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.904 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.904 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.904 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.904 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.904 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:51:00.811+0000 7f03ed13c800 5 monclient: authenticate success, global_id 7473 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:51:00.811+0000 7f03ed13c800 10 monclient: _renew_subs 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:51:00.811+0000 7f03ed13c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:51:00.811+0000 7f03e9e83640 4 set_mon_vals no callback set 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:51:00.811+0000 7f03ed13c800 10 monclient: _renew_subs 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:51:00.811+0000 7f03ed13c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:51:00.813+0000 7f02ce7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:51:00.813+0000 7f02ce7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:51:00.813+0000 7f02ce7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:00.905 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:51:00.813+0000 7f03e8e81640 10 monclient: get_auth_request con 0x7f02c0076380 auth_method 0 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:51:00.813+0000 7f03ed13c800 10 monclient: get_monmap_and_config 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:51:00.813+0000 7f03ed13c800 10 monclient: build_initial_monmap 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:51:00.813+0000 7f03ed13c800 1 build_initial for_mkfs: 0 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:51:00.813+0000 7f03ed13c800 10 monclient: monmap: 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:00.906 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:00.907 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.907 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding auth protocol: cephx 2024-09-12T17:51:00.907 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding auth protocol: cephx 2024-09-12T17:51:00.907 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding auth protocol: cephx 2024-09-12T17:51:00.907 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: secure 2024-09-12T17:51:00.907 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: crc 2024-09-12T17:51:00.907 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: secure 2024-09-12T17:51:00.907 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: crc 2024-09-12T17:51:00.907 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: secure 2024-09-12T17:51:00.907 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: crc 2024-09-12T17:51:00.907 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: crc 2024-09-12T17:51:00.907 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: secure 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: crc 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: secure 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: crc 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: secure 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:51:00.814+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient: init 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding auth protocol: cephx 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding auth protocol: cephx 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding auth protocol: cephx 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: secure 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: crc 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: secure 2024-09-12T17:51:00.908 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: crc 2024-09-12T17:51:00.909 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: secure 2024-09-12T17:51:00.909 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: crc 2024-09-12T17:51:00.909 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: crc 2024-09-12T17:51:00.909 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: secure 2024-09-12T17:51:00.909 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: crc 2024-09-12T17:51:00.909 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: secure 2024-09-12T17:51:00.909 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: crc 2024-09-12T17:51:00.909 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: secure 2024-09-12T17:51:00.909 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:51:00.814+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.909 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:51:00.814+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.909 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 asok(0x559142b91730) register_command rotate-key cmddesc rotate-key hook 0x7ffc99be2dd8 EEXIST 2024-09-12T17:51:00.910 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:00.910 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:51:00.910 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-a con 0x559142e83f00 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:00.910 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-c con 0x559142e53ad0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:00.910 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-b con 0x559142e7f6d0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:00.910 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.910 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.910 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.910 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:00.910 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): authenticate will time out at 2065.360871s 2024-09-12T17:51:00.910 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:51:00.814+0000 7f03e8e81640 10 monclient(hunting): get_auth_request con 0x559142e83f00 auth_method 0 2024-09-12T17:51:00.911 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:51:00.814+0000 7f03e8e81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.911 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:51:00.814+0000 7f03e8e81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.911 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:51:00.814+0000 7f03e8e81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.911 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:51:00.814+0000 7f03e0680640 10 monclient(hunting): get_auth_request con 0x559142e53ad0 auth_method 0 2024-09-12T17:51:00.911 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:51:00.814+0000 7f03e0680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.911 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:51:00.814+0000 7f03e0680640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.911 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:51:00.814+0000 7f03e0680640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.911 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:51:00.815+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.911 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:51:00.815+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.911 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:51:00.815+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.911 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): get_auth_request con 0x559142e7f6d0 auth_method 0 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:51:00.815+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:51:00.815+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:51:00.815+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:51:00.815+0000 7f03e8e81640 10 monclient(hunting): handle_auth_done global_id 7476 payload 274 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:51:00.815+0000 7f03e8e81640 10 monclient: _finish_hunting 0 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:51:00.815+0000 7f03e8e81640 1 monclient: found mon.noname-a 2024-09-12T17:51:00.912 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:51:00.815+0000 7f03e8e81640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.913 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.913 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:51:00.913 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: dump: 2024-09-12T17:51:00.913 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.913 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.913 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.913 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.913 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.913 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.913 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.913 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.914 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.914 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.914 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: _finish_auth 0 2024-09-12T17:51:00.914 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: _check_auth_tickets 2024-09-12T17:51:00.914 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:00.914 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.914 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:51:00.914 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: dump: 2024-09-12T17:51:00.914 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.914 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.914 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:51:00.815+0000 7f03ed13c800 5 monclient: authenticate success, global_id 7476 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:51:00.815+0000 7f03ed13c800 10 monclient: get_monmap_and_config success 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:51:00.815+0000 7f03ed13c800 4 set_mon_vals no callback set 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:51:00.815+0000 7f03ed13c800 10 monclient: shutdown 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:51:00.816+0000 7f03ed13c800 10 monclient: build_initial_monmap 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:51:00.816+0000 7f03ed13c800 1 build_initial for_mkfs: 0 2024-09-12T17:51:00.915 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:51:00.816+0000 7f03ed13c800 10 monclient: monmap: 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding auth protocol: cephx 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding auth protocol: cephx 2024-09-12T17:51:00.916 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding auth protocol: cephx 2024-09-12T17:51:00.917 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: secure 2024-09-12T17:51:00.917 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: crc 2024-09-12T17:51:00.917 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: secure 2024-09-12T17:51:00.917 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: crc 2024-09-12T17:51:00.917 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: secure 2024-09-12T17:51:00.917 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: crc 2024-09-12T17:51:00.917 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: crc 2024-09-12T17:51:00.917 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: secure 2024-09-12T17:51:00.921 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: crc 2024-09-12T17:51:00.921 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: secure 2024-09-12T17:51:00.921 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: crc 2024-09-12T17:51:00.921 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: secure 2024-09-12T17:51:00.921 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:51:00.816+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.921 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:51:00.816+0000 7f03ed13c800 1 librados: starting msgr at 2024-09-12T17:51:00.921 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:51:00.816+0000 7f03ed13c800 1 librados: starting objecter 2024-09-12T17:51:00.921 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 asok(0x559142b91730) register_command objecter_requests cmddesc objecter_requests hook 0x559142df26f0 EEXIST 2024-09-12T17:51:00.922 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:51:00.816+0000 7f03ed13c800 1 librados: setting wanted keys 2024-09-12T17:51:00.922 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:51:00.816+0000 7f03ed13c800 1 librados: calling monclient init 2024-09-12T17:51:00.922 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:51:00.816+0000 7f03ed13c800 10 monclient: init 2024-09-12T17:51:00.922 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding auth protocol: cephx 2024-09-12T17:51:00.922 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding auth protocol: cephx 2024-09-12T17:51:00.922 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding auth protocol: cephx 2024-09-12T17:51:00.922 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: secure 2024-09-12T17:51:00.922 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: crc 2024-09-12T17:51:00.922 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: secure 2024-09-12T17:51:00.922 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: crc 2024-09-12T17:51:00.922 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: secure 2024-09-12T17:51:00.923 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: crc 2024-09-12T17:51:00.923 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: crc 2024-09-12T17:51:00.923 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: secure 2024-09-12T17:51:00.923 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: crc 2024-09-12T17:51:00.923 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: secure 2024-09-12T17:51:00.923 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: crc 2024-09-12T17:51:00.923 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: secure 2024-09-12T17:51:00.923 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:51:00.816+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.923 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:51:00.816+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.923 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:51:00.817+0000 7f03ed13c800 5 asok(0x559142b91730) register_command rotate-key cmddesc rotate-key hook 0x559142e444b8 EEXIST 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-a con 0x559142e53ad0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-b con 0x559142e7f6d0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-c con 0x559142e83f00 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): authenticate will time out at 2065.363068s 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): get_auth_request con 0x559142e53ad0 auth_method 0 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.924 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): get_auth_request con 0x559142e83f00 auth_method 0 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): handle_auth_done global_id 7479 payload 824 2024-09-12T17:51:00.925 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient: _finish_hunting 0 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:51:00.817+0000 7f03e8e81640 1 monclient: found mon.noname-a 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:51:00.817+0000 7f03e0680640 10 monclient: get_auth_request con 0x559142e7f6d0 auth_method 0 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: dump: 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.926 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: _finish_auth 0 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: dump: 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.927 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:51:00.817+0000 7f03ed13c800 5 monclient: authenticate success, global_id 7479 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient: _renew_subs 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:51:00.817+0000 7f02bffff640 4 set_mon_vals no callback set 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient: _renew_subs 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:51:00.817+0000 7f03ed13c800 1 librados: init done 2024-09-12T17:51:00.928 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:51:00.817+0000 7f03ed13c800 5 asok(0x559142b91730) register_command cr dump hook 0x559142e79b38 2024-09-12T17:51:00.929 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:51:00.819+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.929 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:51:00.819+0000 7f02be7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:51:00.929 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:51:00.819+0000 7f02be7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:00.929 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:51:00.819+0000 7f02be7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:00.929 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:51:00.819+0000 7f03e0680640 10 monclient: get_auth_request con 0x7f02b4076470 auth_method 0 2024-09-12T17:51:00.929 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:51:00.819+0000 7f03e9682640 10 monclient: get_auth_request con 0x559142e9db20 auth_method 0 2024-09-12T17:51:00.929 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.929 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 realm 2024-09-12T17:51:00.929 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.929 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.929 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:51:00.820+0000 7f03ed13c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:00.929 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:51:00.821+0000 7f03e8e81640 10 monclient: get_auth_request con 0x559142ea1e50 auth_method 0 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:51:00.821+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:51:00.821+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:51:00.821+0000 7f03e0680640 10 monclient: get_auth_request con 0x559142ea5570 auth_method 0 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:51:00.822+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:51:00.822+0000 7f03ed13c800 20 searching for the correct realm 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:51:00.822+0000 7f03e9682640 10 monclient: get_auth_request con 0x559142eaa330 auth_method 0 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:51:00.823+0000 7f03e8e81640 10 monclient: get_auth_request con 0x7f03e4017070 auth_method 0 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:51:00.824+0000 7f03e0680640 10 monclient: get_auth_request con 0x7f03d0071050 auth_method 0 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:51:00.825+0000 7f03e9682640 0 -- 172.21.15.107:0/1503616224 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x559142e9db20 msgr2=0x559142e9ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:51:00.825+0000 7f02be7fc640 1 client.7479.objecter ms_handle_reset 0x559142e9db20 session 0x559142e9d4a0 osd.1 2024-09-12T17:51:00.930 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:51:00.825+0000 7f02be7fc640 10 monclient: _renew_subs 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:51:00.825+0000 7f02be7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:51:00.825+0000 7f03e9682640 10 monclient: get_auth_request con 0x7f02b4086b20 auth_method 0 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:51:00.825+0000 7f03e9682640 10 monclient: get_auth_request con 0x7f03d000a8f0 auth_method 0 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:51:00.827+0000 7f03e8e81640 10 monclient: get_auth_request con 0x7f03d00666d0 auth_method 0 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:51:00.828+0000 7f03e0680640 0 -- 172.21.15.107:0/1503616224 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f03d0071050 msgr2=0x7f03d0066fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:51:00.828+0000 7f02be7fc640 1 client.7479.objecter ms_handle_reset 0x7f03d0071050 session 0x7f03d0011040 osd.4 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:51:00.828+0000 7f03e0680640 10 monclient: get_auth_request con 0x559142e9db20 auth_method 0 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:51:00.829+0000 7f02be7fc640 1 client.7479.objecter ms_handle_reset 0x559142ea1e50 session 0x559142ea0ca0 osd.5 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:51:00.830+0000 7f03e8e81640 10 monclient: get_auth_request con 0x7f03d0071050 auth_method 0 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:00.931 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:00.932 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:00.932 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:00.932 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.932 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.932 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.932 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.932 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.932 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:00.933 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 zone default found 2024-09-12T17:51:00.933 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:51:00.833+0000 7f03ed13c800 4 Realm: () 2024-09-12T17:51:00.933 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:51:00.833+0000 7f03ed13c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:00.933 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:51:00.833+0000 7f03ed13c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:00.933 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:51:00.833+0000 7f03ed13c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:00.933 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 zonegroup default 2024-09-12T17:51:00.933 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.933 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.933 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.933 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:51:00.834+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.933 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:51:00.834+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.934 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:51:00.834+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.934 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:51:00.834+0000 7f03ed13c800 20 started sync module instance, tier type = 2024-09-12T17:51:00.934 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:51:00.834+0000 7f03ed13c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:00.934 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=0 2024-09-12T17:51:00.934 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=1 2024-09-12T17:51:00.934 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=2 2024-09-12T17:51:00.934 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=3 2024-09-12T17:51:00.934 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=4 2024-09-12T17:51:00.934 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=5 2024-09-12T17:51:00.934 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=6 2024-09-12T17:51:00.934 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:51:00.845+0000 7f03ed13c800 20 add_watcher() i=7 2024-09-12T17:51:00.934 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:51:00.845+0000 7f03ed13c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding auth protocol: cephx 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding auth protocol: cephx 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding auth protocol: cephx 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: secure 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: crc 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: secure 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: crc 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: secure 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:51:00.846+0000 7f029f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: crc 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: crc 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: secure 2024-09-12T17:51:00.935 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: crc 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: secure 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: crc 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: secure 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:51:00.847+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:51:00.847+0000 7f03ed13c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:51:00.847+0000 7f03ed13c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command cache list hook 0x559142e7b870 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command cache inspect hook 0x559142e7b870 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command cache erase hook 0x559142e7b870 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command cache zap hook 0x559142e7b870 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 note: GC not initialized 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:51:00.847+0000 7f029e7e4640 20 reqs_thread_entry: start 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command sync trace show hook 0x7f03d00042f0 2024-09-12T17:51:00.936 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command sync trace history hook 0x7f03d00042f0 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command sync trace active hook 0x7f03d00042f0 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command sync trace active_short hook 0x7f03d00042f0 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:51:00.847+0000 7f03ed13c800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:51:00.847+0000 7f03ed13c800 20 Filter name: none 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:51:00.847+0000 7f0297fff640 20 reqs_thread_entry: start 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:51:00.847+0000 7f03ed13c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:51:00.847+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:51:00.848+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 : miss 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:51:00.848+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.937 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:51:00.848+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:51:00.852+0000 7f03ed13c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:51:00.852+0000 7f03ed13c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:51:00.852+0000 7f03ed13c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:51:00.852+0000 7f03ed13c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35, ofs0, ns] 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:51:00.852+0000 7f02bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94082381309024 notifier 7479 bl.length()=995 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:51:00.852+0000 7f02bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:51:00.852+0000 7f02bffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:51:00.852+0000 7f02bffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:51:00.853+0000 7f03ed13c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): orig_sources= new_sources= 2024-09-12T17:51:00.938 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:51:00.853+0000 7f03ed13c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): potential sources added=[] removed=[] 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:51:00.853+0000 7f03ed13c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): orig_dests= new_dests= 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:51:00.853+0000 7f03ed13c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): potential dests added=[] removed=[] 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:51:00.855+0000 7f03ed13c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f03ed13c800 time 2024-09-12T17:51:00.856199+0000 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03ee98c71a] 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f03ee98c8d8] 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559142040841] 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55914205057a] 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f03ed629590] 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:51:00.939 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:51:00.856+0000 7f03ed13c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f03ed13c800 thread_name:radosgw-admin 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f03ed63e6f0] 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f03ed68b99c] 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03ee98c774] 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f03ee98c8d8] 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559142040841] 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55914205057a] 2024-09-12T17:51:00.940 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:51:00.941 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f03ed629590] 2024-09-12T17:51:00.941 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:51:00.941 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:51:00.941 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:51:00.941 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.941 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:51:00.941 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:51:00.941 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:51:00.941 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:51:00.941 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:51:00.941 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:51:00.941 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:51:00.942 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:51:00.943 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:51:00.944 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:51:00.944 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:51:00.944 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:51:00.944 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:51:00.944 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:51:00.944 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:51:00.944 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:51:00.944 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:51:00.944 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:51:00.944 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:51:00.944 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:51:00.944 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:51:00.945 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:51:00.945 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:51:00.945 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:51:00.945 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:51:00.945 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:51:00.945 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:51:00.945 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:51:00.945 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:51:00.945 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:51:00.945 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:51:00.945 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:51:00.945 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:51:00.946 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:51:00.947 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:51:00.948 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:51:00.948 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:51:00.948 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:51:00.948 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:51:00.948 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0297fff640 / http_manager 2024-09-12T17:51:00.948 INFO:tasks.workunit.client.0.smithi107.stderr: 7f029e7e4640 / http_manager 2024-09-12T17:51:00.948 INFO:tasks.workunit.client.0.smithi107.stderr: 7f029f7e6640 / rgw_dt_lg_renew 2024-09-12T17:51:00.948 INFO:tasks.workunit.client.0.smithi107.stderr: 7f02be7fc640 / ms_dispatch 2024-09-12T17:51:00.948 INFO:tasks.workunit.client.0.smithi107.stderr: 7f02bffff640 / io_context_pool 2024-09-12T17:51:00.948 INFO:tasks.workunit.client.0.smithi107.stderr: 7f02ce7fc640 / ms_dispatch 2024-09-12T17:51:00.948 INFO:tasks.workunit.client.0.smithi107.stderr: 7f02d560a640 / ms_dispatch 2024-09-12T17:51:00.948 INFO:tasks.workunit.client.0.smithi107.stderr: 7f02d6e0d640 / io_context_pool 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr: 7f03e0680640 / msgr-worker-2 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr: 7f03e8e81640 / msgr-worker-1 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr: 7f03e9682640 / msgr-worker-0 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr: 7f03e9e83640 / io_context_pool 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr: 7f03ed13c800 / radosgw-admin 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/log/ceph/ceph-client.admin.127749.log 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:51:00.802+0000 7f02d6e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:51:00.802+0000 7f03ed13c800 10 monclient: get_monmap_and_config success 2024-09-12T17:51:00.949 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:51:00.802+0000 7f03ed13c800 4 set_mon_vals no callback set 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:51:00.802+0000 7f02d6e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:51:00.802+0000 7f02d6e0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:51:00.802+0000 7f02d6e0d640 10 monclient: dump: 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.950 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:51:00.802+0000 7f03ed13c800 10 monclient: shutdown 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:51:00.802+0000 7f03ed13c800 5 asok(0x559142b91730) unregister_commands rotate-key 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:51:00.803+0000 7f03ed13c800 10 monclient: build_initial_monmap 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:51:00.803+0000 7f03ed13c800 1 build_initial for_mkfs: 0 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:51:00.803+0000 7f03ed13c800 10 monclient: monmap: 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:00.951 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding auth protocol: cephx 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding auth protocol: cephx 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding auth protocol: cephx 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: secure 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: crc 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: secure 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: crc 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: secure 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: crc 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: crc 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: secure 2024-09-12T17:51:00.952 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: crc 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: secure 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: crc 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db9490) adding con mode: secure 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:51:00.803+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:51:00.803+0000 7f03ed13c800 1 librados: starting msgr at 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:51:00.803+0000 7f03ed13c800 1 librados: starting objecter 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 asok(0x559142b91730) register_command objecter_requests hook 0x559142db8e00 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:51:00.803+0000 7f03ed13c800 1 librados: setting wanted keys 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:51:00.803+0000 7f03ed13c800 1 librados: calling monclient init 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:51:00.803+0000 7f03ed13c800 10 monclient: init 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding auth protocol: cephx 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding auth protocol: cephx 2024-09-12T17:51:00.953 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding auth protocol: cephx 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: secure 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: crc 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: secure 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: crc 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: secure 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: crc 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: crc 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: secure 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: crc 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: secure 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: crc 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:51:00.803+0000 7f03ed13c800 5 AuthRegistry(0x559142db3d80) adding con mode: secure 2024-09-12T17:51:00.954 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:51:00.803+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.955 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:51:00.803+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.955 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:51:00.804+0000 7f03ed13c800 5 asok(0x559142b91730) register_command rotate-key hook 0x559142db3ec8 2024-09-12T17:51:00.955 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:00.955 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:51:00.955 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-a con 0x559142cf6b00 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:00.955 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-c con 0x559142cf9a70 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:00.955 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-b con 0x559142cfa3f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:00.955 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.955 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.955 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient(hunting): authenticate will time out at 2065.350068s 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): get_auth_request con 0x559142cf6b00 auth_method 0 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): get_auth_request con 0x559142cf9a70 auth_method 0 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.956 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.957 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.957 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.957 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:51:00.804+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.957 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient(hunting): handle_auth_done global_id 7470 payload 824 2024-09-12T17:51:00.957 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient: _finish_hunting 0 2024-09-12T17:51:00.957 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:51:00.804+0000 7f03e8e81640 1 monclient: found mon.noname-a 2024-09-12T17:51:00.957 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:51:00.804+0000 7f03e8e81640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.957 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.957 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:51:00.957 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: dump: 2024-09-12T17:51:00.957 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: _finish_auth 0 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: _check_auth_tickets 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:00.958 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:51:00.804+0000 7f02d560a640 10 monclient: dump: 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.959 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:51:00.804+0000 7f03ed13c800 5 monclient: authenticate success, global_id 7470 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient: _renew_subs 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:51:00.804+0000 7f02d6e0d640 4 set_mon_vals no callback set 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient: _renew_subs 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:51:00.804+0000 7f03ed13c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:51:00.804+0000 7f03ed13c800 1 librados: init done 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:51:00.806+0000 7f02d560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:51:00.806+0000 7f02d560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:51:00.806+0000 7f02d560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:51:00.806+0000 7f03e0680640 10 monclient: get_auth_request con 0x7f02d0076470 auth_method 0 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:51:00.807+0000 7f03e9682640 10 monclient: get_auth_request con 0x559142dfc080 auth_method 0 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:51:00.807+0000 7f03e8e81640 10 monclient: get_auth_request con 0x559142dff260 auth_method 0 2024-09-12T17:51:00.960 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:51:00.808+0000 7f03e0680640 10 monclient: get_auth_request con 0x559142e034e0 auth_method 0 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:51:00.809+0000 7f03ed13c800 10 monclient: build_initial_monmap 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:51:00.809+0000 7f03ed13c800 1 build_initial for_mkfs: 0 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:51:00.809+0000 7f03ed13c800 10 monclient: monmap: 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.961 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding auth protocol: cephx 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding auth protocol: cephx 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding auth protocol: cephx 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: secure 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: crc 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: secure 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: crc 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: secure 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: crc 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: crc 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: secure 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: crc 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: secure 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: crc 2024-09-12T17:51:00.962 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:51:00.809+0000 7f03ed13c800 5 AuthRegistry(0x559142e08280) adding con mode: secure 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:51:00.810+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 asok(0x559142b91730) register_command objecter_requests cmddesc objecter_requests hook 0x559142e0b790 EEXIST 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient: init 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding auth protocol: cephx 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding auth protocol: cephx 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding auth protocol: cephx 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: secure 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: crc 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: secure 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: crc 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: secure 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: crc 2024-09-12T17:51:00.963 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: crc 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: secure 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: crc 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: secure 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: crc 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 AuthRegistry(0x559142e069e8) adding con mode: secure 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:51:00.810+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:51:00.810+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:51:00.810+0000 7f03ed13c800 5 asok(0x559142b91730) register_command rotate-key cmddesc rotate-key hook 0x559142e06b30 EEXIST 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-b con 0x559142e2fab0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-a con 0x559142e2fe90 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-c con 0x559142e2e7c0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:00.964 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:51:00.810+0000 7f03ed13c800 10 monclient(hunting): authenticate will time out at 2065.356819s 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:51:00.810+0000 7f03e0680640 10 monclient(hunting): get_auth_request con 0x559142e2fe90 auth_method 0 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:51:00.810+0000 7f03e0680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:51:00.810+0000 7f03e0680640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:51:00.810+0000 7f03e0680640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:51:00.810+0000 7f03e9682640 10 monclient(hunting): get_auth_request con 0x559142e2e7c0 auth_method 0 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:51:00.810+0000 7f03e9682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:51:00.810+0000 7f03e9682640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:51:00.810+0000 7f03e9682640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:51:00.810+0000 7f03e8e81640 10 monclient(hunting): get_auth_request con 0x559142e2fab0 auth_method 0 2024-09-12T17:51:00.965 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:51:00.810+0000 7f03e8e81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.966 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:51:00.810+0000 7f03e8e81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.966 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:51:00.810+0000 7f03e8e81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.966 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:51:00.811+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.966 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:51:00.811+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.966 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:51:00.811+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.966 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:51:00.811+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.966 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:51:00.811+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.966 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:51:00.811+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.966 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:51:00.811+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.966 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:51:00.811+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.966 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:51:00.811+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:51:00.811+0000 7f03e0680640 10 monclient(hunting): handle_auth_done global_id 7473 payload 824 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:51:00.811+0000 7f03e0680640 10 monclient: _finish_hunting 0 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:51:00.811+0000 7f03e0680640 1 monclient: found mon.noname-a 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:51:00.811+0000 7f03e0680640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: dump: 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.967 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: _finish_auth 0 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:51:00.811+0000 7f02ce7fc640 10 monclient: dump: 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.968 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.969 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.969 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.969 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.969 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.969 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.969 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:51:00.811+0000 7f03ed13c800 5 monclient: authenticate success, global_id 7473 2024-09-12T17:51:00.969 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:51:00.811+0000 7f03ed13c800 10 monclient: _renew_subs 2024-09-12T17:51:00.969 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:51:00.811+0000 7f03ed13c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.969 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:51:00.811+0000 7f03e9e83640 4 set_mon_vals no callback set 2024-09-12T17:51:00.969 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:51:00.811+0000 7f03ed13c800 10 monclient: _renew_subs 2024-09-12T17:51:00.969 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:51:00.811+0000 7f03ed13c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.969 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:51:00.813+0000 7f02ce7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:51:00.813+0000 7f02ce7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:51:00.813+0000 7f02ce7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:51:00.813+0000 7f03e8e81640 10 monclient: get_auth_request con 0x7f02c0076380 auth_method 0 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:51:00.813+0000 7f03ed13c800 10 monclient: get_monmap_and_config 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:51:00.813+0000 7f03ed13c800 10 monclient: build_initial_monmap 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:51:00.813+0000 7f03ed13c800 1 build_initial for_mkfs: 0 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:51:00.813+0000 7f03ed13c800 10 monclient: monmap: 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.970 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding auth protocol: cephx 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding auth protocol: cephx 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding auth protocol: cephx 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: secure 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: crc 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: secure 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: crc 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: secure 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: crc 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: crc 2024-09-12T17:51:00.971 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: secure 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: crc 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: secure 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: crc 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:51:00.813+0000 7f03ed13c800 5 AuthRegistry(0x559142e4f9e0) adding con mode: secure 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:51:00.814+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient: init 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding auth protocol: cephx 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding auth protocol: cephx 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding auth protocol: cephx 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: secure 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: crc 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: secure 2024-09-12T17:51:00.972 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: crc 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: secure 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: crc 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: crc 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: secure 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: crc 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: secure 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: crc 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be2c90) adding con mode: secure 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:51:00.814+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:51:00.814+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:51:00.814+0000 7f03ed13c800 5 asok(0x559142b91730) register_command rotate-key cmddesc rotate-key hook 0x7ffc99be2dd8 EEXIST 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:51:00.973 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-a con 0x559142e83f00 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:00.974 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-c con 0x559142e53ad0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:00.974 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-b con 0x559142e7f6d0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:00.974 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.974 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.974 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.974 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:00.974 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:51:00.814+0000 7f03ed13c800 10 monclient(hunting): authenticate will time out at 2065.360871s 2024-09-12T17:51:00.974 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:51:00.814+0000 7f03e8e81640 10 monclient(hunting): get_auth_request con 0x559142e83f00 auth_method 0 2024-09-12T17:51:00.974 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:51:00.814+0000 7f03e8e81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.974 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:51:00.814+0000 7f03e8e81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.974 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:51:00.814+0000 7f03e8e81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.974 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:51:00.814+0000 7f03e0680640 10 monclient(hunting): get_auth_request con 0x559142e53ad0 auth_method 0 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:51:00.814+0000 7f03e0680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:51:00.814+0000 7f03e0680640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:51:00.814+0000 7f03e0680640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:51:00.815+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:51:00.815+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:51:00.815+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): get_auth_request con 0x559142e7f6d0 auth_method 0 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:51:00.815+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:51:00.815+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:51:00.815+0000 7f03e0680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.975 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:51:00.815+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:51:00.815+0000 7f03e8e81640 10 monclient(hunting): handle_auth_done global_id 7476 payload 274 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:51:00.815+0000 7f03e8e81640 10 monclient: _finish_hunting 0 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:51:00.815+0000 7f03e8e81640 1 monclient: found mon.noname-a 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:51:00.815+0000 7f03e8e81640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: dump: 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.976 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: _finish_auth 0 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: _check_auth_tickets 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:51:00.815+0000 7f02bffff640 10 monclient: dump: 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.977 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.978 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.978 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.978 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.978 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.978 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.978 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.978 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:51:00.815+0000 7f03ed13c800 5 monclient: authenticate success, global_id 7476 2024-09-12T17:51:00.978 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:51:00.815+0000 7f03ed13c800 10 monclient: get_monmap_and_config success 2024-09-12T17:51:00.978 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:51:00.815+0000 7f03ed13c800 4 set_mon_vals no callback set 2024-09-12T17:51:00.978 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:51:00.815+0000 7f03ed13c800 10 monclient: shutdown 2024-09-12T17:51:00.978 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:51:00.816+0000 7f03ed13c800 10 monclient: build_initial_monmap 2024-09-12T17:51:00.978 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:51:00.816+0000 7f03ed13c800 1 build_initial for_mkfs: 0 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:51:00.816+0000 7f03ed13c800 10 monclient: monmap: 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding auth protocol: cephx 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding auth protocol: cephx 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding auth protocol: cephx 2024-09-12T17:51:00.979 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: secure 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: crc 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: secure 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: crc 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: secure 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: crc 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: crc 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: secure 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: crc 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: secure 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: crc 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e76060) adding con mode: secure 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:51:00.816+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.980 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:51:00.816+0000 7f03ed13c800 1 librados: starting msgr at 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:51:00.816+0000 7f03ed13c800 1 librados: starting objecter 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 asok(0x559142b91730) register_command objecter_requests cmddesc objecter_requests hook 0x559142df26f0 EEXIST 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:51:00.816+0000 7f03ed13c800 1 librados: setting wanted keys 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:51:00.816+0000 7f03ed13c800 1 librados: calling monclient init 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:51:00.816+0000 7f03ed13c800 10 monclient: init 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding auth protocol: cephx 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding auth protocol: cephx 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding auth protocol: cephx 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: secure 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: crc 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: secure 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: crc 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: secure 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: crc 2024-09-12T17:51:00.981 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: crc 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: secure 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: crc 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: secure 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: crc 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:51:00.816+0000 7f03ed13c800 5 AuthRegistry(0x559142e44370) adding con mode: secure 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:51:00.816+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:51:00.816+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:51:00.817+0000 7f03ed13c800 5 asok(0x559142b91730) register_command rotate-key cmddesc rotate-key hook 0x559142e444b8 EEXIST 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-a con 0x559142e53ad0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-b con 0x559142e7f6d0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): picked mon.noname-c con 0x559142e83f00 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:00.982 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient(hunting): authenticate will time out at 2065.363068s 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): get_auth_request con 0x559142e53ad0 auth_method 0 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): get_auth_request con 0x559142e83f00 auth_method 0 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:00.983 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:51:00.817+0000 7f03e9682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient(hunting): handle_auth_done global_id 7479 payload 824 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient: _finish_hunting 0 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:51:00.817+0000 7f03e8e81640 1 monclient: found mon.noname-a 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:51:00.817+0000 7f03e8e81640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:51:00.817+0000 7f03e0680640 10 monclient: get_auth_request con 0x559142e7f6d0 auth_method 0 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:51:00.984 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: dump: 2024-09-12T17:51:00.985 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.985 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.985 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.985 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.985 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.985 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.985 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.985 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.985 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.985 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.985 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: _finish_auth 0 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:51:00.817+0000 7f02be7fc640 10 monclient: dump: 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:00.986 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:51:00.817+0000 7f03ed13c800 5 monclient: authenticate success, global_id 7479 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient: _renew_subs 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:51:00.817+0000 7f02bffff640 4 set_mon_vals no callback set 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient: _renew_subs 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:51:00.817+0000 7f03ed13c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:51:00.817+0000 7f03ed13c800 1 librados: init done 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:51:00.817+0000 7f03ed13c800 5 asok(0x559142b91730) register_command cr dump hook 0x559142e79b38 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:51:00.819+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:51:00.819+0000 7f02be7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:51:00.819+0000 7f02be7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:51:00.819+0000 7f02be7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:00.987 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:51:00.819+0000 7f03e0680640 10 monclient: get_auth_request con 0x7f02b4076470 auth_method 0 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:51:00.819+0000 7f03e9682640 10 monclient: get_auth_request con 0x559142e9db20 auth_method 0 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 realm 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:51:00.820+0000 7f03ed13c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:51:00.820+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:51:00.821+0000 7f03e8e81640 10 monclient: get_auth_request con 0x559142ea1e50 auth_method 0 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:51:00.821+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:51:00.821+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:51:00.821+0000 7f03e0680640 10 monclient: get_auth_request con 0x559142ea5570 auth_method 0 2024-09-12T17:51:00.988 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:51:00.822+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:51:00.822+0000 7f03ed13c800 20 searching for the correct realm 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:51:00.822+0000 7f03e9682640 10 monclient: get_auth_request con 0x559142eaa330 auth_method 0 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:51:00.823+0000 7f03e8e81640 10 monclient: get_auth_request con 0x7f03e4017070 auth_method 0 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:51:00.824+0000 7f03e0680640 10 monclient: get_auth_request con 0x7f03d0071050 auth_method 0 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:51:00.825+0000 7f03e9682640 0 -- 172.21.15.107:0/1503616224 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x559142e9db20 msgr2=0x559142e9ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:51:00.825+0000 7f02be7fc640 1 client.7479.objecter ms_handle_reset 0x559142e9db20 session 0x559142e9d4a0 osd.1 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:51:00.825+0000 7f02be7fc640 10 monclient: _renew_subs 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:51:00.825+0000 7f02be7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:51:00.825+0000 7f03e9682640 10 monclient: get_auth_request con 0x7f02b4086b20 auth_method 0 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:51:00.825+0000 7f03e9682640 10 monclient: get_auth_request con 0x7f03d000a8f0 auth_method 0 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:51:00.827+0000 7f03e8e81640 10 monclient: get_auth_request con 0x7f03d00666d0 auth_method 0 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:51:00.828+0000 7f03e0680640 0 -- 172.21.15.107:0/1503616224 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f03d0071050 msgr2=0x7f03d0066fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:00.989 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:51:00.828+0000 7f02be7fc640 1 client.7479.objecter ms_handle_reset 0x7f03d0071050 session 0x7f03d0011040 osd.4 2024-09-12T17:51:00.990 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:51:00.828+0000 7f03e0680640 10 monclient: get_auth_request con 0x559142e9db20 auth_method 0 2024-09-12T17:51:00.990 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:51:00.829+0000 7f02be7fc640 1 client.7479.objecter ms_handle_reset 0x559142ea1e50 session 0x559142ea0ca0 osd.5 2024-09-12T17:51:00.990 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:51:00.830+0000 7f03e8e81640 10 monclient: get_auth_request con 0x7f03d0071050 auth_method 0 2024-09-12T17:51:00.990 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:00.990 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:00.990 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:00.990 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:00.990 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:00.990 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:00.990 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:51:00.832+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.990 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.990 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 zone default found 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:51:00.833+0000 7f03ed13c800 4 Realm: () 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:51:00.833+0000 7f03ed13c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:51:00.833+0000 7f03ed13c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:51:00.833+0000 7f03ed13c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 zonegroup default 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:51:00.833+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.991 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:51:00.834+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:51:00.834+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:51:00.834+0000 7f03ed13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:51:00.834+0000 7f03ed13c800 20 started sync module instance, tier type = 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:51:00.834+0000 7f03ed13c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=0 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=1 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=2 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=3 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=4 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=5 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:51:00.844+0000 7f03ed13c800 20 add_watcher() i=6 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:51:00.845+0000 7f03ed13c800 20 add_watcher() i=7 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:51:00.845+0000 7f03ed13c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:00.992 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding auth protocol: cephx 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding auth protocol: cephx 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding auth protocol: cephx 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: secure 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: crc 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: secure 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: crc 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: secure 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:51:00.846+0000 7f029f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: crc 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: crc 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: secure 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: crc 2024-09-12T17:51:00.993 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: secure 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: crc 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 AuthRegistry(0x7ffc99be3160) adding con mode: secure 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:51:00.847+0000 7f03ed13c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:51:00.847+0000 7f03ed13c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:51:00.847+0000 7f03ed13c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command cache list hook 0x559142e7b870 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command cache inspect hook 0x559142e7b870 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command cache erase hook 0x559142e7b870 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command cache zap hook 0x559142e7b870 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 note: GC not initialized 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:51:00.847+0000 7f029e7e4640 20 reqs_thread_entry: start 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command sync trace show hook 0x7f03d00042f0 2024-09-12T17:51:00.994 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command sync trace history hook 0x7f03d00042f0 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command sync trace active hook 0x7f03d00042f0 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:51:00.847+0000 7f03ed13c800 5 asok(0x559142b91730) register_command sync trace active_short hook 0x7f03d00042f0 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:51:00.847+0000 7f03ed13c800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:51:00.847+0000 7f03ed13c800 20 Filter name: none 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:51:00.847+0000 7f0297fff640 20 reqs_thread_entry: start 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:51:00.847+0000 7f03ed13c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:51:00.847+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:51:00.848+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 : miss 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:51:00.848+0000 7f03ed13c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:00.995 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:51:00.848+0000 7f03ed13c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:51:00.848+0000 7f03ed13c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:51:00.852+0000 7f03ed13c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:51:00.852+0000 7f03ed13c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:51:00.852+0000 7f03ed13c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:51:00.852+0000 7f03ed13c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35, ofs0, ns] 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:51:00.852+0000 7f02bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94082381309024 notifier 7479 bl.length()=995 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:51:00.852+0000 7f02bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:51:00.852+0000 7f02bffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:51:00.852+0000 7f02bffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:00.996 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:51:00.853+0000 7f03ed13c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): orig_sources= new_sources= 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:51:00.853+0000 7f03ed13c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): potential sources added=[] removed=[] 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:51:00.853+0000 7f03ed13c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): orig_dests= new_dests= 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:51:00.853+0000 7f03ed13c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): potential dests added=[] removed=[] 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:51:00.855+0000 7f03ed13c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f03ed13c800 time 2024-09-12T17:51:00.856199+0000 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f03ee98c71a] 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f03ee98c8d8] 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559142040841] 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55914205057a] 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:51:00.997 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f03ed629590] 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:51:00.856+0000 7f03ed13c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f03ed13c800 thread_name:radosgw-admin 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f03ed63e6f0] 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f03ed68b99c] 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f03ee98c774] 2024-09-12T17:51:00.998 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f03ee98c8d8] 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559142040841] 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55914205057a] 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f03ed629590] 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:51:00.999 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:51:01.000 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:51:01.001 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:51:01.001 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:51:01.001 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:51:01.001 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:51:01.001 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:51:01.001 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:51:01.001 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:51:01.001 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:51:01.001 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:51:01.001 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:51:01.001 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:51:01.001 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:51:01.002 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:51:01.003 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:51:01.004 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:51:01.005 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 7f0297fff640 / http_manager 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 7f029e7e4640 / http_manager 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 7f029f7e6640 / rgw_dt_lg_renew 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 7f02be7fc640 / ms_dispatch 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 7f02bffff640 / io_context_pool 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 7f02ce7fc640 / ms_dispatch 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 7f02d560a640 / ms_dispatch 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 7f02d6e0d640 / io_context_pool 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 7f03e0680640 / msgr-worker-2 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 7f03e8e81640 / msgr-worker-1 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 7f03e9682640 / msgr-worker-0 2024-09-12T17:51:01.006 INFO:tasks.workunit.client.0.smithi107.stderr: 7f03e9e83640 / io_context_pool 2024-09-12T17:51:01.007 INFO:tasks.workunit.client.0.smithi107.stderr: 7f03ed13c800 / radosgw-admin 2024-09-12T17:51:01.007 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:51:01.007 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:51:01.007 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:51:00.857573Z_37ec897e-358e-4f3b-9752-55f04ed4ce78/log 2024-09-12T17:51:01.007 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:51:01.007 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:51:01.012 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:01.012 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:01.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.930+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.932+0000 7f06b4320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.932+0000 7f06b4320800 20 realm 2024-09-12T17:51:01.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.932+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.932+0000 7f06b4320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.932+0000 7f06b4320800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:01.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.932+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.932+0000 7f06b4320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.932+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.933+0000 7f06b4320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.933+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.934+0000 7f06b4320800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.934+0000 7f06b4320800 20 searching for the correct realm 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.936+0000 7f06b0869640 0 -- 172.21.15.107:0/1563722413 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55c51a9fc3d0 msgr2=0x55c51a9fe890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.940+0000 7f06b0068640 0 -- 172.21.15.107:0/1563722413 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f0698057420 msgr2=0x7f06980578a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:01.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:01.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 zone default found 2024-09-12T17:51:01.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 4 Realm: () 2024-09-12T17:51:01.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:01.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:01.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:01.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 zonegroup default 2024-09-12T17:51:01.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.944+0000 7f06b4320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.945+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.945+0000 7f06b4320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.945+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.945+0000 7f06b4320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.945+0000 7f06b4320800 20 started sync module instance, tier type = 2024-09-12T17:51:01.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.945+0000 7f06b4320800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:01.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.953+0000 7f06b4320800 20 add_watcher() i=0 2024-09-12T17:51:01.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.953+0000 7f06b4320800 20 add_watcher() i=1 2024-09-12T17:51:01.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.953+0000 7f06b4320800 20 add_watcher() i=2 2024-09-12T17:51:01.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.953+0000 7f06b4320800 20 add_watcher() i=3 2024-09-12T17:51:01.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.953+0000 7f06b4320800 20 add_watcher() i=4 2024-09-12T17:51:01.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.953+0000 7f06b4320800 20 add_watcher() i=5 2024-09-12T17:51:01.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.953+0000 7f06b4320800 20 add_watcher() i=6 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.954+0000 7f06b4320800 20 add_watcher() i=7 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.954+0000 7f06b4320800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.956+0000 7f05667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.956+0000 7f06b4320800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.956+0000 7f06b4320800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.956+0000 7f06b4320800 5 note: GC not initialized 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.956+0000 7f05657e2640 20 reqs_thread_entry: start 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.956+0000 7f06b4320800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.956+0000 7f06b4320800 20 Filter name: none 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.956+0000 7f04d6ffd640 20 reqs_thread_entry: start 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.957+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.957+0000 7f06b4320800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.957+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.958+0000 7f06b4320800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.958+0000 7f06b4320800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.958+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.958+0000 7f06b4320800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.958+0000 7f06b4320800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.958+0000 7f06b4320800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.958+0000 7f06b4320800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.959+0000 7f05667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.961+0000 7f06b4320800 20 remove_watcher() i=0 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.961+0000 7f06b4320800 2 removed watcher, disabling cache 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.962+0000 7f06b4320800 20 remove_watcher() i=1 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.963+0000 7f06b4320800 20 remove_watcher() i=2 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.964+0000 7f06b4320800 20 remove_watcher() i=3 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.965+0000 7f06b4320800 20 remove_watcher() i=4 2024-09-12T17:51:01.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.966+0000 7f06b4320800 20 remove_watcher() i=5 2024-09-12T17:51:01.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.967+0000 7f06b4320800 20 remove_watcher() i=6 2024-09-12T17:51:01.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:00.968+0000 7f06b4320800 20 remove_watcher() i=7 2024-09-12T17:51:01.018 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:01.018 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:51:01.018 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-do-reshard id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:51:01.018 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:01.030 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:51:01.060 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:01.060 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:01.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.096+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.097+0000 7f6128342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.097+0000 7f6128342800 20 realm 2024-09-12T17:51:01.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.097+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.097+0000 7f6128342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.097+0000 7f6128342800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:01.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.097+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.098+0000 7f6128342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.098+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.098+0000 7f6128342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:01.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.098+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.099+0000 7f6128342800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:01.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.099+0000 7f6128342800 20 searching for the correct realm 2024-09-12T17:51:01.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.102+0000 7f6124887640 0 -- 172.21.15.107:0/1803242172 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5600b3d1ecf0 msgr2=0x5600b3d211b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:01.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.105+0000 7f6124086640 0 -- 172.21.15.107:0/1803242172 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f610c0612b0 msgr2=0x7f610c098950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:01.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:01.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:01.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:01.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:01.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:01.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:01.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:01.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:01.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.110+0000 7f6128342800 20 zone default found 2024-09-12T17:51:01.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 4 Realm: () 2024-09-12T17:51:01.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:01.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:01.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:01.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 20 zonegroup default 2024-09-12T17:51:01.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:01.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 20 started sync module instance, tier type = 2024-09-12T17:51:01.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.111+0000 7f6128342800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:01.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.120+0000 7f6128342800 20 add_watcher() i=0 2024-09-12T17:51:01.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.120+0000 7f6128342800 20 add_watcher() i=1 2024-09-12T17:51:01.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.120+0000 7f6128342800 20 add_watcher() i=2 2024-09-12T17:51:01.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.120+0000 7f6128342800 20 add_watcher() i=3 2024-09-12T17:51:01.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.120+0000 7f6128342800 20 add_watcher() i=4 2024-09-12T17:51:01.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.120+0000 7f6128342800 20 add_watcher() i=5 2024-09-12T17:51:01.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.120+0000 7f6128342800 20 add_watcher() i=6 2024-09-12T17:51:01.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.121+0000 7f6128342800 20 add_watcher() i=7 2024-09-12T17:51:01.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.121+0000 7f6128342800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:01.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.122+0000 7f5fdafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.123+0000 7f6128342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.123+0000 7f6128342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.123+0000 7f6128342800 5 note: GC not initialized 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.123+0000 7f5fd9fdb640 20 reqs_thread_entry: start 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.123+0000 7f6128342800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.123+0000 7f6128342800 20 Filter name: none 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.123+0000 7f5f4b7fe640 20 reqs_thread_entry: start 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.123+0000 7f6128342800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.123+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.124+0000 7f6128342800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.124+0000 7f6128342800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.124+0000 7f6128342800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:51:01.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.124+0000 7f6128342800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 : miss 2024-09-12T17:51:01.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.124+0000 7f6128342800 20 rados->read ofs=0 len=0 2024-09-12T17:51:01.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.124+0000 7f6128342800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:51:01.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.124+0000 7f6128342800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:01.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.124+0000 7f6128342800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:01.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.124+0000 7f6128342800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:01.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.124+0000 7f6128342800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:01.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.124+0000 7f6128342800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 2024-09-12T17:51:01.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.125+0000 7f6128342800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to be held by another RGW process; skipping for now 2024-09-12T17:51:01.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.126+0000 7f5fdafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:01.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.128+0000 7f6128342800 20 remove_watcher() i=0 2024-09-12T17:51:01.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.128+0000 7f6128342800 2 removed watcher, disabling cache 2024-09-12T17:51:01.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.129+0000 7f6128342800 20 remove_watcher() i=1 2024-09-12T17:51:01.131 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.130+0000 7f6128342800 20 remove_watcher() i=2 2024-09-12T17:51:01.132 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.131+0000 7f6128342800 20 remove_watcher() i=3 2024-09-12T17:51:01.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.132+0000 7f6128342800 20 remove_watcher() i=4 2024-09-12T17:51:01.133 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.133+0000 7f6128342800 20 remove_watcher() i=5 2024-09-12T17:51:01.134 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.133+0000 7f6128342800 20 remove_watcher() i=6 2024-09-12T17:51:01.135 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:01.134+0000 7f6128342800 20 remove_watcher() i=7 2024-09-12T17:51:01.146 INFO:tasks.workunit.client.0.smithi107.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:51:31.167 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:51:31.201 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:31.201 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:31.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.242+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.243+0000 7ff653f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:31.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.243+0000 7ff653f21800 20 realm 2024-09-12T17:51:31.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.243+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.244+0000 7ff653f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:31.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.244+0000 7ff653f21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:31.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.244+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.244+0000 7ff653f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:31.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.244+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.245+0000 7ff653f21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:31.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.245+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.245+0000 7ff653f21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:31.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.245+0000 7ff653f21800 20 searching for the correct realm 2024-09-12T17:51:31.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.248+0000 7ff64f355640 0 -- 172.21.15.107:0/2430544346 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7ff644081040 msgr2=0x7ff644067890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:31.457 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.456+0000 7ff64fb56640 0 -- 172.21.15.107:0/2430544346 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7ff644097b70 msgr2=0x7ff64408e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:31.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.663+0000 7ff653f21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:31.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.663+0000 7ff653f21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:31.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.663+0000 7ff653f21800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:31.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.663+0000 7ff653f21800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:31.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.663+0000 7ff653f21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:31.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.663+0000 7ff653f21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:31.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.663+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.663+0000 7ff653f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:31.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.663+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.664+0000 7ff653f21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:31.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.664+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.664+0000 7ff653f21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:31.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.664+0000 7ff653f21800 20 zone default found 2024-09-12T17:51:31.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.664+0000 7ff653f21800 4 Realm: () 2024-09-12T17:51:31.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.664+0000 7ff653f21800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:31.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.664+0000 7ff653f21800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:31.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.664+0000 7ff653f21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:31.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.664+0000 7ff653f21800 20 zonegroup default 2024-09-12T17:51:31.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.664+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.665+0000 7ff653f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:31.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.665+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.665+0000 7ff653f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:31.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.665+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.666+0000 7ff653f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:31.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.666+0000 7ff653f21800 20 started sync module instance, tier type = 2024-09-12T17:51:31.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.666+0000 7ff653f21800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:31.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.677+0000 7ff653f21800 20 add_watcher() i=0 2024-09-12T17:51:31.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.677+0000 7ff653f21800 20 add_watcher() i=1 2024-09-12T17:51:31.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.677+0000 7ff653f21800 20 add_watcher() i=2 2024-09-12T17:51:31.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.677+0000 7ff653f21800 20 add_watcher() i=3 2024-09-12T17:51:31.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.677+0000 7ff653f21800 20 add_watcher() i=4 2024-09-12T17:51:31.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.677+0000 7ff653f21800 20 add_watcher() i=5 2024-09-12T17:51:31.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.677+0000 7ff653f21800 20 add_watcher() i=6 2024-09-12T17:51:31.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.678+0000 7ff653f21800 20 add_watcher() i=7 2024-09-12T17:51:31.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.678+0000 7ff653f21800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:31.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.680+0000 7ff505fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:31.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.681+0000 7ff653f21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:31.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.681+0000 7ff653f21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:31.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.681+0000 7ff653f21800 5 note: GC not initialized 2024-09-12T17:51:31.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.681+0000 7ff504fe1640 20 reqs_thread_entry: start 2024-09-12T17:51:31.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.681+0000 7ff653f21800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:31.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.681+0000 7ff653f21800 20 Filter name: none 2024-09-12T17:51:31.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.681+0000 7ff47e7fc640 20 reqs_thread_entry: start 2024-09-12T17:51:31.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.681+0000 7ff653f21800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:51:31.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.681+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.682+0000 7ff653f21800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:31.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.682+0000 7ff653f21800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:51:31.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.682+0000 7ff653f21800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:51:31.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.682+0000 7ff653f21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 : miss 2024-09-12T17:51:31.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.682+0000 7ff653f21800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.682+0000 7ff653f21800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:51:31.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.682+0000 7ff653f21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:31.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.682+0000 7ff653f21800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:31.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.682+0000 7ff653f21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:31.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.682+0000 7ff653f21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:31.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.682+0000 7ff653f21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 2024-09-12T17:51:31.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.684+0000 7ff653f21800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:51:31.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.688+0000 7ff653f21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:31.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.688+0000 7ff653f21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:31.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.688+0000 7ff653f21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:31.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.688+0000 7ff653f21800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35, ofs0, ns] 2024-09-12T17:51:31.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.688+0000 7ff52effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94864337043024 notifier 7539 bl.length()=995 2024-09-12T17:51:31.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.688+0000 7ff52effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:31.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.688+0000 7ff52effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:31.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.688+0000 7ff52effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:31.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.689+0000 7ff653f21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): orig_sources= new_sources= 2024-09-12T17:51:31.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.689+0000 7ff653f21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): potential sources added=[] removed=[] 2024-09-12T17:51:31.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.689+0000 7ff653f21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): orig_dests= new_dests= 2024-09-12T17:51:31.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.689+0000 7ff653f21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): potential dests added=[] removed=[] 2024-09-12T17:51:31.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.693+0000 7ff653f21800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.35.2.0 2024-09-12T17:51:31.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.693+0000 7ff653f21800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.35.2.0 2024-09-12T17:51:31.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.693+0000 7ff653f21800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.35.2.1 2024-09-12T17:51:31.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.693+0000 7ff653f21800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.35.2.1 2024-09-12T17:51:31.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.693+0000 7ff653f21800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.35.0 2024-09-12T17:51:31.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.695+0000 7ff653f21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:51:31.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.696+0000 7ff653f21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 2024-09-12T17:51:31.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.697+0000 7ff653f21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:31.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.697+0000 7ff653f21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:31.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.697+0000 7ff653f21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:31.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.697+0000 7ff653f21800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35, ofs0, ns] 2024-09-12T17:51:31.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.697+0000 7ff52e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94864337043024 notifier 7539 bl.length()=995 2024-09-12T17:51:31.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.697+0000 7ff52e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:31.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.697+0000 7ff52e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:31.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.697+0000 7ff52e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:31.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.698+0000 7ff653f21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): orig_sources= new_sources= 2024-09-12T17:51:31.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.698+0000 7ff653f21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): potential sources added=[] removed=[] 2024-09-12T17:51:31.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.698+0000 7ff653f21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): orig_dests= new_dests= 2024-09-12T17:51:31.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.698+0000 7ff653f21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): potential dests added=[] removed=[] 2024-09-12T17:51:31.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.699+0000 7ff653f21800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.35.0 2024-09-12T17:51:31.700 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.699+0000 7ff653f21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:51:31.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.699+0000 7ff653f21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 2024-09-12T17:51:31.701 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.700+0000 7ff653f21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:31.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.700+0000 7ff653f21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:31.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.700+0000 7ff653f21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:31.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.700+0000 7ff653f21800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35, ofs0, ns] 2024-09-12T17:51:31.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.701+0000 7ff52effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94864337043024 notifier 7539 bl.length()=963 2024-09-12T17:51:31.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.701+0000 7ff52effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 info.flags=0x17 2024-09-12T17:51:31.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.701+0000 7ff52effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 to cache LRU end 2024-09-12T17:51:31.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.701+0000 7ff52effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:31.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.701+0000 7ff653f21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): orig_sources= new_sources= 2024-09-12T17:51:31.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.701+0000 7ff653f21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): potential sources added=[] removed=[] 2024-09-12T17:51:31.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.701+0000 7ff653f21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): orig_dests= new_dests= 2024-09-12T17:51:31.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.701+0000 7ff653f21800 20 handle_bi_update(): bucket=:abort-at-do-reshard[35ed0db6-4f54-4e96-b306-71079c84e007.4596.35]): potential dests added=[] removed=[] 2024-09-12T17:51:31.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.702+0000 7ff653f21800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T17:51:31.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.704+0000 7ff505fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:31.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.707+0000 7ff653f21800 20 remove_watcher() i=0 2024-09-12T17:51:31.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.707+0000 7ff653f21800 2 removed watcher, disabling cache 2024-09-12T17:51:31.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.708+0000 7ff653f21800 20 remove_watcher() i=1 2024-09-12T17:51:31.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.709+0000 7ff653f21800 20 remove_watcher() i=2 2024-09-12T17:51:31.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.711+0000 7ff653f21800 20 remove_watcher() i=3 2024-09-12T17:51:31.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.712+0000 7ff653f21800 20 remove_watcher() i=4 2024-09-12T17:51:31.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.713+0000 7ff653f21800 20 remove_watcher() i=5 2024-09-12T17:51:31.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.714+0000 7ff653f21800 20 remove_watcher() i=6 2024-09-12T17:51:31.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.715+0000 7ff653f21800 20 remove_watcher() i=7 2024-09-12T17:51:31.729 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:51:31.760 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:31.760 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:31.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.796+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.798+0000 7f44d540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:31.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.798+0000 7f44d540e800 20 realm 2024-09-12T17:51:31.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.798+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.798+0000 7f44d540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:31.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.798+0000 7f44d540e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:31.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.798+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.798+0000 7f44d540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:31.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.798+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.799+0000 7f44d540e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:31.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.799+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:31.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.800+0000 7f44d540e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:31.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.800+0000 7f44d540e800 20 searching for the correct realm 2024-09-12T17:51:31.804 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.803+0000 7f44c8258640 0 -- 172.21.15.107:0/2943489513 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f44b806d040 msgr2=0x7f44b8080a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:31.807 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:31.806+0000 7f44d0a59640 0 -- 172.21.15.107:0/2943489513 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f44b80e0a60 msgr2=0x7f44b80718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:32.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.012+0000 7f44d540e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:32.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.012+0000 7f44d540e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:32.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.012+0000 7f44d540e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:32.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.012+0000 7f44d540e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:32.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.012+0000 7f44d540e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:32.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.012+0000 7f44d540e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:32.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.012+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.012+0000 7f44d540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.012+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.013+0000 7f44d540e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:32.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.013+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.013+0000 7f44d540e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:32.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.013+0000 7f44d540e800 20 zone default found 2024-09-12T17:51:32.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.013+0000 7f44d540e800 4 Realm: () 2024-09-12T17:51:32.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.013+0000 7f44d540e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:32.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.013+0000 7f44d540e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:32.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.013+0000 7f44d540e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:32.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.013+0000 7f44d540e800 20 zonegroup default 2024-09-12T17:51:32.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.013+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.013+0000 7f44d540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.013+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.014+0000 7f44d540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.014+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.014+0000 7f44d540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.014+0000 7f44d540e800 20 started sync module instance, tier type = 2024-09-12T17:51:32.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.014+0000 7f44d540e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:32.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.023+0000 7f44d540e800 20 add_watcher() i=0 2024-09-12T17:51:32.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.023+0000 7f44d540e800 20 add_watcher() i=1 2024-09-12T17:51:32.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.023+0000 7f44d540e800 20 add_watcher() i=2 2024-09-12T17:51:32.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.023+0000 7f44d540e800 20 add_watcher() i=3 2024-09-12T17:51:32.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.023+0000 7f44d540e800 20 add_watcher() i=4 2024-09-12T17:51:32.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.023+0000 7f44d540e800 20 add_watcher() i=5 2024-09-12T17:51:32.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.023+0000 7f44d540e800 20 add_watcher() i=6 2024-09-12T17:51:32.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.024+0000 7f44d540e800 20 add_watcher() i=7 2024-09-12T17:51:32.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.024+0000 7f44d540e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:32.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.026+0000 7f4386fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:32.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.026+0000 7f44d540e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:32.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.026+0000 7f44d540e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:32.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.026+0000 7f44d540e800 5 note: GC not initialized 2024-09-12T17:51:32.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.026+0000 7f4385fe3640 20 reqs_thread_entry: start 2024-09-12T17:51:32.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.027+0000 7f44d540e800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:32.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.027+0000 7f44d540e800 20 Filter name: none 2024-09-12T17:51:32.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.027+0000 7f42f77fe640 20 reqs_thread_entry: start 2024-09-12T17:51:32.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.027+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.027+0000 7f44d540e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:32.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.027+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.028+0000 7f44d540e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:51:32.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.028+0000 7f44d540e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:32.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.028+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.028+0000 7f44d540e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:51:32.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.028+0000 7f44d540e800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.029+0000 7f44d540e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:51:32.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.029+0000 7f44d540e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:32.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.030+0000 7f4386fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:32.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.032+0000 7f44d540e800 20 remove_watcher() i=0 2024-09-12T17:51:32.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.032+0000 7f44d540e800 2 removed watcher, disabling cache 2024-09-12T17:51:32.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.033+0000 7f44d540e800 20 remove_watcher() i=1 2024-09-12T17:51:32.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.034+0000 7f44d540e800 20 remove_watcher() i=2 2024-09-12T17:51:32.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.035+0000 7f44d540e800 20 remove_watcher() i=3 2024-09-12T17:51:32.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.036+0000 7f44d540e800 20 remove_watcher() i=4 2024-09-12T17:51:32.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.037+0000 7f44d540e800 20 remove_watcher() i=5 2024-09-12T17:51:32.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.038+0000 7f44d540e800 20 remove_watcher() i=6 2024-09-12T17:51:32.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.039+0000 7f44d540e800 20 remove_watcher() i=7 2024-09-12T17:51:32.051 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:32.051 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:51:32.051 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-do-reshard id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:51:32.051 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:32.113 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T17:51:32.113 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:32.298 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:51:32.325 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:32.325 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:32.362 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.361+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.362+0000 7f8c65d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.362+0000 7f8c65d46800 20 realm 2024-09-12T17:51:32.363 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.362+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.362+0000 7f8c65d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.362+0000 7f8c65d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:32.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.362+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.362+0000 7f8c65d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.364 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.362+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.363+0000 7f8c65d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:32.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.363+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.364+0000 7f8c65d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:32.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.364+0000 7f8c65d46800 20 searching for the correct realm 2024-09-12T17:51:32.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.366+0000 7f8c5bfff640 0 -- 172.21.15.107:0/3290176598 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f8c4c018070 msgr2=0x7f8c4c08ab20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:32.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.370+0000 7f8c63837640 0 -- 172.21.15.107:0/3290176598 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f8c4c060060 msgr2=0x7f8c4c07a170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:32.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.577+0000 7f8c65d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:32.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.577+0000 7f8c65d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:32.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.577+0000 7f8c65d46800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:32.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.577+0000 7f8c65d46800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:32.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.577+0000 7f8c65d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:32.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.577+0000 7f8c65d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:32.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.577+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.579 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.577+0000 7f8c65d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.577+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.578+0000 7f8c65d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:32.580 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.578+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.578+0000 7f8c65d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.578+0000 7f8c65d46800 20 zone default found 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.578+0000 7f8c65d46800 4 Realm: () 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.578+0000 7f8c65d46800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.578+0000 7f8c65d46800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.578+0000 7f8c65d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.578+0000 7f8c65d46800 20 zonegroup default 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.578+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.578+0000 7f8c65d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.578+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.579+0000 7f8c65d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.579+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.582 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.579+0000 7f8c65d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.579+0000 7f8c65d46800 20 started sync module instance, tier type = 2024-09-12T17:51:32.583 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.579+0000 7f8c65d46800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:32.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.587+0000 7f8c65d46800 20 add_watcher() i=0 2024-09-12T17:51:32.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.587+0000 7f8c65d46800 20 add_watcher() i=1 2024-09-12T17:51:32.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.587+0000 7f8c65d46800 20 add_watcher() i=2 2024-09-12T17:51:32.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.587+0000 7f8c65d46800 20 add_watcher() i=3 2024-09-12T17:51:32.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.587+0000 7f8c65d46800 20 add_watcher() i=4 2024-09-12T17:51:32.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.587+0000 7f8c65d46800 20 add_watcher() i=5 2024-09-12T17:51:32.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.588+0000 7f8c65d46800 20 add_watcher() i=6 2024-09-12T17:51:32.590 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.588+0000 7f8c65d46800 20 add_watcher() i=7 2024-09-12T17:51:32.590 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.588+0000 7f8c65d46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:32.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.590+0000 7f8b19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:32.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.590+0000 7f8c65d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:32.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.590+0000 7f8c65d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:32.592 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.590+0000 7f8c65d46800 5 note: GC not initialized 2024-09-12T17:51:32.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.590+0000 7f8b18fe1640 20 reqs_thread_entry: start 2024-09-12T17:51:32.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.591+0000 7f8c65d46800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:32.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.591+0000 7f8c65d46800 20 Filter name: none 2024-09-12T17:51:32.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.591+0000 7f8a927fc640 20 reqs_thread_entry: start 2024-09-12T17:51:32.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.591+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.591+0000 7f8c65d46800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:32.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.591+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.592+0000 7f8c65d46800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:32.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.592+0000 7f8c65d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:32.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.592+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.593+0000 7f8c65d46800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:32.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.593+0000 7f8c65d46800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.593+0000 7f8c65d46800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:32.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.593+0000 7f8c65d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:32.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.594+0000 7f8b19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:32.597 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.596+0000 7f8c65d46800 20 remove_watcher() i=0 2024-09-12T17:51:32.598 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.596+0000 7f8c65d46800 2 removed watcher, disabling cache 2024-09-12T17:51:32.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.597+0000 7f8c65d46800 20 remove_watcher() i=1 2024-09-12T17:51:32.599 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.598+0000 7f8c65d46800 20 remove_watcher() i=2 2024-09-12T17:51:32.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.599+0000 7f8c65d46800 20 remove_watcher() i=3 2024-09-12T17:51:32.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.600+0000 7f8c65d46800 20 remove_watcher() i=4 2024-09-12T17:51:32.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.601+0000 7f8c65d46800 20 remove_watcher() i=5 2024-09-12T17:51:32.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.602+0000 7f8c65d46800 20 remove_watcher() i=6 2024-09-12T17:51:32.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.603+0000 7f8c65d46800 20 remove_watcher() i=7 2024-09-12T17:51:32.614 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:32.614 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:51:32.614 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-logrecord-writes id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:51:32.614 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:32.616 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T17:51:32.649 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:32.649 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:32.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.685+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.686+0000 7fc6c0540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.686+0000 7fc6c0540800 20 realm 2024-09-12T17:51:32.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.686+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.687+0000 7fc6c0540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.687+0000 7fc6c0540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:32.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.687+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.687+0000 7fc6c0540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.687+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.688+0000 7fc6c0540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:32.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.688+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.688+0000 7fc6c0540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:32.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.688+0000 7fc6c0540800 20 searching for the correct realm 2024-09-12T17:51:32.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.691+0000 7fc6bc286640 0 -- 172.21.15.107:0/2568463119 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fc6b409d3d0 msgr2=0x7fc6b4063d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:32.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.694+0000 7fc6bc286640 0 -- 172.21.15.107:0/2568463119 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc6a4080640 msgr2=0x7fc6a402bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:32.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.900+0000 7fc6c0540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:32.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.900+0000 7fc6c0540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:32.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.900+0000 7fc6c0540800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:32.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.900+0000 7fc6c0540800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:32.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.900+0000 7fc6c0540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:32.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.900+0000 7fc6c0540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:32.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.900+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.900+0000 7fc6c0540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.900+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.900+0000 7fc6c0540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:32.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.900+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.901+0000 7fc6c0540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:32.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.901+0000 7fc6c0540800 20 zone default found 2024-09-12T17:51:32.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.901+0000 7fc6c0540800 4 Realm: () 2024-09-12T17:51:32.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.901+0000 7fc6c0540800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:32.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.901+0000 7fc6c0540800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:32.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.901+0000 7fc6c0540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:32.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.901+0000 7fc6c0540800 20 zonegroup default 2024-09-12T17:51:32.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.901+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.901+0000 7fc6c0540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.901+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.902+0000 7fc6c0540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.902+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.902+0000 7fc6c0540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:32.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.902+0000 7fc6c0540800 20 started sync module instance, tier type = 2024-09-12T17:51:32.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.902+0000 7fc6c0540800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:32.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.910+0000 7fc6c0540800 20 add_watcher() i=0 2024-09-12T17:51:32.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.910+0000 7fc6c0540800 20 add_watcher() i=1 2024-09-12T17:51:32.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.910+0000 7fc6c0540800 20 add_watcher() i=2 2024-09-12T17:51:32.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.910+0000 7fc6c0540800 20 add_watcher() i=3 2024-09-12T17:51:32.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.910+0000 7fc6c0540800 20 add_watcher() i=4 2024-09-12T17:51:32.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.910+0000 7fc6c0540800 20 add_watcher() i=5 2024-09-12T17:51:32.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.910+0000 7fc6c0540800 20 add_watcher() i=6 2024-09-12T17:51:32.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.911+0000 7fc6c0540800 20 add_watcher() i=7 2024-09-12T17:51:32.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.911+0000 7fc6c0540800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:32.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.913+0000 7fc5727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:32.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.913+0000 7fc6c0540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:32.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.913+0000 7fc6c0540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:32.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.913+0000 7fc6c0540800 5 note: GC not initialized 2024-09-12T17:51:32.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.914+0000 7fc5717e2640 20 reqs_thread_entry: start 2024-09-12T17:51:32.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.914+0000 7fc6c0540800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:32.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.914+0000 7fc6c0540800 20 Filter name: none 2024-09-12T17:51:32.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.914+0000 7fc4e2ffd640 20 reqs_thread_entry: start 2024-09-12T17:51:32.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.914+0000 7fc6c0540800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:51:32.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.914+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.914+0000 7fc6c0540800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:32.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.914+0000 7fc6c0540800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:51:32.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.914+0000 7fc6c0540800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:51:32.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.914+0000 7fc6c0540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 : miss 2024-09-12T17:51:32.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.914+0000 7fc6c0540800 20 rados->read ofs=0 len=0 2024-09-12T17:51:32.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.915+0000 7fc6c0540800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:32.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.915+0000 7fc6c0540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 info.flags=0x17 2024-09-12T17:51:32.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.915+0000 7fc6c0540800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 to cache LRU end 2024-09-12T17:51:32.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.915+0000 7fc6c0540800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:32.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.915+0000 7fc6c0540800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:32.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.915+0000 7fc6c0540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 2024-09-12T17:51:32.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.919+0000 7fc6c0540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 info.flags=0x17 2024-09-12T17:51:32.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.919+0000 7fc6c0540800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 to cache LRU end 2024-09-12T17:51:32.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.919+0000 7fc6c0540800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:32.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.919+0000 7fc6c0540800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36, ofs0, ns] 2024-09-12T17:51:32.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.919+0000 7fc59b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464317 cookie 94331668232048 notifier 7145 bl.length()=1007 2024-09-12T17:51:32.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.919+0000 7fc59b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 info.flags=0x17 2024-09-12T17:51:32.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.919+0000 7fc59b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 to cache LRU end 2024-09-12T17:51:32.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.919+0000 7fc59b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:32.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.919+0000 7fc6c0540800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): orig_sources= new_sources= 2024-09-12T17:51:32.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.919+0000 7fc6c0540800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): potential sources added=[] removed=[] 2024-09-12T17:51:32.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.919+0000 7fc6c0540800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): orig_dests= new_dests= 2024-09-12T17:51:32.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.919+0000 7fc6c0540800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): potential dests added=[] removed=[] 2024-09-12T17:51:32.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.920+0000 7fc6c0540800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T17:51:32.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.920+0000 7fc6c0540800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:51:32.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.922+0000 7fc6c0540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:51:32.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.922+0000 7fc6c0540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 2024-09-12T17:51:32.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.923+0000 7fc6c0540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 info.flags=0x17 2024-09-12T17:51:32.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.923+0000 7fc6c0540800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 to cache LRU end 2024-09-12T17:51:32.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.923+0000 7fc6c0540800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:32.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.923+0000 7fc6c0540800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36, ofs0, ns] 2024-09-12T17:51:32.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.924+0000 7fc59affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464318 cookie 94331668232048 notifier 7145 bl.length()=975 2024-09-12T17:51:32.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.924+0000 7fc59affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 info.flags=0x17 2024-09-12T17:51:32.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.924+0000 7fc59affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 to cache LRU end 2024-09-12T17:51:32.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.924+0000 7fc59affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:32.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.924+0000 7fc6c0540800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): orig_sources= new_sources= 2024-09-12T17:51:32.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.924+0000 7fc6c0540800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): potential sources added=[] removed=[] 2024-09-12T17:51:32.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.924+0000 7fc6c0540800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): orig_dests= new_dests= 2024-09-12T17:51:32.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.924+0000 7fc6c0540800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): potential dests added=[] removed=[] 2024-09-12T17:51:32.927 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.926+0000 7fc5727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:32.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.928+0000 7fc6c0540800 20 remove_watcher() i=0 2024-09-12T17:51:32.929 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.928+0000 7fc6c0540800 2 removed watcher, disabling cache 2024-09-12T17:51:32.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.929+0000 7fc6c0540800 20 remove_watcher() i=1 2024-09-12T17:51:32.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.930+0000 7fc6c0540800 20 remove_watcher() i=2 2024-09-12T17:51:32.932 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.931+0000 7fc6c0540800 20 remove_watcher() i=3 2024-09-12T17:51:32.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.932+0000 7fc6c0540800 20 remove_watcher() i=4 2024-09-12T17:51:32.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.933+0000 7fc6c0540800 20 remove_watcher() i=5 2024-09-12T17:51:32.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.933+0000 7fc6c0540800 20 remove_watcher() i=6 2024-09-12T17:51:32.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:32.934+0000 7fc6c0540800 20 remove_watcher() i=7 2024-09-12T17:51:32.947 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:51:32.976 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:32.976 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:33.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.214+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.216+0000 7f83d7f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:33.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.216+0000 7f83d7f28800 20 realm 2024-09-12T17:51:33.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.216+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.216+0000 7f83d7f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:33.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.216+0000 7f83d7f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:33.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.216+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.216+0000 7f83d7f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:33.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.216+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.217+0000 7f83d7f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:33.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.217+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.218+0000 7f83d7f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:33.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.218+0000 7f83d7f28800 20 searching for the correct realm 2024-09-12T17:51:33.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.219+0000 7f83d346e640 0 -- 172.21.15.107:0/2678705741 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x555ab0cbded0 msgr2=0x555ab0cc02c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:33.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.223+0000 7f83d346e640 0 -- 172.21.15.107:0/2678705741 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x7f829c086b20 msgr2=0x7f829c088f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:33.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.227+0000 7f83d7f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:33.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.227+0000 7f83d7f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:33.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.227+0000 7f83d7f28800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:33.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.227+0000 7f83d7f28800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:33.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.227+0000 7f83d7f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:33.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.227+0000 7f83d7f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:33.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.227+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.227+0000 7f83d7f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:33.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.227+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.228+0000 7f83d7f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:33.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.228+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.228+0000 7f83d7f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.228+0000 7f83d7f28800 20 zone default found 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.228+0000 7f83d7f28800 4 Realm: () 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.228+0000 7f83d7f28800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.228+0000 7f83d7f28800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.228+0000 7f83d7f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.228+0000 7f83d7f28800 20 zonegroup default 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.228+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.228+0000 7f83d7f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.228+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.229+0000 7f83d7f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.229+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.229+0000 7f83d7f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.229+0000 7f83d7f28800 20 started sync module instance, tier type = 2024-09-12T17:51:33.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.229+0000 7f83d7f28800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:33.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.238+0000 7f83d7f28800 20 add_watcher() i=0 2024-09-12T17:51:33.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.238+0000 7f83d7f28800 20 add_watcher() i=1 2024-09-12T17:51:33.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.238+0000 7f83d7f28800 20 add_watcher() i=2 2024-09-12T17:51:33.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.238+0000 7f83d7f28800 20 add_watcher() i=3 2024-09-12T17:51:33.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.238+0000 7f83d7f28800 20 add_watcher() i=4 2024-09-12T17:51:33.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.238+0000 7f83d7f28800 20 add_watcher() i=5 2024-09-12T17:51:33.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.238+0000 7f83d7f28800 20 add_watcher() i=6 2024-09-12T17:51:33.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.238+0000 7f83d7f28800 20 add_watcher() i=7 2024-09-12T17:51:33.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.238+0000 7f83d7f28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:33.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.240+0000 7f8289fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:33.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.240+0000 7f83d7f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:33.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.240+0000 7f83d7f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:33.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.240+0000 7f83d7f28800 5 note: GC not initialized 2024-09-12T17:51:33.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.240+0000 7f8288fe1640 20 reqs_thread_entry: start 2024-09-12T17:51:33.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.240+0000 7f83d7f28800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:33.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.241+0000 7f83d7f28800 20 Filter name: none 2024-09-12T17:51:33.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.241+0000 7f82027fc640 20 reqs_thread_entry: start 2024-09-12T17:51:33.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.241+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.241+0000 7f83d7f28800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:33.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.241+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.242+0000 7f83d7f28800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:33.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.242+0000 7f83d7f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:33.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.242+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.242+0000 7f83d7f28800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:33.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.242+0000 7f83d7f28800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.242+0000 7f83d7f28800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:33.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.242+0000 7f83d7f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:33.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.243+0000 7f8289fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:33.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.245+0000 7f83d7f28800 20 remove_watcher() i=0 2024-09-12T17:51:33.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.245+0000 7f83d7f28800 2 removed watcher, disabling cache 2024-09-12T17:51:33.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.246+0000 7f83d7f28800 20 remove_watcher() i=1 2024-09-12T17:51:33.248 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.247+0000 7f83d7f28800 20 remove_watcher() i=2 2024-09-12T17:51:33.249 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.248+0000 7f83d7f28800 20 remove_watcher() i=3 2024-09-12T17:51:33.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.249+0000 7f83d7f28800 20 remove_watcher() i=4 2024-09-12T17:51:33.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.250+0000 7f83d7f28800 20 remove_watcher() i=5 2024-09-12T17:51:33.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.251+0000 7f83d7f28800 20 remove_watcher() i=6 2024-09-12T17:51:33.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.252+0000 7f83d7f28800 20 remove_watcher() i=7 2024-09-12T17:51:33.263 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:33.263 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:51:33.263 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-logrecord-writes id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:51:33.263 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:33.314 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:51:33.345 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:33.345 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:33.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.583+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.584+0000 7f20c3328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:33.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.584+0000 7f20c3328800 20 realm 2024-09-12T17:51:33.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.584+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.585+0000 7f20c3328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:33.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.585+0000 7f20c3328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:33.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.585+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.585+0000 7f20c3328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:33.586 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.585+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.587 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.586+0000 7f20c3328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:33.587 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.586+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:33.587 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.586+0000 7f20c3328800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:33.587 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.586+0000 7f20c3328800 20 searching for the correct realm 2024-09-12T17:51:33.589 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.588+0000 7f20b686e640 0 -- 172.21.15.107:0/4254483222 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f20a8026040 msgr2=0x7f20a80673f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:33.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:33.794+0000 7f20bf06f640 0 -- 172.21.15.107:0/4254483222 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f20a80972f0 msgr2=0x7f20a80883a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:34.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.000+0000 7f20c3328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:34.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.000+0000 7f20c3328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:34.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.000+0000 7f20c3328800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:34.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.000+0000 7f20c3328800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:34.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.000+0000 7f20c3328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:34.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.000+0000 7f20c3328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:34.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.000+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.000+0000 7f20c3328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:34.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.000+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.003 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.000+0000 7f20c3328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:34.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.000+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:34.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 20 zone default found 2024-09-12T17:51:34.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 4 Realm: () 2024-09-12T17:51:34.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:34.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:34.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:34.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 20 zonegroup default 2024-09-12T17:51:34.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:34.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.004 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:34.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.001+0000 7f20c3328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:34.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.002+0000 7f20c3328800 20 started sync module instance, tier type = 2024-09-12T17:51:34.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.002+0000 7f20c3328800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:34.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.010+0000 7f20c3328800 20 add_watcher() i=0 2024-09-12T17:51:34.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.010+0000 7f20c3328800 20 add_watcher() i=1 2024-09-12T17:51:34.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.010+0000 7f20c3328800 20 add_watcher() i=2 2024-09-12T17:51:34.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.010+0000 7f20c3328800 20 add_watcher() i=3 2024-09-12T17:51:34.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.010+0000 7f20c3328800 20 add_watcher() i=4 2024-09-12T17:51:34.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.010+0000 7f20c3328800 20 add_watcher() i=5 2024-09-12T17:51:34.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.010+0000 7f20c3328800 20 add_watcher() i=6 2024-09-12T17:51:34.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.011+0000 7f20c3328800 20 add_watcher() i=7 2024-09-12T17:51:34.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.011+0000 7f20c3328800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:34.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.012+0000 7f1f75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:34.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.013+0000 7f20c3328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:34.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.013+0000 7f20c3328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:34.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.013+0000 7f20c3328800 5 note: GC not initialized 2024-09-12T17:51:34.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.013+0000 7f1f74fe1640 20 reqs_thread_entry: start 2024-09-12T17:51:34.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.013+0000 7f20c3328800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:34.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.013+0000 7f20c3328800 20 Filter name: none 2024-09-12T17:51:34.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.013+0000 7f1eee7fc640 20 reqs_thread_entry: start 2024-09-12T17:51:34.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.013+0000 7f20c3328800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:51:34.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.013+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.014+0000 7f20c3328800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:34.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.014+0000 7f20c3328800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:51:34.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.014+0000 7f20c3328800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:51:34.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.014+0000 7f20c3328800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 : miss 2024-09-12T17:51:34.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.014+0000 7f20c3328800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.014+0000 7f20c3328800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:34.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.014+0000 7f20c3328800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 info.flags=0x17 2024-09-12T17:51:34.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.014+0000 7f20c3328800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 to cache LRU end 2024-09-12T17:51:34.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.014+0000 7f20c3328800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:34.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.014+0000 7f20c3328800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:34.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.014+0000 7f20c3328800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 2024-09-12T17:51:34.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.018+0000 7f20c3328800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 info.flags=0x17 2024-09-12T17:51:34.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.018+0000 7f20c3328800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 to cache LRU end 2024-09-12T17:51:34.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.018+0000 7f20c3328800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:34.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.018+0000 7f20c3328800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36, ofs0, ns] 2024-09-12T17:51:34.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.018+0000 7f1fa2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94203756285408 notifier 7632 bl.length()=1007 2024-09-12T17:51:34.019 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.018+0000 7f1fa2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 info.flags=0x17 2024-09-12T17:51:34.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.018+0000 7f1fa2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 to cache LRU end 2024-09-12T17:51:34.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.018+0000 7f1fa2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:34.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.019+0000 7f20c3328800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): orig_sources= new_sources= 2024-09-12T17:51:34.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.019+0000 7f20c3328800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): potential sources added=[] removed=[] 2024-09-12T17:51:34.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.019+0000 7f20c3328800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): orig_dests= new_dests= 2024-09-12T17:51:34.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.019+0000 7f20c3328800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): potential dests added=[] removed=[] 2024-09-12T17:51:34.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.021+0000 7f20c3328800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.36.1.0 2024-09-12T17:51:34.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.021+0000 7f20c3328800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.36.1.0 2024-09-12T17:51:34.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.021+0000 7f20c3328800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.36.1.1 2024-09-12T17:51:34.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.021+0000 7f20c3328800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.36.1.1 2024-09-12T17:51:34.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.021+0000 7f20c3328800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.36.0 2024-09-12T17:51:34.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.022+0000 7f20c3328800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:51:34.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.022+0000 7f20c3328800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 2024-09-12T17:51:34.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.024+0000 7f20c3328800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 info.flags=0x17 2024-09-12T17:51:34.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.024+0000 7f20c3328800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 to cache LRU end 2024-09-12T17:51:34.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.024+0000 7f20c3328800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:34.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.024+0000 7f20c3328800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36, ofs0, ns] 2024-09-12T17:51:34.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.024+0000 7f1fa27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464320 cookie 94203756285408 notifier 7632 bl.length()=1007 2024-09-12T17:51:34.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.024+0000 7f1fa27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 info.flags=0x17 2024-09-12T17:51:34.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.024+0000 7f1fa27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 to cache LRU end 2024-09-12T17:51:34.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.024+0000 7f1fa27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:34.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.024+0000 7f20c3328800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): orig_sources= new_sources= 2024-09-12T17:51:34.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.024+0000 7f20c3328800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): potential sources added=[] removed=[] 2024-09-12T17:51:34.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.024+0000 7f20c3328800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): orig_dests= new_dests= 2024-09-12T17:51:34.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.024+0000 7f20c3328800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): potential dests added=[] removed=[] 2024-09-12T17:51:34.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.025+0000 7f20c3328800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.36.0 2024-09-12T17:51:34.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.026+0000 7f20c3328800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:51:34.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.026+0000 7f20c3328800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 2024-09-12T17:51:34.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.027+0000 7f20c3328800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 info.flags=0x17 2024-09-12T17:51:34.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.027+0000 7f20c3328800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 to cache LRU end 2024-09-12T17:51:34.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.027+0000 7f20c3328800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:34.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.027+0000 7f20c3328800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36, ofs0, ns] 2024-09-12T17:51:34.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.027+0000 7f1fa27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464321 cookie 94203756285408 notifier 7632 bl.length()=975 2024-09-12T17:51:34.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.027+0000 7f1fa27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 info.flags=0x17 2024-09-12T17:51:34.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.027+0000 7f1fa27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 to cache LRU end 2024-09-12T17:51:34.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.027+0000 7f1fa27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:34.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.028+0000 7f20c3328800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): orig_sources= new_sources= 2024-09-12T17:51:34.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.028+0000 7f20c3328800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): potential sources added=[] removed=[] 2024-09-12T17:51:34.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.028+0000 7f20c3328800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): orig_dests= new_dests= 2024-09-12T17:51:34.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.028+0000 7f20c3328800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.36]): potential dests added=[] removed=[] 2024-09-12T17:51:34.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.029+0000 7f20c3328800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T17:51:34.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.030+0000 7f1f75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:34.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.032+0000 7f20c3328800 20 remove_watcher() i=0 2024-09-12T17:51:34.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.032+0000 7f20c3328800 2 removed watcher, disabling cache 2024-09-12T17:51:34.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.033+0000 7f20c3328800 20 remove_watcher() i=1 2024-09-12T17:51:34.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.034+0000 7f20c3328800 20 remove_watcher() i=2 2024-09-12T17:51:34.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.035+0000 7f20c3328800 20 remove_watcher() i=3 2024-09-12T17:51:34.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.036+0000 7f20c3328800 20 remove_watcher() i=4 2024-09-12T17:51:34.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.037+0000 7f20c3328800 20 remove_watcher() i=5 2024-09-12T17:51:34.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.038+0000 7f20c3328800 20 remove_watcher() i=6 2024-09-12T17:51:34.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.039+0000 7f20c3328800 20 remove_watcher() i=7 2024-09-12T17:51:34.052 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:51:34.081 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:34.081 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:34.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.116+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.318+0000 7f1396e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:34.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.318+0000 7f1396e0f800 20 realm 2024-09-12T17:51:34.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.318+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.318+0000 7f1396e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:34.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.318+0000 7f1396e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:34.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.318+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.319+0000 7f1396e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:34.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.319+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.320+0000 7f1396e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:34.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.320+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.320+0000 7f1396e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:34.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.320+0000 7f1396e0f800 20 searching for the correct realm 2024-09-12T17:51:34.325 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.322+0000 7f1389d91640 0 -- 172.21.15.107:0/4071498638 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f137c025040 msgr2=0x7f137c067d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:34.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.527+0000 7f1392592640 0 -- 172.21.15.107:0/4071498638 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f137c0a1350 msgr2=0x7f137c067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:51:34.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.733+0000 7f1396e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:34.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.733+0000 7f1396e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:34.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.733+0000 7f1396e0f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:34.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.733+0000 7f1396e0f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:34.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.733+0000 7f1396e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:34.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.733+0000 7f1396e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:34.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.733+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.733+0000 7f1396e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:34.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.733+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.734+0000 7f1396e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:34.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.734+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.734+0000 7f1396e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:34.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.734+0000 7f1396e0f800 20 zone default found 2024-09-12T17:51:34.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.734+0000 7f1396e0f800 4 Realm: () 2024-09-12T17:51:34.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.734+0000 7f1396e0f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:34.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.734+0000 7f1396e0f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:34.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.734+0000 7f1396e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:34.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.734+0000 7f1396e0f800 20 zonegroup default 2024-09-12T17:51:34.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.734+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.734+0000 7f1396e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:34.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.734+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.735+0000 7f1396e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:34.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.735+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.735+0000 7f1396e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:34.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.735+0000 7f1396e0f800 20 started sync module instance, tier type = 2024-09-12T17:51:34.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.735+0000 7f1396e0f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:34.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.744+0000 7f1396e0f800 20 add_watcher() i=0 2024-09-12T17:51:34.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.744+0000 7f1396e0f800 20 add_watcher() i=1 2024-09-12T17:51:34.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.744+0000 7f1396e0f800 20 add_watcher() i=2 2024-09-12T17:51:34.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.744+0000 7f1396e0f800 20 add_watcher() i=3 2024-09-12T17:51:34.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.744+0000 7f1396e0f800 20 add_watcher() i=4 2024-09-12T17:51:34.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.744+0000 7f1396e0f800 20 add_watcher() i=5 2024-09-12T17:51:34.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.744+0000 7f1396e0f800 20 add_watcher() i=6 2024-09-12T17:51:34.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.745+0000 7f1396e0f800 20 add_watcher() i=7 2024-09-12T17:51:34.746 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.745+0000 7f1396e0f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:34.748 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.747+0000 7f1248fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:34.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.748+0000 7f1396e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:34.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.748+0000 7f1396e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:34.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.748+0000 7f1396e0f800 5 note: GC not initialized 2024-09-12T17:51:34.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.748+0000 7f11c37fe640 20 reqs_thread_entry: start 2024-09-12T17:51:34.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.748+0000 7f1396e0f800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:34.749 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.748+0000 7f1396e0f800 20 Filter name: none 2024-09-12T17:51:34.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.748+0000 7f11c17fa640 20 reqs_thread_entry: start 2024-09-12T17:51:34.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.748+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.749+0000 7f1396e0f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:34.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.749+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.749+0000 7f1396e0f800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:34.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.749+0000 7f1396e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:34.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.749+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.750+0000 7f1396e0f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:34.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.750+0000 7f1396e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:51:34.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.750+0000 7f1396e0f800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:34.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.750+0000 7f1396e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:34.752 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.751+0000 7f1248fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:34.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.754+0000 7f1396e0f800 20 remove_watcher() i=0 2024-09-12T17:51:34.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.754+0000 7f1396e0f800 2 removed watcher, disabling cache 2024-09-12T17:51:34.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.755+0000 7f1396e0f800 20 remove_watcher() i=1 2024-09-12T17:51:34.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.756+0000 7f1396e0f800 20 remove_watcher() i=2 2024-09-12T17:51:34.758 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.757+0000 7f1396e0f800 20 remove_watcher() i=3 2024-09-12T17:51:34.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.758+0000 7f1396e0f800 20 remove_watcher() i=4 2024-09-12T17:51:34.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.759+0000 7f1396e0f800 20 remove_watcher() i=5 2024-09-12T17:51:34.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.760+0000 7f1396e0f800 20 remove_watcher() i=6 2024-09-12T17:51:34.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:34.761+0000 7f1396e0f800 20 remove_watcher() i=7 2024-09-12T17:51:34.772 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:34.772 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:51:34.773 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-logrecord-writes id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:51:34.773 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:34.834 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T17:51:34.835 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.019 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:51:35.048 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:35.048 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:35.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.082+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.084+0000 7fb2fcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.084+0000 7fb2fcb23800 20 realm 2024-09-12T17:51:35.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.084+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.084+0000 7fb2fcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.084+0000 7fb2fcb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:35.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.084+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.084+0000 7fb2fcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.084+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.085+0000 7fb2fcb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:35.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.085+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.086+0000 7fb2fcb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:35.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.086+0000 7fb2fcb23800 20 searching for the correct realm 2024-09-12T17:51:35.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.089+0000 7fb2f880c640 0 -- 172.21.15.107:0/1861414108 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fb2f401ebc0 msgr2=0x7fb2f4028960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:35.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.092+0000 7fb2f880c640 0 -- 172.21.15.107:0/1861414108 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fb2e4082040 msgr2=0x7fb2e4099970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:35.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.096+0000 7fb2fcb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:35.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.096+0000 7fb2fcb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:35.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.096+0000 7fb2fcb23800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:35.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.096+0000 7fb2fcb23800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:35.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.096+0000 7fb2fcb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:35.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.096+0000 7fb2fcb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:35.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.096+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.096+0000 7fb2fcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.096+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.096+0000 7fb2fcb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:35.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.096+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:35.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 20 zone default found 2024-09-12T17:51:35.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 4 Realm: () 2024-09-12T17:51:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 20 zonegroup default 2024-09-12T17:51:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 20 started sync module instance, tier type = 2024-09-12T17:51:35.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.097+0000 7fb2fcb23800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:35.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.106+0000 7fb2fcb23800 20 add_watcher() i=0 2024-09-12T17:51:35.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.106+0000 7fb2fcb23800 20 add_watcher() i=1 2024-09-12T17:51:35.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.106+0000 7fb2fcb23800 20 add_watcher() i=2 2024-09-12T17:51:35.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.106+0000 7fb2fcb23800 20 add_watcher() i=3 2024-09-12T17:51:35.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.106+0000 7fb2fcb23800 20 add_watcher() i=4 2024-09-12T17:51:35.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.106+0000 7fb2fcb23800 20 add_watcher() i=5 2024-09-12T17:51:35.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.106+0000 7fb2fcb23800 20 add_watcher() i=6 2024-09-12T17:51:35.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.107+0000 7fb2fcb23800 20 add_watcher() i=7 2024-09-12T17:51:35.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.107+0000 7fb2fcb23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:35.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.108+0000 7fb1aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:35.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.109+0000 7fb2fcb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:35.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.109+0000 7fb2fcb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:35.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.109+0000 7fb2fcb23800 5 note: GC not initialized 2024-09-12T17:51:35.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.109+0000 7fb1adfe3640 20 reqs_thread_entry: start 2024-09-12T17:51:35.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.109+0000 7fb2fcb23800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:35.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.109+0000 7fb2fcb23800 20 Filter name: none 2024-09-12T17:51:35.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.109+0000 7fb11f7fe640 20 reqs_thread_entry: start 2024-09-12T17:51:35.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.109+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.110+0000 7fb2fcb23800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:35.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.110+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.110+0000 7fb2fcb23800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:35.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.110+0000 7fb2fcb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:35.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.110+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.111+0000 7fb2fcb23800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:35.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.111+0000 7fb2fcb23800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.111+0000 7fb2fcb23800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:35.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.111+0000 7fb2fcb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:35.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.112+0000 7fb1aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:35.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.114+0000 7fb2fcb23800 20 remove_watcher() i=0 2024-09-12T17:51:35.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.114+0000 7fb2fcb23800 2 removed watcher, disabling cache 2024-09-12T17:51:35.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.115+0000 7fb2fcb23800 20 remove_watcher() i=1 2024-09-12T17:51:35.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.116+0000 7fb2fcb23800 20 remove_watcher() i=2 2024-09-12T17:51:35.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.117+0000 7fb2fcb23800 20 remove_watcher() i=3 2024-09-12T17:51:35.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.118+0000 7fb2fcb23800 20 remove_watcher() i=4 2024-09-12T17:51:35.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.119+0000 7fb2fcb23800 20 remove_watcher() i=5 2024-09-12T17:51:35.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.120+0000 7fb2fcb23800 20 remove_watcher() i=6 2024-09-12T17:51:35.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.121+0000 7fb2fcb23800 20 remove_watcher() i=7 2024-09-12T17:51:35.132 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.132 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:51:35.132 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-logrecord-writes id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:51:35.132 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.134 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:51:35.167 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:35.167 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:35.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.202+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.204+0000 7f44a6087800 20 realm 2024-09-12T17:51:35.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.204+0000 7f44a6087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:35.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.206 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.205+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:35.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.205+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.205+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:35.207 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.205+0000 7f44a6087800 20 searching for the correct realm 2024-09-12T17:51:35.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.208+0000 7f449b370640 0 -- 172.21.15.107:0/4081348405 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f448c06cb80 msgr2=0x7f448c0a2a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:35.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.211+0000 7f44a3b71640 0 -- 172.21.15.107:0/4081348405 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f448c06dba0 msgr2=0x7f448c092520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:35.419 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:35.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:35.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:35.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:35.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:35.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:35.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.417+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:35.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:35.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 20 zone default found 2024-09-12T17:51:35.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 4 Realm: () 2024-09-12T17:51:35.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:35.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:35.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:35.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 20 zonegroup default 2024-09-12T17:51:35.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.419+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.419+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.419+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.419+0000 7f44a6087800 20 started sync module instance, tier type = 2024-09-12T17:51:35.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.419+0000 7f44a6087800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:35.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=0 2024-09-12T17:51:35.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=1 2024-09-12T17:51:35.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=2 2024-09-12T17:51:35.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=3 2024-09-12T17:51:35.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=4 2024-09-12T17:51:35.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=5 2024-09-12T17:51:35.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=6 2024-09-12T17:51:35.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.429+0000 7f44a6087800 20 add_watcher() i=7 2024-09-12T17:51:35.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.429+0000 7f44a6087800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:35.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.430+0000 7f4359fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:35.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.431+0000 7f44a6087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:35.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.431+0000 7f44a6087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:35.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.431+0000 7f44a6087800 5 note: GC not initialized 2024-09-12T17:51:35.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.431+0000 7f4358fe1640 20 reqs_thread_entry: start 2024-09-12T17:51:35.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.431+0000 7f44a6087800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:35.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.431+0000 7f44a6087800 20 Filter name: none 2024-09-12T17:51:35.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.431+0000 7f42d27fc640 20 reqs_thread_entry: start 2024-09-12T17:51:35.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.431+0000 7f44a6087800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:51:35.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.431+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.432+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:35.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.432+0000 7f44a6087800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:51:35.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.432+0000 7f44a6087800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:51:35.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.432+0000 7f44a6087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 : miss 2024-09-12T17:51:35.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.432+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.432+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:35.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.432+0000 7f44a6087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:51:35.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.432+0000 7f44a6087800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:51:35.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.432+0000 7f44a6087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:35.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.432+0000 7f44a6087800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:35.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.432+0000 7f44a6087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 2024-09-12T17:51:35.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.435+0000 7f44a6087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:51:35.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.435+0000 7f44a6087800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:51:35.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.435+0000 7f44a6087800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:35.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.435+0000 7f44a6087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37, ofs0, ns] 2024-09-12T17:51:35.437 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.436+0000 7f4382ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94030485652352 notifier 7232 bl.length()=1007 2024-09-12T17:51:35.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.436+0000 7f4382ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:51:35.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.436+0000 7f4382ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:51:35.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.436+0000 7f4382ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:35.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.436+0000 7f44a6087800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): orig_sources= new_sources= 2024-09-12T17:51:35.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.436+0000 7f44a6087800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): potential sources added=[] removed=[] 2024-09-12T17:51:35.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.436+0000 7f44a6087800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): orig_dests= new_dests= 2024-09-12T17:51:35.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.436+0000 7f44a6087800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): potential dests added=[] removed=[] 2024-09-12T17:51:35.439 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f44a6087800 time 2024-09-12T17:51:35.438785+0000 2024-09-12T17:51:35.439 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:51:35.439 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:35.439 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f44a958c71a] 2024-09-12T17:51:35.439 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f44a958c8d8] 2024-09-12T17:51:35.439 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55852b6b2841] 2024-09-12T17:51:35.439 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd7490c) [0x55852bbc090c] 2024-09-12T17:51:35.440 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55852b6c250d] 2024-09-12T17:51:35.440 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:51:35.440 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f44a8229590] 2024-09-12T17:51:35.440 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:51:35.440 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:51:35.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.438+0000 7f44a6087800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f44a6087800 time 2024-09-12T17:51:35.438785+0000 2024-09-12T17:51:35.440 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:51:35.440 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.440 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:35.440 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f44a958c71a] 2024-09-12T17:51:35.440 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f44a958c8d8] 2024-09-12T17:51:35.440 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55852b6b2841] 2024-09-12T17:51:35.441 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd7490c) [0x55852bbc090c] 2024-09-12T17:51:35.441 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55852b6c250d] 2024-09-12T17:51:35.441 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:51:35.441 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f44a8229590] 2024-09-12T17:51:35.441 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:51:35.441 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:51:35.441 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.441 INFO:tasks.workunit.client.0.smithi107.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:51:35.441 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f44a6087800 thread_name:radosgw-admin 2024-09-12T17:51:35.461 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:35.462 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f44a823e6f0] 2024-09-12T17:51:35.462 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f44a828b99c] 2024-09-12T17:51:35.462 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:51:35.462 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:51:35.462 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f44a958c774] 2024-09-12T17:51:35.462 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f44a958c8d8] 2024-09-12T17:51:35.462 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55852b6b2841] 2024-09-12T17:51:35.462 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd7490c) [0x55852bbc090c] 2024-09-12T17:51:35.462 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55852b6c250d] 2024-09-12T17:51:35.462 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:51:35.463 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f44a8229590] 2024-09-12T17:51:35.463 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:51:35.463 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:51:35.463 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.439+0000 7f44a6087800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:51:35.463 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f44a6087800 thread_name:radosgw-admin 2024-09-12T17:51:35.463 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.463 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:35.463 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f44a823e6f0] 2024-09-12T17:51:35.463 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f44a828b99c] 2024-09-12T17:51:35.463 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:51:35.463 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:51:35.463 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f44a958c774] 2024-09-12T17:51:35.464 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f44a958c8d8] 2024-09-12T17:51:35.464 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55852b6b2841] 2024-09-12T17:51:35.464 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd7490c) [0x55852bbc090c] 2024-09-12T17:51:35.464 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55852b6c250d] 2024-09-12T17:51:35.464 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:51:35.464 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f44a8229590] 2024-09-12T17:51:35.464 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:51:35.464 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:51:35.464 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:51:35.464 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.465 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:51:35.465 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:51:35.186+0000 7f4391e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:35.465 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:51:35.186+0000 7f44a6087800 10 monclient: get_monmap_and_config success 2024-09-12T17:51:35.465 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:51:35.186+0000 7f44a6087800 4 set_mon_vals no callback set 2024-09-12T17:51:35.465 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:51:35.186+0000 7f4391e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.465 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:51:35.186+0000 7f4391e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:51:35.465 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:51:35.186+0000 7f4391e0b640 10 monclient: dump: 2024-09-12T17:51:35.465 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.465 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.465 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.465 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.465 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.466 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.466 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.466 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.466 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.466 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.466 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:51:35.186+0000 7f44a6087800 10 monclient: shutdown 2024-09-12T17:51:35.466 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:51:35.186+0000 7f44a6087800 5 asok(0x55852d800730) unregister_commands rotate-key 2024-09-12T17:51:35.466 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:51:35.187+0000 7f44a6087800 10 monclient: build_initial_monmap 2024-09-12T17:51:35.466 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:51:35.187+0000 7f44a6087800 1 build_initial for_mkfs: 0 2024-09-12T17:51:35.466 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:51:35.187+0000 7f44a6087800 10 monclient: monmap: 2024-09-12T17:51:35.466 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:35.466 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:35.467 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:35.467 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:35.467 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:35.467 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.467 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:35.467 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:35.467 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:35.467 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.467 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding auth protocol: cephx 2024-09-12T17:51:35.467 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding auth protocol: cephx 2024-09-12T17:51:35.467 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding auth protocol: cephx 2024-09-12T17:51:35.467 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: secure 2024-09-12T17:51:35.468 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: crc 2024-09-12T17:51:35.468 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: secure 2024-09-12T17:51:35.468 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: crc 2024-09-12T17:51:35.468 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: secure 2024-09-12T17:51:35.468 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: crc 2024-09-12T17:51:35.468 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: crc 2024-09-12T17:51:35.468 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: secure 2024-09-12T17:51:35.468 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: crc 2024-09-12T17:51:35.468 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: secure 2024-09-12T17:51:35.468 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: crc 2024-09-12T17:51:35.469 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: secure 2024-09-12T17:51:35.469 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:51:35.187+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.469 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:51:35.187+0000 7f44a6087800 1 librados: starting msgr at 2024-09-12T17:51:35.469 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:51:35.187+0000 7f44a6087800 1 librados: starting objecter 2024-09-12T17:51:35.469 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 asok(0x55852d800730) register_command objecter_requests hook 0x55852da26e20 2024-09-12T17:51:35.469 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:51:35.187+0000 7f44a6087800 1 librados: setting wanted keys 2024-09-12T17:51:35.469 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:51:35.187+0000 7f44a6087800 1 librados: calling monclient init 2024-09-12T17:51:35.469 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:51:35.187+0000 7f44a6087800 10 monclient: init 2024-09-12T17:51:35.469 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding auth protocol: cephx 2024-09-12T17:51:35.469 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding auth protocol: cephx 2024-09-12T17:51:35.469 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding auth protocol: cephx 2024-09-12T17:51:35.470 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: secure 2024-09-12T17:51:35.470 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: crc 2024-09-12T17:51:35.470 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: secure 2024-09-12T17:51:35.470 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: crc 2024-09-12T17:51:35.470 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: secure 2024-09-12T17:51:35.470 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: crc 2024-09-12T17:51:35.470 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: crc 2024-09-12T17:51:35.470 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: secure 2024-09-12T17:51:35.470 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: crc 2024-09-12T17:51:35.470 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: secure 2024-09-12T17:51:35.470 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: crc 2024-09-12T17:51:35.470 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: secure 2024-09-12T17:51:35.471 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:51:35.187+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.471 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:51:35.187+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.471 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:51:35.188+0000 7f44a6087800 5 asok(0x55852d800730) register_command rotate-key hook 0x55852da24fd8 2024-09-12T17:51:35.471 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:35.471 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:51:35.471 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-a con 0x55852d967c70 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:35.471 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-b con 0x55852d96df30 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:35.471 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-c con 0x55852d973250 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:35.471 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.471 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.471 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.471 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): authenticate will time out at 2099.734115s 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): get_auth_request con 0x55852d967c70 auth_method 0 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): get_auth_request con 0x55852d973250 auth_method 0 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.472 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.473 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.473 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.473 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): get_auth_request con 0x55852d96df30 auth_method 0 2024-09-12T17:51:35.473 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.473 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.473 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.473 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.473 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.473 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.473 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): handle_auth_done global_id 7683 payload 824 2024-09-12T17:51:35.473 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient: _finish_hunting 0 2024-09-12T17:51:35.474 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:51:35.188+0000 7f44a3b71640 1 monclient: found mon.noname-a 2024-09-12T17:51:35.474 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:51:35.474 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.474 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:51:35.474 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: dump: 2024-09-12T17:51:35.474 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.474 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.474 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.474 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.474 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.474 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.474 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: _finish_auth 0 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: dump: 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.475 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.476 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.476 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.476 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.476 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.476 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.476 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.476 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:51:35.188+0000 7f44a6087800 5 monclient: authenticate success, global_id 7683 2024-09-12T17:51:35.476 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient: _renew_subs 2024-09-12T17:51:35.476 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:35.476 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:51:35.188+0000 7f4391e0b640 4 set_mon_vals no callback set 2024-09-12T17:51:35.476 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient: _renew_subs 2024-09-12T17:51:35.476 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:35.477 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:51:35.188+0000 7f44a6087800 1 librados: init done 2024-09-12T17:51:35.477 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:51:35.190+0000 7f438bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:51:35.477 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:51:35.190+0000 7f438bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:35.477 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:51:35.190+0000 7f438bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:35.477 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:51:35.190+0000 7f449b370640 10 monclient: get_auth_request con 0x7f438c076470 auth_method 0 2024-09-12T17:51:35.477 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:51:35.190+0000 7f44a4372640 10 monclient: get_auth_request con 0x55852da4d710 auth_method 0 2024-09-12T17:51:35.477 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:51:35.191+0000 7f44a3b71640 10 monclient: get_auth_request con 0x55852da6ffe0 auth_method 0 2024-09-12T17:51:35.477 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:51:35.192+0000 7f449b370640 10 monclient: get_auth_request con 0x55852da746b0 auth_method 0 2024-09-12T17:51:35.477 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:51:35.193+0000 7f44a6087800 10 monclient: build_initial_monmap 2024-09-12T17:51:35.477 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:51:35.193+0000 7f44a6087800 1 build_initial for_mkfs: 0 2024-09-12T17:51:35.477 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:51:35.193+0000 7f44a6087800 10 monclient: monmap: 2024-09-12T17:51:35.477 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:35.478 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:35.478 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:35.478 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:35.478 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:35.478 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.478 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:35.478 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:35.478 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:35.478 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.478 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding auth protocol: cephx 2024-09-12T17:51:35.478 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding auth protocol: cephx 2024-09-12T17:51:35.478 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding auth protocol: cephx 2024-09-12T17:51:35.479 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: secure 2024-09-12T17:51:35.479 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: crc 2024-09-12T17:51:35.479 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: secure 2024-09-12T17:51:35.479 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: crc 2024-09-12T17:51:35.479 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: secure 2024-09-12T17:51:35.479 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: crc 2024-09-12T17:51:35.479 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: crc 2024-09-12T17:51:35.479 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: secure 2024-09-12T17:51:35.479 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: crc 2024-09-12T17:51:35.479 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: secure 2024-09-12T17:51:35.479 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: crc 2024-09-12T17:51:35.479 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: secure 2024-09-12T17:51:35.480 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:51:35.194+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.480 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 asok(0x55852d800730) register_command objecter_requests cmddesc objecter_requests hook 0x55852da7cf20 EEXIST 2024-09-12T17:51:35.480 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient: init 2024-09-12T17:51:35.480 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding auth protocol: cephx 2024-09-12T17:51:35.480 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding auth protocol: cephx 2024-09-12T17:51:35.480 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding auth protocol: cephx 2024-09-12T17:51:35.480 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: secure 2024-09-12T17:51:35.480 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: crc 2024-09-12T17:51:35.480 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: secure 2024-09-12T17:51:35.480 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: crc 2024-09-12T17:51:35.480 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: secure 2024-09-12T17:51:35.481 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: crc 2024-09-12T17:51:35.481 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: crc 2024-09-12T17:51:35.481 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: secure 2024-09-12T17:51:35.481 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: crc 2024-09-12T17:51:35.481 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: secure 2024-09-12T17:51:35.481 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: crc 2024-09-12T17:51:35.481 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: secure 2024-09-12T17:51:35.481 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:51:35.194+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.481 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:51:35.194+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.481 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 asok(0x55852d800730) register_command rotate-key cmddesc rotate-key hook 0x55852da77d00 EEXIST 2024-09-12T17:51:35.481 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:35.481 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:51:35.482 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-c con 0x55852daa0c10 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:35.482 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-b con 0x55852daa2ee0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:35.482 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-a con 0x55852da9f3e0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:35.482 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.482 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.482 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.482 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:35.482 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): authenticate will time out at 2099.740796s 2024-09-12T17:51:35.482 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): get_auth_request con 0x55852daa0c10 auth_method 0 2024-09-12T17:51:35.482 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.482 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.483 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.483 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): get_auth_request con 0x55852da9f3e0 auth_method 0 2024-09-12T17:51:35.483 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.483 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.483 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.483 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.483 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.483 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.483 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.483 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.483 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.484 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:51:35.195+0000 7f44a3b71640 10 monclient(hunting): handle_auth_done global_id 7226 payload 824 2024-09-12T17:51:35.484 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:51:35.195+0000 7f44a3b71640 10 monclient: _finish_hunting 0 2024-09-12T17:51:35.484 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:51:35.195+0000 7f44a3b71640 1 monclient: found mon.noname-c 2024-09-12T17:51:35.484 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:51:35.195+0000 7f44a3b71640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.484 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.484 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:51:35.484 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: dump: 2024-09-12T17:51:35.484 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.484 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.484 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.484 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.485 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.485 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.485 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.485 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.485 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.485 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.485 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: _finish_auth 0 2024-09-12T17:51:35.485 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: _check_auth_tickets 2024-09-12T17:51:35.485 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:35.485 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.486 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:51:35.486 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: dump: 2024-09-12T17:51:35.486 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.486 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.486 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.486 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.486 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.486 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.486 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.486 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.486 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.487 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.487 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:51:35.195+0000 7f44a6087800 5 monclient: authenticate success, global_id 7226 2024-09-12T17:51:35.487 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:51:35.195+0000 7f44a6087800 10 monclient: _renew_subs 2024-09-12T17:51:35.487 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:51:35.195+0000 7f44a6087800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.487 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:51:35.195+0000 7f44a4b73640 4 set_mon_vals no callback set 2024-09-12T17:51:35.487 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:51:35.195+0000 7f44a6087800 10 monclient: _renew_subs 2024-09-12T17:51:35.487 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:51:35.195+0000 7f44a6087800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.487 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:51:35.196+0000 7f43897fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:51:35.487 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:51:35.196+0000 7f43897fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:35.487 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:51:35.196+0000 7f43897fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:35.487 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:51:35.197+0000 7f44a6087800 10 monclient: get_monmap_and_config 2024-09-12T17:51:35.488 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:51:35.197+0000 7f44a6087800 10 monclient: build_initial_monmap 2024-09-12T17:51:35.488 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:51:35.197+0000 7f44a6087800 1 build_initial for_mkfs: 0 2024-09-12T17:51:35.488 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:51:35.197+0000 7f44a6087800 10 monclient: monmap: 2024-09-12T17:51:35.488 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:35.488 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:35.488 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:35.488 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:35.488 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:35.488 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.488 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:35.488 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:35.488 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:35.489 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.489 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding auth protocol: cephx 2024-09-12T17:51:35.489 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding auth protocol: cephx 2024-09-12T17:51:35.489 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding auth protocol: cephx 2024-09-12T17:51:35.489 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: secure 2024-09-12T17:51:35.489 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: crc 2024-09-12T17:51:35.489 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: secure 2024-09-12T17:51:35.489 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: crc 2024-09-12T17:51:35.489 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: secure 2024-09-12T17:51:35.489 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: crc 2024-09-12T17:51:35.490 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: crc 2024-09-12T17:51:35.490 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: secure 2024-09-12T17:51:35.490 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: crc 2024-09-12T17:51:35.490 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: secure 2024-09-12T17:51:35.490 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: crc 2024-09-12T17:51:35.490 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: secure 2024-09-12T17:51:35.490 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:51:35.197+0000 7f449b370640 10 monclient: get_auth_request con 0x7f437c076380 auth_method 0 2024-09-12T17:51:35.490 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:51:35.197+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.490 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:51:35.197+0000 7f44a6087800 10 monclient: init 2024-09-12T17:51:35.490 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding auth protocol: cephx 2024-09-12T17:51:35.490 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding auth protocol: cephx 2024-09-12T17:51:35.490 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding auth protocol: cephx 2024-09-12T17:51:35.491 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: secure 2024-09-12T17:51:35.491 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: crc 2024-09-12T17:51:35.491 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: secure 2024-09-12T17:51:35.491 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: crc 2024-09-12T17:51:35.491 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: secure 2024-09-12T17:51:35.491 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: crc 2024-09-12T17:51:35.491 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: crc 2024-09-12T17:51:35.491 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: secure 2024-09-12T17:51:35.491 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: crc 2024-09-12T17:51:35.491 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: secure 2024-09-12T17:51:35.491 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: crc 2024-09-12T17:51:35.492 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: secure 2024-09-12T17:51:35.492 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:51:35.197+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.492 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:51:35.198+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.492 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:51:35.198+0000 7f44a6087800 5 asok(0x55852d800730) register_command rotate-key cmddesc rotate-key hook 0x7ffc4cfb3a38 EEXIST 2024-09-12T17:51:35.492 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:35.492 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:51:35.492 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-a con 0x55852daf49c0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:35.492 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-c con 0x55852dae5530 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:35.492 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-b con 0x55852daefdf0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:35.493 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.493 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.493 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.493 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:35.493 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): authenticate will time out at 2099.744264s 2024-09-12T17:51:35.493 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): get_auth_request con 0x55852dae5530 auth_method 0 2024-09-12T17:51:35.493 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.493 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.493 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.493 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): get_auth_request con 0x55852daf49c0 auth_method 0 2024-09-12T17:51:35.493 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.493 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.494 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.494 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.494 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.494 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.494 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): get_auth_request con 0x55852daefdf0 auth_method 0 2024-09-12T17:51:35.494 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.494 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.494 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.494 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.494 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.494 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.495 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.495 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.495 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.495 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): handle_auth_done global_id 7229 payload 274 2024-09-12T17:51:35.495 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient: _finish_hunting 0 2024-09-12T17:51:35.495 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:51:35.198+0000 7f449b370640 1 monclient: found mon.noname-c 2024-09-12T17:51:35.495 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.495 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.495 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:51:35.495 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: dump: 2024-09-12T17:51:35.495 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.496 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.496 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.496 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.496 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.496 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.496 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.496 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.496 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.496 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.496 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: _finish_auth 0 2024-09-12T17:51:35.497 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:51:35.497 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:51:35.198+0000 7f44a6087800 5 monclient: authenticate success, global_id 7229 2024-09-12T17:51:35.497 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:35.497 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient: get_monmap_and_config success 2024-09-12T17:51:35.497 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:51:35.198+0000 7f44a6087800 4 set_mon_vals no callback set 2024-09-12T17:51:35.497 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.497 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:51:35.497 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: dump: 2024-09-12T17:51:35.497 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.497 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.497 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.497 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.498 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.498 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.498 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.498 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.498 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.498 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.498 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:51:35.199+0000 7f44a6087800 10 monclient: shutdown 2024-09-12T17:51:35.498 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:51:35.199+0000 7f44a6087800 10 monclient: build_initial_monmap 2024-09-12T17:51:35.498 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:51:35.199+0000 7f44a6087800 1 build_initial for_mkfs: 0 2024-09-12T17:51:35.498 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:51:35.199+0000 7f44a6087800 10 monclient: monmap: 2024-09-12T17:51:35.498 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:35.498 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:35.499 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:35.499 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:35.499 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:35.499 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.499 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:35.499 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:35.499 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:35.499 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.499 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding auth protocol: cephx 2024-09-12T17:51:35.499 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding auth protocol: cephx 2024-09-12T17:51:35.499 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding auth protocol: cephx 2024-09-12T17:51:35.500 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: secure 2024-09-12T17:51:35.500 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: crc 2024-09-12T17:51:35.500 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: secure 2024-09-12T17:51:35.500 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: crc 2024-09-12T17:51:35.500 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: secure 2024-09-12T17:51:35.500 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: crc 2024-09-12T17:51:35.500 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: crc 2024-09-12T17:51:35.500 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: secure 2024-09-12T17:51:35.500 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: crc 2024-09-12T17:51:35.500 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: secure 2024-09-12T17:51:35.500 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: crc 2024-09-12T17:51:35.500 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: secure 2024-09-12T17:51:35.501 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:51:35.199+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.501 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:51:35.199+0000 7f44a6087800 1 librados: starting msgr at 2024-09-12T17:51:35.501 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:51:35.199+0000 7f44a6087800 1 librados: starting objecter 2024-09-12T17:51:35.501 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 asok(0x55852d800730) register_command objecter_requests cmddesc objecter_requests hook 0x55852daa2d50 EEXIST 2024-09-12T17:51:35.501 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:51:35.199+0000 7f44a6087800 1 librados: setting wanted keys 2024-09-12T17:51:35.501 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:51:35.199+0000 7f44a6087800 1 librados: calling monclient init 2024-09-12T17:51:35.501 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:51:35.199+0000 7f44a6087800 10 monclient: init 2024-09-12T17:51:35.501 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding auth protocol: cephx 2024-09-12T17:51:35.501 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding auth protocol: cephx 2024-09-12T17:51:35.501 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding auth protocol: cephx 2024-09-12T17:51:35.501 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: secure 2024-09-12T17:51:35.501 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: crc 2024-09-12T17:51:35.502 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: secure 2024-09-12T17:51:35.502 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: crc 2024-09-12T17:51:35.502 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: secure 2024-09-12T17:51:35.502 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: crc 2024-09-12T17:51:35.502 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: crc 2024-09-12T17:51:35.502 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: secure 2024-09-12T17:51:35.502 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: crc 2024-09-12T17:51:35.502 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: secure 2024-09-12T17:51:35.502 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: crc 2024-09-12T17:51:35.502 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: secure 2024-09-12T17:51:35.502 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:51:35.200+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.502 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:51:35.200+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.503 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:51:35.200+0000 7f44a6087800 5 asok(0x55852d800730) register_command rotate-key cmddesc rotate-key hook 0x55852dab8b08 EEXIST 2024-09-12T17:51:35.503 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:35.503 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:51:35.503 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-a con 0x55852dae5530 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:35.503 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-c con 0x55852daefdf0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:35.503 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-b con 0x55852daf49c0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:35.503 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.503 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.503 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.503 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:35.503 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): authenticate will time out at 2099.746476s 2024-09-12T17:51:35.504 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): get_auth_request con 0x55852dae5530 auth_method 0 2024-09-12T17:51:35.504 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.504 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.504 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.504 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): get_auth_request con 0x55852daefdf0 auth_method 0 2024-09-12T17:51:35.504 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.504 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.504 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.504 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.504 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.504 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.504 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.505 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.505 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.505 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:51:35.200+0000 7f44a4372640 10 monclient(hunting): get_auth_request con 0x55852daf49c0 auth_method 0 2024-09-12T17:51:35.505 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:51:35.200+0000 7f44a4372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.505 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:51:35.200+0000 7f44a4372640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.505 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:51:35.200+0000 7f44a4372640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.505 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): handle_auth_done global_id 7232 payload 824 2024-09-12T17:51:35.505 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient: _finish_hunting 0 2024-09-12T17:51:35.505 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:51:35.200+0000 7f449b370640 1 monclient: found mon.noname-c 2024-09-12T17:51:35.505 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.505 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: dump: 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.506 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: _finish_auth 0 2024-09-12T17:51:35.507 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: _check_auth_tickets 2024-09-12T17:51:35.507 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:35.507 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.507 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:51:35.507 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: dump: 2024-09-12T17:51:35.507 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.507 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.507 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.507 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.507 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.507 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.507 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.508 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.508 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.508 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.508 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:51:35.201+0000 7f44a6087800 5 monclient: authenticate success, global_id 7232 2024-09-12T17:51:35.508 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:51:35.201+0000 7f4382ffd640 4 set_mon_vals no callback set 2024-09-12T17:51:35.508 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:51:35.201+0000 7f44a6087800 10 monclient: _renew_subs 2024-09-12T17:51:35.508 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:51:35.201+0000 7f44a6087800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.508 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:51:35.201+0000 7f44a6087800 10 monclient: _renew_subs 2024-09-12T17:51:35.508 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:51:35.201+0000 7f44a6087800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.508 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:51:35.201+0000 7f44a6087800 1 librados: init done 2024-09-12T17:51:35.508 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:51:35.201+0000 7f44a6087800 5 asok(0x55852d800730) register_command cr dump hook 0x55852dae2bb8 2024-09-12T17:51:35.509 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:51:35.202+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.509 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:51:35.203+0000 7f43817fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:51:35.509 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:51:35.203+0000 7f43817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:35.509 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:51:35.203+0000 7f43817fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:35.509 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:51:35.203+0000 7f44a3b71640 10 monclient: get_auth_request con 0x7f436c076640 auth_method 0 2024-09-12T17:51:35.509 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:51:35.203+0000 7f44a4372640 10 monclient: get_auth_request con 0x55852db0f1c0 auth_method 0 2024-09-12T17:51:35.509 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.509 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 realm 2024-09-12T17:51:35.509 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.509 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.509 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:51:35.204+0000 7f44a6087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:35.510 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.510 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.510 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.510 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:51:35.204+0000 7f44a3b71640 10 monclient: get_auth_request con 0x55852db13420 auth_method 0 2024-09-12T17:51:35.510 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:51:35.205+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:35.510 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:51:35.205+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.510 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:51:35.205+0000 7f449b370640 10 monclient: get_auth_request con 0x55852db16c80 auth_method 0 2024-09-12T17:51:35.510 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:51:35.205+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:35.510 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:51:35.205+0000 7f44a6087800 20 searching for the correct realm 2024-09-12T17:51:35.510 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:51:35.206+0000 7f44a4372640 10 monclient: get_auth_request con 0x55852db1ba20 auth_method 0 2024-09-12T17:51:35.510 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:51:35.206+0000 7f44a3b71640 10 monclient: get_auth_request con 0x7f449c02c410 auth_method 0 2024-09-12T17:51:35.511 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:51:35.207+0000 7f449b370640 10 monclient: get_auth_request con 0x7f448c06cb80 auth_method 0 2024-09-12T17:51:35.511 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:51:35.208+0000 7f449b370640 0 -- 172.21.15.107:0/4081348405 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f448c06cb80 msgr2=0x7f448c0a2a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:35.511 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:51:35.208+0000 7f43817fa640 1 client.7232.objecter ms_handle_reset 0x7f448c06cb80 session 0x7f448c06c090 osd.4 2024-09-12T17:51:35.511 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:51:35.208+0000 7f43817fa640 10 monclient: _renew_subs 2024-09-12T17:51:35.511 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:51:35.208+0000 7f43817fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.511 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:51:35.208+0000 7f449b370640 10 monclient: get_auth_request con 0x7f436c086d70 auth_method 0 2024-09-12T17:51:35.511 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:51:35.209+0000 7f44a4372640 10 monclient: get_auth_request con 0x7f448c075670 auth_method 0 2024-09-12T17:51:35.511 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:51:35.211+0000 7f44a3b71640 10 monclient: get_auth_request con 0x7f448c06dba0 auth_method 0 2024-09-12T17:51:35.511 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:51:35.211+0000 7f44a3b71640 0 -- 172.21.15.107:0/4081348405 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f448c06dba0 msgr2=0x7f448c092520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:35.511 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:51:35.413+0000 7f44a3b71640 10 monclient: get_auth_request con 0x7f448c06dba0 auth_method 0 2024-09-12T17:51:35.511 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:35.512 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:35.512 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:35.512 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:35.512 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:35.512 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:35.512 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.512 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.512 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.512 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:35.512 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.512 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:35.512 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 zone default found 2024-09-12T17:51:35.513 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:51:35.418+0000 7f44a6087800 4 Realm: () 2024-09-12T17:51:35.513 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:51:35.418+0000 7f44a6087800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:35.513 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:51:35.418+0000 7f44a6087800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:35.513 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:51:35.418+0000 7f44a6087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:35.513 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 zonegroup default 2024-09-12T17:51:35.513 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.513 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.513 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.513 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:51:35.419+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.513 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:51:35.419+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.513 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:51:35.419+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.514 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:51:35.419+0000 7f44a6087800 20 started sync module instance, tier type = 2024-09-12T17:51:35.514 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:51:35.419+0000 7f44a6087800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:35.514 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=0 2024-09-12T17:51:35.514 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=1 2024-09-12T17:51:35.514 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=2 2024-09-12T17:51:35.514 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=3 2024-09-12T17:51:35.514 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=4 2024-09-12T17:51:35.514 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=5 2024-09-12T17:51:35.514 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=6 2024-09-12T17:51:35.514 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:51:35.429+0000 7f44a6087800 20 add_watcher() i=7 2024-09-12T17:51:35.514 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:51:35.429+0000 7f44a6087800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:35.514 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding auth protocol: cephx 2024-09-12T17:51:35.515 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding auth protocol: cephx 2024-09-12T17:51:35.515 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding auth protocol: cephx 2024-09-12T17:51:35.515 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: secure 2024-09-12T17:51:35.515 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: crc 2024-09-12T17:51:35.515 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: secure 2024-09-12T17:51:35.515 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: crc 2024-09-12T17:51:35.515 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: secure 2024-09-12T17:51:35.515 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: crc 2024-09-12T17:51:35.515 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:51:35.430+0000 7f4359fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:35.515 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: crc 2024-09-12T17:51:35.515 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: secure 2024-09-12T17:51:35.515 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: crc 2024-09-12T17:51:35.516 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: secure 2024-09-12T17:51:35.516 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: crc 2024-09-12T17:51:35.516 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: secure 2024-09-12T17:51:35.516 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:51:35.431+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.516 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:51:35.431+0000 7f44a6087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:35.516 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:51:35.431+0000 7f44a6087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:35.516 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command cache list hook 0x55852daeaba0 2024-09-12T17:51:35.516 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command cache inspect hook 0x55852daeaba0 2024-09-12T17:51:35.516 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command cache erase hook 0x55852daeaba0 2024-09-12T17:51:35.516 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command cache zap hook 0x55852daeaba0 2024-09-12T17:51:35.516 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 note: GC not initialized 2024-09-12T17:51:35.517 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:51:35.431+0000 7f4358fe1640 20 reqs_thread_entry: start 2024-09-12T17:51:35.517 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command sync trace show hook 0x7f448c002ee0 2024-09-12T17:51:35.517 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command sync trace history hook 0x7f448c002ee0 2024-09-12T17:51:35.517 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command sync trace active hook 0x7f448c002ee0 2024-09-12T17:51:35.517 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command sync trace active_short hook 0x7f448c002ee0 2024-09-12T17:51:35.517 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:51:35.431+0000 7f44a6087800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:35.517 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:51:35.431+0000 7f44a6087800 20 Filter name: none 2024-09-12T17:51:35.517 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:51:35.431+0000 7f42d27fc640 20 reqs_thread_entry: start 2024-09-12T17:51:35.517 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:51:35.431+0000 7f44a6087800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:51:35.517 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:51:35.431+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.517 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:51:35.432+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:35.517 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:51:35.518 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:51:35.518 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 : miss 2024-09-12T17:51:35.518 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:51:35.432+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.518 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:51:35.432+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:35.518 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:51:35.518 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:51:35.518 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:35.518 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:35.518 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 2024-09-12T17:51:35.518 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:51:35.435+0000 7f44a6087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:51:35.518 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:51:35.435+0000 7f44a6087800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:51:35.518 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:51:35.435+0000 7f44a6087800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:35.519 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:51:35.435+0000 7f44a6087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37, ofs0, ns] 2024-09-12T17:51:35.519 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:51:35.436+0000 7f4382ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94030485652352 notifier 7232 bl.length()=1007 2024-09-12T17:51:35.519 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:51:35.436+0000 7f4382ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:51:35.519 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:51:35.436+0000 7f4382ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:51:35.519 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:51:35.436+0000 7f4382ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:35.519 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:51:35.436+0000 7f44a6087800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): orig_sources= new_sources= 2024-09-12T17:51:35.519 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:51:35.436+0000 7f44a6087800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): potential sources added=[] removed=[] 2024-09-12T17:51:35.519 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:51:35.436+0000 7f44a6087800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): orig_dests= new_dests= 2024-09-12T17:51:35.519 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:51:35.436+0000 7f44a6087800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): potential dests added=[] removed=[] 2024-09-12T17:51:35.519 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:51:35.438+0000 7f44a6087800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f44a6087800 time 2024-09-12T17:51:35.438785+0000 2024-09-12T17:51:35.519 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:51:35.520 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.520 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:35.520 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f44a958c71a] 2024-09-12T17:51:35.520 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f44a958c8d8] 2024-09-12T17:51:35.520 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55852b6b2841] 2024-09-12T17:51:35.520 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd7490c) [0x55852bbc090c] 2024-09-12T17:51:35.520 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55852b6c250d] 2024-09-12T17:51:35.520 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:51:35.520 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f44a8229590] 2024-09-12T17:51:35.520 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:51:35.520 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:51:35.520 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.521 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:51:35.439+0000 7f44a6087800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:51:35.521 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f44a6087800 thread_name:radosgw-admin 2024-09-12T17:51:35.521 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.521 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:35.521 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f44a823e6f0] 2024-09-12T17:51:35.521 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f44a828b99c] 2024-09-12T17:51:35.521 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:51:35.521 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:51:35.521 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f44a958c774] 2024-09-12T17:51:35.521 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f44a958c8d8] 2024-09-12T17:51:35.521 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55852b6b2841] 2024-09-12T17:51:35.521 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd7490c) [0x55852bbc090c] 2024-09-12T17:51:35.522 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55852b6c250d] 2024-09-12T17:51:35.522 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:51:35.522 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f44a8229590] 2024-09-12T17:51:35.522 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:51:35.522 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:51:35.522 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:51:35.522 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.522 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:51:35.522 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:51:35.522 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:51:35.522 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:51:35.522 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:51:35.523 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:51:35.524 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:51:35.524 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:51:35.524 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:51:35.524 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:51:35.524 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:51:35.524 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:51:35.524 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:51:35.524 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:51:35.524 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:51:35.524 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:51:35.524 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:51:35.525 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:51:35.526 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:51:35.526 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:51:35.526 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:51:35.526 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:51:35.526 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:51:35.526 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:51:35.526 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:51:35.526 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:51:35.526 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:51:35.526 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:51:35.526 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:51:35.527 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:51:35.527 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:51:35.527 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:51:35.527 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:51:35.527 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:51:35.527 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:51:35.527 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:51:35.527 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:51:35.527 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:51:35.527 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:51:35.527 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:51:35.527 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:51:35.528 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:51:35.528 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:51:35.528 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:51:35.528 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:51:35.528 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:51:35.528 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:51:35.528 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:51:35.528 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:51:35.528 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:51:35.528 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:51:35.528 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:51:35.528 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:51:35.529 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:51:35.529 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:51:35.529 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:51:35.529 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:51:35.529 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:51:35.529 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:51:35.529 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:51:35.529 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:51:35.529 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:51:35.529 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:51:35.529 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:51:35.529 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:51:35.530 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:51:35.530 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:51:35.530 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:51:35.530 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:51:35.530 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:51:35.530 INFO:tasks.workunit.client.0.smithi107.stderr: 7f42d27fc640 / http_manager 2024-09-12T17:51:35.530 INFO:tasks.workunit.client.0.smithi107.stderr: 7f4358fe1640 / http_manager 2024-09-12T17:51:35.530 INFO:tasks.workunit.client.0.smithi107.stderr: 7f4359fe3640 / rgw_dt_lg_renew 2024-09-12T17:51:35.530 INFO:tasks.workunit.client.0.smithi107.stderr: 7f43817fa640 / ms_dispatch 2024-09-12T17:51:35.530 INFO:tasks.workunit.client.0.smithi107.stderr: 7f4382ffd640 / io_context_pool 2024-09-12T17:51:35.530 INFO:tasks.workunit.client.0.smithi107.stderr: 7f43897fa640 / ms_dispatch 2024-09-12T17:51:35.531 INFO:tasks.workunit.client.0.smithi107.stderr: 7f438bfff640 / ms_dispatch 2024-09-12T17:51:35.531 INFO:tasks.workunit.client.0.smithi107.stderr: 7f4391e0b640 / io_context_pool 2024-09-12T17:51:35.531 INFO:tasks.workunit.client.0.smithi107.stderr: 7f449b370640 / msgr-worker-2 2024-09-12T17:51:35.531 INFO:tasks.workunit.client.0.smithi107.stderr: 7f44a3b71640 / msgr-worker-1 2024-09-12T17:51:35.531 INFO:tasks.workunit.client.0.smithi107.stderr: 7f44a4372640 / msgr-worker-0 2024-09-12T17:51:35.531 INFO:tasks.workunit.client.0.smithi107.stderr: 7f44a4b73640 / io_context_pool 2024-09-12T17:51:35.531 INFO:tasks.workunit.client.0.smithi107.stderr: 7f44a6087800 / radosgw-admin 2024-09-12T17:51:35.531 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:51:35.531 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:51:35.531 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/log/ceph/ceph-client.admin.134229.log 2024-09-12T17:51:35.531 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:51:35.531 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:51:35.532 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:51:35.186+0000 7f4391e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:35.532 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:51:35.186+0000 7f44a6087800 10 monclient: get_monmap_and_config success 2024-09-12T17:51:35.532 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:51:35.186+0000 7f44a6087800 4 set_mon_vals no callback set 2024-09-12T17:51:35.532 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:51:35.186+0000 7f4391e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.532 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:51:35.186+0000 7f4391e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:51:35.532 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:51:35.186+0000 7f4391e0b640 10 monclient: dump: 2024-09-12T17:51:35.532 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.532 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.532 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.532 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.532 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.532 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.533 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.533 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.533 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.533 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.533 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:51:35.186+0000 7f44a6087800 10 monclient: shutdown 2024-09-12T17:51:35.533 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:51:35.186+0000 7f44a6087800 5 asok(0x55852d800730) unregister_commands rotate-key 2024-09-12T17:51:35.533 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:51:35.187+0000 7f44a6087800 10 monclient: build_initial_monmap 2024-09-12T17:51:35.533 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:51:35.187+0000 7f44a6087800 1 build_initial for_mkfs: 0 2024-09-12T17:51:35.533 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:51:35.187+0000 7f44a6087800 10 monclient: monmap: 2024-09-12T17:51:35.533 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:35.533 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:35.533 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:35.534 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:35.534 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:35.534 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.534 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:35.534 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:35.534 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:35.534 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.534 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding auth protocol: cephx 2024-09-12T17:51:35.534 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding auth protocol: cephx 2024-09-12T17:51:35.534 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding auth protocol: cephx 2024-09-12T17:51:35.534 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: secure 2024-09-12T17:51:35.535 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: crc 2024-09-12T17:51:35.535 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: secure 2024-09-12T17:51:35.535 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: crc 2024-09-12T17:51:35.535 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: secure 2024-09-12T17:51:35.535 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: crc 2024-09-12T17:51:35.535 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: crc 2024-09-12T17:51:35.535 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: secure 2024-09-12T17:51:35.535 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: crc 2024-09-12T17:51:35.535 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: secure 2024-09-12T17:51:35.535 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: crc 2024-09-12T17:51:35.535 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da27fc0) adding con mode: secure 2024-09-12T17:51:35.536 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:51:35.187+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.536 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:51:35.187+0000 7f44a6087800 1 librados: starting msgr at 2024-09-12T17:51:35.536 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:51:35.187+0000 7f44a6087800 1 librados: starting objecter 2024-09-12T17:51:35.536 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 asok(0x55852d800730) register_command objecter_requests hook 0x55852da26e20 2024-09-12T17:51:35.536 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:51:35.187+0000 7f44a6087800 1 librados: setting wanted keys 2024-09-12T17:51:35.536 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:51:35.187+0000 7f44a6087800 1 librados: calling monclient init 2024-09-12T17:51:35.536 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:51:35.187+0000 7f44a6087800 10 monclient: init 2024-09-12T17:51:35.536 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding auth protocol: cephx 2024-09-12T17:51:35.536 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding auth protocol: cephx 2024-09-12T17:51:35.536 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding auth protocol: cephx 2024-09-12T17:51:35.536 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: secure 2024-09-12T17:51:35.536 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: crc 2024-09-12T17:51:35.537 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: secure 2024-09-12T17:51:35.537 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: crc 2024-09-12T17:51:35.537 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: secure 2024-09-12T17:51:35.537 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: crc 2024-09-12T17:51:35.537 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: crc 2024-09-12T17:51:35.537 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: secure 2024-09-12T17:51:35.537 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: crc 2024-09-12T17:51:35.537 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: secure 2024-09-12T17:51:35.537 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: crc 2024-09-12T17:51:35.537 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:51:35.187+0000 7f44a6087800 5 AuthRegistry(0x55852da24e90) adding con mode: secure 2024-09-12T17:51:35.537 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:51:35.187+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.537 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:51:35.187+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.538 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:51:35.188+0000 7f44a6087800 5 asok(0x55852d800730) register_command rotate-key hook 0x55852da24fd8 2024-09-12T17:51:35.538 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:35.538 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:51:35.538 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-a con 0x55852d967c70 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:35.538 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-b con 0x55852d96df30 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:35.538 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-c con 0x55852d973250 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:35.538 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.538 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.538 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.538 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:35.538 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient(hunting): authenticate will time out at 2099.734115s 2024-09-12T17:51:35.539 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): get_auth_request con 0x55852d967c70 auth_method 0 2024-09-12T17:51:35.539 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.539 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.539 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.539 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): get_auth_request con 0x55852d973250 auth_method 0 2024-09-12T17:51:35.539 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.539 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.539 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.539 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.539 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.539 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.540 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.540 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.540 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:51:35.188+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.540 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): get_auth_request con 0x55852d96df30 auth_method 0 2024-09-12T17:51:35.540 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.540 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.540 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.540 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.540 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.540 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:51:35.188+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.540 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient(hunting): handle_auth_done global_id 7683 payload 824 2024-09-12T17:51:35.541 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient: _finish_hunting 0 2024-09-12T17:51:35.541 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:51:35.188+0000 7f44a3b71640 1 monclient: found mon.noname-a 2024-09-12T17:51:35.541 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:51:35.188+0000 7f44a3b71640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:51:35.541 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.541 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:51:35.541 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: dump: 2024-09-12T17:51:35.541 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.541 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.541 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.541 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.542 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.542 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.542 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.542 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.542 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.542 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.542 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: _finish_auth 0 2024-09-12T17:51:35.542 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:51:35.542 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:35.542 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.542 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:51:35.542 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:51:35.188+0000 7f438bfff640 10 monclient: dump: 2024-09-12T17:51:35.543 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.543 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.543 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.543 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.543 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.543 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.543 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.543 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.543 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.543 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.543 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:51:35.188+0000 7f44a6087800 5 monclient: authenticate success, global_id 7683 2024-09-12T17:51:35.543 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient: _renew_subs 2024-09-12T17:51:35.544 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:35.544 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:51:35.188+0000 7f4391e0b640 4 set_mon_vals no callback set 2024-09-12T17:51:35.544 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient: _renew_subs 2024-09-12T17:51:35.544 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:51:35.188+0000 7f44a6087800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:51:35.544 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:51:35.188+0000 7f44a6087800 1 librados: init done 2024-09-12T17:51:35.544 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:51:35.190+0000 7f438bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:51:35.544 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:51:35.190+0000 7f438bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:35.544 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:51:35.190+0000 7f438bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:35.544 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:51:35.190+0000 7f449b370640 10 monclient: get_auth_request con 0x7f438c076470 auth_method 0 2024-09-12T17:51:35.544 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:51:35.190+0000 7f44a4372640 10 monclient: get_auth_request con 0x55852da4d710 auth_method 0 2024-09-12T17:51:35.544 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:51:35.191+0000 7f44a3b71640 10 monclient: get_auth_request con 0x55852da6ffe0 auth_method 0 2024-09-12T17:51:35.545 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:51:35.192+0000 7f449b370640 10 monclient: get_auth_request con 0x55852da746b0 auth_method 0 2024-09-12T17:51:35.545 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:51:35.193+0000 7f44a6087800 10 monclient: build_initial_monmap 2024-09-12T17:51:35.545 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:51:35.193+0000 7f44a6087800 1 build_initial for_mkfs: 0 2024-09-12T17:51:35.545 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:51:35.193+0000 7f44a6087800 10 monclient: monmap: 2024-09-12T17:51:35.545 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:35.545 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:35.545 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:35.545 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:35.545 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:35.545 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.545 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:35.545 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:35.546 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:35.546 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.546 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding auth protocol: cephx 2024-09-12T17:51:35.546 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding auth protocol: cephx 2024-09-12T17:51:35.546 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding auth protocol: cephx 2024-09-12T17:51:35.546 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: secure 2024-09-12T17:51:35.546 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: crc 2024-09-12T17:51:35.546 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: secure 2024-09-12T17:51:35.546 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: crc 2024-09-12T17:51:35.546 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: secure 2024-09-12T17:51:35.547 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: crc 2024-09-12T17:51:35.547 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: crc 2024-09-12T17:51:35.547 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: secure 2024-09-12T17:51:35.547 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: crc 2024-09-12T17:51:35.547 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: secure 2024-09-12T17:51:35.547 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: crc 2024-09-12T17:51:35.547 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:51:35.193+0000 7f44a6087800 5 AuthRegistry(0x55852da79530) adding con mode: secure 2024-09-12T17:51:35.547 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:51:35.194+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.547 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 asok(0x55852d800730) register_command objecter_requests cmddesc objecter_requests hook 0x55852da7cf20 EEXIST 2024-09-12T17:51:35.547 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient: init 2024-09-12T17:51:35.547 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding auth protocol: cephx 2024-09-12T17:51:35.547 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding auth protocol: cephx 2024-09-12T17:51:35.548 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding auth protocol: cephx 2024-09-12T17:51:35.548 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: secure 2024-09-12T17:51:35.548 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: crc 2024-09-12T17:51:35.548 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: secure 2024-09-12T17:51:35.548 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: crc 2024-09-12T17:51:35.548 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: secure 2024-09-12T17:51:35.548 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: crc 2024-09-12T17:51:35.548 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: crc 2024-09-12T17:51:35.548 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: secure 2024-09-12T17:51:35.548 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: crc 2024-09-12T17:51:35.548 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: secure 2024-09-12T17:51:35.549 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: crc 2024-09-12T17:51:35.549 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 AuthRegistry(0x55852da77bb8) adding con mode: secure 2024-09-12T17:51:35.549 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:51:35.194+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.549 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:51:35.194+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.549 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:51:35.194+0000 7f44a6087800 5 asok(0x55852d800730) register_command rotate-key cmddesc rotate-key hook 0x55852da77d00 EEXIST 2024-09-12T17:51:35.549 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:35.549 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:51:35.549 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-c con 0x55852daa0c10 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:35.549 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-b con 0x55852daa2ee0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:35.549 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-a con 0x55852da9f3e0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:35.549 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.549 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.550 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.550 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:35.550 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:51:35.194+0000 7f44a6087800 10 monclient(hunting): authenticate will time out at 2099.740796s 2024-09-12T17:51:35.550 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): get_auth_request con 0x55852daa0c10 auth_method 0 2024-09-12T17:51:35.550 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.550 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.550 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.550 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): get_auth_request con 0x55852da9f3e0 auth_method 0 2024-09-12T17:51:35.550 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.550 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.550 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.550 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.551 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.551 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:51:35.194+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.551 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.551 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.551 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:51:35.194+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.551 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:51:35.195+0000 7f44a3b71640 10 monclient(hunting): handle_auth_done global_id 7226 payload 824 2024-09-12T17:51:35.551 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:51:35.195+0000 7f44a3b71640 10 monclient: _finish_hunting 0 2024-09-12T17:51:35.551 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:51:35.195+0000 7f44a3b71640 1 monclient: found mon.noname-c 2024-09-12T17:51:35.551 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:51:35.195+0000 7f44a3b71640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.552 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.552 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:51:35.552 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: dump: 2024-09-12T17:51:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.552 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: _finish_auth 0 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: _check_auth_tickets 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:51:35.195+0000 7f43897fa640 10 monclient: dump: 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.553 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.554 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.554 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.554 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.554 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.554 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.554 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:51:35.195+0000 7f44a6087800 5 monclient: authenticate success, global_id 7226 2024-09-12T17:51:35.556 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:51:35.195+0000 7f44a6087800 10 monclient: _renew_subs 2024-09-12T17:51:35.556 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:51:35.195+0000 7f44a6087800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.556 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:51:35.195+0000 7f44a4b73640 4 set_mon_vals no callback set 2024-09-12T17:51:35.556 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:51:35.195+0000 7f44a6087800 10 monclient: _renew_subs 2024-09-12T17:51:35.556 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:51:35.195+0000 7f44a6087800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.556 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:51:35.196+0000 7f43897fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:51:35.557 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:51:35.196+0000 7f43897fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:35.557 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:51:35.196+0000 7f43897fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:35.557 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:51:35.197+0000 7f44a6087800 10 monclient: get_monmap_and_config 2024-09-12T17:51:35.557 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:51:35.197+0000 7f44a6087800 10 monclient: build_initial_monmap 2024-09-12T17:51:35.557 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:51:35.197+0000 7f44a6087800 1 build_initial for_mkfs: 0 2024-09-12T17:51:35.557 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:51:35.197+0000 7f44a6087800 10 monclient: monmap: 2024-09-12T17:51:35.557 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:35.557 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:35.557 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:35.557 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:35.557 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:35.557 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.558 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:35.558 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:35.558 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:35.558 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.558 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding auth protocol: cephx 2024-09-12T17:51:35.558 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding auth protocol: cephx 2024-09-12T17:51:35.558 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding auth protocol: cephx 2024-09-12T17:51:35.558 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: secure 2024-09-12T17:51:35.558 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: crc 2024-09-12T17:51:35.558 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: secure 2024-09-12T17:51:35.558 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: crc 2024-09-12T17:51:35.559 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: secure 2024-09-12T17:51:35.559 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: crc 2024-09-12T17:51:35.559 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: crc 2024-09-12T17:51:35.559 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: secure 2024-09-12T17:51:35.559 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: crc 2024-09-12T17:51:35.559 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: secure 2024-09-12T17:51:35.559 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: crc 2024-09-12T17:51:35.559 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x55852dac0440) adding con mode: secure 2024-09-12T17:51:35.559 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:51:35.197+0000 7f449b370640 10 monclient: get_auth_request con 0x7f437c076380 auth_method 0 2024-09-12T17:51:35.559 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:51:35.197+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.559 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:51:35.197+0000 7f44a6087800 10 monclient: init 2024-09-12T17:51:35.559 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding auth protocol: cephx 2024-09-12T17:51:35.560 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding auth protocol: cephx 2024-09-12T17:51:35.560 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding auth protocol: cephx 2024-09-12T17:51:35.560 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: secure 2024-09-12T17:51:35.560 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: crc 2024-09-12T17:51:35.560 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: secure 2024-09-12T17:51:35.560 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: crc 2024-09-12T17:51:35.560 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: secure 2024-09-12T17:51:35.560 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: crc 2024-09-12T17:51:35.560 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: crc 2024-09-12T17:51:35.560 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: secure 2024-09-12T17:51:35.560 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: crc 2024-09-12T17:51:35.561 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: secure 2024-09-12T17:51:35.561 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: crc 2024-09-12T17:51:35.561 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:51:35.197+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb38f0) adding con mode: secure 2024-09-12T17:51:35.561 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:51:35.197+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.561 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:51:35.198+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.561 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:51:35.198+0000 7f44a6087800 5 asok(0x55852d800730) register_command rotate-key cmddesc rotate-key hook 0x7ffc4cfb3a38 EEXIST 2024-09-12T17:51:35.561 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:35.561 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:51:35.561 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-a con 0x55852daf49c0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:35.561 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-c con 0x55852dae5530 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:35.561 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-b con 0x55852daefdf0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:35.562 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.562 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.562 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.562 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:35.562 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient(hunting): authenticate will time out at 2099.744264s 2024-09-12T17:51:35.562 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): get_auth_request con 0x55852dae5530 auth_method 0 2024-09-12T17:51:35.562 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.562 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.562 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.562 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): get_auth_request con 0x55852daf49c0 auth_method 0 2024-09-12T17:51:35.562 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.562 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.563 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.563 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.563 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.563 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.563 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): get_auth_request con 0x55852daefdf0 auth_method 0 2024-09-12T17:51:35.563 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.563 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.563 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.563 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.563 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.563 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:51:35.198+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.563 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.564 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.564 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:51:35.198+0000 7f44a4372640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.564 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient(hunting): handle_auth_done global_id 7229 payload 274 2024-09-12T17:51:35.564 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient: _finish_hunting 0 2024-09-12T17:51:35.564 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:51:35.198+0000 7f449b370640 1 monclient: found mon.noname-c 2024-09-12T17:51:35.564 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:51:35.198+0000 7f449b370640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.564 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.564 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:51:35.564 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: dump: 2024-09-12T17:51:35.564 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.564 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.565 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.565 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.565 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.565 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.565 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.565 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.565 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.565 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.565 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: _finish_auth 0 2024-09-12T17:51:35.565 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:51:35.565 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:51:35.198+0000 7f44a6087800 5 monclient: authenticate success, global_id 7229 2024-09-12T17:51:35.565 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:35.566 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:51:35.198+0000 7f44a6087800 10 monclient: get_monmap_and_config success 2024-09-12T17:51:35.566 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:51:35.198+0000 7f44a6087800 4 set_mon_vals no callback set 2024-09-12T17:51:35.566 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.566 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:51:35.566 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:51:35.198+0000 7f4382ffd640 10 monclient: dump: 2024-09-12T17:51:35.566 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.566 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.566 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.566 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.566 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.566 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.566 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:51:35.199+0000 7f44a6087800 10 monclient: shutdown 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:51:35.199+0000 7f44a6087800 10 monclient: build_initial_monmap 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:51:35.199+0000 7f44a6087800 1 build_initial for_mkfs: 0 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:51:35.199+0000 7f44a6087800 10 monclient: monmap: 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:51:35.567 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.568 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:51:35.568 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:51:35.568 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:51:35.568 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.568 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding auth protocol: cephx 2024-09-12T17:51:35.568 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding auth protocol: cephx 2024-09-12T17:51:35.568 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding auth protocol: cephx 2024-09-12T17:51:35.568 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: secure 2024-09-12T17:51:35.568 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: crc 2024-09-12T17:51:35.568 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: secure 2024-09-12T17:51:35.568 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: crc 2024-09-12T17:51:35.569 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: secure 2024-09-12T17:51:35.569 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: crc 2024-09-12T17:51:35.569 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: crc 2024-09-12T17:51:35.569 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: secure 2024-09-12T17:51:35.569 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: crc 2024-09-12T17:51:35.569 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: secure 2024-09-12T17:51:35.569 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: crc 2024-09-12T17:51:35.569 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dac5150) adding con mode: secure 2024-09-12T17:51:35.569 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:51:35.199+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.569 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:51:35.199+0000 7f44a6087800 1 librados: starting msgr at 2024-09-12T17:51:35.569 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:51:35.199+0000 7f44a6087800 1 librados: starting objecter 2024-09-12T17:51:35.569 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 asok(0x55852d800730) register_command objecter_requests cmddesc objecter_requests hook 0x55852daa2d50 EEXIST 2024-09-12T17:51:35.570 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:51:35.199+0000 7f44a6087800 1 librados: setting wanted keys 2024-09-12T17:51:35.570 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:51:35.199+0000 7f44a6087800 1 librados: calling monclient init 2024-09-12T17:51:35.570 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:51:35.199+0000 7f44a6087800 10 monclient: init 2024-09-12T17:51:35.570 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding auth protocol: cephx 2024-09-12T17:51:35.570 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding auth protocol: cephx 2024-09-12T17:51:35.570 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding auth protocol: cephx 2024-09-12T17:51:35.570 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: secure 2024-09-12T17:51:35.570 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: crc 2024-09-12T17:51:35.570 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: secure 2024-09-12T17:51:35.570 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: crc 2024-09-12T17:51:35.570 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: secure 2024-09-12T17:51:35.570 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: crc 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: crc 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: secure 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: crc 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: secure 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: crc 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:51:35.199+0000 7f44a6087800 5 AuthRegistry(0x55852dab89c0) adding con mode: secure 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:51:35.200+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:51:35.200+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:51:35.200+0000 7f44a6087800 5 asok(0x55852d800730) register_command rotate-key cmddesc rotate-key hook 0x55852dab8b08 EEXIST 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient: _reopen_session rank -1 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-a con 0x55852dae5530 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:51:35.571 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-c con 0x55852daefdf0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:51:35.572 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): picked mon.noname-b con 0x55852daf49c0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:51:35.572 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.572 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.572 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): start opening mon connection 2024-09-12T17:51:35.572 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): _renew_subs 2024-09-12T17:51:35.572 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:51:35.200+0000 7f44a6087800 10 monclient(hunting): authenticate will time out at 2099.746476s 2024-09-12T17:51:35.572 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): get_auth_request con 0x55852dae5530 auth_method 0 2024-09-12T17:51:35.572 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.572 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.572 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.572 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): get_auth_request con 0x55852daefdf0 auth_method 0 2024-09-12T17:51:35.573 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.573 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.573 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.573 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.573 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.573 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.573 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:51:35.573 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:51:35.573 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:51:35.200+0000 7f44a3b71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:51:35.573 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:51:35.200+0000 7f44a4372640 10 monclient(hunting): get_auth_request con 0x55852daf49c0 auth_method 0 2024-09-12T17:51:35.573 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:51:35.200+0000 7f44a4372640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:51:35.573 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:51:35.200+0000 7f44a4372640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:51:35.574 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:51:35.200+0000 7f44a4372640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:51:35.574 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient(hunting): handle_auth_done global_id 7232 payload 824 2024-09-12T17:51:35.574 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient: _finish_hunting 0 2024-09-12T17:51:35.574 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:51:35.200+0000 7f449b370640 1 monclient: found mon.noname-c 2024-09-12T17:51:35.574 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:51:35.200+0000 7f449b370640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.574 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.574 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:51:35.574 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: dump: 2024-09-12T17:51:35.574 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.574 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.574 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.574 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: _finish_auth 0 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: _check_auth_tickets 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:51:35.201+0000 7f43817fa640 10 monclient: dump: 2024-09-12T17:51:35.575 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:51:35.576 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:51:35.576 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.576 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:51:35.576 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:51:35.576 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:51:35.576 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:51:35.576 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:51:35.576 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:51:35.576 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.576 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:51:35.201+0000 7f44a6087800 5 monclient: authenticate success, global_id 7232 2024-09-12T17:51:35.576 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:51:35.201+0000 7f4382ffd640 4 set_mon_vals no callback set 2024-09-12T17:51:35.577 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:51:35.201+0000 7f44a6087800 10 monclient: _renew_subs 2024-09-12T17:51:35.577 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:51:35.201+0000 7f44a6087800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.577 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:51:35.201+0000 7f44a6087800 10 monclient: _renew_subs 2024-09-12T17:51:35.577 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:51:35.201+0000 7f44a6087800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.577 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:51:35.201+0000 7f44a6087800 1 librados: init done 2024-09-12T17:51:35.577 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:51:35.201+0000 7f44a6087800 5 asok(0x55852d800730) register_command cr dump hook 0x55852dae2bb8 2024-09-12T17:51:35.577 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:51:35.202+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.577 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:51:35.203+0000 7f43817fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:51:35.577 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:51:35.203+0000 7f43817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:35.577 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:51:35.203+0000 7f43817fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:51:35.577 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:51:35.203+0000 7f44a3b71640 10 monclient: get_auth_request con 0x7f436c076640 auth_method 0 2024-09-12T17:51:35.577 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:51:35.203+0000 7f44a4372640 10 monclient: get_auth_request con 0x55852db0f1c0 auth_method 0 2024-09-12T17:51:35.578 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.578 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 realm 2024-09-12T17:51:35.578 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.578 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.578 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:51:35.204+0000 7f44a6087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:35.578 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.578 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.578 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:51:35.204+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.578 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:51:35.204+0000 7f44a3b71640 10 monclient: get_auth_request con 0x55852db13420 auth_method 0 2024-09-12T17:51:35.578 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:51:35.205+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:35.578 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:51:35.205+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.578 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:51:35.205+0000 7f449b370640 10 monclient: get_auth_request con 0x55852db16c80 auth_method 0 2024-09-12T17:51:35.579 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:51:35.205+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:35.579 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:51:35.205+0000 7f44a6087800 20 searching for the correct realm 2024-09-12T17:51:35.579 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:51:35.206+0000 7f44a4372640 10 monclient: get_auth_request con 0x55852db1ba20 auth_method 0 2024-09-12T17:51:35.579 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:51:35.206+0000 7f44a3b71640 10 monclient: get_auth_request con 0x7f449c02c410 auth_method 0 2024-09-12T17:51:35.579 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:51:35.207+0000 7f449b370640 10 monclient: get_auth_request con 0x7f448c06cb80 auth_method 0 2024-09-12T17:51:35.579 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:51:35.208+0000 7f449b370640 0 -- 172.21.15.107:0/4081348405 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f448c06cb80 msgr2=0x7f448c0a2a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:35.579 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:51:35.208+0000 7f43817fa640 1 client.7232.objecter ms_handle_reset 0x7f448c06cb80 session 0x7f448c06c090 osd.4 2024-09-12T17:51:35.579 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:51:35.208+0000 7f43817fa640 10 monclient: _renew_subs 2024-09-12T17:51:35.579 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:51:35.208+0000 7f43817fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:51:35.579 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:51:35.208+0000 7f449b370640 10 monclient: get_auth_request con 0x7f436c086d70 auth_method 0 2024-09-12T17:51:35.579 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:51:35.209+0000 7f44a4372640 10 monclient: get_auth_request con 0x7f448c075670 auth_method 0 2024-09-12T17:51:35.579 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:51:35.211+0000 7f44a3b71640 10 monclient: get_auth_request con 0x7f448c06dba0 auth_method 0 2024-09-12T17:51:35.580 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:51:35.211+0000 7f44a3b71640 0 -- 172.21.15.107:0/4081348405 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f448c06dba0 msgr2=0x7f448c092520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:35.580 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:51:35.413+0000 7f44a3b71640 10 monclient: get_auth_request con 0x7f448c06dba0 auth_method 0 2024-09-12T17:51:35.580 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:35.580 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:35.580 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:35.580 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:35.580 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:35.580 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:35.580 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:51:35.417+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.580 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.580 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.581 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:35.581 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.581 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:35.581 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 zone default found 2024-09-12T17:51:35.581 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:51:35.418+0000 7f44a6087800 4 Realm: () 2024-09-12T17:51:35.581 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:51:35.418+0000 7f44a6087800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:35.581 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:51:35.418+0000 7f44a6087800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:35.581 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:51:35.418+0000 7f44a6087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:35.581 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 zonegroup default 2024-09-12T17:51:35.581 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.581 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.581 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:51:35.418+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.582 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:51:35.419+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.582 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:51:35.419+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.582 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:51:35.419+0000 7f44a6087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.582 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:51:35.419+0000 7f44a6087800 20 started sync module instance, tier type = 2024-09-12T17:51:35.582 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:51:35.419+0000 7f44a6087800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:35.582 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=0 2024-09-12T17:51:35.582 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=1 2024-09-12T17:51:35.582 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=2 2024-09-12T17:51:35.582 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=3 2024-09-12T17:51:35.582 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=4 2024-09-12T17:51:35.582 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=5 2024-09-12T17:51:35.582 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:51:35.428+0000 7f44a6087800 20 add_watcher() i=6 2024-09-12T17:51:35.583 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:51:35.429+0000 7f44a6087800 20 add_watcher() i=7 2024-09-12T17:51:35.583 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:51:35.429+0000 7f44a6087800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:35.583 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding auth protocol: cephx 2024-09-12T17:51:35.583 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding auth protocol: cephx 2024-09-12T17:51:35.583 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding auth protocol: cephx 2024-09-12T17:51:35.583 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: secure 2024-09-12T17:51:35.583 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: crc 2024-09-12T17:51:35.583 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: secure 2024-09-12T17:51:35.583 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: crc 2024-09-12T17:51:35.583 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: secure 2024-09-12T17:51:35.583 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: crc 2024-09-12T17:51:35.583 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:51:35.430+0000 7f4359fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:35.584 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: crc 2024-09-12T17:51:35.584 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: secure 2024-09-12T17:51:35.584 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: crc 2024-09-12T17:51:35.584 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: secure 2024-09-12T17:51:35.584 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: crc 2024-09-12T17:51:35.584 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:51:35.430+0000 7f44a6087800 5 AuthRegistry(0x7ffc4cfb3dc0) adding con mode: secure 2024-09-12T17:51:35.584 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:51:35.431+0000 7f44a6087800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:51:35.584 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:51:35.431+0000 7f44a6087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:35.584 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:51:35.431+0000 7f44a6087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:35.584 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command cache list hook 0x55852daeaba0 2024-09-12T17:51:35.584 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command cache inspect hook 0x55852daeaba0 2024-09-12T17:51:35.584 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command cache erase hook 0x55852daeaba0 2024-09-12T17:51:35.585 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command cache zap hook 0x55852daeaba0 2024-09-12T17:51:35.585 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 note: GC not initialized 2024-09-12T17:51:35.585 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:51:35.431+0000 7f4358fe1640 20 reqs_thread_entry: start 2024-09-12T17:51:35.585 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command sync trace show hook 0x7f448c002ee0 2024-09-12T17:51:35.585 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command sync trace history hook 0x7f448c002ee0 2024-09-12T17:51:35.585 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command sync trace active hook 0x7f448c002ee0 2024-09-12T17:51:35.585 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:51:35.431+0000 7f44a6087800 5 asok(0x55852d800730) register_command sync trace active_short hook 0x7f448c002ee0 2024-09-12T17:51:35.585 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:51:35.431+0000 7f44a6087800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:35.585 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:51:35.431+0000 7f44a6087800 20 Filter name: none 2024-09-12T17:51:35.585 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:51:35.431+0000 7f42d27fc640 20 reqs_thread_entry: start 2024-09-12T17:51:35.585 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:51:35.431+0000 7f44a6087800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:51:35.585 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:51:35.431+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.586 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:51:35.432+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:35.586 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:51:35.586 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:51:35.586 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 : miss 2024-09-12T17:51:35.586 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:51:35.432+0000 7f44a6087800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.586 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:51:35.432+0000 7f44a6087800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:51:35.586 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:51:35.586 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:51:35.586 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:35.586 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:35.586 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:51:35.432+0000 7f44a6087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 2024-09-12T17:51:35.586 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:51:35.435+0000 7f44a6087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:51:35.587 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:51:35.435+0000 7f44a6087800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:51:35.587 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:51:35.435+0000 7f44a6087800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:35.587 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:51:35.435+0000 7f44a6087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37, ofs0, ns] 2024-09-12T17:51:35.587 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:51:35.436+0000 7f4382ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94030485652352 notifier 7232 bl.length()=1007 2024-09-12T17:51:35.587 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:51:35.436+0000 7f4382ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:51:35.587 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:51:35.436+0000 7f4382ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:51:35.587 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:51:35.436+0000 7f4382ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:35.587 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:51:35.436+0000 7f44a6087800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): orig_sources= new_sources= 2024-09-12T17:51:35.587 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:51:35.436+0000 7f44a6087800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): potential sources added=[] removed=[] 2024-09-12T17:51:35.587 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:51:35.436+0000 7f44a6087800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): orig_dests= new_dests= 2024-09-12T17:51:35.587 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:51:35.436+0000 7f44a6087800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): potential dests added=[] removed=[] 2024-09-12T17:51:35.587 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:51:35.438+0000 7f44a6087800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f44a6087800 time 2024-09-12T17:51:35.438785+0000 2024-09-12T17:51:35.588 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:51:35.588 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.588 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:35.588 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f44a958c71a] 2024-09-12T17:51:35.588 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f44a958c8d8] 2024-09-12T17:51:35.588 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55852b6b2841] 2024-09-12T17:51:35.588 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd7490c) [0x55852bbc090c] 2024-09-12T17:51:35.588 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55852b6c250d] 2024-09-12T17:51:35.588 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:51:35.588 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f44a8229590] 2024-09-12T17:51:35.588 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:51:35.439+0000 7f44a6087800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f44a6087800 thread_name:radosgw-admin 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f44a823e6f0] 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f44a828b99c] 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f44a958c774] 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f44a958c8d8] 2024-09-12T17:51:35.589 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55852b6b2841] 2024-09-12T17:51:35.590 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd7490c) [0x55852bbc090c] 2024-09-12T17:51:35.590 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55852b6c250d] 2024-09-12T17:51:35.590 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:51:35.590 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f44a8229590] 2024-09-12T17:51:35.590 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:51:35.590 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:51:35.590 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:51:35.590 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.590 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:51:35.590 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:51:35.590 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:51:35.591 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:51:35.591 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:51:35.591 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:51:35.591 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:51:35.591 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:51:35.591 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:51:35.591 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:51:35.591 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:51:35.591 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:51:35.591 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:51:35.591 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:51:35.591 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:51:35.592 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:51:35.592 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:51:35.592 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:51:35.592 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:51:35.592 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:51:35.592 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:51:35.592 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:51:35.592 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:51:35.592 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:51:35.592 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:51:35.592 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:51:35.592 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:51:35.593 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:51:35.593 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:51:35.593 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:51:35.593 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:51:35.593 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:51:35.593 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:51:35.593 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:51:35.593 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:51:35.593 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:51:35.593 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:51:35.593 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:51:35.594 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:51:35.595 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:51:35.595 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:51:35.595 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:51:35.595 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:51:35.595 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:51:35.595 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:51:35.595 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:51:35.595 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:51:35.595 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:51:35.595 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:51:35.595 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:51:35.595 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:51:35.596 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:51:35.596 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:51:35.596 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:51:35.596 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:51:35.596 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:51:35.596 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:51:35.596 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:51:35.596 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:51:35.596 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:51:35.596 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:51:35.596 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:51:35.596 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:51:35.597 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:51:35.598 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:51:35.598 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:51:35.598 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:51:35.598 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:51:35.598 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:51:35.598 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:51:35.598 INFO:tasks.workunit.client.0.smithi107.stderr: 7f42d27fc640 / http_manager 2024-09-12T17:51:35.598 INFO:tasks.workunit.client.0.smithi107.stderr: 7f4358fe1640 / http_manager 2024-09-12T17:51:35.598 INFO:tasks.workunit.client.0.smithi107.stderr: 7f4359fe3640 / rgw_dt_lg_renew 2024-09-12T17:51:35.598 INFO:tasks.workunit.client.0.smithi107.stderr: 7f43817fa640 / ms_dispatch 2024-09-12T17:51:35.598 INFO:tasks.workunit.client.0.smithi107.stderr: 7f4382ffd640 / io_context_pool 2024-09-12T17:51:35.598 INFO:tasks.workunit.client.0.smithi107.stderr: 7f43897fa640 / ms_dispatch 2024-09-12T17:51:35.599 INFO:tasks.workunit.client.0.smithi107.stderr: 7f438bfff640 / ms_dispatch 2024-09-12T17:51:35.599 INFO:tasks.workunit.client.0.smithi107.stderr: 7f4391e0b640 / io_context_pool 2024-09-12T17:51:35.599 INFO:tasks.workunit.client.0.smithi107.stderr: 7f449b370640 / msgr-worker-2 2024-09-12T17:51:35.599 INFO:tasks.workunit.client.0.smithi107.stderr: 7f44a3b71640 / msgr-worker-1 2024-09-12T17:51:35.599 INFO:tasks.workunit.client.0.smithi107.stderr: 7f44a4372640 / msgr-worker-0 2024-09-12T17:51:35.599 INFO:tasks.workunit.client.0.smithi107.stderr: 7f44a4b73640 / io_context_pool 2024-09-12T17:51:35.599 INFO:tasks.workunit.client.0.smithi107.stderr: 7f44a6087800 / radosgw-admin 2024-09-12T17:51:35.599 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:51:35.599 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:51:35.599 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:51:35.440481Z_5861326e-3273-4120-8778-958f312e5b1c/log 2024-09-12T17:51:35.599 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:51:35.599 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:51:35.605 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:35.606 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:35.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.514+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.515+0000 7fb692324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.515+0000 7fb692324800 20 realm 2024-09-12T17:51:35.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.515+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.516+0000 7fb692324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.516+0000 7fb692324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:35.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.516+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.516+0000 7fb692324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.516+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.517+0000 7fb692324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:35.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.517+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.517+0000 7fb692324800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:35.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.517+0000 7fb692324800 20 searching for the correct realm 2024-09-12T17:51:35.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.520+0000 7fb68e703640 0 -- 172.21.15.107:0/1606276074 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x555a86e22b40 msgr2=0x555a86e24fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:35.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.523+0000 7fb68df02640 0 -- 172.21.15.107:0/1606276074 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fb6780a4040 msgr2=0x7fb6780a4930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:35.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.527+0000 7fb692324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:35.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.527+0000 7fb692324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:35.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.527+0000 7fb692324800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:35.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.527+0000 7fb692324800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:35.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.527+0000 7fb692324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.527+0000 7fb692324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.527+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.527+0000 7fb692324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.527+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.527+0000 7fb692324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.527+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 20 zone default found 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 4 Realm: () 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:35.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 20 zonegroup default 2024-09-12T17:51:35.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 20 started sync module instance, tier type = 2024-09-12T17:51:35.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.528+0000 7fb692324800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:35.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.537+0000 7fb692324800 20 add_watcher() i=0 2024-09-12T17:51:35.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.537+0000 7fb692324800 20 add_watcher() i=1 2024-09-12T17:51:35.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.537+0000 7fb692324800 20 add_watcher() i=2 2024-09-12T17:51:35.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.537+0000 7fb692324800 20 add_watcher() i=3 2024-09-12T17:51:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.537+0000 7fb692324800 20 add_watcher() i=4 2024-09-12T17:51:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.537+0000 7fb692324800 20 add_watcher() i=5 2024-09-12T17:51:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.537+0000 7fb692324800 20 add_watcher() i=6 2024-09-12T17:51:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.538+0000 7fb692324800 20 add_watcher() i=7 2024-09-12T17:51:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.538+0000 7fb692324800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.540+0000 7fb53f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.540+0000 7fb692324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.540+0000 7fb692324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.540+0000 7fb692324800 5 note: GC not initialized 2024-09-12T17:51:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.540+0000 7fb53e7fc640 20 reqs_thread_entry: start 2024-09-12T17:51:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.540+0000 7fb692324800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.540+0000 7fb692324800 20 Filter name: none 2024-09-12T17:51:35.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.540+0000 7fb4affff640 20 reqs_thread_entry: start 2024-09-12T17:51:35.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.540+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.541+0000 7fb692324800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:35.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.541+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.541+0000 7fb692324800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:51:35.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.541+0000 7fb692324800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:35.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.541+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.542+0000 7fb692324800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:35.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.542+0000 7fb692324800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.542+0000 7fb692324800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:51:35.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.542+0000 7fb692324800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:51:35.611 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.543+0000 7fb53f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:35.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.545+0000 7fb692324800 20 remove_watcher() i=0 2024-09-12T17:51:35.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.545+0000 7fb692324800 2 removed watcher, disabling cache 2024-09-12T17:51:35.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.546+0000 7fb692324800 20 remove_watcher() i=1 2024-09-12T17:51:35.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.547+0000 7fb692324800 20 remove_watcher() i=2 2024-09-12T17:51:35.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.548+0000 7fb692324800 20 remove_watcher() i=3 2024-09-12T17:51:35.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.549+0000 7fb692324800 20 remove_watcher() i=4 2024-09-12T17:51:35.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.550+0000 7fb692324800 20 remove_watcher() i=5 2024-09-12T17:51:35.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.551+0000 7fb692324800 20 remove_watcher() i=6 2024-09-12T17:51:35.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.552+0000 7fb692324800 20 remove_watcher() i=7 2024-09-12T17:51:35.612 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.612 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:51:35.612 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-logrecord-writes id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:51:35.613 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:51:35.615 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:51:35.646 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:51:35.646 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:51:35.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.681+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.682+0000 7f960c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.682+0000 7f960c92c800 20 realm 2024-09-12T17:51:35.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.682+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.683+0000 7f960c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.683+0000 7f960c92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:51:35.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.683+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.683+0000 7f960c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.686 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.683+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.684+0000 7f960c92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:35.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.684+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.684+0000 7f960c92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:51:35.687 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.684+0000 7f960c92c800 20 searching for the correct realm 2024-09-12T17:51:35.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.687+0000 7f960853e640 0 -- 172.21.15.107:0/2760589593 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f960006d0d0 msgr2=0x7f9600088ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:35.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.690+0000 7f960853e640 0 -- 172.21.15.107:0/2760589593 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f95f004d040 msgr2=0x7f95f004d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:51:35.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.695+0000 7f960c92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:51:35.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.695+0000 7f960c92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:51:35.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.695+0000 7f960c92c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:51:35.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.695+0000 7f960c92c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:51:35.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.695+0000 7f960c92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:51:35.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.695+0000 7f960c92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:51:35.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.695+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.696 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.695+0000 7f960c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.697 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.695+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.695+0000 7f960c92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:51:35.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.695+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.696+0000 7f960c92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:51:35.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.696+0000 7f960c92c800 20 zone default found 2024-09-12T17:51:35.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.696+0000 7f960c92c800 4 Realm: () 2024-09-12T17:51:35.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.696+0000 7f960c92c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:51:35.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.696+0000 7f960c92c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:51:35.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.696+0000 7f960c92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:51:35.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.696+0000 7f960c92c800 20 zonegroup default 2024-09-12T17:51:35.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.696+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.696+0000 7f960c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.696+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.697+0000 7f960c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.697+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.697+0000 7f960c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:51:35.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.697+0000 7f960c92c800 20 started sync module instance, tier type = 2024-09-12T17:51:35.699 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.697+0000 7f960c92c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:51:35.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.705+0000 7f960c92c800 20 add_watcher() i=0 2024-09-12T17:51:35.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.705+0000 7f960c92c800 20 add_watcher() i=1 2024-09-12T17:51:35.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.705+0000 7f960c92c800 20 add_watcher() i=2 2024-09-12T17:51:35.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.705+0000 7f960c92c800 20 add_watcher() i=3 2024-09-12T17:51:35.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.705+0000 7f960c92c800 20 add_watcher() i=4 2024-09-12T17:51:35.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.705+0000 7f960c92c800 20 add_watcher() i=5 2024-09-12T17:51:35.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.705+0000 7f960c92c800 20 add_watcher() i=6 2024-09-12T17:51:35.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.706+0000 7f960c92c800 20 add_watcher() i=7 2024-09-12T17:51:35.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.706+0000 7f960c92c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:51:35.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.707+0000 7f94befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:35.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.708+0000 7f960c92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:51:35.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.708+0000 7f960c92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:51:35.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.708+0000 7f960c92c800 5 note: GC not initialized 2024-09-12T17:51:35.709 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.708+0000 7f94bdfdb640 20 reqs_thread_entry: start 2024-09-12T17:51:35.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.708+0000 7f960c92c800 20 init_complete bucket index max shards: 1 2024-09-12T17:51:35.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.708+0000 7f960c92c800 20 Filter name: none 2024-09-12T17:51:35.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.708+0000 7f942f7fe640 20 reqs_thread_entry: start 2024-09-12T17:51:35.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.708+0000 7f960c92c800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:51:35.710 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.708+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.709+0000 7f960c92c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:51:35.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.709+0000 7f960c92c800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:51:35.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.709+0000 7f960c92c800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:51:35.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.709+0000 7f960c92c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 : miss 2024-09-12T17:51:35.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.709+0000 7f960c92c800 20 rados->read ofs=0 len=0 2024-09-12T17:51:35.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.709+0000 7f960c92c800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:51:35.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.709+0000 7f960c92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:51:35.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.709+0000 7f960c92c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:51:35.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.709+0000 7f960c92c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:51:35.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.709+0000 7f960c92c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:51:35.711 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.709+0000 7f960c92c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 2024-09-12T17:51:35.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.710+0000 7f960c92c800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to be held by another RGW process; skipping for now 2024-09-12T17:51:35.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.711+0000 7f94befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:51:35.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.713+0000 7f960c92c800 20 remove_watcher() i=0 2024-09-12T17:51:35.714 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.713+0000 7f960c92c800 2 removed watcher, disabling cache 2024-09-12T17:51:35.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.714+0000 7f960c92c800 20 remove_watcher() i=1 2024-09-12T17:51:35.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.715+0000 7f960c92c800 20 remove_watcher() i=2 2024-09-12T17:51:35.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.716+0000 7f960c92c800 20 remove_watcher() i=3 2024-09-12T17:51:35.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.717+0000 7f960c92c800 20 remove_watcher() i=4 2024-09-12T17:51:35.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.718+0000 7f960c92c800 20 remove_watcher() i=5 2024-09-12T17:51:35.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.719+0000 7f960c92c800 20 remove_watcher() i=6 2024-09-12T17:51:35.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:51:35.720+0000 7f960c92c800 20 remove_watcher() i=7 2024-09-12T17:51:35.730 INFO:tasks.workunit.client.0.smithi107.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:52:05.759 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:52:05.793 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:05.793 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:05.835 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.834+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:05.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.835+0000 7f05b960e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:05.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.835+0000 7f05b960e800 20 realm 2024-09-12T17:52:05.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.835+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:05.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.835+0000 7f05b960e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:05.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.835+0000 7f05b960e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:05.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.835+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:05.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.835+0000 7f05b960e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:05.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.835+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:05.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.836+0000 7f05b960e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:05.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.836+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:05.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.837+0000 7f05b960e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:05.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.837+0000 7f05b960e800 20 searching for the correct realm 2024-09-12T17:52:05.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:05.840+0000 7f05b4458640 0 -- 172.21.15.107:0/3364585234 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f059c0602d0 msgr2=0x7f059c008990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:06.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.047+0000 7f05b4c59640 0 -- 172.21.15.107:0/3364585234 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f059c076310 msgr2=0x7f059c076790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:06.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.254+0000 7f05b960e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:06.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.254+0000 7f05b960e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:06.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.254+0000 7f05b960e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:06.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.254+0000 7f05b960e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:06.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.254+0000 7f05b960e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:06.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.254+0000 7f05b960e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:06.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.254+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.254+0000 7f05b960e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:06.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.254+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.255+0000 7f05b960e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:06.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.255+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.255+0000 7f05b960e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:06.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.255+0000 7f05b960e800 20 zone default found 2024-09-12T17:52:06.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.255+0000 7f05b960e800 4 Realm: () 2024-09-12T17:52:06.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.255+0000 7f05b960e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:06.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.255+0000 7f05b960e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:06.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.255+0000 7f05b960e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:06.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.255+0000 7f05b960e800 20 zonegroup default 2024-09-12T17:52:06.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.255+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.256+0000 7f05b960e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:06.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.256+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.256+0000 7f05b960e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:06.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.256+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.257+0000 7f05b960e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:06.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.257+0000 7f05b960e800 20 started sync module instance, tier type = 2024-09-12T17:52:06.259 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.257+0000 7f05b960e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:06.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.268+0000 7f05b960e800 20 add_watcher() i=0 2024-09-12T17:52:06.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.268+0000 7f05b960e800 20 add_watcher() i=1 2024-09-12T17:52:06.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.268+0000 7f05b960e800 20 add_watcher() i=2 2024-09-12T17:52:06.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.268+0000 7f05b960e800 20 add_watcher() i=3 2024-09-12T17:52:06.269 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.268+0000 7f05b960e800 20 add_watcher() i=4 2024-09-12T17:52:06.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.268+0000 7f05b960e800 20 add_watcher() i=5 2024-09-12T17:52:06.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.268+0000 7f05b960e800 20 add_watcher() i=6 2024-09-12T17:52:06.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.269+0000 7f05b960e800 20 add_watcher() i=7 2024-09-12T17:52:06.270 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.269+0000 7f05b960e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:06.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.271+0000 7f046b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:06.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.272+0000 7f05b960e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:06.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.272+0000 7f05b960e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:06.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.272+0000 7f05b960e800 5 note: GC not initialized 2024-09-12T17:52:06.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.272+0000 7f046a7e4640 20 reqs_thread_entry: start 2024-09-12T17:52:06.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.272+0000 7f05b960e800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:06.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.272+0000 7f05b960e800 20 Filter name: none 2024-09-12T17:52:06.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.272+0000 7f0463fff640 20 reqs_thread_entry: start 2024-09-12T17:52:06.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.272+0000 7f05b960e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:52:06.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.272+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.273+0000 7f05b960e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:52:06.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.273+0000 7f05b960e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:52:06.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.273+0000 7f05b960e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:52:06.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.273+0000 7f05b960e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 : miss 2024-09-12T17:52:06.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.273+0000 7f05b960e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.273+0000 7f05b960e800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:52:06.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.273+0000 7f05b960e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:52:06.275 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.273+0000 7f05b960e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:52:06.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.273+0000 7f05b960e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:06.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.273+0000 7f05b960e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:06.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.273+0000 7f05b960e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 2024-09-12T17:52:06.276 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.275+0000 7f05b960e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:52:06.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.279+0000 7f05b960e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:52:06.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.279+0000 7f05b960e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:52:06.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.279+0000 7f05b960e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:06.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.279+0000 7f05b960e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37, ofs0, ns] 2024-09-12T17:52:06.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.279+0000 7f048bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464366 cookie 94436851773120 notifier 7746 bl.length()=1007 2024-09-12T17:52:06.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.279+0000 7f048bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:52:06.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.279+0000 7f048bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:52:06.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.279+0000 7f048bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:06.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.280+0000 7f05b960e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): orig_sources= new_sources= 2024-09-12T17:52:06.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.280+0000 7f05b960e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): potential sources added=[] removed=[] 2024-09-12T17:52:06.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.280+0000 7f05b960e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): orig_dests= new_dests= 2024-09-12T17:52:06.282 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.280+0000 7f05b960e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): potential dests added=[] removed=[] 2024-09-12T17:52:06.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.282+0000 7f05b960e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.37.2.0 2024-09-12T17:52:06.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.282+0000 7f05b960e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.37.2.0 2024-09-12T17:52:06.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.282+0000 7f05b960e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.37.2.1 2024-09-12T17:52:06.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.282+0000 7f05b960e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.37.2.1 2024-09-12T17:52:06.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.282+0000 7f05b960e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.37.0 2024-09-12T17:52:06.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.285+0000 7f05b960e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:52:06.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.285+0000 7f05b960e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 2024-09-12T17:52:06.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.287+0000 7f05b960e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:52:06.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.287+0000 7f05b960e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:52:06.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.287+0000 7f05b960e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:06.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.287+0000 7f05b960e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37, ofs0, ns] 2024-09-12T17:52:06.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.287+0000 7f048b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464367 cookie 94436851773120 notifier 7746 bl.length()=1007 2024-09-12T17:52:06.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.287+0000 7f048b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:52:06.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.287+0000 7f048b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:52:06.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.287+0000 7f048b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:06.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.287+0000 7f05b960e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): orig_sources= new_sources= 2024-09-12T17:52:06.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.287+0000 7f05b960e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): potential sources added=[] removed=[] 2024-09-12T17:52:06.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.287+0000 7f05b960e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): orig_dests= new_dests= 2024-09-12T17:52:06.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.287+0000 7f05b960e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): potential dests added=[] removed=[] 2024-09-12T17:52:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.289+0000 7f05b960e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.37.0 2024-09-12T17:52:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.289+0000 7f05b960e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:52:06.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.289+0000 7f05b960e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 2024-09-12T17:52:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.290+0000 7f05b960e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:52:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.290+0000 7f05b960e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:52:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.290+0000 7f05b960e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:06.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.290+0000 7f05b960e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37, ofs0, ns] 2024-09-12T17:52:06.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.291+0000 7f048bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464368 cookie 94436851773120 notifier 7746 bl.length()=975 2024-09-12T17:52:06.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.291+0000 7f048bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 info.flags=0x17 2024-09-12T17:52:06.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.291+0000 7f048bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 to cache LRU end 2024-09-12T17:52:06.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.291+0000 7f048bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:06.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.291+0000 7f05b960e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): orig_sources= new_sources= 2024-09-12T17:52:06.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.291+0000 7f05b960e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): potential sources added=[] removed=[] 2024-09-12T17:52:06.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.291+0000 7f05b960e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): orig_dests= new_dests= 2024-09-12T17:52:06.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.291+0000 7f05b960e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[35ed0db6-4f54-4e96-b306-71079c84e007.4596.37]): potential dests added=[] removed=[] 2024-09-12T17:52:06.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.292+0000 7f05b960e800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T17:52:06.297 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.295+0000 7f046b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:06.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.297+0000 7f05b960e800 20 remove_watcher() i=0 2024-09-12T17:52:06.298 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.297+0000 7f05b960e800 2 removed watcher, disabling cache 2024-09-12T17:52:06.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.298+0000 7f05b960e800 20 remove_watcher() i=1 2024-09-12T17:52:06.301 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.299+0000 7f05b960e800 20 remove_watcher() i=2 2024-09-12T17:52:06.302 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.301+0000 7f05b960e800 20 remove_watcher() i=3 2024-09-12T17:52:06.303 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.302+0000 7f05b960e800 20 remove_watcher() i=4 2024-09-12T17:52:06.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.303+0000 7f05b960e800 20 remove_watcher() i=5 2024-09-12T17:52:06.305 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.304+0000 7f05b960e800 20 remove_watcher() i=6 2024-09-12T17:52:06.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.305+0000 7f05b960e800 20 remove_watcher() i=7 2024-09-12T17:52:06.320 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:52:06.350 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:06.350 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:06.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.589+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.591+0000 7fbce1525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:06.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.591+0000 7fbce1525800 20 realm 2024-09-12T17:52:06.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.591+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.592+0000 7fbce1525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:06.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.592+0000 7fbce1525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:06.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.592+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.592+0000 7fbce1525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:06.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.592+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.593+0000 7fbce1525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:06.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.593+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:06.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.593+0000 7fbce1525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:06.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.593+0000 7fbce1525800 20 searching for the correct realm 2024-09-12T17:52:06.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.595+0000 7fbcd7fff640 0 -- 172.21.15.107:0/2881228305 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fbcc801a040 msgr2=0x7fbcc8061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:52:06.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:06.801+0000 7fbcdd1b5640 0 -- 172.21.15.107:0/2881228305 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fbcc8077750 msgr2=0x7fbcc80636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:52:07.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.009+0000 7fbce1525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:07.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.009+0000 7fbce1525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:07.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.009+0000 7fbce1525800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:07.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.009+0000 7fbce1525800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:07.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.009+0000 7fbce1525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:07.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.009+0000 7fbce1525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.009+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.009+0000 7fbce1525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.009+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.009+0000 7fbce1525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.009+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.010+0000 7fbce1525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.010+0000 7fbce1525800 20 zone default found 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.010+0000 7fbce1525800 4 Realm: () 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.010+0000 7fbce1525800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.010+0000 7fbce1525800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.010+0000 7fbce1525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.010+0000 7fbce1525800 20 zonegroup default 2024-09-12T17:52:07.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.010+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.010+0000 7fbce1525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.010+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.013 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.010+0000 7fbce1525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.010+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.011+0000 7fbce1525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.011+0000 7fbce1525800 20 started sync module instance, tier type = 2024-09-12T17:52:07.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.011+0000 7fbce1525800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:07.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.021+0000 7fbce1525800 20 add_watcher() i=0 2024-09-12T17:52:07.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.021+0000 7fbce1525800 20 add_watcher() i=1 2024-09-12T17:52:07.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.021+0000 7fbce1525800 20 add_watcher() i=2 2024-09-12T17:52:07.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.021+0000 7fbce1525800 20 add_watcher() i=3 2024-09-12T17:52:07.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.021+0000 7fbce1525800 20 add_watcher() i=4 2024-09-12T17:52:07.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.021+0000 7fbce1525800 20 add_watcher() i=5 2024-09-12T17:52:07.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.021+0000 7fbce1525800 20 add_watcher() i=6 2024-09-12T17:52:07.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.022+0000 7fbce1525800 20 add_watcher() i=7 2024-09-12T17:52:07.023 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.022+0000 7fbce1525800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:07.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.024+0000 7fbb937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:07.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.024+0000 7fbce1525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:07.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.024+0000 7fbce1525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:07.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.024+0000 7fbce1525800 5 note: GC not initialized 2024-09-12T17:52:07.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.024+0000 7fbb927e4640 20 reqs_thread_entry: start 2024-09-12T17:52:07.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.025+0000 7fbce1525800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:07.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.025+0000 7fbce1525800 20 Filter name: none 2024-09-12T17:52:07.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.025+0000 7fbb03fff640 20 reqs_thread_entry: start 2024-09-12T17:52:07.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.025+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.025+0000 7fbce1525800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:52:07.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.025+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.026+0000 7fbce1525800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:52:07.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.026+0000 7fbce1525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:07.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.026+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.026+0000 7fbce1525800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:52:07.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.026+0000 7fbce1525800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.027+0000 7fbce1525800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:52:07.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.027+0000 7fbce1525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:07.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.028+0000 7fbb937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:07.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.031+0000 7fbce1525800 20 remove_watcher() i=0 2024-09-12T17:52:07.032 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.031+0000 7fbce1525800 2 removed watcher, disabling cache 2024-09-12T17:52:07.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.032+0000 7fbce1525800 20 remove_watcher() i=1 2024-09-12T17:52:07.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.033+0000 7fbce1525800 20 remove_watcher() i=2 2024-09-12T17:52:07.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.034+0000 7fbce1525800 20 remove_watcher() i=3 2024-09-12T17:52:07.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.035+0000 7fbce1525800 20 remove_watcher() i=4 2024-09-12T17:52:07.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.036+0000 7fbce1525800 20 remove_watcher() i=5 2024-09-12T17:52:07.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.037+0000 7fbce1525800 20 remove_watcher() i=6 2024-09-12T17:52:07.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.038+0000 7fbce1525800 20 remove_watcher() i=7 2024-09-12T17:52:07.051 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:07.051 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:52:07.051 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-logrecord-writes id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:52:07.051 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:07.115 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T17:52:07.115 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:07.300 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:52:07.328 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:07.329 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:07.365 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.364+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.366+0000 7f216a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.366+0000 7f216a32a800 20 realm 2024-09-12T17:52:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.366+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.366+0000 7f216a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.366+0000 7f216a32a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:07.367 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.366+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.366+0000 7f216a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.366+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.367+0000 7f216a32a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:07.368 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.367+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.369 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.368+0000 7f216a32a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:07.369 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.368+0000 7f216a32a800 20 searching for the correct realm 2024-09-12T17:52:07.371 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.370+0000 7f21668db640 0 -- 172.21.15.107:0/4123901003 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5592ef7142e0 msgr2=0x5592ef7167a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:07.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.374+0000 7f21660da640 0 -- 172.21.15.107:0/4123901003 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f215006de20 msgr2=0x7f215003a030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.377+0000 7f216a32a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.377+0000 7f216a32a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.377+0000 7f216a32a800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.377+0000 7f216a32a800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.377+0000 7f216a32a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.377+0000 7f216a32a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.377+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.378+0000 7f216a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.378+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.378+0000 7f216a32a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:07.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.378+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.378+0000 7f216a32a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.378+0000 7f216a32a800 20 zone default found 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.378+0000 7f216a32a800 4 Realm: () 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.378+0000 7f216a32a800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.378+0000 7f216a32a800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.378+0000 7f216a32a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.378+0000 7f216a32a800 20 zonegroup default 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.378+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.379+0000 7f216a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.379+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.379+0000 7f216a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.379+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.379+0000 7f216a32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.379+0000 7f216a32a800 20 started sync module instance, tier type = 2024-09-12T17:52:07.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.379+0000 7f216a32a800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:07.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.387+0000 7f216a32a800 20 add_watcher() i=0 2024-09-12T17:52:07.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.387+0000 7f216a32a800 20 add_watcher() i=1 2024-09-12T17:52:07.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.387+0000 7f216a32a800 20 add_watcher() i=2 2024-09-12T17:52:07.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.387+0000 7f216a32a800 20 add_watcher() i=3 2024-09-12T17:52:07.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.387+0000 7f216a32a800 20 add_watcher() i=4 2024-09-12T17:52:07.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.387+0000 7f216a32a800 20 add_watcher() i=5 2024-09-12T17:52:07.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.387+0000 7f216a32a800 20 add_watcher() i=6 2024-09-12T17:52:07.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.388+0000 7f216a32a800 20 add_watcher() i=7 2024-09-12T17:52:07.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.388+0000 7f216a32a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:07.391 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.390+0000 7f201cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:07.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.390+0000 7f216a32a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:07.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.390+0000 7f216a32a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:07.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.390+0000 7f216a32a800 5 note: GC not initialized 2024-09-12T17:52:07.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.391+0000 7f1f977fe640 20 reqs_thread_entry: start 2024-09-12T17:52:07.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.391+0000 7f216a32a800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:07.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.391+0000 7f216a32a800 20 Filter name: none 2024-09-12T17:52:07.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.391+0000 7f1f957fa640 20 reqs_thread_entry: start 2024-09-12T17:52:07.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.391+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.392+0000 7f216a32a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:07.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.392+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.392+0000 7f216a32a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:07.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.392+0000 7f216a32a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:07.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.392+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.392+0000 7f216a32a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:07.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.392+0000 7f216a32a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.393+0000 7f216a32a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:07.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.393+0000 7f216a32a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:07.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.394+0000 7f201cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:07.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.397+0000 7f216a32a800 20 remove_watcher() i=0 2024-09-12T17:52:07.398 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.397+0000 7f216a32a800 2 removed watcher, disabling cache 2024-09-12T17:52:07.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.398+0000 7f216a32a800 20 remove_watcher() i=1 2024-09-12T17:52:07.400 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.399+0000 7f216a32a800 20 remove_watcher() i=2 2024-09-12T17:52:07.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.400+0000 7f216a32a800 20 remove_watcher() i=3 2024-09-12T17:52:07.402 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.401+0000 7f216a32a800 20 remove_watcher() i=4 2024-09-12T17:52:07.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.402+0000 7f216a32a800 20 remove_watcher() i=5 2024-09-12T17:52:07.403 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.402+0000 7f216a32a800 20 remove_watcher() i=6 2024-09-12T17:52:07.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.403+0000 7f216a32a800 20 remove_watcher() i=7 2024-09-12T17:52:07.415 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:07.415 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:52:07.415 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-change-reshard-state id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:52:07.415 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:07.416 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T17:52:07.450 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:07.450 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:07.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.486+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.488+0000 7fdfc1eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.488+0000 7fdfc1eb7800 20 realm 2024-09-12T17:52:07.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.488+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.488+0000 7fdfc1eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.488+0000 7fdfc1eb7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:07.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.488+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.488+0000 7fdfc1eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.488+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.489+0000 7fdfc1eb7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:07.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.489+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.491 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.489+0000 7fdfc1eb7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:07.491 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.489+0000 7fdfc1eb7800 20 searching for the correct realm 2024-09-12T17:52:07.491 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.490+0000 7fdfbf9a1640 0 -- 172.21.15.107:0/2084344476 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fdfac003bd0 msgr2=0x7fdfb8029930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:07.698 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.697+0000 7fdfb71a0640 0 -- 172.21.15.107:0/2084344476 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x5571bb8f0de0 msgr2=0x5571bb8f31d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:07.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.702+0000 7fdfc1eb7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:07.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.702+0000 7fdfc1eb7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:07.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.702+0000 7fdfc1eb7800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:07.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.702+0000 7fdfc1eb7800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:07.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.702+0000 7fdfc1eb7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:07.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.702+0000 7fdfc1eb7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:07.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.702+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.703+0000 7fdfc1eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.703+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.705 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.703+0000 7fdfc1eb7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.703+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.703+0000 7fdfc1eb7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.703+0000 7fdfc1eb7800 20 zone default found 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.703+0000 7fdfc1eb7800 4 Realm: () 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.703+0000 7fdfc1eb7800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.703+0000 7fdfc1eb7800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.703+0000 7fdfc1eb7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.703+0000 7fdfc1eb7800 20 zonegroup default 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.703+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.704+0000 7fdfc1eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.704+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.704+0000 7fdfc1eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.706 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.704+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.704+0000 7fdfc1eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.704+0000 7fdfc1eb7800 20 started sync module instance, tier type = 2024-09-12T17:52:07.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.704+0000 7fdfc1eb7800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:07.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.714+0000 7fdfc1eb7800 20 add_watcher() i=0 2024-09-12T17:52:07.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.714+0000 7fdfc1eb7800 20 add_watcher() i=1 2024-09-12T17:52:07.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.714+0000 7fdfc1eb7800 20 add_watcher() i=2 2024-09-12T17:52:07.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.714+0000 7fdfc1eb7800 20 add_watcher() i=3 2024-09-12T17:52:07.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.714+0000 7fdfc1eb7800 20 add_watcher() i=4 2024-09-12T17:52:07.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.714+0000 7fdfc1eb7800 20 add_watcher() i=5 2024-09-12T17:52:07.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.714+0000 7fdfc1eb7800 20 add_watcher() i=6 2024-09-12T17:52:07.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.715+0000 7fdfc1eb7800 20 add_watcher() i=7 2024-09-12T17:52:07.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.715+0000 7fdfc1eb7800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:07.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.716+0000 7fde75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:07.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.717+0000 7fdfc1eb7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:07.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.717+0000 7fdfc1eb7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:07.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.717+0000 7fdfc1eb7800 5 note: GC not initialized 2024-09-12T17:52:07.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.717+0000 7fde74fe1640 20 reqs_thread_entry: start 2024-09-12T17:52:07.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.717+0000 7fdfc1eb7800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:07.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.717+0000 7fdfc1eb7800 20 Filter name: none 2024-09-12T17:52:07.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.717+0000 7fddee7fc640 20 reqs_thread_entry: start 2024-09-12T17:52:07.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.717+0000 7fdfc1eb7800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:52:07.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.717+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.718+0000 7fdfc1eb7800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:07.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.718+0000 7fdfc1eb7800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:52:07.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.718+0000 7fdfc1eb7800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:52:07.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.718+0000 7fdfc1eb7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 : miss 2024-09-12T17:52:07.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.718+0000 7fdfc1eb7800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.718+0000 7fdfc1eb7800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:07.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.718+0000 7fdfc1eb7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 info.flags=0x17 2024-09-12T17:52:07.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.718+0000 7fdfc1eb7800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 to cache LRU end 2024-09-12T17:52:07.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.718+0000 7fdfc1eb7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:07.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.718+0000 7fdfc1eb7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:07.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.718+0000 7fdfc1eb7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 2024-09-12T17:52:07.723 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.722+0000 7fdfc1eb7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 info.flags=0x17 2024-09-12T17:52:07.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.722+0000 7fdfc1eb7800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 to cache LRU end 2024-09-12T17:52:07.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.722+0000 7fdfc1eb7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:07.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.722+0000 7fdfc1eb7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38, ofs0, ns] 2024-09-12T17:52:07.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.722+0000 7fde9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464324 cookie 93946966415504 notifier 7800 bl.length()=1015 2024-09-12T17:52:07.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.722+0000 7fde9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 info.flags=0x17 2024-09-12T17:52:07.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.722+0000 7fde9effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 to cache LRU end 2024-09-12T17:52:07.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.722+0000 7fde9effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:07.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.723+0000 7fdfc1eb7800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): orig_sources= new_sources= 2024-09-12T17:52:07.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.723+0000 7fdfc1eb7800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): potential sources added=[] removed=[] 2024-09-12T17:52:07.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.723+0000 7fdfc1eb7800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): orig_dests= new_dests= 2024-09-12T17:52:07.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.723+0000 7fdfc1eb7800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): potential dests added=[] removed=[] 2024-09-12T17:52:07.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.725+0000 7fdfc1eb7800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.38.1.0 2024-09-12T17:52:07.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.725+0000 7fdfc1eb7800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.38.1.0 2024-09-12T17:52:07.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.725+0000 7fdfc1eb7800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.38.1.1 2024-09-12T17:52:07.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.725+0000 7fdfc1eb7800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.38.1.1 2024-09-12T17:52:07.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.725+0000 7fdfc1eb7800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.38.0 2024-09-12T17:52:07.728 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.727+0000 7fdfc1eb7800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T17:52:07.728 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.727+0000 7fdfc1eb7800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T17:52:07.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.731+0000 7fdfc1eb7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:52:07.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.731+0000 7fdfc1eb7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 2024-09-12T17:52:07.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fdfc1eb7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 info.flags=0x17 2024-09-12T17:52:07.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fdfc1eb7800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 to cache LRU end 2024-09-12T17:52:07.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fdfc1eb7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:07.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fdfc1eb7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38, ofs0, ns] 2024-09-12T17:52:07.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fde9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464325 cookie 93946966415504 notifier 7800 bl.length()=983 2024-09-12T17:52:07.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fde9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 info.flags=0x17 2024-09-12T17:52:07.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fde9e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 to cache LRU end 2024-09-12T17:52:07.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fde9e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:07.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fdfc1eb7800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): orig_sources= new_sources= 2024-09-12T17:52:07.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fdfc1eb7800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): potential sources added=[] removed=[] 2024-09-12T17:52:07.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fdfc1eb7800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): orig_dests= new_dests= 2024-09-12T17:52:07.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fdfc1eb7800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): potential dests added=[] removed=[] 2024-09-12T17:52:07.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.733+0000 7fdfc1eb7800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T17:52:07.736 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.735+0000 7fde75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:07.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.737+0000 7fdfc1eb7800 20 remove_watcher() i=0 2024-09-12T17:52:07.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.737+0000 7fdfc1eb7800 2 removed watcher, disabling cache 2024-09-12T17:52:07.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.738+0000 7fdfc1eb7800 20 remove_watcher() i=1 2024-09-12T17:52:07.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.739+0000 7fdfc1eb7800 20 remove_watcher() i=2 2024-09-12T17:52:07.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.740+0000 7fdfc1eb7800 20 remove_watcher() i=3 2024-09-12T17:52:07.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.741+0000 7fdfc1eb7800 20 remove_watcher() i=4 2024-09-12T17:52:07.743 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.742+0000 7fdfc1eb7800 20 remove_watcher() i=5 2024-09-12T17:52:07.744 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.743+0000 7fdfc1eb7800 20 remove_watcher() i=6 2024-09-12T17:52:07.745 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.744+0000 7fdfc1eb7800 20 remove_watcher() i=7 2024-09-12T17:52:07.757 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:52:07.785 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:07.785 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:07.820 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.819+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.821+0000 7fc827d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.822 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.821+0000 7fc827d44800 20 realm 2024-09-12T17:52:07.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.821+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.821+0000 7fc827d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.821+0000 7fc827d44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:07.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.821+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.821+0000 7fc827d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:07.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.821+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.822+0000 7fc827d44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:07.823 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.822+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:07.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.823+0000 7fc827d44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:07.824 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.823+0000 7fc827d44800 20 searching for the correct realm 2024-09-12T17:52:07.826 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.825+0000 7fc823af4640 0 -- 172.21.15.107:0/1830856636 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fc81c061b50 msgr2=0x7fc81c06a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:07.830 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:07.829+0000 7fc823af4640 0 -- 172.21.15.107:0/1830856636 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc818098020 msgr2=0x7fc818027970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:08.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.035+0000 7fc827d44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:08.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.035+0000 7fc827d44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:08.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.035+0000 7fc827d44800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:08.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.035+0000 7fc827d44800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:08.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.035+0000 7fc827d44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:08.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.035+0000 7fc827d44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:08.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.035+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.035+0000 7fc827d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.035+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.036+0000 7fc827d44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:08.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.036+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.036+0000 7fc827d44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:08.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.036+0000 7fc827d44800 20 zone default found 2024-09-12T17:52:08.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.036+0000 7fc827d44800 4 Realm: () 2024-09-12T17:52:08.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.036+0000 7fc827d44800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:08.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.036+0000 7fc827d44800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:08.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.036+0000 7fc827d44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:08.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.036+0000 7fc827d44800 20 zonegroup default 2024-09-12T17:52:08.039 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.036+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.036+0000 7fc827d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.036+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.037+0000 7fc827d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.037+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.037+0000 7fc827d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.037+0000 7fc827d44800 20 started sync module instance, tier type = 2024-09-12T17:52:08.040 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.037+0000 7fc827d44800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:08.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.046+0000 7fc827d44800 20 add_watcher() i=0 2024-09-12T17:52:08.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.046+0000 7fc827d44800 20 add_watcher() i=1 2024-09-12T17:52:08.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.046+0000 7fc827d44800 20 add_watcher() i=2 2024-09-12T17:52:08.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.046+0000 7fc827d44800 20 add_watcher() i=3 2024-09-12T17:52:08.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.046+0000 7fc827d44800 20 add_watcher() i=4 2024-09-12T17:52:08.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.046+0000 7fc827d44800 20 add_watcher() i=5 2024-09-12T17:52:08.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.046+0000 7fc827d44800 20 add_watcher() i=6 2024-09-12T17:52:08.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.047+0000 7fc827d44800 20 add_watcher() i=7 2024-09-12T17:52:08.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.047+0000 7fc827d44800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:08.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.049+0000 7fc6d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:08.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.049+0000 7fc827d44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:08.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.049+0000 7fc827d44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:08.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.049+0000 7fc827d44800 5 note: GC not initialized 2024-09-12T17:52:08.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.049+0000 7fc6d8fe1640 20 reqs_thread_entry: start 2024-09-12T17:52:08.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.049+0000 7fc827d44800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:08.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.049+0000 7fc827d44800 20 Filter name: none 2024-09-12T17:52:08.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.049+0000 7fc6527fc640 20 reqs_thread_entry: start 2024-09-12T17:52:08.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.050+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.050+0000 7fc827d44800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:08.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.050+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.051+0000 7fc827d44800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:08.052 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.051+0000 7fc827d44800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:08.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.051+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.051+0000 7fc827d44800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:08.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.051+0000 7fc827d44800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.051+0000 7fc827d44800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:08.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.051+0000 7fc827d44800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:08.053 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.052+0000 7fc6d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:08.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.054+0000 7fc827d44800 20 remove_watcher() i=0 2024-09-12T17:52:08.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.054+0000 7fc827d44800 2 removed watcher, disabling cache 2024-09-12T17:52:08.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.055+0000 7fc827d44800 20 remove_watcher() i=1 2024-09-12T17:52:08.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.056+0000 7fc827d44800 20 remove_watcher() i=2 2024-09-12T17:52:08.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.057+0000 7fc827d44800 20 remove_watcher() i=3 2024-09-12T17:52:08.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.058+0000 7fc827d44800 20 remove_watcher() i=4 2024-09-12T17:52:08.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.059+0000 7fc827d44800 20 remove_watcher() i=5 2024-09-12T17:52:08.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.060+0000 7fc827d44800 20 remove_watcher() i=6 2024-09-12T17:52:08.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.061+0000 7fc827d44800 20 remove_watcher() i=7 2024-09-12T17:52:08.072 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:08.072 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:52:08.072 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-change-reshard-state id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:52:08.073 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:08.124 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:52:08.155 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:08.155 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:08.192 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.190+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.192+0000 7f7e14533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.192+0000 7f7e14533800 20 realm 2024-09-12T17:52:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.192+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.192+0000 7f7e14533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.192+0000 7f7e14533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.192+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.193+0000 7f7e14533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.193+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.193+0000 7f7e14533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:08.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.193+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.194+0000 7f7e14533800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:08.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.194+0000 7f7e14533800 20 searching for the correct realm 2024-09-12T17:52:08.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.195+0000 7f7e10276640 0 -- 172.21.15.107:0/3798990926 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f7e08028040 msgr2=0x7f7e08019940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:08.401 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.400+0000 7f7e07fff640 0 -- 172.21.15.107:0/3798990926 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x55e2a98ef5e0 msgr2=0x55e2a98f19d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:08.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:08.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:08.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:08.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:08.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:08.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:08.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:08.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:08.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 zone default found 2024-09-12T17:52:08.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 4 Realm: () 2024-09-12T17:52:08.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:08.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:08.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:08.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 zonegroup default 2024-09-12T17:52:08.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.406+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.407+0000 7f7e14533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.407+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.407+0000 7f7e14533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.407+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.407+0000 7f7e14533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.407+0000 7f7e14533800 20 started sync module instance, tier type = 2024-09-12T17:52:08.410 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.407+0000 7f7e14533800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:08.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.416+0000 7f7e14533800 20 add_watcher() i=0 2024-09-12T17:52:08.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.416+0000 7f7e14533800 20 add_watcher() i=1 2024-09-12T17:52:08.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.416+0000 7f7e14533800 20 add_watcher() i=2 2024-09-12T17:52:08.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.416+0000 7f7e14533800 20 add_watcher() i=3 2024-09-12T17:52:08.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.416+0000 7f7e14533800 20 add_watcher() i=4 2024-09-12T17:52:08.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.416+0000 7f7e14533800 20 add_watcher() i=5 2024-09-12T17:52:08.417 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.416+0000 7f7e14533800 20 add_watcher() i=6 2024-09-12T17:52:08.418 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.417+0000 7f7e14533800 20 add_watcher() i=7 2024-09-12T17:52:08.418 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.417+0000 7f7e14533800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:08.419 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.418+0000 7f7cc27f4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:08.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.418+0000 7f7e14533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:08.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.418+0000 7f7e14533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:08.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.419+0000 7f7e14533800 5 note: GC not initialized 2024-09-12T17:52:08.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.419+0000 7f7cc17f2640 20 reqs_thread_entry: start 2024-09-12T17:52:08.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.419+0000 7f7e14533800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:08.420 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.419+0000 7f7e14533800 20 Filter name: none 2024-09-12T17:52:08.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.419+0000 7f7c3affd640 20 reqs_thread_entry: start 2024-09-12T17:52:08.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.419+0000 7f7e14533800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:52:08.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.419+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.421 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.419+0000 7f7e14533800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:08.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.419+0000 7f7e14533800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:52:08.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.419+0000 7f7e14533800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:52:08.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.419+0000 7f7e14533800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 : miss 2024-09-12T17:52:08.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.419+0000 7f7e14533800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.420+0000 7f7e14533800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:08.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.420+0000 7f7e14533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 info.flags=0x17 2024-09-12T17:52:08.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.420+0000 7f7e14533800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 to cache LRU end 2024-09-12T17:52:08.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.420+0000 7f7e14533800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:08.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.420+0000 7f7e14533800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:08.422 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.420+0000 7f7e14533800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 2024-09-12T17:52:08.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.424+0000 7f7e14533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 info.flags=0x17 2024-09-12T17:52:08.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.424+0000 7f7e14533800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 to cache LRU end 2024-09-12T17:52:08.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.424+0000 7f7e14533800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:08.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.424+0000 7f7e14533800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38, ofs0, ns] 2024-09-12T17:52:08.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.424+0000 7f7ce6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464326 cookie 94431995721856 notifier 7373 bl.length()=1015 2024-09-12T17:52:08.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.424+0000 7f7ce6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 info.flags=0x17 2024-09-12T17:52:08.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.424+0000 7f7ce6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 to cache LRU end 2024-09-12T17:52:08.425 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.424+0000 7f7ce6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:08.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.424+0000 7f7e14533800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): orig_sources= new_sources= 2024-09-12T17:52:08.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.424+0000 7f7e14533800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): potential sources added=[] removed=[] 2024-09-12T17:52:08.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.424+0000 7f7e14533800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): orig_dests= new_dests= 2024-09-12T17:52:08.426 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.424+0000 7f7e14533800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): potential dests added=[] removed=[] 2024-09-12T17:52:08.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.426+0000 7f7e14533800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.38.1.0 2024-09-12T17:52:08.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.426+0000 7f7e14533800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.38.1.0 2024-09-12T17:52:08.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.426+0000 7f7e14533800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.38.1.1 2024-09-12T17:52:08.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.426+0000 7f7e14533800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.38.1.1 2024-09-12T17:52:08.428 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.426+0000 7f7e14533800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.38.0 2024-09-12T17:52:08.429 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.428+0000 7f7e14533800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:52:08.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.428+0000 7f7e14533800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 2024-09-12T17:52:08.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.430+0000 7f7e14533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 info.flags=0x17 2024-09-12T17:52:08.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.430+0000 7f7e14533800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 to cache LRU end 2024-09-12T17:52:08.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.430+0000 7f7e14533800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:08.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.430+0000 7f7e14533800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38, ofs0, ns] 2024-09-12T17:52:08.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.430+0000 7f7ce6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464327 cookie 94431995721856 notifier 7373 bl.length()=1015 2024-09-12T17:52:08.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.430+0000 7f7ce6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 info.flags=0x17 2024-09-12T17:52:08.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.430+0000 7f7ce6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 to cache LRU end 2024-09-12T17:52:08.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.430+0000 7f7ce6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:08.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.431+0000 7f7e14533800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): orig_sources= new_sources= 2024-09-12T17:52:08.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.431+0000 7f7e14533800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): potential sources added=[] removed=[] 2024-09-12T17:52:08.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.431+0000 7f7e14533800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): orig_dests= new_dests= 2024-09-12T17:52:08.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.431+0000 7f7e14533800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): potential dests added=[] removed=[] 2024-09-12T17:52:08.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.432+0000 7f7e14533800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.38.0 2024-09-12T17:52:08.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.432+0000 7f7e14533800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:52:08.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.432+0000 7f7e14533800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 2024-09-12T17:52:08.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.433+0000 7f7e14533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 info.flags=0x17 2024-09-12T17:52:08.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.433+0000 7f7e14533800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 to cache LRU end 2024-09-12T17:52:08.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.433+0000 7f7e14533800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:08.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.433+0000 7f7e14533800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38, ofs0, ns] 2024-09-12T17:52:08.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.433+0000 7f7ce6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464328 cookie 94431995721856 notifier 7373 bl.length()=983 2024-09-12T17:52:08.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.433+0000 7f7ce6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 info.flags=0x17 2024-09-12T17:52:08.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.433+0000 7f7ce6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 to cache LRU end 2024-09-12T17:52:08.435 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.433+0000 7f7ce6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:08.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.434+0000 7f7e14533800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): orig_sources= new_sources= 2024-09-12T17:52:08.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.434+0000 7f7e14533800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): potential sources added=[] removed=[] 2024-09-12T17:52:08.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.434+0000 7f7e14533800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): orig_dests= new_dests= 2024-09-12T17:52:08.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.434+0000 7f7e14533800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.38]): potential dests added=[] removed=[] 2024-09-12T17:52:08.436 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.435+0000 7f7e14533800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T17:52:08.438 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.437+0000 7f7cc27f4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:08.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.439+0000 7f7e14533800 20 remove_watcher() i=0 2024-09-12T17:52:08.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.439+0000 7f7e14533800 2 removed watcher, disabling cache 2024-09-12T17:52:08.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.440+0000 7f7e14533800 20 remove_watcher() i=1 2024-09-12T17:52:08.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.441+0000 7f7e14533800 20 remove_watcher() i=2 2024-09-12T17:52:08.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.442+0000 7f7e14533800 20 remove_watcher() i=3 2024-09-12T17:52:08.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.443+0000 7f7e14533800 20 remove_watcher() i=4 2024-09-12T17:52:08.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.444+0000 7f7e14533800 20 remove_watcher() i=5 2024-09-12T17:52:08.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.445+0000 7f7e14533800 20 remove_watcher() i=6 2024-09-12T17:52:08.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.446+0000 7f7e14533800 20 remove_watcher() i=7 2024-09-12T17:52:08.458 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:52:08.487 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:08.488 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:08.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.523+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.525+0000 7f24ed326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.525+0000 7f24ed326800 20 realm 2024-09-12T17:52:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.525+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.525+0000 7f24ed326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.525+0000 7f24ed326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.525+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.525+0000 7f24ed326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.525+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.526+0000 7f24ed326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:08.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.526+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.527+0000 7f24ed326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:08.528 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.527+0000 7f24ed326800 20 searching for the correct realm 2024-09-12T17:52:08.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.529+0000 7f24e8f09640 0 -- 172.21.15.107:0/494007396 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f24e4055410 msgr2=0x7f24e4055870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:08.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.532+0000 7f24e8f09640 0 -- 172.21.15.107:0/494007396 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f24d40800e0 msgr2=0x7f24d4062930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:08.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.738+0000 7f24ed326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:08.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.738+0000 7f24ed326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:08.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.738+0000 7f24ed326800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:08.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.738+0000 7f24ed326800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:08.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.738+0000 7f24ed326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:08.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.738+0000 7f24ed326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:08.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.738+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.738+0000 7f24ed326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.738+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.738+0000 7f24ed326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:08.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.738+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.739+0000 7f24ed326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:08.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.739+0000 7f24ed326800 20 zone default found 2024-09-12T17:52:08.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.739+0000 7f24ed326800 4 Realm: () 2024-09-12T17:52:08.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.739+0000 7f24ed326800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:08.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.739+0000 7f24ed326800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:08.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.739+0000 7f24ed326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:08.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.739+0000 7f24ed326800 20 zonegroup default 2024-09-12T17:52:08.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.739+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.739+0000 7f24ed326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.739+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.740+0000 7f24ed326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.740+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.740+0000 7f24ed326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:08.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.740+0000 7f24ed326800 20 started sync module instance, tier type = 2024-09-12T17:52:08.742 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.740+0000 7f24ed326800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:08.750 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.749+0000 7f24ed326800 20 add_watcher() i=0 2024-09-12T17:52:08.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.749+0000 7f24ed326800 20 add_watcher() i=1 2024-09-12T17:52:08.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.749+0000 7f24ed326800 20 add_watcher() i=2 2024-09-12T17:52:08.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.749+0000 7f24ed326800 20 add_watcher() i=3 2024-09-12T17:52:08.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.749+0000 7f24ed326800 20 add_watcher() i=4 2024-09-12T17:52:08.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.749+0000 7f24ed326800 20 add_watcher() i=5 2024-09-12T17:52:08.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.749+0000 7f24ed326800 20 add_watcher() i=6 2024-09-12T17:52:08.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.750+0000 7f24ed326800 20 add_watcher() i=7 2024-09-12T17:52:08.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.750+0000 7f24ed326800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:08.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.752+0000 7f239f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:08.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.752+0000 7f24ed326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:08.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.752+0000 7f24ed326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:08.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.752+0000 7f24ed326800 5 note: GC not initialized 2024-09-12T17:52:08.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.752+0000 7f239e7e4640 20 reqs_thread_entry: start 2024-09-12T17:52:08.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.752+0000 7f24ed326800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:08.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.752+0000 7f24ed326800 20 Filter name: none 2024-09-12T17:52:08.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.753+0000 7f23977fe640 20 reqs_thread_entry: start 2024-09-12T17:52:08.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.753+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.753+0000 7f24ed326800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:08.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.753+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.754+0000 7f24ed326800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:08.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.754+0000 7f24ed326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:08.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.754+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.754+0000 7f24ed326800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:08.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.754+0000 7f24ed326800 20 rados->read ofs=0 len=0 2024-09-12T17:52:08.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.755+0000 7f24ed326800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:08.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.755+0000 7f24ed326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:08.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.756+0000 7f239f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:08.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.758+0000 7f24ed326800 20 remove_watcher() i=0 2024-09-12T17:52:08.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.758+0000 7f24ed326800 2 removed watcher, disabling cache 2024-09-12T17:52:08.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.759+0000 7f24ed326800 20 remove_watcher() i=1 2024-09-12T17:52:08.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.760+0000 7f24ed326800 20 remove_watcher() i=2 2024-09-12T17:52:08.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.761+0000 7f24ed326800 20 remove_watcher() i=3 2024-09-12T17:52:08.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.762+0000 7f24ed326800 20 remove_watcher() i=4 2024-09-12T17:52:08.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.763+0000 7f24ed326800 20 remove_watcher() i=5 2024-09-12T17:52:08.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.764+0000 7f24ed326800 20 remove_watcher() i=6 2024-09-12T17:52:08.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:08.765+0000 7f24ed326800 20 remove_watcher() i=7 2024-09-12T17:52:08.776 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:08.776 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:52:08.776 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-change-reshard-state id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.38 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:52:08.776 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:08.837 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T17:52:08.837 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:09.015 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:52:09.043 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:09.043 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:09.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.078+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.080+0000 7fe182abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.080+0000 7fe182abb800 20 realm 2024-09-12T17:52:09.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.080+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.081 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.080+0000 7fe182abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.080+0000 7fe182abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:09.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.080+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.080+0000 7fe182abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.080+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.081+0000 7fe182abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:09.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.081+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.082+0000 7fe182abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:09.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.082+0000 7fe182abb800 20 searching for the correct realm 2024-09-12T17:52:09.085 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.085+0000 7fe180da6640 0 -- 172.21.15.107:0/583554094 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x558e6fe31840 msgr2=0x558e6fe33d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:09.089 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.088+0000 7fe1805a5640 0 -- 172.21.15.107:0/583554094 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fe16806f060 msgr2=0x7fe1680669c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:52:09.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:09.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:09.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:09.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:09.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:09.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:09.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:09.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:09.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 zone default found 2024-09-12T17:52:09.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 4 Realm: () 2024-09-12T17:52:09.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:09.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:09.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:09.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 zonegroup default 2024-09-12T17:52:09.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.092+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.093+0000 7fe182abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.093+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.093+0000 7fe182abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.093+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.093+0000 7fe182abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.093+0000 7fe182abb800 20 started sync module instance, tier type = 2024-09-12T17:52:09.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.093+0000 7fe182abb800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:09.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.102+0000 7fe182abb800 20 add_watcher() i=0 2024-09-12T17:52:09.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.102+0000 7fe182abb800 20 add_watcher() i=1 2024-09-12T17:52:09.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.102+0000 7fe182abb800 20 add_watcher() i=2 2024-09-12T17:52:09.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.102+0000 7fe182abb800 20 add_watcher() i=3 2024-09-12T17:52:09.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.102+0000 7fe182abb800 20 add_watcher() i=4 2024-09-12T17:52:09.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.102+0000 7fe182abb800 20 add_watcher() i=5 2024-09-12T17:52:09.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.102+0000 7fe182abb800 20 add_watcher() i=6 2024-09-12T17:52:09.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.103+0000 7fe182abb800 20 add_watcher() i=7 2024-09-12T17:52:09.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.103+0000 7fe182abb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:09.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.105+0000 7fe036fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:09.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.105+0000 7fe182abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:09.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.105+0000 7fe182abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:09.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.105+0000 7fe182abb800 5 note: GC not initialized 2024-09-12T17:52:09.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.105+0000 7fe035fdb640 20 reqs_thread_entry: start 2024-09-12T17:52:09.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.105+0000 7fe182abb800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:09.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.105+0000 7fe182abb800 20 Filter name: none 2024-09-12T17:52:09.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.105+0000 7fdfa77fe640 20 reqs_thread_entry: start 2024-09-12T17:52:09.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.105+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.106+0000 7fe182abb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.106+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.107+0000 7fe182abb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.107+0000 7fe182abb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.107+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.107+0000 7fe182abb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.107+0000 7fe182abb800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.107+0000 7fe182abb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.107+0000 7fe182abb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:09.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.109+0000 7fe036fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:09.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.111+0000 7fe182abb800 20 remove_watcher() i=0 2024-09-12T17:52:09.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.111+0000 7fe182abb800 2 removed watcher, disabling cache 2024-09-12T17:52:09.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.112+0000 7fe182abb800 20 remove_watcher() i=1 2024-09-12T17:52:09.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.113+0000 7fe182abb800 20 remove_watcher() i=2 2024-09-12T17:52:09.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.114+0000 7fe182abb800 20 remove_watcher() i=3 2024-09-12T17:52:09.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.115+0000 7fe182abb800 20 remove_watcher() i=4 2024-09-12T17:52:09.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.116+0000 7fe182abb800 20 remove_watcher() i=5 2024-09-12T17:52:09.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.117+0000 7fe182abb800 20 remove_watcher() i=6 2024-09-12T17:52:09.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.118+0000 7fe182abb800 20 remove_watcher() i=7 2024-09-12T17:52:09.129 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:09.129 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:52:09.129 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-change-reshard-state id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:52:09.129 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:09.130 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T17:52:09.166 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:09.166 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:09.202 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.200+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.202+0000 7efd5cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.203 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.202+0000 7efd5cdaf800 20 realm 2024-09-12T17:52:09.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.202+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.202+0000 7efd5cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.202+0000 7efd5cdaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:09.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.202+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.202+0000 7efd5cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.202+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.203+0000 7efd5cdaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:09.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.203+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.204+0000 7efd5cdaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:09.205 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.204+0000 7efd5cdaf800 20 searching for the correct realm 2024-09-12T17:52:09.208 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.207+0000 7efd5b09a640 0 -- 172.21.15.107:0/313162235 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x55973b52a7f0 msgr2=0x55973b52cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:09.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.210+0000 7efd5a098640 0 -- 172.21.15.107:0/313162235 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7efd4404b070 msgr2=0x7efd4405f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:09.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:09.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:09.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:09.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:09.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:09.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:09.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:09.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:09.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 zone default found 2024-09-12T17:52:09.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 4 Realm: () 2024-09-12T17:52:09.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:09.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:09.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:09.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 zonegroup default 2024-09-12T17:52:09.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.214+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.215+0000 7efd5cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.215+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.215+0000 7efd5cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.215+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.215+0000 7efd5cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.215+0000 7efd5cdaf800 20 started sync module instance, tier type = 2024-09-12T17:52:09.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.215+0000 7efd5cdaf800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:09.225 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.224+0000 7efd5cdaf800 20 add_watcher() i=0 2024-09-12T17:52:09.225 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.224+0000 7efd5cdaf800 20 add_watcher() i=1 2024-09-12T17:52:09.225 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.224+0000 7efd5cdaf800 20 add_watcher() i=2 2024-09-12T17:52:09.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.224+0000 7efd5cdaf800 20 add_watcher() i=3 2024-09-12T17:52:09.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.224+0000 7efd5cdaf800 20 add_watcher() i=4 2024-09-12T17:52:09.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.224+0000 7efd5cdaf800 20 add_watcher() i=5 2024-09-12T17:52:09.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.224+0000 7efd5cdaf800 20 add_watcher() i=6 2024-09-12T17:52:09.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.225+0000 7efd5cdaf800 20 add_watcher() i=7 2024-09-12T17:52:09.226 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.225+0000 7efd5cdaf800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:09.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.227+0000 7efc117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:09.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.227+0000 7efd5cdaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:09.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.227+0000 7efd5cdaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:09.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.228+0000 7efd5cdaf800 5 note: GC not initialized 2024-09-12T17:52:09.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.228+0000 7efb8bfff640 20 reqs_thread_entry: start 2024-09-12T17:52:09.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.228+0000 7efd5cdaf800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:09.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.228+0000 7efd5cdaf800 20 Filter name: none 2024-09-12T17:52:09.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.228+0000 7efb89ffb640 20 reqs_thread_entry: start 2024-09-12T17:52:09.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.228+0000 7efd5cdaf800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:52:09.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.228+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.228+0000 7efd5cdaf800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:09.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.228+0000 7efd5cdaf800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:52:09.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.228+0000 7efd5cdaf800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:52:09.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.228+0000 7efd5cdaf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 : miss 2024-09-12T17:52:09.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.228+0000 7efd5cdaf800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.229+0000 7efd5cdaf800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:09.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.229+0000 7efd5cdaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 info.flags=0x17 2024-09-12T17:52:09.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.229+0000 7efd5cdaf800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 to cache LRU end 2024-09-12T17:52:09.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.229+0000 7efd5cdaf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:09.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.229+0000 7efd5cdaf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:09.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.229+0000 7efd5cdaf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 2024-09-12T17:52:09.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.232+0000 7efd5cdaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 info.flags=0x17 2024-09-12T17:52:09.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.232+0000 7efd5cdaf800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 to cache LRU end 2024-09-12T17:52:09.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.232+0000 7efd5cdaf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:09.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.232+0000 7efd5cdaf800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39, ofs0, ns] 2024-09-12T17:52:09.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.233+0000 7efc3e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464331 cookie 94108023762608 notifier 7887 bl.length()=1015 2024-09-12T17:52:09.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.233+0000 7efc3e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 info.flags=0x17 2024-09-12T17:52:09.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.233+0000 7efc3e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 to cache LRU end 2024-09-12T17:52:09.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.233+0000 7efc3e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:09.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.233+0000 7efd5cdaf800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.39]): orig_sources= new_sources= 2024-09-12T17:52:09.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.233+0000 7efd5cdaf800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.39]): potential sources added=[] removed=[] 2024-09-12T17:52:09.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.233+0000 7efd5cdaf800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.39]): orig_dests= new_dests= 2024-09-12T17:52:09.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.233+0000 7efd5cdaf800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.39]): potential dests added=[] removed=[] 2024-09-12T17:52:09.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.235+0000 7efd5cdaf800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.39.1.0 2024-09-12T17:52:09.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.235+0000 7efd5cdaf800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.39.1.0 2024-09-12T17:52:09.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.235+0000 7efd5cdaf800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.39.1.1 2024-09-12T17:52:09.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.235+0000 7efd5cdaf800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.39.1.1 2024-09-12T17:52:09.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.235+0000 7efd5cdaf800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.39.0 2024-09-12T17:52:09.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.237+0000 7efd5cdaf800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T17:52:09.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.237+0000 7efd5cdaf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:52:09.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.237+0000 7efd5cdaf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 2024-09-12T17:52:09.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.238+0000 7efd5cdaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 info.flags=0x17 2024-09-12T17:52:09.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.238+0000 7efd5cdaf800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 to cache LRU end 2024-09-12T17:52:09.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.238+0000 7efd5cdaf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:09.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.238+0000 7efd5cdaf800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39, ofs0, ns] 2024-09-12T17:52:09.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.239+0000 7efc3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 94108023762608 notifier 7887 bl.length()=1015 2024-09-12T17:52:09.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.239+0000 7efc3dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 info.flags=0x17 2024-09-12T17:52:09.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.239+0000 7efc3dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 to cache LRU end 2024-09-12T17:52:09.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.239+0000 7efc3dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:09.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.239+0000 7efd5cdaf800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.39]): orig_sources= new_sources= 2024-09-12T17:52:09.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.239+0000 7efd5cdaf800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.39]): potential sources added=[] removed=[] 2024-09-12T17:52:09.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.239+0000 7efd5cdaf800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.39]): orig_dests= new_dests= 2024-09-12T17:52:09.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.239+0000 7efd5cdaf800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.39]): potential dests added=[] removed=[] 2024-09-12T17:52:09.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.240+0000 7efd5cdaf800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.39.0 2024-09-12T17:52:09.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.241+0000 7efd5cdaf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:52:09.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.241+0000 7efd5cdaf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 2024-09-12T17:52:09.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.242+0000 7efd5cdaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 info.flags=0x17 2024-09-12T17:52:09.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.242+0000 7efd5cdaf800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 to cache LRU end 2024-09-12T17:52:09.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.242+0000 7efd5cdaf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:09.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.242+0000 7efd5cdaf800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39, ofs0, ns] 2024-09-12T17:52:09.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.242+0000 7efc3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464333 cookie 94108023762608 notifier 7887 bl.length()=983 2024-09-12T17:52:09.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.242+0000 7efc3dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 info.flags=0x17 2024-09-12T17:52:09.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.242+0000 7efc3dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 to cache LRU end 2024-09-12T17:52:09.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.242+0000 7efc3dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:09.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.243+0000 7efd5cdaf800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.39]): orig_sources= new_sources= 2024-09-12T17:52:09.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.243+0000 7efd5cdaf800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.39]): potential sources added=[] removed=[] 2024-09-12T17:52:09.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.243+0000 7efd5cdaf800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.39]): orig_dests= new_dests= 2024-09-12T17:52:09.245 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.243+0000 7efd5cdaf800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.39]): potential dests added=[] removed=[] 2024-09-12T17:52:09.246 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.245+0000 7efd5cdaf800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T17:52:09.247 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.247+0000 7efc117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:09.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.249+0000 7efd5cdaf800 20 remove_watcher() i=0 2024-09-12T17:52:09.250 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.249+0000 7efd5cdaf800 2 removed watcher, disabling cache 2024-09-12T17:52:09.251 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.250+0000 7efd5cdaf800 20 remove_watcher() i=1 2024-09-12T17:52:09.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.251+0000 7efd5cdaf800 20 remove_watcher() i=2 2024-09-12T17:52:09.253 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.252+0000 7efd5cdaf800 20 remove_watcher() i=3 2024-09-12T17:52:09.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.253+0000 7efd5cdaf800 20 remove_watcher() i=4 2024-09-12T17:52:09.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.254+0000 7efd5cdaf800 20 remove_watcher() i=5 2024-09-12T17:52:09.256 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.255+0000 7efd5cdaf800 20 remove_watcher() i=6 2024-09-12T17:52:09.257 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.256+0000 7efd5cdaf800 20 remove_watcher() i=7 2024-09-12T17:52:09.269 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:52:09.297 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:09.297 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:09.333 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.332+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.333+0000 7fe28bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.333+0000 7fe28bf26800 20 realm 2024-09-12T17:52:09.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.333+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.334+0000 7fe28bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.334+0000 7fe28bf26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:09.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.334+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.334+0000 7fe28bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.334+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.335+0000 7fe28bf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:09.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.335+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.335+0000 7fe28bf26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:09.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.335+0000 7fe28bf26800 20 searching for the correct realm 2024-09-12T17:52:09.339 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.338+0000 7fe27f44a640 0 -- 172.21.15.107:0/3664664002 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fe270036070 msgr2=0x7fe2700389f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:09.342 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.341+0000 7fe287c4b640 0 -- 172.21.15.107:0/3664664002 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fe27005d060 msgr2=0x7fe27005d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:09.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:09.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:09.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:09.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:09.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:09.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:09.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:09.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:09.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 20 zone default found 2024-09-12T17:52:09.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 4 Realm: () 2024-09-12T17:52:09.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:09.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.547+0000 7fe28bf26800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:09.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.548+0000 7fe28bf26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:09.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.548+0000 7fe28bf26800 20 zonegroup default 2024-09-12T17:52:09.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.548+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.548+0000 7fe28bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.548+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.548+0000 7fe28bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.548+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.548+0000 7fe28bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.548+0000 7fe28bf26800 20 started sync module instance, tier type = 2024-09-12T17:52:09.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.548+0000 7fe28bf26800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:09.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.557+0000 7fe28bf26800 20 add_watcher() i=0 2024-09-12T17:52:09.558 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.557+0000 7fe28bf26800 20 add_watcher() i=1 2024-09-12T17:52:09.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.557+0000 7fe28bf26800 20 add_watcher() i=2 2024-09-12T17:52:09.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.557+0000 7fe28bf26800 20 add_watcher() i=3 2024-09-12T17:52:09.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.557+0000 7fe28bf26800 20 add_watcher() i=4 2024-09-12T17:52:09.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.557+0000 7fe28bf26800 20 add_watcher() i=5 2024-09-12T17:52:09.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.557+0000 7fe28bf26800 20 add_watcher() i=6 2024-09-12T17:52:09.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.558+0000 7fe28bf26800 20 add_watcher() i=7 2024-09-12T17:52:09.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.558+0000 7fe28bf26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:09.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.560+0000 7fe13dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:09.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.560+0000 7fe28bf26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:09.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.560+0000 7fe28bf26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:09.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.560+0000 7fe28bf26800 5 note: GC not initialized 2024-09-12T17:52:09.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.560+0000 7fe13cfe1640 20 reqs_thread_entry: start 2024-09-12T17:52:09.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.560+0000 7fe28bf26800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:09.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.560+0000 7fe28bf26800 20 Filter name: none 2024-09-12T17:52:09.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.561+0000 7fe0b67fc640 20 reqs_thread_entry: start 2024-09-12T17:52:09.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.561+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.561+0000 7fe28bf26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:09.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.561+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.561+0000 7fe28bf26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:09.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.561+0000 7fe28bf26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:09.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.561+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.562+0000 7fe28bf26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:09.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.562+0000 7fe28bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.562+0000 7fe28bf26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:09.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.562+0000 7fe28bf26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:09.564 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.563+0000 7fe13dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:09.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.565+0000 7fe28bf26800 20 remove_watcher() i=0 2024-09-12T17:52:09.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.565+0000 7fe28bf26800 2 removed watcher, disabling cache 2024-09-12T17:52:09.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.566+0000 7fe28bf26800 20 remove_watcher() i=1 2024-09-12T17:52:09.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.567+0000 7fe28bf26800 20 remove_watcher() i=2 2024-09-12T17:52:09.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.568+0000 7fe28bf26800 20 remove_watcher() i=3 2024-09-12T17:52:09.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.569+0000 7fe28bf26800 20 remove_watcher() i=4 2024-09-12T17:52:09.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.570+0000 7fe28bf26800 20 remove_watcher() i=5 2024-09-12T17:52:09.572 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.571+0000 7fe28bf26800 20 remove_watcher() i=6 2024-09-12T17:52:09.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.572+0000 7fe28bf26800 20 remove_watcher() i=7 2024-09-12T17:52:09.583 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:09.583 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:52:09.583 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: error-at-change-reshard-state id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.39 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:52:09.583 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:09.644 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T17:52:09.644 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:09.818 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:52:09.846 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:09.846 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:09.881 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.880+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.882+0000 7f6b47e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.883 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.882+0000 7f6b47e40800 20 realm 2024-09-12T17:52:09.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.882+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.882+0000 7f6b47e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.882+0000 7f6b47e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:09.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.882+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.882+0000 7f6b47e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.882+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.883+0000 7f6b47e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:09.884 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.883+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.884+0000 7f6b47e40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:09.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.884+0000 7f6b47e40800 20 searching for the correct realm 2024-09-12T17:52:09.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.887+0000 7f6b4612b640 0 -- 172.21.15.107:0/4154863567 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5604e2727090 msgr2=0x5604e2729550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:09.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.890+0000 7f6b4592a640 0 -- 172.21.15.107:0/4154863567 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f6b30009040 msgr2=0x7f6b3004ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:09.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:09.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:09.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:09.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:09.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:09.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:09.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:09.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:09.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 zone default found 2024-09-12T17:52:09.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 4 Realm: () 2024-09-12T17:52:09.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:09.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:09.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:09.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 zonegroup default 2024-09-12T17:52:09.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.897 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.894+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.895+0000 7f6b47e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.895+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.895+0000 7f6b47e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:09.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.895+0000 7f6b47e40800 20 started sync module instance, tier type = 2024-09-12T17:52:09.898 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.895+0000 7f6b47e40800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:09.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.904+0000 7f6b47e40800 20 add_watcher() i=0 2024-09-12T17:52:09.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.904+0000 7f6b47e40800 20 add_watcher() i=1 2024-09-12T17:52:09.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.904+0000 7f6b47e40800 20 add_watcher() i=2 2024-09-12T17:52:09.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.904+0000 7f6b47e40800 20 add_watcher() i=3 2024-09-12T17:52:09.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.904+0000 7f6b47e40800 20 add_watcher() i=4 2024-09-12T17:52:09.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.904+0000 7f6b47e40800 20 add_watcher() i=5 2024-09-12T17:52:09.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.904+0000 7f6b47e40800 20 add_watcher() i=6 2024-09-12T17:52:09.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.905+0000 7f6b47e40800 20 add_watcher() i=7 2024-09-12T17:52:09.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.905+0000 7f6b47e40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:09.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.906+0000 7f69f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:09.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.907+0000 7f6b47e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:09.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.907+0000 7f6b47e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:09.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.907+0000 7f6b47e40800 5 note: GC not initialized 2024-09-12T17:52:09.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.907+0000 7f69f67fc640 20 reqs_thread_entry: start 2024-09-12T17:52:09.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.907+0000 7f6b47e40800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:09.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.907+0000 7f6b47e40800 20 Filter name: none 2024-09-12T17:52:09.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.907+0000 7f6967fff640 20 reqs_thread_entry: start 2024-09-12T17:52:09.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.907+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.908+0000 7f6b47e40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:09.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.908+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.908+0000 7f6b47e40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:09.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.908+0000 7f6b47e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:09.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.908+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.909+0000 7f6b47e40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:09.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.909+0000 7f6b47e40800 20 rados->read ofs=0 len=0 2024-09-12T17:52:09.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.909+0000 7f6b47e40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:09.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.909+0000 7f6b47e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:09.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.910+0000 7f69f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:09.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.913+0000 7f6b47e40800 20 remove_watcher() i=0 2024-09-12T17:52:09.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.913+0000 7f6b47e40800 2 removed watcher, disabling cache 2024-09-12T17:52:09.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.914+0000 7f6b47e40800 20 remove_watcher() i=1 2024-09-12T17:52:09.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.915+0000 7f6b47e40800 20 remove_watcher() i=2 2024-09-12T17:52:09.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.916+0000 7f6b47e40800 20 remove_watcher() i=3 2024-09-12T17:52:09.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.917+0000 7f6b47e40800 20 remove_watcher() i=4 2024-09-12T17:52:09.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.918+0000 7f6b47e40800 20 remove_watcher() i=5 2024-09-12T17:52:09.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.919+0000 7f6b47e40800 20 remove_watcher() i=6 2024-09-12T17:52:09.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:09.920+0000 7f6b47e40800 20 remove_watcher() i=7 2024-09-12T17:52:09.931 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:09.931 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:52:09.931 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-change-reshard-state id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:52:09.931 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:09.933 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:52:09.967 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:09.967 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:10.003 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.002+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.004+0000 7f84ab811800 20 realm 2024-09-12T17:52:10.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.004+0000 7f84ab811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:10.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.005+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:10.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.005+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.006+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:10.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.006+0000 7f84ab811800 20 searching for the correct realm 2024-09-12T17:52:10.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.008+0000 7f849ffff640 0 -- 172.21.15.107:0/3333412071 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f8490057c30 msgr2=0x7f8490088420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:10.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.011+0000 7f84a6f22640 0 -- 172.21.15.107:0/3333412071 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f8490099930 msgr2=0x7f84900643f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:10.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:10.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:10.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:10.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:10.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:10.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:10.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.216+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:10.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:10.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 20 zone default found 2024-09-12T17:52:10.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 4 Realm: () 2024-09-12T17:52:10.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:10.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:10.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:10.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 20 zonegroup default 2024-09-12T17:52:10.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.218+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.218+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.218+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.218+0000 7f84ab811800 20 started sync module instance, tier type = 2024-09-12T17:52:10.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.218+0000 7f84ab811800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:10.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=0 2024-09-12T17:52:10.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=1 2024-09-12T17:52:10.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=2 2024-09-12T17:52:10.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=3 2024-09-12T17:52:10.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=4 2024-09-12T17:52:10.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=5 2024-09-12T17:52:10.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=6 2024-09-12T17:52:10.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.228+0000 7f84ab811800 20 add_watcher() i=7 2024-09-12T17:52:10.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.228+0000 7f84ab811800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:10.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.230+0000 7f835d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:10.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.230+0000 7f84ab811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:10.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.230+0000 7f84ab811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:10.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.230+0000 7f84ab811800 5 note: GC not initialized 2024-09-12T17:52:10.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.230+0000 7f82d7fff640 20 reqs_thread_entry: start 2024-09-12T17:52:10.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.230+0000 7f84ab811800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:10.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.230+0000 7f84ab811800 20 Filter name: none 2024-09-12T17:52:10.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f82d5ffb640 20 reqs_thread_entry: start 2024-09-12T17:52:10.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:52:10.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:10.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:52:10.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:52:10.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 : miss 2024-09-12T17:52:10.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:10.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:10.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:10.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:10.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:10.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.231+0000 7f84ab811800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 2024-09-12T17:52:10.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.235+0000 7f84ab811800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:10.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.235+0000 7f84ab811800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:10.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.235+0000 7f84ab811800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:10.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.235+0000 7f84ab811800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40, ofs0, ns] 2024-09-12T17:52:10.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.235+0000 7f838a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 93946060162928 notifier 7941 bl.length()=1015 2024-09-12T17:52:10.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.235+0000 7f838a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:10.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.235+0000 7f838a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:10.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.235+0000 7f838a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:10.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.236+0000 7f84ab811800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): orig_sources= new_sources= 2024-09-12T17:52:10.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.236+0000 7f84ab811800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): potential sources added=[] removed=[] 2024-09-12T17:52:10.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.236+0000 7f84ab811800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): orig_dests= new_dests= 2024-09-12T17:52:10.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.236+0000 7f84ab811800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): potential dests added=[] removed=[] 2024-09-12T17:52:10.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.238+0000 7f84ab811800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.1.0 2024-09-12T17:52:10.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.238+0000 7f84ab811800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.1.0 2024-09-12T17:52:10.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.238+0000 7f84ab811800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.1.1 2024-09-12T17:52:10.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.238+0000 7f84ab811800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.1.1 2024-09-12T17:52:10.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.238+0000 7f84ab811800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.0 2024-09-12T17:52:10.242 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84ab811800 time 2024-09-12T17:52:10.242112+0000 2024-09-12T17:52:10.242 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:52:10.243 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:10.243 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84ac98c71a] 2024-09-12T17:52:10.243 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84ac98c8d8] 2024-09-12T17:52:10.243 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571832b3841] 2024-09-12T17:52:10.243 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5571832c2734] 2024-09-12T17:52:10.243 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571832c35d4] 2024-09-12T17:52:10.243 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:52:10.243 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f84ab629590] 2024-09-12T17:52:10.243 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:52:10.243 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f84ab811800 thread_name:radosgw-admin 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.241+0000 7f84ab811800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84ab811800 time 2024-09-12T17:52:10.242112+0000 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84ac98c71a] 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84ac98c8d8] 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571832b3841] 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5571832c2734] 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571832c35d4] 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f84ab629590] 2024-09-12T17:52:10.244 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:52:10.245 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:52:10.245 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.260 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:10.260 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f84ab63e6f0] 2024-09-12T17:52:10.260 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f84ab68b99c] 2024-09-12T17:52:10.260 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:52:10.260 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:52:10.260 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84ac98c774] 2024-09-12T17:52:10.260 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84ac98c8d8] 2024-09-12T17:52:10.260 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571832b3841] 2024-09-12T17:52:10.260 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5571832c2734] 2024-09-12T17:52:10.261 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571832c35d4] 2024-09-12T17:52:10.261 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:52:10.261 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f84ab629590] 2024-09-12T17:52:10.261 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:52:10.261 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:52:10.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.242+0000 7f84ab811800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:52:10.261 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f84ab811800 thread_name:radosgw-admin 2024-09-12T17:52:10.261 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.261 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:10.261 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f84ab63e6f0] 2024-09-12T17:52:10.261 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f84ab68b99c] 2024-09-12T17:52:10.261 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84ac98c774] 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84ac98c8d8] 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571832b3841] 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5571832c2734] 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571832c35d4] 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f84ab629590] 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.262 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:52:09.985+0000 7f8394e09640 10 monclient: dump: 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:52:09.986+0000 7f84ab811800 10 monclient: shutdown 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 asok(0x557185596730) unregister_commands rotate-key 2024-09-12T17:52:10.263 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:52:09.986+0000 7f84ab811800 10 monclient: build_initial_monmap 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:52:09.986+0000 7f84ab811800 1 build_initial for_mkfs: 0 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:52:09.986+0000 7f84ab811800 10 monclient: monmap: 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.264 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding auth protocol: cephx 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding auth protocol: cephx 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding auth protocol: cephx 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: secure 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: crc 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: secure 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: crc 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: secure 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: crc 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: crc 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: secure 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: crc 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: secure 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: crc 2024-09-12T17:52:10.265 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: secure 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:52:09.986+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:52:09.986+0000 7f84ab811800 1 librados: starting msgr at 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:52:09.986+0000 7f84ab811800 1 librados: starting objecter 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 asok(0x557185596730) register_command objecter_requests hook 0x5571857bbb10 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:52:09.986+0000 7f84ab811800 1 librados: setting wanted keys 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:52:09.986+0000 7f84ab811800 1 librados: calling monclient init 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:52:09.986+0000 7f84ab811800 10 monclient: init 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding auth protocol: cephx 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding auth protocol: cephx 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding auth protocol: cephx 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: secure 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: crc 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: secure 2024-09-12T17:52:10.266 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: crc 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: secure 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: crc 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: crc 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: secure 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: crc 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: secure 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: crc 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: secure 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:52:09.987+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:52:09.987+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:52:09.987+0000 7f84ab811800 5 asok(0x557185596730) register_command rotate-key hook 0x5571857b8b38 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:10.267 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-c con 0x55718566fba0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-b con 0x5571856fb110 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-a con 0x557185701560 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): authenticate will time out at 2134.533403s 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): get_auth_request con 0x55718566fba0 auth_method 0 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.268 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): get_auth_request con 0x557185701560 auth_method 0 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): get_auth_request con 0x5571856fb110 auth_method 0 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.269 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): handle_auth_done global_id 7932 payload 824 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient: _finish_hunting 0 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:52:09.987+0000 7f84a7723640 1 monclient: found mon.noname-a 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: dump: 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.270 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: _finish_auth 0 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: _check_auth_tickets 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: dump: 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.271 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:52:09.988+0000 7f84ab811800 5 monclient: authenticate success, global_id 7932 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:52:09.988+0000 7f84ab811800 10 monclient: _renew_subs 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:52:09.988+0000 7f84ab811800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:52:09.988+0000 7f8394e09640 4 set_mon_vals no callback set 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:52:09.988+0000 7f84ab811800 10 monclient: _renew_subs 2024-09-12T17:52:10.272 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:52:09.988+0000 7f84ab811800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:52:09.988+0000 7f84ab811800 1 librados: init done 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:52:09.990+0000 7f8393606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:52:09.990+0000 7f8393606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:52:09.990+0000 7f8393606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:52:09.990+0000 7f84a6f22640 10 monclient: get_auth_request con 0x7f838c0764a0 auth_method 0 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:52:09.990+0000 7f849ffff640 10 monclient: get_auth_request con 0x5571857f73b0 auth_method 0 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:52:09.991+0000 7f84a6f22640 10 monclient: get_auth_request con 0x557185803d80 auth_method 0 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:52:09.992+0000 7f849ffff640 10 monclient: get_auth_request con 0x557185807fc0 auth_method 0 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:52:09.993+0000 7f84ab811800 10 monclient: build_initial_monmap 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:52:09.993+0000 7f84ab811800 1 build_initial for_mkfs: 0 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:52:09.993+0000 7f84ab811800 10 monclient: monmap: 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:10.273 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding auth protocol: cephx 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding auth protocol: cephx 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding auth protocol: cephx 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: secure 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: crc 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: secure 2024-09-12T17:52:10.274 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: crc 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: secure 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: crc 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: crc 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: secure 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: crc 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: secure 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: crc 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: secure 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:52:09.993+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 asok(0x557185596730) register_command objecter_requests cmddesc objecter_requests hook 0x5571858107e0 EEXIST 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:52:09.993+0000 7f84ab811800 10 monclient: init 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding auth protocol: cephx 2024-09-12T17:52:10.275 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding auth protocol: cephx 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding auth protocol: cephx 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: secure 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: crc 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: secure 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: crc 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: secure 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: crc 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: crc 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: secure 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: crc 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: secure 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: crc 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: secure 2024-09-12T17:52:10.276 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:52:09.994+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:52:09.994+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:52:09.994+0000 7f84ab811800 5 asok(0x557185596730) register_command rotate-key cmddesc rotate-key hook 0x55718580b640 EEXIST 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-c con 0x5571858344d0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-b con 0x5571858367a0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-a con 0x557185832ca0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): authenticate will time out at 2134.540361s 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): get_auth_request con 0x5571858344d0 auth_method 0 2024-09-12T17:52:10.277 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): get_auth_request con 0x557185832ca0 auth_method 0 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): get_auth_request con 0x5571858367a0 auth_method 0 2024-09-12T17:52:10.278 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): handle_auth_done global_id 7469 payload 824 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient: _finish_hunting 0 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:52:09.994+0000 7f84a6f22640 1 monclient: found mon.noname-c 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:52:09.994+0000 7f8390e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:52:09.994+0000 7f8390e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:52:09.994+0000 7f8390e01640 10 monclient: dump: 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.279 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:52:09.995+0000 7f8390e01640 10 monclient: _finish_auth 0 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:52:09.995+0000 7f8390e01640 10 monclient: _check_auth_tickets 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:52:09.995+0000 7f8390e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:52:09.995+0000 7f84ab811800 5 monclient: authenticate success, global_id 7469 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:52:09.995+0000 7f8390e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.280 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:52:09.995+0000 7f8390e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:52:09.995+0000 7f8390e01640 10 monclient: dump: 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:52:09.995+0000 7f84ab811800 10 monclient: _renew_subs 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:52:09.995+0000 7f84ab811800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:52:10.281 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:52:09.995+0000 7f84a7f24640 4 set_mon_vals no callback set 2024-09-12T17:52:10.282 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:52:09.995+0000 7f84ab811800 10 monclient: _renew_subs 2024-09-12T17:52:10.282 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:52:09.995+0000 7f84ab811800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:52:10.282 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:52:09.996+0000 7f8390e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:52:10.282 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:52:09.996+0000 7f8390e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:10.282 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:52:09.996+0000 7f8390e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:10.282 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:52:09.997+0000 7f849ffff640 10 monclient: get_auth_request con 0x7f8380076380 auth_method 0 2024-09-12T17:52:10.282 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:52:09.997+0000 7f84ab811800 10 monclient: get_monmap_and_config 2024-09-12T17:52:10.282 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:52:09.997+0000 7f84ab811800 10 monclient: build_initial_monmap 2024-09-12T17:52:10.282 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:52:09.997+0000 7f84ab811800 1 build_initial for_mkfs: 0 2024-09-12T17:52:10.282 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:52:09.997+0000 7f84ab811800 10 monclient: monmap: 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding auth protocol: cephx 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding auth protocol: cephx 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding auth protocol: cephx 2024-09-12T17:52:10.283 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: secure 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: crc 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: secure 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: crc 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: secure 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: crc 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: crc 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: secure 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: crc 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: secure 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: crc 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: secure 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:52:09.997+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:52:09.997+0000 7f84ab811800 10 monclient: init 2024-09-12T17:52:10.284 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding auth protocol: cephx 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding auth protocol: cephx 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding auth protocol: cephx 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: secure 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: crc 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: secure 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: crc 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: secure 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: crc 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: crc 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: secure 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: crc 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: secure 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: crc 2024-09-12T17:52:10.285 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: secure 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:52:09.997+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:52:09.998+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:52:09.998+0000 7f84ab811800 5 asok(0x557185596730) register_command rotate-key cmddesc rotate-key hook 0x7ffe48fd0018 EEXIST 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-c con 0x5571858889a0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-b con 0x5571858792f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-a con 0x557185883dd0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): authenticate will time out at 2134.544297s 2024-09-12T17:52:10.286 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): get_auth_request con 0x5571858889a0 auth_method 0 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): get_auth_request con 0x557185883dd0 auth_method 0 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:52:09.998+0000 7f849ffff640 10 monclient(hunting): get_auth_request con 0x5571858792f0 auth_method 0 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:52:09.998+0000 7f849ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:52:09.998+0000 7f849ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.287 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:52:09.998+0000 7f849ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): handle_auth_done global_id 7938 payload 274 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient: _finish_hunting 0 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:52:09.998+0000 7f84a7723640 1 monclient: found mon.noname-a 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: dump: 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.288 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:52:09.998+0000 7f84ab811800 5 monclient: authenticate success, global_id 7938 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient: get_monmap_and_config success 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:52:09.998+0000 7f84ab811800 4 set_mon_vals no callback set 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.289 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: dump: 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:52:09.999+0000 7f84ab811800 10 monclient: shutdown 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:52:09.999+0000 7f84ab811800 10 monclient: build_initial_monmap 2024-09-12T17:52:10.290 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:52:09.999+0000 7f84ab811800 1 build_initial for_mkfs: 0 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:52:09.999+0000 7f84ab811800 10 monclient: monmap: 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding auth protocol: cephx 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding auth protocol: cephx 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding auth protocol: cephx 2024-09-12T17:52:10.291 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: secure 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: crc 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: secure 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: crc 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: secure 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: crc 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: crc 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: secure 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: crc 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: secure 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: crc 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: secure 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:52:09.999+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:52:09.999+0000 7f84ab811800 1 librados: starting msgr at 2024-09-12T17:52:10.292 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:52:09.999+0000 7f84ab811800 1 librados: starting objecter 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 asok(0x557185596730) register_command objecter_requests cmddesc objecter_requests hook 0x557185834b20 EEXIST 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:52:09.999+0000 7f84ab811800 1 librados: setting wanted keys 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:52:09.999+0000 7f84ab811800 1 librados: calling monclient init 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:52:09.999+0000 7f84ab811800 10 monclient: init 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding auth protocol: cephx 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding auth protocol: cephx 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding auth protocol: cephx 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: secure 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: crc 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: secure 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: crc 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: secure 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: crc 2024-09-12T17:52:10.293 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: crc 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: secure 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: crc 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: secure 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: crc 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: secure 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:52:10.000+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:52:10.000+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:52:10.000+0000 7f84ab811800 5 asok(0x557185596730) register_command rotate-key cmddesc rotate-key hook 0x55718584c3c8 EEXIST 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-a con 0x5571858792f0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-c con 0x557185883dd0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-b con 0x5571858889a0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:10.294 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): authenticate will time out at 2134.546490s 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): get_auth_request con 0x5571858792f0 auth_method 0 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): get_auth_request con 0x557185883dd0 auth_method 0 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.295 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): handle_auth_done global_id 7941 payload 824 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient: _finish_hunting 0 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:52:10.000+0000 7f84a6f22640 1 monclient: found mon.noname-a 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: dump: 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.296 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.297 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.297 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.297 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.297 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.297 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.297 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.297 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.297 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.297 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: _finish_auth 0 2024-09-12T17:52:10.297 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:52:10.001+0000 7f84ab811800 5 monclient: authenticate success, global_id 7941 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: dump: 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.298 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:52:10.001+0000 7f838a7fc640 4 set_mon_vals no callback set 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:52:10.001+0000 7f84ab811800 10 monclient: _renew_subs 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:52:10.001+0000 7f84ab811800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:52:10.001+0000 7f84ab811800 10 monclient: _renew_subs 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:52:10.001+0000 7f84ab811800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:52:10.001+0000 7f84ab811800 1 librados: init done 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:52:10.001+0000 7f84ab811800 5 asok(0x557185596730) register_command cr dump hook 0x55718587bb98 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:52:10.002+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:52:10.003+0000 7f8388ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:52:10.003+0000 7f8388ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:52:10.003+0000 7f8388ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:52:10.003+0000 7f849ffff640 10 monclient: get_auth_request con 0x7f8370076470 auth_method 0 2024-09-12T17:52:10.299 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:52:10.003+0000 7f84a7723640 10 monclient: get_auth_request con 0x5571858a2da0 auth_method 0 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 realm 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:52:10.004+0000 7f84ab811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:52:10.004+0000 7f84a6f22640 10 monclient: get_auth_request con 0x5571858a6fb0 auth_method 0 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:52:10.005+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:52:10.005+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:52:10.005+0000 7f849ffff640 10 monclient: get_auth_request con 0x5571858aa7f0 auth_method 0 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:52:10.006+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:10.300 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:52:10.006+0000 7f84ab811800 20 searching for the correct realm 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:52:10.006+0000 7f84a7723640 10 monclient: get_auth_request con 0x5571858af5b0 auth_method 0 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:52:10.006+0000 7f84a6f22640 10 monclient: get_auth_request con 0x7f84a0067ba0 auth_method 0 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:52:10.007+0000 7f849ffff640 10 monclient: get_auth_request con 0x7f8490057c30 auth_method 0 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:52:10.008+0000 7f849ffff640 0 -- 172.21.15.107:0/3333412071 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f8490057c30 msgr2=0x7f8490088420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:52:10.008+0000 7f8388ff9640 1 client.7941.objecter ms_handle_reset 0x7f8490057c30 session 0x7f8490081040 osd.4 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:52:10.008+0000 7f8388ff9640 10 monclient: _renew_subs 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:52:10.008+0000 7f8388ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:52:10.008+0000 7f849ffff640 10 monclient: get_auth_request con 0x7f8370086ba0 auth_method 0 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:52:10.009+0000 7f84a7723640 10 monclient: get_auth_request con 0x7f8490099040 auth_method 0 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:52:10.011+0000 7f84a6f22640 10 monclient: get_auth_request con 0x7f8490099930 auth_method 0 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:52:10.011+0000 7f84a6f22640 0 -- 172.21.15.107:0/3333412071 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f8490099930 msgr2=0x7f84900643f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:52:10.212+0000 7f84a6f22640 10 monclient: get_auth_request con 0x7f8490099930 auth_method 0 2024-09-12T17:52:10.301 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 zone default found 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:52:10.217+0000 7f84ab811800 4 Realm: () 2024-09-12T17:52:10.302 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:52:10.217+0000 7f84ab811800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:52:10.217+0000 7f84ab811800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:52:10.217+0000 7f84ab811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 zonegroup default 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:52:10.218+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:52:10.218+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:52:10.218+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:52:10.218+0000 7f84ab811800 20 started sync module instance, tier type = 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:52:10.218+0000 7f84ab811800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=0 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=1 2024-09-12T17:52:10.303 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=2 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=3 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=4 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=5 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=6 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:52:10.228+0000 7f84ab811800 20 add_watcher() i=7 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:52:10.228+0000 7f84ab811800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding auth protocol: cephx 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding auth protocol: cephx 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding auth protocol: cephx 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: secure 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: crc 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: secure 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: crc 2024-09-12T17:52:10.304 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: secure 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: crc 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: crc 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: secure 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: crc 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: secure 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:52:10.230+0000 7f835d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: crc 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: secure 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:52:10.230+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:52:10.230+0000 7f84ab811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:52:10.230+0000 7f84ab811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command cache list hook 0x557185881730 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command cache inspect hook 0x557185881730 2024-09-12T17:52:10.305 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command cache erase hook 0x557185881730 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command cache zap hook 0x557185881730 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 note: GC not initialized 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:52:10.230+0000 7f82d7fff640 20 reqs_thread_entry: start 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command sync trace show hook 0x7f8498004680 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command sync trace history hook 0x7f8498004680 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command sync trace active hook 0x7f8498004680 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command sync trace active_short hook 0x7f8498004680 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:52:10.230+0000 7f84ab811800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:52:10.230+0000 7f84ab811800 20 Filter name: none 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:52:10.231+0000 7f82d5ffb640 20 reqs_thread_entry: start 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:52:10.231+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:52:10.231+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:10.306 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 : miss 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:52:10.231+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:52:10.231+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:52:10.235+0000 7f84ab811800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:52:10.235+0000 7f84ab811800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:52:10.235+0000 7f84ab811800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:52:10.235+0000 7f84ab811800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40, ofs0, ns] 2024-09-12T17:52:10.307 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:52:10.235+0000 7f838a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 93946060162928 notifier 7941 bl.length()=1015 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:52:10.235+0000 7f838a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:52:10.235+0000 7f838a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:52:10.235+0000 7f838a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:52:10.236+0000 7f84ab811800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): orig_sources= new_sources= 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:52:10.236+0000 7f84ab811800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): potential sources added=[] removed=[] 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:52:10.236+0000 7f84ab811800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): orig_dests= new_dests= 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:52:10.236+0000 7f84ab811800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): potential dests added=[] removed=[] 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:52:10.238+0000 7f84ab811800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.1.0 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:52:10.238+0000 7f84ab811800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.1.0 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:52:10.238+0000 7f84ab811800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.1.1 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:52:10.238+0000 7f84ab811800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.1.1 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:52:10.238+0000 7f84ab811800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.0 2024-09-12T17:52:10.308 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:52:10.241+0000 7f84ab811800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84ab811800 time 2024-09-12T17:52:10.242112+0000 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84ac98c71a] 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84ac98c8d8] 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571832b3841] 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5571832c2734] 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571832c35d4] 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f84ab629590] 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.309 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:52:10.242+0000 7f84ab811800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f84ab811800 thread_name:radosgw-admin 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f84ab63e6f0] 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f84ab68b99c] 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84ac98c774] 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84ac98c8d8] 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571832b3841] 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5571832c2734] 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571832c35d4] 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:52:10.310 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f84ab629590] 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:52:10.311 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:52:10.312 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:52:10.313 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:52:10.314 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:52:10.315 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:52:10.316 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:52:10.317 INFO:tasks.workunit.client.0.smithi107.stderr: 7f82d5ffb640 / http_manager 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: 7f82d7fff640 / http_manager 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: 7f835d7e2640 / rgw_dt_lg_renew 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: 7f8388ff9640 / ms_dispatch 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: 7f838a7fc640 / io_context_pool 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: 7f8390e01640 / ms_dispatch 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: 7f8393606640 / ms_dispatch 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: 7f8394e09640 / io_context_pool 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: 7f849ffff640 / msgr-worker-2 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: 7f84a6f22640 / msgr-worker-1 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: 7f84a7723640 / msgr-worker-0 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: 7f84a7f24640 / io_context_pool 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: 7f84ab811800 / radosgw-admin 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:52:10.318 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/log/ceph/ceph-client.admin.142475.log 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:52:09.985+0000 7f8394e09640 10 monclient: dump: 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.319 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:52:09.986+0000 7f84ab811800 10 monclient: shutdown 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 asok(0x557185596730) unregister_commands rotate-key 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:52:09.986+0000 7f84ab811800 10 monclient: build_initial_monmap 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:52:09.986+0000 7f84ab811800 1 build_initial for_mkfs: 0 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:52:09.986+0000 7f84ab811800 10 monclient: monmap: 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:10.320 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding auth protocol: cephx 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding auth protocol: cephx 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding auth protocol: cephx 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: secure 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: crc 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: secure 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: crc 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: secure 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: crc 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: crc 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: secure 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: crc 2024-09-12T17:52:10.321 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: secure 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: crc 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857be060) adding con mode: secure 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:52:09.986+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:52:09.986+0000 7f84ab811800 1 librados: starting msgr at 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:52:09.986+0000 7f84ab811800 1 librados: starting objecter 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 asok(0x557185596730) register_command objecter_requests hook 0x5571857bbb10 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:52:09.986+0000 7f84ab811800 1 librados: setting wanted keys 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:52:09.986+0000 7f84ab811800 1 librados: calling monclient init 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:52:09.986+0000 7f84ab811800 10 monclient: init 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding auth protocol: cephx 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding auth protocol: cephx 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding auth protocol: cephx 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: secure 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: crc 2024-09-12T17:52:10.322 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: secure 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: crc 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: secure 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: crc 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: crc 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: secure 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: crc 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: secure 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: crc 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:52:09.986+0000 7f84ab811800 5 AuthRegistry(0x5571857b89f0) adding con mode: secure 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:52:09.987+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:52:09.987+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:52:09.987+0000 7f84ab811800 5 asok(0x557185596730) register_command rotate-key hook 0x5571857b8b38 2024-09-12T17:52:10.323 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-c con 0x55718566fba0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-b con 0x5571856fb110 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-a con 0x557185701560 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:52:09.987+0000 7f84ab811800 10 monclient(hunting): authenticate will time out at 2134.533403s 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): get_auth_request con 0x55718566fba0 auth_method 0 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.324 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): get_auth_request con 0x557185701560 auth_method 0 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:52:09.987+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): get_auth_request con 0x5571856fb110 auth_method 0 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.325 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:52:09.987+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient(hunting): handle_auth_done global_id 7932 payload 824 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient: _finish_hunting 0 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:52:09.987+0000 7f84a7723640 1 monclient: found mon.noname-a 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:52:09.987+0000 7f84a7723640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: dump: 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.326 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: _finish_auth 0 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: _check_auth_tickets 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:52:09.988+0000 7f8393606640 10 monclient: dump: 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.327 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:52:09.988+0000 7f84ab811800 5 monclient: authenticate success, global_id 7932 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:52:09.988+0000 7f84ab811800 10 monclient: _renew_subs 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:52:09.988+0000 7f84ab811800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:52:09.988+0000 7f8394e09640 4 set_mon_vals no callback set 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:52:09.988+0000 7f84ab811800 10 monclient: _renew_subs 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:52:09.988+0000 7f84ab811800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.328 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:52:09.988+0000 7f84ab811800 1 librados: init done 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:52:09.990+0000 7f8393606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:52:09.990+0000 7f8393606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:52:09.990+0000 7f8393606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:52:09.990+0000 7f84a6f22640 10 monclient: get_auth_request con 0x7f838c0764a0 auth_method 0 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:52:09.990+0000 7f849ffff640 10 monclient: get_auth_request con 0x5571857f73b0 auth_method 0 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:52:09.991+0000 7f84a6f22640 10 monclient: get_auth_request con 0x557185803d80 auth_method 0 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:52:09.992+0000 7f849ffff640 10 monclient: get_auth_request con 0x557185807fc0 auth_method 0 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:52:09.993+0000 7f84ab811800 10 monclient: build_initial_monmap 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:52:09.993+0000 7f84ab811800 1 build_initial for_mkfs: 0 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:52:09.993+0000 7f84ab811800 10 monclient: monmap: 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:10.329 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding auth protocol: cephx 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding auth protocol: cephx 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding auth protocol: cephx 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: secure 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: crc 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: secure 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: crc 2024-09-12T17:52:10.330 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: secure 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: crc 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: crc 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: secure 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: crc 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: secure 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: crc 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580cdd0) adding con mode: secure 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:52:09.993+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 asok(0x557185596730) register_command objecter_requests cmddesc objecter_requests hook 0x5571858107e0 EEXIST 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:52:09.993+0000 7f84ab811800 10 monclient: init 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding auth protocol: cephx 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding auth protocol: cephx 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding auth protocol: cephx 2024-09-12T17:52:10.331 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: secure 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: crc 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: secure 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: crc 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: secure 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: crc 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: crc 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: secure 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: crc 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: secure 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: crc 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:52:09.993+0000 7f84ab811800 5 AuthRegistry(0x55718580b4f8) adding con mode: secure 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:52:09.994+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.332 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:52:09.994+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:52:09.994+0000 7f84ab811800 5 asok(0x557185596730) register_command rotate-key cmddesc rotate-key hook 0x55718580b640 EEXIST 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-c con 0x5571858344d0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-b con 0x5571858367a0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-a con 0x557185832ca0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:52:09.994+0000 7f84ab811800 10 monclient(hunting): authenticate will time out at 2134.540361s 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): get_auth_request con 0x5571858344d0 auth_method 0 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.333 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): get_auth_request con 0x557185832ca0 auth_method 0 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:52:09.994+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): get_auth_request con 0x5571858367a0 auth_method 0 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.334 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:52:09.994+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient(hunting): handle_auth_done global_id 7469 payload 824 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient: _finish_hunting 0 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:52:09.994+0000 7f84a6f22640 1 monclient: found mon.noname-c 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:52:09.994+0000 7f84a6f22640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:52:09.994+0000 7f8390e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:52:09.994+0000 7f8390e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:52:09.994+0000 7f8390e01640 10 monclient: dump: 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.335 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:52:09.995+0000 7f8390e01640 10 monclient: _finish_auth 0 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:52:09.995+0000 7f8390e01640 10 monclient: _check_auth_tickets 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:52:09.995+0000 7f8390e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:52:09.995+0000 7f84ab811800 5 monclient: authenticate success, global_id 7469 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:52:09.995+0000 7f8390e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:52:09.995+0000 7f8390e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:52:10.336 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:52:09.995+0000 7f8390e01640 10 monclient: dump: 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:52:09.995+0000 7f84ab811800 10 monclient: _renew_subs 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:52:09.995+0000 7f84ab811800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:52:09.995+0000 7f84a7f24640 4 set_mon_vals no callback set 2024-09-12T17:52:10.337 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:52:09.995+0000 7f84ab811800 10 monclient: _renew_subs 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:52:09.995+0000 7f84ab811800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:52:09.996+0000 7f8390e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:52:09.996+0000 7f8390e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:52:09.996+0000 7f8390e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:52:09.997+0000 7f849ffff640 10 monclient: get_auth_request con 0x7f8380076380 auth_method 0 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:52:09.997+0000 7f84ab811800 10 monclient: get_monmap_and_config 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:52:09.997+0000 7f84ab811800 10 monclient: build_initial_monmap 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:52:09.997+0000 7f84ab811800 1 build_initial for_mkfs: 0 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:52:09.997+0000 7f84ab811800 10 monclient: monmap: 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:10.338 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding auth protocol: cephx 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding auth protocol: cephx 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding auth protocol: cephx 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: secure 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: crc 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: secure 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: crc 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: secure 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: crc 2024-09-12T17:52:10.339 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: crc 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: secure 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: crc 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: secure 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: crc 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x5571858543b0) adding con mode: secure 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:52:09.997+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:52:09.997+0000 7f84ab811800 10 monclient: init 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding auth protocol: cephx 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding auth protocol: cephx 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding auth protocol: cephx 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: secure 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: crc 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: secure 2024-09-12T17:52:10.340 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: crc 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: secure 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: crc 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: crc 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: secure 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: crc 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: secure 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: crc 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:52:09.997+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fcfed0) adding con mode: secure 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:52:09.997+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:52:09.998+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:52:09.998+0000 7f84ab811800 5 asok(0x557185596730) register_command rotate-key cmddesc rotate-key hook 0x7ffe48fd0018 EEXIST 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:10.341 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-c con 0x5571858889a0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-b con 0x5571858792f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-a con 0x557185883dd0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient(hunting): authenticate will time out at 2134.544297s 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): get_auth_request con 0x5571858889a0 auth_method 0 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): get_auth_request con 0x557185883dd0 auth_method 0 2024-09-12T17:52:10.342 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:52:09.998+0000 7f849ffff640 10 monclient(hunting): get_auth_request con 0x5571858792f0 auth_method 0 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:52:09.998+0000 7f849ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:52:09.998+0000 7f849ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:52:09.998+0000 7f849ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:52:09.998+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.343 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient(hunting): handle_auth_done global_id 7938 payload 274 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient: _finish_hunting 0 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:52:09.998+0000 7f84a7723640 1 monclient: found mon.noname-a 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:52:09.998+0000 7f84a7723640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: dump: 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.344 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:52:09.998+0000 7f84ab811800 5 monclient: authenticate success, global_id 7938 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:52:09.998+0000 7f84ab811800 10 monclient: get_monmap_and_config success 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:52:09.998+0000 7f84ab811800 4 set_mon_vals no callback set 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:52:09.998+0000 7f838a7fc640 10 monclient: dump: 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.345 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:52:09.999+0000 7f84ab811800 10 monclient: shutdown 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:52:09.999+0000 7f84ab811800 10 monclient: build_initial_monmap 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:52:09.999+0000 7f84ab811800 1 build_initial for_mkfs: 0 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:52:09.999+0000 7f84ab811800 10 monclient: monmap: 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:10.346 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding auth protocol: cephx 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding auth protocol: cephx 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding auth protocol: cephx 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: secure 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: crc 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: secure 2024-09-12T17:52:10.347 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: crc 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: secure 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: crc 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: crc 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: secure 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: crc 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: secure 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: crc 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x557185857f00) adding con mode: secure 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:52:09.999+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:52:09.999+0000 7f84ab811800 1 librados: starting msgr at 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:52:09.999+0000 7f84ab811800 1 librados: starting objecter 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 asok(0x557185596730) register_command objecter_requests cmddesc objecter_requests hook 0x557185834b20 EEXIST 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:52:09.999+0000 7f84ab811800 1 librados: setting wanted keys 2024-09-12T17:52:10.348 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:52:09.999+0000 7f84ab811800 1 librados: calling monclient init 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:52:09.999+0000 7f84ab811800 10 monclient: init 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding auth protocol: cephx 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding auth protocol: cephx 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding auth protocol: cephx 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: secure 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: crc 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: secure 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: crc 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: secure 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: crc 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: crc 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: secure 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: crc 2024-09-12T17:52:10.349 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: secure 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: crc 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:52:09.999+0000 7f84ab811800 5 AuthRegistry(0x55718584c280) adding con mode: secure 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:52:10.000+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:52:10.000+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:52:10.000+0000 7f84ab811800 5 asok(0x557185596730) register_command rotate-key cmddesc rotate-key hook 0x55718584c3c8 EEXIST 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-a con 0x5571858792f0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-c con 0x557185883dd0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): picked mon.noname-b con 0x5571858889a0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.350 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:52:10.000+0000 7f84ab811800 10 monclient(hunting): authenticate will time out at 2134.546490s 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): get_auth_request con 0x5571858792f0 auth_method 0 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): get_auth_request con 0x557185883dd0 auth_method 0 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:10.351 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:52:10.000+0000 7f849ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient(hunting): handle_auth_done global_id 7941 payload 824 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient: _finish_hunting 0 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:52:10.000+0000 7f84a6f22640 1 monclient: found mon.noname-a 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:52:10.000+0000 7f84a6f22640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: dump: 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.352 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: _finish_auth 0 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:52:10.001+0000 7f84ab811800 5 monclient: authenticate success, global_id 7941 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:52:10.001+0000 7f8388ff9640 10 monclient: dump: 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:10.353 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:52:10.001+0000 7f838a7fc640 4 set_mon_vals no callback set 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:52:10.001+0000 7f84ab811800 10 monclient: _renew_subs 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:52:10.001+0000 7f84ab811800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:52:10.001+0000 7f84ab811800 10 monclient: _renew_subs 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:52:10.001+0000 7f84ab811800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:52:10.001+0000 7f84ab811800 1 librados: init done 2024-09-12T17:52:10.354 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:52:10.001+0000 7f84ab811800 5 asok(0x557185596730) register_command cr dump hook 0x55718587bb98 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:52:10.002+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:52:10.003+0000 7f8388ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:52:10.003+0000 7f8388ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:52:10.003+0000 7f8388ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:52:10.003+0000 7f849ffff640 10 monclient: get_auth_request con 0x7f8370076470 auth_method 0 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:52:10.003+0000 7f84a7723640 10 monclient: get_auth_request con 0x5571858a2da0 auth_method 0 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 realm 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:52:10.004+0000 7f84ab811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.355 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:52:10.004+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:52:10.004+0000 7f84a6f22640 10 monclient: get_auth_request con 0x5571858a6fb0 auth_method 0 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:52:10.005+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:52:10.005+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:52:10.005+0000 7f849ffff640 10 monclient: get_auth_request con 0x5571858aa7f0 auth_method 0 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:52:10.006+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:52:10.006+0000 7f84ab811800 20 searching for the correct realm 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:52:10.006+0000 7f84a7723640 10 monclient: get_auth_request con 0x5571858af5b0 auth_method 0 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:52:10.006+0000 7f84a6f22640 10 monclient: get_auth_request con 0x7f84a0067ba0 auth_method 0 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:52:10.007+0000 7f849ffff640 10 monclient: get_auth_request con 0x7f8490057c30 auth_method 0 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:52:10.008+0000 7f849ffff640 0 -- 172.21.15.107:0/3333412071 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f8490057c30 msgr2=0x7f8490088420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:52:10.008+0000 7f8388ff9640 1 client.7941.objecter ms_handle_reset 0x7f8490057c30 session 0x7f8490081040 osd.4 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:52:10.008+0000 7f8388ff9640 10 monclient: _renew_subs 2024-09-12T17:52:10.356 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:52:10.008+0000 7f8388ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:52:10.008+0000 7f849ffff640 10 monclient: get_auth_request con 0x7f8370086ba0 auth_method 0 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:52:10.009+0000 7f84a7723640 10 monclient: get_auth_request con 0x7f8490099040 auth_method 0 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:52:10.011+0000 7f84a6f22640 10 monclient: get_auth_request con 0x7f8490099930 auth_method 0 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:52:10.011+0000 7f84a6f22640 0 -- 172.21.15.107:0/3333412071 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f8490099930 msgr2=0x7f84900643f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:52:10.212+0000 7f84a6f22640 10 monclient: get_auth_request con 0x7f8490099930 auth_method 0 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:52:10.216+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.357 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 zone default found 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:52:10.217+0000 7f84ab811800 4 Realm: () 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:52:10.217+0000 7f84ab811800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:52:10.217+0000 7f84ab811800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:52:10.217+0000 7f84ab811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 zonegroup default 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:52:10.217+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:52:10.218+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.358 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:52:10.218+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:52:10.218+0000 7f84ab811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:52:10.218+0000 7f84ab811800 20 started sync module instance, tier type = 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:52:10.218+0000 7f84ab811800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=0 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=1 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=2 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=3 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=4 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=5 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:52:10.227+0000 7f84ab811800 20 add_watcher() i=6 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:52:10.228+0000 7f84ab811800 20 add_watcher() i=7 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:52:10.228+0000 7f84ab811800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding auth protocol: cephx 2024-09-12T17:52:10.359 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding auth protocol: cephx 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding auth protocol: cephx 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: secure 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: crc 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: secure 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: crc 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: secure 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: crc 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: crc 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: secure 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: crc 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: secure 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:52:10.230+0000 7f835d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: crc 2024-09-12T17:52:10.360 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 AuthRegistry(0x7ffe48fd03a0) adding con mode: secure 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:52:10.230+0000 7f84ab811800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:52:10.230+0000 7f84ab811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:52:10.230+0000 7f84ab811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command cache list hook 0x557185881730 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command cache inspect hook 0x557185881730 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command cache erase hook 0x557185881730 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command cache zap hook 0x557185881730 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 note: GC not initialized 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:52:10.230+0000 7f82d7fff640 20 reqs_thread_entry: start 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command sync trace show hook 0x7f8498004680 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command sync trace history hook 0x7f8498004680 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command sync trace active hook 0x7f8498004680 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:52:10.230+0000 7f84ab811800 5 asok(0x557185596730) register_command sync trace active_short hook 0x7f8498004680 2024-09-12T17:52:10.361 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:52:10.230+0000 7f84ab811800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:52:10.230+0000 7f84ab811800 20 Filter name: none 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:52:10.231+0000 7f82d5ffb640 20 reqs_thread_entry: start 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:52:10.231+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:52:10.231+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 : miss 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:52:10.231+0000 7f84ab811800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:52:10.231+0000 7f84ab811800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:10.362 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:52:10.231+0000 7f84ab811800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:52:10.235+0000 7f84ab811800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:52:10.235+0000 7f84ab811800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:52:10.235+0000 7f84ab811800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:52:10.235+0000 7f84ab811800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40, ofs0, ns] 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:52:10.235+0000 7f838a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 93946060162928 notifier 7941 bl.length()=1015 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:52:10.235+0000 7f838a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:52:10.235+0000 7f838a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:52:10.235+0000 7f838a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:52:10.236+0000 7f84ab811800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): orig_sources= new_sources= 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:52:10.236+0000 7f84ab811800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): potential sources added=[] removed=[] 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:52:10.236+0000 7f84ab811800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): orig_dests= new_dests= 2024-09-12T17:52:10.363 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:52:10.236+0000 7f84ab811800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): potential dests added=[] removed=[] 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:52:10.238+0000 7f84ab811800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.1.0 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:52:10.238+0000 7f84ab811800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.1.0 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:52:10.238+0000 7f84ab811800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.1.1 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:52:10.238+0000 7f84ab811800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.1.1 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:52:10.238+0000 7f84ab811800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.0 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:52:10.241+0000 7f84ab811800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f84ab811800 time 2024-09-12T17:52:10.242112+0000 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f84ac98c71a] 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84ac98c8d8] 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571832b3841] 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5571832c2734] 2024-09-12T17:52:10.364 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571832c35d4] 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f84ab629590] 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:52:10.242+0000 7f84ab811800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f84ab811800 thread_name:radosgw-admin 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f84ab63e6f0] 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f84ab68b99c] 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:52:10.365 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f84ac98c774] 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f84ac98c8d8] 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571832b3841] 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5571832c2734] 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5571832c35d4] 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f84ab629590] 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:52:10.366 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:52:10.367 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:52:10.368 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:52:10.369 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:52:10.370 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:52:10.371 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:52:10.372 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 7f82d5ffb640 / http_manager 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 7f82d7fff640 / http_manager 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 7f835d7e2640 / rgw_dt_lg_renew 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 7f8388ff9640 / ms_dispatch 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 7f838a7fc640 / io_context_pool 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 7f8390e01640 / ms_dispatch 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 7f8393606640 / ms_dispatch 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 7f8394e09640 / io_context_pool 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 7f849ffff640 / msgr-worker-2 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 7f84a6f22640 / msgr-worker-1 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 7f84a7723640 / msgr-worker-0 2024-09-12T17:52:10.373 INFO:tasks.workunit.client.0.smithi107.stderr: 7f84a7f24640 / io_context_pool 2024-09-12T17:52:10.374 INFO:tasks.workunit.client.0.smithi107.stderr: 7f84ab811800 / radosgw-admin 2024-09-12T17:52:10.374 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:52:10.374 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:52:10.374 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:52:10.243731Z_3fe7750b-9463-40fe-ada7-f5b91cb24232/log 2024-09-12T17:52:10.374 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:52:10.374 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:52:10.379 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:10.379 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:10.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.316+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.317+0000 7f55079ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.317+0000 7f55079ab800 20 realm 2024-09-12T17:52:10.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.317+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.379 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.318+0000 7f55079ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.318+0000 7f55079ab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.318+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.318+0000 7f55079ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.318+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.319+0000 7f55079ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.319+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.319+0000 7f55079ab800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.320+0000 7f55079ab800 20 searching for the correct realm 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.322+0000 7f5505c96640 0 -- 172.21.15.107:0/1356719832 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55d170dce5e0 msgr2=0x55d170dd0aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.325+0000 7f5505495640 0 -- 172.21.15.107:0/1356719832 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f54f009b040 msgr2=0x7f54f009b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.329+0000 7f55079ab800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.329+0000 7f55079ab800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:10.380 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.329+0000 7f55079ab800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.329+0000 7f55079ab800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.329+0000 7f55079ab800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.329+0000 7f55079ab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.329+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.329+0000 7f55079ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.329+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 20 zone default found 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 4 Realm: () 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:10.381 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:10.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 20 zonegroup default 2024-09-12T17:52:10.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.330+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.331+0000 7f55079ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.331+0000 7f55079ab800 20 started sync module instance, tier type = 2024-09-12T17:52:10.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.331+0000 7f55079ab800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:10.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.339+0000 7f55079ab800 20 add_watcher() i=0 2024-09-12T17:52:10.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.339+0000 7f55079ab800 20 add_watcher() i=1 2024-09-12T17:52:10.382 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.339+0000 7f55079ab800 20 add_watcher() i=2 2024-09-12T17:52:10.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.339+0000 7f55079ab800 20 add_watcher() i=3 2024-09-12T17:52:10.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.339+0000 7f55079ab800 20 add_watcher() i=4 2024-09-12T17:52:10.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.339+0000 7f55079ab800 20 add_watcher() i=5 2024-09-12T17:52:10.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.339+0000 7f55079ab800 20 add_watcher() i=6 2024-09-12T17:52:10.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.340+0000 7f55079ab800 20 add_watcher() i=7 2024-09-12T17:52:10.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.340+0000 7f55079ab800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:10.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.342+0000 7f53bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:10.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.342+0000 7f55079ab800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:10.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.342+0000 7f55079ab800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:10.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.342+0000 7f55079ab800 5 note: GC not initialized 2024-09-12T17:52:10.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.342+0000 7f53ba7e4640 20 reqs_thread_entry: start 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.342+0000 7f55079ab800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.342+0000 7f55079ab800 20 Filter name: none 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.343+0000 7f532bfff640 20 reqs_thread_entry: start 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.343+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.343+0000 7f55079ab800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.343+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.344+0000 7f55079ab800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.344+0000 7f55079ab800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.344+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.344+0000 7f55079ab800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.344+0000 7f55079ab800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.344+0000 7f55079ab800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.344+0000 7f55079ab800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:10.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.346+0000 7f53bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:10.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.348+0000 7f55079ab800 20 remove_watcher() i=0 2024-09-12T17:52:10.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.348+0000 7f55079ab800 2 removed watcher, disabling cache 2024-09-12T17:52:10.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.349+0000 7f55079ab800 20 remove_watcher() i=1 2024-09-12T17:52:10.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.350+0000 7f55079ab800 20 remove_watcher() i=2 2024-09-12T17:52:10.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.351+0000 7f55079ab800 20 remove_watcher() i=3 2024-09-12T17:52:10.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.352+0000 7f55079ab800 20 remove_watcher() i=4 2024-09-12T17:52:10.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.353+0000 7f55079ab800 20 remove_watcher() i=5 2024-09-12T17:52:10.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.354+0000 7f55079ab800 20 remove_watcher() i=6 2024-09-12T17:52:10.386 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.354+0000 7f55079ab800 20 remove_watcher() i=7 2024-09-12T17:52:10.386 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.386 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:52:10.386 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-change-reshard-state id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:52:10.386 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:10.417 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:52:10.448 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:10.449 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:10.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.484+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.485+0000 7f8813698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.485+0000 7f8813698800 20 realm 2024-09-12T17:52:10.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.485+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.485+0000 7f8813698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.485+0000 7f8813698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:10.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.485+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.485+0000 7f8813698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.485+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.486+0000 7f8813698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:10.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.486+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.487+0000 7f8813698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:10.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.487+0000 7f8813698800 20 searching for the correct realm 2024-09-12T17:52:10.490 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.489+0000 7f880bfff640 0 -- 172.21.15.107:0/1680878858 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f87fc06d060 msgr2=0x7f87fc0037a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:52:10.494 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.493+0000 7f8811182640 0 -- 172.21.15.107:0/1680878858 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f87fc070120 msgr2=0x7f87fc0639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:52:10.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.700+0000 7f8813698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:10.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.700+0000 7f8813698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:10.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.700+0000 7f8813698800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:10.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.700+0000 7f8813698800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:10.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.700+0000 7f8813698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:10.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.700+0000 7f8813698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:10.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.700+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.700+0000 7f8813698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.700+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.700+0000 7f8813698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.700+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.700+0000 7f8813698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 20 zone default found 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 4 Realm: () 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 20 zonegroup default 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:10.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 20 started sync module instance, tier type = 2024-09-12T17:52:10.704 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.701+0000 7f8813698800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:10.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.710+0000 7f8813698800 20 add_watcher() i=0 2024-09-12T17:52:10.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.710+0000 7f8813698800 20 add_watcher() i=1 2024-09-12T17:52:10.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.710+0000 7f8813698800 20 add_watcher() i=2 2024-09-12T17:52:10.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.710+0000 7f8813698800 20 add_watcher() i=3 2024-09-12T17:52:10.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.710+0000 7f8813698800 20 add_watcher() i=4 2024-09-12T17:52:10.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.710+0000 7f8813698800 20 add_watcher() i=5 2024-09-12T17:52:10.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.711+0000 7f8813698800 20 add_watcher() i=6 2024-09-12T17:52:10.712 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.711+0000 7f8813698800 20 add_watcher() i=7 2024-09-12T17:52:10.713 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.711+0000 7f8813698800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:10.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.713+0000 7f86c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:10.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.713+0000 7f8813698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:10.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.713+0000 7f8813698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:10.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.713+0000 7f8813698800 5 note: GC not initialized 2024-09-12T17:52:10.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.713+0000 7f86c67e4640 20 reqs_thread_entry: start 2024-09-12T17:52:10.715 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:10.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 20 Filter name: none 2024-09-12T17:52:10.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8637fff640 20 reqs_thread_entry: start 2024-09-12T17:52:10.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:52:10.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:10.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:52:10.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:52:10.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 : miss 2024-09-12T17:52:10.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 20 rados->read ofs=0 len=0 2024-09-12T17:52:10.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:52:10.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:10.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:10.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:10.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:10.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.714+0000 7f8813698800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 2024-09-12T17:52:10.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.715+0000 7f8813698800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to be held by another RGW process; skipping for now 2024-09-12T17:52:10.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.716+0000 7f86c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:10.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.718+0000 7f8813698800 20 remove_watcher() i=0 2024-09-12T17:52:10.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.718+0000 7f8813698800 2 removed watcher, disabling cache 2024-09-12T17:52:10.720 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.719+0000 7f8813698800 20 remove_watcher() i=1 2024-09-12T17:52:10.721 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.720+0000 7f8813698800 20 remove_watcher() i=2 2024-09-12T17:52:10.722 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.721+0000 7f8813698800 20 remove_watcher() i=3 2024-09-12T17:52:10.723 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.722+0000 7f8813698800 20 remove_watcher() i=4 2024-09-12T17:52:10.724 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.723+0000 7f8813698800 20 remove_watcher() i=5 2024-09-12T17:52:10.725 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.724+0000 7f8813698800 20 remove_watcher() i=6 2024-09-12T17:52:10.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:10.725+0000 7f8813698800 20 remove_watcher() i=7 2024-09-12T17:52:10.736 INFO:tasks.workunit.client.0.smithi107.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:52:40.759 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:52:40.797 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:40.797 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:40.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.837+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:40.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.839+0000 7f6675c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:40.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.839+0000 7f6675c0e800 20 realm 2024-09-12T17:52:40.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.839+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:40.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.839+0000 7f6675c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:40.840 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.839+0000 7f6675c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:40.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.839+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:40.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.839+0000 7f6675c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:40.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.839+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:40.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.840+0000 7f6675c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:40.841 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.840+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:40.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.841+0000 7f6675c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:40.842 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.841+0000 7f6675c0e800 20 searching for the correct realm 2024-09-12T17:52:40.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.844+0000 7f6671259640 0 -- 172.21.15.107:0/1172999194 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f666c061040 msgr2=0x7f666c0a6a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:40.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:40.847+0000 7f6671259640 0 -- 172.21.15.107:0/1172999194 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f6668083040 msgr2=0x7f6668090700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:41.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.053+0000 7f6675c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:41.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.053+0000 7f6675c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:41.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.053+0000 7f6675c0e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:41.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.053+0000 7f6675c0e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:41.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.053+0000 7f6675c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:41.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.053+0000 7f6675c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:41.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.053+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.053+0000 7f6675c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.053+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.054+0000 7f6675c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:41.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.054+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.054+0000 7f6675c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:41.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.054+0000 7f6675c0e800 20 zone default found 2024-09-12T17:52:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.054+0000 7f6675c0e800 4 Realm: () 2024-09-12T17:52:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.054+0000 7f6675c0e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.054+0000 7f6675c0e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.054+0000 7f6675c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.054+0000 7f6675c0e800 20 zonegroup default 2024-09-12T17:52:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.054+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.055+0000 7f6675c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.055+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.055+0000 7f6675c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.055+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.056+0000 7f6675c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.058 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.056+0000 7f6675c0e800 20 started sync module instance, tier type = 2024-09-12T17:52:41.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.056+0000 7f6675c0e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:41.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.066+0000 7f6675c0e800 20 add_watcher() i=0 2024-09-12T17:52:41.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.066+0000 7f6675c0e800 20 add_watcher() i=1 2024-09-12T17:52:41.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.066+0000 7f6675c0e800 20 add_watcher() i=2 2024-09-12T17:52:41.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.066+0000 7f6675c0e800 20 add_watcher() i=3 2024-09-12T17:52:41.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.066+0000 7f6675c0e800 20 add_watcher() i=4 2024-09-12T17:52:41.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.066+0000 7f6675c0e800 20 add_watcher() i=5 2024-09-12T17:52:41.067 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.066+0000 7f6675c0e800 20 add_watcher() i=6 2024-09-12T17:52:41.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.067+0000 7f6675c0e800 20 add_watcher() i=7 2024-09-12T17:52:41.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.067+0000 7f6675c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:41.069 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.068+0000 7f6527fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:41.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.069+0000 7f6675c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:41.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.069+0000 7f6675c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:41.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.069+0000 7f6675c0e800 5 note: GC not initialized 2024-09-12T17:52:41.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.069+0000 7f6526fe5640 20 reqs_thread_entry: start 2024-09-12T17:52:41.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.069+0000 7f6675c0e800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:41.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.069+0000 7f6675c0e800 20 Filter name: none 2024-09-12T17:52:41.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.069+0000 7f6524fe1640 20 reqs_thread_entry: start 2024-09-12T17:52:41.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.069+0000 7f6675c0e800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:52:41.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.069+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.070+0000 7f6675c0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:41.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.070+0000 7f6675c0e800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:52:41.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.070+0000 7f6675c0e800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:52:41.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.070+0000 7f6675c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 : miss 2024-09-12T17:52:41.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.070+0000 7f6675c0e800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.070+0000 7f6675c0e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:52:41.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.070+0000 7f6675c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:41.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.070+0000 7f6675c0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:41.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.070+0000 7f6675c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:41.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.070+0000 7f6675c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:41.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.070+0000 7f6675c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 2024-09-12T17:52:41.073 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.071+0000 7f6675c0e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:52:41.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.076+0000 7f6675c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:41.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.076+0000 7f6675c0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:41.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.076+0000 7f6675c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:41.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.076+0000 7f6675c0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40, ofs0, ns] 2024-09-12T17:52:41.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.076+0000 7f6543fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464376 cookie 94362306517232 notifier 7998 bl.length()=1015 2024-09-12T17:52:41.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.076+0000 7f6543fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:41.077 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.076+0000 7f6543fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:41.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.076+0000 7f6543fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:41.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.076+0000 7f6675c0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): orig_sources= new_sources= 2024-09-12T17:52:41.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.076+0000 7f6675c0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): potential sources added=[] removed=[] 2024-09-12T17:52:41.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.076+0000 7f6675c0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): orig_dests= new_dests= 2024-09-12T17:52:41.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.076+0000 7f6675c0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): potential dests added=[] removed=[] 2024-09-12T17:52:41.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.081+0000 7f6675c0e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.2.0 2024-09-12T17:52:41.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.081+0000 7f6675c0e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.2.0 2024-09-12T17:52:41.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.081+0000 7f6675c0e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.2.1 2024-09-12T17:52:41.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.081+0000 7f6675c0e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.2.1 2024-09-12T17:52:41.082 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.081+0000 7f6675c0e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.0 2024-09-12T17:52:41.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.083+0000 7f6675c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 : hit (requested=0x17, cached=0x17) 2024-09-12T17:52:41.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.083+0000 7f6675c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 2024-09-12T17:52:41.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.085+0000 7f6675c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:41.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.085+0000 7f6675c0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:41.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.085+0000 7f6675c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:41.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.085+0000 7f6675c0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40, ofs0, ns] 2024-09-12T17:52:41.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.085+0000 7f6543fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464377 cookie 94362306517232 notifier 7998 bl.length()=1015 2024-09-12T17:52:41.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.085+0000 7f6543fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:41.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.085+0000 7f6543fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:41.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.085+0000 7f6543fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:41.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.086+0000 7f6675c0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): orig_sources= new_sources= 2024-09-12T17:52:41.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.086+0000 7f6675c0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): potential sources added=[] removed=[] 2024-09-12T17:52:41.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.086+0000 7f6675c0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): orig_dests= new_dests= 2024-09-12T17:52:41.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.086+0000 7f6675c0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): potential dests added=[] removed=[] 2024-09-12T17:52:41.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.087+0000 7f6675c0e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.40.0 2024-09-12T17:52:41.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.087+0000 7f6675c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 : hit (requested=0x17, cached=0x17) 2024-09-12T17:52:41.088 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.087+0000 7f6675c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 2024-09-12T17:52:41.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.089+0000 7f6675c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:41.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.089+0000 7f6675c0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:41.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.089+0000 7f6675c0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:41.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.089+0000 7f6675c0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40, ofs0, ns] 2024-09-12T17:52:41.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.089+0000 7f6554ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464378 cookie 94362306517232 notifier 7998 bl.length()=983 2024-09-12T17:52:41.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.089+0000 7f6554ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 info.flags=0x17 2024-09-12T17:52:41.090 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.089+0000 7f6554ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 to cache LRU end 2024-09-12T17:52:41.091 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.089+0000 7f6554ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:52:41.091 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.089+0000 7f6675c0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): orig_sources= new_sources= 2024-09-12T17:52:41.091 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.089+0000 7f6675c0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): potential sources added=[] removed=[] 2024-09-12T17:52:41.091 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.089+0000 7f6675c0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): orig_dests= new_dests= 2024-09-12T17:52:41.091 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.089+0000 7f6675c0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[35ed0db6-4f54-4e96-b306-71079c84e007.4596.40]): potential dests added=[] removed=[] 2024-09-12T17:52:41.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.091+0000 7f6675c0e800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T17:52:41.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.092+0000 7f6527fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:41.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.095+0000 7f6675c0e800 20 remove_watcher() i=0 2024-09-12T17:52:41.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.095+0000 7f6675c0e800 2 removed watcher, disabling cache 2024-09-12T17:52:41.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.096+0000 7f6675c0e800 20 remove_watcher() i=1 2024-09-12T17:52:41.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.098+0000 7f6675c0e800 20 remove_watcher() i=2 2024-09-12T17:52:41.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.099+0000 7f6675c0e800 20 remove_watcher() i=3 2024-09-12T17:52:41.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.100+0000 7f6675c0e800 20 remove_watcher() i=4 2024-09-12T17:52:41.102 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.101+0000 7f6675c0e800 20 remove_watcher() i=5 2024-09-12T17:52:41.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.102+0000 7f6675c0e800 20 remove_watcher() i=6 2024-09-12T17:52:41.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.103+0000 7f6675c0e800 20 remove_watcher() i=7 2024-09-12T17:52:41.116 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:52:41.145 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:41.145 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:41.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.180+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.182+0000 7ff80a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.182+0000 7ff80a336800 20 realm 2024-09-12T17:52:41.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.182+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.183 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.182+0000 7ff80a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.182+0000 7ff80a336800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:41.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.182+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.182+0000 7ff80a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.182+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.183+0000 7ff80a336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:41.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.183+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.184+0000 7ff80a336800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:41.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.184+0000 7ff80a336800 20 searching for the correct realm 2024-09-12T17:52:41.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.186+0000 7ff7fffff640 0 -- 172.21.15.107:0/3148019447 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7ff7f0018070 msgr2=0x7ff7f008a490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:52:41.393 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.392+0000 7ff8060b7640 0 -- 172.21.15.107:0/3148019447 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7ff7f0073040 msgr2=0x7ff7f007a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:52:41.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.599+0000 7ff80a336800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:41.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.599+0000 7ff80a336800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:41.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.599+0000 7ff80a336800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:41.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.599+0000 7ff80a336800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:41.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.599+0000 7ff80a336800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:41.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.599+0000 7ff80a336800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:41.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.599+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.599+0000 7ff80a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.601 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.599+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.599+0000 7ff80a336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:41.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.599+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.600+0000 7ff80a336800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:41.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.600+0000 7ff80a336800 20 zone default found 2024-09-12T17:52:41.602 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.600+0000 7ff80a336800 4 Realm: () 2024-09-12T17:52:41.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.600+0000 7ff80a336800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:41.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.600+0000 7ff80a336800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:41.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.600+0000 7ff80a336800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:41.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.600+0000 7ff80a336800 20 zonegroup default 2024-09-12T17:52:41.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.600+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.600+0000 7ff80a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.600+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.601+0000 7ff80a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.601+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.601+0000 7ff80a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.601+0000 7ff80a336800 20 started sync module instance, tier type = 2024-09-12T17:52:41.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.601+0000 7ff80a336800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:41.612 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.611+0000 7ff80a336800 20 add_watcher() i=0 2024-09-12T17:52:41.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.611+0000 7ff80a336800 20 add_watcher() i=1 2024-09-12T17:52:41.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.611+0000 7ff80a336800 20 add_watcher() i=2 2024-09-12T17:52:41.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.611+0000 7ff80a336800 20 add_watcher() i=3 2024-09-12T17:52:41.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.611+0000 7ff80a336800 20 add_watcher() i=4 2024-09-12T17:52:41.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.611+0000 7ff80a336800 20 add_watcher() i=5 2024-09-12T17:52:41.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.611+0000 7ff80a336800 20 add_watcher() i=6 2024-09-12T17:52:41.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.612+0000 7ff80a336800 20 add_watcher() i=7 2024-09-12T17:52:41.613 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.612+0000 7ff80a336800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:41.615 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.614+0000 7ff6bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:41.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.614+0000 7ff80a336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:41.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.614+0000 7ff80a336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:41.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.614+0000 7ff80a336800 5 note: GC not initialized 2024-09-12T17:52:41.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.615+0000 7ff6377fe640 20 reqs_thread_entry: start 2024-09-12T17:52:41.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.615+0000 7ff80a336800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:41.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.615+0000 7ff80a336800 20 Filter name: none 2024-09-12T17:52:41.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.615+0000 7ff6357fa640 20 reqs_thread_entry: start 2024-09-12T17:52:41.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.615+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.615+0000 7ff80a336800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:41.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.615+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.616+0000 7ff80a336800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.616+0000 7ff80a336800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:41.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.616+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.616+0000 7ff80a336800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:52:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.616+0000 7ff80a336800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.617+0000 7ff80a336800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:52:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.617+0000 7ff80a336800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:41.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.618+0000 7ff6bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:41.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.620+0000 7ff80a336800 20 remove_watcher() i=0 2024-09-12T17:52:41.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.620+0000 7ff80a336800 2 removed watcher, disabling cache 2024-09-12T17:52:41.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.621+0000 7ff80a336800 20 remove_watcher() i=1 2024-09-12T17:52:41.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.623+0000 7ff80a336800 20 remove_watcher() i=2 2024-09-12T17:52:41.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.624+0000 7ff80a336800 20 remove_watcher() i=3 2024-09-12T17:52:41.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.625+0000 7ff80a336800 20 remove_watcher() i=4 2024-09-12T17:52:41.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.626+0000 7ff80a336800 20 remove_watcher() i=5 2024-09-12T17:52:41.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.627+0000 7ff80a336800 20 remove_watcher() i=6 2024-09-12T17:52:41.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.628+0000 7ff80a336800 20 remove_watcher() i=7 2024-09-12T17:52:41.640 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:41.640 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:52:41.640 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: abort-at-change-reshard-state id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.40 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:52:41.640 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:41.702 INFO:tasks.workunit.client.0.smithi107.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T17:52:41.704 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:52:41.732 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:41.732 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:41.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.767+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.769+0000 7f5fb5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.769+0000 7f5fb5746800 20 realm 2024-09-12T17:52:41.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.769+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.769+0000 7f5fb5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.769+0000 7f5fb5746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:41.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.769+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.769+0000 7f5fb5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.769+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.770+0000 7f5fb5746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:41.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.770+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.771+0000 7f5fb5746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:41.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.771+0000 7f5fb5746800 20 searching for the correct realm 2024-09-12T17:52:41.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.774+0000 7f5fb3a31640 0 -- 172.21.15.107:0/2432637182 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x561e4f3d03b0 msgr2=0x561e4f3d2870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:41.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.777+0000 7f5fb3230640 0 -- 172.21.15.107:0/2432637182 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f5fa808a040 msgr2=0x7f5fa80289e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:41.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:41.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:41.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:41.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:41.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:41.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:41.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:41.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:41.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 zone default found 2024-09-12T17:52:41.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 4 Realm: () 2024-09-12T17:52:41.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:41.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:41.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:41.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 zonegroup default 2024-09-12T17:52:41.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.782+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.783+0000 7f5fb5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.783+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.783+0000 7f5fb5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.783+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.783+0000 7f5fb5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.783+0000 7f5fb5746800 20 started sync module instance, tier type = 2024-09-12T17:52:41.786 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.783+0000 7f5fb5746800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:41.793 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.792+0000 7f5fb5746800 20 add_watcher() i=0 2024-09-12T17:52:41.793 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.792+0000 7f5fb5746800 20 add_watcher() i=1 2024-09-12T17:52:41.793 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.792+0000 7f5fb5746800 20 add_watcher() i=2 2024-09-12T17:52:41.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.792+0000 7f5fb5746800 20 add_watcher() i=3 2024-09-12T17:52:41.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.792+0000 7f5fb5746800 20 add_watcher() i=4 2024-09-12T17:52:41.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.792+0000 7f5fb5746800 20 add_watcher() i=5 2024-09-12T17:52:41.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.792+0000 7f5fb5746800 20 add_watcher() i=6 2024-09-12T17:52:41.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.793+0000 7f5fb5746800 20 add_watcher() i=7 2024-09-12T17:52:41.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.793+0000 7f5fb5746800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:41.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.794+0000 7f5e69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:41.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.795+0000 7f5fb5746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:41.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.795+0000 7f5fb5746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:41.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.795+0000 7f5fb5746800 5 note: GC not initialized 2024-09-12T17:52:41.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.795+0000 7f5e68fe1640 20 reqs_thread_entry: start 2024-09-12T17:52:41.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.795+0000 7f5fb5746800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:41.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.795+0000 7f5fb5746800 20 Filter name: none 2024-09-12T17:52:41.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.795+0000 7f5de27fc640 20 reqs_thread_entry: start 2024-09-12T17:52:41.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.795+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.796+0000 7f5fb5746800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:52:41.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.796+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.796+0000 7f5fb5746800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:52:41.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.796+0000 7f5fb5746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:41.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.796+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.797+0000 7f5fb5746800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:52:41.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.797+0000 7f5fb5746800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.797+0000 7f5fb5746800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:52:41.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.797+0000 7f5fb5746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:41.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.798+0000 7f5e69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:41.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.801+0000 7f5fb5746800 20 remove_watcher() i=0 2024-09-12T17:52:41.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.801+0000 7f5fb5746800 2 removed watcher, disabling cache 2024-09-12T17:52:41.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.802+0000 7f5fb5746800 20 remove_watcher() i=1 2024-09-12T17:52:41.804 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.803+0000 7f5fb5746800 20 remove_watcher() i=2 2024-09-12T17:52:41.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.804+0000 7f5fb5746800 20 remove_watcher() i=3 2024-09-12T17:52:41.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.805+0000 7f5fb5746800 20 remove_watcher() i=4 2024-09-12T17:52:41.807 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.806+0000 7f5fb5746800 20 remove_watcher() i=5 2024-09-12T17:52:41.808 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.807+0000 7f5fb5746800 20 remove_watcher() i=6 2024-09-12T17:52:41.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.808+0000 7f5fb5746800 20 remove_watcher() i=7 2024-09-12T17:52:41.819 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:41.819 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:52:41.819 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: a-bucket id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T17:52:41.819 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:41.821 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:52:41.849 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:41.850 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:41.886 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.884+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.886+0000 7f4dc4a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.886+0000 7f4dc4a11800 20 realm 2024-09-12T17:52:41.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.886+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.886+0000 7f4dc4a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.886+0000 7f4dc4a11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:41.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.886+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.886+0000 7f4dc4a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.886+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.887+0000 7f4dc4a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:41.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.887+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.888+0000 7f4dc4a11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:41.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.888+0000 7f4dc4a11800 20 searching for the correct realm 2024-09-12T17:52:41.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.891+0000 7f4db7991640 0 -- 172.21.15.107:0/1053062114 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f4da801f050 msgr2=0x7f4da8010950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:41.896 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.895+0000 7f4dc0993640 0 -- 172.21.15.107:0/1053062114 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7f4da8020b70 msgr2=0x7f4da803d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:41.899 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.898+0000 7f4dc4a11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:41.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.898+0000 7f4dc4a11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:41.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.898+0000 7f4dc4a11800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:41.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.898+0000 7f4dc4a11800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:41.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.898+0000 7f4dc4a11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:41.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.898+0000 7f4dc4a11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:41.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.898+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.898+0000 7f4dc4a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.900 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.898+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.899+0000 7f4dc4a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:41.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.899+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.899+0000 7f4dc4a11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:41.901 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.899+0000 7f4dc4a11800 20 zone default found 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.899+0000 7f4dc4a11800 4 Realm: () 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.899+0000 7f4dc4a11800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.899+0000 7f4dc4a11800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.899+0000 7f4dc4a11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.899+0000 7f4dc4a11800 20 zonegroup default 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.899+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.899+0000 7f4dc4a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.899+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.900+0000 7f4dc4a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.900+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.900+0000 7f4dc4a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.900+0000 7f4dc4a11800 20 started sync module instance, tier type = 2024-09-12T17:52:41.902 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.900+0000 7f4dc4a11800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:41.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.909+0000 7f4dc4a11800 20 add_watcher() i=0 2024-09-12T17:52:41.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.909+0000 7f4dc4a11800 20 add_watcher() i=1 2024-09-12T17:52:41.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.909+0000 7f4dc4a11800 20 add_watcher() i=2 2024-09-12T17:52:41.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.909+0000 7f4dc4a11800 20 add_watcher() i=3 2024-09-12T17:52:41.910 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.909+0000 7f4dc4a11800 20 add_watcher() i=4 2024-09-12T17:52:41.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.909+0000 7f4dc4a11800 20 add_watcher() i=5 2024-09-12T17:52:41.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.909+0000 7f4dc4a11800 20 add_watcher() i=6 2024-09-12T17:52:41.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.910+0000 7f4dc4a11800 20 add_watcher() i=7 2024-09-12T17:52:41.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.910+0000 7f4dc4a11800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:41.913 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.912+0000 7f4c76fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:41.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.912+0000 7f4dc4a11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:41.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.912+0000 7f4dc4a11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:41.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.912+0000 7f4dc4a11800 5 note: GC not initialized 2024-09-12T17:52:41.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.912+0000 7f4c75fdb640 20 reqs_thread_entry: start 2024-09-12T17:52:41.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.912+0000 7f4dc4a11800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:41.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.912+0000 7f4dc4a11800 20 Filter name: none 2024-09-12T17:52:41.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.912+0000 7f4be77fe640 20 reqs_thread_entry: start 2024-09-12T17:52:41.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.913+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.913+0000 7f4dc4a11800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:52:41.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.913+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.913+0000 7f4dc4a11800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:52:41.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.913+0000 7f4dc4a11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:41.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.913+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.914+0000 7f4dc4a11800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:52:41.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.914+0000 7f4dc4a11800 20 rados->read ofs=0 len=0 2024-09-12T17:52:41.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.914+0000 7f4dc4a11800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:52:41.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.914+0000 7f4dc4a11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:41.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.915+0000 7f4c76fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:41.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.918+0000 7f4dc4a11800 20 remove_watcher() i=0 2024-09-12T17:52:41.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.918+0000 7f4dc4a11800 2 removed watcher, disabling cache 2024-09-12T17:52:41.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.919+0000 7f4dc4a11800 20 remove_watcher() i=1 2024-09-12T17:52:41.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.920+0000 7f4dc4a11800 20 remove_watcher() i=2 2024-09-12T17:52:41.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.921+0000 7f4dc4a11800 20 remove_watcher() i=3 2024-09-12T17:52:41.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.922+0000 7f4dc4a11800 20 remove_watcher() i=4 2024-09-12T17:52:41.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.923+0000 7f4dc4a11800 20 remove_watcher() i=5 2024-09-12T17:52:41.925 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.924+0000 7f4dc4a11800 20 remove_watcher() i=6 2024-09-12T17:52:41.926 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:41.925+0000 7f4dc4a11800 20 remove_watcher() i=7 2024-09-12T17:52:41.938 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:52:41.971 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:41.972 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:42.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.007+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.008+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.008+0000 7f7782f26800 20 realm 2024-09-12T17:52:42.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.008+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.008+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.008+0000 7f7782f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:42.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.008+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.009+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.010 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.009+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.010+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:42.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.010+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.010+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:42.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.010+0000 7f7782f26800 20 searching for the correct realm 2024-09-12T17:52:42.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.013+0000 7f777f30a640 0 -- 172.21.15.107:0/3045872432 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x555fece477d0 msgr2=0x555fece49c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:42.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.017+0000 7f7777fff640 0 -- 172.21.15.107:0/3045872432 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f776804def0 msgr2=0x7f77680dd400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:42.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:42.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:42.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:42.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:42.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:42.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:42.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.020+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.022 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:42.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:42.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.021+0000 7f7782f26800 20 zone default found 2024-09-12T17:52:42.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.021+0000 7f7782f26800 4 Realm: () 2024-09-12T17:52:42.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.021+0000 7f7782f26800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:42.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.021+0000 7f7782f26800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:42.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.021+0000 7f7782f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:42.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.021+0000 7f7782f26800 20 zonegroup default 2024-09-12T17:52:42.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.024 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.022+0000 7f7782f26800 20 started sync module instance, tier type = 2024-09-12T17:52:42.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.022+0000 7f7782f26800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:42.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=0 2024-09-12T17:52:42.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=1 2024-09-12T17:52:42.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=2 2024-09-12T17:52:42.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=3 2024-09-12T17:52:42.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=4 2024-09-12T17:52:42.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=5 2024-09-12T17:52:42.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=6 2024-09-12T17:52:42.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.033+0000 7f7782f26800 20 add_watcher() i=7 2024-09-12T17:52:42.034 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.033+0000 7f7782f26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:42.035 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.034+0000 7f76357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:42.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.035+0000 7f7782f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:42.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.035+0000 7f7782f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:42.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.035+0000 7f7782f26800 5 note: GC not initialized 2024-09-12T17:52:42.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.035+0000 7f75affff640 20 reqs_thread_entry: start 2024-09-12T17:52:42.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.035+0000 7f7782f26800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:42.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.035+0000 7f7782f26800 20 Filter name: none 2024-09-12T17:52:42.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.035+0000 7f75adffb640 20 reqs_thread_entry: start 2024-09-12T17:52:42.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.035+0000 7f7782f26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:52:42.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.035+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.037 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.036+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:52:42.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.036+0000 7f7782f26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:52:42.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.036+0000 7f7782f26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:52:42.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.036+0000 7f7782f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:52:42.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.036+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.036+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:52:42.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.036+0000 7f7782f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:52:42.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.036+0000 7f7782f26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:52:42.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.036+0000 7f7782f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:42.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.036+0000 7f7782f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:52:42.038 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.036+0000 7f7782f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:52:42.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.040+0000 7f7782f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:52:42.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.040+0000 7f7782f26800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:52:42.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.040+0000 7f7782f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:52:42.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.040+0000 7f7782f26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:52:42.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.040+0000 7f76627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 93870484717328 notifier 8070 bl.length()=911 2024-09-12T17:52:42.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.040+0000 7f76627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:52:42.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.040+0000 7f76627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:52:42.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.040+0000 7f76627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:52:42.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.041+0000 7f7782f26800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:52:42.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.041+0000 7f7782f26800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:52:42.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.041+0000 7f7782f26800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:52:42.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.041+0000 7f7782f26800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:52:42.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.0 2024-09-12T17:52:42.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.0 2024-09-12T17:52:42.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.1 2024-09-12T17:52:42.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.1 2024-09-12T17:52:42.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.2 2024-09-12T17:52:42.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.2 2024-09-12T17:52:42.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.3 2024-09-12T17:52:42.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.3 2024-09-12T17:52:42.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:52:42.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:52:42.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:52:42.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:52:42.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.045+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:52:42.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.045+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:52:42.048 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7782f26800 time 2024-09-12T17:52:42.048315+0000 2024-09-12T17:52:42.048 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:52:42.049 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:42.049 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f778458c71a] 2024-09-12T17:52:42.049 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f778458c8d8] 2024-09-12T17:52:42.049 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555feb77b841] 2024-09-12T17:52:42.049 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555feb78a734] 2024-09-12T17:52:42.049 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555feb78b5d4] 2024-09-12T17:52:42.049 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:52:42.049 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7783229590] 2024-09-12T17:52:42.049 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:52:42.049 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:52:42.049 INFO:tasks.workunit.client.0.smithi107.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f7782f26800 thread_name:radosgw-admin 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.048+0000 7f7782f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7782f26800 time 2024-09-12T17:52:42.048315+0000 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f778458c71a] 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f778458c8d8] 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555feb77b841] 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555feb78a734] 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555feb78b5d4] 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7783229590] 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:52:42.050 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:52:42.051 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.070 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:42.070 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f778323e6f0] 2024-09-12T17:52:42.071 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f778328b99c] 2024-09-12T17:52:42.071 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:52:42.071 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:52:42.071 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f778458c774] 2024-09-12T17:52:42.071 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f778458c8d8] 2024-09-12T17:52:42.071 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555feb77b841] 2024-09-12T17:52:42.071 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555feb78a734] 2024-09-12T17:52:42.071 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555feb78b5d4] 2024-09-12T17:52:42.071 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:52:42.071 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7783229590] 2024-09-12T17:52:42.071 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:52:42.071 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.048+0000 7f7782f26800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f7782f26800 thread_name:radosgw-admin 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f778323e6f0] 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f778328b99c] 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f778458c774] 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f778458c8d8] 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555feb77b841] 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555feb78a734] 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555feb78b5d4] 2024-09-12T17:52:42.072 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7783229590] 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding auth protocol: cephx 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding auth protocol: cephx 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: secure 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: crc 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: secure 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: crc 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: secure 2024-09-12T17:52:42.073 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: crc 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: crc 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: secure 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: crc 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: secure 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: crc 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: secure 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:52:41.991+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:52:41.991+0000 7f7782f26800 1 librados: starting msgr at 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:52:41.991+0000 7f7782f26800 1 librados: starting objecter 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command objecter_requests hook 0x555fecd606b0 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:52:41.991+0000 7f7782f26800 1 librados: setting wanted keys 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:52:41.991+0000 7f7782f26800 1 librados: calling monclient init 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:52:41.991+0000 7f7782f26800 10 monclient: init 2024-09-12T17:52:42.074 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding auth protocol: cephx 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding auth protocol: cephx 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding auth protocol: cephx 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: secure 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: crc 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: secure 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: crc 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: secure 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: crc 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: crc 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: secure 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: crc 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: secure 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: crc 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: secure 2024-09-12T17:52:42.075 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:52:41.991+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:52:41.992+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:52:41.992+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command rotate-key hook 0x555fecd5ddb8 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-c con 0x555fecc14950 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-b con 0x555fecca3a60 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-a con 0x555fecd64400 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): authenticate will time out at 2166.538150s 2024-09-12T17:52:42.076 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): get_auth_request con 0x555fecd64400 auth_method 0 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): get_auth_request con 0x555fecc14950 auth_method 0 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.077 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:52:41.992+0000 7f7777fff640 10 monclient(hunting): get_auth_request con 0x555fecca3a60 auth_method 0 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:52:41.992+0000 7f7777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:52:41.992+0000 7f7777fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:52:41.992+0000 7f7777fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): handle_auth_done global_id 8061 payload 824 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient: _finish_hunting 0 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:52:41.992+0000 7f777f30a640 1 monclient: found mon.noname-a 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: dump: 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.078 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: _finish_auth 0 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: _check_auth_tickets 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: dump: 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.079 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:52:41.992+0000 7f7782f26800 5 monclient: authenticate success, global_id 8061 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient: _renew_subs 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:52:41.992+0000 7f766ce09640 4 set_mon_vals no callback set 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient: _renew_subs 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.080 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:52:41.992+0000 7f7782f26800 1 librados: init done 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:52:41.994+0000 7f766b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:52:41.994+0000 7f766b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:52:41.994+0000 7f766b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:52:41.995+0000 7f777eb09640 10 monclient: get_auth_request con 0x7f7664076470 auth_method 0 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:52:41.995+0000 7f7777fff640 10 monclient: get_auth_request con 0x555fecd865d0 auth_method 0 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:52:41.995+0000 7f777eb09640 10 monclient: get_auth_request con 0x555fecda9210 auth_method 0 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:52:41.996+0000 7f7777fff640 10 monclient: get_auth_request con 0x555fecdad400 auth_method 0 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:52:41.998+0000 7f7782f26800 10 monclient: build_initial_monmap 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:52:41.998+0000 7f7782f26800 1 build_initial for_mkfs: 0 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:52:41.998+0000 7f7782f26800 10 monclient: monmap: 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:42.081 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding auth protocol: cephx 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding auth protocol: cephx 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding auth protocol: cephx 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: secure 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: crc 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: secure 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: crc 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: secure 2024-09-12T17:52:42.082 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: crc 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: crc 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: secure 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: crc 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: secure 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: crc 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: secure 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:52:41.998+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command objecter_requests cmddesc objecter_requests hook 0x555fecdb5c60 EEXIST 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:52:41.998+0000 7f7782f26800 10 monclient: init 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding auth protocol: cephx 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding auth protocol: cephx 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding auth protocol: cephx 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: secure 2024-09-12T17:52:42.083 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: crc 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: secure 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: crc 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: secure 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: crc 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: crc 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: secure 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: crc 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: secure 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: crc 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: secure 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:52:41.999+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:52:41.999+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.084 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:52:41.999+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command rotate-key cmddesc rotate-key hook 0x555fecdb0aa0 EEXIST 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-b con 0x555fecdd9950 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-c con 0x555fecddbc20 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-a con 0x555fecdd8120 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): authenticate will time out at 2166.545348s 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): get_auth_request con 0x555fecddbc20 auth_method 0 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.085 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): get_auth_request con 0x555fecdd8120 auth_method 0 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): get_auth_request con 0x555fecdd9950 auth_method 0 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.086 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): handle_auth_done global_id 7589 payload 824 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient: _finish_hunting 0 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:52:41.999+0000 7f7777fff640 1 monclient: found mon.noname-c 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:52:41.999+0000 7f7668e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:52:41.999+0000 7f7668e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:52:41.999+0000 7f7668e01640 10 monclient: dump: 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.087 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.088 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.088 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.088 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.088 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.088 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.088 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.088 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:52:41.999+0000 7f7668e01640 10 monclient: _finish_auth 0 2024-09-12T17:52:42.088 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:52:41.999+0000 7f7668e01640 10 monclient: _check_auth_tickets 2024-09-12T17:52:42.088 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:52:41.999+0000 7f7668e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:52:42.000+0000 7f7668e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:52:42.000+0000 7f7668e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:52:42.000+0000 7f7668e01640 10 monclient: dump: 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.089 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:52:42.000+0000 7f7782f26800 5 monclient: authenticate success, global_id 7589 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:52:42.000+0000 7f7782f26800 10 monclient: _renew_subs 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:52:42.000+0000 7f777fb0b640 4 set_mon_vals no callback set 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:52:42.000+0000 7f7782f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:52:42.000+0000 7f7782f26800 10 monclient: _renew_subs 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:52:42.000+0000 7f7782f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:52:42.001+0000 7f7668e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:52:42.001+0000 7f7668e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:52:42.001+0000 7f7668e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:52:42.002+0000 7f777eb09640 10 monclient: get_auth_request con 0x7f7658076380 auth_method 0 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:52:42.002+0000 7f7782f26800 10 monclient: get_monmap_and_config 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:52:42.002+0000 7f7782f26800 10 monclient: build_initial_monmap 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:52:42.002+0000 7f7782f26800 1 build_initial for_mkfs: 0 2024-09-12T17:52:42.090 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:52:42.002+0000 7f7782f26800 10 monclient: monmap: 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding auth protocol: cephx 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding auth protocol: cephx 2024-09-12T17:52:42.091 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding auth protocol: cephx 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: secure 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: crc 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: secure 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: crc 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: secure 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: crc 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: crc 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: secure 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: crc 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: secure 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: crc 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: secure 2024-09-12T17:52:42.092 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:52:42.002+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:52:42.002+0000 7f7782f26800 10 monclient: init 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding auth protocol: cephx 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding auth protocol: cephx 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding auth protocol: cephx 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: secure 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: crc 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: secure 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: crc 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: secure 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: crc 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: crc 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: secure 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: crc 2024-09-12T17:52:42.093 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: secure 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: crc 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: secure 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:52:42.002+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:52:42.003+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:52:42.003+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command rotate-key cmddesc rotate-key hook 0x7ffe2ce70838 EEXIST 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-c con 0x555fece2ddb0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-a con 0x555fece1e700 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-b con 0x555fece291e0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.094 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): authenticate will time out at 2166.549197s 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): get_auth_request con 0x555fece1e700 auth_method 0 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): get_auth_request con 0x555fece2ddb0 auth_method 0 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.095 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:52:42.003+0000 7f777f30a640 10 monclient(hunting): get_auth_request con 0x555fece291e0 auth_method 0 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:52:42.003+0000 7f777f30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:52:42.003+0000 7f777f30a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:52:42.003+0000 7f777f30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): handle_auth_done global_id 8067 payload 274 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient: _finish_hunting 0 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:52:42.003+0000 7f7777fff640 1 monclient: found mon.noname-a 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: dump: 2024-09-12T17:52:42.096 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: _finish_auth 0 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: _check_auth_tickets 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.097 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: dump: 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:52:42.003+0000 7f7782f26800 5 monclient: authenticate success, global_id 8067 2024-09-12T17:52:42.098 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient: get_monmap_and_config success 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:52:42.003+0000 7f7782f26800 4 set_mon_vals no callback set 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:52:42.004+0000 7f7782f26800 10 monclient: shutdown 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:52:42.004+0000 7f7782f26800 10 monclient: build_initial_monmap 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:52:42.004+0000 7f7782f26800 1 build_initial for_mkfs: 0 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:52:42.004+0000 7f7782f26800 10 monclient: monmap: 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:42.099 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding auth protocol: cephx 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding auth protocol: cephx 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding auth protocol: cephx 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: secure 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: crc 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: secure 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: crc 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: secure 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: crc 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: crc 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: secure 2024-09-12T17:52:42.100 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: crc 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: secure 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: crc 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: secure 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:52:42.004+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:52:42.004+0000 7f7782f26800 1 librados: starting msgr at 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:52:42.004+0000 7f7782f26800 1 librados: starting objecter 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command objecter_requests cmddesc objecter_requests hook 0x555fecdfde40 EEXIST 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:52:42.004+0000 7f7782f26800 1 librados: setting wanted keys 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:52:42.004+0000 7f7782f26800 1 librados: calling monclient init 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:52:42.004+0000 7f7782f26800 10 monclient: init 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding auth protocol: cephx 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding auth protocol: cephx 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding auth protocol: cephx 2024-09-12T17:52:42.101 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: secure 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: crc 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: secure 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: crc 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: secure 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: crc 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: crc 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: secure 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: crc 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: secure 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: crc 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: secure 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:52:42.004+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:52:42.005+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.102 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:52:42.005+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command rotate-key cmddesc rotate-key hook 0x555fecdf1848 EEXIST 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-b con 0x555fece1e700 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-a con 0x555fece291e0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-c con 0x555fece2ddb0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): authenticate will time out at 2166.551289s 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): get_auth_request con 0x555fece291e0 auth_method 0 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.103 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): get_auth_request con 0x555fece2ddb0 auth_method 0 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): handle_auth_done global_id 8070 payload 824 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient: _finish_hunting 0 2024-09-12T17:52:42.104 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:52:42.005+0000 7f7777fff640 1 monclient: found mon.noname-a 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: dump: 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.105 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: _finish_auth 0 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: dump: 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.106 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:52:42.005+0000 7f7782f26800 5 monclient: authenticate success, global_id 8070 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:52:42.005+0000 7f76627fc640 4 set_mon_vals no callback set 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient: _renew_subs 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient: _renew_subs 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:52:42.005+0000 7f7782f26800 1 librados: init done 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:52:42.005+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command cr dump hook 0x555fece27ed8 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:52:42.007+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:52:42.007+0000 7f7660ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:52:42.107 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:52:42.007+0000 7f7660ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:52:42.007+0000 7f7660ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:52:42.007+0000 7f777eb09640 10 monclient: get_auth_request con 0x7f7648076470 auth_method 0 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:52:42.008+0000 7f777f30a640 10 monclient: get_auth_request con 0x555fece477d0 auth_method 0 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:52:42.008+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:52:42.008+0000 7f7782f26800 20 realm 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:52:42.008+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:52:42.008+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:52:42.008+0000 7f7782f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:52:42.008+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:52:42.009+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:52:42.009+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:52:42.009+0000 7f777eb09640 10 monclient: get_auth_request con 0x555fece4ba40 auth_method 0 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:52:42.010+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:42.108 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:52:42.010+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:52:42.010+0000 7f7777fff640 10 monclient: get_auth_request con 0x555fece4f2a0 auth_method 0 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:52:42.010+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:52:42.010+0000 7f7782f26800 20 searching for the correct realm 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:52:42.010+0000 7f777f30a640 10 monclient: get_auth_request con 0x555fece54040 auth_method 0 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:52:42.011+0000 7f777eb09640 10 monclient: get_auth_request con 0x7f77780982d0 auth_method 0 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:52:42.012+0000 7f7777fff640 10 monclient: get_auth_request con 0x7f776804def0 auth_method 0 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:52:42.013+0000 7f777f30a640 0 -- 172.21.15.107:0/3045872432 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x555fece477d0 msgr2=0x555fece49c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:52:42.013+0000 7f7660ff9640 1 client.8070.objecter ms_handle_reset 0x555fece477d0 session 0x555fece47150 osd.1 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:52:42.013+0000 7f7660ff9640 10 monclient: _renew_subs 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:52:42.013+0000 7f7660ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:52:42.014+0000 7f777f30a640 10 monclient: get_auth_request con 0x7f7648086ba0 auth_method 0 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:52:42.014+0000 7f777f30a640 10 monclient: get_auth_request con 0x7f77680be070 auth_method 0 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:52:42.016+0000 7f777eb09640 10 monclient: get_auth_request con 0x7f776807cc40 auth_method 0 2024-09-12T17:52:42.109 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:52:42.017+0000 7f7777fff640 0 -- 172.21.15.107:0/3045872432 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f776804def0 msgr2=0x7f77680dd400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:42.110 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:52:42.017+0000 7f7660ff9640 1 client.8070.objecter ms_handle_reset 0x7f776804def0 session 0x7f7768005040 osd.4 2024-09-12T17:52:42.110 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:52:42.017+0000 7f7777fff640 10 monclient: get_auth_request con 0x555fece477d0 auth_method 0 2024-09-12T17:52:42.110 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:42.110 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:42.110 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:42.110 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:42.110 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:42.113 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:42.113 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.113 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.113 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.113 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:42.113 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 zone default found 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:52:42.021+0000 7f7782f26800 4 Realm: () 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:52:42.021+0000 7f7782f26800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:52:42.021+0000 7f7782f26800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:52:42.021+0000 7f7782f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 zonegroup default 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.114 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 started sync module instance, tier type = 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=0 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=1 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=2 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=3 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=4 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=5 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=6 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:52:42.033+0000 7f7782f26800 20 add_watcher() i=7 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:52:42.033+0000 7f7782f26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding auth protocol: cephx 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding auth protocol: cephx 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding auth protocol: cephx 2024-09-12T17:52:42.115 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: secure 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: crc 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: secure 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: crc 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: secure 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: crc 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: crc 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: secure 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: crc 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: secure 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:52:42.034+0000 7f76357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: crc 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: secure 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:52:42.034+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.116 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:52:42.035+0000 7f7782f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:42.117 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:52:42.035+0000 7f7782f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:42.117 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command cache list hook 0x555fece26c70 2024-09-12T17:52:42.117 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command cache inspect hook 0x555fece26c70 2024-09-12T17:52:42.117 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command cache erase hook 0x555fece26c70 2024-09-12T17:52:42.117 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command cache zap hook 0x555fece26c70 2024-09-12T17:52:42.117 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 note: GC not initialized 2024-09-12T17:52:42.117 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:52:42.035+0000 7f75affff640 20 reqs_thread_entry: start 2024-09-12T17:52:42.117 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command sync trace show hook 0x7f7768070f20 2024-09-12T17:52:42.117 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command sync trace history hook 0x7f7768070f20 2024-09-12T17:52:42.117 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command sync trace active hook 0x7f7768070f20 2024-09-12T17:52:42.117 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command sync trace active_short hook 0x7f7768070f20 2024-09-12T17:52:42.117 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:52:42.035+0000 7f7782f26800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:52:42.035+0000 7f7782f26800 20 Filter name: none 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:52:42.035+0000 7f75adffb640 20 reqs_thread_entry: start 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:52:42.035+0000 7f7782f26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:52:42.035+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:52:42.036+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:52:42.036+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:52:42.036+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:42.118 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:52:42.040+0000 7f7782f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:52:42.040+0000 7f7782f26800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:52:42.040+0000 7f7782f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:52:42.040+0000 7f7782f26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:52:42.040+0000 7f76627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 93870484717328 notifier 8070 bl.length()=911 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:52:42.040+0000 7f76627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:52:42.040+0000 7f76627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:52:42.040+0000 7f76627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:52:42.041+0000 7f7782f26800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:52:42.041+0000 7f7782f26800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:52:42.041+0000 7f7782f26800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:52:42.041+0000 7f7782f26800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:52:42.119 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.0 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.0 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.1 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.1 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.2 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.2 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.3 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.3 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:52:42.045+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:52:42.120 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:52:42.045+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:52:42.048+0000 7f7782f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7782f26800 time 2024-09-12T17:52:42.048315+0000 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f778458c71a] 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f778458c8d8] 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555feb77b841] 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555feb78a734] 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555feb78b5d4] 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7783229590] 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.121 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:52:42.048+0000 7f7782f26800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f7782f26800 thread_name:radosgw-admin 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f778323e6f0] 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f778328b99c] 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f778458c774] 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f778458c8d8] 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555feb77b841] 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555feb78a734] 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555feb78b5d4] 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:52:42.122 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7783229590] 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:52:42.123 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:52:42.124 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:52:42.125 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:52:42.125 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:52:42.125 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:52:42.125 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:52:42.125 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:52:42.125 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:52:42.125 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:52:42.125 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:52:42.125 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:52:42.125 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:52:42.125 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:52:42.126 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:52:42.127 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:52:42.128 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:52:42.129 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: 7f75adffb640 / http_manager 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: 7f75affff640 / http_manager 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: 7f76357e2640 / rgw_dt_lg_renew 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: 7f7660ff9640 / ms_dispatch 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: 7f76627fc640 / io_context_pool 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: 7f7668e01640 / ms_dispatch 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: 7f766b606640 / ms_dispatch 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: 7f766ce09640 / io_context_pool 2024-09-12T17:52:42.130 INFO:tasks.workunit.client.0.smithi107.stderr: 7f7777fff640 / msgr-worker-2 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr: 7f777eb09640 / msgr-worker-1 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr: 7f777f30a640 / msgr-worker-0 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr: 7f777fb0b640 / io_context_pool 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr: 7f7782f26800 / radosgw-admin 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/log/ceph/ceph-client.admin.146598.log 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding auth protocol: cephx 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding auth protocol: cephx 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: secure 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: crc 2024-09-12T17:52:42.131 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: secure 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: crc 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: secure 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: crc 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: crc 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: secure 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: crc 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: secure 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: crc 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd63230) adding con mode: secure 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:52:41.991+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:52:41.991+0000 7f7782f26800 1 librados: starting msgr at 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:52:41.991+0000 7f7782f26800 1 librados: starting objecter 2024-09-12T17:52:42.132 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command objecter_requests hook 0x555fecd606b0 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:52:41.991+0000 7f7782f26800 1 librados: setting wanted keys 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:52:41.991+0000 7f7782f26800 1 librados: calling monclient init 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:52:41.991+0000 7f7782f26800 10 monclient: init 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding auth protocol: cephx 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding auth protocol: cephx 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding auth protocol: cephx 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: secure 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: crc 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: secure 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: crc 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: secure 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: crc 2024-09-12T17:52:42.133 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: crc 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: secure 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: crc 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: secure 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: crc 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:52:41.991+0000 7f7782f26800 5 AuthRegistry(0x555fecd5dc70) adding con mode: secure 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:52:41.991+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:52:41.992+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:52:41.992+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command rotate-key hook 0x555fecd5ddb8 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-c con 0x555fecc14950 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-b con 0x555fecca3a60 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:42.134 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-a con 0x555fecd64400 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient(hunting): authenticate will time out at 2166.538150s 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): get_auth_request con 0x555fecd64400 auth_method 0 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): get_auth_request con 0x555fecc14950 auth_method 0 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.135 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:52:41.992+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:52:41.992+0000 7f7777fff640 10 monclient(hunting): get_auth_request con 0x555fecca3a60 auth_method 0 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:52:41.992+0000 7f7777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:52:41.992+0000 7f7777fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:52:41.992+0000 7f7777fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient(hunting): handle_auth_done global_id 8061 payload 824 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient: _finish_hunting 0 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:52:41.992+0000 7f777f30a640 1 monclient: found mon.noname-a 2024-09-12T17:52:42.136 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:52:41.992+0000 7f777f30a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: dump: 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.137 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: _finish_auth 0 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: _check_auth_tickets 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:52:41.992+0000 7f766b606640 10 monclient: dump: 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.138 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:52:41.992+0000 7f7782f26800 5 monclient: authenticate success, global_id 8061 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient: _renew_subs 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:52:41.992+0000 7f766ce09640 4 set_mon_vals no callback set 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient: _renew_subs 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:52:41.992+0000 7f7782f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:52:41.992+0000 7f7782f26800 1 librados: init done 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:52:41.994+0000 7f766b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:52:41.994+0000 7f766b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:52:41.994+0000 7f766b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:42.139 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:52:41.995+0000 7f777eb09640 10 monclient: get_auth_request con 0x7f7664076470 auth_method 0 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:52:41.995+0000 7f7777fff640 10 monclient: get_auth_request con 0x555fecd865d0 auth_method 0 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:52:41.995+0000 7f777eb09640 10 monclient: get_auth_request con 0x555fecda9210 auth_method 0 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:52:41.996+0000 7f7777fff640 10 monclient: get_auth_request con 0x555fecdad400 auth_method 0 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:52:41.998+0000 7f7782f26800 10 monclient: build_initial_monmap 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:52:41.998+0000 7f7782f26800 1 build_initial for_mkfs: 0 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:52:41.998+0000 7f7782f26800 10 monclient: monmap: 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:42.140 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding auth protocol: cephx 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding auth protocol: cephx 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding auth protocol: cephx 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: secure 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: crc 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: secure 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: crc 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: secure 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: crc 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: crc 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: secure 2024-09-12T17:52:42.141 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: crc 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: secure 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: crc 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb2280) adding con mode: secure 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:52:41.998+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command objecter_requests cmddesc objecter_requests hook 0x555fecdb5c60 EEXIST 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:52:41.998+0000 7f7782f26800 10 monclient: init 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding auth protocol: cephx 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding auth protocol: cephx 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding auth protocol: cephx 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: secure 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: crc 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: secure 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: crc 2024-09-12T17:52:42.142 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: secure 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: crc 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: crc 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: secure 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: crc 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: secure 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: crc 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:52:41.998+0000 7f7782f26800 5 AuthRegistry(0x555fecdb0958) adding con mode: secure 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:52:41.999+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:52:41.999+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:52:41.999+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command rotate-key cmddesc rotate-key hook 0x555fecdb0aa0 EEXIST 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:52:42.143 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-b con 0x555fecdd9950 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:42.144 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-c con 0x555fecddbc20 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:42.144 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-a con 0x555fecdd8120 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:42.144 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.144 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.144 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.144 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:42.144 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:52:41.999+0000 7f7782f26800 10 monclient(hunting): authenticate will time out at 2166.545348s 2024-09-12T17:52:42.144 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): get_auth_request con 0x555fecddbc20 auth_method 0 2024-09-12T17:52:42.144 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.144 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.144 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.144 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): get_auth_request con 0x555fecdd8120 auth_method 0 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): get_auth_request con 0x555fecdd9950 auth_method 0 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:52:41.999+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.145 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:52:41.999+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient(hunting): handle_auth_done global_id 7589 payload 824 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient: _finish_hunting 0 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:52:41.999+0000 7f7777fff640 1 monclient: found mon.noname-c 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:52:41.999+0000 7f7777fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:52:41.999+0000 7f7668e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:52:41.999+0000 7f7668e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:52:41.999+0000 7f7668e01640 10 monclient: dump: 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.146 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:52:41.999+0000 7f7668e01640 10 monclient: _finish_auth 0 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:52:41.999+0000 7f7668e01640 10 monclient: _check_auth_tickets 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:52:41.999+0000 7f7668e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:52:42.000+0000 7f7668e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:52:42.000+0000 7f7668e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:52:42.000+0000 7f7668e01640 10 monclient: dump: 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.147 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:52:42.000+0000 7f7782f26800 5 monclient: authenticate success, global_id 7589 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:52:42.000+0000 7f7782f26800 10 monclient: _renew_subs 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:52:42.000+0000 7f777fb0b640 4 set_mon_vals no callback set 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:52:42.000+0000 7f7782f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:52:42.000+0000 7f7782f26800 10 monclient: _renew_subs 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:52:42.000+0000 7f7782f26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:52:42.001+0000 7f7668e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:52:42.001+0000 7f7668e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:52:42.001+0000 7f7668e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:42.148 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:52:42.002+0000 7f777eb09640 10 monclient: get_auth_request con 0x7f7658076380 auth_method 0 2024-09-12T17:52:42.149 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:52:42.002+0000 7f7782f26800 10 monclient: get_monmap_and_config 2024-09-12T17:52:42.149 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:52:42.002+0000 7f7782f26800 10 monclient: build_initial_monmap 2024-09-12T17:52:42.149 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:52:42.002+0000 7f7782f26800 1 build_initial for_mkfs: 0 2024-09-12T17:52:42.149 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:52:42.002+0000 7f7782f26800 10 monclient: monmap: 2024-09-12T17:52:42.149 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:42.149 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:42.149 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:42.149 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:42.149 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:42.149 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.149 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:42.149 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding auth protocol: cephx 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding auth protocol: cephx 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding auth protocol: cephx 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: secure 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: crc 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: secure 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: crc 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: secure 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: crc 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: crc 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: secure 2024-09-12T17:52:42.150 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: crc 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: secure 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: crc 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x555fecdf97b0) adding con mode: secure 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:52:42.002+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:52:42.002+0000 7f7782f26800 10 monclient: init 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding auth protocol: cephx 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding auth protocol: cephx 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding auth protocol: cephx 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: secure 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: crc 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: secure 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: crc 2024-09-12T17:52:42.151 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: secure 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: crc 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: crc 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: secure 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: crc 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: secure 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: crc 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:52:42.002+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce706f0) adding con mode: secure 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:52:42.002+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:52:42.003+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:52:42.003+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command rotate-key cmddesc rotate-key hook 0x7ffe2ce70838 EEXIST 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-c con 0x555fece2ddb0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:42.152 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-a con 0x555fece1e700 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:42.153 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-b con 0x555fece291e0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:42.153 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.153 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.153 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.153 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:42.153 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient(hunting): authenticate will time out at 2166.549197s 2024-09-12T17:52:42.153 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): get_auth_request con 0x555fece1e700 auth_method 0 2024-09-12T17:52:42.153 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.153 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.153 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.153 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): get_auth_request con 0x555fece2ddb0 auth_method 0 2024-09-12T17:52:42.153 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:52:42.003+0000 7f777eb09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:52:42.003+0000 7f777f30a640 10 monclient(hunting): get_auth_request con 0x555fece291e0 auth_method 0 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:52:42.003+0000 7f777f30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:52:42.003+0000 7f777f30a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:52:42.003+0000 7f777f30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient(hunting): handle_auth_done global_id 8067 payload 274 2024-09-12T17:52:42.154 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient: _finish_hunting 0 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:52:42.003+0000 7f7777fff640 1 monclient: found mon.noname-a 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:52:42.003+0000 7f7777fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: dump: 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.155 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: _finish_auth 0 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: _check_auth_tickets 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:52:42.003+0000 7f76627fc640 10 monclient: dump: 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.156 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:52:42.003+0000 7f7782f26800 5 monclient: authenticate success, global_id 8067 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:52:42.003+0000 7f7782f26800 10 monclient: get_monmap_and_config success 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:52:42.003+0000 7f7782f26800 4 set_mon_vals no callback set 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:52:42.004+0000 7f7782f26800 10 monclient: shutdown 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:52:42.004+0000 7f7782f26800 10 monclient: build_initial_monmap 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:52:42.004+0000 7f7782f26800 1 build_initial for_mkfs: 0 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:52:42.004+0000 7f7782f26800 10 monclient: monmap: 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:52:42.157 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:52:42.158 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:52:42.158 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:52:42.158 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.158 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:52:42.158 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:52:42.158 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:52:42.158 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.158 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding auth protocol: cephx 2024-09-12T17:52:42.158 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding auth protocol: cephx 2024-09-12T17:52:42.158 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding auth protocol: cephx 2024-09-12T17:52:42.158 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: secure 2024-09-12T17:52:42.158 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: crc 2024-09-12T17:52:42.159 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: secure 2024-09-12T17:52:42.159 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: crc 2024-09-12T17:52:42.159 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: secure 2024-09-12T17:52:42.159 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: crc 2024-09-12T17:52:42.159 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: crc 2024-09-12T17:52:42.159 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: secure 2024-09-12T17:52:42.159 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: crc 2024-09-12T17:52:42.159 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: secure 2024-09-12T17:52:42.159 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: crc 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdfd310) adding con mode: secure 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:52:42.004+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:52:42.004+0000 7f7782f26800 1 librados: starting msgr at 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:52:42.004+0000 7f7782f26800 1 librados: starting objecter 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command objecter_requests cmddesc objecter_requests hook 0x555fecdfde40 EEXIST 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:52:42.004+0000 7f7782f26800 1 librados: setting wanted keys 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:52:42.004+0000 7f7782f26800 1 librados: calling monclient init 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:52:42.004+0000 7f7782f26800 10 monclient: init 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding auth protocol: cephx 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding auth protocol: cephx 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding auth protocol: cephx 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: secure 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: crc 2024-09-12T17:52:42.160 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: secure 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: crc 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: secure 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: crc 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: crc 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: secure 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: crc 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: secure 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: crc 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:52:42.004+0000 7f7782f26800 5 AuthRegistry(0x555fecdf1700) adding con mode: secure 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:52:42.004+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:52:42.005+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:52:42.005+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command rotate-key cmddesc rotate-key hook 0x555fecdf1848 EEXIST 2024-09-12T17:52:42.161 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient: _reopen_session rank -1 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-b con 0x555fece1e700 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-a con 0x555fece291e0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): picked mon.noname-c con 0x555fece2ddb0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): start opening mon connection 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): _renew_subs 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient(hunting): authenticate will time out at 2166.551289s 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): get_auth_request con 0x555fece291e0 auth_method 0 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.162 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): get_auth_request con 0x555fece2ddb0 auth_method 0 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:52:42.005+0000 7f777f30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient(hunting): handle_auth_done global_id 8070 payload 824 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient: _finish_hunting 0 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:52:42.005+0000 7f7777fff640 1 monclient: found mon.noname-a 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:52:42.005+0000 7f7777fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.163 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: dump: 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: _finish_auth 0 2024-09-12T17:52:42.164 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:52:42.005+0000 7f7660ff9640 10 monclient: dump: 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:52:42.165 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:52:42.005+0000 7f7782f26800 5 monclient: authenticate success, global_id 8070 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:52:42.005+0000 7f76627fc640 4 set_mon_vals no callback set 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient: _renew_subs 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient: _renew_subs 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:52:42.005+0000 7f7782f26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:52:42.005+0000 7f7782f26800 1 librados: init done 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:52:42.005+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command cr dump hook 0x555fece27ed8 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:52:42.007+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:52:42.007+0000 7f7660ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:52:42.007+0000 7f7660ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:52:42.007+0000 7f7660ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:52:42.166 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:52:42.007+0000 7f777eb09640 10 monclient: get_auth_request con 0x7f7648076470 auth_method 0 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:52:42.008+0000 7f777f30a640 10 monclient: get_auth_request con 0x555fece477d0 auth_method 0 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:52:42.008+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:52:42.008+0000 7f7782f26800 20 realm 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:52:42.008+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:52:42.008+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:52:42.008+0000 7f7782f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:52:42.008+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:52:42.009+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:52:42.009+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:52:42.009+0000 7f777eb09640 10 monclient: get_auth_request con 0x555fece4ba40 auth_method 0 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:52:42.010+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:52:42.010+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:52:42.010+0000 7f7777fff640 10 monclient: get_auth_request con 0x555fece4f2a0 auth_method 0 2024-09-12T17:52:42.167 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:52:42.010+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:52:42.010+0000 7f7782f26800 20 searching for the correct realm 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:52:42.010+0000 7f777f30a640 10 monclient: get_auth_request con 0x555fece54040 auth_method 0 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:52:42.011+0000 7f777eb09640 10 monclient: get_auth_request con 0x7f77780982d0 auth_method 0 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:52:42.012+0000 7f7777fff640 10 monclient: get_auth_request con 0x7f776804def0 auth_method 0 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:52:42.013+0000 7f777f30a640 0 -- 172.21.15.107:0/3045872432 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x555fece477d0 msgr2=0x555fece49c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:52:42.013+0000 7f7660ff9640 1 client.8070.objecter ms_handle_reset 0x555fece477d0 session 0x555fece47150 osd.1 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:52:42.013+0000 7f7660ff9640 10 monclient: _renew_subs 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:52:42.013+0000 7f7660ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:52:42.014+0000 7f777f30a640 10 monclient: get_auth_request con 0x7f7648086ba0 auth_method 0 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:52:42.014+0000 7f777f30a640 10 monclient: get_auth_request con 0x7f77680be070 auth_method 0 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:52:42.016+0000 7f777eb09640 10 monclient: get_auth_request con 0x7f776807cc40 auth_method 0 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:52:42.017+0000 7f7777fff640 0 -- 172.21.15.107:0/3045872432 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f776804def0 msgr2=0x7f77680dd400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:42.168 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:52:42.017+0000 7f7660ff9640 1 client.8070.objecter ms_handle_reset 0x7f776804def0 session 0x7f7768005040 osd.4 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:52:42.017+0000 7f7777fff640 10 monclient: get_auth_request con 0x555fece477d0 auth_method 0 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:52:42.020+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:42.169 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 zone default found 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:52:42.021+0000 7f7782f26800 4 Realm: () 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:52:42.021+0000 7f7782f26800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:52:42.021+0000 7f7782f26800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:52:42.021+0000 7f7782f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 zonegroup default 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:52:42.021+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 started sync module instance, tier type = 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:52:42.022+0000 7f7782f26800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:42.170 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=0 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=1 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=2 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=3 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=4 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=5 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:52:42.032+0000 7f7782f26800 20 add_watcher() i=6 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:52:42.033+0000 7f7782f26800 20 add_watcher() i=7 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:52:42.033+0000 7f7782f26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding auth protocol: cephx 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding auth protocol: cephx 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding auth protocol: cephx 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: secure 2024-09-12T17:52:42.171 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: crc 2024-09-12T17:52:42.172 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: secure 2024-09-12T17:52:42.172 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: crc 2024-09-12T17:52:42.172 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: secure 2024-09-12T17:52:42.172 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: crc 2024-09-12T17:52:42.172 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: crc 2024-09-12T17:52:42.172 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: secure 2024-09-12T17:52:42.172 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: crc 2024-09-12T17:52:42.172 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: secure 2024-09-12T17:52:42.172 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:52:42.034+0000 7f76357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:42.172 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: crc 2024-09-12T17:52:42.172 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:52:42.034+0000 7f7782f26800 5 AuthRegistry(0x7ffe2ce70bc0) adding con mode: secure 2024-09-12T17:52:42.172 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:52:42.034+0000 7f7782f26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:52:42.035+0000 7f7782f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:52:42.035+0000 7f7782f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command cache list hook 0x555fece26c70 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command cache inspect hook 0x555fece26c70 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command cache erase hook 0x555fece26c70 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command cache zap hook 0x555fece26c70 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 note: GC not initialized 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:52:42.035+0000 7f75affff640 20 reqs_thread_entry: start 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command sync trace show hook 0x7f7768070f20 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command sync trace history hook 0x7f7768070f20 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command sync trace active hook 0x7f7768070f20 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:52:42.035+0000 7f7782f26800 5 asok(0x555fecb3b730) register_command sync trace active_short hook 0x7f7768070f20 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:52:42.035+0000 7f7782f26800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:42.173 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:52:42.035+0000 7f7782f26800 20 Filter name: none 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:52:42.035+0000 7f75adffb640 20 reqs_thread_entry: start 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:52:42.035+0000 7f7782f26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:52:42.035+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:52:42.036+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:52:42.036+0000 7f7782f26800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:52:42.036+0000 7f7782f26800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:52:42.174 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:52:42.036+0000 7f7782f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:52:42.040+0000 7f7782f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:52:42.040+0000 7f7782f26800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:52:42.040+0000 7f7782f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:52:42.040+0000 7f7782f26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:52:42.040+0000 7f76627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 93870484717328 notifier 8070 bl.length()=911 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:52:42.040+0000 7f76627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:52:42.040+0000 7f76627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:52:42.040+0000 7f76627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:52:42.041+0000 7f7782f26800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:52:42.041+0000 7f7782f26800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:52:42.041+0000 7f7782f26800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:52:42.041+0000 7f7782f26800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.0 2024-09-12T17:52:42.175 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.0 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.1 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.1 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.2 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.2 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.3 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.3 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:52:42.044+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:52:42.044+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:52:42.045+0000 7f7782f26800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:52:42.045+0000 7f7782f26800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:52:42.176 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:52:42.048+0000 7f7782f26800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7782f26800 time 2024-09-12T17:52:42.048315+0000 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f778458c71a] 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f778458c8d8] 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555feb77b841] 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555feb78a734] 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555feb78b5d4] 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7783229590] 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:52:42.177 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:52:42.048+0000 7f7782f26800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f7782f26800 thread_name:radosgw-admin 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f778323e6f0] 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f778328b99c] 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f778458c774] 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f778458c8d8] 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555feb77b841] 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555feb78a734] 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555feb78b5d4] 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:52:42.178 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7783229590] 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:52:42.179 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:52:42.180 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:52:42.181 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:52:42.182 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:52:42.183 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:52:42.184 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:52:42.185 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f75adffb640 / http_manager 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f75affff640 / http_manager 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f76357e2640 / rgw_dt_lg_renew 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f7660ff9640 / ms_dispatch 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f76627fc640 / io_context_pool 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f7668e01640 / ms_dispatch 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f766b606640 / ms_dispatch 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f766ce09640 / io_context_pool 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f7777fff640 / msgr-worker-2 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f777eb09640 / msgr-worker-1 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f777f30a640 / msgr-worker-0 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f777fb0b640 / io_context_pool 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: 7f7782f26800 / radosgw-admin 2024-09-12T17:52:42.186 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:52:42.187 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:52:42.187 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:52:42.049915Z_f372c03c-c75d-420c-a310-2fc4741f450d/log 2024-09-12T17:52:42.187 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:52:42.187 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:52:42.193 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:42.193 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:42.193 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.122+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.124+0000 7fc16192a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.124+0000 7fc16192a800 20 realm 2024-09-12T17:52:42.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.124+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.124+0000 7fc16192a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.124+0000 7fc16192a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:42.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.124+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.124+0000 7fc16192a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.124+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.125+0000 7fc16192a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:42.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.125+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.126+0000 7fc16192a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:42.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.126+0000 7fc16192a800 20 searching for the correct realm 2024-09-12T17:52:42.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.128+0000 7fc15de50640 0 -- 172.21.15.107:0/1226794292 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x563ad2d5c3a0 msgr2=0x563ad2d5e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:42.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.132+0000 7fc15d64f640 0 -- 172.21.15.107:0/1226794292 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc154063930 msgr2=0x7fc1540793c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:42.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:42.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:42.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:42.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:42.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:42.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:42.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:42.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:42.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 zone default found 2024-09-12T17:52:42.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 4 Realm: () 2024-09-12T17:52:42.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:42.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:42.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:42.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 zonegroup default 2024-09-12T17:52:42.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.136+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.137+0000 7fc16192a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.137+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.137+0000 7fc16192a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.137+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.137+0000 7fc16192a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.137+0000 7fc16192a800 20 started sync module instance, tier type = 2024-09-12T17:52:42.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.137+0000 7fc16192a800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:42.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.148+0000 7fc16192a800 20 add_watcher() i=0 2024-09-12T17:52:42.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.148+0000 7fc16192a800 20 add_watcher() i=1 2024-09-12T17:52:42.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.148+0000 7fc16192a800 20 add_watcher() i=2 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.148+0000 7fc16192a800 20 add_watcher() i=3 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.148+0000 7fc16192a800 20 add_watcher() i=4 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.148+0000 7fc16192a800 20 add_watcher() i=5 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.148+0000 7fc16192a800 20 add_watcher() i=6 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.149+0000 7fc16192a800 20 add_watcher() i=7 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.149+0000 7fc16192a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.151+0000 7fc013fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.151+0000 7fc16192a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.151+0000 7fc16192a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.151+0000 7fc16192a800 5 note: GC not initialized 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.151+0000 7fc012fe5640 20 reqs_thread_entry: start 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.151+0000 7fc16192a800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:42.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.151+0000 7fc16192a800 20 Filter name: none 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.152+0000 7fc010fe1640 20 reqs_thread_entry: start 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.152+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.152+0000 7fc16192a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.152+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.153+0000 7fc16192a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.153+0000 7fc16192a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.153+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.153+0000 7fc16192a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.153+0000 7fc16192a800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.153+0000 7fc16192a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.153+0000 7fc16192a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.155+0000 7fc013fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:42.199 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.157+0000 7fc16192a800 20 remove_watcher() i=0 2024-09-12T17:52:42.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.157+0000 7fc16192a800 2 removed watcher, disabling cache 2024-09-12T17:52:42.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.158+0000 7fc16192a800 20 remove_watcher() i=1 2024-09-12T17:52:42.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.160+0000 7fc16192a800 20 remove_watcher() i=2 2024-09-12T17:52:42.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.161+0000 7fc16192a800 20 remove_watcher() i=3 2024-09-12T17:52:42.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.162+0000 7fc16192a800 20 remove_watcher() i=4 2024-09-12T17:52:42.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.162+0000 7fc16192a800 20 remove_watcher() i=5 2024-09-12T17:52:42.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.163+0000 7fc16192a800 20 remove_watcher() i=6 2024-09-12T17:52:42.200 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.165+0000 7fc16192a800 20 remove_watcher() i=7 2024-09-12T17:52:42.200 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:52:42.216 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:52:42.216 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:52:42.252 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.251+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.252+0000 7f423b317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.252+0000 7f423b317800 20 realm 2024-09-12T17:52:42.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.252+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.253+0000 7f423b317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.253+0000 7f423b317800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:52:42.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.253+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.253+0000 7f423b317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.254 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.253+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.253+0000 7f423b317800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:42.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.253+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.254+0000 7f423b317800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:52:42.255 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.254+0000 7f423b317800 20 searching for the correct realm 2024-09-12T17:52:42.258 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.257+0000 7f4239602640 0 -- 172.21.15.107:0/1391821422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db8ab09a40 msgr2=0x55db8aaf7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:52:42.261 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.260+0000 7f4238e01640 0 -- 172.21.15.107:0/1391821422 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f42340640e0 msgr2=0x7f4234062b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:52:42.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.265+0000 7f423b317800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:52:42.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.265+0000 7f423b317800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:52:42.272 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.265+0000 7f423b317800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.265+0000 7f423b317800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.265+0000 7f423b317800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.265+0000 7f423b317800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.265+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.265+0000 7f423b317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.265+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.265+0000 7f423b317800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.265+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 20 zone default found 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 4 Realm: () 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:52:42.273 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:52:42.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 20 zonegroup default 2024-09-12T17:52:42.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:52:42.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 20 started sync module instance, tier type = 2024-09-12T17:52:42.274 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.266+0000 7f423b317800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:52:42.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.278+0000 7f423b317800 20 add_watcher() i=0 2024-09-12T17:52:42.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.278+0000 7f423b317800 20 add_watcher() i=1 2024-09-12T17:52:42.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.278+0000 7f423b317800 20 add_watcher() i=2 2024-09-12T17:52:42.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.278+0000 7f423b317800 20 add_watcher() i=3 2024-09-12T17:52:42.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.278+0000 7f423b317800 20 add_watcher() i=4 2024-09-12T17:52:42.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.278+0000 7f423b317800 20 add_watcher() i=5 2024-09-12T17:52:42.279 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.278+0000 7f423b317800 20 add_watcher() i=6 2024-09-12T17:52:42.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.279+0000 7f423b317800 20 add_watcher() i=7 2024-09-12T17:52:42.280 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.279+0000 7f423b317800 2 all 8 watchers are set, enabling cache 2024-09-12T17:52:42.281 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.280+0000 7f40eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:42.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.281+0000 7f423b317800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:52:42.283 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.281+0000 7f423b317800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.281+0000 7f423b317800 5 note: GC not initialized 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.281+0000 7f40edfe3640 20 reqs_thread_entry: start 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.281+0000 7f423b317800 20 init_complete bucket index max shards: 1 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.281+0000 7f423b317800 20 Filter name: none 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.281+0000 7f405f7fe640 20 reqs_thread_entry: start 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.281+0000 7f423b317800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.281+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.281+0000 7f423b317800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.281+0000 7f423b317800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.281+0000 7f423b317800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.282+0000 7f423b317800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.282+0000 7f423b317800 20 rados->read ofs=0 len=0 2024-09-12T17:52:42.284 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.282+0000 7f423b317800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:52:42.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.282+0000 7f423b317800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:52:42.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.282+0000 7f423b317800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:52:42.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.282+0000 7f423b317800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:52:42.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.282+0000 7f423b317800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:52:42.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.282+0000 7f423b317800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:52:42.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.282+0000 7f423b317800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:52:42.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.282+0000 7f423b317800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:52:42.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.282+0000 7f423b317800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:52:42.285 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.282+0000 7f423b317800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:52:42.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.283+0000 7f423b317800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:52:42.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.283+0000 7f423b317800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:52:42.286 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.284+0000 7f40eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:52:42.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.286+0000 7f423b317800 20 remove_watcher() i=0 2024-09-12T17:52:42.287 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.286+0000 7f423b317800 2 removed watcher, disabling cache 2024-09-12T17:52:42.288 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.287+0000 7f423b317800 20 remove_watcher() i=1 2024-09-12T17:52:42.289 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.288+0000 7f423b317800 20 remove_watcher() i=2 2024-09-12T17:52:42.290 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.289+0000 7f423b317800 20 remove_watcher() i=3 2024-09-12T17:52:42.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.290+0000 7f423b317800 20 remove_watcher() i=4 2024-09-12T17:52:42.292 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.291+0000 7f423b317800 20 remove_watcher() i=5 2024-09-12T17:52:42.293 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.292+0000 7f423b317800 20 remove_watcher() i=6 2024-09-12T17:52:42.294 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:52:42.293+0000 7f423b317800 20 remove_watcher() i=7 2024-09-12T17:53:12.331 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:53:12.362 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:12.362 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:12.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.402+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.404+0000 7f1ab7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.406 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.404+0000 7f1ab7d2e800 20 realm 2024-09-12T17:53:12.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.404+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.405+0000 7f1ab7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.405+0000 7f1ab7d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:12.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.405+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.405+0000 7f1ab7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.405+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.406+0000 7f1ab7d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:12.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.406+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.407+0000 7f1ab7d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:12.409 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.407+0000 7f1ab7d2e800 20 searching for the correct realm 2024-09-12T17:53:12.411 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.410+0000 7f1ab416c640 0 -- 172.21.15.107:0/3956052071 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x56369af00e40 msgr2=0x56369af03290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:12.415 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.414+0000 7f1ab396b640 0 -- 172.21.15.107:0/3956052071 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f1aa80c6950 msgr2=0x7f1aa80be860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:12.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.621+0000 7f1ab7d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:12.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.621+0000 7f1ab7d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:12.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.621+0000 7f1ab7d2e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:12.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.621+0000 7f1ab7d2e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:12.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.621+0000 7f1ab7d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:12.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.621+0000 7f1ab7d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:12.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.621+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.622+0000 7f1ab7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.622+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.622+0000 7f1ab7d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:12.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.622+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.623+0000 7f1ab7d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:12.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.623+0000 7f1ab7d2e800 20 zone default found 2024-09-12T17:53:12.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.623+0000 7f1ab7d2e800 4 Realm: () 2024-09-12T17:53:12.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.623+0000 7f1ab7d2e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:12.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.623+0000 7f1ab7d2e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:12.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.623+0000 7f1ab7d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:12.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.623+0000 7f1ab7d2e800 20 zonegroup default 2024-09-12T17:53:12.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.623+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.623+0000 7f1ab7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.623+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.623+0000 7f1ab7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.623+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.624+0000 7f1ab7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.624+0000 7f1ab7d2e800 20 started sync module instance, tier type = 2024-09-12T17:53:12.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.624+0000 7f1ab7d2e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:12.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.634+0000 7f1ab7d2e800 20 add_watcher() i=0 2024-09-12T17:53:12.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.634+0000 7f1ab7d2e800 20 add_watcher() i=1 2024-09-12T17:53:12.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.634+0000 7f1ab7d2e800 20 add_watcher() i=2 2024-09-12T17:53:12.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.634+0000 7f1ab7d2e800 20 add_watcher() i=3 2024-09-12T17:53:12.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.634+0000 7f1ab7d2e800 20 add_watcher() i=4 2024-09-12T17:53:12.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.634+0000 7f1ab7d2e800 20 add_watcher() i=5 2024-09-12T17:53:12.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.634+0000 7f1ab7d2e800 20 add_watcher() i=6 2024-09-12T17:53:12.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.635+0000 7f1ab7d2e800 20 add_watcher() i=7 2024-09-12T17:53:12.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.635+0000 7f1ab7d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:12.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.636+0000 7f196a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:12.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.637+0000 7f1ab7d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:12.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.637+0000 7f1ab7d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:12.639 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.637+0000 7f1ab7d2e800 5 note: GC not initialized 2024-09-12T17:53:12.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.637+0000 7f19697e2640 20 reqs_thread_entry: start 2024-09-12T17:53:12.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.637+0000 7f1ab7d2e800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:12.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.637+0000 7f1ab7d2e800 20 Filter name: none 2024-09-12T17:53:12.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.637+0000 7f19627fc640 20 reqs_thread_entry: start 2024-09-12T17:53:12.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.637+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.638+0000 7f1ab7d2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:12.640 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.638+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.639+0000 7f1ab7d2e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:53:12.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.639+0000 7f1ab7d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:53:12.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.639+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.639+0000 7f1ab7d2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:12.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.639+0000 7f1ab7d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.640+0000 7f1ab7d2e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:53:12.642 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.640+0000 7f1ab7d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:53:12.643 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.642+0000 7f196a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:12.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.644+0000 7f1ab7d2e800 20 remove_watcher() i=0 2024-09-12T17:53:12.645 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.644+0000 7f1ab7d2e800 2 removed watcher, disabling cache 2024-09-12T17:53:12.646 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.645+0000 7f1ab7d2e800 20 remove_watcher() i=1 2024-09-12T17:53:12.647 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.646+0000 7f1ab7d2e800 20 remove_watcher() i=2 2024-09-12T17:53:12.648 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.647+0000 7f1ab7d2e800 20 remove_watcher() i=3 2024-09-12T17:53:12.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.648+0000 7f1ab7d2e800 20 remove_watcher() i=4 2024-09-12T17:53:12.650 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.650+0000 7f1ab7d2e800 20 remove_watcher() i=5 2024-09-12T17:53:12.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.651+0000 7f1ab7d2e800 20 remove_watcher() i=6 2024-09-12T17:53:12.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.652+0000 7f1ab7d2e800 20 remove_watcher() i=7 2024-09-12T17:53:12.685 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:53:12.714 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:12.714 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:12.751 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.750+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.752+0000 7fc9632bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.752+0000 7fc9632bb800 20 realm 2024-09-12T17:53:12.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.752+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.752+0000 7fc9632bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.752+0000 7fc9632bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:12.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.752+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.752+0000 7fc9632bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.753 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.752+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.753+0000 7fc9632bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:12.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.753+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.754 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.753+0000 7fc9632bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:12.755 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.753+0000 7fc9632bb800 20 searching for the correct realm 2024-09-12T17:53:12.757 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.756+0000 7fc960da5640 0 -- 172.21.15.107:0/2775626762 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fc95c01d060 msgr2=0x7fc95c08c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:12.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.760+0000 7fc960da5640 0 -- 172.21.15.107:0/2775626762 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc94c070dd0 msgr2=0x7fc94c0663a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:12.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.967+0000 7fc9632bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:12.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.967+0000 7fc9632bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:12.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.967+0000 7fc9632bb800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:12.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.967+0000 7fc9632bb800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:12.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.967+0000 7fc9632bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:12.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.967+0000 7fc9632bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:12.969 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.967+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.967+0000 7fc9632bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.967+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.968+0000 7fc9632bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:12.970 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.968+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.971 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.968+0000 7fc9632bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:12.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.968+0000 7fc9632bb800 20 zone default found 2024-09-12T17:53:12.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.968+0000 7fc9632bb800 4 Realm: () 2024-09-12T17:53:12.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.968+0000 7fc9632bb800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:12.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.968+0000 7fc9632bb800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:12.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.968+0000 7fc9632bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:12.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.968+0000 7fc9632bb800 20 zonegroup default 2024-09-12T17:53:12.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.968+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.968+0000 7fc9632bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.968+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.969+0000 7fc9632bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.969+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.973 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.969+0000 7fc9632bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:12.973 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.969+0000 7fc9632bb800 20 started sync module instance, tier type = 2024-09-12T17:53:12.973 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.969+0000 7fc9632bb800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:12.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.979+0000 7fc9632bb800 20 add_watcher() i=0 2024-09-12T17:53:12.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.979+0000 7fc9632bb800 20 add_watcher() i=1 2024-09-12T17:53:12.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.979+0000 7fc9632bb800 20 add_watcher() i=2 2024-09-12T17:53:12.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.979+0000 7fc9632bb800 20 add_watcher() i=3 2024-09-12T17:53:12.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.979+0000 7fc9632bb800 20 add_watcher() i=4 2024-09-12T17:53:12.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.979+0000 7fc9632bb800 20 add_watcher() i=5 2024-09-12T17:53:12.980 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.979+0000 7fc9632bb800 20 add_watcher() i=6 2024-09-12T17:53:12.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.979+0000 7fc9632bb800 20 add_watcher() i=7 2024-09-12T17:53:12.981 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.979+0000 7fc9632bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:12.982 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.981+0000 7fc8177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:12.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.982+0000 7fc9632bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:12.983 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.982+0000 7fc9632bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:12.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.982+0000 7fc9632bb800 5 note: GC not initialized 2024-09-12T17:53:12.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.982+0000 7fc8167e4640 20 reqs_thread_entry: start 2024-09-12T17:53:12.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.982+0000 7fc9632bb800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:12.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.982+0000 7fc9632bb800 20 Filter name: none 2024-09-12T17:53:12.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.982+0000 7fc80ffff640 20 reqs_thread_entry: start 2024-09-12T17:53:12.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.982+0000 7fc9632bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:53:12.984 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.982+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.985 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 20 rados->read ofs=0 len=0 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.983+0000 7fc9632bb800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:53:12.986 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.984+0000 7fc9632bb800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:53:12.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.984+0000 7fc9632bb800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:53:12.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.984+0000 7fc9632bb800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:53:12.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.984+0000 7fc9632bb800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:53:12.987 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.985+0000 7fc8177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:12.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.988+0000 7fc9632bb800 20 remove_watcher() i=0 2024-09-12T17:53:12.989 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.988+0000 7fc9632bb800 2 removed watcher, disabling cache 2024-09-12T17:53:12.990 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.989+0000 7fc9632bb800 20 remove_watcher() i=1 2024-09-12T17:53:12.991 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.990+0000 7fc9632bb800 20 remove_watcher() i=2 2024-09-12T17:53:12.992 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.991+0000 7fc9632bb800 20 remove_watcher() i=3 2024-09-12T17:53:12.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.993+0000 7fc9632bb800 20 remove_watcher() i=4 2024-09-12T17:53:12.997 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.996+0000 7fc9632bb800 20 remove_watcher() i=5 2024-09-12T17:53:12.998 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.997+0000 7fc9632bb800 20 remove_watcher() i=6 2024-09-12T17:53:12.999 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:12.998+0000 7fc9632bb800 20 remove_watcher() i=7 2024-09-12T17:53:13.011 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:53:13.040 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:13.041 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:13.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.075+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.077+0000 7f303a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.077+0000 7f303a128800 20 realm 2024-09-12T17:53:13.078 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.077+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.077+0000 7f303a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.077+0000 7f303a128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:13.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.077+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.077+0000 7f303a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.077+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.078+0000 7f303a128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.078+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.079+0000 7f303a128800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:13.080 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.079+0000 7f303a128800 20 searching for the correct realm 2024-09-12T17:53:13.083 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.082+0000 7f3036670640 0 -- 172.21.15.107:0/3460350917 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x560d0d17dae0 msgr2=0x560d0d17ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:13.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.086+0000 7f3035e6f640 0 -- 172.21.15.107:0/3460350917 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f3020050ab0 msgr2=0x7f30200aba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:13.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:13.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:13.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:13.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:13.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:13.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:13.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:13.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 zone default found 2024-09-12T17:53:13.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 4 Realm: () 2024-09-12T17:53:13.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:13.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:13.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:13.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 zonegroup default 2024-09-12T17:53:13.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.091+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.092+0000 7f303a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.092+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.092+0000 7f303a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.092+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.092+0000 7f303a128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.092+0000 7f303a128800 20 started sync module instance, tier type = 2024-09-12T17:53:13.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.092+0000 7f303a128800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:13.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.102+0000 7f303a128800 20 add_watcher() i=0 2024-09-12T17:53:13.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.102+0000 7f303a128800 20 add_watcher() i=1 2024-09-12T17:53:13.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.102+0000 7f303a128800 20 add_watcher() i=2 2024-09-12T17:53:13.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.102+0000 7f303a128800 20 add_watcher() i=3 2024-09-12T17:53:13.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.102+0000 7f303a128800 20 add_watcher() i=4 2024-09-12T17:53:13.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.102+0000 7f303a128800 20 add_watcher() i=5 2024-09-12T17:53:13.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.102+0000 7f303a128800 20 add_watcher() i=6 2024-09-12T17:53:13.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.103+0000 7f303a128800 20 add_watcher() i=7 2024-09-12T17:53:13.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.103+0000 7f303a128800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:13.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.104+0000 7f2ee77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:13.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.104+0000 7f303a128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:13.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.104+0000 7f303a128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:13.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.104+0000 7f303a128800 5 note: GC not initialized 2024-09-12T17:53:13.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.105+0000 7f2ee67fc640 20 reqs_thread_entry: start 2024-09-12T17:53:13.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.105+0000 7f303a128800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:13.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.105+0000 7f303a128800 20 Filter name: none 2024-09-12T17:53:13.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.105+0000 7f2e57fff640 20 reqs_thread_entry: start 2024-09-12T17:53:13.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.105+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.105+0000 7f303a128800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:13.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.105+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.106+0000 7f303a128800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:53:13.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.106+0000 7f303a128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:53:13.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.106+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.106+0000 7f303a128800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:13.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.106+0000 7f303a128800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.107+0000 7f303a128800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:53:13.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.107+0000 7f303a128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:53:13.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.108+0000 7f2ee77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:13.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.110+0000 7f303a128800 20 remove_watcher() i=0 2024-09-12T17:53:13.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.110+0000 7f303a128800 2 removed watcher, disabling cache 2024-09-12T17:53:13.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.112+0000 7f303a128800 20 remove_watcher() i=1 2024-09-12T17:53:13.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.113+0000 7f303a128800 20 remove_watcher() i=2 2024-09-12T17:53:13.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.114+0000 7f303a128800 20 remove_watcher() i=3 2024-09-12T17:53:13.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.115+0000 7f303a128800 20 remove_watcher() i=4 2024-09-12T17:53:13.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.116+0000 7f303a128800 20 remove_watcher() i=5 2024-09-12T17:53:13.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.117+0000 7f303a128800 20 remove_watcher() i=6 2024-09-12T17:53:13.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.118+0000 7f303a128800 20 remove_watcher() i=7 2024-09-12T17:53:13.129 INFO:tasks.workunit.client.0.smithi107.stderr: test: duplicated entries should be purged before reshard 2024-09-12T17:53:13.132 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:53:13.159 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:13.159 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:13.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.193+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.195+0000 7f8b1020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.195+0000 7f8b1020e800 20 realm 2024-09-12T17:53:13.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.195+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.195+0000 7f8b1020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.195+0000 7f8b1020e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:13.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.195+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.195+0000 7f8b1020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.195+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.196+0000 7f8b1020e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.196+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.197+0000 7f8b1020e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:13.198 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.197+0000 7f8b1020e800 20 searching for the correct realm 2024-09-12T17:53:13.201 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.200+0000 7f8b0c16c640 0 -- 172.21.15.107:0/2820873513 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x555d02764130 msgr2=0x555d027665f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:13.204 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.203+0000 7f8b0b96b640 0 -- 172.21.15.107:0/2820873513 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f8af4092410 msgr2=0x7f8af4092890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:13.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:13.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:13.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:13.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:13.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:13.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:13.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.209 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.210 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 zone default found 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 4 Realm: () 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 zonegroup default 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.208+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.209+0000 7f8b1020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.209+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.209+0000 7f8b1020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.211 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.209+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.209+0000 7f8b1020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.209+0000 7f8b1020e800 20 started sync module instance, tier type = 2024-09-12T17:53:13.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.209+0000 7f8b1020e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:13.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.218+0000 7f8b1020e800 20 add_watcher() i=0 2024-09-12T17:53:13.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.218+0000 7f8b1020e800 20 add_watcher() i=1 2024-09-12T17:53:13.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.218+0000 7f8b1020e800 20 add_watcher() i=2 2024-09-12T17:53:13.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.218+0000 7f8b1020e800 20 add_watcher() i=3 2024-09-12T17:53:13.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.218+0000 7f8b1020e800 20 add_watcher() i=4 2024-09-12T17:53:13.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.218+0000 7f8b1020e800 20 add_watcher() i=5 2024-09-12T17:53:13.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.218+0000 7f8b1020e800 20 add_watcher() i=6 2024-09-12T17:53:13.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.219+0000 7f8b1020e800 20 add_watcher() i=7 2024-09-12T17:53:13.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.219+0000 7f8b1020e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:13.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.220+0000 7f89c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:13.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.221+0000 7f8b1020e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:13.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.221+0000 7f8b1020e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:13.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.221+0000 7f8b1020e800 5 note: GC not initialized 2024-09-12T17:53:13.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.221+0000 7f89c0fe1640 20 reqs_thread_entry: start 2024-09-12T17:53:13.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.221+0000 7f8b1020e800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:13.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.221+0000 7f8b1020e800 20 Filter name: none 2024-09-12T17:53:13.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.221+0000 7f893a7fc640 20 reqs_thread_entry: start 2024-09-12T17:53:13.223 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.221+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.221+0000 7f8b1020e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:13.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.222+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.222+0000 7f8b1020e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:53:13.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.222+0000 7f8b1020e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:53:13.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.222+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.222+0000 7f8b1020e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:13.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.222+0000 7f8b1020e800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.222+0000 7f8b1020e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:53:13.224 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.222+0000 7f8b1020e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:53:13.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.224+0000 7f89c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:13.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.226+0000 7f8b1020e800 20 remove_watcher() i=0 2024-09-12T17:53:13.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.226+0000 7f8b1020e800 2 removed watcher, disabling cache 2024-09-12T17:53:13.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.227+0000 7f8b1020e800 20 remove_watcher() i=1 2024-09-12T17:53:13.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.228+0000 7f8b1020e800 20 remove_watcher() i=2 2024-09-12T17:53:13.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.229+0000 7f8b1020e800 20 remove_watcher() i=3 2024-09-12T17:53:13.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.231+0000 7f8b1020e800 20 remove_watcher() i=4 2024-09-12T17:53:13.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.232+0000 7f8b1020e800 20 remove_watcher() i=5 2024-09-12T17:53:13.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.232+0000 7f8b1020e800 20 remove_watcher() i=6 2024-09-12T17:53:13.234 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.233+0000 7f8b1020e800 20 remove_watcher() i=7 2024-09-12T17:53:13.245 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.245 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:53:13.245 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: a-bucket id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-12T17:53:13.245 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.246 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:53:13.279 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:13.309 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:13.315 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.314+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.316+0000 7f535a52c800 20 realm 2024-09-12T17:53:13.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.317 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.316+0000 7f535a52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:13.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.317+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.318 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.317+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.317+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:13.319 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.317+0000 7f535a52c800 20 searching for the correct realm 2024-09-12T17:53:13.321 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.320+0000 7f535624f640 0 -- 172.21.15.107:0/977462662 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f5350069040 msgr2=0x7f5350060940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:13.324 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.323+0000 7f535624f640 0 -- 172.21.15.107:0/977462662 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f5340096b20 msgr2=0x7f5340061650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:13.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:13.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.529+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.529+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.529+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.530+0000 7f535a52c800 20 zone default found 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.530+0000 7f535a52c800 4 Realm: () 2024-09-12T17:53:13.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.530+0000 7f535a52c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:13.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.530+0000 7f535a52c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:13.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.530+0000 7f535a52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:13.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.530+0000 7f535a52c800 20 zonegroup default 2024-09-12T17:53:13.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.531+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.531+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.531+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.531+0000 7f535a52c800 20 started sync module instance, tier type = 2024-09-12T17:53:13.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.531+0000 7f535a52c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:13.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=0 2024-09-12T17:53:13.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=1 2024-09-12T17:53:13.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=2 2024-09-12T17:53:13.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=3 2024-09-12T17:53:13.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=4 2024-09-12T17:53:13.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=5 2024-09-12T17:53:13.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=6 2024-09-12T17:53:13.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.541+0000 7f535a52c800 20 add_watcher() i=7 2024-09-12T17:53:13.542 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.541+0000 7f535a52c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:13.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.542+0000 7f520d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:13.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.542+0000 7f535a52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:13.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.542+0000 7f535a52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:13.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.543+0000 7f535a52c800 5 note: GC not initialized 2024-09-12T17:53:13.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.543+0000 7f52077fe640 20 reqs_thread_entry: start 2024-09-12T17:53:13.544 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.543+0000 7f535a52c800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:13.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.543+0000 7f535a52c800 20 Filter name: none 2024-09-12T17:53:13.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.543+0000 7f52057fa640 20 reqs_thread_entry: start 2024-09-12T17:53:13.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.543+0000 7f535a52c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:53:13.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.543+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.544+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:13.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.544+0000 7f535a52c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:53:13.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.544+0000 7f535a52c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:53:13.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.544+0000 7f535a52c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:53:13.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.544+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.544+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:53:13.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.544+0000 7f535a52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:13.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.544+0000 7f535a52c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:13.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.544+0000 7f535a52c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:13.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.544+0000 7f535a52c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:13.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.544+0000 7f535a52c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:53:13.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.548+0000 7f535a52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:13.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.548+0000 7f535a52c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:13.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.548+0000 7f535a52c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:13.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.548+0000 7f535a52c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:53:13.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.548+0000 7f5239ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464337 cookie 94266115221248 notifier 8202 bl.length()=911 2024-09-12T17:53:13.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.548+0000 7f5239ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:13.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.548+0000 7f5239ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:13.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.548+0000 7f5239ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:13.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.549+0000 7f535a52c800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:53:13.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.549+0000 7f535a52c800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:53:13.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.549+0000 7f535a52c800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:53:13.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.549+0000 7f535a52c800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:53:13.553 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f535a52c800 time 2024-09-12T17:53:13.553364+0000 2024-09-12T17:53:13.553 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:53:13.553 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:13.554 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f535bd8c71a] 2024-09-12T17:53:13.554 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f535bd8c8d8] 2024-09-12T17:53:13.554 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0910a841] 2024-09-12T17:53:13.554 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bc0911a57a] 2024-09-12T17:53:13.554 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:53:13.554 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f535aa29590] 2024-09-12T17:53:13.554 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:53:13.554 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:53:13.554 INFO:tasks.workunit.client.0.smithi107.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:53:13.554 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f535a52c800 thread_name:radosgw-admin 2024-09-12T17:53:13.554 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.552+0000 7f535a52c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f535a52c800 time 2024-09-12T17:53:13.553364+0000 2024-09-12T17:53:13.555 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:53:13.555 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.555 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:13.555 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f535bd8c71a] 2024-09-12T17:53:13.555 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f535bd8c8d8] 2024-09-12T17:53:13.555 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0910a841] 2024-09-12T17:53:13.555 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bc0911a57a] 2024-09-12T17:53:13.555 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:53:13.555 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f535aa29590] 2024-09-12T17:53:13.556 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:53:13.556 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:53:13.556 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.583 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:13.583 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f535aa3e6f0] 2024-09-12T17:53:13.584 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f535aa8b99c] 2024-09-12T17:53:13.584 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:53:13.584 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:53:13.584 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f535bd8c774] 2024-09-12T17:53:13.584 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f535bd8c8d8] 2024-09-12T17:53:13.584 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0910a841] 2024-09-12T17:53:13.584 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bc0911a57a] 2024-09-12T17:53:13.584 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:53:13.584 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f535aa29590] 2024-09-12T17:53:13.584 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:53:13.584 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:53:13.584 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.553+0000 7f535a52c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f535a52c800 thread_name:radosgw-admin 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f535aa3e6f0] 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f535aa8b99c] 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f535bd8c774] 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f535bd8c8d8] 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0910a841] 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bc0911a57a] 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:53:13.585 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f535aa29590] 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:53:13.298+0000 7f5244608640 10 monclient: _finish_auth 0 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:53:13.298+0000 7f5244608640 10 monclient: _check_auth_tickets 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:53:13.298+0000 7f5244608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:53:13.298+0000 7f5244608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:53:13.298+0000 7f5244608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:53:13.298+0000 7f5244608640 10 monclient: dump: 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.586 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:53:13.298+0000 7f535a52c800 5 monclient: authenticate success, global_id 8190 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:53:13.298+0000 7f535a52c800 10 monclient: get_monmap_and_config success 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:53:13.298+0000 7f535a52c800 4 set_mon_vals no callback set 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:53:13.299+0000 7f535a52c800 10 monclient: shutdown 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 asok(0x55bc0a1df730) unregister_commands rotate-key 2024-09-12T17:53:13.587 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:53:13.299+0000 7f535a52c800 10 monclient: build_initial_monmap 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:53:13.299+0000 7f535a52c800 1 build_initial for_mkfs: 0 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:53:13.299+0000 7f535a52c800 10 monclient: monmap: 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding auth protocol: cephx 2024-09-12T17:53:13.588 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding auth protocol: cephx 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding auth protocol: cephx 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: secure 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: crc 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: secure 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: crc 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: secure 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: crc 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: crc 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: secure 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: crc 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: secure 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: crc 2024-09-12T17:53:13.589 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: secure 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:53:13.299+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:53:13.299+0000 7f535a52c800 1 librados: starting msgr at 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:53:13.299+0000 7f535a52c800 1 librados: starting objecter 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command objecter_requests hook 0x55bc0a432770 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:53:13.299+0000 7f535a52c800 1 librados: setting wanted keys 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:53:13.299+0000 7f535a52c800 1 librados: calling monclient init 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:53:13.299+0000 7f535a52c800 10 monclient: init 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding auth protocol: cephx 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding auth protocol: cephx 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding auth protocol: cephx 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: secure 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: crc 2024-09-12T17:53:13.590 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: secure 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: crc 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: secure 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: crc 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: crc 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: secure 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: crc 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: secure 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: crc 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: secure 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:53:13.300+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:53:13.300+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:53:13.300+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command rotate-key hook 0x55bc0a401a88 2024-09-12T17:53:13.591 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:13.592 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:53:13.592 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-b con 0x55bc0a2b8d60 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:13.592 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-c con 0x55bc0a344cd0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:13.592 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-a con 0x55bc0a34b310 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:13.592 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.592 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.592 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.592 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:13.592 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): authenticate will time out at 2197.846338s 2024-09-12T17:53:13.593 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): get_auth_request con 0x55bc0a344cd0 auth_method 0 2024-09-12T17:53:13.593 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.593 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.593 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.593 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): get_auth_request con 0x55bc0a34b310 auth_method 0 2024-09-12T17:53:13.593 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.593 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.593 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.593 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.593 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.593 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.593 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): handle_auth_done global_id 7706 payload 824 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient: _finish_hunting 0 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:53:13.300+0000 7f534ffff640 1 monclient: found mon.noname-c 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: dump: 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.594 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: _finish_auth 0 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: _check_auth_tickets 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: dump: 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.595 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:53:13.300+0000 7f535a52c800 5 monclient: authenticate success, global_id 7706 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient: _renew_subs 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:53:13.300+0000 7f5244608640 4 set_mon_vals no callback set 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:53:13.301+0000 7f535a52c800 10 monclient: _renew_subs 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:53:13.301+0000 7f535a52c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:53:13.301+0000 7f535a52c800 1 librados: init done 2024-09-12T17:53:13.596 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:53:13.302+0000 7f5242e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:53:13.302+0000 7f5242e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:53:13.302+0000 7f5242e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:53:13.302+0000 7f535624f640 10 monclient: get_auth_request con 0x7f523c0764a0 auth_method 0 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:53:13.303+0000 7f5356a50640 10 monclient: get_auth_request con 0x55bc0a434240 auth_method 0 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:53:13.303+0000 7f535624f640 10 monclient: get_auth_request con 0x55bc0a44cba0 auth_method 0 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:53:13.304+0000 7f534ffff640 10 monclient: get_auth_request con 0x55bc0a450fb0 auth_method 0 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:53:13.305+0000 7f535a52c800 10 monclient: build_initial_monmap 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:53:13.305+0000 7f535a52c800 1 build_initial for_mkfs: 0 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:53:13.305+0000 7f535a52c800 10 monclient: monmap: 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:13.597 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding auth protocol: cephx 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding auth protocol: cephx 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding auth protocol: cephx 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: secure 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: crc 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: secure 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: crc 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: secure 2024-09-12T17:53:13.598 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: crc 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: crc 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: secure 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: crc 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: secure 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: crc 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: secure 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:53:13.306+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command objecter_requests cmddesc objecter_requests hook 0x55bc0a459870 EEXIST 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient: init 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding auth protocol: cephx 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding auth protocol: cephx 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding auth protocol: cephx 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: secure 2024-09-12T17:53:13.599 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: crc 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: secure 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: crc 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: secure 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: crc 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: crc 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: secure 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: crc 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: secure 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: crc 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: secure 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:53:13.306+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:53:13.306+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command rotate-key cmddesc rotate-key hook 0x55bc0a454630 EEXIST 2024-09-12T17:53:13.600 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-a con 0x55bc0a47d560 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-b con 0x55bc0a47f830 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-c con 0x55bc0a47bd30 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): authenticate will time out at 2197.852888s 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:53:13.306+0000 7f535624f640 10 monclient(hunting): get_auth_request con 0x55bc0a47d560 auth_method 0 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:53:13.306+0000 7f535624f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:53:13.306+0000 7f535624f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.601 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:53:13.306+0000 7f535624f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.602 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): get_auth_request con 0x55bc0a47bd30 auth_method 0 2024-09-12T17:53:13.602 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.602 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.602 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.602 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): get_auth_request con 0x55bc0a47f830 auth_method 0 2024-09-12T17:53:13.602 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.602 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.602 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.602 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:53:13.307+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.602 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:53:13.307+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.602 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:53:13.307+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.602 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:53:13.307+0000 7f535624f640 10 monclient(hunting): handle_auth_done global_id 8196 payload 824 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:53:13.307+0000 7f535624f640 10 monclient: _finish_hunting 0 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:53:13.307+0000 7f535624f640 1 monclient: found mon.noname-a 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:53:13.307+0000 7f535624f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: dump: 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.603 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: _finish_auth 0 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:53:13.307+0000 7f535a52c800 5 monclient: authenticate success, global_id 8196 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:53:13.307+0000 7f535a52c800 10 monclient: _renew_subs 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:53:13.307+0000 7f535a52c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.604 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: dump: 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.605 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:53:13.307+0000 7f5357251640 4 set_mon_vals no callback set 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:53:13.307+0000 7f535a52c800 10 monclient: _renew_subs 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:53:13.307+0000 7f535a52c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:53:13.309+0000 7f523bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:53:13.309+0000 7f523bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:53:13.309+0000 7f523bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:53:13.309+0000 7f534ffff640 10 monclient: get_auth_request con 0x7f5230076380 auth_method 0 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:53:13.309+0000 7f535a52c800 10 monclient: get_monmap_and_config 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:53:13.309+0000 7f535a52c800 10 monclient: build_initial_monmap 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:53:13.309+0000 7f535a52c800 1 build_initial for_mkfs: 0 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:53:13.309+0000 7f535a52c800 10 monclient: monmap: 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:13.606 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding auth protocol: cephx 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding auth protocol: cephx 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding auth protocol: cephx 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: secure 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: crc 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: secure 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: crc 2024-09-12T17:53:13.607 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: secure 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: crc 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: crc 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: secure 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: crc 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: secure 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: crc 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: secure 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:53:13.309+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient: init 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding auth protocol: cephx 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding auth protocol: cephx 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding auth protocol: cephx 2024-09-12T17:53:13.608 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: secure 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: crc 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: secure 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: crc 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: secure 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: crc 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: crc 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: secure 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: crc 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: secure 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: crc 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: secure 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:53:13.310+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:53:13.310+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.609 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command rotate-key cmddesc rotate-key hook 0x7ffcbd01fde8 EEXIST 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-c con 0x55bc0a4d1a20 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-a con 0x55bc0a4cbfc0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-b con 0x55bc0a4a1860 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): authenticate will time out at 2197.856562s 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): get_auth_request con 0x55bc0a4d1a20 auth_method 0 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.610 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): get_auth_request con 0x55bc0a4cbfc0 auth_method 0 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:53:13.310+0000 7f5356a50640 10 monclient(hunting): get_auth_request con 0x55bc0a4a1860 auth_method 0 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:53:13.310+0000 7f5356a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:53:13.310+0000 7f5356a50640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:53:13.310+0000 7f5356a50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.611 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): handle_auth_done global_id 8199 payload 274 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient: _finish_hunting 0 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:53:13.310+0000 7f534ffff640 1 monclient: found mon.noname-a 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: dump: 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.612 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: _finish_auth 0 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 monclient: authenticate success, global_id 8199 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:53:13.311+0000 7f535a52c800 10 monclient: get_monmap_and_config success 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:53:13.311+0000 7f535a52c800 4 set_mon_vals no callback set 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: dump: 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.613 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:53:13.311+0000 7f535a52c800 10 monclient: shutdown 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:53:13.311+0000 7f535a52c800 10 monclient: build_initial_monmap 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:53:13.311+0000 7f535a52c800 1 build_initial for_mkfs: 0 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:53:13.311+0000 7f535a52c800 10 monclient: monmap: 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:13.614 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding auth protocol: cephx 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding auth protocol: cephx 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding auth protocol: cephx 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: secure 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: crc 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: secure 2024-09-12T17:53:13.615 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: crc 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: secure 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: crc 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: crc 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: secure 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: crc 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: secure 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: crc 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: secure 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:53:13.311+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:53:13.312+0000 7f535a52c800 1 librados: starting msgr at 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:53:13.312+0000 7f535a52c800 1 librados: starting objecter 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command objecter_requests cmddesc objecter_requests hook 0x55bc0a483570 EEXIST 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:53:13.312+0000 7f535a52c800 1 librados: setting wanted keys 2024-09-12T17:53:13.616 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:53:13.312+0000 7f535a52c800 1 librados: calling monclient init 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient: init 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding auth protocol: cephx 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding auth protocol: cephx 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding auth protocol: cephx 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: secure 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: crc 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: secure 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: crc 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: secure 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: crc 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: crc 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: secure 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: crc 2024-09-12T17:53:13.617 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: secure 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: crc 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: secure 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:53:13.312+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:53:13.312+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command rotate-key cmddesc rotate-key hook 0x55bc0a495458 EEXIST 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-a con 0x55bc0a4a1860 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-b con 0x55bc0a4cbfc0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-c con 0x55bc0a4d1a20 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.618 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): authenticate will time out at 2197.858726s 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): get_auth_request con 0x55bc0a4a1860 auth_method 0 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): get_auth_request con 0x55bc0a4d1a20 auth_method 0 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.619 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.620 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.620 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.620 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:53:13.312+0000 7f534ffff640 10 monclient(hunting): get_auth_request con 0x55bc0a4cbfc0 auth_method 0 2024-09-12T17:53:13.620 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:53:13.312+0000 7f534ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.620 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:53:13.312+0000 7f534ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.620 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:53:13.312+0000 7f534ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.620 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): handle_auth_done global_id 8202 payload 824 2024-09-12T17:53:13.620 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:53:13.313+0000 7f535624f640 10 monclient: _finish_hunting 0 2024-09-12T17:53:13.620 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:53:13.313+0000 7f535624f640 1 monclient: found mon.noname-a 2024-09-12T17:53:13.620 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:53:13.313+0000 7f535624f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.620 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: dump: 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: _finish_auth 0 2024-09-12T17:53:13.621 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: _check_auth_tickets 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:53:13.313+0000 7f535a52c800 5 monclient: authenticate success, global_id 8202 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:53:13.313+0000 7f535a52c800 10 monclient: _renew_subs 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:53:13.313+0000 7f535a52c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: dump: 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.622 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:53:13.313+0000 7f535a52c800 10 monclient: _renew_subs 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:53:13.313+0000 7f535a52c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:53:13.313+0000 7f535a52c800 1 librados: init done 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:53:13.313+0000 7f5239ffb640 4 set_mon_vals no callback set 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:53:13.313+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command cr dump hook 0x55bc0a49e338 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:53:13.314+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:53:13.315+0000 7f5227fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:53:13.315+0000 7f5227fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:53:13.315+0000 7f5227fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:53:13.315+0000 7f534ffff640 10 monclient: get_auth_request con 0x7f5220076470 auth_method 0 2024-09-12T17:53:13.623 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:53:13.315+0000 7f5356a50640 10 monclient: get_auth_request con 0x55bc0a4ebde0 auth_method 0 2024-09-12T17:53:13.624 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.624 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 realm 2024-09-12T17:53:13.624 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.624 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.624 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:53:13.316+0000 7f535a52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:13.624 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.624 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.624 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.624 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:53:13.316+0000 7f535624f640 10 monclient: get_auth_request con 0x55bc0a4f0190 auth_method 0 2024-09-12T17:53:13.624 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:53:13.317+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:53:13.317+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:53:13.317+0000 7f534ffff640 10 monclient: get_auth_request con 0x55bc0a4f38b0 auth_method 0 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:53:13.317+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:53:13.317+0000 7f535a52c800 20 searching for the correct realm 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:53:13.318+0000 7f5356a50640 10 monclient: get_auth_request con 0x55bc0a4f8670 auth_method 0 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:53:13.318+0000 7f535624f640 10 monclient: get_auth_request con 0x7f5350069040 auth_method 0 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:53:13.319+0000 7f534ffff640 10 monclient: get_auth_request con 0x7f534001f060 auth_method 0 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:53:13.320+0000 7f535624f640 0 -- 172.21.15.107:0/977462662 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f5350069040 msgr2=0x7f5350060940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:53:13.320+0000 7f5227fff640 1 client.8202.objecter ms_handle_reset 0x7f5350069040 session 0x7f535006ac80 osd.7 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:53:13.320+0000 7f5227fff640 10 monclient: _renew_subs 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:53:13.320+0000 7f5227fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:53:13.320+0000 7f535624f640 10 monclient: get_auth_request con 0x7f5220086b20 auth_method 0 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:53:13.321+0000 7f5356a50640 10 monclient: get_auth_request con 0x7f53400752c0 auth_method 0 2024-09-12T17:53:13.625 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:53:13.323+0000 7f535624f640 10 monclient: get_auth_request con 0x7f5340096b20 auth_method 0 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:53:13.323+0000 7f535624f640 0 -- 172.21.15.107:0/977462662 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f5340096b20 msgr2=0x7f5340061650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:53:13.524+0000 7f535624f640 10 monclient: get_auth_request con 0x7f5340096b20 auth_method 0 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.626 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 zone default found 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:53:13.530+0000 7f535a52c800 4 Realm: () 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:53:13.530+0000 7f535a52c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:53:13.530+0000 7f535a52c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:53:13.530+0000 7f535a52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 zonegroup default 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:53:13.531+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:53:13.531+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:53:13.531+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:53:13.531+0000 7f535a52c800 20 started sync module instance, tier type = 2024-09-12T17:53:13.627 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:53:13.531+0000 7f535a52c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=0 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=1 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=2 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=3 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=4 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=5 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=6 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:53:13.541+0000 7f535a52c800 20 add_watcher() i=7 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:53:13.541+0000 7f535a52c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding auth protocol: cephx 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding auth protocol: cephx 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding auth protocol: cephx 2024-09-12T17:53:13.628 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: secure 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: crc 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:53:13.542+0000 7f520d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: secure 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: crc 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: secure 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: crc 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: crc 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: secure 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: crc 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: secure 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: crc 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: secure 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:53:13.542+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:53:13.542+0000 7f535a52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:13.629 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:53:13.542+0000 7f535a52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command cache list hook 0x55bc0a4c7b60 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command cache inspect hook 0x55bc0a4c7b60 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command cache erase hook 0x55bc0a4c7b60 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command cache zap hook 0x55bc0a4c7b60 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 note: GC not initialized 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:53:13.543+0000 7f52077fe640 20 reqs_thread_entry: start 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command sync trace show hook 0x7f5340060410 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command sync trace history hook 0x7f5340060410 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command sync trace active hook 0x7f5340060410 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command sync trace active_short hook 0x7f5340060410 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:53:13.543+0000 7f535a52c800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:53:13.543+0000 7f535a52c800 20 Filter name: none 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:53:13.543+0000 7f52057fa640 20 reqs_thread_entry: start 2024-09-12T17:53:13.630 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:53:13.543+0000 7f535a52c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:53:13.543+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:53:13.544+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:53:13.544+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:53:13.544+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:53:13.548+0000 7f535a52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:13.631 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:53:13.548+0000 7f535a52c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:53:13.548+0000 7f535a52c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:53:13.548+0000 7f535a52c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:53:13.548+0000 7f5239ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464337 cookie 94266115221248 notifier 8202 bl.length()=911 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:53:13.548+0000 7f5239ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:53:13.548+0000 7f5239ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:53:13.548+0000 7f5239ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:53:13.549+0000 7f535a52c800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:53:13.549+0000 7f535a52c800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:53:13.549+0000 7f535a52c800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:53:13.549+0000 7f535a52c800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:53:13.552+0000 7f535a52c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f535a52c800 time 2024-09-12T17:53:13.553364+0000 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.632 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f535bd8c71a] 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f535bd8c8d8] 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0910a841] 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bc0911a57a] 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f535aa29590] 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:53:13.553+0000 7f535a52c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f535a52c800 thread_name:radosgw-admin 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.633 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f535aa3e6f0] 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f535aa8b99c] 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f535bd8c774] 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f535bd8c8d8] 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0910a841] 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bc0911a57a] 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f535aa29590] 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:53:13.634 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.635 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:53:13.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:53:13.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:53:13.635 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:53:13.635 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:53:13.636 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:53:13.636 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:53:13.636 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:53:13.636 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:53:13.636 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:53:13.636 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:53:13.636 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:53:13.636 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:53:13.636 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:53:13.636 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:53:13.636 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:53:13.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:53:13.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:53:13.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:53:13.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:53:13.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:53:13.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:53:13.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:53:13.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:53:13.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:53:13.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:53:13.637 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:53:13.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:53:13.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:53:13.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:53:13.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:53:13.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: 7f52057fa640 / http_manager 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: 7f52077fe640 / http_manager 2024-09-12T17:53:13.642 INFO:tasks.workunit.client.0.smithi107.stderr: 7f520d7e2640 / rgw_dt_lg_renew 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: 7f5227fff640 / ms_dispatch 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: 7f5239ffb640 / io_context_pool 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: 7f523bfff640 / ms_dispatch 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: 7f5242e05640 / ms_dispatch 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: 7f5244608640 / io_context_pool 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: 7f534ffff640 / msgr-worker-2 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: 7f535624f640 / msgr-worker-1 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: 7f5356a50640 / msgr-worker-0 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: 7f5357251640 / io_context_pool 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: 7f535a52c800 / radosgw-admin 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/log/ceph/ceph-client.admin.150722.log 2024-09-12T17:53:13.643 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:53:13.298+0000 7f5244608640 10 monclient: _finish_auth 0 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:53:13.298+0000 7f5244608640 10 monclient: _check_auth_tickets 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:53:13.298+0000 7f5244608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:53:13.298+0000 7f5244608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:53:13.298+0000 7f5244608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:53:13.298+0000 7f5244608640 10 monclient: dump: 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.644 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:53:13.298+0000 7f535a52c800 5 monclient: authenticate success, global_id 8190 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:53:13.298+0000 7f535a52c800 10 monclient: get_monmap_and_config success 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:53:13.298+0000 7f535a52c800 4 set_mon_vals no callback set 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:53:13.299+0000 7f535a52c800 10 monclient: shutdown 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 asok(0x55bc0a1df730) unregister_commands rotate-key 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:53:13.299+0000 7f535a52c800 10 monclient: build_initial_monmap 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:53:13.299+0000 7f535a52c800 1 build_initial for_mkfs: 0 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:53:13.299+0000 7f535a52c800 10 monclient: monmap: 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:13.645 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding auth protocol: cephx 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding auth protocol: cephx 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding auth protocol: cephx 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: secure 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: crc 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: secure 2024-09-12T17:53:13.646 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: crc 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: secure 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: crc 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: crc 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: secure 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: crc 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: secure 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: crc 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a406f50) adding con mode: secure 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:53:13.299+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:53:13.299+0000 7f535a52c800 1 librados: starting msgr at 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:53:13.299+0000 7f535a52c800 1 librados: starting objecter 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command objecter_requests hook 0x55bc0a432770 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:53:13.299+0000 7f535a52c800 1 librados: setting wanted keys 2024-09-12T17:53:13.647 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:53:13.299+0000 7f535a52c800 1 librados: calling monclient init 2024-09-12T17:53:13.648 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:53:13.299+0000 7f535a52c800 10 monclient: init 2024-09-12T17:53:13.648 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding auth protocol: cephx 2024-09-12T17:53:13.648 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding auth protocol: cephx 2024-09-12T17:53:13.648 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding auth protocol: cephx 2024-09-12T17:53:13.648 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: secure 2024-09-12T17:53:13.648 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: crc 2024-09-12T17:53:13.648 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: secure 2024-09-12T17:53:13.648 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: crc 2024-09-12T17:53:13.648 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: secure 2024-09-12T17:53:13.648 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: crc 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: crc 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: secure 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: crc 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: secure 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: crc 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:53:13.299+0000 7f535a52c800 5 AuthRegistry(0x55bc0a401940) adding con mode: secure 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:53:13.300+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:53:13.300+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:53:13.300+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command rotate-key hook 0x55bc0a401a88 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-b con 0x55bc0a2b8d60 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:13.649 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-c con 0x55bc0a344cd0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-a con 0x55bc0a34b310 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient(hunting): authenticate will time out at 2197.846338s 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): get_auth_request con 0x55bc0a344cd0 auth_method 0 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): get_auth_request con 0x55bc0a34b310 auth_method 0 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.650 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.651 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.651 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.651 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.651 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.651 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.651 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:53:13.300+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.651 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient(hunting): handle_auth_done global_id 7706 payload 824 2024-09-12T17:53:13.651 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient: _finish_hunting 0 2024-09-12T17:53:13.651 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:53:13.300+0000 7f534ffff640 1 monclient: found mon.noname-c 2024-09-12T17:53:13.651 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:53:13.300+0000 7f534ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:53:13.651 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: dump: 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.652 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: _finish_auth 0 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: _check_auth_tickets 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:53:13.300+0000 7f5242e05640 10 monclient: dump: 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.653 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:53:13.300+0000 7f535a52c800 5 monclient: authenticate success, global_id 7706 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient: _renew_subs 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:53:13.300+0000 7f535a52c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:53:13.300+0000 7f5244608640 4 set_mon_vals no callback set 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:53:13.301+0000 7f535a52c800 10 monclient: _renew_subs 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:53:13.301+0000 7f535a52c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:53:13.301+0000 7f535a52c800 1 librados: init done 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:53:13.302+0000 7f5242e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:53:13.302+0000 7f5242e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:53:13.302+0000 7f5242e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:13.654 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:53:13.302+0000 7f535624f640 10 monclient: get_auth_request con 0x7f523c0764a0 auth_method 0 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:53:13.303+0000 7f5356a50640 10 monclient: get_auth_request con 0x55bc0a434240 auth_method 0 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:53:13.303+0000 7f535624f640 10 monclient: get_auth_request con 0x55bc0a44cba0 auth_method 0 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:53:13.304+0000 7f534ffff640 10 monclient: get_auth_request con 0x55bc0a450fb0 auth_method 0 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:53:13.305+0000 7f535a52c800 10 monclient: build_initial_monmap 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:53:13.305+0000 7f535a52c800 1 build_initial for_mkfs: 0 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:53:13.305+0000 7f535a52c800 10 monclient: monmap: 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.655 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding auth protocol: cephx 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding auth protocol: cephx 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding auth protocol: cephx 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: secure 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: crc 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: secure 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: crc 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: secure 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: crc 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: crc 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: secure 2024-09-12T17:53:13.656 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: crc 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: secure 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: crc 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:53:13.305+0000 7f535a52c800 5 AuthRegistry(0x55bc0a455ed0) adding con mode: secure 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:53:13.306+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command objecter_requests cmddesc objecter_requests hook 0x55bc0a459870 EEXIST 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient: init 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding auth protocol: cephx 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding auth protocol: cephx 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding auth protocol: cephx 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: secure 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: crc 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: secure 2024-09-12T17:53:13.657 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: crc 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: secure 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: crc 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: crc 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: secure 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: crc 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: secure 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: crc 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4544e8) adding con mode: secure 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:53:13.306+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:53:13.306+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:53:13.306+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command rotate-key cmddesc rotate-key hook 0x55bc0a454630 EEXIST 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:13.658 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-a con 0x55bc0a47d560 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-b con 0x55bc0a47f830 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-c con 0x55bc0a47bd30 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:53:13.306+0000 7f535a52c800 10 monclient(hunting): authenticate will time out at 2197.852888s 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:53:13.306+0000 7f535624f640 10 monclient(hunting): get_auth_request con 0x55bc0a47d560 auth_method 0 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:53:13.306+0000 7f535624f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:53:13.306+0000 7f535624f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:53:13.306+0000 7f535624f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): get_auth_request con 0x55bc0a47bd30 auth_method 0 2024-09-12T17:53:13.659 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): get_auth_request con 0x55bc0a47f830 auth_method 0 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:53:13.307+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:53:13.307+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:53:13.307+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:53:13.307+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.660 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:53:13.307+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:53:13.307+0000 7f535624f640 10 monclient(hunting): handle_auth_done global_id 8196 payload 824 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:53:13.307+0000 7f535624f640 10 monclient: _finish_hunting 0 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:53:13.307+0000 7f535624f640 1 monclient: found mon.noname-a 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:53:13.307+0000 7f535624f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: dump: 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.661 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: _finish_auth 0 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:53:13.307+0000 7f535a52c800 5 monclient: authenticate success, global_id 8196 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:53:13.307+0000 7f535a52c800 10 monclient: _renew_subs 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:53:13.307+0000 7f535a52c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:13.662 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:53:13.307+0000 7f523bfff640 10 monclient: dump: 2024-09-12T17:53:13.663 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.663 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.663 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.663 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.663 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.663 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.663 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.663 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.663 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.663 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.663 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:53:13.307+0000 7f5357251640 4 set_mon_vals no callback set 2024-09-12T17:53:13.663 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:53:13.307+0000 7f535a52c800 10 monclient: _renew_subs 2024-09-12T17:53:13.664 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:53:13.307+0000 7f535a52c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.664 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:53:13.309+0000 7f523bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:53:13.664 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:53:13.309+0000 7f523bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:13.664 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:53:13.309+0000 7f523bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:13.664 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:53:13.309+0000 7f534ffff640 10 monclient: get_auth_request con 0x7f5230076380 auth_method 0 2024-09-12T17:53:13.664 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:53:13.309+0000 7f535a52c800 10 monclient: get_monmap_and_config 2024-09-12T17:53:13.664 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:53:13.309+0000 7f535a52c800 10 monclient: build_initial_monmap 2024-09-12T17:53:13.664 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:53:13.309+0000 7f535a52c800 1 build_initial for_mkfs: 0 2024-09-12T17:53:13.664 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:53:13.309+0000 7f535a52c800 10 monclient: monmap: 2024-09-12T17:53:13.664 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:13.664 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:13.664 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding auth protocol: cephx 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding auth protocol: cephx 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding auth protocol: cephx 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: secure 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: crc 2024-09-12T17:53:13.665 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: secure 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: crc 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: secure 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: crc 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: crc 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: secure 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: crc 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: secure 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: crc 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:53:13.309+0000 7f535a52c800 5 AuthRegistry(0x55bc0a49d440) adding con mode: secure 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:53:13.309+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient: init 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding auth protocol: cephx 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding auth protocol: cephx 2024-09-12T17:53:13.666 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding auth protocol: cephx 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: secure 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: crc 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: secure 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: crc 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: secure 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: crc 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: crc 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: secure 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: crc 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: secure 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: crc 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd01fca0) adding con mode: secure 2024-09-12T17:53:13.667 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:53:13.310+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:53:13.310+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:53:13.310+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command rotate-key cmddesc rotate-key hook 0x7ffcbd01fde8 EEXIST 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-c con 0x55bc0a4d1a20 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-a con 0x55bc0a4cbfc0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-b con 0x55bc0a4a1860 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:53:13.310+0000 7f535a52c800 10 monclient(hunting): authenticate will time out at 2197.856562s 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): get_auth_request con 0x55bc0a4d1a20 auth_method 0 2024-09-12T17:53:13.668 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): get_auth_request con 0x55bc0a4cbfc0 auth_method 0 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:53:13.310+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:53:13.310+0000 7f5356a50640 10 monclient(hunting): get_auth_request con 0x55bc0a4a1860 auth_method 0 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:53:13.310+0000 7f5356a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.669 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:53:13.310+0000 7f5356a50640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:53:13.310+0000 7f5356a50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient(hunting): handle_auth_done global_id 8199 payload 274 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient: _finish_hunting 0 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:53:13.310+0000 7f534ffff640 1 monclient: found mon.noname-a 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:53:13.310+0000 7f534ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: dump: 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.670 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: _finish_auth 0 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 monclient: authenticate success, global_id 8199 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:53:13.311+0000 7f535a52c800 10 monclient: get_monmap_and_config success 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:53:13.311+0000 7f535a52c800 4 set_mon_vals no callback set 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:13.671 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:53:13.311+0000 7f5239ffb640 10 monclient: dump: 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:53:13.311+0000 7f535a52c800 10 monclient: shutdown 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:53:13.311+0000 7f535a52c800 10 monclient: build_initial_monmap 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:53:13.311+0000 7f535a52c800 1 build_initial for_mkfs: 0 2024-09-12T17:53:13.672 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:53:13.311+0000 7f535a52c800 10 monclient: monmap: 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding auth protocol: cephx 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding auth protocol: cephx 2024-09-12T17:53:13.673 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding auth protocol: cephx 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: secure 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: crc 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: secure 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: crc 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: secure 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: crc 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: crc 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: secure 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: crc 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: secure 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: crc 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:53:13.311+0000 7f535a52c800 5 AuthRegistry(0x55bc0a4c4180) adding con mode: secure 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:53:13.311+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.674 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:53:13.312+0000 7f535a52c800 1 librados: starting msgr at 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:53:13.312+0000 7f535a52c800 1 librados: starting objecter 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command objecter_requests cmddesc objecter_requests hook 0x55bc0a483570 EEXIST 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:53:13.312+0000 7f535a52c800 1 librados: setting wanted keys 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:53:13.312+0000 7f535a52c800 1 librados: calling monclient init 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient: init 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding auth protocol: cephx 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding auth protocol: cephx 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding auth protocol: cephx 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: secure 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: crc 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: secure 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: crc 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: secure 2024-09-12T17:53:13.675 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: crc 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: crc 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: secure 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: crc 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: secure 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: crc 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 AuthRegistry(0x55bc0a495310) adding con mode: secure 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:53:13.312+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:53:13.312+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:53:13.312+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command rotate-key cmddesc rotate-key hook 0x55bc0a495458 EEXIST 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-a con 0x55bc0a4a1860 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-b con 0x55bc0a4cbfc0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:13.676 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): picked mon.noname-c con 0x55bc0a4d1a20 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:53:13.312+0000 7f535a52c800 10 monclient(hunting): authenticate will time out at 2197.858726s 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): get_auth_request con 0x55bc0a4a1860 auth_method 0 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): get_auth_request con 0x55bc0a4d1a20 auth_method 0 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.677 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:53:13.312+0000 7f5356a50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:53:13.312+0000 7f534ffff640 10 monclient(hunting): get_auth_request con 0x55bc0a4cbfc0 auth_method 0 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:53:13.312+0000 7f534ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:53:13.312+0000 7f534ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:53:13.312+0000 7f534ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:53:13.312+0000 7f535624f640 10 monclient(hunting): handle_auth_done global_id 8202 payload 824 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:53:13.313+0000 7f535624f640 10 monclient: _finish_hunting 0 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:53:13.313+0000 7f535624f640 1 monclient: found mon.noname-a 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:53:13.313+0000 7f535624f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.678 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: dump: 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: _finish_auth 0 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: _check_auth_tickets 2024-09-12T17:53:13.679 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:53:13.313+0000 7f535a52c800 5 monclient: authenticate success, global_id 8202 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:53:13.313+0000 7f535a52c800 10 monclient: _renew_subs 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:53:13.313+0000 7f535a52c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:53:13.313+0000 7f5227fff640 10 monclient: dump: 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:13.680 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:53:13.313+0000 7f535a52c800 10 monclient: _renew_subs 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:53:13.313+0000 7f535a52c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:53:13.313+0000 7f535a52c800 1 librados: init done 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:53:13.313+0000 7f5239ffb640 4 set_mon_vals no callback set 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:53:13.313+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command cr dump hook 0x55bc0a49e338 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:53:13.314+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:53:13.315+0000 7f5227fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:53:13.315+0000 7f5227fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:53:13.315+0000 7f5227fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:53:13.315+0000 7f534ffff640 10 monclient: get_auth_request con 0x7f5220076470 auth_method 0 2024-09-12T17:53:13.681 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:53:13.315+0000 7f5356a50640 10 monclient: get_auth_request con 0x55bc0a4ebde0 auth_method 0 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 realm 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:53:13.316+0000 7f535a52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:53:13.316+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:53:13.316+0000 7f535624f640 10 monclient: get_auth_request con 0x55bc0a4f0190 auth_method 0 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:53:13.317+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:53:13.317+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:53:13.317+0000 7f534ffff640 10 monclient: get_auth_request con 0x55bc0a4f38b0 auth_method 0 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:53:13.317+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:13.682 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:53:13.317+0000 7f535a52c800 20 searching for the correct realm 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:53:13.318+0000 7f5356a50640 10 monclient: get_auth_request con 0x55bc0a4f8670 auth_method 0 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:53:13.318+0000 7f535624f640 10 monclient: get_auth_request con 0x7f5350069040 auth_method 0 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:53:13.319+0000 7f534ffff640 10 monclient: get_auth_request con 0x7f534001f060 auth_method 0 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:53:13.320+0000 7f535624f640 0 -- 172.21.15.107:0/977462662 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f5350069040 msgr2=0x7f5350060940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:53:13.320+0000 7f5227fff640 1 client.8202.objecter ms_handle_reset 0x7f5350069040 session 0x7f535006ac80 osd.7 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:53:13.320+0000 7f5227fff640 10 monclient: _renew_subs 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:53:13.320+0000 7f5227fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:53:13.320+0000 7f535624f640 10 monclient: get_auth_request con 0x7f5220086b20 auth_method 0 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:53:13.321+0000 7f5356a50640 10 monclient: get_auth_request con 0x7f53400752c0 auth_method 0 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:53:13.323+0000 7f535624f640 10 monclient: get_auth_request con 0x7f5340096b20 auth_method 0 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:53:13.323+0000 7f535624f640 0 -- 172.21.15.107:0/977462662 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f5340096b20 msgr2=0x7f5340061650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:53:13.524+0000 7f535624f640 10 monclient: get_auth_request con 0x7f5340096b20 auth_method 0 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:13.683 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:53:13.529+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 zone default found 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:53:13.530+0000 7f535a52c800 4 Realm: () 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:53:13.530+0000 7f535a52c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:13.684 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:53:13.530+0000 7f535a52c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:53:13.530+0000 7f535a52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 zonegroup default 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:53:13.530+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:53:13.531+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:53:13.531+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:53:13.531+0000 7f535a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:53:13.531+0000 7f535a52c800 20 started sync module instance, tier type = 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:53:13.531+0000 7f535a52c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=0 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=1 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=2 2024-09-12T17:53:13.685 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=3 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=4 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=5 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:53:13.540+0000 7f535a52c800 20 add_watcher() i=6 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:53:13.541+0000 7f535a52c800 20 add_watcher() i=7 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:53:13.541+0000 7f535a52c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding auth protocol: cephx 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding auth protocol: cephx 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding auth protocol: cephx 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: secure 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: crc 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:53:13.542+0000 7f520d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: secure 2024-09-12T17:53:13.686 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: crc 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: secure 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: crc 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: crc 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: secure 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: crc 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: secure 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: crc 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:53:13.542+0000 7f535a52c800 5 AuthRegistry(0x7ffcbd020170) adding con mode: secure 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:53:13.542+0000 7f535a52c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:53:13.542+0000 7f535a52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:53:13.542+0000 7f535a52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command cache list hook 0x55bc0a4c7b60 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command cache inspect hook 0x55bc0a4c7b60 2024-09-12T17:53:13.687 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command cache erase hook 0x55bc0a4c7b60 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command cache zap hook 0x55bc0a4c7b60 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 note: GC not initialized 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:53:13.543+0000 7f52077fe640 20 reqs_thread_entry: start 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command sync trace show hook 0x7f5340060410 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command sync trace history hook 0x7f5340060410 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command sync trace active hook 0x7f5340060410 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:53:13.543+0000 7f535a52c800 5 asok(0x55bc0a1df730) register_command sync trace active_short hook 0x7f5340060410 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:53:13.543+0000 7f535a52c800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:53:13.543+0000 7f535a52c800 20 Filter name: none 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:53:13.543+0000 7f52057fa640 20 reqs_thread_entry: start 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:53:13.543+0000 7f535a52c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:53:13.543+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:53:13.544+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:13.688 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:53:13.544+0000 7f535a52c800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:53:13.544+0000 7f535a52c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:53:13.544+0000 7f535a52c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:53:13.548+0000 7f535a52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:53:13.548+0000 7f535a52c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:53:13.548+0000 7f535a52c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:53:13.548+0000 7f535a52c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:53:13.689 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:53:13.548+0000 7f5239ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464337 cookie 94266115221248 notifier 8202 bl.length()=911 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:53:13.548+0000 7f5239ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:53:13.548+0000 7f5239ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:53:13.548+0000 7f5239ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:53:13.549+0000 7f535a52c800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:53:13.549+0000 7f535a52c800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:53:13.549+0000 7f535a52c800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:53:13.549+0000 7f535a52c800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:53:13.552+0000 7f535a52c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f535a52c800 time 2024-09-12T17:53:13.553364+0000 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f535bd8c71a] 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f535bd8c8d8] 2024-09-12T17:53:13.690 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0910a841] 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bc0911a57a] 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f535aa29590] 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:53:13.553+0000 7f535a52c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f535a52c800 thread_name:radosgw-admin 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f535aa3e6f0] 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f535aa8b99c] 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:53:13.691 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:53:13.692 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f535bd8c774] 2024-09-12T17:53:13.692 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f535bd8c8d8] 2024-09-12T17:53:13.692 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc0910a841] 2024-09-12T17:53:13.692 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55bc0911a57a] 2024-09-12T17:53:13.692 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:53:13.692 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f535aa29590] 2024-09-12T17:53:13.692 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:53:13.692 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:53:13.692 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:53:13.692 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:13.692 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:53:13.693 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:53:13.694 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:53:13.695 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:53:13.696 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:53:13.697 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:53:13.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 7f52057fa640 / http_manager 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 7f52077fe640 / http_manager 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 7f520d7e2640 / rgw_dt_lg_renew 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 7f5227fff640 / ms_dispatch 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 7f5239ffb640 / io_context_pool 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 7f523bfff640 / ms_dispatch 2024-09-12T17:53:13.699 INFO:tasks.workunit.client.0.smithi107.stderr: 7f5242e05640 / ms_dispatch 2024-09-12T17:53:13.700 INFO:tasks.workunit.client.0.smithi107.stderr: 7f5244608640 / io_context_pool 2024-09-12T17:53:13.700 INFO:tasks.workunit.client.0.smithi107.stderr: 7f534ffff640 / msgr-worker-2 2024-09-12T17:53:13.700 INFO:tasks.workunit.client.0.smithi107.stderr: 7f535624f640 / msgr-worker-1 2024-09-12T17:53:13.700 INFO:tasks.workunit.client.0.smithi107.stderr: 7f5356a50640 / msgr-worker-0 2024-09-12T17:53:13.700 INFO:tasks.workunit.client.0.smithi107.stderr: 7f5357251640 / io_context_pool 2024-09-12T17:53:13.700 INFO:tasks.workunit.client.0.smithi107.stderr: 7f535a52c800 / radosgw-admin 2024-09-12T17:53:13.700 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:53:13.700 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:53:13.700 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:53:13.554749Z_6cd2470f-7d0f-46ca-bada-33c8bbafa449/log 2024-09-12T17:53:13.700 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:53:13.700 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:53:13.702 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:13.702 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:13.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.627+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.629+0000 7f0edd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.629+0000 7f0edd413800 20 realm 2024-09-12T17:53:13.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.629+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.629+0000 7f0edd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.629+0000 7f0edd413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:13.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.629+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.629+0000 7f0edd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.702 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.629+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.630+0000 7f0edd413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.630+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.631+0000 7f0edd413800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:13.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.631+0000 7f0edd413800 20 searching for the correct realm 2024-09-12T17:53:13.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.633+0000 7f0ed3fff640 0 -- 172.21.15.107:0/3036144528 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f0ec4060ec0 msgr2=0x7f0ec405f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:13.703 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.636+0000 7f0ed8b22640 0 -- 172.21.15.107:0/3036144528 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f0ec40860c0 msgr2=0x7f0ec40868c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:13.844 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.843+0000 7f0edd413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:13.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.843+0000 7f0edd413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:13.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.843+0000 7f0edd413800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:13.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.843+0000 7f0edd413800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:13.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.843+0000 7f0edd413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:13.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.843+0000 7f0edd413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:13.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.843+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.843+0000 7f0edd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.845 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.843+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.844+0000 7f0edd413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.844+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.846 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.844+0000 7f0edd413800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.844+0000 7f0edd413800 20 zone default found 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.844+0000 7f0edd413800 4 Realm: () 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.844+0000 7f0edd413800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.844+0000 7f0edd413800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.844+0000 7f0edd413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.844+0000 7f0edd413800 20 zonegroup default 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.844+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.844+0000 7f0edd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.844+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.845+0000 7f0edd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.845+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.845+0000 7f0edd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.845+0000 7f0edd413800 20 started sync module instance, tier type = 2024-09-12T17:53:13.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.845+0000 7f0edd413800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:13.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.854+0000 7f0edd413800 20 add_watcher() i=0 2024-09-12T17:53:13.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.854+0000 7f0edd413800 20 add_watcher() i=1 2024-09-12T17:53:13.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.854+0000 7f0edd413800 20 add_watcher() i=2 2024-09-12T17:53:13.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.854+0000 7f0edd413800 20 add_watcher() i=3 2024-09-12T17:53:13.856 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.854+0000 7f0edd413800 20 add_watcher() i=4 2024-09-12T17:53:13.856 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.854+0000 7f0edd413800 20 add_watcher() i=5 2024-09-12T17:53:13.856 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.854+0000 7f0edd413800 20 add_watcher() i=6 2024-09-12T17:53:13.856 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.855+0000 7f0edd413800 20 add_watcher() i=7 2024-09-12T17:53:13.856 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.855+0000 7f0edd413800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:13.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.857+0000 7f0d8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:13.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.857+0000 7f0edd413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:13.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.857+0000 7f0edd413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:13.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.857+0000 7f0edd413800 5 note: GC not initialized 2024-09-12T17:53:13.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.857+0000 7f0d8e7e4640 20 reqs_thread_entry: start 2024-09-12T17:53:13.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.857+0000 7f0edd413800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:13.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.857+0000 7f0edd413800 20 Filter name: none 2024-09-12T17:53:13.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.857+0000 7f0d87fff640 20 reqs_thread_entry: start 2024-09-12T17:53:13.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.857+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.858+0000 7f0edd413800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:13.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.858+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.858+0000 7f0edd413800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:53:13.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.858+0000 7f0edd413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:53:13.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.858+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.859+0000 7f0edd413800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:13.860 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.859+0000 7f0edd413800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.859+0000 7f0edd413800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:53:13.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.859+0000 7f0edd413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:53:13.862 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.860+0000 7f0d8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:13.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.862+0000 7f0edd413800 20 remove_watcher() i=0 2024-09-12T17:53:13.864 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.862+0000 7f0edd413800 2 removed watcher, disabling cache 2024-09-12T17:53:13.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.863+0000 7f0edd413800 20 remove_watcher() i=1 2024-09-12T17:53:13.865 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.864+0000 7f0edd413800 20 remove_watcher() i=2 2024-09-12T17:53:13.866 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.865+0000 7f0edd413800 20 remove_watcher() i=3 2024-09-12T17:53:13.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.866+0000 7f0edd413800 20 remove_watcher() i=4 2024-09-12T17:53:13.868 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.867+0000 7f0edd413800 20 remove_watcher() i=5 2024-09-12T17:53:13.870 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.868+0000 7f0edd413800 20 remove_watcher() i=6 2024-09-12T17:53:13.870 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.869+0000 7f0edd413800 20 remove_watcher() i=7 2024-09-12T17:53:13.890 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:53:13.918 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:13.919 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:13.955 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.954+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.956 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.955+0000 7fa7dfe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.955+0000 7fa7dfe0f800 20 realm 2024-09-12T17:53:13.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.955+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.955+0000 7fa7dfe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.955+0000 7fa7dfe0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:13.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.955+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.956+0000 7fa7dfe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:13.957 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.956+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.958 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.956+0000 7fa7dfe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:13.958 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.956+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:13.958 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.957+0000 7fa7dfe0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:13.958 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.957+0000 7fa7dfe0f800 20 searching for the correct realm 2024-09-12T17:53:13.960 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:13.959+0000 7fa7d2d47640 0 -- 172.21.15.107:0/3580350574 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fa7c4003bb0 msgr2=0x7fa7c4007720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:14.166 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.164+0000 7fa7db548640 0 -- 172.21.15.107:0/3580350574 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fa7c409eb80 msgr2=0x7fa7c40a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:14.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.370+0000 7fa7dfe0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:14.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.370+0000 7fa7dfe0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:14.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.370+0000 7fa7dfe0f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:14.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.370+0000 7fa7dfe0f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:14.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.370+0000 7fa7dfe0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:14.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.370+0000 7fa7dfe0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:14.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.370+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:14.374 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 20 zone default found 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 4 Realm: () 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 20 zonegroup default 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.371+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:14.375 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.372+0000 7fa7dfe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:14.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.372+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:14.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.372+0000 7fa7dfe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:14.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.372+0000 7fa7dfe0f800 20 started sync module instance, tier type = 2024-09-12T17:53:14.376 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.372+0000 7fa7dfe0f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:14.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.381+0000 7fa7dfe0f800 20 add_watcher() i=0 2024-09-12T17:53:14.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.381+0000 7fa7dfe0f800 20 add_watcher() i=1 2024-09-12T17:53:14.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.381+0000 7fa7dfe0f800 20 add_watcher() i=2 2024-09-12T17:53:14.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.381+0000 7fa7dfe0f800 20 add_watcher() i=3 2024-09-12T17:53:14.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.381+0000 7fa7dfe0f800 20 add_watcher() i=4 2024-09-12T17:53:14.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.381+0000 7fa7dfe0f800 20 add_watcher() i=5 2024-09-12T17:53:14.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.381+0000 7fa7dfe0f800 20 add_watcher() i=6 2024-09-12T17:53:14.383 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.382+0000 7fa7dfe0f800 20 add_watcher() i=7 2024-09-12T17:53:14.384 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.382+0000 7fa7dfe0f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:14.385 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.384+0000 7fa691fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:14.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.385+0000 7fa7dfe0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:14.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.385+0000 7fa7dfe0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:14.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.385+0000 7fa7dfe0f800 5 note: GC not initialized 2024-09-12T17:53:14.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.385+0000 7fa690fe1640 20 reqs_thread_entry: start 2024-09-12T17:53:14.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.385+0000 7fa7dfe0f800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:14.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.385+0000 7fa7dfe0f800 20 Filter name: none 2024-09-12T17:53:14.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.385+0000 7fa60a7fc640 20 reqs_thread_entry: start 2024-09-12T17:53:14.387 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.385+0000 7fa7dfe0f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:53:14.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.385+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:14.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:14.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:53:14.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:53:14.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:53:14.388 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:14.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:53:14.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:14.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:14.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:14.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:14.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:53:14.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:53:14.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.386+0000 7fa7dfe0f800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:53:14.389 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.387+0000 7fa7dfe0f800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:53:14.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.387+0000 7fa7dfe0f800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:53:14.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.387+0000 7fa7dfe0f800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:53:14.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.387+0000 7fa7dfe0f800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:53:14.390 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.388+0000 7fa691fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:14.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.391+0000 7fa7dfe0f800 20 remove_watcher() i=0 2024-09-12T17:53:14.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.391+0000 7fa7dfe0f800 2 removed watcher, disabling cache 2024-09-12T17:53:14.392 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.392+0000 7fa7dfe0f800 20 remove_watcher() i=1 2024-09-12T17:53:14.394 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.393+0000 7fa7dfe0f800 20 remove_watcher() i=2 2024-09-12T17:53:14.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.394+0000 7fa7dfe0f800 20 remove_watcher() i=3 2024-09-12T17:53:14.396 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.395+0000 7fa7dfe0f800 20 remove_watcher() i=4 2024-09-12T17:53:14.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.396+0000 7fa7dfe0f800 20 remove_watcher() i=5 2024-09-12T17:53:14.397 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.397+0000 7fa7dfe0f800 20 remove_watcher() i=6 2024-09-12T17:53:14.399 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:14.398+0000 7fa7dfe0f800 20 remove_watcher() i=7 2024-09-12T17:53:44.425 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:53:44.461 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:44.462 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:44.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.501+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.503+0000 7fa448e0f800 20 realm 2024-09-12T17:53:44.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.503+0000 7fa448e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:44.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.504+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:44.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.504+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.505+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:44.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.505+0000 7fa448e0f800 20 searching for the correct realm 2024-09-12T17:53:44.510 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.509+0000 7fa43ffff640 0 -- 172.21.15.107:0/803876037 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fa430019040 msgr2=0x7fa430083270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:44.513 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.512+0000 7fa4470fa640 0 -- 172.21.15.107:0/803876037 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7fa43004e790 msgr2=0x7fa43008b130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:44.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:44.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:44.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:44.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:44.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:44.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:44.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.517+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.517+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.519 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.517+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:44.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:44.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 20 zone default found 2024-09-12T17:53:44.520 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 4 Realm: () 2024-09-12T17:53:44.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:44.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:44.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:44.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 20 zonegroup default 2024-09-12T17:53:44.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.519+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.519+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.519+0000 7fa448e0f800 20 started sync module instance, tier type = 2024-09-12T17:53:44.521 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.519+0000 7fa448e0f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:44.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=0 2024-09-12T17:53:44.529 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=1 2024-09-12T17:53:44.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=2 2024-09-12T17:53:44.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=3 2024-09-12T17:53:44.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=4 2024-09-12T17:53:44.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=5 2024-09-12T17:53:44.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=6 2024-09-12T17:53:44.530 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.529+0000 7fa448e0f800 20 add_watcher() i=7 2024-09-12T17:53:44.531 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.529+0000 7fa448e0f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:44.532 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.531+0000 7fa2fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:44.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.531+0000 7fa448e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:44.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.531+0000 7fa448e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:44.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.531+0000 7fa448e0f800 5 note: GC not initialized 2024-09-12T17:53:44.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.531+0000 7fa277fff640 20 reqs_thread_entry: start 2024-09-12T17:53:44.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.531+0000 7fa448e0f800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:44.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.531+0000 7fa448e0f800 20 Filter name: none 2024-09-12T17:53:44.533 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa275ffb640 20 reqs_thread_entry: start 2024-09-12T17:53:44.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:53:44.534 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:44.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:53:44.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:53:44.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:53:44.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:53:44.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:44.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:44.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:44.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:44.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.532+0000 7fa448e0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:53:44.537 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.534+0000 7fa448e0f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:53:44.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.538+0000 7fa448e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:44.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.538+0000 7fa448e0f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:44.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.538+0000 7fa448e0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:44.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.538+0000 7fa448e0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:53:44.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.538+0000 7fa329ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94212740461616 notifier 8253 bl.length()=911 2024-09-12T17:53:44.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.538+0000 7fa329ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:44.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.538+0000 7fa329ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:44.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.538+0000 7fa329ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:44.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.539+0000 7fa448e0f800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:53:44.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.539+0000 7fa448e0f800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:53:44.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.539+0000 7fa448e0f800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:53:44.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.539+0000 7fa448e0f800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:53:44.565 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa448e0f800 time 2024-09-12T17:53:44.543132+0000 2024-09-12T17:53:44.565 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:53:44.565 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:44.565 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa44c38c71a] 2024-09-12T17:53:44.565 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa44c38c8d8] 2024-09-12T17:53:44.565 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af9b056841] 2024-09-12T17:53:44.565 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd7490c) [0x55af9b56490c] 2024-09-12T17:53:44.565 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af9b06650d] 2024-09-12T17:53:44.565 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa44b029590] 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7fa448e0f800 thread_name:radosgw-admin 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.542+0000 7fa448e0f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa448e0f800 time 2024-09-12T17:53:44.543132+0000 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa44c38c71a] 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa44c38c8d8] 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af9b056841] 2024-09-12T17:53:44.566 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd7490c) [0x55af9b56490c] 2024-09-12T17:53:44.567 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af9b06650d] 2024-09-12T17:53:44.567 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:53:44.567 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa44b029590] 2024-09-12T17:53:44.567 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:53:44.567 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:53:44.567 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.567 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:44.567 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa44b03e6f0] 2024-09-12T17:53:44.567 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa44b08b99c] 2024-09-12T17:53:44.567 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:53:44.567 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:53:44.568 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa44c38c774] 2024-09-12T17:53:44.568 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa44c38c8d8] 2024-09-12T17:53:44.568 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af9b056841] 2024-09-12T17:53:44.568 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd7490c) [0x55af9b56490c] 2024-09-12T17:53:44.568 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af9b06650d] 2024-09-12T17:53:44.568 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:53:44.568 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa44b029590] 2024-09-12T17:53:44.568 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:53:44.568 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:53:44.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.543+0000 7fa448e0f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:53:44.568 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7fa448e0f800 thread_name:radosgw-admin 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa44b03e6f0] 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa44b08b99c] 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa44c38c774] 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa44c38c8d8] 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af9b056841] 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd7490c) [0x55af9b56490c] 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af9b06650d] 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:53:44.569 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa44b029590] 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: dump: 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.570 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.571 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.571 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.571 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.571 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.571 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: _finish_auth 0 2024-09-12T17:53:44.571 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: _check_auth_tickets 2024-09-12T17:53:44.571 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:44.571 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:53:44.483+0000 7fa448e0f800 5 monclient: authenticate success, global_id 8241 2024-09-12T17:53:44.571 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:53:44.483+0000 7fa448e0f800 10 monclient: get_monmap_and_config success 2024-09-12T17:53:44.571 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:53:44.483+0000 7fa448e0f800 4 set_mon_vals no callback set 2024-09-12T17:53:44.571 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.571 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:44.572 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: dump: 2024-09-12T17:53:44.572 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.572 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.572 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.572 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.572 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.572 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.572 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.572 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.572 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.572 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.572 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:53:44.484+0000 7fa448e0f800 10 monclient: shutdown 2024-09-12T17:53:44.573 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 asok(0x55af9cbbb730) unregister_commands rotate-key 2024-09-12T17:53:44.573 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:53:44.484+0000 7fa448e0f800 10 monclient: build_initial_monmap 2024-09-12T17:53:44.573 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:53:44.484+0000 7fa448e0f800 1 build_initial for_mkfs: 0 2024-09-12T17:53:44.573 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:53:44.484+0000 7fa448e0f800 10 monclient: monmap: 2024-09-12T17:53:44.573 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:44.573 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:44.573 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding auth protocol: cephx 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding auth protocol: cephx 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding auth protocol: cephx 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: secure 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: crc 2024-09-12T17:53:44.574 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: secure 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: crc 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: secure 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: crc 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: crc 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: secure 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: crc 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: secure 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: crc 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: secure 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:53:44.484+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:53:44.484+0000 7fa448e0f800 1 librados: starting msgr at 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:53:44.484+0000 7fa448e0f800 1 librados: starting objecter 2024-09-12T17:53:44.575 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command objecter_requests hook 0x55af9cde1680 2024-09-12T17:53:44.576 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:53:44.484+0000 7fa448e0f800 1 librados: setting wanted keys 2024-09-12T17:53:44.576 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:53:44.484+0000 7fa448e0f800 1 librados: calling monclient init 2024-09-12T17:53:44.576 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:53:44.484+0000 7fa448e0f800 10 monclient: init 2024-09-12T17:53:44.576 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding auth protocol: cephx 2024-09-12T17:53:44.576 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding auth protocol: cephx 2024-09-12T17:53:44.576 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding auth protocol: cephx 2024-09-12T17:53:44.576 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: secure 2024-09-12T17:53:44.576 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: crc 2024-09-12T17:53:44.576 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: secure 2024-09-12T17:53:44.576 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: crc 2024-09-12T17:53:44.576 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: secure 2024-09-12T17:53:44.576 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: crc 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: crc 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: secure 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: crc 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: secure 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: crc 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: secure 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:53:44.485+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:53:44.485+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:53:44.485+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command rotate-key hook 0x55af9cdddea8 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-a con 0x55af9cd209c0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:44.577 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-b con 0x55af9cd23da0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-c con 0x55af9cd2bf70 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): authenticate will time out at 2229.031499s 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): get_auth_request con 0x55af9cd2bf70 auth_method 0 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): get_auth_request con 0x55af9cd209c0 auth_method 0 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.578 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.579 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.579 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.579 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.579 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.579 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.579 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.579 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): handle_auth_done global_id 8244 payload 824 2024-09-12T17:53:44.579 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient: _finish_hunting 0 2024-09-12T17:53:44.579 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:53:44.485+0000 7fa4468f9640 1 monclient: found mon.noname-a 2024-09-12T17:53:44.579 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: dump: 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.580 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: _finish_auth 0 2024-09-12T17:53:44.581 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: _check_auth_tickets 2024-09-12T17:53:44.581 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:44.581 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.581 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:44.581 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: dump: 2024-09-12T17:53:44.581 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.581 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:53:44.486+0000 7fa448e0f800 5 monclient: authenticate success, global_id 8244 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:53:44.486+0000 7fa448e0f800 10 monclient: _renew_subs 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:53:44.486+0000 7fa448e0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:53:44.486+0000 7fa334e09640 4 set_mon_vals no callback set 2024-09-12T17:53:44.582 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:53:44.486+0000 7fa448e0f800 10 monclient: _renew_subs 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:53:44.486+0000 7fa448e0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:53:44.486+0000 7fa448e0f800 1 librados: init done 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:53:44.488+0000 7fa333606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:53:44.488+0000 7fa333606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:53:44.488+0000 7fa333606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:53:44.488+0000 7fa43ffff640 10 monclient: get_auth_request con 0x7fa32c076470 auth_method 0 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:53:44.488+0000 7fa4470fa640 10 monclient: get_auth_request con 0x55af9ce069b0 auth_method 0 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:53:44.489+0000 7fa4468f9640 10 monclient: get_auth_request con 0x55af9ce29150 auth_method 0 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:53:44.490+0000 7fa43ffff640 10 monclient: get_auth_request con 0x55af9ce2d4b0 auth_method 0 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:53:44.491+0000 7fa448e0f800 10 monclient: build_initial_monmap 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:53:44.491+0000 7fa448e0f800 1 build_initial for_mkfs: 0 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:53:44.491+0000 7fa448e0f800 10 monclient: monmap: 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:44.583 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding auth protocol: cephx 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding auth protocol: cephx 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding auth protocol: cephx 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: secure 2024-09-12T17:53:44.584 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: crc 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: secure 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: crc 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: secure 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: crc 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: crc 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: secure 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: crc 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: secure 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: crc 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: secure 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:53:44.492+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command objecter_requests cmddesc objecter_requests hook 0x55af9ce35c00 EEXIST 2024-09-12T17:53:44.585 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:53:44.492+0000 7fa448e0f800 10 monclient: init 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding auth protocol: cephx 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding auth protocol: cephx 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding auth protocol: cephx 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: secure 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: crc 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: secure 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: crc 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: secure 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: crc 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: crc 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: secure 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: crc 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: secure 2024-09-12T17:53:44.586 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: crc 2024-09-12T17:53:44.587 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: secure 2024-09-12T17:53:44.587 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:53:44.492+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.587 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:53:44.493+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.587 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:53:44.493+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command rotate-key cmddesc rotate-key hook 0x55af9ce30b10 EEXIST 2024-09-12T17:53:44.587 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:44.587 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:53:44.587 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-a con 0x55af9ce598f0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:44.587 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-c con 0x55af9ce5bbc0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:44.587 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-b con 0x55af9ce580c0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:44.587 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.587 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.588 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.588 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:44.588 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): authenticate will time out at 2229.039122s 2024-09-12T17:53:44.588 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): get_auth_request con 0x55af9ce5bbc0 auth_method 0 2024-09-12T17:53:44.588 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.588 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.588 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.588 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): get_auth_request con 0x55af9ce598f0 auth_method 0 2024-09-12T17:53:44.588 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.588 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.588 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.589 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.592 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.592 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.592 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.592 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.592 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.592 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): get_auth_request con 0x55af9ce580c0 auth_method 0 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): handle_auth_done global_id 7763 payload 824 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient: _finish_hunting 0 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:53:44.493+0000 7fa43ffff640 1 monclient: found mon.noname-c 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: dump: 2024-09-12T17:53:44.593 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: _finish_auth 0 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: _check_auth_tickets 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.594 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:53:44.595 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: dump: 2024-09-12T17:53:44.595 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.595 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.595 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.595 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.595 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.595 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.595 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.595 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:53:44.493+0000 7fa448e0f800 5 monclient: authenticate success, global_id 7763 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient: _renew_subs 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:53:44.493+0000 7fa4478fb640 4 set_mon_vals no callback set 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient: _renew_subs 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:53:44.495+0000 7fa330e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:53:44.495+0000 7fa330e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:53:44.495+0000 7fa330e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:53:44.496+0000 7fa4468f9640 10 monclient: get_auth_request con 0x7fa320076380 auth_method 0 2024-09-12T17:53:44.596 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:53:44.496+0000 7fa448e0f800 10 monclient: get_monmap_and_config 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:53:44.496+0000 7fa448e0f800 10 monclient: build_initial_monmap 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:53:44.496+0000 7fa448e0f800 1 build_initial for_mkfs: 0 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:53:44.496+0000 7fa448e0f800 10 monclient: monmap: 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.597 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding auth protocol: cephx 2024-09-12T17:53:44.598 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding auth protocol: cephx 2024-09-12T17:53:44.598 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding auth protocol: cephx 2024-09-12T17:53:44.598 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: secure 2024-09-12T17:53:44.598 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: crc 2024-09-12T17:53:44.598 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: secure 2024-09-12T17:53:44.598 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: crc 2024-09-12T17:53:44.598 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: secure 2024-09-12T17:53:44.598 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: crc 2024-09-12T17:53:44.598 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: crc 2024-09-12T17:53:44.598 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: secure 2024-09-12T17:53:44.598 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: crc 2024-09-12T17:53:44.598 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: secure 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: crc 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: secure 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:53:44.496+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:53:44.496+0000 7fa448e0f800 10 monclient: init 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding auth protocol: cephx 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding auth protocol: cephx 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding auth protocol: cephx 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: secure 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: crc 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: secure 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: crc 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: secure 2024-09-12T17:53:44.599 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: crc 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: crc 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: secure 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: crc 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: secure 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: crc 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: secure 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:53:44.496+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:53:44.497+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:53:44.497+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command rotate-key cmddesc rotate-key hook 0x7ffffbeb2938 EEXIST 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-c con 0x55af9ceadaa0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-a con 0x55af9ceade80 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:44.600 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-b con 0x55af9ceb35d0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): authenticate will time out at 2229.043235s 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): get_auth_request con 0x55af9ceade80 auth_method 0 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): get_auth_request con 0x55af9ceadaa0 auth_method 0 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.601 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:53:44.497+0000 7fa4470fa640 10 monclient(hunting): get_auth_request con 0x55af9ceb35d0 auth_method 0 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:53:44.497+0000 7fa4470fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:53:44.497+0000 7fa4470fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:53:44.497+0000 7fa4470fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): handle_auth_done global_id 7766 payload 274 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient: _finish_hunting 0 2024-09-12T17:53:44.602 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:53:44.497+0000 7fa4468f9640 1 monclient: found mon.noname-c 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: dump: 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.603 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.604 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:53:44.604 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:53:44.604 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:44.604 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.604 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:53:44.604 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: dump: 2024-09-12T17:53:44.604 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.604 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.604 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:53:44.497+0000 7fa448e0f800 5 monclient: authenticate success, global_id 7766 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient: get_monmap_and_config success 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:53:44.497+0000 7fa448e0f800 4 set_mon_vals no callback set 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:53:44.498+0000 7fa448e0f800 10 monclient: shutdown 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:53:44.498+0000 7fa448e0f800 10 monclient: build_initial_monmap 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:53:44.498+0000 7fa448e0f800 1 build_initial for_mkfs: 0 2024-09-12T17:53:44.605 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:53:44.498+0000 7fa448e0f800 10 monclient: monmap: 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding auth protocol: cephx 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding auth protocol: cephx 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding auth protocol: cephx 2024-09-12T17:53:44.606 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: secure 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: crc 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: secure 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: crc 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: secure 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: crc 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: crc 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: secure 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: crc 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: secure 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: crc 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: secure 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:53:44.498+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.607 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:53:44.498+0000 7fa448e0f800 1 librados: starting msgr at 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:53:44.498+0000 7fa448e0f800 1 librados: starting objecter 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command objecter_requests cmddesc objecter_requests hook 0x55af9cea8f20 EEXIST 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:53:44.499+0000 7fa448e0f800 1 librados: setting wanted keys 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:53:44.499+0000 7fa448e0f800 1 librados: calling monclient init 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient: init 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding auth protocol: cephx 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding auth protocol: cephx 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding auth protocol: cephx 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: secure 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: crc 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: secure 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: crc 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: secure 2024-09-12T17:53:44.608 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: crc 2024-09-12T17:53:44.609 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: crc 2024-09-12T17:53:44.609 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: secure 2024-09-12T17:53:44.609 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: crc 2024-09-12T17:53:44.609 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: secure 2024-09-12T17:53:44.609 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: crc 2024-09-12T17:53:44.609 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: secure 2024-09-12T17:53:44.609 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:53:44.499+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.609 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:53:44.499+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.609 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command rotate-key cmddesc rotate-key hook 0x55af9ce717e8 EEXIST 2024-09-12T17:53:44.609 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:44.609 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:53:44.609 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-b con 0x55af9ceadaa0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-a con 0x55af9ceb35d0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-c con 0x55af9ceacf40 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): authenticate will time out at 2229.045582s 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): get_auth_request con 0x55af9ceb35d0 auth_method 0 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): get_auth_request con 0x55af9ceacf40 auth_method 0 2024-09-12T17:53:44.610 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.611 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.611 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.611 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.611 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.611 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.611 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.611 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.611 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.611 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): handle_auth_done global_id 8253 payload 824 2024-09-12T17:53:44.611 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient: _finish_hunting 0 2024-09-12T17:53:44.611 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:53:44.499+0000 7fa43ffff640 1 monclient: found mon.noname-a 2024-09-12T17:53:44.612 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.612 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.612 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:53:44.612 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: dump: 2024-09-12T17:53:44.612 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: _finish_auth 0 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:44.613 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.614 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:44.614 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: dump: 2024-09-12T17:53:44.614 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.614 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.614 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.614 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.614 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.614 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.614 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.614 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.614 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.614 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.615 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:53:44.500+0000 7fa32a7fc640 4 set_mon_vals no callback set 2024-09-12T17:53:44.616 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:53:44.500+0000 7fa448e0f800 5 monclient: authenticate success, global_id 8253 2024-09-12T17:53:44.616 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:53:44.500+0000 7fa448e0f800 10 monclient: _renew_subs 2024-09-12T17:53:44.616 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:53:44.500+0000 7fa448e0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.616 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:53:44.500+0000 7fa448e0f800 10 monclient: _renew_subs 2024-09-12T17:53:44.617 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:53:44.500+0000 7fa448e0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.617 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:53:44.500+0000 7fa448e0f800 1 librados: init done 2024-09-12T17:53:44.617 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:53:44.500+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command cr dump hook 0x55af9cea6b48 2024-09-12T17:53:44.617 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:53:44.501+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.617 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:53:44.502+0000 7fa328ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:53:44.617 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:53:44.502+0000 7fa328ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:44.618 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:53:44.502+0000 7fa328ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:44.618 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:53:44.502+0000 7fa4468f9640 10 monclient: get_auth_request con 0x7fa310076640 auth_method 0 2024-09-12T17:53:44.618 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:53:44.502+0000 7fa4470fa640 10 monclient: get_auth_request con 0x55af9cec8370 auth_method 0 2024-09-12T17:53:44.618 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.618 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 realm 2024-09-12T17:53:44.618 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.618 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.619 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:53:44.503+0000 7fa448e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:44.619 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.619 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.619 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.619 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:53:44.503+0000 7fa4468f9640 10 monclient: get_auth_request con 0x55af9cecc5e0 auth_method 0 2024-09-12T17:53:44.620 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:53:44.504+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:44.620 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:53:44.504+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.620 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:53:44.504+0000 7fa43ffff640 10 monclient: get_auth_request con 0x55af9cecfe40 auth_method 0 2024-09-12T17:53:44.620 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:53:44.505+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:44.620 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:53:44.505+0000 7fa448e0f800 20 searching for the correct realm 2024-09-12T17:53:44.621 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:53:44.505+0000 7fa4470fa640 10 monclient: get_auth_request con 0x55af9ced4b90 auth_method 0 2024-09-12T17:53:44.621 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:53:44.506+0000 7fa4468f9640 10 monclient: get_auth_request con 0x7fa440078930 auth_method 0 2024-09-12T17:53:44.621 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:53:44.507+0000 7fa43ffff640 10 monclient: get_auth_request con 0x7fa430019040 auth_method 0 2024-09-12T17:53:44.621 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:53:44.509+0000 7fa43ffff640 0 -- 172.21.15.107:0/803876037 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fa430019040 msgr2=0x7fa430083270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:44.621 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:53:44.509+0000 7fa328ff9640 1 client.8253.objecter ms_handle_reset 0x7fa430019040 session 0x7fa430005040 osd.4 2024-09-12T17:53:44.621 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:53:44.509+0000 7fa328ff9640 10 monclient: _renew_subs 2024-09-12T17:53:44.621 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:53:44.509+0000 7fa328ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.622 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:53:44.509+0000 7fa4470fa640 10 monclient: get_auth_request con 0x7fa43004e790 auth_method 0 2024-09-12T17:53:44.622 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:53:44.509+0000 7fa43ffff640 10 monclient: get_auth_request con 0x7fa310086d70 auth_method 0 2024-09-12T17:53:44.622 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:53:44.511+0000 7fa4468f9640 10 monclient: get_auth_request con 0x7fa430052040 auth_method 0 2024-09-12T17:53:44.622 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:53:44.512+0000 7fa4470fa640 0 -- 172.21.15.107:0/803876037 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7fa43004e790 msgr2=0x7fa43008b130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:44.622 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:53:44.512+0000 7fa328ff9640 1 client.8253.objecter ms_handle_reset 0x7fa43004e790 session 0x7fa430085430 osd.6 2024-09-12T17:53:44.622 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:53:44.512+0000 7fa4470fa640 10 monclient: get_auth_request con 0x7fa430019040 auth_method 0 2024-09-12T17:53:44.622 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:44.623 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:44.623 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:44.623 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:44.623 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:44.623 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:44.624 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.624 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.624 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.624 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:44.624 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.625 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:44.625 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 zone default found 2024-09-12T17:53:44.625 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:53:44.518+0000 7fa448e0f800 4 Realm: () 2024-09-12T17:53:44.625 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:53:44.518+0000 7fa448e0f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:44.625 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:53:44.518+0000 7fa448e0f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:44.625 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:53:44.518+0000 7fa448e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:44.625 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 zonegroup default 2024-09-12T17:53:44.625 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.627 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.627 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.627 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.627 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:53:44.519+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.628 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:53:44.519+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.628 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:53:44.519+0000 7fa448e0f800 20 started sync module instance, tier type = 2024-09-12T17:53:44.628 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:53:44.519+0000 7fa448e0f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:44.628 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=0 2024-09-12T17:53:44.628 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=1 2024-09-12T17:53:44.628 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=2 2024-09-12T17:53:44.628 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=3 2024-09-12T17:53:44.628 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=4 2024-09-12T17:53:44.628 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=5 2024-09-12T17:53:44.628 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=6 2024-09-12T17:53:44.628 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:53:44.529+0000 7fa448e0f800 20 add_watcher() i=7 2024-09-12T17:53:44.628 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:53:44.529+0000 7fa448e0f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding auth protocol: cephx 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding auth protocol: cephx 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding auth protocol: cephx 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: secure 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: crc 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: secure 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: crc 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: secure 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: crc 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: crc 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: secure 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: crc 2024-09-12T17:53:44.629 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: secure 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: crc 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: secure 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:53:44.531+0000 7fa2fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:53:44.531+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:53:44.531+0000 7fa448e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:53:44.531+0000 7fa448e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command cache list hook 0x55af9ce9bb60 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command cache inspect hook 0x55af9ce9bb60 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command cache erase hook 0x55af9ce9bb60 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command cache zap hook 0x55af9ce9bb60 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 note: GC not initialized 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:53:44.531+0000 7fa277fff640 20 reqs_thread_entry: start 2024-09-12T17:53:44.630 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command sync trace show hook 0x7fa430004400 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command sync trace history hook 0x7fa430004400 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command sync trace active hook 0x7fa430004400 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command sync trace active_short hook 0x7fa430004400 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:53:44.531+0000 7fa448e0f800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:53:44.531+0000 7fa448e0f800 20 Filter name: none 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:53:44.532+0000 7fa275ffb640 20 reqs_thread_entry: start 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:53:44.532+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:53:44.532+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:53:44.631 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:53:44.532+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:53:44.532+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:53:44.534+0000 7fa448e0f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:53:44.538+0000 7fa448e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:53:44.538+0000 7fa448e0f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:53:44.538+0000 7fa448e0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:53:44.538+0000 7fa448e0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:53:44.538+0000 7fa329ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94212740461616 notifier 8253 bl.length()=911 2024-09-12T17:53:44.632 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:53:44.538+0000 7fa329ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:44.633 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:53:44.538+0000 7fa329ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:44.633 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:53:44.538+0000 7fa329ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:44.633 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:53:44.539+0000 7fa448e0f800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:53:44.633 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:53:44.539+0000 7fa448e0f800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:53:44.633 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:53:44.539+0000 7fa448e0f800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:53:44.633 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:53:44.539+0000 7fa448e0f800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:53:44.633 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:53:44.542+0000 7fa448e0f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa448e0f800 time 2024-09-12T17:53:44.543132+0000 2024-09-12T17:53:44.633 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa44c38c71a] 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa44c38c8d8] 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af9b056841] 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd7490c) [0x55af9b56490c] 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af9b06650d] 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa44b029590] 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:53:44.543+0000 7fa448e0f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:53:44.634 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7fa448e0f800 thread_name:radosgw-admin 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa44b03e6f0] 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa44b08b99c] 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa44c38c774] 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa44c38c8d8] 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af9b056841] 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd7490c) [0x55af9b56490c] 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af9b06650d] 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:53:44.635 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa44b029590] 2024-09-12T17:53:44.636 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:53:44.636 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:53:44.636 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:53:44.636 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.636 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:53:44.636 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:53:44.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:53:44.637 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:53:44.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:53:44.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:53:44.638 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:53:44.639 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:53:44.640 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:53:44.641 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:53:44.642 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:53:44.643 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:53:44.644 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:53:44.644 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:53:44.644 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:53:44.644 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:53:44.644 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:53:44.644 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:53:44.644 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:53:44.644 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:53:44.644 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:53:44.644 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:53:44.644 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:53:44.644 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:53:44.645 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:53:44.645 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:53:44.645 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:53:44.645 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:53:44.645 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:53:44.645 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:53:44.645 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:53:44.645 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:53:44.645 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa275ffb640 / http_manager 2024-09-12T17:53:44.645 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa277fff640 / http_manager 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa2fd7e2640 / rgw_dt_lg_renew 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa328ff9640 / ms_dispatch 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa329ffb640 / io_context_pool 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa32a7fc640 / io_context_pool 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa330e01640 / ms_dispatch 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa333606640 / ms_dispatch 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa334e09640 / io_context_pool 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa43ffff640 / msgr-worker-2 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa4468f9640 / msgr-worker-1 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa4470fa640 / msgr-worker-0 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa4478fb640 / io_context_pool 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa448e0f800 / radosgw-admin 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:53:44.646 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/log/ceph/ceph-client.admin.152489.log 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: dump: 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.647 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: _finish_auth 0 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: _check_auth_tickets 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:53:44.483+0000 7fa448e0f800 5 monclient: authenticate success, global_id 8241 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:53:44.483+0000 7fa448e0f800 10 monclient: get_monmap_and_config success 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:53:44.483+0000 7fa448e0f800 4 set_mon_vals no callback set 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:53:44.483+0000 7fa334e09640 10 monclient: dump: 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.648 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:53:44.484+0000 7fa448e0f800 10 monclient: shutdown 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 asok(0x55af9cbbb730) unregister_commands rotate-key 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:53:44.484+0000 7fa448e0f800 10 monclient: build_initial_monmap 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:53:44.484+0000 7fa448e0f800 1 build_initial for_mkfs: 0 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:53:44.484+0000 7fa448e0f800 10 monclient: monmap: 2024-09-12T17:53:44.649 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding auth protocol: cephx 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding auth protocol: cephx 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding auth protocol: cephx 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: secure 2024-09-12T17:53:44.650 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: crc 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: secure 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: crc 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: secure 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: crc 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: crc 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: secure 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: crc 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: secure 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: crc 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cde3370) adding con mode: secure 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:53:44.484+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:53:44.484+0000 7fa448e0f800 1 librados: starting msgr at 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:53:44.484+0000 7fa448e0f800 1 librados: starting objecter 2024-09-12T17:53:44.651 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command objecter_requests hook 0x55af9cde1680 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:53:44.484+0000 7fa448e0f800 1 librados: setting wanted keys 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:53:44.484+0000 7fa448e0f800 1 librados: calling monclient init 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:53:44.484+0000 7fa448e0f800 10 monclient: init 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding auth protocol: cephx 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding auth protocol: cephx 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding auth protocol: cephx 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: secure 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: crc 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: secure 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: crc 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: secure 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: crc 2024-09-12T17:53:44.652 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: crc 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: secure 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: crc 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: secure 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: crc 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:53:44.484+0000 7fa448e0f800 5 AuthRegistry(0x55af9cdddd60) adding con mode: secure 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:53:44.485+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:53:44.485+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:53:44.485+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command rotate-key hook 0x55af9cdddea8 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-a con 0x55af9cd209c0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-b con 0x55af9cd23da0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-c con 0x55af9cd2bf70 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:44.653 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:53:44.485+0000 7fa448e0f800 10 monclient(hunting): authenticate will time out at 2229.031499s 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): get_auth_request con 0x55af9cd2bf70 auth_method 0 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): get_auth_request con 0x55af9cd209c0 auth_method 0 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.654 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:53:44.485+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient(hunting): handle_auth_done global_id 8244 payload 824 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient: _finish_hunting 0 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:53:44.485+0000 7fa4468f9640 1 monclient: found mon.noname-a 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:53:44.485+0000 7fa4468f9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: dump: 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.655 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.656 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.656 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.656 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.656 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.656 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.656 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.656 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.656 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.656 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: _finish_auth 0 2024-09-12T17:53:44.656 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: _check_auth_tickets 2024-09-12T17:53:44.656 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:44.656 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:53:44.486+0000 7fa333606640 10 monclient: dump: 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.657 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:53:44.486+0000 7fa448e0f800 5 monclient: authenticate success, global_id 8244 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:53:44.486+0000 7fa448e0f800 10 monclient: _renew_subs 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:53:44.486+0000 7fa448e0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:53:44.486+0000 7fa334e09640 4 set_mon_vals no callback set 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:53:44.486+0000 7fa448e0f800 10 monclient: _renew_subs 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:53:44.486+0000 7fa448e0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:53:44.486+0000 7fa448e0f800 1 librados: init done 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:53:44.488+0000 7fa333606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:53:44.488+0000 7fa333606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:53:44.488+0000 7fa333606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:53:44.488+0000 7fa43ffff640 10 monclient: get_auth_request con 0x7fa32c076470 auth_method 0 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:53:44.488+0000 7fa4470fa640 10 monclient: get_auth_request con 0x55af9ce069b0 auth_method 0 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:53:44.489+0000 7fa4468f9640 10 monclient: get_auth_request con 0x55af9ce29150 auth_method 0 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:53:44.490+0000 7fa43ffff640 10 monclient: get_auth_request con 0x55af9ce2d4b0 auth_method 0 2024-09-12T17:53:44.658 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:53:44.491+0000 7fa448e0f800 10 monclient: build_initial_monmap 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:53:44.491+0000 7fa448e0f800 1 build_initial for_mkfs: 0 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:53:44.491+0000 7fa448e0f800 10 monclient: monmap: 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.659 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding auth protocol: cephx 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding auth protocol: cephx 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding auth protocol: cephx 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: secure 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: crc 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: secure 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: crc 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: secure 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: crc 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: crc 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: secure 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: crc 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: secure 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: crc 2024-09-12T17:53:44.660 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce322b0) adding con mode: secure 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:53:44.492+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command objecter_requests cmddesc objecter_requests hook 0x55af9ce35c00 EEXIST 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:53:44.492+0000 7fa448e0f800 10 monclient: init 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding auth protocol: cephx 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding auth protocol: cephx 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding auth protocol: cephx 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: secure 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: crc 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: secure 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: crc 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: secure 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: crc 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: crc 2024-09-12T17:53:44.661 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: secure 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: crc 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: secure 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: crc 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:53:44.492+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce309c8) adding con mode: secure 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:53:44.492+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:53:44.493+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:53:44.493+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command rotate-key cmddesc rotate-key hook 0x55af9ce30b10 EEXIST 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-a con 0x55af9ce598f0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-c con 0x55af9ce5bbc0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-b con 0x55af9ce580c0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.662 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient(hunting): authenticate will time out at 2229.039122s 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): get_auth_request con 0x55af9ce5bbc0 auth_method 0 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): get_auth_request con 0x55af9ce598f0 auth_method 0 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.663 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:53:44.493+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): get_auth_request con 0x55af9ce580c0 auth_method 0 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:53:44.493+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient(hunting): handle_auth_done global_id 7763 payload 824 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient: _finish_hunting 0 2024-09-12T17:53:44.664 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:53:44.493+0000 7fa43ffff640 1 monclient: found mon.noname-c 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:53:44.493+0000 7fa43ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: dump: 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.665 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: _finish_auth 0 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: _check_auth_tickets 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:53:44.493+0000 7fa330e01640 10 monclient: dump: 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.666 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:53:44.493+0000 7fa448e0f800 5 monclient: authenticate success, global_id 7763 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient: _renew_subs 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:53:44.493+0000 7fa4478fb640 4 set_mon_vals no callback set 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient: _renew_subs 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:53:44.493+0000 7fa448e0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:53:44.495+0000 7fa330e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:53:44.495+0000 7fa330e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:53:44.495+0000 7fa330e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:53:44.496+0000 7fa4468f9640 10 monclient: get_auth_request con 0x7fa320076380 auth_method 0 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:53:44.496+0000 7fa448e0f800 10 monclient: get_monmap_and_config 2024-09-12T17:53:44.667 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:53:44.496+0000 7fa448e0f800 10 monclient: build_initial_monmap 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:53:44.496+0000 7fa448e0f800 1 build_initial for_mkfs: 0 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:53:44.496+0000 7fa448e0f800 10 monclient: monmap: 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding auth protocol: cephx 2024-09-12T17:53:44.668 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding auth protocol: cephx 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding auth protocol: cephx 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: secure 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: crc 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: secure 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: crc 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: secure 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: crc 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: crc 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: secure 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: crc 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: secure 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: crc 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce797e0) adding con mode: secure 2024-09-12T17:53:44.669 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:53:44.496+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:53:44.496+0000 7fa448e0f800 10 monclient: init 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding auth protocol: cephx 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding auth protocol: cephx 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding auth protocol: cephx 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: secure 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: crc 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: secure 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: crc 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: secure 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: crc 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: crc 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: secure 2024-09-12T17:53:44.670 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: crc 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: secure 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: crc 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:53:44.496+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb27f0) adding con mode: secure 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:53:44.496+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:53:44.497+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:53:44.497+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command rotate-key cmddesc rotate-key hook 0x7ffffbeb2938 EEXIST 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-c con 0x55af9ceadaa0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-a con 0x55af9ceade80 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-b con 0x55af9ceb35d0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.671 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient(hunting): authenticate will time out at 2229.043235s 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): get_auth_request con 0x55af9ceade80 auth_method 0 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): get_auth_request con 0x55af9ceadaa0 auth_method 0 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:53:44.497+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.672 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:53:44.497+0000 7fa4470fa640 10 monclient(hunting): get_auth_request con 0x55af9ceb35d0 auth_method 0 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:53:44.497+0000 7fa4470fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:53:44.497+0000 7fa4470fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:53:44.497+0000 7fa4470fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient(hunting): handle_auth_done global_id 7766 payload 274 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient: _finish_hunting 0 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:53:44.497+0000 7fa4468f9640 1 monclient: found mon.noname-c 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:53:44.497+0000 7fa4468f9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: dump: 2024-09-12T17:53:44.673 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.674 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:53:44.497+0000 7fa32a7fc640 10 monclient: dump: 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:53:44.497+0000 7fa448e0f800 5 monclient: authenticate success, global_id 7766 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:53:44.497+0000 7fa448e0f800 10 monclient: get_monmap_and_config success 2024-09-12T17:53:44.675 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:53:44.497+0000 7fa448e0f800 4 set_mon_vals no callback set 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:53:44.498+0000 7fa448e0f800 10 monclient: shutdown 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:53:44.498+0000 7fa448e0f800 10 monclient: build_initial_monmap 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:53:44.498+0000 7fa448e0f800 1 build_initial for_mkfs: 0 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:53:44.498+0000 7fa448e0f800 10 monclient: monmap: 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.676 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding auth protocol: cephx 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding auth protocol: cephx 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding auth protocol: cephx 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: secure 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: crc 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: secure 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: crc 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: secure 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: crc 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: crc 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: secure 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: crc 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: secure 2024-09-12T17:53:44.677 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: crc 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 AuthRegistry(0x55af9cea93a0) adding con mode: secure 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:53:44.498+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:53:44.498+0000 7fa448e0f800 1 librados: starting msgr at 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:53:44.498+0000 7fa448e0f800 1 librados: starting objecter 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:53:44.498+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command objecter_requests cmddesc objecter_requests hook 0x55af9cea8f20 EEXIST 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:53:44.499+0000 7fa448e0f800 1 librados: setting wanted keys 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:53:44.499+0000 7fa448e0f800 1 librados: calling monclient init 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient: init 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding auth protocol: cephx 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding auth protocol: cephx 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding auth protocol: cephx 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: secure 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: crc 2024-09-12T17:53:44.678 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: secure 2024-09-12T17:53:44.679 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: crc 2024-09-12T17:53:44.679 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: secure 2024-09-12T17:53:44.679 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: crc 2024-09-12T17:53:44.679 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: crc 2024-09-12T17:53:44.679 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: secure 2024-09-12T17:53:44.679 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: crc 2024-09-12T17:53:44.679 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: secure 2024-09-12T17:53:44.679 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: crc 2024-09-12T17:53:44.679 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 AuthRegistry(0x55af9ce716a0) adding con mode: secure 2024-09-12T17:53:44.679 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:53:44.499+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.680 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:53:44.499+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.680 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:53:44.499+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command rotate-key cmddesc rotate-key hook 0x55af9ce717e8 EEXIST 2024-09-12T17:53:44.680 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient: _reopen_session rank -1 2024-09-12T17:53:44.680 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:53:44.680 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-b con 0x55af9ceadaa0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:53:44.680 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-a con 0x55af9ceb35d0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:53:44.680 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): picked mon.noname-c con 0x55af9ceacf40 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:53:44.680 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.680 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.680 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:53:44.680 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): _renew_subs 2024-09-12T17:53:44.681 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:53:44.499+0000 7fa448e0f800 10 monclient(hunting): authenticate will time out at 2229.045582s 2024-09-12T17:53:44.681 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): get_auth_request con 0x55af9ceb35d0 auth_method 0 2024-09-12T17:53:44.681 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.681 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.681 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.681 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): get_auth_request con 0x55af9ceacf40 auth_method 0 2024-09-12T17:53:44.681 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:53:44.681 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:53:44.681 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:53:44.499+0000 7fa4470fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient(hunting): handle_auth_done global_id 8253 payload 824 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient: _finish_hunting 0 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:53:44.499+0000 7fa43ffff640 1 monclient: found mon.noname-a 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:53:44.499+0000 7fa43ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: dump: 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.682 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: _finish_auth 0 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:53:44.683 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:53:44.500+0000 7fa328ff9640 10 monclient: dump: 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:53:44.500+0000 7fa32a7fc640 4 set_mon_vals no callback set 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:53:44.500+0000 7fa448e0f800 5 monclient: authenticate success, global_id 8253 2024-09-12T17:53:44.684 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:53:44.500+0000 7fa448e0f800 10 monclient: _renew_subs 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:53:44.500+0000 7fa448e0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:53:44.500+0000 7fa448e0f800 10 monclient: _renew_subs 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:53:44.500+0000 7fa448e0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:53:44.500+0000 7fa448e0f800 1 librados: init done 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:53:44.500+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command cr dump hook 0x55af9cea6b48 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:53:44.501+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:53:44.502+0000 7fa328ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:53:44.502+0000 7fa328ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:53:44.502+0000 7fa328ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:53:44.502+0000 7fa4468f9640 10 monclient: get_auth_request con 0x7fa310076640 auth_method 0 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:53:44.502+0000 7fa4470fa640 10 monclient: get_auth_request con 0x55af9cec8370 auth_method 0 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 realm 2024-09-12T17:53:44.685 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:53:44.503+0000 7fa448e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:53:44.503+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:53:44.503+0000 7fa4468f9640 10 monclient: get_auth_request con 0x55af9cecc5e0 auth_method 0 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:53:44.504+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:53:44.504+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:53:44.504+0000 7fa43ffff640 10 monclient: get_auth_request con 0x55af9cecfe40 auth_method 0 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:53:44.505+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:53:44.505+0000 7fa448e0f800 20 searching for the correct realm 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:53:44.505+0000 7fa4470fa640 10 monclient: get_auth_request con 0x55af9ced4b90 auth_method 0 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:53:44.506+0000 7fa4468f9640 10 monclient: get_auth_request con 0x7fa440078930 auth_method 0 2024-09-12T17:53:44.686 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:53:44.507+0000 7fa43ffff640 10 monclient: get_auth_request con 0x7fa430019040 auth_method 0 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:53:44.509+0000 7fa43ffff640 0 -- 172.21.15.107:0/803876037 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fa430019040 msgr2=0x7fa430083270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:53:44.509+0000 7fa328ff9640 1 client.8253.objecter ms_handle_reset 0x7fa430019040 session 0x7fa430005040 osd.4 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:53:44.509+0000 7fa328ff9640 10 monclient: _renew_subs 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:53:44.509+0000 7fa328ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:53:44.509+0000 7fa4470fa640 10 monclient: get_auth_request con 0x7fa43004e790 auth_method 0 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:53:44.509+0000 7fa43ffff640 10 monclient: get_auth_request con 0x7fa310086d70 auth_method 0 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:53:44.511+0000 7fa4468f9640 10 monclient: get_auth_request con 0x7fa430052040 auth_method 0 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:53:44.512+0000 7fa4470fa640 0 -- 172.21.15.107:0/803876037 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7fa43004e790 msgr2=0x7fa43008b130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:53:44.512+0000 7fa328ff9640 1 client.8253.objecter ms_handle_reset 0x7fa43004e790 session 0x7fa430085430 osd.6 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:53:44.512+0000 7fa4470fa640 10 monclient: get_auth_request con 0x7fa430019040 auth_method 0 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:44.687 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:53:44.517+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 zone default found 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:53:44.518+0000 7fa448e0f800 4 Realm: () 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:53:44.518+0000 7fa448e0f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:53:44.518+0000 7fa448e0f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:53:44.518+0000 7fa448e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:44.688 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 zonegroup default 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:53:44.518+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:53:44.519+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:53:44.519+0000 7fa448e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:53:44.519+0000 7fa448e0f800 20 started sync module instance, tier type = 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:53:44.519+0000 7fa448e0f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=0 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=1 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=2 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=3 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=4 2024-09-12T17:53:44.689 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=5 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:53:44.528+0000 7fa448e0f800 20 add_watcher() i=6 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:53:44.529+0000 7fa448e0f800 20 add_watcher() i=7 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:53:44.529+0000 7fa448e0f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding auth protocol: cephx 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding auth protocol: cephx 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding auth protocol: cephx 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: secure 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: crc 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: secure 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: crc 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: secure 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: crc 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: crc 2024-09-12T17:53:44.690 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: secure 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: crc 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: secure 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: crc 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 AuthRegistry(0x7ffffbeb2cc0) adding con mode: secure 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:53:44.531+0000 7fa2fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:53:44.531+0000 7fa448e0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:53:44.531+0000 7fa448e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:53:44.531+0000 7fa448e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command cache list hook 0x55af9ce9bb60 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command cache inspect hook 0x55af9ce9bb60 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command cache erase hook 0x55af9ce9bb60 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command cache zap hook 0x55af9ce9bb60 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 note: GC not initialized 2024-09-12T17:53:44.691 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:53:44.531+0000 7fa277fff640 20 reqs_thread_entry: start 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command sync trace show hook 0x7fa430004400 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command sync trace history hook 0x7fa430004400 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command sync trace active hook 0x7fa430004400 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:53:44.531+0000 7fa448e0f800 5 asok(0x55af9cbbb730) register_command sync trace active_short hook 0x7fa430004400 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:53:44.531+0000 7fa448e0f800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:53:44.531+0000 7fa448e0f800 20 Filter name: none 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:53:44.532+0000 7fa275ffb640 20 reqs_thread_entry: start 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:53:44.532+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:53:44.532+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:53:44.692 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:53:44.532+0000 7fa448e0f800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:53:44.532+0000 7fa448e0f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:53:44.532+0000 7fa448e0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:53:44.534+0000 7fa448e0f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:53:44.538+0000 7fa448e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:53:44.538+0000 7fa448e0f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:53:44.538+0000 7fa448e0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:53:44.538+0000 7fa448e0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:53:44.693 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:53:44.538+0000 7fa329ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94212740461616 notifier 8253 bl.length()=911 2024-09-12T17:53:44.694 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:53:44.538+0000 7fa329ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:44.694 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:53:44.538+0000 7fa329ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:44.694 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:53:44.538+0000 7fa329ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:44.694 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:53:44.539+0000 7fa448e0f800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:53:44.694 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:53:44.539+0000 7fa448e0f800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:53:44.694 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:53:44.539+0000 7fa448e0f800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:53:44.694 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:53:44.539+0000 7fa448e0f800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:53:44.694 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:53:44.542+0000 7fa448e0f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa448e0f800 time 2024-09-12T17:53:44.543132+0000 2024-09-12T17:53:44.694 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:53:44.694 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.694 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:44.694 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa44c38c71a] 2024-09-12T17:53:44.695 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa44c38c8d8] 2024-09-12T17:53:44.695 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af9b056841] 2024-09-12T17:53:44.695 INFO:tasks.workunit.client.0.smithi107.stderr: 4: radosgw-admin(+0xd7490c) [0x55af9b56490c] 2024-09-12T17:53:44.695 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af9b06650d] 2024-09-12T17:53:44.695 INFO:tasks.workunit.client.0.smithi107.stderr: 6: main() 2024-09-12T17:53:44.695 INFO:tasks.workunit.client.0.smithi107.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa44b029590] 2024-09-12T17:53:44.695 INFO:tasks.workunit.client.0.smithi107.stderr: 8: __libc_start_main() 2024-09-12T17:53:44.695 INFO:tasks.workunit.client.0.smithi107.stderr: 9: _start() 2024-09-12T17:53:44.695 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.695 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:53:44.543+0000 7fa448e0f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:53:44.695 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7fa448e0f800 thread_name:radosgw-admin 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa44b03e6f0] 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa44b08b99c] 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa44c38c774] 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa44c38c8d8] 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af9b056841] 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 8: radosgw-admin(+0xd7490c) [0x55af9b56490c] 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af9b06650d] 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 10: main() 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa44b029590] 2024-09-12T17:53:44.696 INFO:tasks.workunit.client.0.smithi107.stderr: 12: __libc_start_main() 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: 13: _start() 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:53:44.697 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:53:44.698 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:53:44.699 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:53:44.700 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:53:44.701 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:53:44.702 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:53:44.703 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa275ffb640 / http_manager 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa277fff640 / http_manager 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa2fd7e2640 / rgw_dt_lg_renew 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa328ff9640 / ms_dispatch 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa329ffb640 / io_context_pool 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa32a7fc640 / io_context_pool 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa330e01640 / ms_dispatch 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa333606640 / ms_dispatch 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa334e09640 / io_context_pool 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa43ffff640 / msgr-worker-2 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa4468f9640 / msgr-worker-1 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa4470fa640 / msgr-worker-0 2024-09-12T17:53:44.704 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa4478fb640 / io_context_pool 2024-09-12T17:53:44.705 INFO:tasks.workunit.client.0.smithi107.stderr: 7fa448e0f800 / radosgw-admin 2024-09-12T17:53:44.705 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:53:44.705 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:53:44.705 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:53:44.544760Z_f41b6ede-86a4-432b-82fd-62894ca3ea4f/log 2024-09-12T17:53:44.705 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:53:44.705 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.618+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.620+0000 7f54dc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.620+0000 7f54dc810800 20 realm 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.620+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.620+0000 7f54dc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.620+0000 7f54dc810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.620+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.620+0000 7f54dc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.620+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.621+0000 7f54dc810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:44.707 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.621+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.622+0000 7f54dc810800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:44.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.622+0000 7f54dc810800 20 searching for the correct realm 2024-09-12T17:53:44.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.625+0000 7f54d86cc640 0 -- 172.21.15.107:0/4117511442 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x555d700f59f0 msgr2=0x555d700f7eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:44.708 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.628+0000 7f54d7ecb640 0 -- 172.21.15.107:0/4117511442 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f54c008e9a0 msgr2=0x7f54c00b42f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:44.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.834+0000 7f54dc810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:44.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.834+0000 7f54dc810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:44.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.834+0000 7f54dc810800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:53:44.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.834+0000 7f54dc810800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:53:44.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.834+0000 7f54dc810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:44.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.834+0000 7f54dc810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:44.836 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.834+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.834+0000 7f54dc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.834+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.834+0000 7f54dc810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.834+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 20 zone default found 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 4 Realm: () 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 20 zonegroup default 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.837 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:44.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 20 started sync module instance, tier type = 2024-09-12T17:53:44.838 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.835+0000 7f54dc810800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:53:44.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.846+0000 7f54dc810800 20 add_watcher() i=0 2024-09-12T17:53:44.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.846+0000 7f54dc810800 20 add_watcher() i=1 2024-09-12T17:53:44.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.846+0000 7f54dc810800 20 add_watcher() i=2 2024-09-12T17:53:44.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.846+0000 7f54dc810800 20 add_watcher() i=3 2024-09-12T17:53:44.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.846+0000 7f54dc810800 20 add_watcher() i=4 2024-09-12T17:53:44.847 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.846+0000 7f54dc810800 20 add_watcher() i=5 2024-09-12T17:53:44.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.846+0000 7f54dc810800 20 add_watcher() i=6 2024-09-12T17:53:44.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.847+0000 7f54dc810800 20 add_watcher() i=7 2024-09-12T17:53:44.848 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.847+0000 7f54dc810800 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:44.849 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.848+0000 7f538e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:44.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.849+0000 7f54dc810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:44.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.849+0000 7f54dc810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:44.850 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.849+0000 7f54dc810800 5 note: GC not initialized 2024-09-12T17:53:44.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.849+0000 7f538d7e2640 20 reqs_thread_entry: start 2024-09-12T17:53:44.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.849+0000 7f54dc810800 20 init_complete bucket index max shards: 1 2024-09-12T17:53:44.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.849+0000 7f54dc810800 20 Filter name: none 2024-09-12T17:53:44.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.849+0000 7f53867fc640 20 reqs_thread_entry: start 2024-09-12T17:53:44.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.849+0000 7f54dc810800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:53:44.851 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.849+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.852 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:53:44.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:53:44.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:53:44.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:53:44.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 20 rados->read ofs=0 len=0 2024-09-12T17:53:44.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:53:44.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:53:44.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:53:44.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:44.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:53:44.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:53:44.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:53:44.853 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.850+0000 7f54dc810800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:53:44.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.851+0000 7f54dc810800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:53:44.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.851+0000 7f54dc810800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:53:44.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.851+0000 7f54dc810800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:53:44.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.851+0000 7f54dc810800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:53:44.854 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.852+0000 7f538e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:44.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.855+0000 7f54dc810800 20 remove_watcher() i=0 2024-09-12T17:53:44.855 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.855+0000 7f54dc810800 2 removed watcher, disabling cache 2024-09-12T17:53:44.857 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.856+0000 7f54dc810800 20 remove_watcher() i=1 2024-09-12T17:53:44.858 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.857+0000 7f54dc810800 20 remove_watcher() i=2 2024-09-12T17:53:44.859 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.858+0000 7f54dc810800 20 remove_watcher() i=3 2024-09-12T17:53:44.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.859+0000 7f54dc810800 20 remove_watcher() i=4 2024-09-12T17:53:44.861 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.860+0000 7f54dc810800 20 remove_watcher() i=5 2024-09-12T17:53:44.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.861+0000 7f54dc810800 20 remove_watcher() i=6 2024-09-12T17:53:44.863 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:53:44.862+0000 7f54dc810800 20 remove_watcher() i=7 2024-09-12T17:53:44.873 INFO:tasks.workunit.client.0.smithi107.stderr: test: duplicated entries can be purged manually 2024-09-12T17:54:14.891 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:54:14.923 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:14.923 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:14.965 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.963+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:14.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.965+0000 7f51c292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:14.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.965+0000 7f51c292c800 20 realm 2024-09-12T17:54:14.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.965+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:14.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.966+0000 7f51c292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:14.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.966+0000 7f51c292c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:14.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.966+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:14.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.966+0000 7f51c292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:14.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.966+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:14.967 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.967+0000 7f51c292c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:14.968 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.967+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:14.968 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.967+0000 7f51c292c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:14.968 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.967+0000 7f51c292c800 20 searching for the correct realm 2024-09-12T17:54:14.972 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.971+0000 7f51bee50640 0 -- 172.21.15.107:0/298827844 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x557ba683d860 msgr2=0x557ba683fcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:14.975 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.974+0000 7f51be64f640 0 -- 172.21.15.107:0/298827844 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f51b407d920 msgr2=0x7f51b4088400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:15.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.979+0000 7f51c292c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:15.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.979+0000 7f51c292c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:15.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.979+0000 7f51c292c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:15.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.979+0000 7f51c292c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:15.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.979+0000 7f51c292c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:15.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.979+0000 7f51c292c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:15.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.979+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.046 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.979+0000 7f51c292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.979+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.979+0000 7f51c292c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:15.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.979+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:15.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 20 zone default found 2024-09-12T17:54:15.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 4 Realm: () 2024-09-12T17:54:15.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:15.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:15.047 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:15.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 20 zonegroup default 2024-09-12T17:54:15.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.980+0000 7f51c292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.981+0000 7f51c292c800 20 started sync module instance, tier type = 2024-09-12T17:54:15.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.981+0000 7f51c292c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:15.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.990+0000 7f51c292c800 20 add_watcher() i=0 2024-09-12T17:54:15.048 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.990+0000 7f51c292c800 20 add_watcher() i=1 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.990+0000 7f51c292c800 20 add_watcher() i=2 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.990+0000 7f51c292c800 20 add_watcher() i=3 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.990+0000 7f51c292c800 20 add_watcher() i=4 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.990+0000 7f51c292c800 20 add_watcher() i=5 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.990+0000 7f51c292c800 20 add_watcher() i=6 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.991+0000 7f51c292c800 20 add_watcher() i=7 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.991+0000 7f51c292c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.993+0000 7f5074fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.994+0000 7f51c292c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.994+0000 7f51c292c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.994+0000 7f51c292c800 5 note: GC not initialized 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.994+0000 7f4fef7fe640 20 reqs_thread_entry: start 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.994+0000 7f51c292c800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:15.049 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.994+0000 7f51c292c800 20 Filter name: none 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.994+0000 7f4fed7fa640 20 reqs_thread_entry: start 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.994+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.995+0000 7f51c292c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.995+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.995+0000 7f51c292c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.995+0000 7f51c292c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.995+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.995+0000 7f51c292c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.995+0000 7f51c292c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.996+0000 7f51c292c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.996+0000 7f51c292c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:14.998+0000 7f5074fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.000+0000 7f51c292c800 20 remove_watcher() i=0 2024-09-12T17:54:15.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.000+0000 7f51c292c800 2 removed watcher, disabling cache 2024-09-12T17:54:15.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.001+0000 7f51c292c800 20 remove_watcher() i=1 2024-09-12T17:54:15.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.003+0000 7f51c292c800 20 remove_watcher() i=2 2024-09-12T17:54:15.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.004+0000 7f51c292c800 20 remove_watcher() i=3 2024-09-12T17:54:15.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.005+0000 7f51c292c800 20 remove_watcher() i=4 2024-09-12T17:54:15.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.006+0000 7f51c292c800 20 remove_watcher() i=5 2024-09-12T17:54:15.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.007+0000 7f51c292c800 20 remove_watcher() i=6 2024-09-12T17:54:15.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.007+0000 7f51c292c800 20 remove_watcher() i=7 2024-09-12T17:54:15.051 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.051 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:54:15.051 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: a-bucket id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-12T17:54:15.051 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.052 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:54:15.055 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:15.055 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:15.092 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.090+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.092+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.092+0000 7f9937335800 20 realm 2024-09-12T17:54:15.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.092+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.093 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.092+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.092+0000 7f9937335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:15.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.092+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.092+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.094 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.092+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.093+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:15.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.093+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.094+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:15.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.094+0000 7f9937335800 20 searching for the correct realm 2024-09-12T17:54:15.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.097+0000 7f99338e5640 0 -- 172.21.15.107:0/1782678578 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5577535f60c0 msgr2=0x5577535f8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:15.101 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.100+0000 7f99330e4640 0 -- 172.21.15.107:0/1782678578 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f991c07a420 msgr2=0x7f991c07a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:15.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:15.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:15.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:15.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:15.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:15.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:15.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.104+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.104+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.104+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.105+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:15.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.105+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.105+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:15.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.105+0000 7f9937335800 20 zone default found 2024-09-12T17:54:15.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.105+0000 7f9937335800 4 Realm: () 2024-09-12T17:54:15.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.105+0000 7f9937335800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:15.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.105+0000 7f9937335800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:15.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.105+0000 7f9937335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:15.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.105+0000 7f9937335800 20 zonegroup default 2024-09-12T17:54:15.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.105+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.105+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.105+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.106+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.106+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.106+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.106+0000 7f9937335800 20 started sync module instance, tier type = 2024-09-12T17:54:15.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.106+0000 7f9937335800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:15.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=0 2024-09-12T17:54:15.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=1 2024-09-12T17:54:15.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=2 2024-09-12T17:54:15.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=3 2024-09-12T17:54:15.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=4 2024-09-12T17:54:15.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=5 2024-09-12T17:54:15.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=6 2024-09-12T17:54:15.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.116+0000 7f9937335800 20 add_watcher() i=7 2024-09-12T17:54:15.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.116+0000 7f9937335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:15.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.117+0000 7f97e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:15.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.118+0000 7f9937335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:15.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.118+0000 7f9937335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:15.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.118+0000 7f9937335800 5 note: GC not initialized 2024-09-12T17:54:15.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.118+0000 7f97e8fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:15.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.118+0000 7f9937335800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:15.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.118+0000 7f9937335800 20 Filter name: none 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.118+0000 7f97627fc640 20 reqs_thread_entry: start 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.118+0000 7f9937335800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.118+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.119+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.119+0000 7f9937335800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.119+0000 7f9937335800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.119+0000 7f9937335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.119+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.119+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.119+0000 7f9937335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.119+0000 7f9937335800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.119+0000 7f9937335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:15.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.119+0000 7f9937335800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:15.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.119+0000 7f9937335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:54:15.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.120+0000 7f9937335800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:54:15.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.124+0000 7f9937335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:15.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.124+0000 7f9937335800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:15.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.124+0000 7f9937335800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:15.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.124+0000 7f9937335800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:54:15.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.124+0000 7f9816ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 93970988244144 notifier 7817 bl.length()=911 2024-09-12T17:54:15.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.125+0000 7f9816ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:15.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.125+0000 7f9816ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:15.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.125+0000 7f9816ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:15.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.125+0000 7f9937335800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:54:15.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.125+0000 7f9937335800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:54:15.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.125+0000 7f9937335800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:54:15.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.125+0000 7f9937335800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:54:15.129 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9937335800 time 2024-09-12T17:54:15.129487+0000 2024-09-12T17:54:15.129 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:54:15.130 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:54:15.130 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9938b8c71a] 2024-09-12T17:54:15.130 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9938b8c8d8] 2024-09-12T17:54:15.130 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577524f9841] 2024-09-12T17:54:15.130 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55775250957a] 2024-09-12T17:54:15.130 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:54:15.130 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9937829590] 2024-09-12T17:54:15.130 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:54:15.130 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:54:15.130 INFO:tasks.workunit.client.0.smithi107.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:54:15.131 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f9937335800 thread_name:radosgw-admin 2024-09-12T17:54:15.131 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.129+0000 7f9937335800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9937335800 time 2024-09-12T17:54:15.129487+0000 2024-09-12T17:54:15.131 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:54:15.131 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.131 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:54:15.131 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9938b8c71a] 2024-09-12T17:54:15.131 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9938b8c8d8] 2024-09-12T17:54:15.131 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577524f9841] 2024-09-12T17:54:15.131 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55775250957a] 2024-09-12T17:54:15.131 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:54:15.132 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9937829590] 2024-09-12T17:54:15.132 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:54:15.132 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:54:15.132 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.163 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:54:15.163 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f993783e6f0] 2024-09-12T17:54:15.163 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f993788b99c] 2024-09-12T17:54:15.164 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:54:15.164 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:54:15.164 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9938b8c774] 2024-09-12T17:54:15.164 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9938b8c8d8] 2024-09-12T17:54:15.164 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577524f9841] 2024-09-12T17:54:15.164 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55775250957a] 2024-09-12T17:54:15.164 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:54:15.165 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9937829590] 2024-09-12T17:54:15.165 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:54:15.165 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:54:15.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.129+0000 7f9937335800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:54:15.165 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f9937335800 thread_name:radosgw-admin 2024-09-12T17:54:15.165 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.165 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:54:15.165 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f993783e6f0] 2024-09-12T17:54:15.165 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f993788b99c] 2024-09-12T17:54:15.165 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:54:15.165 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:54:15.165 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9938b8c774] 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9938b8c8d8] 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577524f9841] 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55775250957a] 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9937829590] 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: dump: 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.166 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.167 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.167 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.167 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.167 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.167 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.167 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.167 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.167 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.168 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: _finish_auth 0 2024-09-12T17:54:15.168 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: _check_auth_tickets 2024-09-12T17:54:15.168 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:54:15.168 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.168 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:54:15.168 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: dump: 2024-09-12T17:54:15.169 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.169 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.169 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.169 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.169 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.169 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.170 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.171 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.171 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.171 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.171 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:54:15.073+0000 7f9937335800 5 monclient: authenticate success, global_id 7805 2024-09-12T17:54:15.171 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:54:15.073+0000 7f9937335800 10 monclient: get_monmap_and_config success 2024-09-12T17:54:15.171 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:54:15.073+0000 7f9937335800 4 set_mon_vals no callback set 2024-09-12T17:54:15.172 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:54:15.074+0000 7f9937335800 10 monclient: shutdown 2024-09-12T17:54:15.172 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:54:15.074+0000 7f9937335800 5 asok(0x5577532dd730) unregister_commands rotate-key 2024-09-12T17:54:15.173 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:54:15.074+0000 7f9937335800 10 monclient: build_initial_monmap 2024-09-12T17:54:15.173 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:54:15.074+0000 7f9937335800 1 build_initial for_mkfs: 0 2024-09-12T17:54:15.173 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:54:15.074+0000 7f9937335800 10 monclient: monmap: 2024-09-12T17:54:15.173 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:54:15.173 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:54:15.173 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:54:15.174 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:54:15.174 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:54:15.174 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.174 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:54:15.174 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:54:15.174 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:54:15.175 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.175 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding auth protocol: cephx 2024-09-12T17:54:15.175 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding auth protocol: cephx 2024-09-12T17:54:15.175 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding auth protocol: cephx 2024-09-12T17:54:15.175 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: secure 2024-09-12T17:54:15.175 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: crc 2024-09-12T17:54:15.176 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: secure 2024-09-12T17:54:15.176 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: crc 2024-09-12T17:54:15.176 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: secure 2024-09-12T17:54:15.176 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: crc 2024-09-12T17:54:15.176 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: crc 2024-09-12T17:54:15.176 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: secure 2024-09-12T17:54:15.177 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: crc 2024-09-12T17:54:15.177 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: secure 2024-09-12T17:54:15.177 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: crc 2024-09-12T17:54:15.177 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: secure 2024-09-12T17:54:15.177 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:54:15.075+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.177 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:54:15.075+0000 7f9937335800 1 librados: starting msgr at 2024-09-12T17:54:15.178 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:54:15.075+0000 7f9937335800 1 librados: starting objecter 2024-09-12T17:54:15.178 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:54:15.075+0000 7f9937335800 5 asok(0x5577532dd730) register_command objecter_requests hook 0x557753502cd0 2024-09-12T17:54:15.178 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:54:15.075+0000 7f9937335800 1 librados: setting wanted keys 2024-09-12T17:54:15.178 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:54:15.075+0000 7f9937335800 1 librados: calling monclient init 2024-09-12T17:54:15.178 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient: init 2024-09-12T17:54:15.178 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding auth protocol: cephx 2024-09-12T17:54:15.179 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding auth protocol: cephx 2024-09-12T17:54:15.179 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding auth protocol: cephx 2024-09-12T17:54:15.179 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: secure 2024-09-12T17:54:15.179 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: crc 2024-09-12T17:54:15.179 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: secure 2024-09-12T17:54:15.180 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: crc 2024-09-12T17:54:15.180 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: secure 2024-09-12T17:54:15.180 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: crc 2024-09-12T17:54:15.180 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: crc 2024-09-12T17:54:15.180 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: secure 2024-09-12T17:54:15.180 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: crc 2024-09-12T17:54:15.181 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: secure 2024-09-12T17:54:15.181 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: crc 2024-09-12T17:54:15.181 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: secure 2024-09-12T17:54:15.181 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:54:15.075+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.181 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:54:15.075+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.181 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:54:15.075+0000 7f9937335800 5 asok(0x5577532dd730) register_command rotate-key hook 0x5577534ffcb8 2024-09-12T17:54:15.182 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient: _reopen_session rank -1 2024-09-12T17:54:15.182 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:54:15.182 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): picked mon.noname-c con 0x5577533b6d60 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:54:15.182 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): picked mon.noname-b con 0x557753442cd0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:54:15.183 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): picked mon.noname-a con 0x557753449310 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:54:15.183 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.183 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.183 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.183 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): _renew_subs 2024-09-12T17:54:15.183 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): authenticate will time out at 2259.621747s 2024-09-12T17:54:15.184 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): get_auth_request con 0x5577533b6d60 auth_method 0 2024-09-12T17:54:15.184 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.184 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.184 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.184 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.184 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.185 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.185 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): get_auth_request con 0x557753449310 auth_method 0 2024-09-12T17:54:15.185 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.185 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.185 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.185 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.186 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.186 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.187 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): handle_auth_done global_id 7808 payload 824 2024-09-12T17:54:15.187 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:54:15.076+0000 7f99330e4640 10 monclient: _finish_hunting 0 2024-09-12T17:54:15.187 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:54:15.076+0000 7f99330e4640 1 monclient: found mon.noname-c 2024-09-12T17:54:15.187 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:54:15.076+0000 7f99330e4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.187 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:54:15.076+0000 7f992bfff640 10 monclient: get_auth_request con 0x557753442cd0 auth_method 0 2024-09-12T17:54:15.187 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.187 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:54:15.187 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: dump: 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: _finish_auth 0 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: _check_auth_tickets 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:54:15.188 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: dump: 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.189 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:54:15.076+0000 7f9937335800 5 monclient: authenticate success, global_id 7808 2024-09-12T17:54:15.190 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:54:15.076+0000 7f9937335800 10 monclient: _renew_subs 2024-09-12T17:54:15.190 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:54:15.076+0000 7f9937335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.190 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:54:15.076+0000 7f982160a640 4 set_mon_vals no callback set 2024-09-12T17:54:15.190 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:54:15.076+0000 7f9937335800 10 monclient: _renew_subs 2024-09-12T17:54:15.190 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:54:15.076+0000 7f9937335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.190 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:54:15.076+0000 7f9937335800 1 librados: init done 2024-09-12T17:54:15.190 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:54:15.078+0000 7f981fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:54:15.190 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:54:15.078+0000 7f981fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:54:15.190 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:54:15.078+0000 7f981fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:54:15.190 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:54:15.078+0000 7f992bfff640 10 monclient: get_auth_request con 0x7f9818076470 auth_method 0 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:54:15.078+0000 7f99338e5640 10 monclient: get_auth_request con 0x557753528030 auth_method 0 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:54:15.079+0000 7f99330e4640 10 monclient: get_auth_request con 0x55775354b100 auth_method 0 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:54:15.080+0000 7f992bfff640 10 monclient: get_auth_request con 0x55775354f460 auth_method 0 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:54:15.081+0000 7f9937335800 10 monclient: build_initial_monmap 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:54:15.081+0000 7f9937335800 1 build_initial for_mkfs: 0 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:54:15.081+0000 7f9937335800 10 monclient: monmap: 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:54:15.191 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding auth protocol: cephx 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding auth protocol: cephx 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding auth protocol: cephx 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: secure 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: crc 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: secure 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: crc 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: secure 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: crc 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: crc 2024-09-12T17:54:15.192 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: secure 2024-09-12T17:54:15.193 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: crc 2024-09-12T17:54:15.193 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: secure 2024-09-12T17:54:15.193 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: crc 2024-09-12T17:54:15.193 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: secure 2024-09-12T17:54:15.193 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:54:15.081+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.193 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:54:15.081+0000 7f9937335800 5 asok(0x5577532dd730) register_command objecter_requests cmddesc objecter_requests hook 0x557753557c40 EEXIST 2024-09-12T17:54:15.193 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:54:15.081+0000 7f9937335800 10 monclient: init 2024-09-12T17:54:15.193 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding auth protocol: cephx 2024-09-12T17:54:15.193 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding auth protocol: cephx 2024-09-12T17:54:15.193 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding auth protocol: cephx 2024-09-12T17:54:15.193 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: secure 2024-09-12T17:54:15.193 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: crc 2024-09-12T17:54:15.194 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: secure 2024-09-12T17:54:15.194 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: crc 2024-09-12T17:54:15.194 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: secure 2024-09-12T17:54:15.194 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: crc 2024-09-12T17:54:15.194 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: crc 2024-09-12T17:54:15.194 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: secure 2024-09-12T17:54:15.194 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: crc 2024-09-12T17:54:15.194 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: secure 2024-09-12T17:54:15.194 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: crc 2024-09-12T17:54:15.194 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: secure 2024-09-12T17:54:15.194 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:54:15.082+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.195 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:54:15.082+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.195 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:54:15.082+0000 7f9937335800 5 asok(0x5577532dd730) register_command rotate-key cmddesc rotate-key hook 0x5577535529f0 EEXIST 2024-09-12T17:54:15.195 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient: _reopen_session rank -1 2024-09-12T17:54:15.195 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:54:15.195 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): picked mon.noname-b con 0x55775357b930 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:54:15.195 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): picked mon.noname-c con 0x55775357dc00 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:54:15.195 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): picked mon.noname-a con 0x55775357a100 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:54:15.195 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.195 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.195 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): _renew_subs 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): authenticate will time out at 2259.628497s 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): get_auth_request con 0x55775357a100 auth_method 0 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): get_auth_request con 0x55775357dc00 auth_method 0 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.196 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:54:15.082+0000 7f99330e4640 10 monclient(hunting): get_auth_request con 0x55775357b930 auth_method 0 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:54:15.082+0000 7f99330e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:54:15.082+0000 7f99330e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:54:15.082+0000 7f99330e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): handle_auth_done global_id 8304 payload 824 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient: _finish_hunting 0 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:54:15.082+0000 7f99338e5640 1 monclient: found mon.noname-a 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.197 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: dump: 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: _finish_auth 0 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: _check_auth_tickets 2024-09-12T17:54:15.198 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:54:15.199 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.199 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:54:15.199 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: dump: 2024-09-12T17:54:15.199 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.199 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.199 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.199 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.199 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.199 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.199 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.199 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.199 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:54:15.083+0000 7f9937335800 5 monclient: authenticate success, global_id 8304 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:54:15.083+0000 7f9937335800 10 monclient: _renew_subs 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:54:15.083+0000 7f9937335800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:54:15.083+0000 7f99340e6640 4 set_mon_vals no callback set 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:54:15.083+0000 7f9937335800 10 monclient: _renew_subs 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:54:15.083+0000 7f9937335800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:54:15.084+0000 7f981d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:54:15.084+0000 7f981d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:54:15.084+0000 7f981d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:54:15.085+0000 7f99330e4640 10 monclient: get_auth_request con 0x7f980c076380 auth_method 0 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:54:15.085+0000 7f9937335800 10 monclient: get_monmap_and_config 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:54:15.085+0000 7f9937335800 10 monclient: build_initial_monmap 2024-09-12T17:54:15.200 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:54:15.085+0000 7f9937335800 1 build_initial for_mkfs: 0 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:54:15.085+0000 7f9937335800 10 monclient: monmap: 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding auth protocol: cephx 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding auth protocol: cephx 2024-09-12T17:54:15.201 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding auth protocol: cephx 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: secure 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: crc 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: secure 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: crc 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: secure 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: crc 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: crc 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: secure 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: crc 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: secure 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: crc 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: secure 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:54:15.085+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.202 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:54:15.085+0000 7f9937335800 10 monclient: init 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding auth protocol: cephx 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding auth protocol: cephx 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding auth protocol: cephx 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: secure 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: crc 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: secure 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: crc 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: secure 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: crc 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: crc 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: secure 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: crc 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: secure 2024-09-12T17:54:15.203 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: crc 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: secure 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:54:15.085+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:54:15.086+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:54:15.086+0000 7f9937335800 5 asok(0x5577532dd730) register_command rotate-key cmddesc rotate-key hook 0x7fff686cb368 EEXIST 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient: _reopen_session rank -1 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): picked mon.noname-b con 0x5577535cf990 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): picked mon.noname-a con 0x5577535cfd70 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): picked mon.noname-c con 0x5577535d54c0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.204 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): _renew_subs 2024-09-12T17:54:15.205 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): authenticate will time out at 2259.632188s 2024-09-12T17:54:15.205 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): get_auth_request con 0x5577535cfd70 auth_method 0 2024-09-12T17:54:15.205 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.205 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.205 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.205 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): get_auth_request con 0x5577535d54c0 auth_method 0 2024-09-12T17:54:15.205 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.205 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.205 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.206 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.206 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.206 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.206 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.206 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.206 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.207 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): handle_auth_done global_id 7814 payload 274 2024-09-12T17:54:15.207 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient: _finish_hunting 0 2024-09-12T17:54:15.207 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:54:15.086+0000 7f99338e5640 1 monclient: found mon.noname-c 2024-09-12T17:54:15.207 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.207 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.207 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:54:15.207 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: dump: 2024-09-12T17:54:15.207 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.208 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.208 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.208 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.208 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.208 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.208 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.208 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.208 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.209 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.209 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: _finish_auth 0 2024-09-12T17:54:15.209 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:54:15.209 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:54:15.209 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:54:15.086+0000 7f9937335800 5 monclient: authenticate success, global_id 7814 2024-09-12T17:54:15.209 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient: get_monmap_and_config success 2024-09-12T17:54:15.209 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:54:15.086+0000 7f9937335800 4 set_mon_vals no callback set 2024-09-12T17:54:15.209 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.210 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:54:15.210 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: dump: 2024-09-12T17:54:15.210 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.210 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.210 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.210 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.210 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.210 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.211 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.211 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.211 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.211 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.211 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:54:15.087+0000 7f9937335800 10 monclient: shutdown 2024-09-12T17:54:15.211 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:54:15.087+0000 7f9937335800 10 monclient: build_initial_monmap 2024-09-12T17:54:15.212 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:54:15.087+0000 7f9937335800 1 build_initial for_mkfs: 0 2024-09-12T17:54:15.212 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:54:15.087+0000 7f9937335800 10 monclient: monmap: 2024-09-12T17:54:15.213 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:54:15.213 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:54:15.213 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:54:15.213 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:54:15.213 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:54:15.213 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.213 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:54:15.213 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:54:15.214 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:54:15.214 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.214 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding auth protocol: cephx 2024-09-12T17:54:15.214 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding auth protocol: cephx 2024-09-12T17:54:15.214 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding auth protocol: cephx 2024-09-12T17:54:15.214 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: secure 2024-09-12T17:54:15.215 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: crc 2024-09-12T17:54:15.215 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: secure 2024-09-12T17:54:15.215 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: crc 2024-09-12T17:54:15.215 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: secure 2024-09-12T17:54:15.215 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: crc 2024-09-12T17:54:15.215 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: crc 2024-09-12T17:54:15.215 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: secure 2024-09-12T17:54:15.215 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: crc 2024-09-12T17:54:15.215 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: secure 2024-09-12T17:54:15.216 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: crc 2024-09-12T17:54:15.216 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: secure 2024-09-12T17:54:15.216 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:54:15.087+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.216 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:54:15.087+0000 7f9937335800 1 librados: starting msgr at 2024-09-12T17:54:15.216 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:54:15.087+0000 7f9937335800 1 librados: starting objecter 2024-09-12T17:54:15.216 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:54:15.087+0000 7f9937335800 5 asok(0x5577532dd730) register_command objecter_requests cmddesc objecter_requests hook 0x55775357ec60 EEXIST 2024-09-12T17:54:15.216 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:54:15.087+0000 7f9937335800 1 librados: setting wanted keys 2024-09-12T17:54:15.216 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:54:15.087+0000 7f9937335800 1 librados: calling monclient init 2024-09-12T17:54:15.217 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:54:15.087+0000 7f9937335800 10 monclient: init 2024-09-12T17:54:15.217 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding auth protocol: cephx 2024-09-12T17:54:15.217 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding auth protocol: cephx 2024-09-12T17:54:15.217 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding auth protocol: cephx 2024-09-12T17:54:15.217 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: secure 2024-09-12T17:54:15.217 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: crc 2024-09-12T17:54:15.217 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: secure 2024-09-12T17:54:15.217 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: crc 2024-09-12T17:54:15.218 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: secure 2024-09-12T17:54:15.218 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: crc 2024-09-12T17:54:15.218 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: crc 2024-09-12T17:54:15.218 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: secure 2024-09-12T17:54:15.218 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: crc 2024-09-12T17:54:15.218 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: secure 2024-09-12T17:54:15.218 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: crc 2024-09-12T17:54:15.218 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: secure 2024-09-12T17:54:15.219 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:54:15.088+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.219 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:54:15.088+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.219 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:54:15.088+0000 7f9937335800 5 asok(0x5577532dd730) register_command rotate-key cmddesc rotate-key hook 0x557753593828 EEXIST 2024-09-12T17:54:15.219 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient: _reopen_session rank -1 2024-09-12T17:54:15.219 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:54:15.220 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): picked mon.noname-b con 0x5577535cf990 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:54:15.220 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): picked mon.noname-a con 0x5577535d54c0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:54:15.220 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): picked mon.noname-c con 0x55775359d230 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:54:15.220 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.220 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.220 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.220 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): _renew_subs 2024-09-12T17:54:15.220 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): authenticate will time out at 2259.634308s 2024-09-12T17:54:15.220 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): get_auth_request con 0x5577535d54c0 auth_method 0 2024-09-12T17:54:15.220 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.221 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.221 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.221 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): get_auth_request con 0x55775359d230 auth_method 0 2024-09-12T17:54:15.221 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.221 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.221 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.221 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.221 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.222 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.222 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.222 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.222 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.222 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): get_auth_request con 0x5577535cf990 auth_method 0 2024-09-12T17:54:15.222 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.222 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.222 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.222 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.222 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.222 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.223 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): handle_auth_done global_id 7817 payload 824 2024-09-12T17:54:15.223 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient: _finish_hunting 0 2024-09-12T17:54:15.223 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:54:15.088+0000 7f99338e5640 1 monclient: found mon.noname-c 2024-09-12T17:54:15.223 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.223 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.223 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:54:15.223 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: dump: 2024-09-12T17:54:15.224 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.224 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.224 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.224 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.224 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.224 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: _finish_auth 0 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: _check_auth_tickets 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: dump: 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.225 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:54:15.088+0000 7f9937335800 5 monclient: authenticate success, global_id 7817 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient: _renew_subs 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:54:15.088+0000 7f9816ffd640 4 set_mon_vals no callback set 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient: _renew_subs 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:54:15.089+0000 7f9937335800 1 librados: init done 2024-09-12T17:54:15.226 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:54:15.089+0000 7f9937335800 5 asok(0x5577532dd730) register_command cr dump hook 0x5577535dce38 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:54:15.090+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:54:15.091+0000 7f98157fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:54:15.091+0000 7f98157fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:54:15.091+0000 7f98157fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:54:15.091+0000 7f99330e4640 10 monclient: get_auth_request con 0x7f97fc076470 auth_method 0 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:54:15.091+0000 7f992bfff640 10 monclient: get_auth_request con 0x5577535e98a0 auth_method 0 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:54:15.092+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:54:15.092+0000 7f9937335800 20 realm 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:54:15.092+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:54:15.092+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:54:15.092+0000 7f9937335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:54:15.092+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:54:15.092+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.227 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:54:15.092+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.228 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:54:15.092+0000 7f99330e4640 10 monclient: get_auth_request con 0x5577535edc60 auth_method 0 2024-09-12T17:54:15.228 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:54:15.093+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:15.228 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:54:15.093+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.228 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:54:15.093+0000 7f992bfff640 10 monclient: get_auth_request con 0x5577535f13c0 auth_method 0 2024-09-12T17:54:15.228 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:54:15.094+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:15.228 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:54:15.094+0000 7f9937335800 20 searching for the correct realm 2024-09-12T17:54:15.228 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:54:15.094+0000 7f99338e5640 10 monclient: get_auth_request con 0x5577535f60c0 auth_method 0 2024-09-12T17:54:15.228 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:54:15.095+0000 7f99330e4640 10 monclient: get_auth_request con 0x7f992c017020 auth_method 0 2024-09-12T17:54:15.228 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:54:15.096+0000 7f992bfff640 10 monclient: get_auth_request con 0x7f991c07a040 auth_method 0 2024-09-12T17:54:15.228 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:54:15.097+0000 7f99338e5640 0 -- 172.21.15.107:0/1782678578 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5577535f60c0 msgr2=0x5577535f8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:15.228 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:54:15.097+0000 7f98157fa640 1 client.7817.objecter ms_handle_reset 0x5577535f60c0 session 0x5577535f5a40 osd.3 2024-09-12T17:54:15.228 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:54:15.097+0000 7f98157fa640 10 monclient: _renew_subs 2024-09-12T17:54:15.229 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:54:15.097+0000 7f98157fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.229 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:54:15.097+0000 7f99338e5640 10 monclient: get_auth_request con 0x7f97fc086b20 auth_method 0 2024-09-12T17:54:15.229 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:54:15.097+0000 7f99338e5640 10 monclient: get_auth_request con 0x7f991c056980 auth_method 0 2024-09-12T17:54:15.229 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:54:15.100+0000 7f99330e4640 10 monclient: get_auth_request con 0x7f991c07a420 auth_method 0 2024-09-12T17:54:15.229 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:54:15.100+0000 7f99330e4640 0 -- 172.21.15.107:0/1782678578 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f991c07a420 msgr2=0x7f991c07a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:15.229 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:54:15.100+0000 7f98157fa640 1 client.7817.objecter ms_handle_reset 0x7f991c07a420 session 0x7f991c06ce00 osd.0 2024-09-12T17:54:15.229 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:54:15.100+0000 7f99330e4640 10 monclient: get_auth_request con 0x5577535f60c0 auth_method 0 2024-09-12T17:54:15.229 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:15.229 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:15.229 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:15.229 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:15.230 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:15.230 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:15.230 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:54:15.104+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.230 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:54:15.104+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.230 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:54:15.104+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.230 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:54:15.105+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:15.230 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:54:15.105+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.230 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:54:15.105+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:15.230 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:54:15.105+0000 7f9937335800 20 zone default found 2024-09-12T17:54:15.231 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:54:15.105+0000 7f9937335800 4 Realm: () 2024-09-12T17:54:15.231 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:54:15.105+0000 7f9937335800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:15.231 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:54:15.105+0000 7f9937335800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:15.231 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:54:15.105+0000 7f9937335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:15.231 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:54:15.105+0000 7f9937335800 20 zonegroup default 2024-09-12T17:54:15.231 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:54:15.105+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.231 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:54:15.105+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.231 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:54:15.105+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.231 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:54:15.106+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.232 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:54:15.106+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.232 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:54:15.106+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.232 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:54:15.106+0000 7f9937335800 20 started sync module instance, tier type = 2024-09-12T17:54:15.232 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:54:15.106+0000 7f9937335800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:15.232 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=0 2024-09-12T17:54:15.232 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=1 2024-09-12T17:54:15.232 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=2 2024-09-12T17:54:15.232 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=3 2024-09-12T17:54:15.232 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=4 2024-09-12T17:54:15.233 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=5 2024-09-12T17:54:15.233 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=6 2024-09-12T17:54:15.233 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:54:15.116+0000 7f9937335800 20 add_watcher() i=7 2024-09-12T17:54:15.233 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:54:15.116+0000 7f9937335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:15.233 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding auth protocol: cephx 2024-09-12T17:54:15.233 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding auth protocol: cephx 2024-09-12T17:54:15.233 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding auth protocol: cephx 2024-09-12T17:54:15.233 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: secure 2024-09-12T17:54:15.234 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: crc 2024-09-12T17:54:15.234 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: secure 2024-09-12T17:54:15.234 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: crc 2024-09-12T17:54:15.234 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: secure 2024-09-12T17:54:15.234 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: crc 2024-09-12T17:54:15.234 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: crc 2024-09-12T17:54:15.234 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: secure 2024-09-12T17:54:15.234 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: crc 2024-09-12T17:54:15.235 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: secure 2024-09-12T17:54:15.235 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:54:15.117+0000 7f97e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:15.235 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: crc 2024-09-12T17:54:15.235 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: secure 2024-09-12T17:54:15.235 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:54:15.118+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.235 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:54:15.118+0000 7f9937335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:15.235 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:54:15.118+0000 7f9937335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:15.235 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command cache list hook 0x5577535c62a0 2024-09-12T17:54:15.236 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command cache inspect hook 0x5577535c62a0 2024-09-12T17:54:15.236 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command cache erase hook 0x5577535c62a0 2024-09-12T17:54:15.236 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command cache zap hook 0x5577535c62a0 2024-09-12T17:54:15.236 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:54:15.118+0000 7f9937335800 5 note: GC not initialized 2024-09-12T17:54:15.236 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:54:15.118+0000 7f97e8fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:15.236 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command sync trace show hook 0x7f9924064040 2024-09-12T17:54:15.236 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command sync trace history hook 0x7f9924064040 2024-09-12T17:54:15.236 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command sync trace active hook 0x7f9924064040 2024-09-12T17:54:15.237 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command sync trace active_short hook 0x7f9924064040 2024-09-12T17:54:15.237 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:54:15.118+0000 7f9937335800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:15.237 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:54:15.118+0000 7f9937335800 20 Filter name: none 2024-09-12T17:54:15.237 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:54:15.118+0000 7f97627fc640 20 reqs_thread_entry: start 2024-09-12T17:54:15.237 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:54:15.118+0000 7f9937335800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:54:15.237 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:54:15.118+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.238 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:54:15.119+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:15.238 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:54:15.119+0000 7f9937335800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:54:15.238 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:54:15.119+0000 7f9937335800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:54:15.238 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:54:15.119+0000 7f9937335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:54:15.239 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:54:15.119+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.239 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:54:15.119+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:54:15.239 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:54:15.119+0000 7f9937335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:15.239 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:54:15.119+0000 7f9937335800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:15.239 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:54:15.119+0000 7f9937335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:15.239 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:54:15.119+0000 7f9937335800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:15.239 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:54:15.119+0000 7f9937335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:54:15.240 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:54:15.120+0000 7f9937335800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:54:15.240 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:54:15.124+0000 7f9937335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:15.240 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:54:15.124+0000 7f9937335800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:15.240 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:54:15.124+0000 7f9937335800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:15.240 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:54:15.124+0000 7f9937335800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:54:15.240 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:54:15.124+0000 7f9816ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 93970988244144 notifier 7817 bl.length()=911 2024-09-12T17:54:15.241 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:54:15.125+0000 7f9816ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:15.241 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:54:15.125+0000 7f9816ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:15.241 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:54:15.125+0000 7f9816ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:15.241 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:54:15.125+0000 7f9937335800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:54:15.241 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:54:15.125+0000 7f9937335800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:54:15.241 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:54:15.125+0000 7f9937335800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:54:15.241 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:54:15.125+0000 7f9937335800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:54:15.241 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:54:15.129+0000 7f9937335800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9937335800 time 2024-09-12T17:54:15.129487+0000 2024-09-12T17:54:15.242 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:54:15.242 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.242 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:54:15.242 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9938b8c71a] 2024-09-12T17:54:15.242 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9938b8c8d8] 2024-09-12T17:54:15.242 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577524f9841] 2024-09-12T17:54:15.243 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55775250957a] 2024-09-12T17:54:15.243 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:54:15.243 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9937829590] 2024-09-12T17:54:15.243 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:54:15.243 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:54:15.243 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:54:15.129+0000 7f9937335800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f9937335800 thread_name:radosgw-admin 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f993783e6f0] 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f993788b99c] 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9938b8c774] 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9938b8c8d8] 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577524f9841] 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55775250957a] 2024-09-12T17:54:15.244 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9937829590] 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:54:15.245 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:54:15.246 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:54:15.247 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:54:15.247 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:54:15.247 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:54:15.247 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:54:15.247 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:54:15.247 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:54:15.247 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:54:15.247 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:54:15.247 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:54:15.247 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:54:15.247 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:54:15.248 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:54:15.249 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:54:15.250 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:54:15.251 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:54:15.251 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:54:15.251 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:54:15.251 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:54:15.251 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:54:15.251 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:54:15.251 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:54:15.251 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:54:15.251 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:54:15.251 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:54:15.251 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:54:15.252 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:54:15.252 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:54:15.252 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:54:15.252 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:54:15.252 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:54:15.252 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:54:15.252 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:54:15.253 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:54:15.253 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:54:15.253 INFO:tasks.workunit.client.0.smithi107.stderr: 7f97627fc640 / http_manager 2024-09-12T17:54:15.253 INFO:tasks.workunit.client.0.smithi107.stderr: 7f97e8fe1640 / http_manager 2024-09-12T17:54:15.253 INFO:tasks.workunit.client.0.smithi107.stderr: 7f97e9fe3640 / rgw_dt_lg_renew 2024-09-12T17:54:15.253 INFO:tasks.workunit.client.0.smithi107.stderr: 7f98157fa640 / ms_dispatch 2024-09-12T17:54:15.253 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9816ffd640 / io_context_pool 2024-09-12T17:54:15.254 INFO:tasks.workunit.client.0.smithi107.stderr: 7f981d602640 / ms_dispatch 2024-09-12T17:54:15.254 INFO:tasks.workunit.client.0.smithi107.stderr: 7f981fe07640 / ms_dispatch 2024-09-12T17:54:15.254 INFO:tasks.workunit.client.0.smithi107.stderr: 7f982160a640 / io_context_pool 2024-09-12T17:54:15.254 INFO:tasks.workunit.client.0.smithi107.stderr: 7f992bfff640 / msgr-worker-2 2024-09-12T17:54:15.254 INFO:tasks.workunit.client.0.smithi107.stderr: 7f99330e4640 / msgr-worker-1 2024-09-12T17:54:15.254 INFO:tasks.workunit.client.0.smithi107.stderr: 7f99338e5640 / msgr-worker-0 2024-09-12T17:54:15.255 INFO:tasks.workunit.client.0.smithi107.stderr: 7f99340e6640 / io_context_pool 2024-09-12T17:54:15.255 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9937335800 / radosgw-admin 2024-09-12T17:54:15.255 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:54:15.255 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:54:15.255 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/log/ceph/ceph-client.admin.154256.log 2024-09-12T17:54:15.255 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:54:15.255 INFO:tasks.workunit.client.0.smithi107.stderr:--- begin dump of recent events --- 2024-09-12T17:54:15.256 INFO:tasks.workunit.client.0.smithi107.stderr: -499> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: dump: 2024-09-12T17:54:15.256 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.256 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.256 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.256 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.256 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.257 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.257 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.257 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.257 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.257 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.257 INFO:tasks.workunit.client.0.smithi107.stderr: -498> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: _finish_auth 0 2024-09-12T17:54:15.258 INFO:tasks.workunit.client.0.smithi107.stderr: -497> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: _check_auth_tickets 2024-09-12T17:54:15.258 INFO:tasks.workunit.client.0.smithi107.stderr: -496> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:54:15.258 INFO:tasks.workunit.client.0.smithi107.stderr: -495> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.258 INFO:tasks.workunit.client.0.smithi107.stderr: -494> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:54:15.258 INFO:tasks.workunit.client.0.smithi107.stderr: -493> 2024-09-12T17:54:15.073+0000 7f982160a640 10 monclient: dump: 2024-09-12T17:54:15.259 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.259 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.259 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.259 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.259 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.259 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.260 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.260 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.260 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.260 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.260 INFO:tasks.workunit.client.0.smithi107.stderr: -492> 2024-09-12T17:54:15.073+0000 7f9937335800 5 monclient: authenticate success, global_id 7805 2024-09-12T17:54:15.261 INFO:tasks.workunit.client.0.smithi107.stderr: -491> 2024-09-12T17:54:15.073+0000 7f9937335800 10 monclient: get_monmap_and_config success 2024-09-12T17:54:15.261 INFO:tasks.workunit.client.0.smithi107.stderr: -490> 2024-09-12T17:54:15.073+0000 7f9937335800 4 set_mon_vals no callback set 2024-09-12T17:54:15.261 INFO:tasks.workunit.client.0.smithi107.stderr: -489> 2024-09-12T17:54:15.074+0000 7f9937335800 10 monclient: shutdown 2024-09-12T17:54:15.261 INFO:tasks.workunit.client.0.smithi107.stderr: -488> 2024-09-12T17:54:15.074+0000 7f9937335800 5 asok(0x5577532dd730) unregister_commands rotate-key 2024-09-12T17:54:15.261 INFO:tasks.workunit.client.0.smithi107.stderr: -487> 2024-09-12T17:54:15.074+0000 7f9937335800 10 monclient: build_initial_monmap 2024-09-12T17:54:15.262 INFO:tasks.workunit.client.0.smithi107.stderr: -486> 2024-09-12T17:54:15.074+0000 7f9937335800 1 build_initial for_mkfs: 0 2024-09-12T17:54:15.262 INFO:tasks.workunit.client.0.smithi107.stderr: -485> 2024-09-12T17:54:15.074+0000 7f9937335800 10 monclient: monmap: 2024-09-12T17:54:15.262 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:54:15.262 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:54:15.263 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:54:15.263 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:54:15.263 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:54:15.263 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.263 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:54:15.264 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:54:15.264 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:54:15.264 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.264 INFO:tasks.workunit.client.0.smithi107.stderr: -484> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding auth protocol: cephx 2024-09-12T17:54:15.264 INFO:tasks.workunit.client.0.smithi107.stderr: -483> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding auth protocol: cephx 2024-09-12T17:54:15.264 INFO:tasks.workunit.client.0.smithi107.stderr: -482> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding auth protocol: cephx 2024-09-12T17:54:15.265 INFO:tasks.workunit.client.0.smithi107.stderr: -481> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: secure 2024-09-12T17:54:15.265 INFO:tasks.workunit.client.0.smithi107.stderr: -480> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: crc 2024-09-12T17:54:15.265 INFO:tasks.workunit.client.0.smithi107.stderr: -479> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: secure 2024-09-12T17:54:15.265 INFO:tasks.workunit.client.0.smithi107.stderr: -478> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: crc 2024-09-12T17:54:15.265 INFO:tasks.workunit.client.0.smithi107.stderr: -477> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: secure 2024-09-12T17:54:15.266 INFO:tasks.workunit.client.0.smithi107.stderr: -476> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: crc 2024-09-12T17:54:15.266 INFO:tasks.workunit.client.0.smithi107.stderr: -475> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: crc 2024-09-12T17:54:15.266 INFO:tasks.workunit.client.0.smithi107.stderr: -474> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: secure 2024-09-12T17:54:15.266 INFO:tasks.workunit.client.0.smithi107.stderr: -473> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: crc 2024-09-12T17:54:15.266 INFO:tasks.workunit.client.0.smithi107.stderr: -472> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: secure 2024-09-12T17:54:15.266 INFO:tasks.workunit.client.0.smithi107.stderr: -471> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: crc 2024-09-12T17:54:15.267 INFO:tasks.workunit.client.0.smithi107.stderr: -470> 2024-09-12T17:54:15.074+0000 7f9937335800 5 AuthRegistry(0x557753505210) adding con mode: secure 2024-09-12T17:54:15.267 INFO:tasks.workunit.client.0.smithi107.stderr: -469> 2024-09-12T17:54:15.075+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.267 INFO:tasks.workunit.client.0.smithi107.stderr: -468> 2024-09-12T17:54:15.075+0000 7f9937335800 1 librados: starting msgr at 2024-09-12T17:54:15.267 INFO:tasks.workunit.client.0.smithi107.stderr: -467> 2024-09-12T17:54:15.075+0000 7f9937335800 1 librados: starting objecter 2024-09-12T17:54:15.267 INFO:tasks.workunit.client.0.smithi107.stderr: -466> 2024-09-12T17:54:15.075+0000 7f9937335800 5 asok(0x5577532dd730) register_command objecter_requests hook 0x557753502cd0 2024-09-12T17:54:15.267 INFO:tasks.workunit.client.0.smithi107.stderr: -465> 2024-09-12T17:54:15.075+0000 7f9937335800 1 librados: setting wanted keys 2024-09-12T17:54:15.268 INFO:tasks.workunit.client.0.smithi107.stderr: -464> 2024-09-12T17:54:15.075+0000 7f9937335800 1 librados: calling monclient init 2024-09-12T17:54:15.268 INFO:tasks.workunit.client.0.smithi107.stderr: -463> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient: init 2024-09-12T17:54:15.268 INFO:tasks.workunit.client.0.smithi107.stderr: -462> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding auth protocol: cephx 2024-09-12T17:54:15.268 INFO:tasks.workunit.client.0.smithi107.stderr: -461> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding auth protocol: cephx 2024-09-12T17:54:15.268 INFO:tasks.workunit.client.0.smithi107.stderr: -460> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding auth protocol: cephx 2024-09-12T17:54:15.268 INFO:tasks.workunit.client.0.smithi107.stderr: -459> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: secure 2024-09-12T17:54:15.268 INFO:tasks.workunit.client.0.smithi107.stderr: -458> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: crc 2024-09-12T17:54:15.269 INFO:tasks.workunit.client.0.smithi107.stderr: -457> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: secure 2024-09-12T17:54:15.269 INFO:tasks.workunit.client.0.smithi107.stderr: -456> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: crc 2024-09-12T17:54:15.269 INFO:tasks.workunit.client.0.smithi107.stderr: -455> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: secure 2024-09-12T17:54:15.269 INFO:tasks.workunit.client.0.smithi107.stderr: -454> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: crc 2024-09-12T17:54:15.269 INFO:tasks.workunit.client.0.smithi107.stderr: -453> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: crc 2024-09-12T17:54:15.270 INFO:tasks.workunit.client.0.smithi107.stderr: -452> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: secure 2024-09-12T17:54:15.270 INFO:tasks.workunit.client.0.smithi107.stderr: -451> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: crc 2024-09-12T17:54:15.270 INFO:tasks.workunit.client.0.smithi107.stderr: -450> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: secure 2024-09-12T17:54:15.270 INFO:tasks.workunit.client.0.smithi107.stderr: -449> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: crc 2024-09-12T17:54:15.270 INFO:tasks.workunit.client.0.smithi107.stderr: -448> 2024-09-12T17:54:15.075+0000 7f9937335800 5 AuthRegistry(0x5577534ffb70) adding con mode: secure 2024-09-12T17:54:15.270 INFO:tasks.workunit.client.0.smithi107.stderr: -447> 2024-09-12T17:54:15.075+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.271 INFO:tasks.workunit.client.0.smithi107.stderr: -446> 2024-09-12T17:54:15.075+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.271 INFO:tasks.workunit.client.0.smithi107.stderr: -445> 2024-09-12T17:54:15.075+0000 7f9937335800 5 asok(0x5577532dd730) register_command rotate-key hook 0x5577534ffcb8 2024-09-12T17:54:15.271 INFO:tasks.workunit.client.0.smithi107.stderr: -444> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient: _reopen_session rank -1 2024-09-12T17:54:15.271 INFO:tasks.workunit.client.0.smithi107.stderr: -443> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:54:15.271 INFO:tasks.workunit.client.0.smithi107.stderr: -442> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): picked mon.noname-c con 0x5577533b6d60 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:54:15.271 INFO:tasks.workunit.client.0.smithi107.stderr: -441> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): picked mon.noname-b con 0x557753442cd0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:54:15.272 INFO:tasks.workunit.client.0.smithi107.stderr: -440> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): picked mon.noname-a con 0x557753449310 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:54:15.272 INFO:tasks.workunit.client.0.smithi107.stderr: -439> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.272 INFO:tasks.workunit.client.0.smithi107.stderr: -438> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.272 INFO:tasks.workunit.client.0.smithi107.stderr: -437> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.272 INFO:tasks.workunit.client.0.smithi107.stderr: -436> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): _renew_subs 2024-09-12T17:54:15.272 INFO:tasks.workunit.client.0.smithi107.stderr: -435> 2024-09-12T17:54:15.075+0000 7f9937335800 10 monclient(hunting): authenticate will time out at 2259.621747s 2024-09-12T17:54:15.273 INFO:tasks.workunit.client.0.smithi107.stderr: -434> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): get_auth_request con 0x5577533b6d60 auth_method 0 2024-09-12T17:54:15.273 INFO:tasks.workunit.client.0.smithi107.stderr: -433> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.273 INFO:tasks.workunit.client.0.smithi107.stderr: -432> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.273 INFO:tasks.workunit.client.0.smithi107.stderr: -431> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.273 INFO:tasks.workunit.client.0.smithi107.stderr: -430> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.273 INFO:tasks.workunit.client.0.smithi107.stderr: -429> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.274 INFO:tasks.workunit.client.0.smithi107.stderr: -428> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.274 INFO:tasks.workunit.client.0.smithi107.stderr: -427> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): get_auth_request con 0x557753449310 auth_method 0 2024-09-12T17:54:15.274 INFO:tasks.workunit.client.0.smithi107.stderr: -426> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.274 INFO:tasks.workunit.client.0.smithi107.stderr: -425> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.274 INFO:tasks.workunit.client.0.smithi107.stderr: -424> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.274 INFO:tasks.workunit.client.0.smithi107.stderr: -423> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.275 INFO:tasks.workunit.client.0.smithi107.stderr: -422> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.275 INFO:tasks.workunit.client.0.smithi107.stderr: -421> 2024-09-12T17:54:15.075+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.275 INFO:tasks.workunit.client.0.smithi107.stderr: -420> 2024-09-12T17:54:15.075+0000 7f99330e4640 10 monclient(hunting): handle_auth_done global_id 7808 payload 824 2024-09-12T17:54:15.275 INFO:tasks.workunit.client.0.smithi107.stderr: -419> 2024-09-12T17:54:15.076+0000 7f99330e4640 10 monclient: _finish_hunting 0 2024-09-12T17:54:15.275 INFO:tasks.workunit.client.0.smithi107.stderr: -418> 2024-09-12T17:54:15.076+0000 7f99330e4640 1 monclient: found mon.noname-c 2024-09-12T17:54:15.275 INFO:tasks.workunit.client.0.smithi107.stderr: -417> 2024-09-12T17:54:15.076+0000 7f99330e4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.276 INFO:tasks.workunit.client.0.smithi107.stderr: -416> 2024-09-12T17:54:15.076+0000 7f992bfff640 10 monclient: get_auth_request con 0x557753442cd0 auth_method 0 2024-09-12T17:54:15.276 INFO:tasks.workunit.client.0.smithi107.stderr: -415> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.276 INFO:tasks.workunit.client.0.smithi107.stderr: -414> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:54:15.276 INFO:tasks.workunit.client.0.smithi107.stderr: -413> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: dump: 2024-09-12T17:54:15.276 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.276 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.277 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.277 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.277 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.277 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.277 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.277 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.278 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.278 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.278 INFO:tasks.workunit.client.0.smithi107.stderr: -412> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: _finish_auth 0 2024-09-12T17:54:15.278 INFO:tasks.workunit.client.0.smithi107.stderr: -411> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: _check_auth_tickets 2024-09-12T17:54:15.278 INFO:tasks.workunit.client.0.smithi107.stderr: -410> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:54:15.279 INFO:tasks.workunit.client.0.smithi107.stderr: -409> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.279 INFO:tasks.workunit.client.0.smithi107.stderr: -408> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:54:15.279 INFO:tasks.workunit.client.0.smithi107.stderr: -407> 2024-09-12T17:54:15.076+0000 7f981fe07640 10 monclient: dump: 2024-09-12T17:54:15.279 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.279 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.279 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.279 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.280 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.280 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.280 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.280 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.280 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.280 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.280 INFO:tasks.workunit.client.0.smithi107.stderr: -406> 2024-09-12T17:54:15.076+0000 7f9937335800 5 monclient: authenticate success, global_id 7808 2024-09-12T17:54:15.281 INFO:tasks.workunit.client.0.smithi107.stderr: -405> 2024-09-12T17:54:15.076+0000 7f9937335800 10 monclient: _renew_subs 2024-09-12T17:54:15.281 INFO:tasks.workunit.client.0.smithi107.stderr: -404> 2024-09-12T17:54:15.076+0000 7f9937335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.281 INFO:tasks.workunit.client.0.smithi107.stderr: -403> 2024-09-12T17:54:15.076+0000 7f982160a640 4 set_mon_vals no callback set 2024-09-12T17:54:15.281 INFO:tasks.workunit.client.0.smithi107.stderr: -402> 2024-09-12T17:54:15.076+0000 7f9937335800 10 monclient: _renew_subs 2024-09-12T17:54:15.281 INFO:tasks.workunit.client.0.smithi107.stderr: -401> 2024-09-12T17:54:15.076+0000 7f9937335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.281 INFO:tasks.workunit.client.0.smithi107.stderr: -400> 2024-09-12T17:54:15.076+0000 7f9937335800 1 librados: init done 2024-09-12T17:54:15.281 INFO:tasks.workunit.client.0.smithi107.stderr: -399> 2024-09-12T17:54:15.078+0000 7f981fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:54:15.281 INFO:tasks.workunit.client.0.smithi107.stderr: -398> 2024-09-12T17:54:15.078+0000 7f981fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:54:15.282 INFO:tasks.workunit.client.0.smithi107.stderr: -397> 2024-09-12T17:54:15.078+0000 7f981fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:54:15.282 INFO:tasks.workunit.client.0.smithi107.stderr: -396> 2024-09-12T17:54:15.078+0000 7f992bfff640 10 monclient: get_auth_request con 0x7f9818076470 auth_method 0 2024-09-12T17:54:15.282 INFO:tasks.workunit.client.0.smithi107.stderr: -395> 2024-09-12T17:54:15.078+0000 7f99338e5640 10 monclient: get_auth_request con 0x557753528030 auth_method 0 2024-09-12T17:54:15.282 INFO:tasks.workunit.client.0.smithi107.stderr: -394> 2024-09-12T17:54:15.079+0000 7f99330e4640 10 monclient: get_auth_request con 0x55775354b100 auth_method 0 2024-09-12T17:54:15.282 INFO:tasks.workunit.client.0.smithi107.stderr: -393> 2024-09-12T17:54:15.080+0000 7f992bfff640 10 monclient: get_auth_request con 0x55775354f460 auth_method 0 2024-09-12T17:54:15.282 INFO:tasks.workunit.client.0.smithi107.stderr: -392> 2024-09-12T17:54:15.081+0000 7f9937335800 10 monclient: build_initial_monmap 2024-09-12T17:54:15.282 INFO:tasks.workunit.client.0.smithi107.stderr: -391> 2024-09-12T17:54:15.081+0000 7f9937335800 1 build_initial for_mkfs: 0 2024-09-12T17:54:15.282 INFO:tasks.workunit.client.0.smithi107.stderr: -390> 2024-09-12T17:54:15.081+0000 7f9937335800 10 monclient: monmap: 2024-09-12T17:54:15.282 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:54:15.282 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:54:15.282 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:54:15.282 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:54:15.283 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:54:15.283 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.283 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:54:15.283 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:54:15.283 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:54:15.283 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.283 INFO:tasks.workunit.client.0.smithi107.stderr: -389> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding auth protocol: cephx 2024-09-12T17:54:15.283 INFO:tasks.workunit.client.0.smithi107.stderr: -388> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding auth protocol: cephx 2024-09-12T17:54:15.283 INFO:tasks.workunit.client.0.smithi107.stderr: -387> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding auth protocol: cephx 2024-09-12T17:54:15.284 INFO:tasks.workunit.client.0.smithi107.stderr: -386> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: secure 2024-09-12T17:54:15.284 INFO:tasks.workunit.client.0.smithi107.stderr: -385> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: crc 2024-09-12T17:54:15.284 INFO:tasks.workunit.client.0.smithi107.stderr: -384> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: secure 2024-09-12T17:54:15.284 INFO:tasks.workunit.client.0.smithi107.stderr: -383> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: crc 2024-09-12T17:54:15.284 INFO:tasks.workunit.client.0.smithi107.stderr: -382> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: secure 2024-09-12T17:54:15.284 INFO:tasks.workunit.client.0.smithi107.stderr: -381> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: crc 2024-09-12T17:54:15.284 INFO:tasks.workunit.client.0.smithi107.stderr: -380> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: crc 2024-09-12T17:54:15.284 INFO:tasks.workunit.client.0.smithi107.stderr: -379> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: secure 2024-09-12T17:54:15.284 INFO:tasks.workunit.client.0.smithi107.stderr: -378> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: crc 2024-09-12T17:54:15.284 INFO:tasks.workunit.client.0.smithi107.stderr: -377> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: secure 2024-09-12T17:54:15.285 INFO:tasks.workunit.client.0.smithi107.stderr: -376> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: crc 2024-09-12T17:54:15.285 INFO:tasks.workunit.client.0.smithi107.stderr: -375> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535541f0) adding con mode: secure 2024-09-12T17:54:15.285 INFO:tasks.workunit.client.0.smithi107.stderr: -374> 2024-09-12T17:54:15.081+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.285 INFO:tasks.workunit.client.0.smithi107.stderr: -373> 2024-09-12T17:54:15.081+0000 7f9937335800 5 asok(0x5577532dd730) register_command objecter_requests cmddesc objecter_requests hook 0x557753557c40 EEXIST 2024-09-12T17:54:15.285 INFO:tasks.workunit.client.0.smithi107.stderr: -372> 2024-09-12T17:54:15.081+0000 7f9937335800 10 monclient: init 2024-09-12T17:54:15.285 INFO:tasks.workunit.client.0.smithi107.stderr: -371> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding auth protocol: cephx 2024-09-12T17:54:15.285 INFO:tasks.workunit.client.0.smithi107.stderr: -370> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding auth protocol: cephx 2024-09-12T17:54:15.285 INFO:tasks.workunit.client.0.smithi107.stderr: -369> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding auth protocol: cephx 2024-09-12T17:54:15.286 INFO:tasks.workunit.client.0.smithi107.stderr: -368> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: secure 2024-09-12T17:54:15.286 INFO:tasks.workunit.client.0.smithi107.stderr: -367> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: crc 2024-09-12T17:54:15.286 INFO:tasks.workunit.client.0.smithi107.stderr: -366> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: secure 2024-09-12T17:54:15.286 INFO:tasks.workunit.client.0.smithi107.stderr: -365> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: crc 2024-09-12T17:54:15.286 INFO:tasks.workunit.client.0.smithi107.stderr: -364> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: secure 2024-09-12T17:54:15.286 INFO:tasks.workunit.client.0.smithi107.stderr: -363> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: crc 2024-09-12T17:54:15.286 INFO:tasks.workunit.client.0.smithi107.stderr: -362> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: crc 2024-09-12T17:54:15.287 INFO:tasks.workunit.client.0.smithi107.stderr: -361> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: secure 2024-09-12T17:54:15.287 INFO:tasks.workunit.client.0.smithi107.stderr: -360> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: crc 2024-09-12T17:54:15.287 INFO:tasks.workunit.client.0.smithi107.stderr: -359> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: secure 2024-09-12T17:54:15.287 INFO:tasks.workunit.client.0.smithi107.stderr: -358> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: crc 2024-09-12T17:54:15.287 INFO:tasks.workunit.client.0.smithi107.stderr: -357> 2024-09-12T17:54:15.081+0000 7f9937335800 5 AuthRegistry(0x5577535528a8) adding con mode: secure 2024-09-12T17:54:15.287 INFO:tasks.workunit.client.0.smithi107.stderr: -356> 2024-09-12T17:54:15.082+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.287 INFO:tasks.workunit.client.0.smithi107.stderr: -355> 2024-09-12T17:54:15.082+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.287 INFO:tasks.workunit.client.0.smithi107.stderr: -354> 2024-09-12T17:54:15.082+0000 7f9937335800 5 asok(0x5577532dd730) register_command rotate-key cmddesc rotate-key hook 0x5577535529f0 EEXIST 2024-09-12T17:54:15.287 INFO:tasks.workunit.client.0.smithi107.stderr: -353> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient: _reopen_session rank -1 2024-09-12T17:54:15.287 INFO:tasks.workunit.client.0.smithi107.stderr: -352> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -351> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): picked mon.noname-b con 0x55775357b930 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -350> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): picked mon.noname-c con 0x55775357dc00 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -349> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): picked mon.noname-a con 0x55775357a100 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -348> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -347> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -346> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -345> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): _renew_subs 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -344> 2024-09-12T17:54:15.082+0000 7f9937335800 10 monclient(hunting): authenticate will time out at 2259.628497s 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -343> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): get_auth_request con 0x55775357a100 auth_method 0 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -342> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -341> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -340> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.288 INFO:tasks.workunit.client.0.smithi107.stderr: -339> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): get_auth_request con 0x55775357dc00 auth_method 0 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -338> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -337> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -336> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -335> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -334> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -333> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -332> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -331> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -330> 2024-09-12T17:54:15.082+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -329> 2024-09-12T17:54:15.082+0000 7f99330e4640 10 monclient(hunting): get_auth_request con 0x55775357b930 auth_method 0 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -328> 2024-09-12T17:54:15.082+0000 7f99330e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -327> 2024-09-12T17:54:15.082+0000 7f99330e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -326> 2024-09-12T17:54:15.082+0000 7f99330e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.289 INFO:tasks.workunit.client.0.smithi107.stderr: -325> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient(hunting): handle_auth_done global_id 8304 payload 824 2024-09-12T17:54:15.290 INFO:tasks.workunit.client.0.smithi107.stderr: -324> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient: _finish_hunting 0 2024-09-12T17:54:15.290 INFO:tasks.workunit.client.0.smithi107.stderr: -323> 2024-09-12T17:54:15.082+0000 7f99338e5640 1 monclient: found mon.noname-a 2024-09-12T17:54:15.290 INFO:tasks.workunit.client.0.smithi107.stderr: -322> 2024-09-12T17:54:15.082+0000 7f99338e5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.107:3300/0 2024-09-12T17:54:15.290 INFO:tasks.workunit.client.0.smithi107.stderr: -321> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.290 INFO:tasks.workunit.client.0.smithi107.stderr: -320> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:54:15.290 INFO:tasks.workunit.client.0.smithi107.stderr: -319> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: dump: 2024-09-12T17:54:15.290 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.290 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.290 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.290 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.290 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.290 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr: -318> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: _finish_auth 0 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr: -317> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: _check_auth_tickets 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr: -316> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr: -315> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr: -314> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr: -313> 2024-09-12T17:54:15.083+0000 7f981d602640 10 monclient: dump: 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.291 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr: -312> 2024-09-12T17:54:15.083+0000 7f9937335800 5 monclient: authenticate success, global_id 8304 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr: -311> 2024-09-12T17:54:15.083+0000 7f9937335800 10 monclient: _renew_subs 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr: -310> 2024-09-12T17:54:15.083+0000 7f9937335800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr: -309> 2024-09-12T17:54:15.083+0000 7f99340e6640 4 set_mon_vals no callback set 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr: -308> 2024-09-12T17:54:15.083+0000 7f9937335800 10 monclient: _renew_subs 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr: -307> 2024-09-12T17:54:15.083+0000 7f9937335800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.107:3300/0 2024-09-12T17:54:15.292 INFO:tasks.workunit.client.0.smithi107.stderr: -306> 2024-09-12T17:54:15.084+0000 7f981d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr: -305> 2024-09-12T17:54:15.084+0000 7f981d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr: -304> 2024-09-12T17:54:15.084+0000 7f981d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr: -303> 2024-09-12T17:54:15.085+0000 7f99330e4640 10 monclient: get_auth_request con 0x7f980c076380 auth_method 0 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr: -302> 2024-09-12T17:54:15.085+0000 7f9937335800 10 monclient: get_monmap_and_config 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr: -301> 2024-09-12T17:54:15.085+0000 7f9937335800 10 monclient: build_initial_monmap 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr: -300> 2024-09-12T17:54:15.085+0000 7f9937335800 1 build_initial for_mkfs: 0 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr: -299> 2024-09-12T17:54:15.085+0000 7f9937335800 10 monclient: monmap: 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:54:15.293 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.294 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:54:15.294 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:54:15.294 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:54:15.294 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.294 INFO:tasks.workunit.client.0.smithi107.stderr: -298> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding auth protocol: cephx 2024-09-12T17:54:15.294 INFO:tasks.workunit.client.0.smithi107.stderr: -297> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding auth protocol: cephx 2024-09-12T17:54:15.294 INFO:tasks.workunit.client.0.smithi107.stderr: -296> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding auth protocol: cephx 2024-09-12T17:54:15.294 INFO:tasks.workunit.client.0.smithi107.stderr: -295> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: secure 2024-09-12T17:54:15.294 INFO:tasks.workunit.client.0.smithi107.stderr: -294> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: crc 2024-09-12T17:54:15.294 INFO:tasks.workunit.client.0.smithi107.stderr: -293> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: secure 2024-09-12T17:54:15.294 INFO:tasks.workunit.client.0.smithi107.stderr: -292> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: crc 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -291> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: secure 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -290> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: crc 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -289> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: crc 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -288> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: secure 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -287> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: crc 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -286> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: secure 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -285> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: crc 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -284> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x55775359b6d0) adding con mode: secure 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -283> 2024-09-12T17:54:15.085+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -282> 2024-09-12T17:54:15.085+0000 7f9937335800 10 monclient: init 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -281> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding auth protocol: cephx 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -280> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding auth protocol: cephx 2024-09-12T17:54:15.295 INFO:tasks.workunit.client.0.smithi107.stderr: -279> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding auth protocol: cephx 2024-09-12T17:54:15.296 INFO:tasks.workunit.client.0.smithi107.stderr: -278> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: secure 2024-09-12T17:54:15.296 INFO:tasks.workunit.client.0.smithi107.stderr: -277> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: crc 2024-09-12T17:54:15.296 INFO:tasks.workunit.client.0.smithi107.stderr: -276> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: secure 2024-09-12T17:54:15.296 INFO:tasks.workunit.client.0.smithi107.stderr: -275> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: crc 2024-09-12T17:54:15.296 INFO:tasks.workunit.client.0.smithi107.stderr: -274> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: secure 2024-09-12T17:54:15.296 INFO:tasks.workunit.client.0.smithi107.stderr: -273> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: crc 2024-09-12T17:54:15.296 INFO:tasks.workunit.client.0.smithi107.stderr: -272> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: crc 2024-09-12T17:54:15.296 INFO:tasks.workunit.client.0.smithi107.stderr: -271> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: secure 2024-09-12T17:54:15.296 INFO:tasks.workunit.client.0.smithi107.stderr: -270> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: crc 2024-09-12T17:54:15.297 INFO:tasks.workunit.client.0.smithi107.stderr: -269> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: secure 2024-09-12T17:54:15.297 INFO:tasks.workunit.client.0.smithi107.stderr: -268> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: crc 2024-09-12T17:54:15.297 INFO:tasks.workunit.client.0.smithi107.stderr: -267> 2024-09-12T17:54:15.085+0000 7f9937335800 5 AuthRegistry(0x7fff686cb220) adding con mode: secure 2024-09-12T17:54:15.297 INFO:tasks.workunit.client.0.smithi107.stderr: -266> 2024-09-12T17:54:15.085+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.297 INFO:tasks.workunit.client.0.smithi107.stderr: -265> 2024-09-12T17:54:15.086+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.297 INFO:tasks.workunit.client.0.smithi107.stderr: -264> 2024-09-12T17:54:15.086+0000 7f9937335800 5 asok(0x5577532dd730) register_command rotate-key cmddesc rotate-key hook 0x7fff686cb368 EEXIST 2024-09-12T17:54:15.297 INFO:tasks.workunit.client.0.smithi107.stderr: -263> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient: _reopen_session rank -1 2024-09-12T17:54:15.297 INFO:tasks.workunit.client.0.smithi107.stderr: -262> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:54:15.297 INFO:tasks.workunit.client.0.smithi107.stderr: -261> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): picked mon.noname-b con 0x5577535cf990 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:54:15.297 INFO:tasks.workunit.client.0.smithi107.stderr: -260> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): picked mon.noname-a con 0x5577535cfd70 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:54:15.297 INFO:tasks.workunit.client.0.smithi107.stderr: -259> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): picked mon.noname-c con 0x5577535d54c0 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:54:15.297 INFO:tasks.workunit.client.0.smithi107.stderr: -258> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -257> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -256> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -255> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): _renew_subs 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -254> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient(hunting): authenticate will time out at 2259.632188s 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -253> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): get_auth_request con 0x5577535cfd70 auth_method 0 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -252> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -251> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -250> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -249> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): get_auth_request con 0x5577535d54c0 auth_method 0 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -248> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -247> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -246> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.298 INFO:tasks.workunit.client.0.smithi107.stderr: -245> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr: -244> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr: -243> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr: -242> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr: -241> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr: -240> 2024-09-12T17:54:15.086+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr: -239> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient(hunting): handle_auth_done global_id 7814 payload 274 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr: -238> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient: _finish_hunting 0 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr: -237> 2024-09-12T17:54:15.086+0000 7f99338e5640 1 monclient: found mon.noname-c 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr: -236> 2024-09-12T17:54:15.086+0000 7f99338e5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr: -235> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr: -234> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr: -233> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: dump: 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.299 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.300 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.300 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.300 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.300 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.300 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.300 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.300 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.300 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.300 INFO:tasks.workunit.client.0.smithi107.stderr: -232> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: _finish_auth 0 2024-09-12T17:54:15.301 INFO:tasks.workunit.client.0.smithi107.stderr: -231> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:54:15.301 INFO:tasks.workunit.client.0.smithi107.stderr: -230> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:54:15.301 INFO:tasks.workunit.client.0.smithi107.stderr: -229> 2024-09-12T17:54:15.086+0000 7f9937335800 5 monclient: authenticate success, global_id 7814 2024-09-12T17:54:15.301 INFO:tasks.workunit.client.0.smithi107.stderr: -228> 2024-09-12T17:54:15.086+0000 7f9937335800 10 monclient: get_monmap_and_config success 2024-09-12T17:54:15.301 INFO:tasks.workunit.client.0.smithi107.stderr: -227> 2024-09-12T17:54:15.086+0000 7f9937335800 4 set_mon_vals no callback set 2024-09-12T17:54:15.301 INFO:tasks.workunit.client.0.smithi107.stderr: -226> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.301 INFO:tasks.workunit.client.0.smithi107.stderr: -225> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:54:15.301 INFO:tasks.workunit.client.0.smithi107.stderr: -224> 2024-09-12T17:54:15.086+0000 7f9816ffd640 10 monclient: dump: 2024-09-12T17:54:15.301 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.301 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.301 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.301 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr: -223> 2024-09-12T17:54:15.087+0000 7f9937335800 10 monclient: shutdown 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr: -222> 2024-09-12T17:54:15.087+0000 7f9937335800 10 monclient: build_initial_monmap 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr: -221> 2024-09-12T17:54:15.087+0000 7f9937335800 1 build_initial for_mkfs: 0 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr: -220> 2024-09-12T17:54:15.087+0000 7f9937335800 10 monclient: monmap: 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 0 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:54:15.302 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 0.000000 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr:created 0.000000 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 0 (unknown) 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.noname-a 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.noname-c 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr: -219> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding auth protocol: cephx 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr: -218> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding auth protocol: cephx 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr: -217> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding auth protocol: cephx 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr: -216> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: secure 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr: -215> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: crc 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr: -214> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: secure 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr: -213> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: crc 2024-09-12T17:54:15.303 INFO:tasks.workunit.client.0.smithi107.stderr: -212> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: secure 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -211> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: crc 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -210> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: crc 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -209> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: secure 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -208> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: crc 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -207> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: secure 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -206> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: crc 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -205> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535cb270) adding con mode: secure 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -204> 2024-09-12T17:54:15.087+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -203> 2024-09-12T17:54:15.087+0000 7f9937335800 1 librados: starting msgr at 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -202> 2024-09-12T17:54:15.087+0000 7f9937335800 1 librados: starting objecter 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -201> 2024-09-12T17:54:15.087+0000 7f9937335800 5 asok(0x5577532dd730) register_command objecter_requests cmddesc objecter_requests hook 0x55775357ec60 EEXIST 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -200> 2024-09-12T17:54:15.087+0000 7f9937335800 1 librados: setting wanted keys 2024-09-12T17:54:15.304 INFO:tasks.workunit.client.0.smithi107.stderr: -199> 2024-09-12T17:54:15.087+0000 7f9937335800 1 librados: calling monclient init 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -198> 2024-09-12T17:54:15.087+0000 7f9937335800 10 monclient: init 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -197> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding auth protocol: cephx 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -196> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding auth protocol: cephx 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -195> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding auth protocol: cephx 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -194> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: secure 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -193> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: crc 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -192> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: secure 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -191> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: crc 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -190> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: secure 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -189> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: crc 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -188> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: crc 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -187> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: secure 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -186> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: crc 2024-09-12T17:54:15.305 INFO:tasks.workunit.client.0.smithi107.stderr: -185> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: secure 2024-09-12T17:54:15.306 INFO:tasks.workunit.client.0.smithi107.stderr: -184> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: crc 2024-09-12T17:54:15.306 INFO:tasks.workunit.client.0.smithi107.stderr: -183> 2024-09-12T17:54:15.087+0000 7f9937335800 5 AuthRegistry(0x5577535936e0) adding con mode: secure 2024-09-12T17:54:15.306 INFO:tasks.workunit.client.0.smithi107.stderr: -182> 2024-09-12T17:54:15.088+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.306 INFO:tasks.workunit.client.0.smithi107.stderr: -181> 2024-09-12T17:54:15.088+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.306 INFO:tasks.workunit.client.0.smithi107.stderr: -180> 2024-09-12T17:54:15.088+0000 7f9937335800 5 asok(0x5577532dd730) register_command rotate-key cmddesc rotate-key hook 0x557753593828 EEXIST 2024-09-12T17:54:15.306 INFO:tasks.workunit.client.0.smithi107.stderr: -179> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient: _reopen_session rank -1 2024-09-12T17:54:15.306 INFO:tasks.workunit.client.0.smithi107.stderr: -178> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:54:15.306 INFO:tasks.workunit.client.0.smithi107.stderr: -177> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): picked mon.noname-b con 0x5577535cf990 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-12T17:54:15.306 INFO:tasks.workunit.client.0.smithi107.stderr: -176> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): picked mon.noname-a con 0x5577535d54c0 addr [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -175> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): picked mon.noname-c con 0x55775359d230 addr [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -174> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -173> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -172> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): start opening mon connection 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -171> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): _renew_subs 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -170> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient(hunting): authenticate will time out at 2259.634308s 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -169> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): get_auth_request con 0x5577535d54c0 auth_method 0 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -168> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -167> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -166> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -165> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): get_auth_request con 0x55775359d230 auth_method 0 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -164> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.307 INFO:tasks.workunit.client.0.smithi107.stderr: -163> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -162> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -161> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -160> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -159> 2024-09-12T17:54:15.088+0000 7f992bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -158> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -157> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -156> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -155> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): get_auth_request con 0x5577535cf990 auth_method 0 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -154> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -153> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -152> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -151> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:54:15.308 INFO:tasks.workunit.client.0.smithi107.stderr: -150> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr: -149> 2024-09-12T17:54:15.088+0000 7f99330e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr: -148> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient(hunting): handle_auth_done global_id 7817 payload 824 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr: -147> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient: _finish_hunting 0 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr: -146> 2024-09-12T17:54:15.088+0000 7f99338e5640 1 monclient: found mon.noname-c 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr: -145> 2024-09-12T17:54:15.088+0000 7f99338e5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr: -144> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr: -143> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr: -142> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: dump: 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.309 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr: -141> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: _finish_auth 0 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr: -140> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: _check_auth_tickets 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr: -139> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr: -138> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr: -137> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr: -136> 2024-09-12T17:54:15.088+0000 7f98157fa640 10 monclient: dump: 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr:epoch 1 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr:fsid 2daf3ce0-18c7-480c-9839-5cd2a9722806 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr:last_changed 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.310 INFO:tasks.workunit.client.0.smithi107.stderr:created 2024-09-12T17:28:40.913330+0000 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr:min_mon_release 19 (squid) 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr:election_strategy: 1 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr: -135> 2024-09-12T17:54:15.088+0000 7f9937335800 5 monclient: authenticate success, global_id 7817 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr: -134> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient: _renew_subs 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr: -133> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr: -132> 2024-09-12T17:54:15.088+0000 7f9816ffd640 4 set_mon_vals no callback set 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr: -131> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient: _renew_subs 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr: -130> 2024-09-12T17:54:15.088+0000 7f9937335800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr: -129> 2024-09-12T17:54:15.089+0000 7f9937335800 1 librados: init done 2024-09-12T17:54:15.311 INFO:tasks.workunit.client.0.smithi107.stderr: -128> 2024-09-12T17:54:15.089+0000 7f9937335800 5 asok(0x5577532dd730) register_command cr dump hook 0x5577535dce38 2024-09-12T17:54:15.312 INFO:tasks.workunit.client.0.smithi107.stderr: -127> 2024-09-12T17:54:15.090+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.312 INFO:tasks.workunit.client.0.smithi107.stderr: -126> 2024-09-12T17:54:15.091+0000 7f98157fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:54:15.312 INFO:tasks.workunit.client.0.smithi107.stderr: -125> 2024-09-12T17:54:15.091+0000 7f98157fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:54:15.312 INFO:tasks.workunit.client.0.smithi107.stderr: -124> 2024-09-12T17:54:15.091+0000 7f98157fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6808/4088825946,v1:172.21.15.148:6809/4088825946] 2024-09-12T17:54:15.312 INFO:tasks.workunit.client.0.smithi107.stderr: -123> 2024-09-12T17:54:15.091+0000 7f99330e4640 10 monclient: get_auth_request con 0x7f97fc076470 auth_method 0 2024-09-12T17:54:15.312 INFO:tasks.workunit.client.0.smithi107.stderr: -122> 2024-09-12T17:54:15.091+0000 7f992bfff640 10 monclient: get_auth_request con 0x5577535e98a0 auth_method 0 2024-09-12T17:54:15.312 INFO:tasks.workunit.client.0.smithi107.stderr: -121> 2024-09-12T17:54:15.092+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.312 INFO:tasks.workunit.client.0.smithi107.stderr: -120> 2024-09-12T17:54:15.092+0000 7f9937335800 20 realm 2024-09-12T17:54:15.312 INFO:tasks.workunit.client.0.smithi107.stderr: -119> 2024-09-12T17:54:15.092+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.312 INFO:tasks.workunit.client.0.smithi107.stderr: -118> 2024-09-12T17:54:15.092+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.313 INFO:tasks.workunit.client.0.smithi107.stderr: -117> 2024-09-12T17:54:15.092+0000 7f9937335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:15.313 INFO:tasks.workunit.client.0.smithi107.stderr: -116> 2024-09-12T17:54:15.092+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.313 INFO:tasks.workunit.client.0.smithi107.stderr: -115> 2024-09-12T17:54:15.092+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.313 INFO:tasks.workunit.client.0.smithi107.stderr: -114> 2024-09-12T17:54:15.092+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.313 INFO:tasks.workunit.client.0.smithi107.stderr: -113> 2024-09-12T17:54:15.092+0000 7f99330e4640 10 monclient: get_auth_request con 0x5577535edc60 auth_method 0 2024-09-12T17:54:15.313 INFO:tasks.workunit.client.0.smithi107.stderr: -112> 2024-09-12T17:54:15.093+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:15.313 INFO:tasks.workunit.client.0.smithi107.stderr: -111> 2024-09-12T17:54:15.093+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.313 INFO:tasks.workunit.client.0.smithi107.stderr: -110> 2024-09-12T17:54:15.093+0000 7f992bfff640 10 monclient: get_auth_request con 0x5577535f13c0 auth_method 0 2024-09-12T17:54:15.313 INFO:tasks.workunit.client.0.smithi107.stderr: -109> 2024-09-12T17:54:15.094+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:15.314 INFO:tasks.workunit.client.0.smithi107.stderr: -108> 2024-09-12T17:54:15.094+0000 7f9937335800 20 searching for the correct realm 2024-09-12T17:54:15.314 INFO:tasks.workunit.client.0.smithi107.stderr: -107> 2024-09-12T17:54:15.094+0000 7f99338e5640 10 monclient: get_auth_request con 0x5577535f60c0 auth_method 0 2024-09-12T17:54:15.314 INFO:tasks.workunit.client.0.smithi107.stderr: -106> 2024-09-12T17:54:15.095+0000 7f99330e4640 10 monclient: get_auth_request con 0x7f992c017020 auth_method 0 2024-09-12T17:54:15.314 INFO:tasks.workunit.client.0.smithi107.stderr: -105> 2024-09-12T17:54:15.096+0000 7f992bfff640 10 monclient: get_auth_request con 0x7f991c07a040 auth_method 0 2024-09-12T17:54:15.314 INFO:tasks.workunit.client.0.smithi107.stderr: -104> 2024-09-12T17:54:15.097+0000 7f99338e5640 0 -- 172.21.15.107:0/1782678578 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5577535f60c0 msgr2=0x5577535f8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:15.314 INFO:tasks.workunit.client.0.smithi107.stderr: -103> 2024-09-12T17:54:15.097+0000 7f98157fa640 1 client.7817.objecter ms_handle_reset 0x5577535f60c0 session 0x5577535f5a40 osd.3 2024-09-12T17:54:15.314 INFO:tasks.workunit.client.0.smithi107.stderr: -102> 2024-09-12T17:54:15.097+0000 7f98157fa640 10 monclient: _renew_subs 2024-09-12T17:54:15.314 INFO:tasks.workunit.client.0.smithi107.stderr: -101> 2024-09-12T17:54:15.097+0000 7f98157fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.107:3301/0 2024-09-12T17:54:15.315 INFO:tasks.workunit.client.0.smithi107.stderr: -100> 2024-09-12T17:54:15.097+0000 7f99338e5640 10 monclient: get_auth_request con 0x7f97fc086b20 auth_method 0 2024-09-12T17:54:15.315 INFO:tasks.workunit.client.0.smithi107.stderr: -99> 2024-09-12T17:54:15.097+0000 7f99338e5640 10 monclient: get_auth_request con 0x7f991c056980 auth_method 0 2024-09-12T17:54:15.315 INFO:tasks.workunit.client.0.smithi107.stderr: -98> 2024-09-12T17:54:15.100+0000 7f99330e4640 10 monclient: get_auth_request con 0x7f991c07a420 auth_method 0 2024-09-12T17:54:15.315 INFO:tasks.workunit.client.0.smithi107.stderr: -97> 2024-09-12T17:54:15.100+0000 7f99330e4640 0 -- 172.21.15.107:0/1782678578 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f991c07a420 msgr2=0x7f991c07a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:15.315 INFO:tasks.workunit.client.0.smithi107.stderr: -96> 2024-09-12T17:54:15.100+0000 7f98157fa640 1 client.7817.objecter ms_handle_reset 0x7f991c07a420 session 0x7f991c06ce00 osd.0 2024-09-12T17:54:15.315 INFO:tasks.workunit.client.0.smithi107.stderr: -95> 2024-09-12T17:54:15.100+0000 7f99330e4640 10 monclient: get_auth_request con 0x5577535f60c0 auth_method 0 2024-09-12T17:54:15.315 INFO:tasks.workunit.client.0.smithi107.stderr: -94> 2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:15.316 INFO:tasks.workunit.client.0.smithi107.stderr: -93> 2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:15.316 INFO:tasks.workunit.client.0.smithi107.stderr: -92> 2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:15.316 INFO:tasks.workunit.client.0.smithi107.stderr: -91> 2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:15.316 INFO:tasks.workunit.client.0.smithi107.stderr: -90> 2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:15.316 INFO:tasks.workunit.client.0.smithi107.stderr: -89> 2024-09-12T17:54:15.104+0000 7f9937335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:15.316 INFO:tasks.workunit.client.0.smithi107.stderr: -88> 2024-09-12T17:54:15.104+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.316 INFO:tasks.workunit.client.0.smithi107.stderr: -87> 2024-09-12T17:54:15.104+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.316 INFO:tasks.workunit.client.0.smithi107.stderr: -86> 2024-09-12T17:54:15.104+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.317 INFO:tasks.workunit.client.0.smithi107.stderr: -85> 2024-09-12T17:54:15.105+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:15.317 INFO:tasks.workunit.client.0.smithi107.stderr: -84> 2024-09-12T17:54:15.105+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.317 INFO:tasks.workunit.client.0.smithi107.stderr: -83> 2024-09-12T17:54:15.105+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:15.317 INFO:tasks.workunit.client.0.smithi107.stderr: -82> 2024-09-12T17:54:15.105+0000 7f9937335800 20 zone default found 2024-09-12T17:54:15.317 INFO:tasks.workunit.client.0.smithi107.stderr: -81> 2024-09-12T17:54:15.105+0000 7f9937335800 4 Realm: () 2024-09-12T17:54:15.317 INFO:tasks.workunit.client.0.smithi107.stderr: -80> 2024-09-12T17:54:15.105+0000 7f9937335800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:15.317 INFO:tasks.workunit.client.0.smithi107.stderr: -79> 2024-09-12T17:54:15.105+0000 7f9937335800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:15.317 INFO:tasks.workunit.client.0.smithi107.stderr: -78> 2024-09-12T17:54:15.105+0000 7f9937335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:15.318 INFO:tasks.workunit.client.0.smithi107.stderr: -77> 2024-09-12T17:54:15.105+0000 7f9937335800 20 zonegroup default 2024-09-12T17:54:15.318 INFO:tasks.workunit.client.0.smithi107.stderr: -76> 2024-09-12T17:54:15.105+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.318 INFO:tasks.workunit.client.0.smithi107.stderr: -75> 2024-09-12T17:54:15.105+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.318 INFO:tasks.workunit.client.0.smithi107.stderr: -74> 2024-09-12T17:54:15.105+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.318 INFO:tasks.workunit.client.0.smithi107.stderr: -73> 2024-09-12T17:54:15.106+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.318 INFO:tasks.workunit.client.0.smithi107.stderr: -72> 2024-09-12T17:54:15.106+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.318 INFO:tasks.workunit.client.0.smithi107.stderr: -71> 2024-09-12T17:54:15.106+0000 7f9937335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.318 INFO:tasks.workunit.client.0.smithi107.stderr: -70> 2024-09-12T17:54:15.106+0000 7f9937335800 20 started sync module instance, tier type = 2024-09-12T17:54:15.319 INFO:tasks.workunit.client.0.smithi107.stderr: -69> 2024-09-12T17:54:15.106+0000 7f9937335800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:15.319 INFO:tasks.workunit.client.0.smithi107.stderr: -68> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=0 2024-09-12T17:54:15.319 INFO:tasks.workunit.client.0.smithi107.stderr: -67> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=1 2024-09-12T17:54:15.319 INFO:tasks.workunit.client.0.smithi107.stderr: -66> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=2 2024-09-12T17:54:15.319 INFO:tasks.workunit.client.0.smithi107.stderr: -65> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=3 2024-09-12T17:54:15.319 INFO:tasks.workunit.client.0.smithi107.stderr: -64> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=4 2024-09-12T17:54:15.319 INFO:tasks.workunit.client.0.smithi107.stderr: -63> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=5 2024-09-12T17:54:15.319 INFO:tasks.workunit.client.0.smithi107.stderr: -62> 2024-09-12T17:54:15.115+0000 7f9937335800 20 add_watcher() i=6 2024-09-12T17:54:15.320 INFO:tasks.workunit.client.0.smithi107.stderr: -61> 2024-09-12T17:54:15.116+0000 7f9937335800 20 add_watcher() i=7 2024-09-12T17:54:15.320 INFO:tasks.workunit.client.0.smithi107.stderr: -60> 2024-09-12T17:54:15.116+0000 7f9937335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:15.320 INFO:tasks.workunit.client.0.smithi107.stderr: -59> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding auth protocol: cephx 2024-09-12T17:54:15.320 INFO:tasks.workunit.client.0.smithi107.stderr: -58> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding auth protocol: cephx 2024-09-12T17:54:15.320 INFO:tasks.workunit.client.0.smithi107.stderr: -57> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding auth protocol: cephx 2024-09-12T17:54:15.320 INFO:tasks.workunit.client.0.smithi107.stderr: -56> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: secure 2024-09-12T17:54:15.320 INFO:tasks.workunit.client.0.smithi107.stderr: -55> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: crc 2024-09-12T17:54:15.320 INFO:tasks.workunit.client.0.smithi107.stderr: -54> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: secure 2024-09-12T17:54:15.321 INFO:tasks.workunit.client.0.smithi107.stderr: -53> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: crc 2024-09-12T17:54:15.321 INFO:tasks.workunit.client.0.smithi107.stderr: -52> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: secure 2024-09-12T17:54:15.321 INFO:tasks.workunit.client.0.smithi107.stderr: -51> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: crc 2024-09-12T17:54:15.321 INFO:tasks.workunit.client.0.smithi107.stderr: -50> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: crc 2024-09-12T17:54:15.321 INFO:tasks.workunit.client.0.smithi107.stderr: -49> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: secure 2024-09-12T17:54:15.321 INFO:tasks.workunit.client.0.smithi107.stderr: -48> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: crc 2024-09-12T17:54:15.321 INFO:tasks.workunit.client.0.smithi107.stderr: -47> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: secure 2024-09-12T17:54:15.321 INFO:tasks.workunit.client.0.smithi107.stderr: -46> 2024-09-12T17:54:15.117+0000 7f97e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:15.322 INFO:tasks.workunit.client.0.smithi107.stderr: -45> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: crc 2024-09-12T17:54:15.322 INFO:tasks.workunit.client.0.smithi107.stderr: -44> 2024-09-12T17:54:15.117+0000 7f9937335800 5 AuthRegistry(0x7fff686cb6f0) adding con mode: secure 2024-09-12T17:54:15.322 INFO:tasks.workunit.client.0.smithi107.stderr: -43> 2024-09-12T17:54:15.118+0000 7f9937335800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:54:15.322 INFO:tasks.workunit.client.0.smithi107.stderr: -42> 2024-09-12T17:54:15.118+0000 7f9937335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:15.322 INFO:tasks.workunit.client.0.smithi107.stderr: -41> 2024-09-12T17:54:15.118+0000 7f9937335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:15.322 INFO:tasks.workunit.client.0.smithi107.stderr: -40> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command cache list hook 0x5577535c62a0 2024-09-12T17:54:15.322 INFO:tasks.workunit.client.0.smithi107.stderr: -39> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command cache inspect hook 0x5577535c62a0 2024-09-12T17:54:15.322 INFO:tasks.workunit.client.0.smithi107.stderr: -38> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command cache erase hook 0x5577535c62a0 2024-09-12T17:54:15.322 INFO:tasks.workunit.client.0.smithi107.stderr: -37> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command cache zap hook 0x5577535c62a0 2024-09-12T17:54:15.323 INFO:tasks.workunit.client.0.smithi107.stderr: -36> 2024-09-12T17:54:15.118+0000 7f9937335800 5 note: GC not initialized 2024-09-12T17:54:15.323 INFO:tasks.workunit.client.0.smithi107.stderr: -35> 2024-09-12T17:54:15.118+0000 7f97e8fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:15.323 INFO:tasks.workunit.client.0.smithi107.stderr: -34> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command sync trace show hook 0x7f9924064040 2024-09-12T17:54:15.323 INFO:tasks.workunit.client.0.smithi107.stderr: -33> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command sync trace history hook 0x7f9924064040 2024-09-12T17:54:15.323 INFO:tasks.workunit.client.0.smithi107.stderr: -32> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command sync trace active hook 0x7f9924064040 2024-09-12T17:54:15.323 INFO:tasks.workunit.client.0.smithi107.stderr: -31> 2024-09-12T17:54:15.118+0000 7f9937335800 5 asok(0x5577532dd730) register_command sync trace active_short hook 0x7f9924064040 2024-09-12T17:54:15.323 INFO:tasks.workunit.client.0.smithi107.stderr: -30> 2024-09-12T17:54:15.118+0000 7f9937335800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:15.323 INFO:tasks.workunit.client.0.smithi107.stderr: -29> 2024-09-12T17:54:15.118+0000 7f9937335800 20 Filter name: none 2024-09-12T17:54:15.323 INFO:tasks.workunit.client.0.smithi107.stderr: -28> 2024-09-12T17:54:15.118+0000 7f97627fc640 20 reqs_thread_entry: start 2024-09-12T17:54:15.324 INFO:tasks.workunit.client.0.smithi107.stderr: -27> 2024-09-12T17:54:15.118+0000 7f9937335800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:54:15.324 INFO:tasks.workunit.client.0.smithi107.stderr: -26> 2024-09-12T17:54:15.118+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.324 INFO:tasks.workunit.client.0.smithi107.stderr: -25> 2024-09-12T17:54:15.119+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:15.324 INFO:tasks.workunit.client.0.smithi107.stderr: -24> 2024-09-12T17:54:15.119+0000 7f9937335800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:54:15.324 INFO:tasks.workunit.client.0.smithi107.stderr: -23> 2024-09-12T17:54:15.119+0000 7f9937335800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:54:15.324 INFO:tasks.workunit.client.0.smithi107.stderr: -22> 2024-09-12T17:54:15.119+0000 7f9937335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:54:15.324 INFO:tasks.workunit.client.0.smithi107.stderr: -21> 2024-09-12T17:54:15.119+0000 7f9937335800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.324 INFO:tasks.workunit.client.0.smithi107.stderr: -20> 2024-09-12T17:54:15.119+0000 7f9937335800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:54:15.325 INFO:tasks.workunit.client.0.smithi107.stderr: -19> 2024-09-12T17:54:15.119+0000 7f9937335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:15.325 INFO:tasks.workunit.client.0.smithi107.stderr: -18> 2024-09-12T17:54:15.119+0000 7f9937335800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:15.325 INFO:tasks.workunit.client.0.smithi107.stderr: -17> 2024-09-12T17:54:15.119+0000 7f9937335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:15.328 INFO:tasks.workunit.client.0.smithi107.stderr: -16> 2024-09-12T17:54:15.119+0000 7f9937335800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:15.328 INFO:tasks.workunit.client.0.smithi107.stderr: -15> 2024-09-12T17:54:15.119+0000 7f9937335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:54:15.328 INFO:tasks.workunit.client.0.smithi107.stderr: -14> 2024-09-12T17:54:15.120+0000 7f9937335800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:54:15.329 INFO:tasks.workunit.client.0.smithi107.stderr: -13> 2024-09-12T17:54:15.124+0000 7f9937335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:15.329 INFO:tasks.workunit.client.0.smithi107.stderr: -12> 2024-09-12T17:54:15.124+0000 7f9937335800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:15.329 INFO:tasks.workunit.client.0.smithi107.stderr: -11> 2024-09-12T17:54:15.124+0000 7f9937335800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:15.329 INFO:tasks.workunit.client.0.smithi107.stderr: -10> 2024-09-12T17:54:15.124+0000 7f9937335800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:54:15.329 INFO:tasks.workunit.client.0.smithi107.stderr: -9> 2024-09-12T17:54:15.124+0000 7f9816ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 93970988244144 notifier 7817 bl.length()=911 2024-09-12T17:54:15.329 INFO:tasks.workunit.client.0.smithi107.stderr: -8> 2024-09-12T17:54:15.125+0000 7f9816ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:15.329 INFO:tasks.workunit.client.0.smithi107.stderr: -7> 2024-09-12T17:54:15.125+0000 7f9816ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:15.329 INFO:tasks.workunit.client.0.smithi107.stderr: -6> 2024-09-12T17:54:15.125+0000 7f9816ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:15.330 INFO:tasks.workunit.client.0.smithi107.stderr: -5> 2024-09-12T17:54:15.125+0000 7f9937335800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:54:15.330 INFO:tasks.workunit.client.0.smithi107.stderr: -4> 2024-09-12T17:54:15.125+0000 7f9937335800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:54:15.330 INFO:tasks.workunit.client.0.smithi107.stderr: -3> 2024-09-12T17:54:15.125+0000 7f9937335800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:54:15.330 INFO:tasks.workunit.client.0.smithi107.stderr: -2> 2024-09-12T17:54:15.125+0000 7f9937335800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:54:15.330 INFO:tasks.workunit.client.0.smithi107.stderr: -1> 2024-09-12T17:54:15.129+0000 7f9937335800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9937335800 time 2024-09-12T17:54:15.129487+0000 2024-09-12T17:54:15.330 INFO:tasks.workunit.client.0.smithi107.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:54:15.330 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.330 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:54:15.330 INFO:tasks.workunit.client.0.smithi107.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9938b8c71a] 2024-09-12T17:54:15.330 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9938b8c8d8] 2024-09-12T17:54:15.331 INFO:tasks.workunit.client.0.smithi107.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577524f9841] 2024-09-12T17:54:15.331 INFO:tasks.workunit.client.0.smithi107.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55775250957a] 2024-09-12T17:54:15.331 INFO:tasks.workunit.client.0.smithi107.stderr: 5: main() 2024-09-12T17:54:15.331 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9937829590] 2024-09-12T17:54:15.331 INFO:tasks.workunit.client.0.smithi107.stderr: 7: __libc_start_main() 2024-09-12T17:54:15.331 INFO:tasks.workunit.client.0.smithi107.stderr: 8: _start() 2024-09-12T17:54:15.331 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.331 INFO:tasks.workunit.client.0.smithi107.stderr: 0> 2024-09-12T17:54:15.129+0000 7f9937335800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:54:15.331 INFO:tasks.workunit.client.0.smithi107.stderr: in thread 7f9937335800 thread_name:radosgw-admin 2024-09-12T17:54:15.331 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.331 INFO:tasks.workunit.client.0.smithi107.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:54:15.331 INFO:tasks.workunit.client.0.smithi107.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f993783e6f0] 2024-09-12T17:54:15.332 INFO:tasks.workunit.client.0.smithi107.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f993788b99c] 2024-09-12T17:54:15.332 INFO:tasks.workunit.client.0.smithi107.stderr: 3: raise() 2024-09-12T17:54:15.332 INFO:tasks.workunit.client.0.smithi107.stderr: 4: abort() 2024-09-12T17:54:15.332 INFO:tasks.workunit.client.0.smithi107.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9938b8c774] 2024-09-12T17:54:15.332 INFO:tasks.workunit.client.0.smithi107.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9938b8c8d8] 2024-09-12T17:54:15.332 INFO:tasks.workunit.client.0.smithi107.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577524f9841] 2024-09-12T17:54:15.332 INFO:tasks.workunit.client.0.smithi107.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55775250957a] 2024-09-12T17:54:15.332 INFO:tasks.workunit.client.0.smithi107.stderr: 9: main() 2024-09-12T17:54:15.332 INFO:tasks.workunit.client.0.smithi107.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9937829590] 2024-09-12T17:54:15.332 INFO:tasks.workunit.client.0.smithi107.stderr: 11: __libc_start_main() 2024-09-12T17:54:15.333 INFO:tasks.workunit.client.0.smithi107.stderr: 12: _start() 2024-09-12T17:54:15.333 INFO:tasks.workunit.client.0.smithi107.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:54:15.333 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:15.333 INFO:tasks.workunit.client.0.smithi107.stderr:--- logging levels --- 2024-09-12T17:54:15.333 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 none 2024-09-12T17:54:15.333 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 lockdep 2024-09-12T17:54:15.333 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 context 2024-09-12T17:54:15.333 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 crush 2024-09-12T17:54:15.333 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds 2024-09-12T17:54:15.333 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_balancer 2024-09-12T17:54:15.333 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_locker 2024-09-12T17:54:15.333 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_log_expire 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mds_migrator 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 3/ 5 mds_quiesce 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 buffer 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 timer 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 filer 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 striper 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 1 objecter 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rados 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_mirror 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_replay 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 rbd_pwl 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 journaler 2024-09-12T17:54:15.334 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objectcacher 2024-09-12T17:54:15.335 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:54:15.335 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 client 2024-09-12T17:54:15.335 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 osd 2024-09-12T17:54:15.335 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 optracker 2024-09-12T17:54:15.335 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 objclass 2024-09-12T17:54:15.335 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 filestore 2024-09-12T17:54:15.335 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 journal 2024-09-12T17:54:15.335 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 ms 2024-09-12T17:54:15.335 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mon 2024-09-12T17:54:15.335 INFO:tasks.workunit.client.0.smithi107.stderr: 0/10 monc 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 paxos 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 tp 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 auth 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 crypto 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 finisher 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 reserver 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 heartbeatmap 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 perfcounter 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_sync 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_datacache 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_access 2024-09-12T17:54:15.336 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_flight 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 20/20 rgw_notification 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 javaclient 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 asok 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 1 throttle 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 0 refs 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 compressor 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluestore 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 bluefs 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 3 bdev 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 kstore 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 4/ 5 rocksdb 2024-09-12T17:54:15.337 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 fuse 2024-09-12T17:54:15.338 INFO:tasks.workunit.client.0.smithi107.stderr: 2/ 5 mgr 2024-09-12T17:54:15.338 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mgrc 2024-09-12T17:54:15.338 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 dpdk 2024-09-12T17:54:15.338 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 eventtrace 2024-09-12T17:54:15.338 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 prioritycache 2024-09-12T17:54:15.338 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 test 2024-09-12T17:54:15.338 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:54:15.338 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cephsqlite 2024-09-12T17:54:15.339 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:54:15.339 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore 2024-09-12T17:54:15.339 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_onode 2024-09-12T17:54:15.339 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_odata 2024-09-12T17:54:15.339 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_omap 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_tm 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_t 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_epm 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_lba 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_cache 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_journal 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_device 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 seastore_backref 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 alienstore 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 mclock 2024-09-12T17:54:15.340 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 cyanstore 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 ceph_exporter 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 memstore 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: 1/ 5 trace 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: 0/ 5 ceph_dedup 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: -2/-2 (syslog threshold) 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: 99/99 (stderr threshold) 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: 7f97627fc640 / http_manager 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: 7f97e8fe1640 / http_manager 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: 7f97e9fe3640 / rgw_dt_lg_renew 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: 7f98157fa640 / ms_dispatch 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9816ffd640 / io_context_pool 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: 7f981d602640 / ms_dispatch 2024-09-12T17:54:15.341 INFO:tasks.workunit.client.0.smithi107.stderr: 7f981fe07640 / ms_dispatch 2024-09-12T17:54:15.342 INFO:tasks.workunit.client.0.smithi107.stderr: 7f982160a640 / io_context_pool 2024-09-12T17:54:15.342 INFO:tasks.workunit.client.0.smithi107.stderr: 7f992bfff640 / msgr-worker-2 2024-09-12T17:54:15.342 INFO:tasks.workunit.client.0.smithi107.stderr: 7f99330e4640 / msgr-worker-1 2024-09-12T17:54:15.342 INFO:tasks.workunit.client.0.smithi107.stderr: 7f99338e5640 / msgr-worker-0 2024-09-12T17:54:15.342 INFO:tasks.workunit.client.0.smithi107.stderr: 7f99340e6640 / io_context_pool 2024-09-12T17:54:15.342 INFO:tasks.workunit.client.0.smithi107.stderr: 7f9937335800 / radosgw-admin 2024-09-12T17:54:15.342 INFO:tasks.workunit.client.0.smithi107.stderr: max_recent 500 2024-09-12T17:54:15.342 INFO:tasks.workunit.client.0.smithi107.stderr: max_new 1000 2024-09-12T17:54:15.342 INFO:tasks.workunit.client.0.smithi107.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:54:15.130840Z_46259f9e-fd8d-4df9-9c05-fb36b22f9390/log 2024-09-12T17:54:15.342 INFO:tasks.workunit.client.0.smithi107.stderr:--- end dump of recent events --- 2024-09-12T17:54:15.342 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:54:15.349 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:15.349 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:15.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.203+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.205+0000 7f507ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.205+0000 7f507ab42800 20 realm 2024-09-12T17:54:15.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.205+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.205+0000 7f507ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.205+0000 7f507ab42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:15.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.205+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.205+0000 7f507ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.205+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.206+0000 7f507ab42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.206+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.207+0000 7f507ab42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.207+0000 7f507ab42800 20 searching for the correct realm 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.210+0000 7f5076886640 0 -- 172.21.15.107:0/4116919800 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f5070020040 msgr2=0x7f5070020930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.213+0000 7f5076886640 0 -- 172.21.15.107:0/4116919800 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f5060073aa0 msgr2=0x7f5060083050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.218+0000 7f507ab42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.218+0000 7f507ab42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.218+0000 7f507ab42800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.218+0000 7f507ab42800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.218+0000 7f507ab42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.218+0000 7f507ab42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:15.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.218+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.218+0000 7f507ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.218+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.218+0000 7f507ab42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.218+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.219+0000 7f507ab42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.219+0000 7f507ab42800 20 zone default found 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.219+0000 7f507ab42800 4 Realm: () 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.219+0000 7f507ab42800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.219+0000 7f507ab42800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.219+0000 7f507ab42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.219+0000 7f507ab42800 20 zonegroup default 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.219+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.219+0000 7f507ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.219+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.219+0000 7f507ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.219+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.220+0000 7f507ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.220+0000 7f507ab42800 20 started sync module instance, tier type = 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.220+0000 7f507ab42800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.228+0000 7f507ab42800 20 add_watcher() i=0 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.228+0000 7f507ab42800 20 add_watcher() i=1 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.228+0000 7f507ab42800 20 add_watcher() i=2 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.228+0000 7f507ab42800 20 add_watcher() i=3 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.228+0000 7f507ab42800 20 add_watcher() i=4 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.228+0000 7f507ab42800 20 add_watcher() i=5 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.228+0000 7f507ab42800 20 add_watcher() i=6 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.229+0000 7f507ab42800 20 add_watcher() i=7 2024-09-12T17:54:15.352 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.229+0000 7f507ab42800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.231+0000 7f4f2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.231+0000 7f507ab42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.231+0000 7f507ab42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.231+0000 7f507ab42800 5 note: GC not initialized 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.231+0000 7f4ea7fff640 20 reqs_thread_entry: start 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.232+0000 7f507ab42800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.232+0000 7f507ab42800 20 Filter name: none 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.232+0000 7f4ea5ffb640 20 reqs_thread_entry: start 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.232+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.232+0000 7f507ab42800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.233+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.233+0000 7f507ab42800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.233+0000 7f507ab42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:15.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.233+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.234+0000 7f507ab42800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.234+0000 7f507ab42800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.234+0000 7f507ab42800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.234+0000 7f507ab42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.235+0000 7f4f2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.237+0000 7f507ab42800 20 remove_watcher() i=0 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.237+0000 7f507ab42800 2 removed watcher, disabling cache 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.238+0000 7f507ab42800 20 remove_watcher() i=1 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.239+0000 7f507ab42800 20 remove_watcher() i=2 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.240+0000 7f507ab42800 20 remove_watcher() i=3 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.241+0000 7f507ab42800 20 remove_watcher() i=4 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.242+0000 7f507ab42800 20 remove_watcher() i=5 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.243+0000 7f507ab42800 20 remove_watcher() i=6 2024-09-12T17:54:15.354 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.244+0000 7f507ab42800 20 remove_watcher() i=7 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.328+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.330+0000 7f71769ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.330+0000 7f71769ad800 20 realm 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.330+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.330+0000 7f71769ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.330+0000 7f71769ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.330+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.330+0000 7f71769ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.330+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.331+0000 7f71769ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.331+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.332+0000 7f71769ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:15.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.332+0000 7f71769ad800 20 searching for the correct realm 2024-09-12T17:54:15.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.334+0000 7f7174497640 0 -- 172.21.15.107:0/2360076206 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f716c071040 msgr2=0x7f716c055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:15.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.338+0000 7f7174497640 0 -- 172.21.15.107:0/2360076206 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f715c08d4e0 msgr2=0x7f715c082960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:15.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.544+0000 7f71769ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:15.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.544+0000 7f71769ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:15.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.544+0000 7f71769ad800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:15.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.544+0000 7f71769ad800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:15.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.544+0000 7f71769ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:15.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.544+0000 7f71769ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:15.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.544+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 20 zone default found 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 4 Realm: () 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 20 zonegroup default 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.545+0000 7f71769ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.546+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.546+0000 7f71769ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.546+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.546+0000 7f71769ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:15.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.546+0000 7f71769ad800 20 started sync module instance, tier type = 2024-09-12T17:54:15.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.546+0000 7f71769ad800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:15.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.555+0000 7f71769ad800 20 add_watcher() i=0 2024-09-12T17:54:15.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.555+0000 7f71769ad800 20 add_watcher() i=1 2024-09-12T17:54:15.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.555+0000 7f71769ad800 20 add_watcher() i=2 2024-09-12T17:54:15.556 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.555+0000 7f71769ad800 20 add_watcher() i=3 2024-09-12T17:54:15.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.555+0000 7f71769ad800 20 add_watcher() i=4 2024-09-12T17:54:15.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.555+0000 7f71769ad800 20 add_watcher() i=5 2024-09-12T17:54:15.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.555+0000 7f71769ad800 20 add_watcher() i=6 2024-09-12T17:54:15.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.556+0000 7f71769ad800 20 add_watcher() i=7 2024-09-12T17:54:15.557 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.556+0000 7f71769ad800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:15.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.558+0000 7f702afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:15.559 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.558+0000 7f71769ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:15.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.558+0000 7f71769ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:15.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.558+0000 7f71769ad800 5 note: GC not initialized 2024-09-12T17:54:15.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.558+0000 7f7029fdb640 20 reqs_thread_entry: start 2024-09-12T17:54:15.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.558+0000 7f71769ad800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:15.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.558+0000 7f71769ad800 20 Filter name: none 2024-09-12T17:54:15.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f6f9b7fe640 20 reqs_thread_entry: start 2024-09-12T17:54:15.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:54:15.560 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:15.561 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 20 rados->read ofs=0 len=0 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.559+0000 7f71769ad800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.560+0000 7f71769ad800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:54:15.562 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.560+0000 7f71769ad800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:54:15.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.560+0000 7f71769ad800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:54:15.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.560+0000 7f71769ad800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:54:15.563 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.561+0000 7f702afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:15.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.564+0000 7f71769ad800 20 remove_watcher() i=0 2024-09-12T17:54:15.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.564+0000 7f71769ad800 2 removed watcher, disabling cache 2024-09-12T17:54:15.565 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.565+0000 7f71769ad800 20 remove_watcher() i=1 2024-09-12T17:54:15.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.566+0000 7f71769ad800 20 remove_watcher() i=2 2024-09-12T17:54:15.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.567+0000 7f71769ad800 20 remove_watcher() i=3 2024-09-12T17:54:15.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.567+0000 7f71769ad800 20 remove_watcher() i=4 2024-09-12T17:54:15.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.568+0000 7f71769ad800 20 remove_watcher() i=5 2024-09-12T17:54:15.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.569+0000 7f71769ad800 20 remove_watcher() i=6 2024-09-12T17:54:15.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:15.570+0000 7f71769ad800 20 remove_watcher() i=7 2024-09-12T17:54:45.599 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T17:54:45.632 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:45.632 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:45.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.673+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.675+0000 7fc233c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:45.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.675+0000 7fc233c40800 20 realm 2024-09-12T17:54:45.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.675+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.675+0000 7fc233c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:45.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.675+0000 7fc233c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:45.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.675+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.675+0000 7fc233c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:45.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.675+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.676+0000 7fc233c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:45.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.676+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.677+0000 7fc233c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:45.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.677+0000 7fc233c40800 20 searching for the correct realm 2024-09-12T17:54:45.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.680+0000 7fc231731640 0 -- 172.21.15.107:0/1506135648 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fc22c01f040 msgr2=0x7fc22c021430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:45.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.683+0000 7fc231731640 0 -- 172.21.15.107:0/1506135648 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc2280b7cf0 msgr2=0x7fc2280c8050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:45.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.890+0000 7fc233c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:45.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.890+0000 7fc233c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:45.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.890+0000 7fc233c40800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:45.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.890+0000 7fc233c40800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:45.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.890+0000 7fc233c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:45.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.890+0000 7fc233c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:45.892 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.890+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.890+0000 7fc233c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.890+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.890+0000 7fc233c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.890+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.891+0000 7fc233c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.891+0000 7fc233c40800 20 zone default found 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.891+0000 7fc233c40800 4 Realm: () 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.891+0000 7fc233c40800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.891+0000 7fc233c40800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.891+0000 7fc233c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.891+0000 7fc233c40800 20 zonegroup default 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.891+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.893 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.891+0000 7fc233c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:45.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.891+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.891+0000 7fc233c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:45.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.891+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.892+0000 7fc233c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:45.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.892+0000 7fc233c40800 20 started sync module instance, tier type = 2024-09-12T17:54:45.894 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.892+0000 7fc233c40800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:45.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.902+0000 7fc233c40800 20 add_watcher() i=0 2024-09-12T17:54:45.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.902+0000 7fc233c40800 20 add_watcher() i=1 2024-09-12T17:54:45.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.902+0000 7fc233c40800 20 add_watcher() i=2 2024-09-12T17:54:45.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.902+0000 7fc233c40800 20 add_watcher() i=3 2024-09-12T17:54:45.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.902+0000 7fc233c40800 20 add_watcher() i=4 2024-09-12T17:54:45.903 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.902+0000 7fc233c40800 20 add_watcher() i=5 2024-09-12T17:54:45.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.902+0000 7fc233c40800 20 add_watcher() i=6 2024-09-12T17:54:45.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.903+0000 7fc233c40800 20 add_watcher() i=7 2024-09-12T17:54:45.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.903+0000 7fc233c40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:45.905 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.904+0000 7fc0e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.905+0000 7fc233c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.905+0000 7fc233c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:45.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.905+0000 7fc233c40800 5 note: GC not initialized 2024-09-12T17:54:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.905+0000 7fc0e6fe5640 20 reqs_thread_entry: start 2024-09-12T17:54:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.905+0000 7fc233c40800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.905+0000 7fc233c40800 20 Filter name: none 2024-09-12T17:54:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.905+0000 7fc0e4fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.905+0000 7fc233c40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:54:45.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.905+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.906+0000 7fc233c40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.906+0000 7fc233c40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:54:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.906+0000 7fc233c40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:54:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.906+0000 7fc233c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:54:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.906+0000 7fc233c40800 20 rados->read ofs=0 len=0 2024-09-12T17:54:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.907+0000 7fc233c40800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:54:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.907+0000 7fc233c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.907+0000 7fc233c40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.907+0000 7fc233c40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.907+0000 7fc233c40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:45.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.907+0000 7fc233c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:54:45.912 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.911+0000 7fc0e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:45.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.913+0000 7fc233c40800 20 remove_watcher() i=0 2024-09-12T17:54:45.914 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.913+0000 7fc233c40800 2 removed watcher, disabling cache 2024-09-12T17:54:45.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.914+0000 7fc233c40800 20 remove_watcher() i=1 2024-09-12T17:54:45.916 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.915+0000 7fc233c40800 20 remove_watcher() i=2 2024-09-12T17:54:45.917 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.916+0000 7fc233c40800 20 remove_watcher() i=3 2024-09-12T17:54:45.918 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.917+0000 7fc233c40800 20 remove_watcher() i=4 2024-09-12T17:54:45.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.918+0000 7fc233c40800 20 remove_watcher() i=5 2024-09-12T17:54:45.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.919+0000 7fc233c40800 20 remove_watcher() i=6 2024-09-12T17:54:45.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.920+0000 7fc233c40800 20 remove_watcher() i=7 2024-09-12T17:54:45.934 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:54:45.963 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:45.995 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:46.000 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:45.999+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.000+0000 7f0ff1324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.000+0000 7f0ff1324800 20 realm 2024-09-12T17:54:46.001 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.000+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.000+0000 7f0ff1324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.000+0000 7f0ff1324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:46.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.000+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.000+0000 7f0ff1324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.000+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.001+0000 7f0ff1324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:46.002 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.001+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.003 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.002+0000 7f0ff1324800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:46.003 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.002+0000 7f0ff1324800 20 searching for the correct realm 2024-09-12T17:54:46.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.004+0000 7f0fe7fff640 0 -- 172.21.15.107:0/3638485235 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f0fd8076070 msgr2=0x7f0fd8056980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:46.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.008+0000 7f0fecf56640 0 -- 172.21.15.107:0/3638485235 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f0fd809b950 msgr2=0x7f0fd8087410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:46.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.215+0000 7f0ff1324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:46.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.215+0000 7f0ff1324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:46.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.215+0000 7f0ff1324800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:46.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.215+0000 7f0ff1324800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:46.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.215+0000 7f0ff1324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:46.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.215+0000 7f0ff1324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:46.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.215+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.215+0000 7f0ff1324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.215+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.215+0000 7f0ff1324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:46.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.215+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.216+0000 7f0ff1324800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.216+0000 7f0ff1324800 20 zone default found 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.216+0000 7f0ff1324800 4 Realm: () 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.216+0000 7f0ff1324800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.216+0000 7f0ff1324800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.216+0000 7f0ff1324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.216+0000 7f0ff1324800 20 zonegroup default 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.216+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.216+0000 7f0ff1324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.216+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.216+0000 7f0ff1324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.216+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.217+0000 7f0ff1324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.219 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.217+0000 7f0ff1324800 20 started sync module instance, tier type = 2024-09-12T17:54:46.220 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.217+0000 7f0ff1324800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:46.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.226+0000 7f0ff1324800 20 add_watcher() i=0 2024-09-12T17:54:46.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.226+0000 7f0ff1324800 20 add_watcher() i=1 2024-09-12T17:54:46.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.226+0000 7f0ff1324800 20 add_watcher() i=2 2024-09-12T17:54:46.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.226+0000 7f0ff1324800 20 add_watcher() i=3 2024-09-12T17:54:46.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.226+0000 7f0ff1324800 20 add_watcher() i=4 2024-09-12T17:54:46.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.226+0000 7f0ff1324800 20 add_watcher() i=5 2024-09-12T17:54:46.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.226+0000 7f0ff1324800 20 add_watcher() i=6 2024-09-12T17:54:46.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.226+0000 7f0ff1324800 20 add_watcher() i=7 2024-09-12T17:54:46.228 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.226+0000 7f0ff1324800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:46.229 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.228+0000 7f0ea2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:46.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.228+0000 7f0ff1324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:46.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.228+0000 7f0ff1324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:46.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.229+0000 7f0ff1324800 5 note: GC not initialized 2024-09-12T17:54:46.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.229+0000 7f0ea1fe3640 20 reqs_thread_entry: start 2024-09-12T17:54:46.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.229+0000 7f0ff1324800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:46.230 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.229+0000 7f0ff1324800 20 Filter name: none 2024-09-12T17:54:46.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.229+0000 7f0e137fe640 20 reqs_thread_entry: start 2024-09-12T17:54:46.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.229+0000 7f0ff1324800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:54:46.231 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.229+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:46.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:54:46.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:54:46.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:54:46.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:54:46.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:46.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:46.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:46.232 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:46.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:54:46.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:54:46.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.230+0000 7f0ff1324800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:54:46.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.231+0000 7f0ff1324800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:54:46.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.231+0000 7f0ff1324800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:54:46.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.231+0000 7f0ff1324800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:54:46.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.231+0000 7f0ff1324800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:54:46.233 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.232+0000 7f0ea2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:46.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.235+0000 7f0ff1324800 20 remove_watcher() i=0 2024-09-12T17:54:46.236 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.235+0000 7f0ff1324800 2 removed watcher, disabling cache 2024-09-12T17:54:46.237 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.236+0000 7f0ff1324800 20 remove_watcher() i=1 2024-09-12T17:54:46.238 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.237+0000 7f0ff1324800 20 remove_watcher() i=2 2024-09-12T17:54:46.239 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.238+0000 7f0ff1324800 20 remove_watcher() i=3 2024-09-12T17:54:46.240 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.239+0000 7f0ff1324800 20 remove_watcher() i=4 2024-09-12T17:54:46.241 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.240+0000 7f0ff1324800 20 remove_watcher() i=5 2024-09-12T17:54:46.242 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.241+0000 7f0ff1324800 20 remove_watcher() i=6 2024-09-12T17:54:46.243 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.242+0000 7f0ff1324800 20 remove_watcher() i=7 2024-09-12T17:54:46.253 INFO:tasks.workunit.client.0.smithi107.stderr:check reshard logrecord successfully 2024-09-12T17:54:46.253 INFO:tasks.workunit.client.0.smithi107.stderr: test: reshard versioned bucket 2024-09-12T17:54:46.255 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:54:46.283 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:46.284 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:46.320 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.319+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.320+0000 7efbff140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.320+0000 7efbff140800 20 realm 2024-09-12T17:54:46.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.320+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.320+0000 7efbff140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.320+0000 7efbff140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:46.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.320+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.321+0000 7efbff140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.322 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.321+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.321+0000 7efbff140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:46.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.321+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.322+0000 7efbff140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:46.323 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.322+0000 7efbff140800 20 searching for the correct realm 2024-09-12T17:54:46.327 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.325+0000 7efbfb6c1640 0 -- 172.21.15.107:0/3486284321 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55ca1e891920 msgr2=0x55ca1e893de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:46.329 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.328+0000 7efbfaec0640 0 -- 172.21.15.107:0/3486284321 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7efbe4096500 msgr2=0x7efbe4096980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:46.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.333+0000 7efbff140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:46.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.333+0000 7efbff140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:46.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.333+0000 7efbff140800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:46.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.333+0000 7efbff140800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:46.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.333+0000 7efbff140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:46.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.333+0000 7efbff140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:46.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.333+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.333+0000 7efbff140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.333+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.334+0000 7efbff140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:46.335 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.334+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.336 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.334+0000 7efbff140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.334+0000 7efbff140800 20 zone default found 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.334+0000 7efbff140800 4 Realm: () 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.334+0000 7efbff140800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.334+0000 7efbff140800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.334+0000 7efbff140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.334+0000 7efbff140800 20 zonegroup default 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.334+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.334+0000 7efbff140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.334+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.335+0000 7efbff140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.335+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.335+0000 7efbff140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.335+0000 7efbff140800 20 started sync module instance, tier type = 2024-09-12T17:54:46.337 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.335+0000 7efbff140800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:46.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.344+0000 7efbff140800 20 add_watcher() i=0 2024-09-12T17:54:46.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.344+0000 7efbff140800 20 add_watcher() i=1 2024-09-12T17:54:46.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.344+0000 7efbff140800 20 add_watcher() i=2 2024-09-12T17:54:46.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.344+0000 7efbff140800 20 add_watcher() i=3 2024-09-12T17:54:46.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.344+0000 7efbff140800 20 add_watcher() i=4 2024-09-12T17:54:46.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.344+0000 7efbff140800 20 add_watcher() i=5 2024-09-12T17:54:46.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.344+0000 7efbff140800 20 add_watcher() i=6 2024-09-12T17:54:46.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.345+0000 7efbff140800 20 add_watcher() i=7 2024-09-12T17:54:46.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.345+0000 7efbff140800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:46.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.346+0000 7efab17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:46.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.347+0000 7efbff140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:46.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.347+0000 7efbff140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:46.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.347+0000 7efbff140800 5 note: GC not initialized 2024-09-12T17:54:46.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.347+0000 7efa2bfff640 20 reqs_thread_entry: start 2024-09-12T17:54:46.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.347+0000 7efbff140800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:46.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.347+0000 7efbff140800 20 Filter name: none 2024-09-12T17:54:46.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.347+0000 7efa29ffb640 20 reqs_thread_entry: start 2024-09-12T17:54:46.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.347+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.348+0000 7efbff140800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:46.349 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.348+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.348+0000 7efbff140800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.348+0000 7efbff140800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.348+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.350 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.349+0000 7efbff140800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:46.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.349+0000 7efbff140800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.349+0000 7efbff140800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:46.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.349+0000 7efbff140800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:46.351 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.350+0000 7efab17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:46.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.352+0000 7efbff140800 20 remove_watcher() i=0 2024-09-12T17:54:46.353 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.352+0000 7efbff140800 2 removed watcher, disabling cache 2024-09-12T17:54:46.355 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.354+0000 7efbff140800 20 remove_watcher() i=1 2024-09-12T17:54:46.356 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.355+0000 7efbff140800 20 remove_watcher() i=2 2024-09-12T17:54:46.357 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.356+0000 7efbff140800 20 remove_watcher() i=3 2024-09-12T17:54:46.358 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.357+0000 7efbff140800 20 remove_watcher() i=4 2024-09-12T17:54:46.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.358+0000 7efbff140800 20 remove_watcher() i=5 2024-09-12T17:54:46.359 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.359+0000 7efbff140800 20 remove_watcher() i=6 2024-09-12T17:54:46.360 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.359+0000 7efbff140800 20 remove_watcher() i=7 2024-09-12T17:54:46.371 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:46.371 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:54:46.371 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: myver id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T17:54:46.371 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:46.372 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-12T17:54:46.403 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:46.403 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:46.440 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.439+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.440+0000 7f6b2df30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.440+0000 7f6b2df30800 20 realm 2024-09-12T17:54:46.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.440+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.441+0000 7f6b2df30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.441+0000 7f6b2df30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:46.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.441+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.441+0000 7f6b2df30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.441+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.442+0000 7f6b2df30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:46.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.442+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.442+0000 7f6b2df30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:46.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.442+0000 7f6b2df30800 20 searching for the correct realm 2024-09-12T17:54:46.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.445+0000 7f6b214af640 0 -- 172.21.15.107:0/333500501 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f6b14065190 msgr2=0x7f6b1405c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:46.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.448+0000 7f6b29cb0640 0 -- 172.21.15.107:0/333500501 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f6b14070930 msgr2=0x7f6b14096380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:46.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.654+0000 7f6b2df30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:46.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.654+0000 7f6b2df30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:46.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.654+0000 7f6b2df30800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:46.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.654+0000 7f6b2df30800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:46.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.654+0000 7f6b2df30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:46.657 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.654+0000 7f6b2df30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:46.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.654+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.654+0000 7f6b2df30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.654+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.654+0000 7f6b2df30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:46.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.654+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.655+0000 7f6b2df30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:46.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.655+0000 7f6b2df30800 20 zone default found 2024-09-12T17:54:46.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.655+0000 7f6b2df30800 4 Realm: () 2024-09-12T17:54:46.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.655+0000 7f6b2df30800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:46.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.655+0000 7f6b2df30800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:46.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.655+0000 7f6b2df30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:46.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.655+0000 7f6b2df30800 20 zonegroup default 2024-09-12T17:54:46.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.655+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.655+0000 7f6b2df30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.655+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.655+0000 7f6b2df30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.655+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.656+0000 7f6b2df30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.656+0000 7f6b2df30800 20 started sync module instance, tier type = 2024-09-12T17:54:46.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.656+0000 7f6b2df30800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:46.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.665+0000 7f6b2df30800 20 add_watcher() i=0 2024-09-12T17:54:46.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.665+0000 7f6b2df30800 20 add_watcher() i=1 2024-09-12T17:54:46.666 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.665+0000 7f6b2df30800 20 add_watcher() i=2 2024-09-12T17:54:46.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.665+0000 7f6b2df30800 20 add_watcher() i=3 2024-09-12T17:54:46.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.665+0000 7f6b2df30800 20 add_watcher() i=4 2024-09-12T17:54:46.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.665+0000 7f6b2df30800 20 add_watcher() i=5 2024-09-12T17:54:46.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.665+0000 7f6b2df30800 20 add_watcher() i=6 2024-09-12T17:54:46.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.666+0000 7f6b2df30800 20 add_watcher() i=7 2024-09-12T17:54:46.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.666+0000 7f6b2df30800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:46.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.668+0000 7f69db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:46.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.668+0000 7f6b2df30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:46.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.668+0000 7f6b2df30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:46.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.668+0000 7f6b2df30800 5 note: GC not initialized 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.668+0000 7f69da7fc640 20 reqs_thread_entry: start 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.668+0000 7f6b2df30800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.668+0000 7f6b2df30800 20 Filter name: none 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.668+0000 7f694bfff640 20 reqs_thread_entry: start 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.668+0000 7f6b2df30800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.668+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.669+0000 7f6b2df30800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.669+0000 7f6b2df30800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.669+0000 7f6b2df30800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.669+0000 7f6b2df30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 : miss 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.669+0000 7f6b2df30800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.669+0000 7f6b2df30800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:46.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.669+0000 7f6b2df30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:46.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.669+0000 7f6b2df30800 10 adding default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:46.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.669+0000 7f6b2df30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:46.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.669+0000 7f6b2df30800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:46.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.669+0000 7f6b2df30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 2024-09-12T17:54:46.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.673+0000 7f6b2df30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:46.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.673+0000 7f6b2df30800 10 moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:46.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.673+0000 7f6b2df30800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:46.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.673+0000 7f6b2df30800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19, ofs0, ns] 2024-09-12T17:54:46.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.673+0000 7f6a0cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464305 cookie 94099028943120 notifier 7922 bl.length()=905 2024-09-12T17:54:46.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.673+0000 7f6a0cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:46.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.673+0000 7f6a0cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:46.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.673+0000 7f6a0cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:46.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.674+0000 7f6b2df30800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_sources= new_sources= 2024-09-12T17:54:46.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.674+0000 7f6b2df30800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential sources added=[] removed=[] 2024-09-12T17:54:46.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.674+0000 7f6b2df30800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_dests= new_dests= 2024-09-12T17:54:46.676 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.674+0000 7f6b2df30800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential dests added=[] removed=[] 2024-09-12T17:54:46.677 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.676+0000 7f6b2df30800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.1.0 2024-09-12T17:54:46.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.676+0000 7f6b2df30800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.1.0 2024-09-12T17:54:46.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.676+0000 7f6b2df30800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.1.1 2024-09-12T17:54:46.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.676+0000 7f6b2df30800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.1.1 2024-09-12T17:54:46.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.676+0000 7f6b2df30800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.0 2024-09-12T17:54:46.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.677+0000 7f6b2df30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:46.678 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.677+0000 7f6b2df30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 2024-09-12T17:54:46.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.678+0000 7f6b2df30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:46.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.678+0000 7f6b2df30800 10 moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:46.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.678+0000 7f6b2df30800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:46.679 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.678+0000 7f6b2df30800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19, ofs0, ns] 2024-09-12T17:54:46.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.678+0000 7f6a0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464306 cookie 94099028943120 notifier 7922 bl.length()=905 2024-09-12T17:54:46.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.678+0000 7f6a0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:46.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.678+0000 7f6a0d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:46.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.678+0000 7f6a0d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:46.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.678+0000 7f6b2df30800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_sources= new_sources= 2024-09-12T17:54:46.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.678+0000 7f6b2df30800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential sources added=[] removed=[] 2024-09-12T17:54:46.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.678+0000 7f6b2df30800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_dests= new_dests= 2024-09-12T17:54:46.680 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.678+0000 7f6b2df30800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential dests added=[] removed=[] 2024-09-12T17:54:46.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.680+0000 7f6b2df30800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.0 2024-09-12T17:54:46.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.680+0000 7f6b2df30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:46.681 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.680+0000 7f6b2df30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 2024-09-12T17:54:46.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.681+0000 7f6b2df30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:46.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.681+0000 7f6b2df30800 10 moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:46.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.681+0000 7f6b2df30800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:46.682 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.681+0000 7f6b2df30800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19, ofs0, ns] 2024-09-12T17:54:46.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.681+0000 7f6a0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464307 cookie 94099028943120 notifier 7922 bl.length()=873 2024-09-12T17:54:46.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.681+0000 7f6a0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:46.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.681+0000 7f6a0d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:46.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.681+0000 7f6a0d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:46.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.682+0000 7f6b2df30800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_sources= new_sources= 2024-09-12T17:54:46.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.682+0000 7f6b2df30800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential sources added=[] removed=[] 2024-09-12T17:54:46.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.682+0000 7f6b2df30800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_dests= new_dests= 2024-09-12T17:54:46.683 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.682+0000 7f6b2df30800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential dests added=[] removed=[] 2024-09-12T17:54:46.684 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.683+0000 7f6b2df30800 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-12T17:54:46.685 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.684+0000 7f69db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:46.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.687+0000 7f6b2df30800 20 remove_watcher() i=0 2024-09-12T17:54:46.688 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.687+0000 7f6b2df30800 2 removed watcher, disabling cache 2024-09-12T17:54:46.689 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.688+0000 7f6b2df30800 20 remove_watcher() i=1 2024-09-12T17:54:46.690 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.689+0000 7f6b2df30800 20 remove_watcher() i=2 2024-09-12T17:54:46.691 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.690+0000 7f6b2df30800 20 remove_watcher() i=3 2024-09-12T17:54:46.692 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.691+0000 7f6b2df30800 20 remove_watcher() i=4 2024-09-12T17:54:46.693 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.692+0000 7f6b2df30800 20 remove_watcher() i=5 2024-09-12T17:54:46.694 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.693+0000 7f6b2df30800 20 remove_watcher() i=6 2024-09-12T17:54:46.695 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.694+0000 7f6b2df30800 20 remove_watcher() i=7 2024-09-12T17:54:46.707 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:54:46.735 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:46.735 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:46.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.771+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.773+0000 7f2d31146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.774 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.773+0000 7f2d31146800 20 realm 2024-09-12T17:54:46.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.773+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.773+0000 7f2d31146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.773+0000 7f2d31146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:46.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.773+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.773+0000 7f2d31146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.773+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.774+0000 7f2d31146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:46.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.774+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.775+0000 7f2d31146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:46.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.775+0000 7f2d31146800 20 searching for the correct realm 2024-09-12T17:54:46.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.776+0000 7f2d2ec30640 0 -- 172.21.15.107:0/1089202415 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f2d2801f040 msgr2=0x7f2d28064b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:46.781 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.780+0000 7f2d2642f640 0 -- 172.21.15.107:0/1089202415 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x55f1601d2b20 msgr2=0x55f1601d4f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:46.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.785+0000 7f2d31146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:46.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.785+0000 7f2d31146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:46.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.785+0000 7f2d31146800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:46.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.785+0000 7f2d31146800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:46.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.785+0000 7f2d31146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:46.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.785+0000 7f2d31146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:46.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.785+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.785+0000 7f2d31146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.787 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.785+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.788 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.786+0000 7f2d31146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:46.788 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.786+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.786+0000 7f2d31146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:46.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.786+0000 7f2d31146800 20 zone default found 2024-09-12T17:54:46.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.786+0000 7f2d31146800 4 Realm: () 2024-09-12T17:54:46.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.786+0000 7f2d31146800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:46.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.786+0000 7f2d31146800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:46.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.786+0000 7f2d31146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:46.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.786+0000 7f2d31146800 20 zonegroup default 2024-09-12T17:54:46.789 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.786+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.786+0000 7f2d31146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.786+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.787+0000 7f2d31146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.787+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.787+0000 7f2d31146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:46.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.787+0000 7f2d31146800 20 started sync module instance, tier type = 2024-09-12T17:54:46.790 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.787+0000 7f2d31146800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:46.796 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.795+0000 7f2d31146800 20 add_watcher() i=0 2024-09-12T17:54:46.796 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.795+0000 7f2d31146800 20 add_watcher() i=1 2024-09-12T17:54:46.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.795+0000 7f2d31146800 20 add_watcher() i=2 2024-09-12T17:54:46.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.795+0000 7f2d31146800 20 add_watcher() i=3 2024-09-12T17:54:46.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.795+0000 7f2d31146800 20 add_watcher() i=4 2024-09-12T17:54:46.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.795+0000 7f2d31146800 20 add_watcher() i=5 2024-09-12T17:54:46.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.795+0000 7f2d31146800 20 add_watcher() i=6 2024-09-12T17:54:46.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.796+0000 7f2d31146800 20 add_watcher() i=7 2024-09-12T17:54:46.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.796+0000 7f2d31146800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:46.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.798+0000 7f2be57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:46.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.798+0000 7f2d31146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:46.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.798+0000 7f2d31146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:46.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.798+0000 7f2d31146800 5 note: GC not initialized 2024-09-12T17:54:46.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.798+0000 7f2b5ffff640 20 reqs_thread_entry: start 2024-09-12T17:54:46.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.798+0000 7f2d31146800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:46.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.798+0000 7f2d31146800 20 Filter name: none 2024-09-12T17:54:46.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.798+0000 7f2b5dffb640 20 reqs_thread_entry: start 2024-09-12T17:54:46.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.798+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.799+0000 7f2d31146800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:46.801 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.799+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.799+0000 7f2d31146800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:46.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.799+0000 7f2d31146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:46.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.799+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.800+0000 7f2d31146800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:46.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.800+0000 7f2d31146800 20 rados->read ofs=0 len=0 2024-09-12T17:54:46.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.800+0000 7f2d31146800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:46.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.800+0000 7f2d31146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:46.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.801+0000 7f2be57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:46.804 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.803+0000 7f2d31146800 20 remove_watcher() i=0 2024-09-12T17:54:46.804 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.803+0000 7f2d31146800 2 removed watcher, disabling cache 2024-09-12T17:54:46.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.804+0000 7f2d31146800 20 remove_watcher() i=1 2024-09-12T17:54:46.807 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.805+0000 7f2d31146800 20 remove_watcher() i=2 2024-09-12T17:54:46.807 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.806+0000 7f2d31146800 20 remove_watcher() i=3 2024-09-12T17:54:46.808 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.807+0000 7f2d31146800 20 remove_watcher() i=4 2024-09-12T17:54:46.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.808+0000 7f2d31146800 20 remove_watcher() i=5 2024-09-12T17:54:46.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.809+0000 7f2d31146800 20 remove_watcher() i=6 2024-09-12T17:54:46.811 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:46.810+0000 7f2d31146800 20 remove_watcher() i=7 2024-09-12T17:54:46.821 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:46.821 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:54:46.821 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: myver id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T17:54:46.821 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:46.868 INFO:tasks.workunit.client.0.smithi107.stderr: test: reshard removes olh entries with empty name 2024-09-12T17:54:46.961 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:54:46.989 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:46.990 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:47.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.026+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.027+0000 7fe9be328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.027+0000 7fe9be328800 20 realm 2024-09-12T17:54:47.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.028+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.028+0000 7fe9be328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.028+0000 7fe9be328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:47.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.028+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.028+0000 7fe9be328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.029 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.028+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.029+0000 7fe9be328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.029+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.030+0000 7fe9be328800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:47.031 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.030+0000 7fe9be328800 20 searching for the correct realm 2024-09-12T17:54:47.033 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.032+0000 7fe9ba06f640 0 -- 172.21.15.107:0/1437900128 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fe9b4027020 msgr2=0x7fe9b4063a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:47.036 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.035+0000 7fe9ba06f640 0 -- 172.21.15.107:0/1437900128 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fe9b00c65e0 msgr2=0x7fe9b00c2690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:47.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.039+0000 7fe9be328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:47.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.039+0000 7fe9be328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:47.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.039+0000 7fe9be328800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:47.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.039+0000 7fe9be328800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:47.041 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.039+0000 7fe9be328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:47.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.039+0000 7fe9be328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:47.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.039+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.042 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:47.043 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 20 zone default found 2024-09-12T17:54:47.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 4 Realm: () 2024-09-12T17:54:47.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:47.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:47.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:47.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 20 zonegroup default 2024-09-12T17:54:47.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.040+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.041+0000 7fe9be328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.041+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.044 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.041+0000 7fe9be328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.041+0000 7fe9be328800 20 started sync module instance, tier type = 2024-09-12T17:54:47.045 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.041+0000 7fe9be328800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:47.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.049+0000 7fe9be328800 20 add_watcher() i=0 2024-09-12T17:54:47.050 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.049+0000 7fe9be328800 20 add_watcher() i=1 2024-09-12T17:54:47.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.049+0000 7fe9be328800 20 add_watcher() i=2 2024-09-12T17:54:47.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.049+0000 7fe9be328800 20 add_watcher() i=3 2024-09-12T17:54:47.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.049+0000 7fe9be328800 20 add_watcher() i=4 2024-09-12T17:54:47.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.049+0000 7fe9be328800 20 add_watcher() i=5 2024-09-12T17:54:47.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.049+0000 7fe9be328800 20 add_watcher() i=6 2024-09-12T17:54:47.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.050+0000 7fe9be328800 20 add_watcher() i=7 2024-09-12T17:54:47.051 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.050+0000 7fe9be328800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:47.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.052+0000 7fe870fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.052+0000 7fe9be328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:47.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.052+0000 7fe9be328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:47.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.052+0000 7fe9be328800 5 note: GC not initialized 2024-09-12T17:54:47.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.052+0000 7fe7eb7fe640 20 reqs_thread_entry: start 2024-09-12T17:54:47.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.052+0000 7fe9be328800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:47.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.052+0000 7fe9be328800 20 Filter name: none 2024-09-12T17:54:47.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.053+0000 7fe7e97fa640 20 reqs_thread_entry: start 2024-09-12T17:54:47.054 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.053+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.053+0000 7fe9be328800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:47.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.053+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.054+0000 7fe9be328800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:54:47.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.054+0000 7fe9be328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:47.055 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.054+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.054+0000 7fe9be328800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:47.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.054+0000 7fe9be328800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.055+0000 7fe9be328800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:54:47.056 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.055+0000 7fe9be328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:47.057 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.056+0000 7fe870fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.058+0000 7fe9be328800 20 remove_watcher() i=0 2024-09-12T17:54:47.059 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.058+0000 7fe9be328800 2 removed watcher, disabling cache 2024-09-12T17:54:47.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.059+0000 7fe9be328800 20 remove_watcher() i=1 2024-09-12T17:54:47.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.060+0000 7fe9be328800 20 remove_watcher() i=2 2024-09-12T17:54:47.062 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.061+0000 7fe9be328800 20 remove_watcher() i=3 2024-09-12T17:54:47.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.062+0000 7fe9be328800 20 remove_watcher() i=4 2024-09-12T17:54:47.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.063+0000 7fe9be328800 20 remove_watcher() i=5 2024-09-12T17:54:47.065 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.064+0000 7fe9be328800 20 remove_watcher() i=6 2024-09-12T17:54:47.066 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.065+0000 7fe9be328800 20 remove_watcher() i=7 2024-09-12T17:54:47.076 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:47.076 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:54:47.076 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: a-bucket id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-12T17:54:47.077 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:47.078 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T17:54:47.106 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:47.108 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:47.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.141+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.343+0000 7f331e575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.343+0000 7f331e575800 20 realm 2024-09-12T17:54:47.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.343+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.344+0000 7f331e575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.344+0000 7f331e575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:47.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.344+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.344+0000 7f331e575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.345 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.344+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.345+0000 7f331e575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.346 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.345+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.346+0000 7f331e575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:47.347 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.346+0000 7f331e575800 20 searching for the correct realm 2024-09-12T17:54:47.348 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.347+0000 7f331b85e640 0 -- 172.21.15.107:0/2446960212 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f3310039500 msgr2=0x7f3310067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:47.554 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.553+0000 7f331c05f640 0 -- 172.21.15.107:0/2446960212 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f3310068040 msgr2=0x7f33100640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:47.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.759+0000 7f331e575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:47.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.759+0000 7f331e575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:47.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.759+0000 7f331e575800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:47.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.759+0000 7f331e575800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:47.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.759+0000 7f331e575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:47.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.759+0000 7f331e575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:47.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.759+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.759+0000 7f331e575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.761 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.759+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.759+0000 7f331e575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.759+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.760+0000 7f331e575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:47.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.760+0000 7f331e575800 20 zone default found 2024-09-12T17:54:47.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.760+0000 7f331e575800 4 Realm: () 2024-09-12T17:54:47.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.760+0000 7f331e575800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:47.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.760+0000 7f331e575800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:47.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.760+0000 7f331e575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:47.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.760+0000 7f331e575800 20 zonegroup default 2024-09-12T17:54:47.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.760+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.760+0000 7f331e575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.760+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.760+0000 7f331e575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.760+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.761+0000 7f331e575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.761+0000 7f331e575800 20 started sync module instance, tier type = 2024-09-12T17:54:47.766 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.761+0000 7f331e575800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:47.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.769+0000 7f331e575800 20 add_watcher() i=0 2024-09-12T17:54:47.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.769+0000 7f331e575800 20 add_watcher() i=1 2024-09-12T17:54:47.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.769+0000 7f331e575800 20 add_watcher() i=2 2024-09-12T17:54:47.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.769+0000 7f331e575800 20 add_watcher() i=3 2024-09-12T17:54:47.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.769+0000 7f331e575800 20 add_watcher() i=4 2024-09-12T17:54:47.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.769+0000 7f331e575800 20 add_watcher() i=5 2024-09-12T17:54:47.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.769+0000 7f331e575800 20 add_watcher() i=6 2024-09-12T17:54:47.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.770+0000 7f331e575800 20 add_watcher() i=7 2024-09-12T17:54:47.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.770+0000 7f331e575800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:47.773 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.772+0000 7f31d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.773+0000 7f331e575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:47.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.773+0000 7f331e575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:47.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.773+0000 7f331e575800 5 note: GC not initialized 2024-09-12T17:54:47.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.773+0000 7f31d1fdb640 20 reqs_thread_entry: start 2024-09-12T17:54:47.776 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.773+0000 7f331e575800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:47.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.773+0000 7f331e575800 20 Filter name: none 2024-09-12T17:54:47.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.773+0000 7f31437fe640 20 reqs_thread_entry: start 2024-09-12T17:54:47.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.773+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.774+0000 7f331e575800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:47.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.774+0000 7f331e575800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.774+0000 7f331e575800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:54:47.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.774+0000 7f331e575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:47.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.775+0000 7f31d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.777+0000 7f331e575800 20 remove_watcher() i=0 2024-09-12T17:54:47.779 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.777+0000 7f331e575800 2 removed watcher, disabling cache 2024-09-12T17:54:47.780 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.778+0000 7f331e575800 20 remove_watcher() i=1 2024-09-12T17:54:47.780 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.779+0000 7f331e575800 20 remove_watcher() i=2 2024-09-12T17:54:47.782 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.781+0000 7f331e575800 20 remove_watcher() i=3 2024-09-12T17:54:47.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.782+0000 7f331e575800 20 remove_watcher() i=4 2024-09-12T17:54:47.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.783+0000 7f331e575800 20 remove_watcher() i=5 2024-09-12T17:54:47.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.783+0000 7f331e575800 20 remove_watcher() i=6 2024-09-12T17:54:47.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.784+0000 7f331e575800 20 remove_watcher() i=7 2024-09-12T17:54:47.797 INFO:tasks.workunit.client.0.smithi107.stderr:rados -p default.rgw.buckets.index setomapval .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T17:54:47.823 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:47.823 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:47.840 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:54:47.868 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:47.868 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:47.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.903+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.905+0000 7ff601f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.905+0000 7ff601f46800 20 realm 2024-09-12T17:54:47.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.905+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.905+0000 7ff601f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.905+0000 7ff601f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:47.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.905+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.905+0000 7ff601f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.905+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.906+0000 7ff601f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.906+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.907+0000 7ff601f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:47.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.907+0000 7ff601f46800 20 searching for the correct realm 2024-09-12T17:54:47.911 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.910+0000 7ff5ffa30640 0 -- 172.21.15.107:0/3282252244 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7ff5f808a6d0 msgr2=0x7ff5f80891a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:47.915 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.914+0000 7ff5ffa30640 0 -- 172.21.15.107:0/3282252244 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7ff5e8070170 msgr2=0x7ff5e806a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:47.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.918+0000 7ff601f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:47.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.918+0000 7ff601f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:47.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.918+0000 7ff601f46800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:47.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.918+0000 7ff601f46800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:47.919 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.918+0000 7ff601f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:47.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.918+0000 7ff601f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:47.920 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.918+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.921 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.918+0000 7ff601f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.918+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.919+0000 7ff601f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:47.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.919+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.919+0000 7ff601f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:47.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.919+0000 7ff601f46800 20 zone default found 2024-09-12T17:54:47.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.919+0000 7ff601f46800 4 Realm: () 2024-09-12T17:54:47.922 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.919+0000 7ff601f46800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:47.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.919+0000 7ff601f46800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:47.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.919+0000 7ff601f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:47.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.919+0000 7ff601f46800 20 zonegroup default 2024-09-12T17:54:47.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.919+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.919+0000 7ff601f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.923 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.919+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.920+0000 7ff601f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.920+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.920+0000 7ff601f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:47.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.920+0000 7ff601f46800 20 started sync module instance, tier type = 2024-09-12T17:54:47.924 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.920+0000 7ff601f46800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:47.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.929+0000 7ff601f46800 20 add_watcher() i=0 2024-09-12T17:54:47.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.929+0000 7ff601f46800 20 add_watcher() i=1 2024-09-12T17:54:47.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.929+0000 7ff601f46800 20 add_watcher() i=2 2024-09-12T17:54:47.930 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.929+0000 7ff601f46800 20 add_watcher() i=3 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.929+0000 7ff601f46800 20 add_watcher() i=4 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.929+0000 7ff601f46800 20 add_watcher() i=5 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.929+0000 7ff601f46800 20 add_watcher() i=6 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.930+0000 7ff601f46800 20 add_watcher() i=7 2024-09-12T17:54:47.931 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.930+0000 7ff601f46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:47.932 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.931+0000 7ff4b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.931+0000 7ff601f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:47.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.931+0000 7ff601f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:47.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.931+0000 7ff601f46800 5 note: GC not initialized 2024-09-12T17:54:47.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.932+0000 7ff4b4fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:47.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.932+0000 7ff601f46800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:47.933 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.932+0000 7ff601f46800 20 Filter name: none 2024-09-12T17:54:47.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.932+0000 7ff42e7fc640 20 reqs_thread_entry: start 2024-09-12T17:54:47.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.932+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.934 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.932+0000 7ff601f46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.932+0000 7ff601f46800 20 rados->read ofs=0 len=0 2024-09-12T17:54:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.933+0000 7ff601f46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:54:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.933+0000 7ff601f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.933+0000 7ff601f46800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T17:54:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.933+0000 7ff601f46800 20 INFO: main: starting shard=0 2024-09-12T17:54:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.933+0000 7ff601f46800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:54:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.933+0000 7ff601f46800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:54:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.933+0000 7ff601f46800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:54:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.934+0000 7ff601f46800 20 INFO: main: starting shard=1 2024-09-12T17:54:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.934+0000 7ff601f46800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:54:47.935 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.934+0000 7ff601f46800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:54:47.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.934+0000 7ff601f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:54:47.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.934+0000 7ff601f46800 20 INFO: main: starting shard=2 2024-09-12T17:54:47.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.934+0000 7ff601f46800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:54:47.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.934+0000 7ff601f46800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:54:47.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.935+0000 7ff601f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:54:47.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.935+0000 7ff601f46800 20 INFO: main: done 2024-09-12T17:54:47.936 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.935+0000 7ff4b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:47.938 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.937+0000 7ff601f46800 20 remove_watcher() i=0 2024-09-12T17:54:47.938 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.937+0000 7ff601f46800 2 removed watcher, disabling cache 2024-09-12T17:54:47.939 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.938+0000 7ff601f46800 20 remove_watcher() i=1 2024-09-12T17:54:47.940 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.939+0000 7ff601f46800 20 remove_watcher() i=2 2024-09-12T17:54:47.941 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.940+0000 7ff601f46800 20 remove_watcher() i=3 2024-09-12T17:54:47.942 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.941+0000 7ff601f46800 20 remove_watcher() i=4 2024-09-12T17:54:47.943 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.942+0000 7ff601f46800 20 remove_watcher() i=5 2024-09-12T17:54:47.944 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.943+0000 7ff601f46800 20 remove_watcher() i=6 2024-09-12T17:54:47.945 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:47.944+0000 7ff601f46800 20 remove_watcher() i=7 2024-09-12T17:54:47.957 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T17:54:47.989 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:47.989 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:48.025 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.024+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.026 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.025+0000 7fea7a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.025+0000 7fea7a898800 20 realm 2024-09-12T17:54:48.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.025+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.025+0000 7fea7a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.025+0000 7fea7a898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:48.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.025+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.025+0000 7fea7a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.025+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.027 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.026+0000 7fea7a898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:48.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.026+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.027+0000 7fea7a898800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:48.028 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.027+0000 7fea7a898800 20 searching for the correct realm 2024-09-12T17:54:48.030 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.029+0000 7fea6fb81640 0 -- 172.21.15.107:0/3076602619 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fea60039030 msgr2=0x7fea60067d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:48.235 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.234+0000 7fea78382640 0 -- 172.21.15.107:0/3076602619 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fea6007e300 msgr2=0x7fea60067410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:48.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.441+0000 7fea7a898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:48.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.441+0000 7fea7a898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:48.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.441+0000 7fea7a898800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:48.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.441+0000 7fea7a898800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:48.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.441+0000 7fea7a898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:48.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.441+0000 7fea7a898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:48.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.441+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.441+0000 7fea7a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.441+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.441+0000 7fea7a898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:48.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.441+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.442+0000 7fea7a898800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:48.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.442+0000 7fea7a898800 20 zone default found 2024-09-12T17:54:48.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.442+0000 7fea7a898800 4 Realm: () 2024-09-12T17:54:48.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.442+0000 7fea7a898800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:48.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.442+0000 7fea7a898800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:48.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.442+0000 7fea7a898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:48.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.442+0000 7fea7a898800 20 zonegroup default 2024-09-12T17:54:48.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.442+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.442+0000 7fea7a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.442+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.443+0000 7fea7a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.443+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.443+0000 7fea7a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.443+0000 7fea7a898800 20 started sync module instance, tier type = 2024-09-12T17:54:48.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.443+0000 7fea7a898800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:48.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.452+0000 7fea7a898800 20 add_watcher() i=0 2024-09-12T17:54:48.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.452+0000 7fea7a898800 20 add_watcher() i=1 2024-09-12T17:54:48.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.452+0000 7fea7a898800 20 add_watcher() i=2 2024-09-12T17:54:48.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.452+0000 7fea7a898800 20 add_watcher() i=3 2024-09-12T17:54:48.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.452+0000 7fea7a898800 20 add_watcher() i=4 2024-09-12T17:54:48.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.452+0000 7fea7a898800 20 add_watcher() i=5 2024-09-12T17:54:48.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.452+0000 7fea7a898800 20 add_watcher() i=6 2024-09-12T17:54:48.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.453+0000 7fea7a898800 20 add_watcher() i=7 2024-09-12T17:54:48.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.453+0000 7fea7a898800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:48.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.455+0000 7fe92efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:48.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.455+0000 7fea7a898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:48.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.455+0000 7fea7a898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:48.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.456+0000 7fea7a898800 5 note: GC not initialized 2024-09-12T17:54:48.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.456+0000 7fe92dfdb640 20 reqs_thread_entry: start 2024-09-12T17:54:48.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.456+0000 7fea7a898800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:48.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.456+0000 7fea7a898800 20 Filter name: none 2024-09-12T17:54:48.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.456+0000 7fe89f7fe640 20 reqs_thread_entry: start 2024-09-12T17:54:48.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.456+0000 7fea7a898800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:54:48.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.456+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.457+0000 7fea7a898800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:48.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.457+0000 7fea7a898800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:54:48.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.457+0000 7fea7a898800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:54:48.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.457+0000 7fea7a898800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : miss 2024-09-12T17:54:48.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.457+0000 7fea7a898800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.457+0000 7fea7a898800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:54:48.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.457+0000 7fea7a898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:48.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.457+0000 7fea7a898800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:48.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.457+0000 7fea7a898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:48.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.457+0000 7fea7a898800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:48.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.457+0000 7fea7a898800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:54:48.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.461+0000 7fea7a898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:48.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.461+0000 7fea7a898800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:48.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.461+0000 7fea7a898800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:48.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.461+0000 7fea7a898800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:54:48.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.462+0000 7fe94effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464341 cookie 94285335499344 notifier 8012 bl.length()=911 2024-09-12T17:54:48.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.462+0000 7fe94effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:48.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.462+0000 7fe94effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:48.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.462+0000 7fe94effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:48.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.462+0000 7fea7a898800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:54:48.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.462+0000 7fea7a898800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:54:48.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.462+0000 7fea7a898800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:54:48.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.462+0000 7fea7a898800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:54:48.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.466+0000 7fea7a898800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.0 2024-09-12T17:54:48.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.466+0000 7fea7a898800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.0 2024-09-12T17:54:48.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.466+0000 7fea7a898800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:54:48.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.466+0000 7fea7a898800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:54:48.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.466+0000 7fea7a898800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T17:54:48.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.466+0000 7fea7a898800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:54:48.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.466+0000 7fea7a898800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:54:48.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.467+0000 7fea7a898800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:54:48.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.467+0000 7fea7a898800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:54:48.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.467+0000 7fea7a898800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:48.469 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.467+0000 7fea7a898800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:54:48.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.469+0000 7fea7a898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:48.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.469+0000 7fea7a898800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:48.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.469+0000 7fea7a898800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:48.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.469+0000 7fea7a898800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:54:48.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.469+0000 7fe94f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464342 cookie 94285335499344 notifier 8012 bl.length()=911 2024-09-12T17:54:48.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.469+0000 7fe94f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:48.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.469+0000 7fe94f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:48.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.469+0000 7fe94f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:48.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.470+0000 7fea7a898800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:54:48.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.470+0000 7fea7a898800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:54:48.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.470+0000 7fea7a898800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:54:48.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.470+0000 7fea7a898800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:54:48.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.472+0000 7fea7a898800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:54:48.473 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.472+0000 7fea7a898800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.0 2024-09-12T17:54:48.473 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.472+0000 7fea7a898800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:54:48.473 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.472+0000 7fea7a898800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.1 2024-09-12T17:54:48.473 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.472+0000 7fea7a898800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:54:48.473 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.472+0000 7fea7a898800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.2.2 2024-09-12T17:54:48.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.473+0000 7fea7a898800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:48.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.473+0000 7fea7a898800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 2024-09-12T17:54:48.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.474+0000 7fea7a898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:48.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.474+0000 7fea7a898800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:48.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.474+0000 7fea7a898800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:48.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.474+0000 7fea7a898800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18, ofs0, ns] 2024-09-12T17:54:48.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.475+0000 7fe94effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464343 cookie 94285335499344 notifier 8012 bl.length()=879 2024-09-12T17:54:48.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.475+0000 7fe94effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 info.flags=0x17 2024-09-12T17:54:48.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.475+0000 7fe94effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.18 to cache LRU end 2024-09-12T17:54:48.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.475+0000 7fe94effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:48.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.475+0000 7fea7a898800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_sources= new_sources= 2024-09-12T17:54:48.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.475+0000 7fea7a898800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential sources added=[] removed=[] 2024-09-12T17:54:48.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.475+0000 7fea7a898800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): orig_dests= new_dests= 2024-09-12T17:54:48.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.475+0000 7fea7a898800 20 handle_bi_update(): bucket=:a-bucket[35ed0db6-4f54-4e96-b306-71079c84e007.4596.18]): potential dests added=[] removed=[] 2024-09-12T17:54:48.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.476+0000 7fea7a898800 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-12T17:54:48.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.478+0000 7fe92efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:48.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.481+0000 7fea7a898800 20 remove_watcher() i=0 2024-09-12T17:54:48.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.481+0000 7fea7a898800 2 removed watcher, disabling cache 2024-09-12T17:54:48.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.482+0000 7fea7a898800 20 remove_watcher() i=1 2024-09-12T17:54:48.483 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.482+0000 7fea7a898800 20 remove_watcher() i=2 2024-09-12T17:54:48.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.484+0000 7fea7a898800 20 remove_watcher() i=3 2024-09-12T17:54:48.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.485+0000 7fea7a898800 20 remove_watcher() i=4 2024-09-12T17:54:48.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.486+0000 7fea7a898800 20 remove_watcher() i=5 2024-09-12T17:54:48.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.486+0000 7fea7a898800 20 remove_watcher() i=6 2024-09-12T17:54:48.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.487+0000 7fea7a898800 20 remove_watcher() i=7 2024-09-12T17:54:48.501 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:54:48.529 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:48.530 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:48.566 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.564+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.567 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.566+0000 7f928cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.566+0000 7f928cf23800 20 realm 2024-09-12T17:54:48.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.566+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.566+0000 7f928cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.566+0000 7f928cf23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:48.568 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.566+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.566+0000 7f928cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.569 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.566+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.567+0000 7f928cf23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:48.570 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.567+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.568+0000 7f928cf23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:48.571 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.568+0000 7f928cf23800 20 searching for the correct realm 2024-09-12T17:54:48.573 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.570+0000 7f9283fff640 0 -- 172.21.15.107:0/3379718198 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f927406b030 msgr2=0x7f927406c940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:48.575 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.574+0000 7f9288c0c640 0 -- 172.21.15.107:0/3379718198 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f92740d55a0 msgr2=0x7f92740c6980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:48.782 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.781+0000 7f928cf23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:48.782 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.781+0000 7f928cf23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:48.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.781+0000 7f928cf23800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:48.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.781+0000 7f928cf23800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:48.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.781+0000 7f928cf23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:48.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.781+0000 7f928cf23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:48.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.781+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.781+0000 7f928cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.783 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.781+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.782+0000 7f928cf23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:48.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.782+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.782+0000 7f928cf23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:48.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.782+0000 7f928cf23800 20 zone default found 2024-09-12T17:54:48.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.782+0000 7f928cf23800 4 Realm: () 2024-09-12T17:54:48.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.782+0000 7f928cf23800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:48.784 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.782+0000 7f928cf23800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:48.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.782+0000 7f928cf23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:48.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.782+0000 7f928cf23800 20 zonegroup default 2024-09-12T17:54:48.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.782+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.782+0000 7f928cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.782+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.783+0000 7f928cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.783+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.783+0000 7f928cf23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.783+0000 7f928cf23800 20 started sync module instance, tier type = 2024-09-12T17:54:48.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.783+0000 7f928cf23800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:48.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.793+0000 7f928cf23800 20 add_watcher() i=0 2024-09-12T17:54:48.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.793+0000 7f928cf23800 20 add_watcher() i=1 2024-09-12T17:54:48.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.793+0000 7f928cf23800 20 add_watcher() i=2 2024-09-12T17:54:48.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.793+0000 7f928cf23800 20 add_watcher() i=3 2024-09-12T17:54:48.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.793+0000 7f928cf23800 20 add_watcher() i=4 2024-09-12T17:54:48.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.793+0000 7f928cf23800 20 add_watcher() i=5 2024-09-12T17:54:48.794 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.793+0000 7f928cf23800 20 add_watcher() i=6 2024-09-12T17:54:48.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.793+0000 7f928cf23800 20 add_watcher() i=7 2024-09-12T17:54:48.795 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.793+0000 7f928cf23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:48.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.796+0000 7f913efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:48.797 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.796+0000 7f928cf23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:48.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.796+0000 7f928cf23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:48.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.796+0000 7f928cf23800 5 note: GC not initialized 2024-09-12T17:54:48.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.796+0000 7f913dfe3640 20 reqs_thread_entry: start 2024-09-12T17:54:48.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.796+0000 7f928cf23800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:48.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.796+0000 7f928cf23800 20 Filter name: none 2024-09-12T17:54:48.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.796+0000 7f90af7fe640 20 reqs_thread_entry: start 2024-09-12T17:54:48.798 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.796+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.797+0000 7f928cf23800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:54:48.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.797+0000 7f928cf23800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.797+0000 7f928cf23800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:54:48.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.797+0000 7f928cf23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:48.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.797+0000 7f928cf23800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T17:54:48.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.797+0000 7f928cf23800 20 INFO: main: starting shard=0 2024-09-12T17:54:48.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.797+0000 7f928cf23800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.0 2024-09-12T17:54:48.799 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.797+0000 7f928cf23800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.18.3.0 2024-09-12T17:54:48.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.798+0000 7f928cf23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:54:48.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.798+0000 7f928cf23800 20 INFO: main: done 2024-09-12T17:54:48.800 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.799+0000 7f913efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:48.802 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.802+0000 7f928cf23800 20 remove_watcher() i=0 2024-09-12T17:54:48.803 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.802+0000 7f928cf23800 2 removed watcher, disabling cache 2024-09-12T17:54:48.804 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.803+0000 7f928cf23800 20 remove_watcher() i=1 2024-09-12T17:54:48.805 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.804+0000 7f928cf23800 20 remove_watcher() i=2 2024-09-12T17:54:48.806 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.805+0000 7f928cf23800 20 remove_watcher() i=3 2024-09-12T17:54:48.808 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.806+0000 7f928cf23800 20 remove_watcher() i=4 2024-09-12T17:54:48.808 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.807+0000 7f928cf23800 20 remove_watcher() i=5 2024-09-12T17:54:48.809 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.808+0000 7f928cf23800 20 remove_watcher() i=6 2024-09-12T17:54:48.810 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.809+0000 7f928cf23800 20 remove_watcher() i=7 2024-09-12T17:54:48.820 INFO:tasks.workunit.client.0.smithi107.stderr: test: PUT succeeds during reshard 2024-09-12T17:54:48.821 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:54:48.850 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:48.850 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:48.885 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.884+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.887 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.886+0000 7f23a420e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.886+0000 7f23a420e800 20 realm 2024-09-12T17:54:48.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.886+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.886+0000 7f23a420e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.886+0000 7f23a420e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:48.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.886+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.887+0000 7f23a420e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:48.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.887+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.888 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.887+0000 7f23a420e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:48.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.887+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:48.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.888+0000 7f23a420e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:48.889 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.888+0000 7f23a420e800 20 searching for the correct realm 2024-09-12T17:54:48.891 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.890+0000 7f239f058640 0 -- 172.21.15.107:0/2813157609 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f2394047070 msgr2=0x7f239406b480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:48.895 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:48.895+0000 7f239f859640 0 -- 172.21.15.107:0/2813157609 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f239406ca10 msgr2=0x7f239409b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:49.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.101+0000 7f23a420e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:49.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.101+0000 7f23a420e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:49.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.101+0000 7f23a420e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:49.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.101+0000 7f23a420e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:49.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.101+0000 7f23a420e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:49.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.101+0000 7f23a420e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:49.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.101+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:49.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.103 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:49.104 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:49.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 20 zone default found 2024-09-12T17:54:49.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 4 Realm: () 2024-09-12T17:54:49.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:49.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:49.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:49.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 20 zonegroup default 2024-09-12T17:54:49.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:49.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.102+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.103+0000 7f23a420e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:49.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.103+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.103+0000 7f23a420e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:49.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.103+0000 7f23a420e800 20 started sync module instance, tier type = 2024-09-12T17:54:49.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.103+0000 7f23a420e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:49.114 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.113+0000 7f23a420e800 20 add_watcher() i=0 2024-09-12T17:54:49.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.113+0000 7f23a420e800 20 add_watcher() i=1 2024-09-12T17:54:49.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.113+0000 7f23a420e800 20 add_watcher() i=2 2024-09-12T17:54:49.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.113+0000 7f23a420e800 20 add_watcher() i=3 2024-09-12T17:54:49.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.113+0000 7f23a420e800 20 add_watcher() i=4 2024-09-12T17:54:49.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.113+0000 7f23a420e800 20 add_watcher() i=5 2024-09-12T17:54:49.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.113+0000 7f23a420e800 20 add_watcher() i=6 2024-09-12T17:54:49.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.114+0000 7f23a420e800 20 add_watcher() i=7 2024-09-12T17:54:49.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.114+0000 7f23a420e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:49.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.115+0000 7f2255fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:49.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.116+0000 7f23a420e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:49.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.116+0000 7f23a420e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:49.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.116+0000 7f23a420e800 5 note: GC not initialized 2024-09-12T17:54:49.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.116+0000 7f2254fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:49.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.116+0000 7f23a420e800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:49.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.116+0000 7f23a420e800 20 Filter name: none 2024-09-12T17:54:49.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.116+0000 7f21ce7fc640 20 reqs_thread_entry: start 2024-09-12T17:54:49.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.116+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.117+0000 7f23a420e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:49.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.117+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.117+0000 7f23a420e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:49.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.117+0000 7f23a420e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:49.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.117+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.117+0000 7f23a420e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:49.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.117+0000 7f23a420e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.118+0000 7f23a420e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:49.122 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.118+0000 7f23a420e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:49.123 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.119+0000 7f2255fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:49.123 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.122+0000 7f23a420e800 20 remove_watcher() i=0 2024-09-12T17:54:49.123 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.122+0000 7f23a420e800 2 removed watcher, disabling cache 2024-09-12T17:54:49.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.123+0000 7f23a420e800 20 remove_watcher() i=1 2024-09-12T17:54:49.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.124+0000 7f23a420e800 20 remove_watcher() i=2 2024-09-12T17:54:49.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.125+0000 7f23a420e800 20 remove_watcher() i=3 2024-09-12T17:54:49.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.126+0000 7f23a420e800 20 remove_watcher() i=4 2024-09-12T17:54:49.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.127+0000 7f23a420e800 20 remove_watcher() i=5 2024-09-12T17:54:49.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.127+0000 7f23a420e800 20 remove_watcher() i=6 2024-09-12T17:54:49.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.128+0000 7f23a420e800 20 remove_watcher() i=7 2024-09-12T17:54:49.139 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:49.139 INFO:tasks.workunit.client.0.smithi107.stderr:BUCKET_STATS: 2024-09-12T17:54:49.140 INFO:tasks.workunit.client.0.smithi107.stderr:bucket: myver id: 35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T17:54:49.140 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:49.142 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-12T17:54:49.175 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:49.175 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:49.212 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.211+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.212+0000 7fc0cf90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.212+0000 7fc0cf90c800 20 realm 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.212+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.212+0000 7fc0cf90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:49.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.212+0000 7fc0cf90c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:49.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.212+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.212+0000 7fc0cf90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:49.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.212+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.213+0000 7fc0cf90c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:49.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.213+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.214+0000 7fc0cf90c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:49.215 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.214+0000 7fc0cf90c800 20 searching for the correct realm 2024-09-12T17:54:49.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.217+0000 7fc0cdbf7640 0 -- 172.21.15.107:0/1675932016 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5574440ac260 msgr2=0x5574440ae720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:49.222 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.221+0000 7fc0cd3f6640 0 -- 172.21.15.107:0/1675932016 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc0b8048830 msgr2=0x7fc0b8086160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:49.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.428+0000 7fc0cf90c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:49.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.428+0000 7fc0cf90c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:49.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.428+0000 7fc0cf90c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:49.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.428+0000 7fc0cf90c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:49.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.428+0000 7fc0cf90c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:49.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.428+0000 7fc0cf90c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:49.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.428+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.428+0000 7fc0cf90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:49.430 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.428+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.429+0000 7fc0cf90c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:49.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.429+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.429+0000 7fc0cf90c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:49.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.429+0000 7fc0cf90c800 20 zone default found 2024-09-12T17:54:49.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.429+0000 7fc0cf90c800 4 Realm: () 2024-09-12T17:54:49.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.429+0000 7fc0cf90c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:49.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.429+0000 7fc0cf90c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:49.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.429+0000 7fc0cf90c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:49.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.429+0000 7fc0cf90c800 20 zonegroup default 2024-09-12T17:54:49.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.429+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.429+0000 7fc0cf90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:49.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.430+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.430+0000 7fc0cf90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:49.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.430+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.430+0000 7fc0cf90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:49.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.430+0000 7fc0cf90c800 20 started sync module instance, tier type = 2024-09-12T17:54:49.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.430+0000 7fc0cf90c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:49.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.440+0000 7fc0cf90c800 20 add_watcher() i=0 2024-09-12T17:54:49.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.440+0000 7fc0cf90c800 20 add_watcher() i=1 2024-09-12T17:54:49.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.440+0000 7fc0cf90c800 20 add_watcher() i=2 2024-09-12T17:54:49.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.440+0000 7fc0cf90c800 20 add_watcher() i=3 2024-09-12T17:54:49.441 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.440+0000 7fc0cf90c800 20 add_watcher() i=4 2024-09-12T17:54:49.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.440+0000 7fc0cf90c800 20 add_watcher() i=5 2024-09-12T17:54:49.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.440+0000 7fc0cf90c800 20 add_watcher() i=6 2024-09-12T17:54:49.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.441+0000 7fc0cf90c800 20 add_watcher() i=7 2024-09-12T17:54:49.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.441+0000 7fc0cf90c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:49.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.442+0000 7fbf83fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:49.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.443+0000 7fc0cf90c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:49.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.443+0000 7fc0cf90c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:49.444 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.443+0000 7fc0cf90c800 5 note: GC not initialized 2024-09-12T17:54:49.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.443+0000 7fbf82fe5640 20 reqs_thread_entry: start 2024-09-12T17:54:49.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.443+0000 7fc0cf90c800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:49.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.443+0000 7fc0cf90c800 20 Filter name: none 2024-09-12T17:54:49.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.443+0000 7fbf80fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:49.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.443+0000 7fc0cf90c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:54:49.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.443+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.444+0000 7fc0cf90c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:49.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.444+0000 7fc0cf90c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:54:49.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.444+0000 7fc0cf90c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:54:49.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.444+0000 7fc0cf90c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 : miss 2024-09-12T17:54:49.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.444+0000 7fc0cf90c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:49.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.444+0000 7fc0cf90c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:49.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.444+0000 7fc0cf90c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:49.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.444+0000 7fc0cf90c800 10 adding default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:49.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.444+0000 7fc0cf90c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:49.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.444+0000 7fc0cf90c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:49.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.444+0000 7fc0cf90c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 2024-09-12T17:54:49.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.448+0000 7fc0cf90c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:49.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.448+0000 7fc0cf90c800 10 moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:49.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.448+0000 7fc0cf90c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:49.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.448+0000 7fc0cf90c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19, ofs0, ns] 2024-09-12T17:54:49.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.448+0000 7fbf9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464308 cookie 93957846137600 notifier 8066 bl.length()=905 2024-09-12T17:54:49.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.448+0000 7fbf9ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:49.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.448+0000 7fbf9ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:49.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.448+0000 7fbf9ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:49.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.449+0000 7fc0cf90c800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_sources= new_sources= 2024-09-12T17:54:49.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.449+0000 7fc0cf90c800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential sources added=[] removed=[] 2024-09-12T17:54:49.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.449+0000 7fc0cf90c800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_dests= new_dests= 2024-09-12T17:54:49.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.449+0000 7fc0cf90c800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential dests added=[] removed=[] 2024-09-12T17:54:49.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:49.451+0000 7fc0cf90c800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T17:54:50.159 INFO:tasks.workunit.client.0.smithi107.stderr:put object successful 2024-09-12T17:54:54.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.452+0000 7fc0cf90c800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.0 2024-09-12T17:54:54.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.452+0000 7fc0cf90c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.0 2024-09-12T17:54:54.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.452+0000 7fc0cf90c800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.1 2024-09-12T17:54:54.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.452+0000 7fc0cf90c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.1 2024-09-12T17:54:54.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.452+0000 7fc0cf90c800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.2 2024-09-12T17:54:54.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.452+0000 7fc0cf90c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.2 2024-09-12T17:54:54.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.452+0000 7fc0cf90c800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.1.0 2024-09-12T17:54:54.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.452+0000 7fc0cf90c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.1.0 2024-09-12T17:54:54.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.453+0000 7fc0cf90c800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.1.1 2024-09-12T17:54:54.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.453+0000 7fc0cf90c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.1.1 2024-09-12T17:54:54.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.456+0000 7fc0cf90c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:54.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.456+0000 7fc0cf90c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 2024-09-12T17:54:54.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.458+0000 7fc0cf90c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:54.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.458+0000 7fc0cf90c800 10 moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:54.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.458+0000 7fc0cf90c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:54.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.458+0000 7fc0cf90c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19, ofs0, ns] 2024-09-12T17:54:54.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.458+0000 7fbfb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 93957846137600 notifier 8066 bl.length()=905 2024-09-12T17:54:54.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.458+0000 7fbfb0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:54.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.458+0000 7fbfb0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:54.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.458+0000 7fbfb0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:54.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.459+0000 7fc0cf90c800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_sources= new_sources= 2024-09-12T17:54:54.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.459+0000 7fc0cf90c800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential sources added=[] removed=[] 2024-09-12T17:54:54.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.459+0000 7fc0cf90c800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_dests= new_dests= 2024-09-12T17:54:54.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.459+0000 7fc0cf90c800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential dests added=[] removed=[] 2024-09-12T17:54:54.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.460+0000 7fc0cf90c800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.1.0 2024-09-12T17:54:54.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.460+0000 7fc0cf90c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.1.0 2024-09-12T17:54:54.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.461+0000 7fc0cf90c800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.1.1 2024-09-12T17:54:54.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.461+0000 7fc0cf90c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.1.1 2024-09-12T17:54:54.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.464+0000 7fc0cf90c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:54.464 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.464+0000 7fc0cf90c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 2024-09-12T17:54:54.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.465+0000 7fc0cf90c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:54.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.465+0000 7fc0cf90c800 10 moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:54.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.465+0000 7fc0cf90c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:54.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.465+0000 7fc0cf90c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19, ofs0, ns] 2024-09-12T17:54:54.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.466+0000 7fbf9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464310 cookie 93957846137600 notifier 8066 bl.length()=873 2024-09-12T17:54:54.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.466+0000 7fbf9ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:54.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.466+0000 7fbf9ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:54.466 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.466+0000 7fbf9ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:54.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.466+0000 7fc0cf90c800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_sources= new_sources= 2024-09-12T17:54:54.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.466+0000 7fc0cf90c800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential sources added=[] removed=[] 2024-09-12T17:54:54.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.466+0000 7fc0cf90c800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_dests= new_dests= 2024-09-12T17:54:54.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.466+0000 7fc0cf90c800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential dests added=[] removed=[] 2024-09-12T17:54:54.467 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.467+0000 7fc0cf90c800 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-12T17:54:54.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.470+0000 7fbf83fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:54.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.472+0000 7fc0cf90c800 20 remove_watcher() i=0 2024-09-12T17:54:54.472 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.472+0000 7fc0cf90c800 2 removed watcher, disabling cache 2024-09-12T17:54:54.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.474+0000 7fc0cf90c800 20 remove_watcher() i=1 2024-09-12T17:54:54.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.475+0000 7fc0cf90c800 20 remove_watcher() i=2 2024-09-12T17:54:54.477 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.477+0000 7fc0cf90c800 20 remove_watcher() i=3 2024-09-12T17:54:54.478 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.478+0000 7fc0cf90c800 20 remove_watcher() i=4 2024-09-12T17:54:54.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.479+0000 7fc0cf90c800 20 remove_watcher() i=5 2024-09-12T17:54:54.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.480+0000 7fc0cf90c800 20 remove_watcher() i=6 2024-09-12T17:54:54.481 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:54.481+0000 7fc0cf90c800 20 remove_watcher() i=7 2024-09-12T17:54:55.160 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T17:54:55.160 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T17:54:55.268 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:54:55.658 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:54:57.105 INFO:tasks.workunit.client.0.smithi107.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:54:57.106 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T17:54:57.140 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:57.141 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:57.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.180+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.182+0000 7f5b19faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.182+0000 7f5b19faf800 20 realm 2024-09-12T17:54:57.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.182+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.182+0000 7f5b19faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.182+0000 7f5b19faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:57.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.182+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.183+0000 7f5b19faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.183+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.184+0000 7f5b19faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:57.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.184+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.184+0000 7f5b19faf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:57.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.184+0000 7f5b19faf800 20 searching for the correct realm 2024-09-12T17:54:57.189 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.188+0000 7f5b1829a640 0 -- 172.21.15.107:0/2703640823 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x555a760f8710 msgr2=0x555a760fab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:57.395 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.394+0000 7f5b17a99640 0 -- 172.21.15.107:0/2703640823 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f5b0c0b1450 msgr2=0x7f5b0c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:57.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.602+0000 7f5b19faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:57.603 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.602+0000 7f5b19faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:57.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.602+0000 7f5b19faf800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:57.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.602+0000 7f5b19faf800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:57.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.602+0000 7f5b19faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:57.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.602+0000 7f5b19faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:57.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.602+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.602+0000 7f5b19faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.604 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.602+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.603+0000 7f5b19faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:57.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.603+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.603+0000 7f5b19faf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:57.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.603+0000 7f5b19faf800 20 zone default found 2024-09-12T17:54:57.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.603+0000 7f5b19faf800 4 Realm: () 2024-09-12T17:54:57.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.603+0000 7f5b19faf800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:57.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.603+0000 7f5b19faf800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:57.605 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.603+0000 7f5b19faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:57.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.603+0000 7f5b19faf800 20 zonegroup default 2024-09-12T17:54:57.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.603+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.604+0000 7f5b19faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.604+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.604+0000 7f5b19faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.604+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.604+0000 7f5b19faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.604+0000 7f5b19faf800 20 started sync module instance, tier type = 2024-09-12T17:54:57.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.604+0000 7f5b19faf800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:57.616 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.615+0000 7f5b19faf800 20 add_watcher() i=0 2024-09-12T17:54:57.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.615+0000 7f5b19faf800 20 add_watcher() i=1 2024-09-12T17:54:57.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.615+0000 7f5b19faf800 20 add_watcher() i=2 2024-09-12T17:54:57.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.615+0000 7f5b19faf800 20 add_watcher() i=3 2024-09-12T17:54:57.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.615+0000 7f5b19faf800 20 add_watcher() i=4 2024-09-12T17:54:57.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.615+0000 7f5b19faf800 20 add_watcher() i=5 2024-09-12T17:54:57.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.615+0000 7f5b19faf800 20 add_watcher() i=6 2024-09-12T17:54:57.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.616+0000 7f5b19faf800 20 add_watcher() i=7 2024-09-12T17:54:57.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.616+0000 7f5b19faf800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:57.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.618+0000 7f59cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:57.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.618+0000 7f5b19faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:57.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.618+0000 7f5b19faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:57.624 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.618+0000 7f5b19faf800 5 note: GC not initialized 2024-09-12T17:54:57.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.619+0000 7f59ccfe1640 20 reqs_thread_entry: start 2024-09-12T17:54:57.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.619+0000 7f5b19faf800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:57.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.619+0000 7f5b19faf800 20 Filter name: none 2024-09-12T17:54:57.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.619+0000 7f59467fc640 20 reqs_thread_entry: start 2024-09-12T17:54:57.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.619+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.619+0000 7f5b19faf800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:57.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.620+0000 7f5b19faf800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.620+0000 7f5b19faf800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:57.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.620+0000 7f5b19faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:57.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.620+0000 7f5b19faf800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T17:54:57.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.620+0000 7f5b19faf800 20 INFO: main: starting shard=0 2024-09-12T17:54:57.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.620+0000 7f5b19faf800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.0 2024-09-12T17:54:57.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.620+0000 7f5b19faf800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.0 2024-09-12T17:54:57.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.621+0000 7f5b19faf800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:54:57.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.621+0000 7f5b19faf800 20 INFO: main: starting shard=1 2024-09-12T17:54:57.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.621+0000 7f5b19faf800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.1 2024-09-12T17:54:57.627 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.621+0000 7f5b19faf800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.1 2024-09-12T17:54:57.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.621+0000 7f5b19faf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:54:57.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.621+0000 7f5b19faf800 20 INFO: main: starting shard=2 2024-09-12T17:54:57.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.621+0000 7f5b19faf800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.2 2024-09-12T17:54:57.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.621+0000 7f5b19faf800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.2 2024-09-12T17:54:57.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.622+0000 7f5b19faf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:54:57.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.622+0000 7f5b19faf800 20 INFO: main: done 2024-09-12T17:54:57.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.623+0000 7f59cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:57.630 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.625+0000 7f5b19faf800 20 remove_watcher() i=0 2024-09-12T17:54:57.631 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.625+0000 7f5b19faf800 2 removed watcher, disabling cache 2024-09-12T17:54:57.631 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.627+0000 7f5b19faf800 20 remove_watcher() i=1 2024-09-12T17:54:57.631 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.629+0000 7f5b19faf800 20 remove_watcher() i=2 2024-09-12T17:54:57.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.630+0000 7f5b19faf800 20 remove_watcher() i=3 2024-09-12T17:54:57.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.631+0000 7f5b19faf800 20 remove_watcher() i=4 2024-09-12T17:54:57.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.633+0000 7f5b19faf800 20 remove_watcher() i=5 2024-09-12T17:54:57.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.634+0000 7f5b19faf800 20 remove_watcher() i=6 2024-09-12T17:54:57.636 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.635+0000 7f5b19faf800 20 remove_watcher() i=7 2024-09-12T17:54:57.702 INFO:tasks.workunit.client.0.smithi107.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:54:57.704 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T17:54:57.736 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:57.737 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:57.775 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.773+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.775+0000 7f0d4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.775+0000 7f0d4432c800 20 realm 2024-09-12T17:54:57.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.775+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.775+0000 7f0d4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.775+0000 7f0d4432c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:57.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.775+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.776+0000 7f0d4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.776+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.777 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.776+0000 7f0d4432c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:57.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.776+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.777+0000 7f0d4432c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:57.778 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.777+0000 7f0d4432c800 20 searching for the correct realm 2024-09-12T17:54:57.781 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.780+0000 7f0d3ff3e640 0 -- 172.21.15.107:0/1902053804 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f0d3802c900 msgr2=0x7f0d3801e3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:57.785 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.784+0000 7f0d3ff3e640 0 -- 172.21.15.107:0/1902053804 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f0d3405c040 msgr2=0x7f0d3405c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:57.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.992+0000 7f0d4432c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:57.993 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.992+0000 7f0d4432c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:57.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.992+0000 7f0d4432c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:57.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.992+0000 7f0d4432c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:57.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.992+0000 7f0d4432c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:57.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.992+0000 7f0d4432c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:57.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.992+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.992+0000 7f0d4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.992+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.992+0000 7f0d4432c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:57.994 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.992+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.993+0000 7f0d4432c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:57.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.993+0000 7f0d4432c800 20 zone default found 2024-09-12T17:54:57.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.993+0000 7f0d4432c800 4 Realm: () 2024-09-12T17:54:57.995 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.993+0000 7f0d4432c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:57.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.993+0000 7f0d4432c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:57.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.993+0000 7f0d4432c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:57.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.993+0000 7f0d4432c800 20 zonegroup default 2024-09-12T17:54:57.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.993+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.993+0000 7f0d4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.993+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.993+0000 7f0d4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.993+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:57.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.994+0000 7f0d4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:57.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.994+0000 7f0d4432c800 20 started sync module instance, tier type = 2024-09-12T17:54:57.996 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:57.994+0000 7f0d4432c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:58.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.004+0000 7f0d4432c800 20 add_watcher() i=0 2024-09-12T17:54:58.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.004+0000 7f0d4432c800 20 add_watcher() i=1 2024-09-12T17:54:58.005 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.004+0000 7f0d4432c800 20 add_watcher() i=2 2024-09-12T17:54:58.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.004+0000 7f0d4432c800 20 add_watcher() i=3 2024-09-12T17:54:58.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.004+0000 7f0d4432c800 20 add_watcher() i=4 2024-09-12T17:54:58.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.004+0000 7f0d4432c800 20 add_watcher() i=5 2024-09-12T17:54:58.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.004+0000 7f0d4432c800 20 add_watcher() i=6 2024-09-12T17:54:58.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.005+0000 7f0d4432c800 20 add_watcher() i=7 2024-09-12T17:54:58.006 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.005+0000 7f0d4432c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:58.007 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.006+0000 7f0bf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:58.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.007+0000 7f0d4432c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:58.008 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.007+0000 7f0d4432c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:58.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.007+0000 7f0d4432c800 5 note: GC not initialized 2024-09-12T17:54:58.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.007+0000 7f0bf4fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:58.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.007+0000 7f0d4432c800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:58.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.007+0000 7f0d4432c800 20 Filter name: none 2024-09-12T17:54:58.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.007+0000 7f0b6e7fc640 20 reqs_thread_entry: start 2024-09-12T17:54:58.009 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.007+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.008+0000 7f0d4432c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:58.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.008+0000 7f0d4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.008+0000 7f0d4432c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:58.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.008+0000 7f0d4432c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:58.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.008+0000 7f0d4432c800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T17:54:58.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.008+0000 7f0d4432c800 20 INFO: main: starting shard=0 2024-09-12T17:54:58.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.008+0000 7f0d4432c800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.0 2024-09-12T17:54:58.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.008+0000 7f0d4432c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.0 2024-09-12T17:54:58.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.009+0000 7f0d4432c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:54:58.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.009+0000 7f0d4432c800 20 INFO: main: starting shard=1 2024-09-12T17:54:58.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.009+0000 7f0d4432c800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.1 2024-09-12T17:54:58.011 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.009+0000 7f0d4432c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.1 2024-09-12T17:54:58.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.009+0000 7f0d4432c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:54:58.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.009+0000 7f0d4432c800 20 INFO: main: starting shard=2 2024-09-12T17:54:58.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.009+0000 7f0d4432c800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.2 2024-09-12T17:54:58.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.009+0000 7f0d4432c800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.2 2024-09-12T17:54:58.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.009+0000 7f0d4432c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:54:58.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.009+0000 7f0d4432c800 20 INFO: main: done 2024-09-12T17:54:58.012 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.010+0000 7f0bf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:58.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.013+0000 7f0d4432c800 20 remove_watcher() i=0 2024-09-12T17:54:58.014 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.013+0000 7f0d4432c800 2 removed watcher, disabling cache 2024-09-12T17:54:58.015 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.014+0000 7f0d4432c800 20 remove_watcher() i=1 2024-09-12T17:54:58.016 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.015+0000 7f0d4432c800 20 remove_watcher() i=2 2024-09-12T17:54:58.017 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.016+0000 7f0d4432c800 20 remove_watcher() i=3 2024-09-12T17:54:58.018 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.018+0000 7f0d4432c800 20 remove_watcher() i=4 2024-09-12T17:54:58.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.019+0000 7f0d4432c800 20 remove_watcher() i=5 2024-09-12T17:54:58.020 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.019+0000 7f0d4432c800 20 remove_watcher() i=6 2024-09-12T17:54:58.021 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.021+0000 7f0d4432c800 20 remove_watcher() i=7 2024-09-12T17:54:58.086 INFO:tasks.workunit.client.0.smithi107.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:54:58.088 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T17:54:58.119 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:58.119 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:58.155 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.154+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.155+0000 7f004f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.155+0000 7f004f736800 20 realm 2024-09-12T17:54:58.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.155+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.156+0000 7f004f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.157 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.156+0000 7f004f736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:58.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.156+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.156+0000 7f004f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.156+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.157+0000 7f004f736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:58.158 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.157+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.158+0000 7f004f736800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:58.159 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.158+0000 7f004f736800 20 searching for the correct realm 2024-09-12T17:54:58.162 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.161+0000 7f004bcb8640 0 -- 172.21.15.107:0/210200852 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55827d5c6f50 msgr2=0x55827d5c9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:58.165 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.164+0000 7f004b4b7640 0 -- 172.21.15.107:0/210200852 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f0040046930 msgr2=0x7f00400433a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:58.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.169+0000 7f004f736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:58.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.169+0000 7f004f736800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:58.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.169+0000 7f004f736800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:58.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.169+0000 7f004f736800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:58.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.169+0000 7f004f736800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:58.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.169+0000 7f004f736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:58.170 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.169+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.171 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.169+0000 7f004f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.169+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.170+0000 7f004f736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.170+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.170+0000 7f004f736800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.170+0000 7f004f736800 20 zone default found 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.170+0000 7f004f736800 4 Realm: () 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.170+0000 7f004f736800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.170+0000 7f004f736800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.170+0000 7f004f736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.170+0000 7f004f736800 20 zonegroup default 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.170+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.170+0000 7f004f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.172 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.170+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.171+0000 7f004f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.171+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.171+0000 7f004f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:58.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.171+0000 7f004f736800 20 started sync module instance, tier type = 2024-09-12T17:54:58.173 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.171+0000 7f004f736800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:58.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.180+0000 7f004f736800 20 add_watcher() i=0 2024-09-12T17:54:58.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.180+0000 7f004f736800 20 add_watcher() i=1 2024-09-12T17:54:58.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.180+0000 7f004f736800 20 add_watcher() i=2 2024-09-12T17:54:58.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.180+0000 7f004f736800 20 add_watcher() i=3 2024-09-12T17:54:58.181 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.180+0000 7f004f736800 20 add_watcher() i=4 2024-09-12T17:54:58.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.180+0000 7f004f736800 20 add_watcher() i=5 2024-09-12T17:54:58.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.180+0000 7f004f736800 20 add_watcher() i=6 2024-09-12T17:54:58.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.181+0000 7f004f736800 20 add_watcher() i=7 2024-09-12T17:54:58.182 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.181+0000 7f004f736800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:58.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.183+0000 7eff01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:58.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.183+0000 7f004f736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:58.184 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.183+0000 7f004f736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:58.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.183+0000 7f004f736800 5 note: GC not initialized 2024-09-12T17:54:58.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.183+0000 7eff00fe1640 20 reqs_thread_entry: start 2024-09-12T17:54:58.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.183+0000 7f004f736800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:58.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.183+0000 7f004f736800 20 Filter name: none 2024-09-12T17:54:58.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.183+0000 7efe7a7fc640 20 reqs_thread_entry: start 2024-09-12T17:54:58.185 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.183+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.184+0000 7f004f736800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:58.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.184+0000 7f004f736800 20 rados->read ofs=0 len=0 2024-09-12T17:54:58.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.184+0000 7f004f736800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:58.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.184+0000 7f004f736800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:58.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.184+0000 7f004f736800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T17:54:58.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.184+0000 7f004f736800 20 INFO: main: starting shard=0 2024-09-12T17:54:58.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.184+0000 7f004f736800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.0 2024-09-12T17:54:58.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.184+0000 7f004f736800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.0 2024-09-12T17:54:58.186 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.185+0000 7f004f736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:54:58.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.185+0000 7f004f736800 20 INFO: main: starting shard=1 2024-09-12T17:54:58.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.185+0000 7f004f736800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.1 2024-09-12T17:54:58.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.185+0000 7f004f736800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.1 2024-09-12T17:54:58.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.185+0000 7f004f736800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:54:58.187 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.185+0000 7f004f736800 20 INFO: main: starting shard=2 2024-09-12T17:54:58.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.185+0000 7f004f736800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.2 2024-09-12T17:54:58.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.185+0000 7f004f736800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.2 2024-09-12T17:54:58.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.186+0000 7f004f736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:54:58.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.186+0000 7f004f736800 20 INFO: main: done 2024-09-12T17:54:58.188 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.186+0000 7eff01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:58.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.189+0000 7f004f736800 20 remove_watcher() i=0 2024-09-12T17:54:58.190 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.189+0000 7f004f736800 2 removed watcher, disabling cache 2024-09-12T17:54:58.191 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.190+0000 7f004f736800 20 remove_watcher() i=1 2024-09-12T17:54:58.192 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.191+0000 7f004f736800 20 remove_watcher() i=2 2024-09-12T17:54:58.194 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.193+0000 7f004f736800 20 remove_watcher() i=3 2024-09-12T17:54:58.195 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.194+0000 7f004f736800 20 remove_watcher() i=4 2024-09-12T17:54:58.196 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.195+0000 7f004f736800 20 remove_watcher() i=5 2024-09-12T17:54:58.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.196+0000 7f004f736800 20 remove_watcher() i=6 2024-09-12T17:54:58.197 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:58.197+0000 7f004f736800 20 remove_watcher() i=7 2024-09-12T17:54:58.215 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:54:58.606 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:54:59.001 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T17:54:59.032 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:59.032 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:59.068 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.067+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.069+0000 7fc8d9d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.069+0000 7fc8d9d33800 20 realm 2024-09-12T17:54:59.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.069+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.069+0000 7fc8d9d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.070 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.069+0000 7fc8d9d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:59.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.069+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.069+0000 7fc8d9d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.069+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.070+0000 7fc8d9d33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:59.071 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.070+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.071+0000 7fc8d9d33800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:59.072 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.071+0000 7fc8d9d33800 20 searching for the correct realm 2024-09-12T17:54:59.076 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.075+0000 7fc8cffff640 0 -- 172.21.15.107:0/3277888544 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fc8c0009040 msgr2=0x7fc8c0038910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:59.079 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.078+0000 7fc8d6277640 0 -- 172.21.15.107:0/3277888544 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7fc8c0050910 msgr2=0x7fc8c0015420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:59.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.083+0000 7fc8d9d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:59.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.083+0000 7fc8d9d33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:59.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.083+0000 7fc8d9d33800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:59.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.083+0000 7fc8d9d33800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:59.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.083+0000 7fc8d9d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:59.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.083+0000 7fc8d9d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:59.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.083+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.083+0000 7fc8d9d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.084 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.083+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.083+0000 7fc8d9d33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:59.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.083+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:59.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 20 zone default found 2024-09-12T17:54:59.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 4 Realm: () 2024-09-12T17:54:59.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:59.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:59.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:59.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 20 zonegroup default 2024-09-12T17:54:59.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.086 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 20 started sync module instance, tier type = 2024-09-12T17:54:59.087 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.084+0000 7fc8d9d33800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:59.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.093+0000 7fc8d9d33800 20 add_watcher() i=0 2024-09-12T17:54:59.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.093+0000 7fc8d9d33800 20 add_watcher() i=1 2024-09-12T17:54:59.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.093+0000 7fc8d9d33800 20 add_watcher() i=2 2024-09-12T17:54:59.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.093+0000 7fc8d9d33800 20 add_watcher() i=3 2024-09-12T17:54:59.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.093+0000 7fc8d9d33800 20 add_watcher() i=4 2024-09-12T17:54:59.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.093+0000 7fc8d9d33800 20 add_watcher() i=5 2024-09-12T17:54:59.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.093+0000 7fc8d9d33800 20 add_watcher() i=6 2024-09-12T17:54:59.095 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.094+0000 7fc8d9d33800 20 add_watcher() i=7 2024-09-12T17:54:59.096 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.094+0000 7fc8d9d33800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:59.097 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.096+0000 7fc7877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:59.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.097+0000 7fc8d9d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:59.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.097+0000 7fc8d9d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:59.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.097+0000 7fc8d9d33800 5 note: GC not initialized 2024-09-12T17:54:59.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.097+0000 7fc7867fc640 20 reqs_thread_entry: start 2024-09-12T17:54:59.098 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.097+0000 7fc8d9d33800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:59.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.097+0000 7fc8d9d33800 20 Filter name: none 2024-09-12T17:54:59.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.097+0000 7fc6f7fff640 20 reqs_thread_entry: start 2024-09-12T17:54:59.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.097+0000 7fc8d9d33800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:54:59.099 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.097+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.098+0000 7fc8d9d33800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:59.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.098+0000 7fc8d9d33800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:54:59.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.098+0000 7fc8d9d33800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:54:59.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.098+0000 7fc8d9d33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 : miss 2024-09-12T17:54:59.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.098+0000 7fc8d9d33800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.098+0000 7fc8d9d33800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:59.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.098+0000 7fc8d9d33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:59.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.098+0000 7fc8d9d33800 10 adding default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:59.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.098+0000 7fc8d9d33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:59.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.098+0000 7fc8d9d33800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:59.100 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.098+0000 7fc8d9d33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 2024-09-12T17:54:59.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.104+0000 7fc8d9d33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:59.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.104+0000 7fc8d9d33800 10 moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:59.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.104+0000 7fc8d9d33800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:59.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.104+0000 7fc8d9d33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19, ofs0, ns] 2024-09-12T17:54:59.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.105+0000 7fc7b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464311 cookie 94477305831056 notifier 8688 bl.length()=905 2024-09-12T17:54:59.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.105+0000 7fc7b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:59.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.105+0000 7fc7b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:59.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.105+0000 7fc7b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:59.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.105+0000 7fc8d9d33800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_sources= new_sources= 2024-09-12T17:54:59.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.105+0000 7fc8d9d33800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential sources added=[] removed=[] 2024-09-12T17:54:59.106 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.105+0000 7fc8d9d33800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_dests= new_dests= 2024-09-12T17:54:59.107 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.105+0000 7fc8d9d33800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential dests added=[] removed=[] 2024-09-12T17:54:59.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.0 2024-09-12T17:54:59.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.0 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.1 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.1 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.2 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.2 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.3 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.3 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.4 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.4 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.5 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.5 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.6 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.6 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.7 2024-09-12T17:54:59.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.7 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.8 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.8 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.10 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.10 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.11 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.11 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.12 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.12 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.13 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.13 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.14 2024-09-12T17:54:59.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.14 2024-09-12T17:54:59.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.15 2024-09-12T17:54:59.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.15 2024-09-12T17:54:59.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.16 2024-09-12T17:54:59.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.16 2024-09-12T17:54:59.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.0 2024-09-12T17:54:59.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.108+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.0 2024-09-12T17:54:59.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.109+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.1 2024-09-12T17:54:59.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.109+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.1 2024-09-12T17:54:59.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.109+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.2 2024-09-12T17:54:59.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.109+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.2 2024-09-12T17:54:59.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.111+0000 7fc8d9d33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:59.113 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.111+0000 7fc8d9d33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 2024-09-12T17:54:59.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.112+0000 7fc8d9d33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.112+0000 7fc8d9d33800 10 moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.112+0000 7fc8d9d33800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.112+0000 7fc8d9d33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19, ofs0, ns] 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.113+0000 7fc7b8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464312 cookie 94477305831056 notifier 8688 bl.length()=905 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.113+0000 7fc7b8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.113+0000 7fc7b8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.113+0000 7fc7b8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.113+0000 7fc8d9d33800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_sources= new_sources= 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.113+0000 7fc8d9d33800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential sources added=[] removed=[] 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.113+0000 7fc8d9d33800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_dests= new_dests= 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.113+0000 7fc8d9d33800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential dests added=[] removed=[] 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.115+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.0 2024-09-12T17:54:59.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.115+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.0 2024-09-12T17:54:59.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.115+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.1 2024-09-12T17:54:59.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.115+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.1 2024-09-12T17:54:59.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.115+0000 7fc8d9d33800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.2 2024-09-12T17:54:59.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.115+0000 7fc8d9d33800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.2.2 2024-09-12T17:54:59.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.115+0000 7fc8d9d33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:54:59.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.115+0000 7fc8d9d33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 2024-09-12T17:54:59.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.117+0000 7fc8d9d33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:59.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.117+0000 7fc8d9d33800 10 moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:59.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.117+0000 7fc8d9d33800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:59.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.117+0000 7fc8d9d33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19, ofs0, ns] 2024-09-12T17:54:59.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.117+0000 7fc7b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464313 cookie 94477305831056 notifier 8688 bl.length()=873 2024-09-12T17:54:59.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.117+0000 7fc7b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:59.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.117+0000 7fc7b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:59.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.117+0000 7fc7b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:59.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.117+0000 7fc8d9d33800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_sources= new_sources= 2024-09-12T17:54:59.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.117+0000 7fc8d9d33800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential sources added=[] removed=[] 2024-09-12T17:54:59.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.117+0000 7fc8d9d33800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): orig_dests= new_dests= 2024-09-12T17:54:59.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.117+0000 7fc8d9d33800 20 handle_bi_update(): bucket=:myver[35ed0db6-4f54-4e96-b306-71079c84e007.4596.19]): potential dests added=[] removed=[] 2024-09-12T17:54:59.120 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.119+0000 7fc8d9d33800 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-12T17:54:59.121 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.121+0000 7fc7877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:59.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.123+0000 7fc8d9d33800 20 remove_watcher() i=0 2024-09-12T17:54:59.124 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.123+0000 7fc8d9d33800 2 removed watcher, disabling cache 2024-09-12T17:54:59.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.124+0000 7fc8d9d33800 20 remove_watcher() i=1 2024-09-12T17:54:59.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.125+0000 7fc8d9d33800 20 remove_watcher() i=2 2024-09-12T17:54:59.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.126+0000 7fc8d9d33800 20 remove_watcher() i=3 2024-09-12T17:54:59.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.127+0000 7fc8d9d33800 20 remove_watcher() i=4 2024-09-12T17:54:59.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.128+0000 7fc8d9d33800 20 remove_watcher() i=5 2024-09-12T17:54:59.130 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.129+0000 7fc8d9d33800 20 remove_watcher() i=6 2024-09-12T17:54:59.131 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.130+0000 7fc8d9d33800 20 remove_watcher() i=7 2024-09-12T17:54:59.143 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:54:59.177 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:59.178 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:59.214 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.213+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.214+0000 7fbb6c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.214+0000 7fbb6c52e800 20 realm 2024-09-12T17:54:59.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.214+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.215+0000 7fbb6c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.215+0000 7fbb6c52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:59.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.215+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.216 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.215+0000 7fbb6c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.215+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.216+0000 7fbb6c52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:59.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.216+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.217 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.216+0000 7fbb6c52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:59.218 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.216+0000 7fbb6c52e800 20 searching for the correct realm 2024-09-12T17:54:59.221 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.220+0000 7fbb68ade640 0 -- 172.21.15.107:0/2933345554 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7fbb5007b040 msgr2=0x7fbb5007d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:59.427 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.426+0000 7fbb68ade640 0 -- 172.21.15.107:0/2933345554 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7fbb5007b040 msgr2=0x7fbb5007d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:54:59.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.430+0000 7fbb6c52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:59.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.430+0000 7fbb6c52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:59.431 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.430+0000 7fbb6c52e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:59.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.430+0000 7fbb6c52e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:59.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.430+0000 7fbb6c52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:59.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.430+0000 7fbb6c52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:59.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.430+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.430+0000 7fbb6c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.432 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.430+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.431+0000 7fbb6c52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:59.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.431+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.431+0000 7fbb6c52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:59.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.431+0000 7fbb6c52e800 20 zone default found 2024-09-12T17:54:59.433 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.431+0000 7fbb6c52e800 4 Realm: () 2024-09-12T17:54:59.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.431+0000 7fbb6c52e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:59.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.431+0000 7fbb6c52e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:59.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.431+0000 7fbb6c52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:59.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.431+0000 7fbb6c52e800 20 zonegroup default 2024-09-12T17:54:59.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.431+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.431+0000 7fbb6c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.431+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.432+0000 7fbb6c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.432+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.432+0000 7fbb6c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.432+0000 7fbb6c52e800 20 started sync module instance, tier type = 2024-09-12T17:54:59.434 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.432+0000 7fbb6c52e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:59.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.441+0000 7fbb6c52e800 20 add_watcher() i=0 2024-09-12T17:54:59.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.441+0000 7fbb6c52e800 20 add_watcher() i=1 2024-09-12T17:54:59.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.441+0000 7fbb6c52e800 20 add_watcher() i=2 2024-09-12T17:54:59.442 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.441+0000 7fbb6c52e800 20 add_watcher() i=3 2024-09-12T17:54:59.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.441+0000 7fbb6c52e800 20 add_watcher() i=4 2024-09-12T17:54:59.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.441+0000 7fbb6c52e800 20 add_watcher() i=5 2024-09-12T17:54:59.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.441+0000 7fbb6c52e800 20 add_watcher() i=6 2024-09-12T17:54:59.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.442+0000 7fbb6c52e800 20 add_watcher() i=7 2024-09-12T17:54:59.443 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.442+0000 7fbb6c52e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:59.445 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.444+0000 7fba1efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.444+0000 7fbb6c52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.444+0000 7fbb6c52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.444+0000 7fbb6c52e800 5 note: GC not initialized 2024-09-12T17:54:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.444+0000 7fba1dfdb640 20 reqs_thread_entry: start 2024-09-12T17:54:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.444+0000 7fbb6c52e800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.444+0000 7fbb6c52e800 20 Filter name: none 2024-09-12T17:54:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fb98f7fe640 20 reqs_thread_entry: start 2024-09-12T17:54:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:54:59.446 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:54:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:54:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 : miss 2024-09-12T17:54:59.447 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:59.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 info.flags=0x17 2024-09-12T17:54:59.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 10 adding default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 to cache LRU end 2024-09-12T17:54:59.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:54:59.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:54:59.448 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.445+0000 7fbb6c52e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:35ed0db6-4f54-4e96-b306-71079c84e007.4596.19 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.446+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.0 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.446+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.0 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.446+0000 7fbb6c52e800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.446+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.1 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.446+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.1 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.446+0000 7fbb6c52e800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.446+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.2 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.446+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.2 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.447+0000 7fbb6c52e800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.447+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.3 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.447+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.3 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.447+0000 7fbb6c52e800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.447+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.4 2024-09-12T17:54:59.449 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.447+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.4 2024-09-12T17:54:59.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.447+0000 7fbb6c52e800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:54:59.450 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.447+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.5 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.447+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.5 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.448+0000 7fbb6c52e800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.448+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.6 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.448+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.6 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.448+0000 7fbb6c52e800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.448+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.7 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.448+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.7 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.449+0000 7fbb6c52e800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.449+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.8 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.449+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.8 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.449+0000 7fbb6c52e800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.449+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.451 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.449+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.450+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.10 2024-09-12T17:54:59.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.450+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.10 2024-09-12T17:54:59.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.451+0000 7fbb6c52e800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:54:59.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.451+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.11 2024-09-12T17:54:59.452 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.451+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.11 2024-09-12T17:54:59.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.451+0000 7fbb6c52e800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T17:54:59.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.451+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.12 2024-09-12T17:54:59.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.451+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.12 2024-09-12T17:54:59.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.451+0000 7fbb6c52e800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T17:54:59.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.451+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.13 2024-09-12T17:54:59.453 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.451+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.13 2024-09-12T17:54:59.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.452+0000 7fbb6c52e800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T17:54:59.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.452+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.14 2024-09-12T17:54:59.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.452+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.14 2024-09-12T17:54:59.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.452+0000 7fbb6c52e800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T17:54:59.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.452+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.15 2024-09-12T17:54:59.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.452+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.15 2024-09-12T17:54:59.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.453+0000 7fbb6c52e800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T17:54:59.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.453+0000 7fbb6c52e800 10 bucket_obj is .dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.16 2024-09-12T17:54:59.454 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.453+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.16 2024-09-12T17:54:59.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.454+0000 7fbb6c52e800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T17:54:59.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.454+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.455 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.455+0000 7fbb6c52e800 20 get_obj_state: octx=0x559873f6a9d0 obj=myver:x state=0x55987420f068 s->prefetch_data=0 2024-09-12T17:54:59.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.455+0000 7fbb6c52e800 20 get_obj_state: setting s->obj_tag to hv12c1f7w21lq3u8ul5hqoiq2bbo02qk 2024-09-12T17:54:59.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.455+0000 7fbb6c52e800 20 get_obj_state_impl: setting s->olh_tag to 0avse29eme2tf0i6eoyfxeo5j8bocu07 2024-09-12T17:54:59.456 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.455+0000 7fbb6c52e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0avse29eme2tf0i6eoyfxeo5j8bocu07 2024-09-12T17:54:59.458 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.457+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.459 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.459+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.459+0000 7fbb6c52e800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T17:54:59.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.459+0000 7fbb6c52e800 20 olh_log_entry: epoch=2 op=3 key=x[yRiryqiE8b1.ErXoMGt22UpQWEsVi0-] 2024-09-12T17:54:59.460 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.459+0000 7fbb6c52e800 20 get_obj_state: octx=0x559873f6a9d0 obj=myver:_:yRiryqiE8b1.ErXoMGt22UpQWEsVi0-_x state=0x55987424b778 s->prefetch_data=0 2024-09-12T17:54:59.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.460+0000 7fbb6c52e800 10 manifest: total_size = 22 2024-09-12T17:54:59.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.460+0000 7fbb6c52e800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.5867199081310941446 2024-09-12T17:54:59.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.460+0000 7fbb6c52e800 20 get_obj_state: octx=0x559873f6a9d0 obj=myver:_:yRiryqiE8b1.ErXoMGt22UpQWEsVi0-_x state=0x55987424b778 s->prefetch_data=0 2024-09-12T17:54:59.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.460+0000 7fbb6c52e800 20 prepare_atomic_modification: state is not atomic. state=0x55987424b778 2024-09-12T17:54:59.461 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.460+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.464+0000 7fba3f7fe640 20 handle_completion(): completion ok for obj=x[yRiryqiE8b1.ErXoMGt22UpQWEsVi0-] 2024-09-12T17:54:59.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.464+0000 7fbb6c52e800 20 get_obj_state: octx=0x559873f6a9d0 obj=myver:x state=0x55987420f068 s->prefetch_data=0 2024-09-12T17:54:59.465 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.464+0000 7fbb6c52e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0avse29eme2tf0i6eoyfxeo5j8bocu07 2024-09-12T17:54:59.468 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.467+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.469+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.470 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.470+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.470+0000 7fbb6c52e800 20 get_obj_state: octx=0x559873f6a9d0 obj=myver:y state=0x55987424cd88 s->prefetch_data=0 2024-09-12T17:54:59.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.470+0000 7fbb6c52e800 20 get_obj_state: setting s->obj_tag to 3p7zcl6iudns7ovzs1jjgjzopnhss3m5 2024-09-12T17:54:59.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.470+0000 7fbb6c52e800 20 get_obj_state_impl: setting s->olh_tag to 59lsyeg0663pz67vxgj66vccolwxk63w 2024-09-12T17:54:59.471 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.470+0000 7fbb6c52e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=59lsyeg0663pz67vxgj66vccolwxk63w 2024-09-12T17:54:59.473 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.472+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.474 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.473+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.474+0000 7fbb6c52e800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T17:54:59.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.474+0000 7fbb6c52e800 20 olh_log_entry: epoch=2 op=3 key=y[dhry1oFDstbQpXcn0E1PbWiUd1B72i6] 2024-09-12T17:54:59.475 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.474+0000 7fbb6c52e800 20 get_obj_state: octx=0x559873f6a9d0 obj=myver:_:dhry1oFDstbQpXcn0E1PbWiUd1B72i6_y state=0x559874210078 s->prefetch_data=0 2024-09-12T17:54:59.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.474+0000 7fbb6c52e800 10 manifest: total_size = 9 2024-09-12T17:54:59.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.474+0000 7fbb6c52e800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.11044111642853550114 2024-09-12T17:54:59.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.474+0000 7fbb6c52e800 20 get_obj_state: octx=0x559873f6a9d0 obj=myver:_:dhry1oFDstbQpXcn0E1PbWiUd1B72i6_y state=0x559874210078 s->prefetch_data=0 2024-09-12T17:54:59.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.474+0000 7fbb6c52e800 20 prepare_atomic_modification: state is not atomic. state=0x559874210078 2024-09-12T17:54:59.476 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.474+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.478+0000 7fba3effd640 20 handle_completion(): completion ok for obj=y[dhry1oFDstbQpXcn0E1PbWiUd1B72i6] 2024-09-12T17:54:59.479 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.478+0000 7fbb6c52e800 20 get_obj_state: octx=0x559873f6a9d0 obj=myver:y state=0x55987424cd88 s->prefetch_data=0 2024-09-12T17:54:59.480 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.478+0000 7fbb6c52e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=59lsyeg0663pz67vxgj66vccolwxk63w 2024-09-12T17:54:59.482 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.481+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.483+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.483+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.484 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.483+0000 7fbb6c52e800 20 get_obj_state: octx=0x559873f6a9d0 obj=myver:z state=0x55987424cd88 s->prefetch_data=0 2024-09-12T17:54:59.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.484+0000 7fbb6c52e800 20 get_obj_state: setting s->obj_tag to pv2ggo835fvzyjbcjkbwumx7ny5m1dji 2024-09-12T17:54:59.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.484+0000 7fbb6c52e800 20 get_obj_state_impl: setting s->olh_tag to qnmomftbmhpy1drma4qccuknksza5ltt 2024-09-12T17:54:59.485 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.484+0000 7fbb6c52e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qnmomftbmhpy1drma4qccuknksza5ltt 2024-09-12T17:54:59.486 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.485+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.487 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.487+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.487+0000 7fbb6c52e800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T17:54:59.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.487+0000 7fbb6c52e800 20 olh_log_entry: epoch=2 op=3 key=z[-1W0Ua5zz41ciRuMrPmGc-FZyAozBRY] 2024-09-12T17:54:59.488 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.487+0000 7fbb6c52e800 20 get_obj_state: octx=0x559873f6a9d0 obj=myver:_:-1W0Ua5zz41ciRuMrPmGc-FZyAozBRY_z state=0x559874210078 s->prefetch_data=0 2024-09-12T17:54:59.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.488+0000 7fbb6c52e800 10 manifest: total_size = 12 2024-09-12T17:54:59.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.488+0000 7fbb6c52e800 20 get_obj_state: setting s->obj_tag to 35ed0db6-4f54-4e96-b306-71079c84e007.4596.11481611511972852258 2024-09-12T17:54:59.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.488+0000 7fbb6c52e800 20 get_obj_state: octx=0x559873f6a9d0 obj=myver:_:-1W0Ua5zz41ciRuMrPmGc-FZyAozBRY_z state=0x559874210078 s->prefetch_data=0 2024-09-12T17:54:59.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.488+0000 7fbb6c52e800 20 prepare_atomic_modification: state is not atomic. state=0x559874210078 2024-09-12T17:54:59.489 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.488+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.492+0000 7fba3f7fe640 20 handle_completion(): completion ok for obj=z[-1W0Ua5zz41ciRuMrPmGc-FZyAozBRY] 2024-09-12T17:54:59.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.492+0000 7fbb6c52e800 20 get_obj_state: octx=0x559873f6a9d0 obj=myver:z state=0x55987424cd88 s->prefetch_data=0 2024-09-12T17:54:59.493 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.492+0000 7fbb6c52e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qnmomftbmhpy1drma4qccuknksza5ltt 2024-09-12T17:54:59.496 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.495+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.497+0000 7fbb6c52e800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.19.3.9 2024-09-12T17:54:59.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.497+0000 7fbb6c52e800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T17:54:59.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.497+0000 7fbb6c52e800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T17:54:59.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.497+0000 7fba1efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:59.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.499+0000 7fbb6c52e800 20 remove_watcher() i=0 2024-09-12T17:54:59.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.499+0000 7fbb6c52e800 2 removed watcher, disabling cache 2024-09-12T17:54:59.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.501+0000 7fbb6c52e800 20 remove_watcher() i=1 2024-09-12T17:54:59.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.502+0000 7fbb6c52e800 20 remove_watcher() i=2 2024-09-12T17:54:59.503 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.503+0000 7fbb6c52e800 20 remove_watcher() i=3 2024-09-12T17:54:59.505 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.504+0000 7fbb6c52e800 20 remove_watcher() i=4 2024-09-12T17:54:59.506 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.506+0000 7fbb6c52e800 20 remove_watcher() i=5 2024-09-12T17:54:59.507 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.506+0000 7fbb6c52e800 20 remove_watcher() i=6 2024-09-12T17:54:59.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.507+0000 7fbb6c52e800 20 remove_watcher() i=7 2024-09-12T17:54:59.569 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:54:59.597 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:59.598 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:59.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.633+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.635+0000 7fc5bda15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.635+0000 7fc5bda15800 20 realm 2024-09-12T17:54:59.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.635+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.635+0000 7fc5bda15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.635+0000 7fc5bda15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:59.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.635+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.636+0000 7fc5bda15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.637 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.636+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.636+0000 7fc5bda15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:59.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.636+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.637+0000 7fc5bda15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:59.638 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.637+0000 7fc5bda15800 20 searching for the correct realm 2024-09-12T17:54:59.641 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.640+0000 7fc5b9993640 0 -- 172.21.15.107:0/160081496 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x558f2e718e10 msgr2=0x558f2e71b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:59.644 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.643+0000 7fc5b9192640 0 -- 172.21.15.107:0/160081496 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc5a40692f0 msgr2=0x7fc5a406b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:59.648 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.647+0000 7fc5bda15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:59.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.647+0000 7fc5bda15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:59.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.647+0000 7fc5bda15800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:54:59.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.647+0000 7fc5bda15800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:54:59.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.647+0000 7fc5bda15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:59.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.647+0000 7fc5bda15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:59.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.647+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.647+0000 7fc5bda15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.647+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:59.649 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:59.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 20 zone default found 2024-09-12T17:54:59.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 4 Realm: () 2024-09-12T17:54:59.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:54:59.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:54:59.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:59.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 20 zonegroup default 2024-09-12T17:54:59.651 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.648+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.649+0000 7fc5bda15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:59.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.649+0000 7fc5bda15800 20 started sync module instance, tier type = 2024-09-12T17:54:59.652 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.649+0000 7fc5bda15800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:54:59.658 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.657+0000 7fc5bda15800 20 add_watcher() i=0 2024-09-12T17:54:59.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.657+0000 7fc5bda15800 20 add_watcher() i=1 2024-09-12T17:54:59.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.657+0000 7fc5bda15800 20 add_watcher() i=2 2024-09-12T17:54:59.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.657+0000 7fc5bda15800 20 add_watcher() i=3 2024-09-12T17:54:59.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.657+0000 7fc5bda15800 20 add_watcher() i=4 2024-09-12T17:54:59.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.657+0000 7fc5bda15800 20 add_watcher() i=5 2024-09-12T17:54:59.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.658+0000 7fc5bda15800 20 add_watcher() i=6 2024-09-12T17:54:59.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.658+0000 7fc5bda15800 20 add_watcher() i=7 2024-09-12T17:54:59.659 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.658+0000 7fc5bda15800 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:59.661 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.660+0000 7fc46f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:59.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.660+0000 7fc5bda15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:59.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.660+0000 7fc5bda15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:59.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.660+0000 7fc5bda15800 5 note: GC not initialized 2024-09-12T17:54:59.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.661+0000 7fc46e7e4640 20 reqs_thread_entry: start 2024-09-12T17:54:59.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.661+0000 7fc5bda15800 20 init_complete bucket index max shards: 1 2024-09-12T17:54:59.662 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.661+0000 7fc5bda15800 20 Filter name: none 2024-09-12T17:54:59.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.661+0000 7fc3dffff640 20 reqs_thread_entry: start 2024-09-12T17:54:59.663 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.661+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.661+0000 7fc5bda15800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:59.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.661+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.662+0000 7fc5bda15800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:59.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.662+0000 7fc5bda15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:59.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.662+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.662+0000 7fc5bda15800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:54:59.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.662+0000 7fc5bda15800 20 rados->read ofs=0 len=0 2024-09-12T17:54:59.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.662+0000 7fc5bda15800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:54:59.664 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.662+0000 7fc5bda15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:54:59.665 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.664+0000 7fc46f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:59.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.666+0000 7fc5bda15800 20 remove_watcher() i=0 2024-09-12T17:54:59.667 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.666+0000 7fc5bda15800 2 removed watcher, disabling cache 2024-09-12T17:54:59.668 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.667+0000 7fc5bda15800 20 remove_watcher() i=1 2024-09-12T17:54:59.670 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.669+0000 7fc5bda15800 20 remove_watcher() i=2 2024-09-12T17:54:59.671 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.670+0000 7fc5bda15800 20 remove_watcher() i=3 2024-09-12T17:54:59.672 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.671+0000 7fc5bda15800 20 remove_watcher() i=4 2024-09-12T17:54:59.673 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.672+0000 7fc5bda15800 20 remove_watcher() i=5 2024-09-12T17:54:59.674 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.673+0000 7fc5bda15800 20 remove_watcher() i=6 2024-09-12T17:54:59.675 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T17:54:59.674+0000 7fc5bda15800 20 remove_watcher() i=7 2024-09-12T17:54:59.685 INFO:tasks.workunit.client.0.smithi107.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:54:59.685 INFO:tasks.workunit.client.0.smithi107.stderr:Deleting bucket a-bucket 2024-09-12T17:54:59.705 INFO:tasks.workunit.client.0.smithi107.stderr:Deleting bucket myver 2024-09-12T17:54:59.783 INFO:tasks.workunit.client.0.smithi107.stderr:Completed resharding tests 2024-09-12T17:54:59.784 INFO:tasks.workunit.client.0.smithi107.stdout:connected to http://localhost:80 2024-09-12T17:54:59.863 INFO:tasks.workunit.client.0.smithi107.stderr:+ deactivate 2024-09-12T17:54:59.863 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:54:59.863 INFO:tasks.workunit.client.0.smithi107.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:54:59.863 INFO:tasks.workunit.client.0.smithi107.stderr:+ export PATH 2024-09-12T17:54:59.863 INFO:tasks.workunit.client.0.smithi107.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:54:59.863 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n '' ']' 2024-09-12T17:54:59.863 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:54:59.863 INFO:tasks.workunit.client.0.smithi107.stderr:+ hash -r 2024-09-12T17:54:59.863 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n '' ']' 2024-09-12T17:54:59.863 INFO:tasks.workunit.client.0.smithi107.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:54:59.863 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:54:59.863 INFO:tasks.workunit.client.0.smithi107.stderr:+ unset -f deactivate 2024-09-12T17:54:59.864 INFO:tasks.workunit.client.0.smithi107.stderr:+ echo OK. 2024-09-12T17:54:59.864 INFO:tasks.workunit.client.0.smithi107.stdout:OK. 2024-09-12T17:54:59.865 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:54:59.865 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:54:59.944 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T17:54:59.944 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:55:00.338 DEBUG:teuthology.parallel:result is None 2024-09-12T17:55:00.339 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:55:00.377 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:55:00.377 DEBUG:teuthology.orchestra.run.smithi107:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:55:00.446 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:55:00.446 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T17:55:00.461 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T17:55:00.462 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T17:55:00.462 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T17:55:00.462 DEBUG:teuthology.orchestra.run.smithi107:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T17:55:00.516 INFO:teuthology.orchestra.run.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T17:55:04.845 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T17:55:04.845 DEBUG:teuthology.orchestra.run.smithi107:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T17:55:06.724 INFO:teuthology.orchestra.run.smithi107.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T17:55:07.293 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:28:24 ago on Thu 12 Sep 2024 05:26:43 PM UTC. 2024-09-12T17:55:07.433 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-09-12T17:55:07.433 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-09-12T17:55:07.434 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-09-12T17:55:07.435 INFO:teuthology.orchestra.run.smithi107.stdout:Install 5 Packages 2024-09-12T17:55:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:07.435 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 46 M 2024-09-12T17:55:07.435 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 166 M 2024-09-12T17:55:07.435 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-09-12T17:55:08.588 INFO:teuthology.orchestra.run.smithi107.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 376 kB/s | 426 kB 00:01 2024-09-12T17:55:09.338 INFO:teuthology.orchestra.run.smithi107.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 1.9 MB/s | 3.5 MB 00:01 2024-09-12T17:55:09.855 INFO:teuthology.orchestra.run.smithi107.stdout:(3/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 3.9 MB/s | 9.3 MB 00:02 2024-09-12T17:55:09.880 INFO:teuthology.orchestra.run.smithi107.stdout:(4/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 48 kB/s | 26 kB 00:00 2024-09-12T17:55:14.188 INFO:teuthology.orchestra.run.smithi107.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 5.8 MB/s | 32 MB 00:05 2024-09-12T17:55:14.188 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:55:14.189 INFO:teuthology.orchestra.run.smithi107.stdout:Total 6.8 MB/s | 46 MB 00:06 2024-09-12T17:55:14.615 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-09-12T17:55:14.636 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-09-12T17:55:14.636 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-09-12T17:55:15.119 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-09-12T17:55:15.119 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-09-12T17:55:15.643 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T17:55:15.789 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-09-12T17:55:15.979 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T17:55:16.598 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T17:55:16.639 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T17:55:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T17:55:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T17:55:17.147 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T17:55:17.178 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:55:17.186 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:55:17.195 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T17:55:17.230 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T17:55:20.186 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:55:20.186 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T17:55:20.187 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T17:55:20.187 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T17:55:20.187 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T17:55:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T17:55:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:20.568 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-09-12T17:55:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T17:55:20.568 INFO:teuthology.orchestra.run.smithi107.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:55:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:55:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:55:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T17:55:20.569 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:20.569 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-09-12T17:55:20.995 INFO:teuthology.orchestra.run.smithi107.stdout: Gradle will be installed under /opt/gradle 2024-09-12T17:55:21.082 INFO:teuthology.orchestra.run.smithi107.stderr:--2024-09-12 17:55:21-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T17:55:21.518 INFO:teuthology.orchestra.run.smithi107.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4865, ... 2024-09-12T17:55:21.526 INFO:teuthology.orchestra.run.smithi107.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-12T17:55:21.593 INFO:teuthology.orchestra.run.smithi107.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T17:55:21.593 INFO:teuthology.orchestra.run.smithi107.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T17:55:21.593 INFO:teuthology.orchestra.run.smithi107.stderr:--2024-09-12 17:55:21-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T17:55:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:Resolving github.com (github.com)... 140.82.114.3 2024-09-12T17:55:21.602 INFO:teuthology.orchestra.run.smithi107.stderr:Connecting to github.com (github.com)|140.82.114.3|:443... connected. 2024-09-12T17:55:21.754 INFO:teuthology.orchestra.run.smithi107.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T17:55:21.754 INFO:teuthology.orchestra.run.smithi107.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T175521Z&X-Amz-Expires=300&X-Amz-Signature=822de045016241691ee4c94b0bc4612aec9327d10268b94d4e933f3da36e8da6&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T17:55:21.754 INFO:teuthology.orchestra.run.smithi107.stderr:--2024-09-12 17:55:21-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T175521Z&X-Amz-Expires=300&X-Amz-Signature=822de045016241691ee4c94b0bc4612aec9327d10268b94d4e933f3da36e8da6&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T17:55:21.769 INFO:teuthology.orchestra.run.smithi107.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.108.133, 185.199.110.133, 185.199.109.133, ... 2024-09-12T17:55:21.782 INFO:teuthology.orchestra.run.smithi107.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.108.133|:443... connected. 2024-09-12T17:55:21.855 INFO:teuthology.orchestra.run.smithi107.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T17:55:21.855 INFO:teuthology.orchestra.run.smithi107.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T17:55:21.855 INFO:teuthology.orchestra.run.smithi107.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T17:55:21.855 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T17:55:21.870 INFO:teuthology.orchestra.run.smithi107.stderr: 0K .......... .......... .......... .......... .......... 0% 3.16M 29s 2024-09-12T17:55:21.883 INFO:teuthology.orchestra.run.smithi107.stderr: 50K .......... .......... .......... .......... .......... 0% 3.86M 26s 2024-09-12T17:55:21.893 INFO:teuthology.orchestra.run.smithi107.stderr: 100K .......... .......... .......... .......... .......... 0% 5.21M 23s 2024-09-12T17:55:21.894 INFO:teuthology.orchestra.run.smithi107.stderr: 150K .......... .......... .......... .......... .......... 0% 23.9M 18s 2024-09-12T17:55:21.896 INFO:teuthology.orchestra.run.smithi107.stderr: 200K .......... .......... .......... .......... .......... 0% 20.6M 16s 2024-09-12T17:55:21.899 INFO:teuthology.orchestra.run.smithi107.stderr: 250K .......... .......... .......... .......... .......... 0% 25.6M 14s 2024-09-12T17:55:21.905 INFO:teuthology.orchestra.run.smithi107.stderr: 300K .......... .......... .......... .......... .......... 0% 7.67M 13s 2024-09-12T17:55:21.907 INFO:teuthology.orchestra.run.smithi107.stderr: 350K .......... .......... .......... .......... .......... 0% 23.7M 12s 2024-09-12T17:55:21.907 INFO:teuthology.orchestra.run.smithi107.stderr: 400K .......... .......... .......... .......... .......... 0% 82.4M 11s 2024-09-12T17:55:21.908 INFO:teuthology.orchestra.run.smithi107.stderr: 450K .......... .......... .......... .......... .......... 0% 58.9M 10s 2024-09-12T17:55:21.910 INFO:teuthology.orchestra.run.smithi107.stderr: 500K .......... .......... .......... .......... .......... 0% 36.6M 9s 2024-09-12T17:55:21.912 INFO:teuthology.orchestra.run.smithi107.stderr: 550K .......... .......... .......... .......... .......... 0% 33.2M 9s 2024-09-12T17:55:21.912 INFO:teuthology.orchestra.run.smithi107.stderr: 600K .......... .......... .......... .......... .......... 0% 75.7M 8s 2024-09-12T17:55:21.918 INFO:teuthology.orchestra.run.smithi107.stderr: 650K .......... .......... .......... .......... .......... 0% 9.36M 8s 2024-09-12T17:55:21.918 INFO:teuthology.orchestra.run.smithi107.stderr: 700K .......... .......... .......... .......... .......... 0% 66.0M 8s 2024-09-12T17:55:21.920 INFO:teuthology.orchestra.run.smithi107.stderr: 750K .......... .......... .......... .......... .......... 0% 31.9M 7s 2024-09-12T17:55:21.920 INFO:teuthology.orchestra.run.smithi107.stderr: 800K .......... .......... .......... .......... .......... 0% 169M 7s 2024-09-12T17:55:21.923 INFO:teuthology.orchestra.run.smithi107.stderr: 850K .......... .......... .......... .......... .......... 0% 447M 7s 2024-09-12T17:55:21.923 INFO:teuthology.orchestra.run.smithi107.stderr: 900K .......... .......... .......... .......... .......... 1% 63.1M 6s 2024-09-12T17:55:21.923 INFO:teuthology.orchestra.run.smithi107.stderr: 950K .......... .......... .......... .......... .......... 1% 70.4M 6s 2024-09-12T17:55:21.924 INFO:teuthology.orchestra.run.smithi107.stderr: 1000K .......... .......... .......... .......... .......... 1% 72.4M 6s 2024-09-12T17:55:21.927 INFO:teuthology.orchestra.run.smithi107.stderr: 1050K .......... .......... .......... .......... .......... 1% 354M 6s 2024-09-12T17:55:21.928 INFO:teuthology.orchestra.run.smithi107.stderr: 1100K .......... .......... .......... .......... .......... 1% 58.6M 5s 2024-09-12T17:55:21.928 INFO:teuthology.orchestra.run.smithi107.stderr: 1150K .......... .......... .......... .......... .......... 1% 121M 5s 2024-09-12T17:55:21.928 INFO:teuthology.orchestra.run.smithi107.stderr: 1200K .......... .......... .......... .......... .......... 1% 84.8M 5s 2024-09-12T17:55:21.937 INFO:teuthology.orchestra.run.smithi107.stderr: 1250K .......... .......... .......... .......... .......... 1% 11.3M 5s 2024-09-12T17:55:21.937 INFO:teuthology.orchestra.run.smithi107.stderr: 1300K .......... .......... .......... .......... .......... 1% 186M 5s 2024-09-12T17:55:21.937 INFO:teuthology.orchestra.run.smithi107.stderr: 1350K .......... .......... .......... .......... .......... 1% 52.5M 5s 2024-09-12T17:55:21.937 INFO:teuthology.orchestra.run.smithi107.stderr: 1400K .......... .......... .......... .......... .......... 1% 91.6M 5s 2024-09-12T17:55:21.937 INFO:teuthology.orchestra.run.smithi107.stderr: 1450K .......... .......... .......... .......... .......... 1% 153M 5s 2024-09-12T17:55:21.937 INFO:teuthology.orchestra.run.smithi107.stderr: 1500K .......... .......... .......... .......... .......... 1% 48.1M 5s 2024-09-12T17:55:21.937 INFO:teuthology.orchestra.run.smithi107.stderr: 1550K .......... .......... .......... .......... .......... 1% 373M 4s 2024-09-12T17:55:21.938 INFO:teuthology.orchestra.run.smithi107.stderr: 1600K .......... .......... .......... .......... .......... 1% 262M 4s 2024-09-12T17:55:21.938 INFO:teuthology.orchestra.run.smithi107.stderr: 1650K .......... .......... .......... .......... .......... 1% 127M 4s 2024-09-12T17:55:21.938 INFO:teuthology.orchestra.run.smithi107.stderr: 1700K .......... .......... .......... .......... .......... 1% 103M 4s 2024-09-12T17:55:21.938 INFO:teuthology.orchestra.run.smithi107.stderr: 1750K .......... .......... .......... .......... .......... 1% 383M 4s 2024-09-12T17:55:21.938 INFO:teuthology.orchestra.run.smithi107.stderr: 1800K .......... .......... .......... .......... .......... 1% 149M 4s 2024-09-12T17:55:23.312 INFO:teuthology.orchestra.run.smithi107.stderr: 1850K .......... .......... .......... .......... .......... 2% 138M 4s 2024-09-12T17:55:23.312 INFO:teuthology.orchestra.run.smithi107.stderr: 1900K .......... .......... .......... .......... .......... 2% 111M 4s 2024-09-12T17:55:23.312 INFO:teuthology.orchestra.run.smithi107.stderr: 1950K .......... .......... .......... .......... .......... 2% 100M 4s 2024-09-12T17:55:23.312 INFO:teuthology.orchestra.run.smithi107.stderr: 2000K .......... .......... .......... .......... .......... 2% 134M 4s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2050K .......... .......... .......... .......... .......... 2% 151M 3s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2100K .......... .......... .......... .......... .......... 2% 194M 3s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2150K .......... .......... .......... .......... .......... 2% 409M 3s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2200K .......... .......... .......... .......... .......... 2% 305M 3s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2250K .......... .......... .......... .......... .......... 2% 298M 3s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2300K .......... .......... .......... .......... .......... 2% 130M 3s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2350K .......... .......... .......... .......... .......... 2% 183M 3s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2400K .......... .......... .......... .......... .......... 2% 210M 3s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2450K .......... .......... .......... .......... .......... 2% 170M 3s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2500K .......... .......... .......... .......... .......... 2% 349M 3s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2550K .......... .......... .......... .......... .......... 2% 14.2M 3s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2600K .......... .......... .......... .......... .......... 2% 338M 3s 2024-09-12T17:55:23.313 INFO:teuthology.orchestra.run.smithi107.stderr: 2650K .......... .......... .......... .......... .......... 2% 61.9M 3s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 2700K .......... .......... .......... .......... .......... 2% 303M 3s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 2750K .......... .......... .......... .......... .......... 3% 411M 3s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 2800K .......... .......... .......... .......... .......... 3% 79.9M 3s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 2850K .......... .......... .......... .......... .......... 3% 403M 3s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 2900K .......... .......... .......... .......... .......... 3% 248M 3s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 2950K .......... .......... .......... .......... .......... 3% 391M 3s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 3000K .......... .......... .......... .......... .......... 3% 164M 3s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 3050K .......... .......... .......... .......... .......... 3% 64.5M 3s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 3100K .......... .......... .......... .......... .......... 3% 225M 3s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 3150K .......... .......... .......... .......... .......... 3% 384M 2s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 3200K .......... .......... .......... .......... .......... 3% 356M 2s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 3250K .......... .......... .......... .......... .......... 3% 357M 2s 2024-09-12T17:55:23.314 INFO:teuthology.orchestra.run.smithi107.stderr: 3300K .......... .......... .......... .......... .......... 3% 261M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3350K .......... .......... .......... .......... .......... 3% 246M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3400K .......... .......... .......... .......... .......... 3% 409M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3450K .......... .......... .......... .......... .......... 3% 250M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3500K .......... .......... .......... .......... .......... 3% 221M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3550K .......... .......... .......... .......... .......... 3% 272M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3600K .......... .......... .......... .......... .......... 3% 382M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3650K .......... .......... .......... .......... .......... 3% 266M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3700K .......... .......... .......... .......... .......... 4% 221M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3750K .......... .......... .......... .......... .......... 4% 237M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3800K .......... .......... .......... .......... .......... 4% 264M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3850K .......... .......... .......... .......... .......... 4% 314M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3900K .......... .......... .......... .......... .......... 4% 285M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 3950K .......... .......... .......... .......... .......... 4% 162M 2s 2024-09-12T17:55:23.315 INFO:teuthology.orchestra.run.smithi107.stderr: 4000K .......... .......... .......... .......... .......... 4% 372M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4050K .......... .......... .......... .......... .......... 4% 227M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4100K .......... .......... .......... .......... .......... 4% 339M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4150K .......... .......... .......... .......... .......... 4% 277M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4200K .......... .......... .......... .......... .......... 4% 267M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4250K .......... .......... .......... .......... .......... 4% 291M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4300K .......... .......... .......... .......... .......... 4% 182M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4350K .......... .......... .......... .......... .......... 4% 204M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4400K .......... .......... .......... .......... .......... 4% 165M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4450K .......... .......... .......... .......... .......... 4% 274M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4500K .......... .......... .......... .......... .......... 4% 242M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4550K .......... .......... .......... .......... .......... 4% 303M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4600K .......... .......... .......... .......... .......... 5% 382M 2s 2024-09-12T17:55:23.316 INFO:teuthology.orchestra.run.smithi107.stderr: 4650K .......... .......... .......... .......... .......... 5% 353M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 4700K .......... .......... .......... .......... .......... 5% 274M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 4750K .......... .......... .......... .......... .......... 5% 185M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 4800K .......... .......... .......... .......... .......... 5% 411M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 4850K .......... .......... .......... .......... .......... 5% 408M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 4900K .......... .......... .......... .......... .......... 5% 369M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 4950K .......... .......... .......... .......... .......... 5% 414M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 5000K .......... .......... .......... .......... .......... 5% 426M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 5050K .......... .......... .......... .......... .......... 5% 312M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 5100K .......... .......... .......... .......... .......... 5% 21.6M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 5150K .......... .......... .......... .......... .......... 5% 254M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 5200K .......... .......... .......... .......... .......... 5% 192M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 5250K .......... .......... .......... .......... .......... 5% 355M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 5300K .......... .......... .......... .......... .......... 5% 372M 2s 2024-09-12T17:55:23.317 INFO:teuthology.orchestra.run.smithi107.stderr: 5350K .......... .......... .......... .......... .......... 5% 118M 2s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 5400K .......... .......... .......... .......... .......... 5% 252M 2s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 5450K .......... .......... .......... .......... .......... 5% 421M 2s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 5500K .......... .......... .......... .......... .......... 5% 206M 2s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 5550K .......... .......... .......... .......... .......... 6% 221M 2s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 5600K .......... .......... .......... .......... .......... 6% 374M 2s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 5650K .......... .......... .......... .......... .......... 6% 276M 2s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 5700K .......... .......... .......... .......... .......... 6% 364M 2s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 5750K .......... .......... .......... .......... .......... 6% 335M 2s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 5800K .......... .......... .......... .......... .......... 6% 363M 1s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 5850K .......... .......... .......... .......... .......... 6% 339M 1s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 5900K .......... .......... .......... .......... .......... 6% 261M 1s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 5950K .......... .......... .......... .......... .......... 6% 266M 1s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 6000K .......... .......... .......... .......... .......... 6% 342M 1s 2024-09-12T17:55:23.318 INFO:teuthology.orchestra.run.smithi107.stderr: 6050K .......... .......... .......... .......... .......... 6% 246M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6100K .......... .......... .......... .......... .......... 6% 185M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6150K .......... .......... .......... .......... .......... 6% 264M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6200K .......... .......... .......... .......... .......... 6% 417M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6250K .......... .......... .......... .......... .......... 6% 231M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6300K .......... .......... .......... .......... .......... 6% 348M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6350K .......... .......... .......... .......... .......... 6% 369M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6400K .......... .......... .......... .......... .......... 6% 301M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6450K .......... .......... .......... .......... .......... 6% 414M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6500K .......... .......... .......... .......... .......... 7% 312M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6550K .......... .......... .......... .......... .......... 7% 157M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6600K .......... .......... .......... .......... .......... 7% 143M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6650K .......... .......... .......... .......... .......... 7% 369M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6700K .......... .......... .......... .......... .......... 7% 214M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6750K .......... .......... .......... .......... .......... 7% 341M 1s 2024-09-12T17:55:23.319 INFO:teuthology.orchestra.run.smithi107.stderr: 6800K .......... .......... .......... .......... .......... 7% 189M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 6850K .......... .......... .......... .......... .......... 7% 175M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 6900K .......... .......... .......... .......... .......... 7% 339M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 6950K .......... .......... .......... .......... .......... 7% 287M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 7000K .......... .......... .......... .......... .......... 7% 242M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 7050K .......... .......... .......... .......... .......... 7% 151M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 7100K .......... .......... .......... .......... .......... 7% 126M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 7150K .......... .......... .......... .......... .......... 7% 394M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 7200K .......... .......... .......... .......... .......... 7% 262M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 7250K .......... .......... .......... .......... .......... 7% 133M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 7300K .......... .......... .......... .......... .......... 7% 310M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 7350K .......... .......... .......... .......... .......... 7% 283M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 7400K .......... .......... .......... .......... .......... 8% 84.9M 1s 2024-09-12T17:55:23.320 INFO:teuthology.orchestra.run.smithi107.stderr: 7450K .......... .......... .......... .......... .......... 8% 374M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 7500K .......... .......... .......... .......... .......... 8% 180M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 7550K .......... .......... .......... .......... .......... 8% 204M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 7600K .......... .......... .......... .......... .......... 8% 217M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 7650K .......... .......... .......... .......... .......... 8% 375M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 7700K .......... .......... .......... .......... .......... 8% 286M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 7750K .......... .......... .......... .......... .......... 8% 429M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 7800K .......... .......... .......... .......... .......... 8% 160M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 7850K .......... .......... .......... .......... .......... 8% 333M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 7900K .......... .......... .......... .......... .......... 8% 373M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 7950K .......... .......... .......... .......... .......... 8% 414M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 8000K .......... .......... .......... .......... .......... 8% 387M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 8050K .......... .......... .......... .......... .......... 8% 419M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 8100K .......... .......... .......... .......... .......... 8% 447M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 8150K .......... .......... .......... .......... .......... 8% 77.1M 1s 2024-09-12T17:55:23.321 INFO:teuthology.orchestra.run.smithi107.stderr: 8200K .......... .......... .......... .......... .......... 8% 69.6M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8250K .......... .......... .......... .......... .......... 8% 166M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8300K .......... .......... .......... .......... .......... 8% 279M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8350K .......... .......... .......... .......... .......... 9% 410M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8400K .......... .......... .......... .......... .......... 9% 119M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8450K .......... .......... .......... .......... .......... 9% 153M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8500K .......... .......... .......... .......... .......... 9% 271M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8550K .......... .......... .......... .......... .......... 9% 397M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8600K .......... .......... .......... .......... .......... 9% 163M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8650K .......... .......... .......... .......... .......... 9% 183M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8700K .......... .......... .......... .......... .......... 9% 249M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8750K .......... .......... .......... .......... .......... 9% 137M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8800K .......... .......... .......... .......... .......... 9% 367M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8850K .......... .......... .......... .......... .......... 9% 415M 1s 2024-09-12T17:55:23.322 INFO:teuthology.orchestra.run.smithi107.stderr: 8900K .......... .......... .......... .......... .......... 9% 371M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 8950K .......... .......... .......... .......... .......... 9% 415M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 9000K .......... .......... .......... .......... .......... 9% 449M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 9050K .......... .......... .......... .......... .......... 9% 233M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 9100K .......... .......... .......... .......... .......... 9% 328M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 9150K .......... .......... .......... .......... .......... 9% 396M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 9200K .......... .......... .......... .......... .......... 9% 440M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 9250K .......... .......... .......... .......... .......... 10% 259M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 9300K .......... .......... .......... .......... .......... 10% 220M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 9350K .......... .......... .......... .......... .......... 10% 240M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 9400K .......... .......... .......... .......... .......... 10% 86.9M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 9450K .......... .......... .......... .......... .......... 10% 411M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 9500K .......... .......... .......... .......... .......... 10% 353M 1s 2024-09-12T17:55:23.323 INFO:teuthology.orchestra.run.smithi107.stderr: 9550K .......... .......... .......... .......... .......... 10% 437M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 9600K .......... .......... .......... .......... .......... 10% 259M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 9650K .......... .......... .......... .......... .......... 10% 341M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 9700K .......... .......... .......... .......... .......... 10% 304M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 9750K .......... .......... .......... .......... .......... 10% 219M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 9800K .......... .......... .......... .......... .......... 10% 298M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 9850K .......... .......... .......... .......... .......... 10% 281M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 9900K .......... .......... .......... .......... .......... 10% 169M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 9950K .......... .......... .......... .......... .......... 10% 201M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 10000K .......... .......... .......... .......... .......... 10% 427M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 10050K .......... .......... .......... .......... .......... 10% 280M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 10100K .......... .......... .......... .......... .......... 10% 222M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 10150K .......... .......... .......... .......... .......... 10% 246M 1s 2024-09-12T17:55:23.324 INFO:teuthology.orchestra.run.smithi107.stderr: 10200K .......... .......... .......... .......... .......... 11% 334M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10250K .......... .......... .......... .......... .......... 11% 203M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10300K .......... .......... .......... .......... .......... 11% 145M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10350K .......... .......... .......... .......... .......... 11% 414M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10400K .......... .......... .......... .......... .......... 11% 440M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10450K .......... .......... .......... .......... .......... 11% 174M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10500K .......... .......... .......... .......... .......... 11% 143M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10550K .......... .......... .......... .......... .......... 11% 108M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10600K .......... .......... .......... .......... .......... 11% 137M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10650K .......... .......... .......... .......... .......... 11% 371M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10700K .......... .......... .......... .......... .......... 11% 144M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10750K .......... .......... .......... .......... .......... 11% 280M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10800K .......... .......... .......... .......... .......... 11% 177M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10850K .......... .......... .......... .......... .......... 11% 326M 1s 2024-09-12T17:55:23.325 INFO:teuthology.orchestra.run.smithi107.stderr: 10900K .......... .......... .......... .......... .......... 11% 404M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 10950K .......... .......... .......... .......... .......... 11% 150M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11000K .......... .......... .......... .......... .......... 11% 351M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11050K .......... .......... .......... .......... .......... 11% 432M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11100K .......... .......... .......... .......... .......... 12% 358M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11150K .......... .......... .......... .......... .......... 12% 443M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11200K .......... .......... .......... .......... .......... 12% 442M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11250K .......... .......... .......... .......... .......... 12% 217M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11300K .......... .......... .......... .......... .......... 12% 301M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11350K .......... .......... .......... .......... .......... 12% 381M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11400K .......... .......... .......... .......... .......... 12% 440M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11450K .......... .......... .......... .......... .......... 12% 99.2M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11500K .......... .......... .......... .......... .......... 12% 226M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11550K .......... .......... .......... .......... .......... 12% 229M 1s 2024-09-12T17:55:23.326 INFO:teuthology.orchestra.run.smithi107.stderr: 11600K .......... .......... .......... .......... .......... 12% 420M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 11650K .......... .......... .......... .......... .......... 12% 169M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 11700K .......... .......... .......... .......... .......... 12% 200M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 11750K .......... .......... .......... .......... .......... 12% 181M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 11800K .......... .......... .......... .......... .......... 12% 392M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 11850K .......... .......... .......... .......... .......... 12% 80.9M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 11900K .......... .......... .......... .......... .......... 12% 163M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 11950K .......... .......... .......... .......... .......... 12% 435M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 12000K .......... .......... .......... .......... .......... 12% 450M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 12050K .......... .......... .......... .......... .......... 13% 444M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 12100K .......... .......... .......... .......... .......... 13% 259M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 12150K .......... .......... .......... .......... .......... 13% 429M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 12200K .......... .......... .......... .......... .......... 13% 247M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 12250K .......... .......... .......... .......... .......... 13% 429M 1s 2024-09-12T17:55:23.327 INFO:teuthology.orchestra.run.smithi107.stderr: 12300K .......... .......... .......... .......... .......... 13% 306M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12350K .......... .......... .......... .......... .......... 13% 359M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12400K .......... .......... .......... .......... .......... 13% 366M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12450K .......... .......... .......... .......... .......... 13% 97.9M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12500K .......... .......... .......... .......... .......... 13% 208M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12550K .......... .......... .......... .......... .......... 13% 420M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12600K .......... .......... .......... .......... .......... 13% 450M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12650K .......... .......... .......... .......... .......... 13% 375M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12700K .......... .......... .......... .......... .......... 13% 354M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12750K .......... .......... .......... .......... .......... 13% 299M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12800K .......... .......... .......... .......... .......... 13% 280M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12850K .......... .......... .......... .......... .......... 13% 101M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12900K .......... .......... .......... .......... .......... 13% 375M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 12950K .......... .......... .......... .......... .......... 13% 376M 1s 2024-09-12T17:55:23.328 INFO:teuthology.orchestra.run.smithi107.stderr: 13000K .......... .......... .......... .......... .......... 14% 427M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13050K .......... .......... .......... .......... .......... 14% 201M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13100K .......... .......... .......... .......... .......... 14% 237M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13150K .......... .......... .......... .......... .......... 14% 431M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13200K .......... .......... .......... .......... .......... 14% 432M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13250K .......... .......... .......... .......... .......... 14% 271M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13300K .......... .......... .......... .......... .......... 14% 347M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13350K .......... .......... .......... .......... .......... 14% 228M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13400K .......... .......... .......... .......... .......... 14% 330M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13450K .......... .......... .......... .......... .......... 14% 248M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13500K .......... .......... .......... .......... .......... 14% 197M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13550K .......... .......... .......... .......... .......... 14% 173M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13600K .......... .......... .......... .......... .......... 14% 99.3M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13650K .......... .......... .......... .......... .......... 14% 76.2M 1s 2024-09-12T17:55:23.329 INFO:teuthology.orchestra.run.smithi107.stderr: 13700K .......... .......... .......... .......... .......... 14% 310M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 13750K .......... .......... .......... .......... .......... 14% 258M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 13800K .......... .......... .......... .......... .......... 14% 416M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 13850K .......... .......... .......... .......... .......... 14% 254M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 13900K .......... .......... .......... .......... .......... 15% 74.7M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 13950K .......... .......... .......... .......... .......... 15% 357M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 14000K .......... .......... .......... .......... .......... 15% 336M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 14050K .......... .......... .......... .......... .......... 15% 220M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 14100K .......... .......... .......... .......... .......... 15% 370M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 14150K .......... .......... .......... .......... .......... 15% 299M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 14200K .......... .......... .......... .......... .......... 15% 368M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 14250K .......... .......... .......... .......... .......... 15% 407M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 14300K .......... .......... .......... .......... .......... 15% 231M 1s 2024-09-12T17:55:23.330 INFO:teuthology.orchestra.run.smithi107.stderr: 14350K .......... .......... .......... .......... .......... 15% 402M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 14400K .......... .......... .......... .......... .......... 15% 444M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 14450K .......... .......... .......... .......... .......... 15% 440M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 14500K .......... .......... .......... .......... .......... 15% 195M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 14550K .......... .......... .......... .......... .......... 15% 226M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 14600K .......... .......... .......... .......... .......... 15% 430M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 14650K .......... .......... .......... .......... .......... 15% 159M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 14700K .......... .......... .......... .......... .......... 15% 367M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 14750K .......... .......... .......... .......... .......... 15% 407M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 14800K .......... .......... .......... .......... .......... 15% 129M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 14850K .......... .......... .......... .......... .......... 16% 370M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 14900K .......... .......... .......... .......... .......... 16% 151M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 14950K .......... .......... .......... .......... .......... 16% 105M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 15000K .......... .......... .......... .......... .......... 16% 174M 1s 2024-09-12T17:55:23.331 INFO:teuthology.orchestra.run.smithi107.stderr: 15050K .......... .......... .......... .......... .......... 16% 405M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15100K .......... .......... .......... .......... .......... 16% 364M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15150K .......... .......... .......... .......... .......... 16% 131M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15200K .......... .......... .......... .......... .......... 16% 143M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15250K .......... .......... .......... .......... .......... 16% 422M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15300K .......... .......... .......... .......... .......... 16% 370M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15350K .......... .......... .......... .......... .......... 16% 398M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15400K .......... .......... .......... .......... .......... 16% 418M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15450K .......... .......... .......... .......... .......... 16% 420M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15500K .......... .......... .......... .......... .......... 16% 284M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15550K .......... .......... .......... .......... .......... 16% 416M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15600K .......... .......... .......... .......... .......... 16% 389M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15650K .......... .......... .......... .......... .......... 16% 222M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15700K .......... .......... .......... .......... .......... 16% 375M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15750K .......... .......... .......... .......... .......... 17% 399M 1s 2024-09-12T17:55:23.332 INFO:teuthology.orchestra.run.smithi107.stderr: 15800K .......... .......... .......... .......... .......... 17% 387M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 15850K .......... .......... .......... .......... .......... 17% 111M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 15900K .......... .......... .......... .......... .......... 17% 198M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 15950K .......... .......... .......... .......... .......... 17% 146M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 16000K .......... .......... .......... .......... .......... 17% 430M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 16050K .......... .......... .......... .......... .......... 17% 316M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 16100K .......... .......... .......... .......... .......... 17% 380M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 16150K .......... .......... .......... .......... .......... 17% 269M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 16200K .......... .......... .......... .......... .......... 17% 427M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 16250K .......... .......... .......... .......... .......... 17% 372M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 16300K .......... .......... .......... .......... .......... 17% 220M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 16350K .......... .......... .......... .......... .......... 17% 384M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 16400K .......... .......... .......... .......... .......... 17% 405M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 16450K .......... .......... .......... .......... .......... 17% 214M 1s 2024-09-12T17:55:23.333 INFO:teuthology.orchestra.run.smithi107.stderr: 16500K .......... .......... .......... .......... .......... 17% 232M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 16550K .......... .......... .......... .......... .......... 17% 124M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 16600K .......... .......... .......... .......... .......... 17% 193M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 16650K .......... .......... .......... .......... .......... 17% 249M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 16700K .......... .......... .......... .......... .......... 18% 93.2M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 16750K .......... .......... .......... .......... .......... 18% 357M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 16800K .......... .......... .......... .......... .......... 18% 248M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 16850K .......... .......... .......... .......... .......... 18% 426M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 16900K .......... .......... .......... .......... .......... 18% 329M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 16950K .......... .......... .......... .......... .......... 18% 408M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 17000K .......... .......... .......... .......... .......... 18% 58.7M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 17050K .......... .......... .......... .......... .......... 18% 371M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 17100K .......... .......... .......... .......... .......... 18% 207M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 17150K .......... .......... .......... .......... .......... 18% 242M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 17200K .......... .......... .......... .......... .......... 18% 344M 1s 2024-09-12T17:55:23.334 INFO:teuthology.orchestra.run.smithi107.stderr: 17250K .......... .......... .......... .......... .......... 18% 228M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17300K .......... .......... .......... .......... .......... 18% 82.6M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17350K .......... .......... .......... .......... .......... 18% 312M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17400K .......... .......... .......... .......... .......... 18% 440M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17450K .......... .......... .......... .......... .......... 18% 142M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17500K .......... .......... .......... .......... .......... 18% 353M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17550K .......... .......... .......... .......... .......... 18% 424M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17600K .......... .......... .......... .......... .......... 18% 437M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17650K .......... .......... .......... .......... .......... 19% 435M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17700K .......... .......... .......... .......... .......... 19% 384M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17750K .......... .......... .......... .......... .......... 19% 315M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17800K .......... .......... .......... .......... .......... 19% 392M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17850K .......... .......... .......... .......... .......... 19% 286M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17900K .......... .......... .......... .......... .......... 19% 239M 1s 2024-09-12T17:55:23.335 INFO:teuthology.orchestra.run.smithi107.stderr: 17950K .......... .......... .......... .......... .......... 19% 367M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18000K .......... .......... .......... .......... .......... 19% 180M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18050K .......... .......... .......... .......... .......... 19% 229M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18100K .......... .......... .......... .......... .......... 19% 250M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18150K .......... .......... .......... .......... .......... 19% 338M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18200K .......... .......... .......... .......... .......... 19% 173M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18250K .......... .......... .......... .......... .......... 19% 81.8M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18300K .......... .......... .......... .......... .......... 19% 211M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18350K .......... .......... .......... .......... .......... 19% 431M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18400K .......... .......... .......... .......... .......... 19% 445M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18450K .......... .......... .......... .......... .......... 19% 377M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18500K .......... .......... .......... .......... .......... 19% 275M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18550K .......... .......... .......... .......... .......... 20% 402M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18600K .......... .......... .......... .......... .......... 20% 446M 1s 2024-09-12T17:55:23.336 INFO:teuthology.orchestra.run.smithi107.stderr: 18650K .......... .......... .......... .......... .......... 20% 259M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 18700K .......... .......... .......... .......... .......... 20% 118M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 18750K .......... .......... .......... .......... .......... 20% 340M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 18800K .......... .......... .......... .......... .......... 20% 191M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 18850K .......... .......... .......... .......... .......... 20% 242M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 18900K .......... .......... .......... .......... .......... 20% 390M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 18950K .......... .......... .......... .......... .......... 20% 436M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 19000K .......... .......... .......... .......... .......... 20% 256M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 19050K .......... .......... .......... .......... .......... 20% 430M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 19100K .......... .......... .......... .......... .......... 20% 135M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 19150K .......... .......... .......... .......... .......... 20% 394M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 19200K .......... .......... .......... .......... .......... 20% 409M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 19250K .......... .......... .......... .......... .......... 20% 196M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 19300K .......... .......... .......... .......... .......... 20% 396M 1s 2024-09-12T17:55:23.337 INFO:teuthology.orchestra.run.smithi107.stderr: 19350K .......... .......... .......... .......... .......... 20% 317M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 19400K .......... .......... .......... .......... .......... 20% 120M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 19450K .......... .......... .......... .......... .......... 20% 346M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 19500K .......... .......... .......... .......... .......... 21% 280M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 19550K .......... .......... .......... .......... .......... 21% 444M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 19600K .......... .......... .......... .......... .......... 21% 234M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 19650K .......... .......... .......... .......... .......... 21% 312M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 19700K .......... .......... .......... .......... .......... 21% 369M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 19750K .......... .......... .......... .......... .......... 21% 445M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 19800K .......... .......... .......... .......... .......... 21% 195M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 19850K .......... .......... .......... .......... .......... 21% 281M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 19900K .......... .......... .......... .......... .......... 21% 305M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 19950K .......... .......... .......... .......... .......... 21% 221M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 20000K .......... .......... .......... .......... .......... 21% 436M 1s 2024-09-12T17:55:23.338 INFO:teuthology.orchestra.run.smithi107.stderr: 20050K .......... .......... .......... .......... .......... 21% 62.7M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20100K .......... .......... .......... .......... .......... 21% 250M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20150K .......... .......... .......... .......... .......... 21% 251M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20200K .......... .......... .......... .......... .......... 21% 246M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20250K .......... .......... .......... .......... .......... 21% 449M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20300K .......... .......... .......... .......... .......... 21% 106M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20350K .......... .......... .......... .......... .......... 21% 89.5M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20400K .......... .......... .......... .......... .......... 22% 140M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20450K .......... .......... .......... .......... .......... 22% 93.9M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20500K .......... .......... .......... .......... .......... 22% 330M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20550K .......... .......... .......... .......... .......... 22% 421M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20600K .......... .......... .......... .......... .......... 22% 392M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20650K .......... .......... .......... .......... .......... 22% 419M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20700K .......... .......... .......... .......... .......... 22% 357M 1s 2024-09-12T17:55:23.339 INFO:teuthology.orchestra.run.smithi107.stderr: 20750K .......... .......... .......... .......... .......... 22% 434M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 20800K .......... .......... .......... .......... .......... 22% 422M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 20850K .......... .......... .......... .......... .......... 22% 422M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 20900K .......... .......... .......... .......... .......... 22% 385M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 20950K .......... .......... .......... .......... .......... 22% 252M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 21000K .......... .......... .......... .......... .......... 22% 404M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 21050K .......... .......... .......... .......... .......... 22% 406M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 21100K .......... .......... .......... .......... .......... 22% 228M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 21150K .......... .......... .......... .......... .......... 22% 235M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 21200K .......... .......... .......... .......... .......... 22% 381M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 21250K .......... .......... .......... .......... .......... 22% 365M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 21300K .......... .......... .......... .......... .......... 22% 208M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 21350K .......... .......... .......... .......... .......... 23% 74.0M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 21400K .......... .......... .......... .......... .......... 23% 381M 1s 2024-09-12T17:55:23.340 INFO:teuthology.orchestra.run.smithi107.stderr: 21450K .......... .......... .......... .......... .......... 23% 389M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 21500K .......... .......... .......... .......... .......... 23% 366M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 21550K .......... .......... .......... .......... .......... 23% 359M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 21600K .......... .......... .......... .......... .......... 23% 374M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 21650K .......... .......... .......... .......... .......... 23% 333M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 21700K .......... .......... .......... .......... .......... 23% 361M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 21750K .......... .......... .......... .......... .......... 23% 81.3M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 21800K .......... .......... .......... .......... .......... 23% 252M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 21850K .......... .......... .......... .......... .......... 23% 311M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 21900K .......... .......... .......... .......... .......... 23% 145M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 21950K .......... .......... .......... .......... .......... 23% 408M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 22000K .......... .......... .......... .......... .......... 23% 296M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 22050K .......... .......... .......... .......... .......... 23% 321M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 22100K .......... .......... .......... .......... .......... 23% 344M 1s 2024-09-12T17:55:23.341 INFO:teuthology.orchestra.run.smithi107.stderr: 22150K .......... .......... .......... .......... .......... 23% 167M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22200K .......... .......... .......... .......... .......... 23% 364M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22250K .......... .......... .......... .......... .......... 24% 311M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22300K .......... .......... .......... .......... .......... 24% 329M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22350K .......... .......... .......... .......... .......... 24% 388M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22400K .......... .......... .......... .......... .......... 24% 396M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22450K .......... .......... .......... .......... .......... 24% 109M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22500K .......... .......... .......... .......... .......... 24% 316M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22550K .......... .......... .......... .......... .......... 24% 431M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22600K .......... .......... .......... .......... .......... 24% 207M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22650K .......... .......... .......... .......... .......... 24% 374M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22700K .......... .......... .......... .......... .......... 24% 156M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22750K .......... .......... .......... .......... .......... 24% 333M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22800K .......... .......... .......... .......... .......... 24% 389M 1s 2024-09-12T17:55:23.342 INFO:teuthology.orchestra.run.smithi107.stderr: 22850K .......... .......... .......... .......... .......... 24% 395M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 22900K .......... .......... .......... .......... .......... 24% 353M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 22950K .......... .......... .......... .......... .......... 24% 381M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23000K .......... .......... .......... .......... .......... 24% 414M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23050K .......... .......... .......... .......... .......... 24% 382M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23100K .......... .......... .......... .......... .......... 24% 113M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23150K .......... .......... .......... .......... .......... 24% 371M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23200K .......... .......... .......... .......... .......... 25% 111M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23250K .......... .......... .......... .......... .......... 25% 369M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23300K .......... .......... .......... .......... .......... 25% 359M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23350K .......... .......... .......... .......... .......... 25% 89.9M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23400K .......... .......... .......... .......... .......... 25% 133M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23450K .......... .......... .......... .......... .......... 25% 200M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23500K .......... .......... .......... .......... .......... 25% 74.4M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23550K .......... .......... .......... .......... .......... 25% 292M 1s 2024-09-12T17:55:23.343 INFO:teuthology.orchestra.run.smithi107.stderr: 23600K .......... .......... .......... .......... .......... 25% 96.9M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 23650K .......... .......... .......... .......... .......... 25% 339M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 23700K .......... .......... .......... .......... .......... 25% 342M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 23750K .......... .......... .......... .......... .......... 25% 390M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 23800K .......... .......... .......... .......... .......... 25% 425M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 23850K .......... .......... .......... .......... .......... 25% 433M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 23900K .......... .......... .......... .......... .......... 25% 241M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 23950K .......... .......... .......... .......... .......... 25% 370M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 24000K .......... .......... .......... .......... .......... 25% 447M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 24050K .......... .......... .......... .......... .......... 25% 374M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 24100K .......... .......... .......... .......... .......... 25% 354M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 24150K .......... .......... .......... .......... .......... 26% 423M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 24200K .......... .......... .......... .......... .......... 26% 419M 1s 2024-09-12T17:55:23.344 INFO:teuthology.orchestra.run.smithi107.stderr: 24250K .......... .......... .......... .......... .......... 26% 425M 1s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24300K .......... .......... .......... .......... .......... 26% 191M 1s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24350K .......... .......... .......... .......... .......... 26% 380M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24400K .......... .......... .......... .......... .......... 26% 166M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24450K .......... .......... .......... .......... .......... 26% 365M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24500K .......... .......... .......... .......... .......... 26% 104M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24550K .......... .......... .......... .......... .......... 26% 314M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24600K .......... .......... .......... .......... .......... 26% 185M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24650K .......... .......... .......... .......... .......... 26% 381M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24700K .......... .......... .......... .......... .......... 26% 322M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24750K .......... .......... .......... .......... .......... 26% 160M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24800K .......... .......... .......... .......... .......... 26% 332M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24850K .......... .......... .......... .......... .......... 26% 125M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24900K .......... .......... .......... .......... .......... 26% 356M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 24950K .......... .......... .......... .......... .......... 26% 372M 0s 2024-09-12T17:55:23.345 INFO:teuthology.orchestra.run.smithi107.stderr: 25000K .......... .......... .......... .......... .......... 26% 259M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25050K .......... .......... .......... .......... .......... 27% 321M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25100K .......... .......... .......... .......... .......... 27% 289M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25150K .......... .......... .......... .......... .......... 27% 360M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25200K .......... .......... .......... .......... .......... 27% 205M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25250K .......... .......... .......... .......... .......... 27% 86.9M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25300K .......... .......... .......... .......... .......... 27% 308M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25350K .......... .......... .......... .......... .......... 27% 347M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25400K .......... .......... .......... .......... .......... 27% 410M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25450K .......... .......... .......... .......... .......... 27% 396M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25500K .......... .......... .......... .......... .......... 27% 120M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25550K .......... .......... .......... .......... .......... 27% 148M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25600K .......... .......... .......... .......... .......... 27% 371M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25650K .......... .......... .......... .......... .......... 27% 350M 0s 2024-09-12T17:55:23.346 INFO:teuthology.orchestra.run.smithi107.stderr: 25700K .......... .......... .......... .......... .......... 27% 356M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 25750K .......... .......... .......... .......... .......... 27% 353M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 25800K .......... .......... .......... .......... .......... 27% 388M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 25850K .......... .......... .......... .......... .......... 27% 273M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 25900K .......... .......... .......... .......... .......... 27% 142M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 25950K .......... .......... .......... .......... .......... 27% 221M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 26000K .......... .......... .......... .......... .......... 28% 194M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 26050K .......... .......... .......... .......... .......... 28% 350M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 26100K .......... .......... .......... .......... .......... 28% 347M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 26150K .......... .......... .......... .......... .......... 28% 417M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 26200K .......... .......... .......... .......... .......... 28% 146M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 26250K .......... .......... .......... .......... .......... 28% 388M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 26300K .......... .......... .......... .......... .......... 28% 318M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 26350K .......... .......... .......... .......... .......... 28% 331M 0s 2024-09-12T17:55:23.347 INFO:teuthology.orchestra.run.smithi107.stderr: 26400K .......... .......... .......... .......... .......... 28% 190M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 26450K .......... .......... .......... .......... .......... 28% 211M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 26500K .......... .......... .......... .......... .......... 28% 251M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 26550K .......... .......... .......... .......... .......... 28% 343M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 26600K .......... .......... .......... .......... .......... 28% 134M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 26650K .......... .......... .......... .......... .......... 28% 66.4M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 26700K .......... .......... .......... .......... .......... 28% 106M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 26750K .......... .......... .......... .......... .......... 28% 264M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 26800K .......... .......... .......... .......... .......... 28% 382M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 26850K .......... .......... .......... .......... .......... 28% 367M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 26900K .......... .......... .......... .......... .......... 29% 313M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 26950K .......... .......... .......... .......... .......... 29% 269M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 27000K .......... .......... .......... .......... .......... 29% 376M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 27050K .......... .......... .......... .......... .......... 29% 249M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 27100K .......... .......... .......... .......... .......... 29% 314M 0s 2024-09-12T17:55:23.348 INFO:teuthology.orchestra.run.smithi107.stderr: 27150K .......... .......... .......... .......... .......... 29% 257M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27200K .......... .......... .......... .......... .......... 29% 280M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27250K .......... .......... .......... .......... .......... 29% 244M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27300K .......... .......... .......... .......... .......... 29% 274M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27350K .......... .......... .......... .......... .......... 29% 302M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27400K .......... .......... .......... .......... .......... 29% 382M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27450K .......... .......... .......... .......... .......... 29% 428M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27500K .......... .......... .......... .......... .......... 29% 146M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27550K .......... .......... .......... .......... .......... 29% 141M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27600K .......... .......... .......... .......... .......... 29% 73.3M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27650K .......... .......... .......... .......... .......... 29% 272M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27700K .......... .......... .......... .......... .......... 29% 388M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27750K .......... .......... .......... .......... .......... 29% 430M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27800K .......... .......... .......... .......... .......... 29% 437M 0s 2024-09-12T17:55:23.349 INFO:teuthology.orchestra.run.smithi107.stderr: 27850K .......... .......... .......... .......... .......... 30% 445M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 27900K .......... .......... .......... .......... .......... 30% 373M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 27950K .......... .......... .......... .......... .......... 30% 413M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28000K .......... .......... .......... .......... .......... 30% 284M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28050K .......... .......... .......... .......... .......... 30% 438M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28100K .......... .......... .......... .......... .......... 30% 328M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28150K .......... .......... .......... .......... .......... 30% 442M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28200K .......... .......... .......... .......... .......... 30% 277M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28250K .......... .......... .......... .......... .......... 30% 325M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28300K .......... .......... .......... .......... .......... 30% 50.4M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28350K .......... .......... .......... .......... .......... 30% 255M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28400K .......... .......... .......... .......... .......... 30% 428M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28450K .......... .......... .......... .......... .......... 30% 415M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28500K .......... .......... .......... .......... .......... 30% 367M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28550K .......... .......... .......... .......... .......... 30% 430M 0s 2024-09-12T17:55:23.350 INFO:teuthology.orchestra.run.smithi107.stderr: 28600K .......... .......... .......... .......... .......... 30% 428M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 28650K .......... .......... .......... .......... .......... 30% 117M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 28700K .......... .......... .......... .......... .......... 30% 291M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 28750K .......... .......... .......... .......... .......... 31% 375M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 28800K .......... .......... .......... .......... .......... 31% 340M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 28850K .......... .......... .......... .......... .......... 31% 445M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 28900K .......... .......... .......... .......... .......... 31% 390M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 28950K .......... .......... .......... .......... .......... 31% 214M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 29000K .......... .......... .......... .......... .......... 31% 193M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 29050K .......... .......... .......... .......... .......... 31% 85.4M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 29100K .......... .......... .......... .......... .......... 31% 221M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 29150K .......... .......... .......... .......... .......... 31% 354M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 29200K .......... .......... .......... .......... .......... 31% 289M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 29250K .......... .......... .......... .......... .......... 31% 235M 0s 2024-09-12T17:55:23.351 INFO:teuthology.orchestra.run.smithi107.stderr: 29300K .......... .......... .......... .......... .......... 31% 365M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29350K .......... .......... .......... .......... .......... 31% 362M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29400K .......... .......... .......... .......... .......... 31% 388M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29450K .......... .......... .......... .......... .......... 31% 197M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29500K .......... .......... .......... .......... .......... 31% 178M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29550K .......... .......... .......... .......... .......... 31% 348M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29600K .......... .......... .......... .......... .......... 31% 433M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29650K .......... .......... .......... .......... .......... 31% 432M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29700K .......... .......... .......... .......... .......... 32% 75.4M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29750K .......... .......... .......... .......... .......... 32% 150M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29800K .......... .......... .......... .......... .......... 32% 305M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29850K .......... .......... .......... .......... .......... 32% 175M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29900K .......... .......... .......... .......... .......... 32% 75.6M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 29950K .......... .......... .......... .......... .......... 32% 227M 0s 2024-09-12T17:55:23.352 INFO:teuthology.orchestra.run.smithi107.stderr: 30000K .......... .......... .......... .......... .......... 32% 352M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30050K .......... .......... .......... .......... .......... 32% 401M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30100K .......... .......... .......... .......... .......... 32% 414M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30150K .......... .......... .......... .......... .......... 32% 427M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30200K .......... .......... .......... .......... .......... 32% 435M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30250K .......... .......... .......... .......... .......... 32% 447M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30300K .......... .......... .......... .......... .......... 32% 133M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30350K .......... .......... .......... .......... .......... 32% 428M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30400K .......... .......... .......... .......... .......... 32% 351M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30450K .......... .......... .......... .......... .......... 32% 90.3M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30500K .......... .......... .......... .......... .......... 32% 253M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30550K .......... .......... .......... .......... .......... 32% 386M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30600K .......... .......... .......... .......... .......... 32% 295M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30650K .......... .......... .......... .......... .......... 33% 146M 0s 2024-09-12T17:55:23.353 INFO:teuthology.orchestra.run.smithi107.stderr: 30700K .......... .......... .......... .......... .......... 33% 426M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 30750K .......... .......... .......... .......... .......... 33% 193M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 30800K .......... .......... .......... .......... .......... 33% 432M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 30850K .......... .......... .......... .......... .......... 33% 381M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 30900K .......... .......... .......... .......... .......... 33% 444M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 30950K .......... .......... .......... .......... .......... 33% 274M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 31000K .......... .......... .......... .......... .......... 33% 371M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 31050K .......... .......... .......... .......... .......... 33% 444M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 31100K .......... .......... .......... .......... .......... 33% 406M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 31150K .......... .......... .......... .......... .......... 33% 343M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 31200K .......... .......... .......... .......... .......... 33% 444M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 31250K .......... .......... .......... .......... .......... 33% 410M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 31300K .......... .......... .......... .......... .......... 33% 454M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 31350K .......... .......... .......... .......... .......... 33% 54.0M 0s 2024-09-12T17:55:23.354 INFO:teuthology.orchestra.run.smithi107.stderr: 31400K .......... .......... .......... .......... .......... 33% 166M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 31450K .......... .......... .......... .......... .......... 33% 373M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 31500K .......... .......... .......... .......... .......... 33% 425M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 31550K .......... .......... .......... .......... .......... 34% 364M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 31600K .......... .......... .......... .......... .......... 34% 458M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 31650K .......... .......... .......... .......... .......... 34% 52.6M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 31700K .......... .......... .......... .......... .......... 34% 366M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 31750K .......... .......... .......... .......... .......... 34% 271M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 31800K .......... .......... .......... .......... .......... 34% 433M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 31850K .......... .......... .......... .......... .......... 34% 281M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 31900K .......... .......... .......... .......... .......... 34% 286M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 31950K .......... .......... .......... .......... .......... 34% 152M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 32000K .......... .......... .......... .......... .......... 34% 382M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 32050K .......... .......... .......... .......... .......... 34% 441M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 32100K .......... .......... .......... .......... .......... 34% 418M 0s 2024-09-12T17:55:23.355 INFO:teuthology.orchestra.run.smithi107.stderr: 32150K .......... .......... .......... .......... .......... 34% 393M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32200K .......... .......... .......... .......... .......... 34% 306M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32250K .......... .......... .......... .......... .......... 34% 339M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32300K .......... .......... .......... .......... .......... 34% 112M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32350K .......... .......... .......... .......... .......... 34% 355M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32400K .......... .......... .......... .......... .......... 34% 400M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32450K .......... .......... .......... .......... .......... 34% 442M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32500K .......... .......... .......... .......... .......... 35% 435M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32550K .......... .......... .......... .......... .......... 35% 355M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32600K .......... .......... .......... .......... .......... 35% 453M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32650K .......... .......... .......... .......... .......... 35% 442M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32700K .......... .......... .......... .......... .......... 35% 453M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32750K .......... .......... .......... .......... .......... 35% 109M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32800K .......... .......... .......... .......... .......... 35% 212M 0s 2024-09-12T17:55:23.356 INFO:teuthology.orchestra.run.smithi107.stderr: 32850K .......... .......... .......... .......... .......... 35% 348M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 32900K .......... .......... .......... .......... .......... 35% 417M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 32950K .......... .......... .......... .......... .......... 35% 50.3M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 33000K .......... .......... .......... .......... .......... 35% 109M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 33050K .......... .......... .......... .......... .......... 35% 428M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 33100K .......... .......... .......... .......... .......... 35% 280M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 33150K .......... .......... .......... .......... .......... 35% 357M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 33200K .......... .......... .......... .......... .......... 35% 445M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 33250K .......... .......... .......... .......... .......... 35% 437M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 33300K .......... .......... .......... .......... .......... 35% 451M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 33350K .......... .......... .......... .......... .......... 35% 214M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 33400K .......... .......... .......... .......... .......... 36% 435M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 33450K .......... .......... .......... .......... .......... 36% 437M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 33500K .......... .......... .......... .......... .......... 36% 428M 0s 2024-09-12T17:55:23.357 INFO:teuthology.orchestra.run.smithi107.stderr: 33550K .......... .......... .......... .......... .......... 36% 54.1M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 33600K .......... .......... .......... .......... .......... 36% 265M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 33650K .......... .......... .......... .......... .......... 36% 424M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 33700K .......... .......... .......... .......... .......... 36% 458M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 33750K .......... .......... .......... .......... .......... 36% 393M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 33800K .......... .......... .......... .......... .......... 36% 456M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 33850K .......... .......... .......... .......... .......... 36% 155M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 33900K .......... .......... .......... .......... .......... 36% 315M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 33950K .......... .......... .......... .......... .......... 36% 349M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 34000K .......... .......... .......... .......... .......... 36% 454M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 34050K .......... .......... .......... .......... .......... 36% 456M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 34100K .......... .......... .......... .......... .......... 36% 186M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 34150K .......... .......... .......... .......... .......... 36% 344M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 34200K .......... .......... .......... .......... .......... 36% 339M 0s 2024-09-12T17:55:23.358 INFO:teuthology.orchestra.run.smithi107.stderr: 34250K .......... .......... .......... .......... .......... 36% 322M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34300K .......... .......... .......... .......... .......... 36% 408M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34350K .......... .......... .......... .......... .......... 37% 89.2M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34400K .......... .......... .......... .......... .......... 37% 358M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34450K .......... .......... .......... .......... .......... 37% 270M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34500K .......... .......... .......... .......... .......... 37% 324M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34550K .......... .......... .......... .......... .......... 37% 164M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34600K .......... .......... .......... .......... .......... 37% 451M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34650K .......... .......... .......... .......... .......... 37% 456M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34700K .......... .......... .......... .......... .......... 37% 449M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34750K .......... .......... .......... .......... .......... 37% 51.3M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34800K .......... .......... .......... .......... .......... 37% 269M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34850K .......... .......... .......... .......... .......... 37% 124M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34900K .......... .......... .......... .......... .......... 37% 362M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 34950K .......... .......... .......... .......... .......... 37% 395M 0s 2024-09-12T17:55:23.359 INFO:teuthology.orchestra.run.smithi107.stderr: 35000K .......... .......... .......... .......... .......... 37% 447M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35050K .......... .......... .......... .......... .......... 37% 456M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35100K .......... .......... .......... .......... .......... 37% 420M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35150K .......... .......... .......... .......... .......... 37% 367M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35200K .......... .......... .......... .......... .......... 37% 443M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35250K .......... .......... .......... .......... .......... 37% 416M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35300K .......... .......... .......... .......... .......... 38% 442M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35350K .......... .......... .......... .......... .......... 38% 301M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35400K .......... .......... .......... .......... .......... 38% 448M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35450K .......... .......... .......... .......... .......... 38% 107M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35500K .......... .......... .......... .......... .......... 38% 189M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35550K .......... .......... .......... .......... .......... 38% 206M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35600K .......... .......... .......... .......... .......... 38% 370M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35650K .......... .......... .......... .......... .......... 38% 390M 0s 2024-09-12T17:55:23.360 INFO:teuthology.orchestra.run.smithi107.stderr: 35700K .......... .......... .......... .......... .......... 38% 382M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 35750K .......... .......... .......... .......... .......... 38% 376M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 35800K .......... .......... .......... .......... .......... 38% 200M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 35850K .......... .......... .......... .......... .......... 38% 409M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 35900K .......... .......... .......... .......... .......... 38% 440M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 35950K .......... .......... .......... .......... .......... 38% 258M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 36000K .......... .......... .......... .......... .......... 38% 90.4M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 36050K .......... .......... .......... .......... .......... 38% 66.0M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 36100K .......... .......... .......... .......... .......... 38% 355M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 36150K .......... .......... .......... .......... .......... 38% 389M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 36200K .......... .......... .......... .......... .......... 39% 300M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 36250K .......... .......... .......... .......... .......... 39% 159M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 36300K .......... .......... .......... .......... .......... 39% 298M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 36350K .......... .......... .......... .......... .......... 39% 335M 0s 2024-09-12T17:55:23.361 INFO:teuthology.orchestra.run.smithi107.stderr: 36400K .......... .......... .......... .......... .......... 39% 422M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 36450K .......... .......... .......... .......... .......... 39% 379M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 36500K .......... .......... .......... .......... .......... 39% 382M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 36550K .......... .......... .......... .......... .......... 39% 122M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 36600K .......... .......... .......... .......... .......... 39% 331M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 36650K .......... .......... .......... .......... .......... 39% 156M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 36700K .......... .......... .......... .......... .......... 39% 396M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 36750K .......... .......... .......... .......... .......... 39% 316M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 36800K .......... .......... .......... .......... .......... 39% 358M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 36850K .......... .......... .......... .......... .......... 39% 352M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 36900K .......... .......... .......... .......... .......... 39% 116M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 36950K .......... .......... .......... .......... .......... 39% 271M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 37000K .......... .......... .......... .......... .......... 39% 231M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 37050K .......... .......... .......... .......... .......... 39% 395M 0s 2024-09-12T17:55:23.362 INFO:teuthology.orchestra.run.smithi107.stderr: 37100K .......... .......... .......... .......... .......... 39% 342M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37150K .......... .......... .......... .......... .......... 40% 117M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37200K .......... .......... .......... .......... .......... 40% 408M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37250K .......... .......... .......... .......... .......... 40% 364M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37300K .......... .......... .......... .......... .......... 40% 421M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37350K .......... .......... .......... .......... .......... 40% 351M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37400K .......... .......... .......... .......... .......... 40% 212M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37450K .......... .......... .......... .......... .......... 40% 409M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37500K .......... .......... .......... .......... .......... 40% 453M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37550K .......... .......... .......... .......... .......... 40% 243M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37600K .......... .......... .......... .......... .......... 40% 71.7M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37650K .......... .......... .......... .......... .......... 40% 385M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37700K .......... .......... .......... .......... .......... 40% 397M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37750K .......... .......... .......... .......... .......... 40% 338M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37800K .......... .......... .......... .......... .......... 40% 152M 0s 2024-09-12T17:55:23.363 INFO:teuthology.orchestra.run.smithi107.stderr: 37850K .......... .......... .......... .......... .......... 40% 182M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 37900K .......... .......... .......... .......... .......... 40% 214M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 37950K .......... .......... .......... .......... .......... 40% 188M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 38000K .......... .......... .......... .......... .......... 40% 168M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 38050K .......... .......... .......... .......... .......... 41% 399M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 38100K .......... .......... .......... .......... .......... 41% 368M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 38150K .......... .......... .......... .......... .......... 41% 354M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 38200K .......... .......... .......... .......... .......... 41% 389M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 38250K .......... .......... .......... .......... .......... 41% 391M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 38300K .......... .......... .......... .......... .......... 41% 412M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 38350K .......... .......... .......... .......... .......... 41% 332M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 38400K .......... .......... .......... .......... .......... 41% 239M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 38450K .......... .......... .......... .......... .......... 41% 391M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 38500K .......... .......... .......... .......... .......... 41% 113M 0s 2024-09-12T17:55:23.364 INFO:teuthology.orchestra.run.smithi107.stderr: 38550K .......... .......... .......... .......... .......... 41% 300M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 38600K .......... .......... .......... .......... .......... 41% 214M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 38650K .......... .......... .......... .......... .......... 41% 402M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 38700K .......... .......... .......... .......... .......... 41% 389M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 38750K .......... .......... .......... .......... .......... 41% 334M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 38800K .......... .......... .......... .......... .......... 41% 292M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 38850K .......... .......... .......... .......... .......... 41% 368M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 38900K .......... .......... .......... .......... .......... 41% 351M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 38950K .......... .......... .......... .......... .......... 41% 252M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 39000K .......... .......... .......... .......... .......... 42% 412M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 39050K .......... .......... .......... .......... .......... 42% 77.8M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 39100K .......... .......... .......... .......... .......... 42% 83.7M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 39150K .......... .......... .......... .......... .......... 42% 233M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 39200K .......... .......... .......... .......... .......... 42% 359M 0s 2024-09-12T17:55:23.365 INFO:teuthology.orchestra.run.smithi107.stderr: 39250K .......... .......... .......... .......... .......... 42% 377M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39300K .......... .......... .......... .......... .......... 42% 436M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39350K .......... .......... .......... .......... .......... 42% 358M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39400K .......... .......... .......... .......... .......... 42% 327M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39450K .......... .......... .......... .......... .......... 42% 364M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39500K .......... .......... .......... .......... .......... 42% 208M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39550K .......... .......... .......... .......... .......... 42% 302M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39600K .......... .......... .......... .......... .......... 42% 319M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39650K .......... .......... .......... .......... .......... 42% 396M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39700K .......... .......... .......... .......... .......... 42% 115M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39750K .......... .......... .......... .......... .......... 42% 105M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39800K .......... .......... .......... .......... .......... 42% 279M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39850K .......... .......... .......... .......... .......... 42% 410M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39900K .......... .......... .......... .......... .......... 43% 423M 0s 2024-09-12T17:55:23.366 INFO:teuthology.orchestra.run.smithi107.stderr: 39950K .......... .......... .......... .......... .......... 43% 115M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40000K .......... .......... .......... .......... .......... 43% 367M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40050K .......... .......... .......... .......... .......... 43% 205M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40100K .......... .......... .......... .......... .......... 43% 401M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40150K .......... .......... .......... .......... .......... 43% 353M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40200K .......... .......... .......... .......... .......... 43% 88.3M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40250K .......... .......... .......... .......... .......... 43% 366M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40300K .......... .......... .......... .......... .......... 43% 409M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40350K .......... .......... .......... .......... .......... 43% 288M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40400K .......... .......... .......... .......... .......... 43% 387M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40450K .......... .......... .......... .......... .......... 43% 147M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40500K .......... .......... .......... .......... .......... 43% 406M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40550K .......... .......... .......... .......... .......... 43% 393M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40600K .......... .......... .......... .......... .......... 43% 391M 0s 2024-09-12T17:55:23.367 INFO:teuthology.orchestra.run.smithi107.stderr: 40650K .......... .......... .......... .......... .......... 43% 108M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 40700K .......... .......... .......... .......... .......... 43% 368M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 40750K .......... .......... .......... .......... .......... 43% 293M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 40800K .......... .......... .......... .......... .......... 43% 369M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 40850K .......... .......... .......... .......... .......... 44% 389M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 40900K .......... .......... .......... .......... .......... 44% 239M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 40950K .......... .......... .......... .......... .......... 44% 265M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 41000K .......... .......... .......... .......... .......... 44% 375M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 41050K .......... .......... .......... .......... .......... 44% 209M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 41100K .......... .......... .......... .......... .......... 44% 103M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 41150K .......... .......... .......... .......... .......... 44% 230M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 41200K .......... .......... .......... .......... .......... 44% 370M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 41250K .......... .......... .......... .......... .......... 44% 218M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 41300K .......... .......... .......... .......... .......... 44% 202M 0s 2024-09-12T17:55:23.368 INFO:teuthology.orchestra.run.smithi107.stderr: 41350K .......... .......... .......... .......... .......... 44% 235M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 41400K .......... .......... .......... .......... .......... 44% 183M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 41450K .......... .......... .......... .......... .......... 44% 336M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 41500K .......... .......... .......... .......... .......... 44% 381M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 41550K .......... .......... .......... .......... .......... 44% 330M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 41600K .......... .......... .......... .......... .......... 44% 358M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 41650K .......... .......... .......... .......... .......... 44% 396M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 41700K .......... .......... .......... .......... .......... 44% 354M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 41750K .......... .......... .......... .......... .......... 44% 350M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 41800K .......... .......... .......... .......... .......... 45% 403M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 41850K .......... .......... .......... .......... .......... 45% 348M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 41900K .......... .......... .......... .......... .......... 45% 391M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 41950K .......... .......... .......... .......... .......... 45% 155M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 42000K .......... .......... .......... .......... .......... 45% 430M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 42050K .......... .......... .......... .......... .......... 45% 116M 0s 2024-09-12T17:55:23.369 INFO:teuthology.orchestra.run.smithi107.stderr: 42100K .......... .......... .......... .......... .......... 45% 302M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42150K .......... .......... .......... .......... .......... 45% 60.3M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42200K .......... .......... .......... .......... .......... 45% 328M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42250K .......... .......... .......... .......... .......... 45% 285M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42300K .......... .......... .......... .......... .......... 45% 328M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42350K .......... .......... .......... .......... .......... 45% 333M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42400K .......... .......... .......... .......... .......... 45% 405M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42450K .......... .......... .......... .......... .......... 45% 434M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42500K .......... .......... .......... .......... .......... 45% 326M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42550K .......... .......... .......... .......... .......... 45% 330M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42600K .......... .......... .......... .......... .......... 45% 126M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42650K .......... .......... .......... .......... .......... 45% 436M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42700K .......... .......... .......... .......... .......... 46% 216M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42750K .......... .......... .......... .......... .......... 46% 284M 0s 2024-09-12T17:55:23.370 INFO:teuthology.orchestra.run.smithi107.stderr: 42800K .......... .......... .......... .......... .......... 46% 125M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 42850K .......... .......... .......... .......... .......... 46% 223M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 42900K .......... .......... .......... .......... .......... 46% 432M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 42950K .......... .......... .......... .......... .......... 46% 398M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 43000K .......... .......... .......... .......... .......... 46% 232M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 43050K .......... .......... .......... .......... .......... 46% 333M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 43100K .......... .......... .......... .......... .......... 46% 364M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 43150K .......... .......... .......... .......... .......... 46% 295M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 43200K .......... .......... .......... .......... .......... 46% 316M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 43250K .......... .......... .......... .......... .......... 46% 95.8M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 43300K .......... .......... .......... .......... .......... 46% 108M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 43350K .......... .......... .......... .......... .......... 46% 319M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 43400K .......... .......... .......... .......... .......... 46% 199M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 43450K .......... .......... .......... .......... .......... 46% 219M 0s 2024-09-12T17:55:23.371 INFO:teuthology.orchestra.run.smithi107.stderr: 43500K .......... .......... .......... .......... .......... 46% 138M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 43550K .......... .......... .......... .......... .......... 46% 366M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 43600K .......... .......... .......... .......... .......... 46% 402M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 43650K .......... .......... .......... .......... .......... 47% 421M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 43700K .......... .......... .......... .......... .......... 47% 88.8M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 43750K .......... .......... .......... .......... .......... 47% 292M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 43800K .......... .......... .......... .......... .......... 47% 435M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 43850K .......... .......... .......... .......... .......... 47% 418M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 43900K .......... .......... .......... .......... .......... 47% 452M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 43950K .......... .......... .......... .......... .......... 47% 368M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 44000K .......... .......... .......... .......... .......... 47% 438M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 44050K .......... .......... .......... .......... .......... 47% 459M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 44100K .......... .......... .......... .......... .......... 47% 399M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 44150K .......... .......... .......... .......... .......... 47% 163M 0s 2024-09-12T17:55:23.372 INFO:teuthology.orchestra.run.smithi107.stderr: 44200K .......... .......... .......... .......... .......... 47% 98.7M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44250K .......... .......... .......... .......... .......... 47% 316M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44300K .......... .......... .......... .......... .......... 47% 442M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44350K .......... .......... .......... .......... .......... 47% 371M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44400K .......... .......... .......... .......... .......... 47% 181M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44450K .......... .......... .......... .......... .......... 47% 113M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44500K .......... .......... .......... .......... .......... 47% 438M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44550K .......... .......... .......... .......... .......... 48% 273M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44600K .......... .......... .......... .......... .......... 48% 441M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44650K .......... .......... .......... .......... .......... 48% 391M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44700K .......... .......... .......... .......... .......... 48% 439M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44750K .......... .......... .......... .......... .......... 48% 369M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44800K .......... .......... .......... .......... .......... 48% 362M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44850K .......... .......... .......... .......... .......... 48% 370M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44900K .......... .......... .......... .......... .......... 48% 460M 0s 2024-09-12T17:55:23.373 INFO:teuthology.orchestra.run.smithi107.stderr: 44950K .......... .......... .......... .......... .......... 48% 93.2M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45000K .......... .......... .......... .......... .......... 48% 374M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45050K .......... .......... .......... .......... .......... 48% 361M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45100K .......... .......... .......... .......... .......... 48% 144M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45150K .......... .......... .......... .......... .......... 48% 298M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45200K .......... .......... .......... .......... .......... 48% 82.7M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45250K .......... .......... .......... .......... .......... 48% 366M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45300K .......... .......... .......... .......... .......... 48% 416M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45350K .......... .......... .......... .......... .......... 48% 82.0M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45400K .......... .......... .......... .......... .......... 48% 388M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45450K .......... .......... .......... .......... .......... 48% 344M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45500K .......... .......... .......... .......... .......... 49% 346M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45550K .......... .......... .......... .......... .......... 49% 370M 0s 2024-09-12T17:55:23.374 INFO:teuthology.orchestra.run.smithi107.stderr: 45600K .......... .......... .......... .......... .......... 49% 310M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 45650K .......... .......... .......... .......... .......... 49% 353M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 45700K .......... .......... .......... .......... .......... 49% 337M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 45750K .......... .......... .......... .......... .......... 49% 364M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 45800K .......... .......... .......... .......... .......... 49% 313M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 45850K .......... .......... .......... .......... .......... 49% 53.7M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 45900K .......... .......... .......... .......... .......... 49% 373M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 45950K .......... .......... .......... .......... .......... 49% 293M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 46000K .......... .......... .......... .......... .......... 49% 318M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 46050K .......... .......... .......... .......... .......... 49% 366M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 46100K .......... .......... .......... .......... .......... 49% 316M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 46150K .......... .......... .......... .......... .......... 49% 394M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 46200K .......... .......... .......... .......... .......... 49% 397M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 46250K .......... .......... .......... .......... .......... 49% 425M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 46300K .......... .......... .......... .......... .......... 49% 470M 0s 2024-09-12T17:55:23.375 INFO:teuthology.orchestra.run.smithi107.stderr: 46350K .......... .......... .......... .......... .......... 49% 130M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 46400K .......... .......... .......... .......... .......... 49% 403M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 46450K .......... .......... .......... .......... .......... 50% 436M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 46500K .......... .......... .......... .......... .......... 50% 117M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 46550K .......... .......... .......... .......... .......... 50% 164M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 46600K .......... .......... .......... .......... .......... 50% 415M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 46650K .......... .......... .......... .......... .......... 50% 433M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 46700K .......... .......... .......... .......... .......... 50% 406M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 46750K .......... .......... .......... .......... .......... 50% 121M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 46800K .......... .......... .......... .......... .......... 50% 221M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 46850K .......... .......... .......... .......... .......... 50% 262M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 46900K .......... .......... .......... .......... .......... 50% 162M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 46950K .......... .......... .......... .......... .......... 50% 369M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 47000K .......... .......... .......... .......... .......... 50% 417M 0s 2024-09-12T17:55:23.376 INFO:teuthology.orchestra.run.smithi107.stderr: 47050K .......... .......... .......... .......... .......... 50% 390M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47100K .......... .......... .......... .......... .......... 50% 408M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47150K .......... .......... .......... .......... .......... 50% 295M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47200K .......... .......... .......... .......... .......... 50% 403M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47250K .......... .......... .......... .......... .......... 50% 228M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47300K .......... .......... .......... .......... .......... 50% 159M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47350K .......... .......... .......... .......... .......... 51% 280M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47400K .......... .......... .......... .......... .......... 51% 289M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47450K .......... .......... .......... .......... .......... 51% 209M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47500K .......... .......... .......... .......... .......... 51% 149M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47550K .......... .......... .......... .......... .......... 51% 210M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47600K .......... .......... .......... .......... .......... 51% 334M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47650K .......... .......... .......... .......... .......... 51% 293M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47700K .......... .......... .......... .......... .......... 51% 373M 0s 2024-09-12T17:55:23.377 INFO:teuthology.orchestra.run.smithi107.stderr: 47750K .......... .......... .......... .......... .......... 51% 336M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 47800K .......... .......... .......... .......... .......... 51% 387M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 47850K .......... .......... .......... .......... .......... 51% 243M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 47900K .......... .......... .......... .......... .......... 51% 229M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 47950K .......... .......... .......... .......... .......... 51% 61.6M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 48000K .......... .......... .......... .......... .......... 51% 295M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 48050K .......... .......... .......... .......... .......... 51% 383M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 48100K .......... .......... .......... .......... .......... 51% 357M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 48150K .......... .......... .......... .......... .......... 51% 337M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 48200K .......... .......... .......... .......... .......... 51% 403M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 48250K .......... .......... .......... .......... .......... 51% 488M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 48300K .......... .......... .......... .......... .......... 52% 234M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 48350K .......... .......... .......... .......... .......... 52% 94.4M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 48400K .......... .......... .......... .......... .......... 52% 265M 0s 2024-09-12T17:55:23.378 INFO:teuthology.orchestra.run.smithi107.stderr: 48450K .......... .......... .......... .......... .......... 52% 109M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 48500K .......... .......... .......... .......... .......... 52% 394M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 48550K .......... .......... .......... .......... .......... 52% 290M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 48600K .......... .......... .......... .......... .......... 52% 431M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 48650K .......... .......... .......... .......... .......... 52% 361M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 48700K .......... .......... .......... .......... .......... 52% 382M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 48750K .......... .......... .......... .......... .......... 52% 347M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 48800K .......... .......... .......... .......... .......... 52% 331M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 48850K .......... .......... .......... .......... .......... 52% 449M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 48900K .......... .......... .......... .......... .......... 52% 90.0M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 48950K .......... .......... .......... .......... .......... 52% 382M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 49000K .......... .......... .......... .......... .......... 52% 161M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 49050K .......... .......... .......... .......... .......... 52% 251M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 49100K .......... .......... .......... .......... .......... 52% 311M 0s 2024-09-12T17:55:23.379 INFO:teuthology.orchestra.run.smithi107.stderr: 49150K .......... .......... .......... .......... .......... 52% 207M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49200K .......... .......... .......... .......... .......... 53% 315M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49250K .......... .......... .......... .......... .......... 53% 348M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49300K .......... .......... .......... .......... .......... 53% 354M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49350K .......... .......... .......... .......... .......... 53% 305M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49400K .......... .......... .......... .......... .......... 53% 393M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49450K .......... .......... .......... .......... .......... 53% 405M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49500K .......... .......... .......... .......... .......... 53% 442M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49550K .......... .......... .......... .......... .......... 53% 84.8M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49600K .......... .......... .......... .......... .......... 53% 406M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49650K .......... .......... .......... .......... .......... 53% 378M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49700K .......... .......... .......... .......... .......... 53% 154M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49750K .......... .......... .......... .......... .......... 53% 349M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49800K .......... .......... .......... .......... .......... 53% 341M 0s 2024-09-12T17:55:23.380 INFO:teuthology.orchestra.run.smithi107.stderr: 49850K .......... .......... .......... .......... .......... 53% 403M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 49900K .......... .......... .......... .......... .......... 53% 369M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 49950K .......... .......... .......... .......... .......... 53% 219M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 50000K .......... .......... .......... .......... .......... 53% 123M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 50050K .......... .......... .......... .......... .......... 53% 301M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 50100K .......... .......... .......... .......... .......... 53% 252M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 50150K .......... .......... .......... .......... .......... 54% 328M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 50200K .......... .......... .......... .......... .......... 54% 448M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 50250K .......... .......... .......... .......... .......... 54% 227M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 50300K .......... .......... .......... .......... .......... 54% 376M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 50350K .......... .......... .......... .......... .......... 54% 183M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 50400K .......... .......... .......... .......... .......... 54% 359M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 50450K .......... .......... .......... .......... .......... 54% 246M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 50500K .......... .......... .......... .......... .......... 54% 106M 0s 2024-09-12T17:55:23.381 INFO:teuthology.orchestra.run.smithi107.stderr: 50550K .......... .......... .......... .......... .......... 54% 201M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 50600K .......... .......... .......... .......... .......... 54% 313M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 50650K .......... .......... .......... .......... .......... 54% 397M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 50700K .......... .......... .......... .......... .......... 54% 277M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 50750K .......... .......... .......... .......... .......... 54% 156M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 50800K .......... .......... .......... .......... .......... 54% 320M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 50850K .......... .......... .......... .......... .......... 54% 410M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 50900K .......... .......... .......... .......... .......... 54% 424M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 50950K .......... .......... .......... .......... .......... 54% 322M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 51000K .......... .......... .......... .......... .......... 54% 93.5M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 51050K .......... .......... .......... .......... .......... 55% 366M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 51100K .......... .......... .......... .......... .......... 55% 131M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 51150K .......... .......... .......... .......... .......... 55% 346M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 51200K .......... .......... .......... .......... .......... 55% 327M 0s 2024-09-12T17:55:23.382 INFO:teuthology.orchestra.run.smithi107.stderr: 51250K .......... .......... .......... .......... .......... 55% 210M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51300K .......... .......... .......... .......... .......... 55% 429M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51350K .......... .......... .......... .......... .......... 55% 373M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51400K .......... .......... .......... .......... .......... 55% 266M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51450K .......... .......... .......... .......... .......... 55% 138M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51500K .......... .......... .......... .......... .......... 55% 117M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51550K .......... .......... .......... .......... .......... 55% 344M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51600K .......... .......... .......... .......... .......... 55% 95.0M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51650K .......... .......... .......... .......... .......... 55% 307M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51700K .......... .......... .......... .......... .......... 55% 233M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51750K .......... .......... .......... .......... .......... 55% 355M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51800K .......... .......... .......... .......... .......... 55% 385M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51850K .......... .......... .......... .......... .......... 55% 461M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51900K .......... .......... .......... .......... .......... 55% 270M 0s 2024-09-12T17:55:23.383 INFO:teuthology.orchestra.run.smithi107.stderr: 51950K .......... .......... .......... .......... .......... 55% 315M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52000K .......... .......... .......... .......... .......... 56% 393M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52050K .......... .......... .......... .......... .......... 56% 384M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52100K .......... .......... .......... .......... .......... 56% 264M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52150K .......... .......... .......... .......... .......... 56% 151M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52200K .......... .......... .......... .......... .......... 56% 416M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52250K .......... .......... .......... .......... .......... 56% 118M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52300K .......... .......... .......... .......... .......... 56% 312M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52350K .......... .......... .......... .......... .......... 56% 416M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52400K .......... .......... .......... .......... .......... 56% 261M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52450K .......... .......... .......... .......... .......... 56% 278M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52500K .......... .......... .......... .......... .......... 56% 279M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52550K .......... .......... .......... .......... .......... 56% 416M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52600K .......... .......... .......... .......... .......... 56% 276M 0s 2024-09-12T17:55:23.384 INFO:teuthology.orchestra.run.smithi107.stderr: 52650K .......... .......... .......... .......... .......... 56% 217M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 52700K .......... .......... .......... .......... .......... 56% 151M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 52750K .......... .......... .......... .......... .......... 56% 257M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 52800K .......... .......... .......... .......... .......... 56% 357M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 52850K .......... .......... .......... .......... .......... 56% 223M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 52900K .......... .......... .......... .......... .......... 56% 324M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 52950K .......... .......... .......... .......... .......... 57% 411M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 53000K .......... .......... .......... .......... .......... 57% 417M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 53050K .......... .......... .......... .......... .......... 57% 234M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 53100K .......... .......... .......... .......... .......... 57% 231M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 53150K .......... .......... .......... .......... .......... 57% 191M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 53200K .......... .......... .......... .......... .......... 57% 363M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 53250K .......... .......... .......... .......... .......... 57% 179M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 53300K .......... .......... .......... .......... .......... 57% 302M 0s 2024-09-12T17:55:23.385 INFO:teuthology.orchestra.run.smithi107.stderr: 53350K .......... .......... .......... .......... .......... 57% 386M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 53400K .......... .......... .......... .......... .......... 57% 374M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 53450K .......... .......... .......... .......... .......... 57% 430M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 53500K .......... .......... .......... .......... .......... 57% 66.6M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 53550K .......... .......... .......... .......... .......... 57% 324M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 53600K .......... .......... .......... .......... .......... 57% 131M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 53650K .......... .......... .......... .......... .......... 57% 370M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 53700K .......... .......... .......... .......... .......... 57% 306M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 53750K .......... .......... .......... .......... .......... 57% 384M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 53800K .......... .......... .......... .......... .......... 57% 336M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 53850K .......... .......... .......... .......... .......... 58% 457M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 53900K .......... .......... .......... .......... .......... 58% 94.8M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 53950K .......... .......... .......... .......... .......... 58% 279M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 54000K .......... .......... .......... .......... .......... 58% 324M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 54050K .......... .......... .......... .......... .......... 58% 353M 0s 2024-09-12T17:55:23.386 INFO:teuthology.orchestra.run.smithi107.stderr: 54100K .......... .......... .......... .......... .......... 58% 425M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54150K .......... .......... .......... .......... .......... 58% 73.7M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54200K .......... .......... .......... .......... .......... 58% 282M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54250K .......... .......... .......... .......... .......... 58% 371M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54300K .......... .......... .......... .......... .......... 58% 313M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54350K .......... .......... .......... .......... .......... 58% 327M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54400K .......... .......... .......... .......... .......... 58% 382M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54450K .......... .......... .......... .......... .......... 58% 367M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54500K .......... .......... .......... .......... .......... 58% 351M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54550K .......... .......... .......... .......... .......... 58% 450M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54600K .......... .......... .......... .......... .......... 58% 192M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54650K .......... .......... .......... .......... .......... 58% 80.2M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54700K .......... .......... .......... .......... .......... 58% 113M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54750K .......... .......... .......... .......... .......... 58% 344M 0s 2024-09-12T17:55:23.387 INFO:teuthology.orchestra.run.smithi107.stderr: 54800K .......... .......... .......... .......... .......... 59% 426M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 54850K .......... .......... .......... .......... .......... 59% 395M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 54900K .......... .......... .......... .......... .......... 59% 274M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 54950K .......... .......... .......... .......... .......... 59% 408M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 55000K .......... .......... .......... .......... .......... 59% 385M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 55050K .......... .......... .......... .......... .......... 59% 127M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 55100K .......... .......... .......... .......... .......... 59% 285M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 55150K .......... .......... .......... .......... .......... 59% 299M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 55200K .......... .......... .......... .......... .......... 59% 410M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 55250K .......... .......... .......... .......... .......... 59% 353M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 55300K .......... .......... .......... .......... .......... 59% 338M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 55350K .......... .......... .......... .......... .......... 59% 204M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 55400K .......... .......... .......... .......... .......... 59% 270M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 55450K .......... .......... .......... .......... .......... 59% 308M 0s 2024-09-12T17:55:23.388 INFO:teuthology.orchestra.run.smithi107.stderr: 55500K .......... .......... .......... .......... .......... 59% 291M 0s 2024-09-12T17:55:23.389 INFO:teuthology.orchestra.run.smithi107.stderr: 55550K .......... .......... .......... .......... .......... 59% 348M 0s 2024-09-12T17:55:23.389 INFO:teuthology.orchestra.run.smithi107.stderr: 55600K .......... .......... .......... .......... .......... 59% 408M 0s 2024-09-12T17:55:23.389 INFO:teuthology.orchestra.run.smithi107.stderr: 55650K .......... .......... .......... .......... .......... 59% 252M 0s 2024-09-12T17:55:23.389 INFO:teuthology.orchestra.run.smithi107.stderr: 55700K .......... .......... .......... .......... .......... 60% 103M 0s 2024-09-12T17:55:23.389 INFO:teuthology.orchestra.run.smithi107.stderr: 55750K .......... .......... .......... .......... .......... 60% 300M 0s 2024-09-12T17:55:23.389 INFO:teuthology.orchestra.run.smithi107.stderr: 55800K .......... .......... .......... .......... .......... 60% 179M 0s 2024-09-12T17:55:23.389 INFO:teuthology.orchestra.run.smithi107.stderr: 55850K .......... .......... .......... .......... .......... 60% 382M 0s 2024-09-12T17:55:23.389 INFO:teuthology.orchestra.run.smithi107.stderr: 55900K .......... .......... .......... .......... .......... 60% 146M 0s 2024-09-12T17:55:23.389 INFO:teuthology.orchestra.run.smithi107.stderr: 55950K .......... .......... .......... .......... .......... 60% 389M 0s 2024-09-12T17:55:23.389 INFO:teuthology.orchestra.run.smithi107.stderr: 56000K .......... .......... .......... .......... .......... 60% 340M 0s 2024-09-12T17:55:23.389 INFO:teuthology.orchestra.run.smithi107.stderr: 56050K .......... .......... .......... .......... .......... 60% 391M 0s 2024-09-12T17:55:23.392 INFO:teuthology.orchestra.run.smithi107.stderr: 56100K .......... .......... .......... .......... .......... 60% 327M 0s 2024-09-12T17:55:23.392 INFO:teuthology.orchestra.run.smithi107.stderr: 56150K .......... .......... .......... .......... .......... 60% 392M 0s 2024-09-12T17:55:23.392 INFO:teuthology.orchestra.run.smithi107.stderr: 56200K .......... .......... .......... .......... .......... 60% 417M 0s 2024-09-12T17:55:23.392 INFO:teuthology.orchestra.run.smithi107.stderr: 56250K .......... .......... .......... .......... .......... 60% 438M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56300K .......... .......... .......... .......... .......... 60% 60.7M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56350K .......... .......... .......... .......... .......... 60% 380M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56400K .......... .......... .......... .......... .......... 60% 362M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56450K .......... .......... .......... .......... .......... 60% 402M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56500K .......... .......... .......... .......... .......... 60% 356M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56550K .......... .......... .......... .......... .......... 60% 361M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56600K .......... .......... .......... .......... .......... 60% 308M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56650K .......... .......... .......... .......... .......... 61% 435M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56700K .......... .......... .......... .......... .......... 61% 126M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56750K .......... .......... .......... .......... .......... 61% 310M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56800K .......... .......... .......... .......... .......... 61% 290M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56850K .......... .......... .......... .......... .......... 61% 258M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56900K .......... .......... .......... .......... .......... 61% 270M 0s 2024-09-12T17:55:23.393 INFO:teuthology.orchestra.run.smithi107.stderr: 56950K .......... .......... .......... .......... .......... 61% 96.8M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57000K .......... .......... .......... .......... .......... 61% 150M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57050K .......... .......... .......... .......... .......... 61% 292M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57100K .......... .......... .......... .......... .......... 61% 120M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57150K .......... .......... .......... .......... .......... 61% 294M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57200K .......... .......... .......... .......... .......... 61% 451M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57250K .......... .......... .......... .......... .......... 61% 97.4M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57300K .......... .......... .......... .......... .......... 61% 255M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57350K .......... .......... .......... .......... .......... 61% 239M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57400K .......... .......... .......... .......... .......... 61% 421M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57450K .......... .......... .......... .......... .......... 61% 355M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57500K .......... .......... .......... .......... .......... 61% 356M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57550K .......... .......... .......... .......... .......... 62% 293M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57600K .......... .......... .......... .......... .......... 62% 310M 0s 2024-09-12T17:55:23.394 INFO:teuthology.orchestra.run.smithi107.stderr: 57650K .......... .......... .......... .......... .......... 62% 379M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 57700K .......... .......... .......... .......... .......... 62% 317M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 57750K .......... .......... .......... .......... .......... 62% 133M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 57800K .......... .......... .......... .......... .......... 62% 419M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 57850K .......... .......... .......... .......... .......... 62% 119M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 57900K .......... .......... .......... .......... .......... 62% 300M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 57950K .......... .......... .......... .......... .......... 62% 401M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 58000K .......... .......... .......... .......... .......... 62% 358M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 58050K .......... .......... .......... .......... .......... 62% 303M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 58100K .......... .......... .......... .......... .......... 62% 354M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 58150K .......... .......... .......... .......... .......... 62% 111M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 58200K .......... .......... .......... .......... .......... 62% 371M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 58250K .......... .......... .......... .......... .......... 62% 381M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 58300K .......... .......... .......... .......... .......... 62% 344M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 58350K .......... .......... .......... .......... .......... 62% 418M 0s 2024-09-12T17:55:23.395 INFO:teuthology.orchestra.run.smithi107.stderr: 58400K .......... .......... .......... .......... .......... 62% 282M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 58450K .......... .......... .......... .......... .......... 62% 93.8M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 58500K .......... .......... .......... .......... .......... 63% 375M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 58550K .......... .......... .......... .......... .......... 63% 393M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 58600K .......... .......... .......... .......... .......... 63% 359M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 58650K .......... .......... .......... .......... .......... 63% 396M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 58700K .......... .......... .......... .......... .......... 63% 294M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 58750K .......... .......... .......... .......... .......... 63% 376M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 58800K .......... .......... .......... .......... .......... 63% 427M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 58850K .......... .......... .......... .......... .......... 63% 312M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 58900K .......... .......... .......... .......... .......... 63% 128M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 58950K .......... .......... .......... .......... .......... 63% 316M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 59000K .......... .......... .......... .......... .......... 63% 382M 0s 2024-09-12T17:55:23.396 INFO:teuthology.orchestra.run.smithi107.stderr: 59050K .......... .......... .......... .......... .......... 63% 99.8M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59100K .......... .......... .......... .......... .......... 63% 268M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59150K .......... .......... .......... .......... .......... 63% 353M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59200K .......... .......... .......... .......... .......... 63% 357M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59250K .......... .......... .......... .......... .......... 63% 475M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59300K .......... .......... .......... .......... .......... 63% 100M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59350K .......... .......... .......... .......... .......... 63% 303M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59400K .......... .......... .......... .......... .......... 63% 110M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59450K .......... .......... .......... .......... .......... 64% 357M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59500K .......... .......... .......... .......... .......... 64% 351M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59550K .......... .......... .......... .......... .......... 64% 380M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59600K .......... .......... .......... .......... .......... 64% 316M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59650K .......... .......... .......... .......... .......... 64% 427M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59700K .......... .......... .......... .......... .......... 64% 353M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59750K .......... .......... .......... .......... .......... 64% 221M 0s 2024-09-12T17:55:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 59800K .......... .......... .......... .......... .......... 64% 379M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 59850K .......... .......... .......... .......... .......... 64% 429M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 59900K .......... .......... .......... .......... .......... 64% 88.0M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 59950K .......... .......... .......... .......... .......... 64% 255M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 60000K .......... .......... .......... .......... .......... 64% 322M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 60050K .......... .......... .......... .......... .......... 64% 105M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 60100K .......... .......... .......... .......... .......... 64% 327M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 60150K .......... .......... .......... .......... .......... 64% 451M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 60200K .......... .......... .......... .......... .......... 64% 196M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 60250K .......... .......... .......... .......... .......... 64% 404M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 60300K .......... .......... .......... .......... .......... 64% 43.1M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 60350K .......... .......... .......... .......... .......... 65% 289M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 60400K .......... .......... .......... .......... .......... 65% 305M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 60450K .......... .......... .......... .......... .......... 65% 310M 0s 2024-09-12T17:55:23.398 INFO:teuthology.orchestra.run.smithi107.stderr: 60500K .......... .......... .......... .......... .......... 65% 314M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 60550K .......... .......... .......... .......... .......... 65% 372M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 60600K .......... .......... .......... .......... .......... 65% 426M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 60650K .......... .......... .......... .......... .......... 65% 426M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 60700K .......... .......... .......... .......... .......... 65% 259M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 60750K .......... .......... .......... .......... .......... 65% 401M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 60800K .......... .......... .......... .......... .......... 65% 381M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 60850K .......... .......... .......... .......... .......... 65% 444M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 60900K .......... .......... .......... .......... .......... 65% 388M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 60950K .......... .......... .......... .......... .......... 65% 261M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 61000K .......... .......... .......... .......... .......... 65% 392M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 61050K .......... .......... .......... .......... .......... 65% 320M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 61100K .......... .......... .......... .......... .......... 65% 308M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 61150K .......... .......... .......... .......... .......... 65% 404M 0s 2024-09-12T17:55:23.399 INFO:teuthology.orchestra.run.smithi107.stderr: 61200K .......... .......... .......... .......... .......... 65% 388M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61250K .......... .......... .......... .......... .......... 65% 80.1M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61300K .......... .......... .......... .......... .......... 66% 349M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61350K .......... .......... .......... .......... .......... 66% 313M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61400K .......... .......... .......... .......... .......... 66% 381M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61450K .......... .......... .......... .......... .......... 66% 440M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61500K .......... .......... .......... .......... .......... 66% 149M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61550K .......... .......... .......... .......... .......... 66% 309M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61600K .......... .......... .......... .......... .......... 66% 239M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61650K .......... .......... .......... .......... .......... 66% 376M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61700K .......... .......... .......... .......... .......... 66% 192M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61750K .......... .......... .......... .......... .......... 66% 256M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61800K .......... .......... .......... .......... .......... 66% 344M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61850K .......... .......... .......... .......... .......... 66% 376M 0s 2024-09-12T17:55:23.400 INFO:teuthology.orchestra.run.smithi107.stderr: 61900K .......... .......... .......... .......... .......... 66% 298M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 61950K .......... .......... .......... .......... .......... 66% 441M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62000K .......... .......... .......... .......... .......... 66% 391M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62050K .......... .......... .......... .......... .......... 66% 468M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62100K .......... .......... .......... .......... .......... 66% 124M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62150K .......... .......... .......... .......... .......... 66% 106M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62200K .......... .......... .......... .......... .......... 67% 359M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62250K .......... .......... .......... .......... .......... 67% 388M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62300K .......... .......... .......... .......... .......... 67% 157M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62350K .......... .......... .......... .......... .......... 67% 309M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62400K .......... .......... .......... .......... .......... 67% 385M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62450K .......... .......... .......... .......... .......... 67% 171M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62500K .......... .......... .......... .......... .......... 67% 347M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62550K .......... .......... .......... .......... .......... 67% 139M 0s 2024-09-12T17:55:23.401 INFO:teuthology.orchestra.run.smithi107.stderr: 62600K .......... .......... .......... .......... .......... 67% 295M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 62650K .......... .......... .......... .......... .......... 67% 374M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 62700K .......... .......... .......... .......... .......... 67% 317M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 62750K .......... .......... .......... .......... .......... 67% 423M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 62800K .......... .......... .......... .......... .......... 67% 349M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 62850K .......... .......... .......... .......... .......... 67% 153M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 62900K .......... .......... .......... .......... .......... 67% 176M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 62950K .......... .......... .......... .......... .......... 67% 348M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 63000K .......... .......... .......... .......... .......... 67% 291M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 63050K .......... .......... .......... .......... .......... 67% 403M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 63100K .......... .......... .......... .......... .......... 67% 114M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 63150K .......... .......... .......... .......... .......... 68% 232M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 63200K .......... .......... .......... .......... .......... 68% 383M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 63250K .......... .......... .......... .......... .......... 68% 116M 0s 2024-09-12T17:55:23.402 INFO:teuthology.orchestra.run.smithi107.stderr: 63300K .......... .......... .......... .......... .......... 68% 333M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63350K .......... .......... .......... .......... .......... 68% 53.0M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63400K .......... .......... .......... .......... .......... 68% 248M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63450K .......... .......... .......... .......... .......... 68% 140M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63500K .......... .......... .......... .......... .......... 68% 196M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63550K .......... .......... .......... .......... .......... 68% 316M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63600K .......... .......... .......... .......... .......... 68% 388M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63650K .......... .......... .......... .......... .......... 68% 390M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63700K .......... .......... .......... .......... .......... 68% 281M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63750K .......... .......... .......... .......... .......... 68% 400M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63800K .......... .......... .......... .......... .......... 68% 419M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63850K .......... .......... .......... .......... .......... 68% 425M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63900K .......... .......... .......... .......... .......... 68% 321M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 63950K .......... .......... .......... .......... .......... 68% 399M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 64000K .......... .......... .......... .......... .......... 68% 267M 0s 2024-09-12T17:55:23.403 INFO:teuthology.orchestra.run.smithi107.stderr: 64050K .......... .......... .......... .......... .......... 68% 311M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64100K .......... .......... .......... .......... .......... 69% 305M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64150K .......... .......... .......... .......... .......... 69% 388M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64200K .......... .......... .......... .......... .......... 69% 306M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64250K .......... .......... .......... .......... .......... 69% 352M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64300K .......... .......... .......... .......... .......... 69% 288M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64350K .......... .......... .......... .......... .......... 69% 211M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64400K .......... .......... .......... .......... .......... 69% 395M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64450K .......... .......... .......... .......... .......... 69% 180M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64500K .......... .......... .......... .......... .......... 69% 260M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64550K .......... .......... .......... .......... .......... 69% 353M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64600K .......... .......... .......... .......... .......... 69% 426M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64650K .......... .......... .......... .......... .......... 69% 64.4M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64700K .......... .......... .......... .......... .......... 69% 317M 0s 2024-09-12T17:55:23.404 INFO:teuthology.orchestra.run.smithi107.stderr: 64750K .......... .......... .......... .......... .......... 69% 360M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 64800K .......... .......... .......... .......... .......... 69% 355M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 64850K .......... .......... .......... .......... .......... 69% 364M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 64900K .......... .......... .......... .......... .......... 69% 285M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 64950K .......... .......... .......... .......... .......... 69% 363M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 65000K .......... .......... .......... .......... .......... 70% 344M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 65050K .......... .......... .......... .......... .......... 70% 325M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 65100K .......... .......... .......... .......... .......... 70% 337M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 65150K .......... .......... .......... .......... .......... 70% 415M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 65200K .......... .......... .......... .......... .......... 70% 117M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 65250K .......... .......... .......... .......... .......... 70% 270M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 65300K .......... .......... .......... .......... .......... 70% 374M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 65350K .......... .......... .......... .......... .......... 70% 233M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 65400K .......... .......... .......... .......... .......... 70% 376M 0s 2024-09-12T17:55:23.405 INFO:teuthology.orchestra.run.smithi107.stderr: 65450K .......... .......... .......... .......... .......... 70% 192M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 65500K .......... .......... .......... .......... .......... 70% 312M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 65550K .......... .......... .......... .......... .......... 70% 334M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 65600K .......... .......... .......... .......... .......... 70% 71.9M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 65650K .......... .......... .......... .......... .......... 70% 344M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 65700K .......... .......... .......... .......... .......... 70% 318M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 65750K .......... .......... .......... .......... .......... 70% 340M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 65800K .......... .......... .......... .......... .......... 70% 386M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 65850K .......... .......... .......... .......... .......... 70% 328M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 65900K .......... .......... .......... .......... .......... 70% 323M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 65950K .......... .......... .......... .......... .......... 71% 327M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 66000K .......... .......... .......... .......... .......... 71% 392M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 66050K .......... .......... .......... .......... .......... 71% 304M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 66100K .......... .......... .......... .......... .......... 71% 359M 0s 2024-09-12T17:55:23.406 INFO:teuthology.orchestra.run.smithi107.stderr: 66150K .......... .......... .......... .......... .......... 71% 125M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66200K .......... .......... .......... .......... .......... 71% 367M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66250K .......... .......... .......... .......... .......... 71% 110M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66300K .......... .......... .......... .......... .......... 71% 171M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66350K .......... .......... .......... .......... .......... 71% 375M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66400K .......... .......... .......... .......... .......... 71% 75.9M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66450K .......... .......... .......... .......... .......... 71% 102M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66500K .......... .......... .......... .......... .......... 71% 282M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66550K .......... .......... .......... .......... .......... 71% 77.1M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66600K .......... .......... .......... .......... .......... 71% 349M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66650K .......... .......... .......... .......... .......... 71% 375M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66700K .......... .......... .......... .......... .......... 71% 270M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66750K .......... .......... .......... .......... .......... 71% 384M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66800K .......... .......... .......... .......... .......... 71% 332M 0s 2024-09-12T17:55:23.407 INFO:teuthology.orchestra.run.smithi107.stderr: 66850K .......... .......... .......... .......... .......... 72% 422M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 66900K .......... .......... .......... .......... .......... 72% 355M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 66950K .......... .......... .......... .......... .......... 72% 257M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 67000K .......... .......... .......... .......... .......... 72% 296M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 67050K .......... .......... .......... .......... .......... 72% 348M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 67100K .......... .......... .......... .......... .......... 72% 324M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 67150K .......... .......... .......... .......... .......... 72% 349M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 67200K .......... .......... .......... .......... .......... 72% 322M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 67250K .......... .......... .......... .......... .......... 72% 393M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 67300K .......... .......... .......... .......... .......... 72% 288M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 67350K .......... .......... .......... .......... .......... 72% 383M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 67400K .......... .......... .......... .......... .......... 72% 309M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 67450K .......... .......... .......... .......... .......... 72% 363M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 67500K .......... .......... .......... .......... .......... 72% 293M 0s 2024-09-12T17:55:23.408 INFO:teuthology.orchestra.run.smithi107.stderr: 67550K .......... .......... .......... .......... .......... 72% 338M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 67600K .......... .......... .......... .......... .......... 72% 343M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 67650K .......... .......... .......... .......... .......... 72% 403M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 67700K .......... .......... .......... .......... .......... 72% 94.6M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 67750K .......... .......... .......... .......... .......... 72% 226M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 67800K .......... .......... .......... .......... .......... 73% 293M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 67850K .......... .......... .......... .......... .......... 73% 340M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 67900K .......... .......... .......... .......... .......... 73% 264M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 67950K .......... .......... .......... .......... .......... 73% 272M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 68000K .......... .......... .......... .......... .......... 73% 317M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 68050K .......... .......... .......... .......... .......... 73% 315M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 68100K .......... .......... .......... .......... .......... 73% 327M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 68150K .......... .......... .......... .......... .......... 73% 325M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 68200K .......... .......... .......... .......... .......... 73% 191M 0s 2024-09-12T17:55:23.409 INFO:teuthology.orchestra.run.smithi107.stderr: 68250K .......... .......... .......... .......... .......... 73% 166M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68300K .......... .......... .......... .......... .......... 73% 298M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68350K .......... .......... .......... .......... .......... 73% 373M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68400K .......... .......... .......... .......... .......... 73% 359M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68450K .......... .......... .......... .......... .......... 73% 99.8M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68500K .......... .......... .......... .......... .......... 73% 317M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68550K .......... .......... .......... .......... .......... 73% 334M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68600K .......... .......... .......... .......... .......... 73% 445M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68650K .......... .......... .......... .......... .......... 73% 139M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68700K .......... .......... .......... .......... .......... 74% 254M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68750K .......... .......... .......... .......... .......... 74% 360M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68800K .......... .......... .......... .......... .......... 74% 329M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68850K .......... .......... .......... .......... .......... 74% 321M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68900K .......... .......... .......... .......... .......... 74% 376M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 68950K .......... .......... .......... .......... .......... 74% 219M 0s 2024-09-12T17:55:23.410 INFO:teuthology.orchestra.run.smithi107.stderr: 69000K .......... .......... .......... .......... .......... 74% 319M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69050K .......... .......... .......... .......... .......... 74% 327M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69100K .......... .......... .......... .......... .......... 74% 350M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69150K .......... .......... .......... .......... .......... 74% 138M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69200K .......... .......... .......... .......... .......... 74% 238M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69250K .......... .......... .......... .......... .......... 74% 195M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69300K .......... .......... .......... .......... .......... 74% 239M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69350K .......... .......... .......... .......... .......... 74% 92.1M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69400K .......... .......... .......... .......... .......... 74% 301M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69450K .......... .......... .......... .......... .......... 74% 193M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69500K .......... .......... .......... .......... .......... 74% 79.9M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69550K .......... .......... .......... .......... .......... 74% 329M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69600K .......... .......... .......... .......... .......... 74% 56.9M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69650K .......... .......... .......... .......... .......... 75% 316M 0s 2024-09-12T17:55:23.411 INFO:teuthology.orchestra.run.smithi107.stderr: 69700K .......... .......... .......... .......... .......... 75% 340M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 69750K .......... .......... .......... .......... .......... 75% 340M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 69800K .......... .......... .......... .......... .......... 75% 349M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 69850K .......... .......... .......... .......... .......... 75% 359M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 69900K .......... .......... .......... .......... .......... 75% 176M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 69950K .......... .......... .......... .......... .......... 75% 267M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 70000K .......... .......... .......... .......... .......... 75% 370M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 70050K .......... .......... .......... .......... .......... 75% 355M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 70100K .......... .......... .......... .......... .......... 75% 299M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 70150K .......... .......... .......... .......... .......... 75% 369M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 70200K .......... .......... .......... .......... .......... 75% 376M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 70250K .......... .......... .......... .......... .......... 75% 341M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 70300K .......... .......... .......... .......... .......... 75% 254M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 70350K .......... .......... .......... .......... .......... 75% 380M 0s 2024-09-12T17:55:23.412 INFO:teuthology.orchestra.run.smithi107.stderr: 70400K .......... .......... .......... .......... .......... 75% 299M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 70450K .......... .......... .......... .......... .......... 75% 350M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 70500K .......... .......... .......... .......... .......... 75% 271M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 70550K .......... .......... .......... .......... .......... 75% 322M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 70600K .......... .......... .......... .......... .......... 76% 349M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 70650K .......... .......... .......... .......... .......... 76% 354M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 70700K .......... .......... .......... .......... .......... 76% 315M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 70750K .......... .......... .......... .......... .......... 76% 446M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 70800K .......... .......... .......... .......... .......... 76% 338M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 70850K .......... .......... .......... .......... .......... 76% 152M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 70900K .......... .......... .......... .......... .......... 76% 285M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 70950K .......... .......... .......... .......... .......... 76% 219M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 71000K .......... .......... .......... .......... .......... 76% 297M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 71050K .......... .......... .......... .......... .......... 76% 339M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 71100K .......... .......... .......... .......... .......... 76% 245M 0s 2024-09-12T17:55:23.413 INFO:teuthology.orchestra.run.smithi107.stderr: 71150K .......... .......... .......... .......... .......... 76% 329M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71200K .......... .......... .......... .......... .......... 76% 385M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71250K .......... .......... .......... .......... .......... 76% 369M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71300K .......... .......... .......... .......... .......... 76% 227M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71350K .......... .......... .......... .......... .......... 76% 389M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71400K .......... .......... .......... .......... .......... 76% 338M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71450K .......... .......... .......... .......... .......... 76% 121M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71500K .......... .......... .......... .......... .......... 77% 103M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71550K .......... .......... .......... .......... .......... 77% 370M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71600K .......... .......... .......... .......... .......... 77% 282M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71650K .......... .......... .......... .......... .......... 77% 309M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71700K .......... .......... .......... .......... .......... 77% 428M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71750K .......... .......... .......... .......... .......... 77% 120M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71800K .......... .......... .......... .......... .......... 77% 392M 0s 2024-09-12T17:55:23.414 INFO:teuthology.orchestra.run.smithi107.stderr: 71850K .......... .......... .......... .......... .......... 77% 295M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 71900K .......... .......... .......... .......... .......... 77% 302M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 71950K .......... .......... .......... .......... .......... 77% 203M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 72000K .......... .......... .......... .......... .......... 77% 342M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 72050K .......... .......... .......... .......... .......... 77% 416M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 72100K .......... .......... .......... .......... .......... 77% 319M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 72150K .......... .......... .......... .......... .......... 77% 210M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 72200K .......... .......... .......... .......... .......... 77% 362M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 72250K .......... .......... .......... .......... .......... 77% 342M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 72300K .......... .......... .......... .......... .......... 77% 433M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 72350K .......... .......... .......... .......... .......... 77% 101M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 72400K .......... .......... .......... .......... .......... 77% 75.4M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 72450K .......... .......... .......... .......... .......... 78% 337M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 72500K .......... .......... .......... .......... .......... 78% 386M 0s 2024-09-12T17:55:23.415 INFO:teuthology.orchestra.run.smithi107.stderr: 72550K .......... .......... .......... .......... .......... 78% 398M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 72600K .......... .......... .......... .......... .......... 78% 151M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 72650K .......... .......... .......... .......... .......... 78% 53.6M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 72700K .......... .......... .......... .......... .......... 78% 152M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 72750K .......... .......... .......... .......... .......... 78% 292M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 72800K .......... .......... .......... .......... .......... 78% 427M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 72850K .......... .......... .......... .......... .......... 78% 209M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 72900K .......... .......... .......... .......... .......... 78% 159M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 72950K .......... .......... .......... .......... .......... 78% 278M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 73000K .......... .......... .......... .......... .......... 78% 429M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 73050K .......... .......... .......... .......... .......... 78% 94.4M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 73100K .......... .......... .......... .......... .......... 78% 356M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 73150K .......... .......... .......... .......... .......... 78% 282M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 73200K .......... .......... .......... .......... .......... 78% 343M 0s 2024-09-12T17:55:23.416 INFO:teuthology.orchestra.run.smithi107.stderr: 73250K .......... .......... .......... .......... .......... 78% 301M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73300K .......... .......... .......... .......... .......... 78% 404M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73350K .......... .......... .......... .......... .......... 79% 333M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73400K .......... .......... .......... .......... .......... 79% 277M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73450K .......... .......... .......... .......... .......... 79% 358M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73500K .......... .......... .......... .......... .......... 79% 394M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73550K .......... .......... .......... .......... .......... 79% 285M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73600K .......... .......... .......... .......... .......... 79% 338M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73650K .......... .......... .......... .......... .......... 79% 346M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73700K .......... .......... .......... .......... .......... 79% 389M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73750K .......... .......... .......... .......... .......... 79% 261M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73800K .......... .......... .......... .......... .......... 79% 306M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73850K .......... .......... .......... .......... .......... 79% 370M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73900K .......... .......... .......... .......... .......... 79% 369M 0s 2024-09-12T17:55:23.417 INFO:teuthology.orchestra.run.smithi107.stderr: 73950K .......... .......... .......... .......... .......... 79% 322M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74000K .......... .......... .......... .......... .......... 79% 387M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74050K .......... .......... .......... .......... .......... 79% 100M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74100K .......... .......... .......... .......... .......... 79% 319M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74150K .......... .......... .......... .......... .......... 79% 307M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74200K .......... .......... .......... .......... .......... 79% 360M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74250K .......... .......... .......... .......... .......... 79% 380M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74300K .......... .......... .......... .......... .......... 80% 357M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74350K .......... .......... .......... .......... .......... 80% 332M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74400K .......... .......... .......... .......... .......... 80% 367M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74450K .......... .......... .......... .......... .......... 80% 409M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74500K .......... .......... .......... .......... .......... 80% 249M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74550K .......... .......... .......... .......... .......... 80% 293M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74600K .......... .......... .......... .......... .......... 80% 244M 0s 2024-09-12T17:55:23.418 INFO:teuthology.orchestra.run.smithi107.stderr: 74650K .......... .......... .......... .......... .......... 80% 375M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 74700K .......... .......... .......... .......... .......... 80% 308M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 74750K .......... .......... .......... .......... .......... 80% 284M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 74800K .......... .......... .......... .......... .......... 80% 85.7M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 74850K .......... .......... .......... .......... .......... 80% 328M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 74900K .......... .......... .......... .......... .......... 80% 356M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 74950K .......... .......... .......... .......... .......... 80% 387M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 75000K .......... .......... .......... .......... .......... 80% 83.6M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 75050K .......... .......... .......... .......... .......... 80% 356M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 75100K .......... .......... .......... .......... .......... 80% 351M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 75150K .......... .......... .......... .......... .......... 80% 312M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 75200K .......... .......... .......... .......... .......... 81% 403M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 75250K .......... .......... .......... .......... .......... 81% 372M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 75300K .......... .......... .......... .......... .......... 81% 237M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 75350K .......... .......... .......... .......... .......... 81% 302M 0s 2024-09-12T17:55:23.419 INFO:teuthology.orchestra.run.smithi107.stderr: 75400K .......... .......... .......... .......... .......... 81% 397M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 75450K .......... .......... .......... .......... .......... 81% 125M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 75500K .......... .......... .......... .......... .......... 81% 173M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 75550K .......... .......... .......... .......... .......... 81% 203M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 75600K .......... .......... .......... .......... .......... 81% 334M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 75650K .......... .......... .......... .......... .......... 81% 222M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 75700K .......... .......... .......... .......... .......... 81% 72.8M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 75750K .......... .......... .......... .......... .......... 81% 116M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 75800K .......... .......... .......... .......... .......... 81% 344M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 75850K .......... .......... .......... .......... .......... 81% 107M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 75900K .......... .......... .......... .......... .......... 81% 425M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 75950K .......... .......... .......... .......... .......... 81% 176M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 76000K .......... .......... .......... .......... .......... 81% 208M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 76050K .......... .......... .......... .......... .......... 81% 390M 0s 2024-09-12T17:55:23.420 INFO:teuthology.orchestra.run.smithi107.stderr: 76100K .......... .......... .......... .......... .......... 81% 101M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76150K .......... .......... .......... .......... .......... 82% 223M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76200K .......... .......... .......... .......... .......... 82% 108M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76250K .......... .......... .......... .......... .......... 82% 325M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76300K .......... .......... .......... .......... .......... 82% 399M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76350K .......... .......... .......... .......... .......... 82% 185M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76400K .......... .......... .......... .......... .......... 82% 402M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76450K .......... .......... .......... .......... .......... 82% 164M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76500K .......... .......... .......... .......... .......... 82% 355M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76550K .......... .......... .......... .......... .......... 82% 262M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76600K .......... .......... .......... .......... .......... 82% 330M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76650K .......... .......... .......... .......... .......... 82% 311M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76700K .......... .......... .......... .......... .......... 82% 372M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76750K .......... .......... .......... .......... .......... 82% 236M 0s 2024-09-12T17:55:23.421 INFO:teuthology.orchestra.run.smithi107.stderr: 76800K .......... .......... .......... .......... .......... 82% 172M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 76850K .......... .......... .......... .......... .......... 82% 280M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 76900K .......... .......... .......... .......... .......... 82% 249M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 76950K .......... .......... .......... .......... .......... 82% 250M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 77000K .......... .......... .......... .......... .......... 82% 269M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 77050K .......... .......... .......... .......... .......... 82% 278M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 77100K .......... .......... .......... .......... .......... 83% 283M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 77150K .......... .......... .......... .......... .......... 83% 227M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 77200K .......... .......... .......... .......... .......... 83% 290M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 77250K .......... .......... .......... .......... .......... 83% 294M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 77300K .......... .......... .......... .......... .......... 83% 275M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 77350K .......... .......... .......... .......... .......... 83% 268M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 77400K .......... .......... .......... .......... .......... 83% 300M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 77450K .......... .......... .......... .......... .......... 83% 295M 0s 2024-09-12T17:55:23.422 INFO:teuthology.orchestra.run.smithi107.stderr: 77500K .......... .......... .......... .......... .......... 83% 301M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 77550K .......... .......... .......... .......... .......... 83% 251M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 77600K .......... .......... .......... .......... .......... 83% 272M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 77650K .......... .......... .......... .......... .......... 83% 300M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 77700K .......... .......... .......... .......... .......... 83% 291M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 77750K .......... .......... .......... .......... .......... 83% 270M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 77800K .......... .......... .......... .......... .......... 83% 301M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 77850K .......... .......... .......... .......... .......... 83% 300M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 77900K .......... .......... .......... .......... .......... 83% 267M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 77950K .......... .......... .......... .......... .......... 83% 226M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 78000K .......... .......... .......... .......... .......... 84% 278M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 78050K .......... .......... .......... .......... .......... 84% 275M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 78100K .......... .......... .......... .......... .......... 84% 279M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 78150K .......... .......... .......... .......... .......... 84% 245M 0s 2024-09-12T17:55:23.423 INFO:teuthology.orchestra.run.smithi107.stderr: 78200K .......... .......... .......... .......... .......... 84% 277M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78250K .......... .......... .......... .......... .......... 84% 270M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78300K .......... .......... .......... .......... .......... 84% 250M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78350K .......... .......... .......... .......... .......... 84% 229M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78400K .......... .......... .......... .......... .......... 84% 267M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78450K .......... .......... .......... .......... .......... 84% 279M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78500K .......... .......... .......... .......... .......... 84% 288M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78550K .......... .......... .......... .......... .......... 84% 248M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78600K .......... .......... .......... .......... .......... 84% 285M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78650K .......... .......... .......... .......... .......... 84% 285M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78700K .......... .......... .......... .......... .......... 84% 146M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78750K .......... .......... .......... .......... .......... 84% 227M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78800K .......... .......... .......... .......... .......... 84% 174M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78850K .......... .......... .......... .......... .......... 84% 243M 0s 2024-09-12T17:55:23.424 INFO:teuthology.orchestra.run.smithi107.stderr: 78900K .......... .......... .......... .......... .......... 84% 84.6M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 78950K .......... .......... .......... .......... .......... 85% 113M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79000K .......... .......... .......... .......... .......... 85% 275M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79050K .......... .......... .......... .......... .......... 85% 240M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79100K .......... .......... .......... .......... .......... 85% 286M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79150K .......... .......... .......... .......... .......... 85% 227M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79200K .......... .......... .......... .......... .......... 85% 253M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79250K .......... .......... .......... .......... .......... 85% 107M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79300K .......... .......... .......... .......... .......... 85% 287M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79350K .......... .......... .......... .......... .......... 85% 248M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79400K .......... .......... .......... .......... .......... 85% 271M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79450K .......... .......... .......... .......... .......... 85% 164M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79500K .......... .......... .......... .......... .......... 85% 275M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79550K .......... .......... .......... .......... .......... 85% 212M 0s 2024-09-12T17:55:23.425 INFO:teuthology.orchestra.run.smithi107.stderr: 79600K .......... .......... .......... .......... .......... 85% 286M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 79650K .......... .......... .......... .......... .......... 85% 186M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 79700K .......... .......... .......... .......... .......... 85% 285M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 79750K .......... .......... .......... .......... .......... 85% 249M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 79800K .......... .......... .......... .......... .......... 85% 301M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 79850K .......... .......... .......... .......... .......... 86% 257M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 79900K .......... .......... .......... .......... .......... 86% 291M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 79950K .......... .......... .......... .......... .......... 86% 212M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 80000K .......... .......... .......... .......... .......... 86% 262M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 80050K .......... .......... .......... .......... .......... 86% 280M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 80100K .......... .......... .......... .......... .......... 86% 283M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 80150K .......... .......... .......... .......... .......... 86% 150M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 80200K .......... .......... .......... .......... .......... 86% 254M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 80250K .......... .......... .......... .......... .......... 86% 292M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 80300K .......... .......... .......... .......... .......... 86% 278M 0s 2024-09-12T17:55:23.426 INFO:teuthology.orchestra.run.smithi107.stderr: 80350K .......... .......... .......... .......... .......... 86% 235M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 80400K .......... .......... .......... .......... .......... 86% 294M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 80450K .......... .......... .......... .......... .......... 86% 259M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 80500K .......... .......... .......... .......... .......... 86% 262M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 80550K .......... .......... .......... .......... .......... 86% 267M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 80600K .......... .......... .......... .......... .......... 86% 258M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 80650K .......... .......... .......... .......... .......... 86% 279M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 80700K .......... .......... .......... .......... .......... 86% 281M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 80750K .......... .......... .......... .......... .......... 86% 205M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 80800K .......... .......... .......... .......... .......... 87% 284M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 80850K .......... .......... .......... .......... .......... 87% 277M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 80900K .......... .......... .......... .......... .......... 87% 238M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 80950K .......... .......... .......... .......... .......... 87% 248M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 81000K .......... .......... .......... .......... .......... 87% 269M 0s 2024-09-12T17:55:23.427 INFO:teuthology.orchestra.run.smithi107.stderr: 81050K .......... .......... .......... .......... .......... 87% 272M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81100K .......... .......... .......... .......... .......... 87% 282M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81150K .......... .......... .......... .......... .......... 87% 205M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81200K .......... .......... .......... .......... .......... 87% 274M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81250K .......... .......... .......... .......... .......... 87% 285M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81300K .......... .......... .......... .......... .......... 87% 289M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81350K .......... .......... .......... .......... .......... 87% 256M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81400K .......... .......... .......... .......... .......... 87% 268M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81450K .......... .......... .......... .......... .......... 87% 257M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81500K .......... .......... .......... .......... .......... 87% 274M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81550K .......... .......... .......... .......... .......... 87% 220M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81600K .......... .......... .......... .......... .......... 87% 230M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81650K .......... .......... .......... .......... .......... 87% 284M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81700K .......... .......... .......... .......... .......... 87% 274M 0s 2024-09-12T17:55:23.428 INFO:teuthology.orchestra.run.smithi107.stderr: 81750K .......... .......... .......... .......... .......... 88% 252M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 81800K .......... .......... .......... .......... .......... 88% 297M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 81850K .......... .......... .......... .......... .......... 88% 270M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 81900K .......... .......... .......... .......... .......... 88% 266M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 81950K .......... .......... .......... .......... .......... 88% 237M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 82000K .......... .......... .......... .......... .......... 88% 178M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 82050K .......... .......... .......... .......... .......... 88% 143M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 82100K .......... .......... .......... .......... .......... 88% 299M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 82150K .......... .......... .......... .......... .......... 88% 170M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 82200K .......... .......... .......... .......... .......... 88% 274M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 82250K .......... .......... .......... .......... .......... 88% 72.9M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 82300K .......... .......... .......... .......... .......... 88% 275M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 82350K .......... .......... .......... .......... .......... 88% 200M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 82400K .......... .......... .......... .......... .......... 88% 274M 0s 2024-09-12T17:55:23.429 INFO:teuthology.orchestra.run.smithi107.stderr: 82450K .......... .......... .......... .......... .......... 88% 256M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 82500K .......... .......... .......... .......... .......... 88% 276M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 82550K .......... .......... .......... .......... .......... 88% 253M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 82600K .......... .......... .......... .......... .......... 88% 281M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 82650K .......... .......... .......... .......... .......... 89% 245M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 82700K .......... .......... .......... .......... .......... 89% 274M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 82750K .......... .......... .......... .......... .......... 89% 234M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 82800K .......... .......... .......... .......... .......... 89% 253M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 82850K .......... .......... .......... .......... .......... 89% 244M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 82900K .......... .......... .......... .......... .......... 89% 277M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 82950K .......... .......... .......... .......... .......... 89% 246M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 83000K .......... .......... .......... .......... .......... 89% 279M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 83050K .......... .......... .......... .......... .......... 89% 279M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 83100K .......... .......... .......... .......... .......... 89% 281M 0s 2024-09-12T17:55:23.430 INFO:teuthology.orchestra.run.smithi107.stderr: 83150K .......... .......... .......... .......... .......... 89% 230M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83200K .......... .......... .......... .......... .......... 89% 218M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83250K .......... .......... .......... .......... .......... 89% 140M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83300K .......... .......... .......... .......... .......... 89% 277M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83350K .......... .......... .......... .......... .......... 89% 176M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83400K .......... .......... .......... .......... .......... 89% 282M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83450K .......... .......... .......... .......... .......... 89% 240M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83500K .......... .......... .......... .......... .......... 89% 275M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83550K .......... .......... .......... .......... .......... 89% 208M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83600K .......... .......... .......... .......... .......... 90% 270M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83650K .......... .......... .......... .......... .......... 90% 238M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83700K .......... .......... .......... .......... .......... 90% 272M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83750K .......... .......... .......... .......... .......... 90% 227M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83800K .......... .......... .......... .......... .......... 90% 286M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83850K .......... .......... .......... .......... .......... 90% 234M 0s 2024-09-12T17:55:23.431 INFO:teuthology.orchestra.run.smithi107.stderr: 83900K .......... .......... .......... .......... .......... 90% 284M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 83950K .......... .......... .......... .......... .......... 90% 227M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84000K .......... .......... .......... .......... .......... 90% 302M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84050K .......... .......... .......... .......... .......... 90% 211M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84100K .......... .......... .......... .......... .......... 90% 274M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84150K .......... .......... .......... .......... .......... 90% 258M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84200K .......... .......... .......... .......... .......... 90% 280M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84250K .......... .......... .......... .......... .......... 90% 283M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84300K .......... .......... .......... .......... .......... 90% 277M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84350K .......... .......... .......... .......... .......... 90% 218M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84400K .......... .......... .......... .......... .......... 90% 275M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84450K .......... .......... .......... .......... .......... 90% 258M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84500K .......... .......... .......... .......... .......... 91% 265M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84550K .......... .......... .......... .......... .......... 91% 248M 0s 2024-09-12T17:55:23.432 INFO:teuthology.orchestra.run.smithi107.stderr: 84600K .......... .......... .......... .......... .......... 91% 274M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 84650K .......... .......... .......... .......... .......... 91% 261M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 84700K .......... .......... .......... .......... .......... 91% 259M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 84750K .......... .......... .......... .......... .......... 91% 224M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 84800K .......... .......... .......... .......... .......... 91% 240M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 84850K .......... .......... .......... .......... .......... 91% 276M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 84900K .......... .......... .......... .......... .......... 91% 267M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 84950K .......... .......... .......... .......... .......... 91% 250M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 85000K .......... .......... .......... .......... .......... 91% 276M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 85050K .......... .......... .......... .......... .......... 91% 301M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 85100K .......... .......... .......... .......... .......... 91% 256M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 85150K .......... .......... .......... .......... .......... 91% 230M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 85200K .......... .......... .......... .......... .......... 91% 287M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 85250K .......... .......... .......... .......... .......... 91% 235M 0s 2024-09-12T17:55:23.433 INFO:teuthology.orchestra.run.smithi107.stderr: 85300K .......... .......... .......... .......... .......... 91% 107M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85350K .......... .......... .......... .......... .......... 91% 128M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85400K .......... .......... .......... .......... .......... 91% 183M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85450K .......... .......... .......... .......... .......... 92% 296M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85500K .......... .......... .......... .......... .......... 92% 114M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85550K .......... .......... .......... .......... .......... 92% 202M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85600K .......... .......... .......... .......... .......... 92% 272M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85650K .......... .......... .......... .......... .......... 92% 283M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85700K .......... .......... .......... .......... .......... 92% 287M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85750K .......... .......... .......... .......... .......... 92% 219M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85800K .......... .......... .......... .......... .......... 92% 335M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85850K .......... .......... .......... .......... .......... 92% 360M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85900K .......... .......... .......... .......... .......... 92% 376M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 85950K .......... .......... .......... .......... .......... 92% 366M 0s 2024-09-12T17:55:23.434 INFO:teuthology.orchestra.run.smithi107.stderr: 86000K .......... .......... .......... .......... .......... 92% 447M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86050K .......... .......... .......... .......... .......... 92% 449M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86100K .......... .......... .......... .......... .......... 92% 425M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86150K .......... .......... .......... .......... .......... 92% 190M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86200K .......... .......... .......... .......... .......... 92% 224M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86250K .......... .......... .......... .......... .......... 92% 117M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86300K .......... .......... .......... .......... .......... 92% 397M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86350K .......... .......... .......... .......... .......... 93% 252M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86400K .......... .......... .......... .......... .......... 93% 124M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86450K .......... .......... .......... .......... .......... 93% 128M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86500K .......... .......... .......... .......... .......... 93% 269M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86550K .......... .......... .......... .......... .......... 93% 255M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86600K .......... .......... .......... .......... .......... 93% 390M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86650K .......... .......... .......... .......... .......... 93% 385M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86700K .......... .......... .......... .......... .......... 93% 324M 0s 2024-09-12T17:55:23.435 INFO:teuthology.orchestra.run.smithi107.stderr: 86750K .......... .......... .......... .......... .......... 93% 351M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 86800K .......... .......... .......... .......... .......... 93% 274M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 86850K .......... .......... .......... .......... .......... 93% 235M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 86900K .......... .......... .......... .......... .......... 93% 156M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 86950K .......... .......... .......... .......... .......... 93% 105M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 87000K .......... .......... .......... .......... .......... 93% 417M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 87050K .......... .......... .......... .......... .......... 93% 236M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 87100K .......... .......... .......... .......... .......... 93% 185M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 87150K .......... .......... .......... .......... .......... 93% 308M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 87200K .......... .......... .......... .......... .......... 93% 383M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 87250K .......... .......... .......... .......... .......... 93% 367M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 87300K .......... .......... .......... .......... .......... 94% 288M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 87350K .......... .......... .......... .......... .......... 94% 315M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 87400K .......... .......... .......... .......... .......... 94% 413M 0s 2024-09-12T17:55:23.436 INFO:teuthology.orchestra.run.smithi107.stderr: 87450K .......... .......... .......... .......... .......... 94% 397M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 87500K .......... .......... .......... .......... .......... 94% 403M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 87550K .......... .......... .......... .......... .......... 94% 383M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 87600K .......... .......... .......... .......... .......... 94% 214M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 87650K .......... .......... .......... .......... .......... 94% 232M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 87700K .......... .......... .......... .......... .......... 94% 282M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 87750K .......... .......... .......... .......... .......... 94% 328M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 87800K .......... .......... .......... .......... .......... 94% 196M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 87850K .......... .......... .......... .......... .......... 94% 412M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 87900K .......... .......... .......... .......... .......... 94% 304M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 87950K .......... .......... .......... .......... .......... 94% 293M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 88000K .......... .......... .......... .......... .......... 94% 435M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 88050K .......... .......... .......... .......... .......... 94% 122M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 88100K .......... .......... .......... .......... .......... 94% 362M 0s 2024-09-12T17:55:23.437 INFO:teuthology.orchestra.run.smithi107.stderr: 88150K .......... .......... .......... .......... .......... 94% 152M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88200K .......... .......... .......... .......... .......... 94% 379M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88250K .......... .......... .......... .......... .......... 95% 330M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88300K .......... .......... .......... .......... .......... 95% 410M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88350K .......... .......... .......... .......... .......... 95% 88.6M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88400K .......... .......... .......... .......... .......... 95% 89.1M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88450K .......... .......... .......... .......... .......... 95% 235M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88500K .......... .......... .......... .......... .......... 95% 349M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88550K .......... .......... .......... .......... .......... 95% 101M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88600K .......... .......... .......... .......... .......... 95% 144M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88650K .......... .......... .......... .......... .......... 95% 331M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88700K .......... .......... .......... .......... .......... 95% 370M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88750K .......... .......... .......... .......... .......... 95% 305M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88800K .......... .......... .......... .......... .......... 95% 432M 0s 2024-09-12T17:55:23.438 INFO:teuthology.orchestra.run.smithi107.stderr: 88850K .......... .......... .......... .......... .......... 95% 400M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 88900K .......... .......... .......... .......... .......... 95% 371M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 88950K .......... .......... .......... .......... .......... 95% 363M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89000K .......... .......... .......... .......... .......... 95% 369M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89050K .......... .......... .......... .......... .......... 95% 365M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89100K .......... .......... .......... .......... .......... 95% 325M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89150K .......... .......... .......... .......... .......... 96% 265M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89200K .......... .......... .......... .......... .......... 96% 293M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89250K .......... .......... .......... .......... .......... 96% 435M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89300K .......... .......... .......... .......... .......... 96% 122M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89350K .......... .......... .......... .......... .......... 96% 330M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89400K .......... .......... .......... .......... .......... 96% 249M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89450K .......... .......... .......... .......... .......... 96% 99.1M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89500K .......... .......... .......... .......... .......... 96% 208M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89550K .......... .......... .......... .......... .......... 96% 375M 0s 2024-09-12T17:55:23.439 INFO:teuthology.orchestra.run.smithi107.stderr: 89600K .......... .......... .......... .......... .......... 96% 163M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 89650K .......... .......... .......... .......... .......... 96% 245M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 89700K .......... .......... .......... .......... .......... 96% 403M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 89750K .......... .......... .......... .......... .......... 96% 349M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 89800K .......... .......... .......... .......... .......... 96% 378M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 89850K .......... .......... .......... .......... .......... 96% 351M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 89900K .......... .......... .......... .......... .......... 96% 266M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 89950K .......... .......... .......... .......... .......... 96% 138M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 90000K .......... .......... .......... .......... .......... 96% 129M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 90050K .......... .......... .......... .......... .......... 96% 124M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 90100K .......... .......... .......... .......... .......... 97% 245M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 90150K .......... .......... .......... .......... .......... 97% 169M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 90200K .......... .......... .......... .......... .......... 97% 369M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 90250K .......... .......... .......... .......... .......... 97% 220M 0s 2024-09-12T17:55:23.440 INFO:teuthology.orchestra.run.smithi107.stderr: 90300K .......... .......... .......... .......... .......... 97% 396M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90350K .......... .......... .......... .......... .......... 97% 321M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90400K .......... .......... .......... .......... .......... 97% 249M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90450K .......... .......... .......... .......... .......... 97% 250M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90500K .......... .......... .......... .......... .......... 97% 340M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90550K .......... .......... .......... .......... .......... 97% 346M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90600K .......... .......... .......... .......... .......... 97% 354M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90650K .......... .......... .......... .......... .......... 97% 414M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90700K .......... .......... .......... .......... .......... 97% 360M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90750K .......... .......... .......... .......... .......... 97% 351M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90800K .......... .......... .......... .......... .......... 97% 361M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90850K .......... .......... .......... .......... .......... 97% 280M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90900K .......... .......... .......... .......... .......... 97% 395M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 90950K .......... .......... .......... .......... .......... 97% 426M 0s 2024-09-12T17:55:23.441 INFO:teuthology.orchestra.run.smithi107.stderr: 91000K .......... .......... .......... .......... .......... 98% 399M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91050K .......... .......... .......... .......... .......... 98% 429M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91100K .......... .......... .......... .......... .......... 98% 215M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91150K .......... .......... .......... .......... .......... 98% 297M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91200K .......... .......... .......... .......... .......... 98% 342M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91250K .......... .......... .......... .......... .......... 98% 180M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91300K .......... .......... .......... .......... .......... 98% 186M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91350K .......... .......... .......... .......... .......... 98% 103M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91400K .......... .......... .......... .......... .......... 98% 283M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91450K .......... .......... .......... .......... .......... 98% 395M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91500K .......... .......... .......... .......... .......... 98% 98.6M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91550K .......... .......... .......... .......... .......... 98% 183M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91600K .......... .......... .......... .......... .......... 98% 235M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91650K .......... .......... .......... .......... .......... 98% 105M 0s 2024-09-12T17:55:23.442 INFO:teuthology.orchestra.run.smithi107.stderr: 91700K .......... .......... .......... .......... .......... 98% 364M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 91750K .......... .......... .......... .......... .......... 98% 161M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 91800K .......... .......... .......... .......... .......... 98% 361M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 91850K .......... .......... .......... .......... .......... 98% 64.8M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 91900K .......... .......... .......... .......... .......... 98% 291M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 91950K .......... .......... .......... .......... .......... 99% 356M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 92000K .......... .......... .......... .......... .......... 99% 342M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 92050K .......... .......... .......... .......... .......... 99% 206M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 92100K .......... .......... .......... .......... .......... 99% 231M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 92150K .......... .......... .......... .......... .......... 99% 261M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 92200K .......... .......... .......... .......... .......... 99% 357M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 92250K .......... .......... .......... .......... .......... 99% 372M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 92300K .......... .......... .......... .......... .......... 99% 384M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 92350K .......... .......... .......... .......... .......... 99% 298M 0s 2024-09-12T17:55:23.443 INFO:teuthology.orchestra.run.smithi107.stderr: 92400K .......... .......... .......... .......... .......... 99% 203M 0s 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr: 92450K .......... .......... .......... .......... .......... 99% 51.5M 0s 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr: 92500K .......... .......... .......... .......... .......... 99% 135M 0s 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr: 92550K .......... .......... .......... .......... .......... 99% 156M 0s 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr: 92600K .......... .......... .......... .......... .......... 99% 307M 0s 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr: 92650K .......... .......... .......... .......... .......... 99% 207M 0s 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr: 92700K .......... .......... .......... .......... .......... 99% 203M 0s 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr: 92750K .......... .......... .......... .......... .......... 99% 267M 0s 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr: 92800K .......... .......... .......... .......... .......... 99% 411M 0s 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr: 92850K .......... .......... .......... .......... .......... 99% 459M 0s 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr: 92900K 100% 134G=0.5s 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12 17:55:22 (197 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T17:55:23.444 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T17:55:23.479 INFO:teuthology.orchestra.run.smithi107.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T17:55:23.479 INFO:teuthology.orchestra.run.smithi107.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T17:55:23.479 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T17:55:23.479 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T17:55:23.479 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T17:55:23.479 INFO:teuthology.orchestra.run.smithi107.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T17:55:23.479 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T17:55:23.479 INFO:teuthology.orchestra.run.smithi107.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T17:55:23.479 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T17:55:23.479 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T17:55:23.480 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T17:55:23.481 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T17:55:23.482 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T17:55:23.483 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T17:55:23.484 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T17:55:23.485 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T17:55:23.486 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T17:55:23.487 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T17:55:23.488 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T17:55:23.489 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T17:55:23.490 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T17:55:23.491 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T17:55:23.492 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T17:55:23.493 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T17:55:23.494 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T17:55:23.495 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout:Welcome to Gradle 6.0.1! 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout:Here are the highlights of this release: 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout: - Substantial improvements in dependency management, including 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout: - Advanced control of transitive versions 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout: - Support for optional features and dependencies 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout: - Rules to tweak published metadata 2024-09-12T17:55:23.496 INFO:teuthology.orchestra.run.smithi107.stdout: - Support for Java 13 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout: - New Zinc compiler for Scala 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout: - VS2019 support 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout:------------------------------------------------------------ 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout:Gradle 6.0.1 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout:------------------------------------------------------------ 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:23.497 INFO:teuthology.orchestra.run.smithi107.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T17:55:23.498 INFO:teuthology.orchestra.run.smithi107.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T17:55:23.498 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:23.498 INFO:teuthology.orchestra.run.smithi107.stdout:Kotlin: 1.3.50 2024-09-12T17:55:23.498 INFO:teuthology.orchestra.run.smithi107.stdout:Groovy: 2.5.8 2024-09-12T17:55:23.498 INFO:teuthology.orchestra.run.smithi107.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T17:55:23.498 INFO:teuthology.orchestra.run.smithi107.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T17:55:23.498 INFO:teuthology.orchestra.run.smithi107.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T17:55:23.498 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:23.498 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T17:55:23.498 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:55:23.499 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T17:55:23.499 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:55:23.499 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T17:55:23.499 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T17:55:23.711 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T17:55:23.711 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T17:55:23.712 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'PCZJRJXYDKAAWCXQLOVA', 'access_secret': '+7UNzEZWPEtAm49VTZCHxpALTP99XBdsPGQApigzp/01hxZ0HvnDVA==', 'region': 'mexico', 'endpoint': 'smithi107.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi107.front.sepia.ceph.com'} 2024-09-12T17:55:23.712 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T17:55:23.712 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'PCZJRJXYDKAAWCXQLOVA', '--secret', '+7UNzEZWPEtAm49VTZCHxpALTP99XBdsPGQApigzp/01hxZ0HvnDVA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T17:55:23.712 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key PCZJRJXYDKAAWCXQLOVA --secret +7UNzEZWPEtAm49VTZCHxpALTP99XBdsPGQApigzp/01hxZ0HvnDVA== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T17:55:23.776 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:23.776 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:23.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.808+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.809+0000 7f7e36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.809+0000 7f7e36926800 20 realm 2024-09-12T17:55:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.809+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.810+0000 7f7e36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.810+0000 7f7e36926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.810+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.810+0000 7f7e36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.810+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.811+0000 7f7e36926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:23.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.811+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.811+0000 7f7e36926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:23.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.812+0000 7f7e36926800 20 searching for the correct realm 2024-09-12T17:55:23.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.815+0000 7f7e32d5e640 0 -- 172.21.15.107:0/1392243502 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x556af3984780 msgr2=0x556af3986c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:23.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.819+0000 7f7e3255d640 0 -- 172.21.15.107:0/1392243502 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f7e1c055420 msgr2=0x7f7e1c055880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:23.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.823+0000 7f7e36926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:23.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.823+0000 7f7e36926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:23.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.823+0000 7f7e36926800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:55:23.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.823+0000 7f7e36926800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:55:23.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.823+0000 7f7e36926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:23.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.823+0000 7f7e36926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:23.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.823+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.823+0000 7f7e36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.823+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.823+0000 7f7e36926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:23.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.823+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.823+0000 7f7e36926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:23.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 20 zone default found 2024-09-12T17:55:23.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 4 Realm: () 2024-09-12T17:55:23.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:55:23.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:55:23.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:23.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 20 zonegroup default 2024-09-12T17:55:23.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 20 started sync module instance, tier type = 2024-09-12T17:55:23.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.824+0000 7f7e36926800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:55:23.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.837+0000 7f7e36926800 20 add_watcher() i=0 2024-09-12T17:55:23.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.837+0000 7f7e36926800 20 add_watcher() i=1 2024-09-12T17:55:23.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.837+0000 7f7e36926800 20 add_watcher() i=2 2024-09-12T17:55:23.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.837+0000 7f7e36926800 20 add_watcher() i=3 2024-09-12T17:55:23.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.837+0000 7f7e36926800 20 add_watcher() i=4 2024-09-12T17:55:23.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.837+0000 7f7e36926800 20 add_watcher() i=5 2024-09-12T17:55:23.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.837+0000 7f7e36926800 20 add_watcher() i=6 2024-09-12T17:55:23.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.838+0000 7f7e36926800 20 add_watcher() i=7 2024-09-12T17:55:23.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.838+0000 7f7e36926800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:23.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.839+0000 7f7ce8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.840+0000 7f7e36926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.840+0000 7f7e36926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.840+0000 7f7e36926800 5 note: GC not initialized 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.840+0000 7f7c637fe640 20 reqs_thread_entry: start 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.840+0000 7f7e36926800 20 init_complete bucket index max shards: 1 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.840+0000 7f7e36926800 20 Filter name: none 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.840+0000 7f7c617fa640 20 reqs_thread_entry: start 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.840+0000 7f7e36926800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.840+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T17:55:23.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T17:55:23.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:55:23.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 10 cache get: name=default.rgw.meta+users.keys+PCZJRJXYDKAAWCXQLOVA : miss 2024-09-12T17:55:23.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 10 cache put: name=default.rgw.meta+users.keys+PCZJRJXYDKAAWCXQLOVA info.flags=0x0 2024-09-12T17:55:23.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 10 adding default.rgw.meta+users.keys+PCZJRJXYDKAAWCXQLOVA to cache LRU end 2024-09-12T17:55:23.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 10 cache get: name=default.rgw.meta+users.keys+PCZJRJXYDKAAWCXQLOVA : hit (negative entry) 2024-09-12T17:55:23.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.841+0000 7f7e36926800 10 cache get: name=default.rgw.meta+users.keys+PCZJRJXYDKAAWCXQLOVA : hit (negative entry) 2024-09-12T17:55:23.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.843+0000 7f7e36926800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:55:23.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.843+0000 7f7e36926800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:55:23.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.843+0000 7f7e36926800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T17:55:23.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.843+0000 7f7d15ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464291 cookie 93917841769584 notifier 8207 bl.length()=670 2024-09-12T17:55:23.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.843+0000 7f7d15ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:55:23.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.843+0000 7f7d15ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:55:23.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.844+0000 7f7e36926800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:55:23.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.844+0000 7f7e36926800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:55:23.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.844+0000 7f7e36926800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T17:55:23.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.845+0000 7f7d157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464316 cookie 93917841758368 notifier 8207 bl.length()=200 2024-09-12T17:55:23.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.845+0000 7f7d157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:55:23.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.845+0000 7f7d157fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:55:23.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.846+0000 7f7e36926800 10 cache put: name=default.rgw.meta+users.keys+PCZJRJXYDKAAWCXQLOVA info.flags=0x7 2024-09-12T17:55:23.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.846+0000 7f7e36926800 10 moving default.rgw.meta+users.keys+PCZJRJXYDKAAWCXQLOVA to cache LRU end 2024-09-12T17:55:23.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.846+0000 7f7e36926800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:PCZJRJXYDKAAWCXQLOVA, ofs0, ns] 2024-09-12T17:55:23.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.847+0000 7f7d15ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 93917841755664 notifier 8207 bl.length()=189 2024-09-12T17:55:23.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.847+0000 7f7d15ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PCZJRJXYDKAAWCXQLOVA info.flags=0x7 2024-09-12T17:55:23.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.847+0000 7f7d15ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PCZJRJXYDKAAWCXQLOVA to cache LRU end 2024-09-12T17:55:23.849 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:55:23.849 INFO:teuthology.orchestra.run.smithi107.stdout: "user_id": "tester.client.0", 2024-09-12T17:55:23.849 INFO:teuthology.orchestra.run.smithi107.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T17:55:23.849 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T17:55:23.849 INFO:teuthology.orchestra.run.smithi107.stdout: "suspended": 0, 2024-09-12T17:55:23.849 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:55:23.849 INFO:teuthology.orchestra.run.smithi107.stdout: "subusers": [], 2024-09-12T17:55:23.849 INFO:teuthology.orchestra.run.smithi107.stdout: "keys": [ 2024-09-12T17:55:23.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: "user": "tester.client.0", 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: "access_key": "PCZJRJXYDKAAWCXQLOVA", 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: "secret_key": "+7UNzEZWPEtAm49VTZCHxpALTP99XBdsPGQApigzp/01hxZ0HvnDVA==", 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: "active": true, 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:55:23.842748Z" 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: "swift_keys": [], 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": [], 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_placement": "", 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: "placement_tags": [], 2024-09-12T17:55:23.850 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: "user_quota": { 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:55:23.851 INFO:teuthology.orchestra.run.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:55:23.852 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "rgw", 2024-09-12T17:55:23.852 INFO:teuthology.orchestra.run.smithi107.stdout: "mfa_ids": [], 2024-09-12T17:55:23.852 INFO:teuthology.orchestra.run.smithi107.stdout: "account_id": "", 2024-09-12T17:55:23.852 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2024-09-12T17:55:23.852 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:55:23.842730Z", 2024-09-12T17:55:23.852 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-09-12T17:55:23.852 INFO:teuthology.orchestra.run.smithi107.stdout: "group_ids": [] 2024-09-12T17:55:23.852 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:55:23.852 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:23.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.848+0000 7f7ce8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:23.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.851+0000 7f7e36926800 20 remove_watcher() i=0 2024-09-12T17:55:23.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.851+0000 7f7e36926800 2 removed watcher, disabling cache 2024-09-12T17:55:23.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.852+0000 7f7e36926800 20 remove_watcher() i=1 2024-09-12T17:55:23.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.853+0000 7f7e36926800 20 remove_watcher() i=2 2024-09-12T17:55:23.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.854+0000 7f7e36926800 20 remove_watcher() i=3 2024-09-12T17:55:23.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.855+0000 7f7e36926800 20 remove_watcher() i=4 2024-09-12T17:55:23.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.856+0000 7f7e36926800 20 remove_watcher() i=5 2024-09-12T17:55:23.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.857+0000 7f7e36926800 20 remove_watcher() i=6 2024-09-12T17:55:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:23.859+0000 7f7e36926800 20 remove_watcher() i=7 2024-09-12T17:55:23.872 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:55:23.873 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T17:55:23.904 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T17:55:23.904 DEBUG:teuthology.orchestra.run.smithi107:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T17:55:23.971 DEBUG:teuthology.orchestra.run.smithi107:> radosgw-admin gc process --include-all 2024-09-12T17:55:24.064 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:24.064 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:24.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.099+0000 7f1801e14800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.101+0000 7f1801e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.101+0000 7f1801e14800 20 realm 2024-09-12T17:55:24.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.101+0000 7f1801e14800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.101+0000 7f1801e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.101+0000 7f1801e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:24.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.101+0000 7f1801e14800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.101+0000 7f1801e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.101+0000 7f1801e14800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.103+0000 7f1801e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:24.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.103+0000 7f1801e14800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.103+0000 7f1801e14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:24.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.103+0000 7f1801e14800 20 searching for the correct realm 2024-09-12T17:55:24.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.106+0000 7f17fdde1640 0 -- 172.21.15.107:0/2395879049 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55f98bc2cd90 msgr2=0x55f98bc2f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:55:24.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.110+0000 7f17fd5e0640 0 -- 172.21.15.107:0/2395879049 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f17e8046930 msgr2=0x7f17e8019410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:24.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.115+0000 7f1801e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:24.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.115+0000 7f1801e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:24.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.115+0000 7f1801e14800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:55:24.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.115+0000 7f1801e14800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:55:24.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.115+0000 7f1801e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:24.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.115+0000 7f1801e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:24.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.115+0000 7f1801e14800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.115+0000 7f1801e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.115+0000 7f1801e14800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:24.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:24.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 20 zone default found 2024-09-12T17:55:24.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 4 Realm: () 2024-09-12T17:55:24.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:55:24.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:55:24.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:24.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 20 zonegroup default 2024-09-12T17:55:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.116+0000 7f1801e14800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.117+0000 7f1801e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.117+0000 7f1801e14800 20 started sync module instance, tier type = 2024-09-12T17:55:24.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.117+0000 7f1801e14800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:55:24.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.126+0000 7f1801e14800 20 add_watcher() i=0 2024-09-12T17:55:24.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.126+0000 7f1801e14800 20 add_watcher() i=1 2024-09-12T17:55:24.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.126+0000 7f1801e14800 20 add_watcher() i=2 2024-09-12T17:55:24.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.126+0000 7f1801e14800 20 add_watcher() i=3 2024-09-12T17:55:24.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.126+0000 7f1801e14800 20 add_watcher() i=4 2024-09-12T17:55:24.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.126+0000 7f1801e14800 20 add_watcher() i=5 2024-09-12T17:55:24.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.126+0000 7f1801e14800 20 add_watcher() i=6 2024-09-12T17:55:24.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.127+0000 7f1801e14800 20 add_watcher() i=7 2024-09-12T17:55:24.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.127+0000 7f1801e14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:24.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.129+0000 7f16b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:24.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.129+0000 7f1801e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:24.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.129+0000 7f1801e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:24.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.166+0000 7f16b27e4640 20 reqs_thread_entry: start 2024-09-12T17:55:24.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.166+0000 7f1801e14800 20 init_complete bucket index max shards: 1 2024-09-12T17:55:24.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.166+0000 7f1801e14800 20 Filter name: none 2024-09-12T17:55:24.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.166+0000 7f1623fff640 20 reqs_thread_entry: start 2024-09-12T17:55:24.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.166+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:55:24.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.168+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.169+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.169+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.169+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.7791929279317029120', time=2024-09-12T19:46:51.725642+0000, chain.objs.size()=3 2024-09-12T17:55:24.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.169+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-FROZEN.2~I_kWuTQrDYOL0seH0YqGrPbBkvD_Oag.1 2024-09-12T17:55:24.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.169+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-FROZEN.2~I_kWuTQrDYOL0seH0YqGrPbBkvD_Oag.2 2024-09-12T17:55:24.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.169+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-FROZEN.2~I_kWuTQrDYOL0seH0YqGrPbBkvD_Oag.3 2024-09-12T17:55:24.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.171+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.173+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:55:24.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.174+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.175+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.175+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.176+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:55:24.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.178+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.179+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.179+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.180+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:55:24.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.182+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.182+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.182+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.183+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:55:24.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.185+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.185+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.185+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.186+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:55:24.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.188+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.188+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.189+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:55:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.189+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.3449314624372240933', time=2024-09-12T19:46:51.666930+0000, chain.objs.size()=1 2024-09-12T17:55:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.189+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.cCP_OfPR859BtbYxU4zCg4ej1kgnJvy_0 2024-09-12T17:55:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.189+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.7361165882894158296', time=2024-09-12T19:46:51.687433+0000, chain.objs.size()=1 2024-09-12T17:55:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.189+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_._2BMb27Z-cnuZZE3Ck0pL8F9OVOspyr_0 2024-09-12T17:55:24.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.190+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.192+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:55:24.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.193+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.194+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.194+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.195+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:55:24.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.196+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.197+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.197+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.197+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.1973942393552559803', time=2024-09-12T19:46:51.612836+0000, chain.objs.size()=4 2024-09-12T17:55:24.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.197+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.13__multipart_foo.2~djhIa7KkauTFRn_CaPYRRkxUPKt1HBZ.1 2024-09-12T17:55:24.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.197+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.13__multipart_foo.2~djhIa7KkauTFRn_CaPYRRkxUPKt1HBZ.2 2024-09-12T17:55:24.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.197+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.13__multipart_foo.2~djhIa7KkauTFRn_CaPYRRkxUPKt1HBZ.3 2024-09-12T17:55:24.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.197+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.13__multipart_foo.2~djhIa7KkauTFRn_CaPYRRkxUPKt1HBZ.4 2024-09-12T17:55:24.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.199+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.202+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:55:24.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.203+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.204+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.204+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:55:24.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.204+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.12416093173032359872', time=2024-09-12T19:46:51.599042+0000, chain.objs.size()=4 2024-09-12T17:55:24.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.204+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.12__multipart_foo.2~xwvzTHnClXLDAQMifyV-Y_VN985Z7-k.1 2024-09-12T17:55:24.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.204+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.12__multipart_foo.2~xwvzTHnClXLDAQMifyV-Y_VN985Z7-k.2 2024-09-12T17:55:24.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.204+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.12__multipart_foo.2~xwvzTHnClXLDAQMifyV-Y_VN985Z7-k.3 2024-09-12T17:55:24.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.204+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.12__multipart_foo.2~xwvzTHnClXLDAQMifyV-Y_VN985Z7-k.4 2024-09-12T17:55:24.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.204+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6922757099240576655', time=2024-09-12T19:46:51.721854+0000, chain.objs.size()=3 2024-09-12T17:55:24.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.204+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-FROZEN.2~I_kWuTQrDYOL0seH0YqGrPbBkvD_Oag.1 2024-09-12T17:55:24.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.204+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-FROZEN.2~I_kWuTQrDYOL0seH0YqGrPbBkvD_Oag.2 2024-09-12T17:55:24.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.204+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-FROZEN.2~I_kWuTQrDYOL0seH0YqGrPbBkvD_Oag.3 2024-09-12T17:55:24.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.207+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.209+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:55:24.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.210+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.211+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.211+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:55:24.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.211+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.4872796393717837466', time=2024-09-12T19:46:51.662743+0000, chain.objs.size()=1 2024-09-12T17:55:24.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.211+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.cCP_OfPR859BtbYxU4zCg4ej1kgnJvy_0 2024-09-12T17:55:24.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.211+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='_n5Sraxa8iJdQilR2ot8ozzOZwzh8Pvw', time=2024-09-12T19:46:51.729869+0000, chain.objs.size()=2 2024-09-12T17:55:24.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.211+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.oE8dvVohiTK-IUVT9QXbvFVXoKhNgNL_0 2024-09-12T17:55:24.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.211+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.oE8dvVohiTK-IUVT9QXbvFVXoKhNgNL_1 2024-09-12T17:55:24.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.215+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.217+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:55:24.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.218+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.219+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.220+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:55:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.220+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.9082211536334448067', time=2024-09-12T19:46:51.648274+0000, chain.objs.size()=4 2024-09-12T17:55:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.220+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.10__multipart_foo.2~wxtyZL4pVTrExWu983LKLt7rD4FclN5.1 2024-09-12T17:55:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.220+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.10__multipart_foo.2~wxtyZL4pVTrExWu983LKLt7rD4FclN5.2 2024-09-12T17:55:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.220+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.10__multipart_foo.2~wxtyZL4pVTrExWu983LKLt7rD4FclN5.3 2024-09-12T17:55:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.220+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.10__multipart_foo.2~wxtyZL4pVTrExWu983LKLt7rD4FclN5.4 2024-09-12T17:55:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.220+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='_bmc0_ixy1ubd4dubpNxyXzOjsUuueeF', time=2024-09-12T19:46:51.733907+0000, chain.objs.size()=2 2024-09-12T17:55:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.220+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.VGU8siO2wSJ21Qt3qPcM1e7Ik7jG6G3_1 2024-09-12T17:55:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.220+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.VGU8siO2wSJ21Qt3qPcM1e7Ik7jG6G3_2 2024-09-12T17:55:24.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.223+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.225+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:55:24.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.226+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.227+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.227+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.227+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='_xPsPJFNAj3lI48x3cuVGUdg3T63xI6I', time=2024-09-12T19:46:51.758167+0000, chain.objs.size()=1 2024-09-12T17:55:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.227+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.SSoG7ByIPv8bp5d1YkfPAcenCrT_ozJ_0 2024-09-12T17:55:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.228+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.231+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:55:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.232+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.232+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.232+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.233+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:55:24.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.234+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.235+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.235+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.236+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:55:24.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.237+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.238+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.238+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.238+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.7774804376258593416', time=2024-09-12T19:46:51.784284+0000, chain.objs.size()=3 2024-09-12T17:55:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.238+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-LUKEWARM.2~o9_O4wSFpM0z-T1dLfdSNWGueMo2UDm.1 2024-09-12T17:55:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.238+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-LUKEWARM.2~o9_O4wSFpM0z-T1dLfdSNWGueMo2UDm.2 2024-09-12T17:55:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.238+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-LUKEWARM.2~o9_O4wSFpM0z-T1dLfdSNWGueMo2UDm.3 2024-09-12T17:55:24.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.242+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.244+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:55:24.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.246+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.246+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.246+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.246+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='_xfF2jA-ORF7z_aVAOhJ6q7cSMjVIQHm', time=2024-09-12T19:46:51.698588+0000, chain.objs.size()=1 2024-09-12T17:55:24.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.246+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.qlZ64ZAjVRsslEohBXMVVovNNRsjR8H_0 2024-09-12T17:55:24.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.248+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.250+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:55:24.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.251+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.252+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.252+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:55:24.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.252+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='_HiuvyWQyrZe2Gq2QLi5q-46vCvpt8x3', time=2024-09-12T19:46:51.762281+0000, chain.objs.size()=1 2024-09-12T17:55:24.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.252+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_._GBSCT3pqm7-0WM4tg__thEluOnaWZj_0 2024-09-12T17:55:24.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.252+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.1373397216165039519', time=2024-09-12T19:46:51.790555+0000, chain.objs.size()=3 2024-09-12T17:55:24.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.252+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-STANDARD.2~VqtVRjMKLzCAbdHhnwQzPWJ6LsP5V9C.1 2024-09-12T17:55:24.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.252+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-STANDARD.2~VqtVRjMKLzCAbdHhnwQzPWJ6LsP5V9C.2 2024-09-12T17:55:24.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.252+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-STANDARD.2~VqtVRjMKLzCAbdHhnwQzPWJ6LsP5V9C.3 2024-09-12T17:55:24.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.254+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.256+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:55:24.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.257+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.258+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.258+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.259+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:55:24.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.260+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.261+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.261+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.261+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.7192970228584175042', time=2024-09-12T19:46:51.679315+0000, chain.objs.size()=1 2024-09-12T17:55:24.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.261+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_._2BMb27Z-cnuZZE3Ck0pL8F9OVOspyr_0 2024-09-12T17:55:24.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.263+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.265+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:55:24.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.267+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.267+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.267+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:55:24.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.267+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.17506282431348491687', time=2024-09-12T19:46:51.754167+0000, chain.objs.size()=3 2024-09-12T17:55:24.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.267+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-STANDARD.2~s7egSJ-WD4mth_jdt8PCUPEovOasVpQ.1 2024-09-12T17:55:24.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.267+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-STANDARD.2~s7egSJ-WD4mth_jdt8PCUPEovOasVpQ.2 2024-09-12T17:55:24.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.267+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-STANDARD.2~s7egSJ-WD4mth_jdt8PCUPEovOasVpQ.3 2024-09-12T17:55:24.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.267+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.17141673587402005078', time=2024-09-12T19:46:51.780352+0000, chain.objs.size()=3 2024-09-12T17:55:24.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.267+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-FROZEN.2~fQ61Q1NC-SyoLTjK1a8BuQpTwqDcuEu.1 2024-09-12T17:55:24.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.268+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-FROZEN.2~fQ61Q1NC-SyoLTjK1a8BuQpTwqDcuEu.2 2024-09-12T17:55:24.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.268+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.15__multipart_foo-FROZEN.2~fQ61Q1NC-SyoLTjK1a8BuQpTwqDcuEu.3 2024-09-12T17:55:24.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.270+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.274+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:55:24.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.275+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.276+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.276+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.276+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='_pKnLRxeGtODqqY5dZ3tClmyvC1cAf6_', time=2024-09-12T19:46:51.750200+0000, chain.objs.size()=2 2024-09-12T17:55:24.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.276+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.HeYUOpbGfSWSdelNjV3HsQUxnC8ccYV_1 2024-09-12T17:55:24.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.276+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.HeYUOpbGfSWSdelNjV3HsQUxnC8ccYV_2 2024-09-12T17:55:24.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.277+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.280+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:55:24.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.281+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.282+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.282+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.282+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.16813518975967515643', time=2024-09-12T19:46:51.630906+0000, chain.objs.size()=4 2024-09-12T17:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.282+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.11__multipart_foo.2~8qu0tORr0IHz1TFWVLinQAOzoslhWP5.1 2024-09-12T17:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.282+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.11__multipart_foo.2~8qu0tORr0IHz1TFWVLinQAOzoslhWP5.2 2024-09-12T17:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.282+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.11__multipart_foo.2~8qu0tORr0IHz1TFWVLinQAOzoslhWP5.3 2024-09-12T17:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.282+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.11__multipart_foo.2~8qu0tORr0IHz1TFWVLinQAOzoslhWP5.4 2024-09-12T17:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.282+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='_woNUtibXW6-IuKvZT80VCRHGAVHBGE3', time=2024-09-12T19:46:51.674789+0000, chain.objs.size()=1 2024-09-12T17:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.282+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.HKBSryxYvljKztAP-9r4kOo2IeYu-Zc_1 2024-09-12T17:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.282+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='_ukEb9nKODZ4xI-s0A5C6t49ggZmsb3S', time=2024-09-12T19:46:51.741885+0000, chain.objs.size()=2 2024-09-12T17:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.282+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.ZIsdT8UKBlW_fuIeHv4Rvhyez0YDZSq_0 2024-09-12T17:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.282+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__shadow_.ZIsdT8UKBlW_fuIeHv4Rvhyez0YDZSq_1 2024-09-12T17:55:24.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.286+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.288+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.289+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.290+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.290+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.290+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.16734481621960305871', time=2024-09-12T19:46:51.745831+0000, chain.objs.size()=3 2024-09-12T17:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.290+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-LUKEWARM.2~n_odkn2dowOpmWLvrc63ryAtiBvT-UR.1 2024-09-12T17:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.290+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-LUKEWARM.2~n_odkn2dowOpmWLvrc63ryAtiBvT-UR.2 2024-09-12T17:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.290+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-LUKEWARM.2~n_odkn2dowOpmWLvrc63ryAtiBvT-UR.3 2024-09-12T17:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.291+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.293+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:55:24.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.295+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.295+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.295+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.295+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.421773847856051476', time=2024-09-12T19:46:51.738121+0000, chain.objs.size()=3 2024-09-12T17:55:24.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.295+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-LUKEWARM.2~n_odkn2dowOpmWLvrc63ryAtiBvT-UR.1 2024-09-12T17:55:24.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.295+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-LUKEWARM.2~n_odkn2dowOpmWLvrc63ryAtiBvT-UR.2 2024-09-12T17:55:24.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.295+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-LUKEWARM.2~n_odkn2dowOpmWLvrc63ryAtiBvT-UR.3 2024-09-12T17:55:24.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.298+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.300+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:55:24.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.301+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.302+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.302+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.302+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.5172945724475597220', time=2024-09-12T19:46:51.805669+0000, chain.objs.size()=2 2024-09-12T17:55:24.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.302+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.14__shadow_.arMRBCGM6TdoFjUsvzdb_BwQriBkdun_0 2024-09-12T17:55:24.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.302+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.14__shadow_.arMRBCGM6TdoFjUsvzdb_BwQriBkdun_1 2024-09-12T17:55:24.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.306+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.308+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:55:24.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.310+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.310+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.311+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.311+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.313+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.314+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.314+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.315+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:55:24.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.316+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.317+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.317+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.317+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='_I7fmMcRFotc51JPFu24geHoBMFMy1O1', time=2024-09-12T19:46:51.691477+0000, chain.objs.size()=1 2024-09-12T17:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.317+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.NZsIhQ8BEdg-unpON1ejR6fcfmzNH-U_1 2024-09-12T17:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.317+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.1348128016423134779', time=2024-09-12T19:46:51.766125+0000, chain.objs.size()=3 2024-09-12T17:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.317+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-STANDARD.2~s7egSJ-WD4mth_jdt8PCUPEovOasVpQ.1 2024-09-12T17:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.317+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-STANDARD.2~s7egSJ-WD4mth_jdt8PCUPEovOasVpQ.2 2024-09-12T17:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.317+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.17__multipart_foo-STANDARD.2~s7egSJ-WD4mth_jdt8PCUPEovOasVpQ.3 2024-09-12T17:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.317+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.11534858072738097226', time=2024-09-12T19:46:51.809871+0000, chain.objs.size()=2 2024-09-12T17:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.317+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.14__shadow_.dZFMKAiWzV8X4Qidc9ynvZI9RJGw0To_0 2024-09-12T17:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.317+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.14__shadow_.dZFMKAiWzV8X4Qidc9ynvZI9RJGw0To_1 2024-09-12T17:55:24.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.321+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.323+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:55:24.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.324+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.325+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.325+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.325+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='_BaZyfvGawdF7IypLjc_6XBcKkw2Qy_B', time=2024-09-12T19:46:51.683237+0000, chain.objs.size()=1 2024-09-12T17:55:24.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.325+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.u-LMCmzK_tEk6BuQZ1ifDUr_gLvkhJr_0 2024-09-12T17:55:24.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.327+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.329+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:55:24.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.330+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.330+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.331+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.331+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='_4_UB0bBwFYWHBYKfYa4-oayOqXM53iV', time=2024-09-12T19:46:51.703831+0000, chain.objs.size()=1 2024-09-12T17:55:24.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.331+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.y8OXGCrqwQH6_bvBQkX4l44dHhXgItl_0 2024-09-12T17:55:24.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.332+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.334+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:55:24.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.335+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.335+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.336+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.337+0000 7f1801e14800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:55:24.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.338+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.338+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.339+0000 7f1801e14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:55:24.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.339+0000 7f1801e14800 20 garbage collection: RGWGC::process iterating over entry tag='_ux1ciiKfNIEmvEpf7KR3_CgNL7BN323', time=2024-09-12T19:46:51.670840+0000, chain.objs.size()=1 2024-09-12T17:55:24.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.339+0000 7f1801e14800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.16__shadow_.e2F1xWh_-ry5L0OE-jwR6rTtoJw4prv_0 2024-09-12T17:55:24.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.340+0000 7f1801e14800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:55:24.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.343+0000 7f16b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:24.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.345+0000 7f1801e14800 20 remove_watcher() i=0 2024-09-12T17:55:24.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.345+0000 7f1801e14800 2 removed watcher, disabling cache 2024-09-12T17:55:24.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.347+0000 7f1801e14800 20 remove_watcher() i=1 2024-09-12T17:55:24.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.348+0000 7f1801e14800 20 remove_watcher() i=2 2024-09-12T17:55:24.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.349+0000 7f1801e14800 20 remove_watcher() i=3 2024-09-12T17:55:24.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.350+0000 7f1801e14800 20 remove_watcher() i=4 2024-09-12T17:55:24.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.351+0000 7f1801e14800 20 remove_watcher() i=5 2024-09-12T17:55:24.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.352+0000 7f1801e14800 20 remove_watcher() i=6 2024-09-12T17:55:24.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.353+0000 7f1801e14800 20 remove_watcher() i=7 2024-09-12T17:55:24.364 DEBUG:teuthology.orchestra.run.smithi107:> radosgw-admin gc process --include-all 2024-09-12T17:55:24.417 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:24.417 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:24.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.452+0000 7fae4e136800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.454+0000 7fae4e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.454+0000 7fae4e136800 20 realm 2024-09-12T17:55:24.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.454+0000 7fae4e136800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.454+0000 7fae4e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.454+0000 7fae4e136800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:24.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.454+0000 7fae4e136800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.454+0000 7fae4e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.454+0000 7fae4e136800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.455+0000 7fae4e136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:24.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.455+0000 7fae4e136800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.456+0000 7fae4e136800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:24.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.456+0000 7fae4e136800 20 searching for the correct realm 2024-09-12T17:55:24.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.458+0000 7fae4a6b8640 0 -- 172.21.15.107:0/3556396934 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5566399f1120 msgr2=0x5566399f35e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:24.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.462+0000 7fae49eb7640 0 -- 172.21.15.107:0/3556396934 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fae340ab2b0 msgr2=0x7fae340e20b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:24.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.466+0000 7fae4e136800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:24.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.466+0000 7fae4e136800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:24.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.466+0000 7fae4e136800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:55:24.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.466+0000 7fae4e136800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:55:24.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.466+0000 7fae4e136800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:24.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.466+0000 7fae4e136800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:24.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.466+0000 7fae4e136800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.466+0000 7fae4e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.466+0000 7fae4e136800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.466+0000 7fae4e136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:24.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.466+0000 7fae4e136800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:24.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 20 zone default found 2024-09-12T17:55:24.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 4 Realm: () 2024-09-12T17:55:24.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:55:24.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:55:24.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:24.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 20 zonegroup default 2024-09-12T17:55:24.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 20 started sync module instance, tier type = 2024-09-12T17:55:24.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.467+0000 7fae4e136800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:55:24.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.476+0000 7fae4e136800 20 add_watcher() i=0 2024-09-12T17:55:24.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.476+0000 7fae4e136800 20 add_watcher() i=1 2024-09-12T17:55:24.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.476+0000 7fae4e136800 20 add_watcher() i=2 2024-09-12T17:55:24.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.476+0000 7fae4e136800 20 add_watcher() i=3 2024-09-12T17:55:24.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.476+0000 7fae4e136800 20 add_watcher() i=4 2024-09-12T17:55:24.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.476+0000 7fae4e136800 20 add_watcher() i=5 2024-09-12T17:55:24.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.476+0000 7fae4e136800 20 add_watcher() i=6 2024-09-12T17:55:24.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.477+0000 7fae4e136800 20 add_watcher() i=7 2024-09-12T17:55:24.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.477+0000 7fae4e136800 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:24.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.478+0000 7facfb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:24.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.479+0000 7fae4e136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:24.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.479+0000 7fae4e136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:24.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.513+0000 7facfa7fc640 20 reqs_thread_entry: start 2024-09-12T17:55:24.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.513+0000 7fae4e136800 20 init_complete bucket index max shards: 1 2024-09-12T17:55:24.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.513+0000 7fae4e136800 20 Filter name: none 2024-09-12T17:55:24.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.513+0000 7fac6bfff640 20 reqs_thread_entry: start 2024-09-12T17:55:24.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.513+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:55:24.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.515+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.515+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.516+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.517+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:55:24.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.518+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.518+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.518+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.519+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:55:24.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.520+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.521+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.521+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.522+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:55:24.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.523+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.524+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.524+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.525+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:55:24.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.526+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.527+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.527+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.528+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:55:24.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.529+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.530+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.530+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.531+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:55:24.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.532+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.532+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.533+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.534+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:55:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.535+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.535+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.535+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.536+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:55:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.538+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.538+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.538+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.539+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:55:24.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.541+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.541+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.541+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.542+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:55:24.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.544+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.544+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.544+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.545+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:55:24.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.546+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.547+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.547+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.548+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:55:24.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.549+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.550+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.550+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.551+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:55:24.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.552+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.553+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.553+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.554+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:55:24.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.555+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.555+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.556+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.557+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:55:24.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.558+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.559+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.559+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.560+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:55:24.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.562+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.562+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.563+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.563+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:55:24.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.565+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.566+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.566+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.567+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:55:24.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.568+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.568+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.569+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.569+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:55:24.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.571+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.571+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.571+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.572+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:55:24.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.573+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.574+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.574+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.575+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:55:24.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.577+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.577+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.577+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.578+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:55:24.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.580+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.580+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.580+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.581+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:55:24.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.583+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.584+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.584+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.585+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:55:24.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.587+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.587+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.587+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.588+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:55:24.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.589+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.590+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.590+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.591+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:55:24.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.592+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.593+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.593+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.594+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:55:24.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.596+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.596+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.597+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.597+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:55:24.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.599+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.599+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.600+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.600+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:55:24.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.602+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.602+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.602+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.603+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:55:24.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.605+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.605+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.606+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.607+0000 7fae4e136800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:55:24.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.608+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.608+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:55:24.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.608+0000 7fae4e136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:55:24.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.610+0000 7facfb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:24.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.612+0000 7fae4e136800 20 remove_watcher() i=0 2024-09-12T17:55:24.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.612+0000 7fae4e136800 2 removed watcher, disabling cache 2024-09-12T17:55:24.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.614+0000 7fae4e136800 20 remove_watcher() i=1 2024-09-12T17:55:24.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.615+0000 7fae4e136800 20 remove_watcher() i=2 2024-09-12T17:55:24.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.616+0000 7fae4e136800 20 remove_watcher() i=3 2024-09-12T17:55:24.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.617+0000 7fae4e136800 20 remove_watcher() i=4 2024-09-12T17:55:24.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.618+0000 7fae4e136800 20 remove_watcher() i=5 2024-09-12T17:55:24.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.619+0000 7fae4e136800 20 remove_watcher() i=6 2024-09-12T17:55:24.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:55:24.620+0000 7fae4e136800 20 remove_watcher() i=7 2024-09-12T17:55:24.632 DEBUG:teuthology.orchestra.run.smithi107:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T17:55:25.116 INFO:teuthology.orchestra.run.smithi107.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T17:55:28.515 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :clean UP-TO-DATE 2024-09-12T17:55:45.314 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :compileJava 2024-09-12T17:55:45.414 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :processResources 2024-09-12T17:55:45.414 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :classes 2024-09-12T17:55:46.114 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:46.114 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :compileTestJava 2024-09-12T17:55:46.114 INFO:teuthology.orchestra.run.smithi107.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:55:46.114 INFO:teuthology.orchestra.run.smithi107.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:55:46.115 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:46.115 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:55:46.115 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :testClasses 2024-09-12T17:55:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:51.814 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :test 2024-09-12T17:55:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:51.814 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T17:55:52.314 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:52.314 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T17:55:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:52.514 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T17:55:52.613 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:52.613 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T17:55:52.813 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:52.813 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T17:55:53.213 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:53.214 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T17:55:53.414 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:53.414 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:55:53.414 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:53.414 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:55:53.514 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:53.514 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T17:55:53.514 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:53.514 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T17:55:53.713 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:53.713 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T17:55:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:54.214 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T17:55:54.513 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:54.513 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:55:54.713 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:54.714 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T17:55:54.714 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12 17:55:54,669 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:55:59.013 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:59.014 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:55:59.313 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:59.313 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T17:55:59.314 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:59.314 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T17:55:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:59.514 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T17:55:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:59.515 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T17:55:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:55:59.814 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T17:56:00.313 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:00.313 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T17:56:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:00.513 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:56:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:00.614 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:56:00.614 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:00.614 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T17:56:02.913 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:02.915 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T17:56:03.113 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:03.113 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:56:03.513 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:03.514 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:56:03.716 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:03.717 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T17:56:04.016 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:04.016 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T17:56:04.213 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:04.213 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:56:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:10.114 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:56:10.313 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:10.313 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T17:56:11.213 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:11.214 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T17:56:11.413 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:11.414 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T17:56:11.913 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:11.914 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T17:56:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:12.114 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T17:56:12.513 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:12.514 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T17:56:12.713 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:12.714 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T17:56:12.714 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:12.714 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T17:56:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:12.914 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T17:56:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:13.014 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T17:56:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:13.213 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T17:56:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:13.214 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T17:56:13.413 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:13.416 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T17:56:13.416 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:13.416 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T17:56:13.614 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:13.614 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T17:56:13.614 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:13.614 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T17:56:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:13.814 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T17:56:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:13.814 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T17:56:14.014 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:14.014 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T17:56:14.014 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:14.014 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T17:56:14.213 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:14.213 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T17:56:14.713 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:14.713 INFO:teuthology.orchestra.run.smithi107.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T17:56:14.914 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:14.914 INFO:teuthology.orchestra.run.smithi107.stdout:---------------------------------------------------------------------- 2024-09-12T17:56:14.914 INFO:teuthology.orchestra.run.smithi107.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T17:56:14.915 INFO:teuthology.orchestra.run.smithi107.stdout:---------------------------------------------------------------------- 2024-09-12T17:56:14.972 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:14.972 INFO:teuthology.orchestra.run.smithi107.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:56:14.973 INFO:teuthology.orchestra.run.smithi107.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:56:14.973 INFO:teuthology.orchestra.run.smithi107.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:56:14.973 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:14.973 INFO:teuthology.orchestra.run.smithi107.stdout:BUILD SUCCESSFUL in 50s 2024-09-12T17:56:14.973 INFO:teuthology.orchestra.run.smithi107.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T17:56:15.293 DEBUG:teuthology.orchestra.run.smithi107:> radosgw-admin gc process --include-all 2024-09-12T17:56:15.345 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:15.345 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:15.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.381+0000 7fd5da696800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.382+0000 7fd5da696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.382+0000 7fd5da696800 20 realm 2024-09-12T17:56:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.382+0000 7fd5da696800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.383+0000 7fd5da696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.383+0000 7fd5da696800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.383+0000 7fd5da696800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.383+0000 7fd5da696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.383+0000 7fd5da696800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.384+0000 7fd5da696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.384+0000 7fd5da696800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.384+0000 7fd5da696800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:15.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.384+0000 7fd5da696800 20 searching for the correct realm 2024-09-12T17:56:15.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.388+0000 7fd5d8981640 0 -- 172.21.15.107:0/3893851349 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x55ea47448b60 msgr2=0x55ea4744aff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.391+0000 7fd5cffff640 0 -- 172.21.15.107:0/3893851349 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fd5c0018070 msgr2=0x7fd5c008abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:15.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:15.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:56:15.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:56:15.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:15.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:15.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:15.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 zone default found 2024-09-12T17:56:15.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 4 Realm: () 2024-09-12T17:56:15.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:56:15.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:56:15.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:15.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 zonegroup default 2024-09-12T17:56:15.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.396+0000 7fd5da696800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.397+0000 7fd5da696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.397+0000 7fd5da696800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.397+0000 7fd5da696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.397+0000 7fd5da696800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.398+0000 7fd5da696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.398+0000 7fd5da696800 20 started sync module instance, tier type = 2024-09-12T17:56:15.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.398+0000 7fd5da696800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:56:15.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.406+0000 7fd5da696800 20 add_watcher() i=0 2024-09-12T17:56:15.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.406+0000 7fd5da696800 20 add_watcher() i=1 2024-09-12T17:56:15.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.406+0000 7fd5da696800 20 add_watcher() i=2 2024-09-12T17:56:15.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.406+0000 7fd5da696800 20 add_watcher() i=3 2024-09-12T17:56:15.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.406+0000 7fd5da696800 20 add_watcher() i=4 2024-09-12T17:56:15.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.406+0000 7fd5da696800 20 add_watcher() i=5 2024-09-12T17:56:15.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.406+0000 7fd5da696800 20 add_watcher() i=6 2024-09-12T17:56:15.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.407+0000 7fd5da696800 20 add_watcher() i=7 2024-09-12T17:56:15.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.407+0000 7fd5da696800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:15.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.409+0000 7fd48efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.409+0000 7fd5da696800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:15.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.409+0000 7fd5da696800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:15.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.442+0000 7fd48dfdb640 20 reqs_thread_entry: start 2024-09-12T17:56:15.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.442+0000 7fd5da696800 20 init_complete bucket index max shards: 1 2024-09-12T17:56:15.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.443+0000 7fd5da696800 20 Filter name: none 2024-09-12T17:56:15.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.443+0000 7fd3ff7fe640 20 reqs_thread_entry: start 2024-09-12T17:56:15.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.443+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:56:15.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.444+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.444+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.445+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.446+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:56:15.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.447+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.448+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.448+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.449+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:56:15.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.450+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.451+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.451+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.452+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:56:15.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.453+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.453+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.454+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.455+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:56:15.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.456+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.457+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.457+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:15.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.457+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.12795886533117836869', time=2024-09-12T19:56:14.757850+0000, chain.objs.size()=11 2024-09-12T17:56:15.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.457+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.67__multipart_key1.2~lKi0vaR5yT5F9K0mjZijSDqUjO55oWc.1 2024-09-12T17:56:15.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.457+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.67__multipart_key1.2~lKi0vaR5yT5F9K0mjZijSDqUjO55oWc.2 2024-09-12T17:56:15.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.457+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.67__multipart_key1.2~lKi0vaR5yT5F9K0mjZijSDqUjO55oWc.3 2024-09-12T17:56:15.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.457+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.67__multipart_key1.2~lKi0vaR5yT5F9K0mjZijSDqUjO55oWc.4 2024-09-12T17:56:15.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.457+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.67__multipart_key1.2~lKi0vaR5yT5F9K0mjZijSDqUjO55oWc.5 2024-09-12T17:56:15.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.458+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.67__multipart_key1.2~lKi0vaR5yT5F9K0mjZijSDqUjO55oWc.6 2024-09-12T17:56:15.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.458+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.67__multipart_key1.2~lKi0vaR5yT5F9K0mjZijSDqUjO55oWc.7 2024-09-12T17:56:15.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.458+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.67__multipart_key1.2~lKi0vaR5yT5F9K0mjZijSDqUjO55oWc.8 2024-09-12T17:56:15.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.458+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.67__multipart_key1.2~lKi0vaR5yT5F9K0mjZijSDqUjO55oWc.9 2024-09-12T17:56:15.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.458+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.67__multipart_key1.2~lKi0vaR5yT5F9K0mjZijSDqUjO55oWc.10 2024-09-12T17:56:15.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.458+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.67__multipart_key1.2~lKi0vaR5yT5F9K0mjZijSDqUjO55oWc.11 2024-09-12T17:56:15.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.463+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.466+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:56:15.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.467+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:15.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR', time=2024-09-12T19:56:12.609960+0000, chain.objs.size()=67 2024-09-12T17:56:15.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.1 2024-09-12T17:56:15.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.2 2024-09-12T17:56:15.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.3 2024-09-12T17:56:15.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.4 2024-09-12T17:56:15.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.5 2024-09-12T17:56:15.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.6 2024-09-12T17:56:15.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.7 2024-09-12T17:56:15.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.8 2024-09-12T17:56:15.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.9 2024-09-12T17:56:15.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.10 2024-09-12T17:56:15.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.11 2024-09-12T17:56:15.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.468+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.12 2024-09-12T17:56:15.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.472+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.13 2024-09-12T17:56:15.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.472+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.14 2024-09-12T17:56:15.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.472+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.15 2024-09-12T17:56:15.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.472+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.16 2024-09-12T17:56:15.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.472+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.17 2024-09-12T17:56:15.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.472+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.18 2024-09-12T17:56:15.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.472+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.19 2024-09-12T17:56:15.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.472+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.20 2024-09-12T17:56:15.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.472+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.21 2024-09-12T17:56:15.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.472+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.22 2024-09-12T17:56:15.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.472+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.23 2024-09-12T17:56:15.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.476+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.24 2024-09-12T17:56:15.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.476+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.25 2024-09-12T17:56:15.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.477+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.26 2024-09-12T17:56:15.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.477+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.27 2024-09-12T17:56:15.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.477+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.28 2024-09-12T17:56:15.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.477+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.29 2024-09-12T17:56:15.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.477+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.30 2024-09-12T17:56:15.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.477+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.31 2024-09-12T17:56:15.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.477+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.32 2024-09-12T17:56:15.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.477+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.33 2024-09-12T17:56:15.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.477+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.34 2024-09-12T17:56:15.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.479+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.35 2024-09-12T17:56:15.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.481+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.36 2024-09-12T17:56:15.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.481+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.37 2024-09-12T17:56:15.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.481+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.38 2024-09-12T17:56:15.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.481+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.39 2024-09-12T17:56:15.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.483+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.40 2024-09-12T17:56:15.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.483+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.41 2024-09-12T17:56:15.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.483+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.42 2024-09-12T17:56:15.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.483+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.43 2024-09-12T17:56:15.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.483+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.44 2024-09-12T17:56:15.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.483+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.45 2024-09-12T17:56:15.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.483+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.46 2024-09-12T17:56:15.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.484+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.47 2024-09-12T17:56:15.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.484+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.48 2024-09-12T17:56:15.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.486+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.49 2024-09-12T17:56:15.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.486+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.50 2024-09-12T17:56:15.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.486+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.51 2024-09-12T17:56:15.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.486+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.52 2024-09-12T17:56:15.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.486+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.53 2024-09-12T17:56:15.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.486+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.54 2024-09-12T17:56:15.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.486+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.55 2024-09-12T17:56:15.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.486+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.56 2024-09-12T17:56:15.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.486+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.57 2024-09-12T17:56:15.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.488+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.58 2024-09-12T17:56:15.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.489+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.59 2024-09-12T17:56:15.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.489+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.60 2024-09-12T17:56:15.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.489+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.61 2024-09-12T17:56:15.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.489+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.62 2024-09-12T17:56:15.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.492+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.63 2024-09-12T17:56:15.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.492+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.64 2024-09-12T17:56:15.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.492+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.65 2024-09-12T17:56:15.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.492+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.66 2024-09-12T17:56:15.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.492+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.59__multipart_key1.2~zPlD5feiQ-MWTxpV4BK30P3-T5NKQIR.67 2024-09-12T17:56:15.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.494+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.497+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:56:15.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.498+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.12922804589440582486', time=2024-09-12T19:56:09.323957+0000, chain.objs.size()=11 2024-09-12T17:56:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~KCRMh_7VeaCZjtIUhn0oR0nCmrZTAud.1 2024-09-12T17:56:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~KCRMh_7VeaCZjtIUhn0oR0nCmrZTAud.1_1 2024-09-12T17:56:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~KCRMh_7VeaCZjtIUhn0oR0nCmrZTAud.2 2024-09-12T17:56:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~KCRMh_7VeaCZjtIUhn0oR0nCmrZTAud.2_1 2024-09-12T17:56:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~KCRMh_7VeaCZjtIUhn0oR0nCmrZTAud.3 2024-09-12T17:56:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~KCRMh_7VeaCZjtIUhn0oR0nCmrZTAud.3_1 2024-09-12T17:56:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~KCRMh_7VeaCZjtIUhn0oR0nCmrZTAud.4 2024-09-12T17:56:15.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~KCRMh_7VeaCZjtIUhn0oR0nCmrZTAud.4_1 2024-09-12T17:56:15.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~KCRMh_7VeaCZjtIUhn0oR0nCmrZTAud.5 2024-09-12T17:56:15.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~KCRMh_7VeaCZjtIUhn0oR0nCmrZTAud.5_1 2024-09-12T17:56:15.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.499+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~KCRMh_7VeaCZjtIUhn0oR0nCmrZTAud.6 2024-09-12T17:56:15.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.505+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.507+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:56:15.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.508+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:56:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.838664747836760392', time=2024-09-12T19:55:59.050144+0000, chain.objs.size()=4 2024-09-12T17:56:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.47__shadow_.PAAFviJ_phL1bv_jD01jVsGqmD_9JvU_1 2024-09-12T17:56:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.47__shadow_.PAAFviJ_phL1bv_jD01jVsGqmD_9JvU_2 2024-09-12T17:56:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.47__shadow_.PAAFviJ_phL1bv_jD01jVsGqmD_9JvU_3 2024-09-12T17:56:15.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.47__shadow_.PAAFviJ_phL1bv_jD01jVsGqmD_9JvU_4 2024-09-12T17:56:15.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.4257968807149136668', time=2024-09-12T19:56:07.909698+0000, chain.objs.size()=11 2024-09-12T17:56:15.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~D0lFbocbTy7YPdFukvKIU_f6c5hwLHR.1 2024-09-12T17:56:15.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~D0lFbocbTy7YPdFukvKIU_f6c5hwLHR.2 2024-09-12T17:56:15.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~D0lFbocbTy7YPdFukvKIU_f6c5hwLHR.3 2024-09-12T17:56:15.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~D0lFbocbTy7YPdFukvKIU_f6c5hwLHR.4 2024-09-12T17:56:15.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~D0lFbocbTy7YPdFukvKIU_f6c5hwLHR.5 2024-09-12T17:56:15.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~D0lFbocbTy7YPdFukvKIU_f6c5hwLHR.6 2024-09-12T17:56:15.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~D0lFbocbTy7YPdFukvKIU_f6c5hwLHR.7 2024-09-12T17:56:15.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.509+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~D0lFbocbTy7YPdFukvKIU_f6c5hwLHR.8 2024-09-12T17:56:15.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.512+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~D0lFbocbTy7YPdFukvKIU_f6c5hwLHR.9 2024-09-12T17:56:15.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.512+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~D0lFbocbTy7YPdFukvKIU_f6c5hwLHR.10 2024-09-12T17:56:15.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.512+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~D0lFbocbTy7YPdFukvKIU_f6c5hwLHR.11 2024-09-12T17:56:15.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.517+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.520+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:56:15.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.522+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.522+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.522+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:15.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.522+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.9130458370297233594', time=2024-09-12T19:55:58.910159+0000, chain.objs.size()=5 2024-09-12T17:56:15.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.522+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~7lZ08_j1vAPz-yaXME6pnGsIdQFTos6.1 2024-09-12T17:56:15.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.522+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__shadow_key1.2~7lZ08_j1vAPz-yaXME6pnGsIdQFTos6.1_1 2024-09-12T17:56:15.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.522+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~7lZ08_j1vAPz-yaXME6pnGsIdQFTos6.2 2024-09-12T17:56:15.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.522+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__shadow_key1.2~7lZ08_j1vAPz-yaXME6pnGsIdQFTos6.2_1 2024-09-12T17:56:15.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.522+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~7lZ08_j1vAPz-yaXME6pnGsIdQFTos6.3 2024-09-12T17:56:15.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.525+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.527+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:56:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.529+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.529+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.530+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.530+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.9020865699085213949', time=2024-09-12T19:56:11.956657+0000, chain.objs.size()=5 2024-09-12T17:56:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.530+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.58__multipart_key1.2~XBqsEPldk-lzzAAiPIn8ZvugQ6_OxCR.1 2024-09-12T17:56:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.530+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.58__multipart_key1.2~XBqsEPldk-lzzAAiPIn8ZvugQ6_OxCR.2 2024-09-12T17:56:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.530+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.58__multipart_key1.2~XBqsEPldk-lzzAAiPIn8ZvugQ6_OxCR.3 2024-09-12T17:56:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.530+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.58__multipart_key1.2~XBqsEPldk-lzzAAiPIn8ZvugQ6_OxCR.4 2024-09-12T17:56:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.530+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.58__multipart_key1.2~XBqsEPldk-lzzAAiPIn8ZvugQ6_OxCR.5 2024-09-12T17:56:15.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.531+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.534+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:56:15.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.535+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.536+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.536+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.537+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:56:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.538+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.539+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.539+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.540+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:56:15.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.541+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.542+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.542+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.543+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:56:15.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.544+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.545+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.545+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:15.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.545+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='2~-FGC2Qvd2FDBcRBw0Hdua2__V3rldIY', time=2024-09-12T19:56:04.087752+0000, chain.objs.size()=3 2024-09-12T17:56:15.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.545+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.55__multipart_key1.2~-FGC2Qvd2FDBcRBw0Hdua2__V3rldIY.7 2024-09-12T17:56:15.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.545+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.55__multipart_key1.2~-FGC2Qvd2FDBcRBw0Hdua2__V3rldIY.10 2024-09-12T17:56:15.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.545+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.55__multipart_key1.2~-FGC2Qvd2FDBcRBw0Hdua2__V3rldIY.13 2024-09-12T17:56:15.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.547+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.549+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:56:15.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.551+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.551+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.551+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.553+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:56:15.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.554+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.555+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.555+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.556+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:56:15.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.557+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.557+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.558+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:15.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.558+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.3488576307849118050', time=2024-09-12T19:56:03.575947+0000, chain.objs.size()=5 2024-09-12T17:56:15.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.558+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.54__multipart_file.mpg.2~g5PkeMc3E0VhDns_Z1zXBwDC6W9PLrC.1 2024-09-12T17:56:15.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.558+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.54__multipart_file.mpg.2~g5PkeMc3E0VhDns_Z1zXBwDC6W9PLrC.2 2024-09-12T17:56:15.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.558+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.54__multipart_file.mpg.2~g5PkeMc3E0VhDns_Z1zXBwDC6W9PLrC.3 2024-09-12T17:56:15.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.558+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.54__multipart_file.mpg.2~g5PkeMc3E0VhDns_Z1zXBwDC6W9PLrC.4 2024-09-12T17:56:15.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.558+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.54__multipart_file.mpg.2~g5PkeMc3E0VhDns_Z1zXBwDC6W9PLrC.5 2024-09-12T17:56:15.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.561+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.563+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:56:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.564+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:56:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.5348010515469996322', time=2024-09-12T19:56:00.366298+0000, chain.objs.size()=5 2024-09-12T17:56:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.52__multipart_key1.2~58sGWazLH-IAyufV4_6fTOTdZdtCO2o.1 2024-09-12T17:56:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.52__multipart_key1.2~58sGWazLH-IAyufV4_6fTOTdZdtCO2o.2 2024-09-12T17:56:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.52__multipart_key1.2~58sGWazLH-IAyufV4_6fTOTdZdtCO2o.3 2024-09-12T17:56:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.52__multipart_key1.2~58sGWazLH-IAyufV4_6fTOTdZdtCO2o.4 2024-09-12T17:56:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.52__multipart_key1.2~58sGWazLH-IAyufV4_6fTOTdZdtCO2o.5 2024-09-12T17:56:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.8557536291520790781', time=2024-09-12T19:56:02.955328+0000, chain.objs.size()=5 2024-09-12T17:56:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.53__multipart_key1.2~KXAGWrABUFH-Y1banEv8guB72ngAH4e.1 2024-09-12T17:56:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.53__multipart_key1.2~KXAGWrABUFH-Y1banEv8guB72ngAH4e.2 2024-09-12T17:56:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.53__multipart_key1.2~KXAGWrABUFH-Y1banEv8guB72ngAH4e.3 2024-09-12T17:56:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.53__multipart_key1.2~KXAGWrABUFH-Y1banEv8guB72ngAH4e.4 2024-09-12T17:56:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.53__multipart_key1.2~KXAGWrABUFH-Y1banEv8guB72ngAH4e.5 2024-09-12T17:56:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6439157462816548732', time=2024-09-12T19:56:05.892874+0000, chain.objs.size()=11 2024-09-12T17:56:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2jtbkBzAszjg0H5SsPPJOVLoWUXYKZ7.1 2024-09-12T17:56:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.565+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2jtbkBzAszjg0H5SsPPJOVLoWUXYKZ7.2 2024-09-12T17:56:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.568+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2jtbkBzAszjg0H5SsPPJOVLoWUXYKZ7.3 2024-09-12T17:56:15.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.569+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2jtbkBzAszjg0H5SsPPJOVLoWUXYKZ7.4 2024-09-12T17:56:15.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.569+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2jtbkBzAszjg0H5SsPPJOVLoWUXYKZ7.5 2024-09-12T17:56:15.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.570+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2jtbkBzAszjg0H5SsPPJOVLoWUXYKZ7.6 2024-09-12T17:56:15.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.570+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2jtbkBzAszjg0H5SsPPJOVLoWUXYKZ7.7 2024-09-12T17:56:15.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.570+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2jtbkBzAszjg0H5SsPPJOVLoWUXYKZ7.8 2024-09-12T17:56:15.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.570+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2jtbkBzAszjg0H5SsPPJOVLoWUXYKZ7.9 2024-09-12T17:56:15.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.570+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2jtbkBzAszjg0H5SsPPJOVLoWUXYKZ7.10 2024-09-12T17:56:15.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.571+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2jtbkBzAszjg0H5SsPPJOVLoWUXYKZ7.11 2024-09-12T17:56:15.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.576+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.579+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:56:15.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.581+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.581+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.581+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.583+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:56:15.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.584+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.584+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:56:15.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='2~UrMNE0TMmmsWL_Jeza1GVAwnk3GTZEy', time=2024-09-12T19:55:52.282926+0000, chain.objs.size()=5 2024-09-12T17:56:15.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.41__multipart_key1.2~UrMNE0TMmmsWL_Jeza1GVAwnk3GTZEy.1 2024-09-12T17:56:15.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.41__multipart_key1.2~UrMNE0TMmmsWL_Jeza1GVAwnk3GTZEy.2 2024-09-12T17:56:15.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.41__multipart_key1.2~UrMNE0TMmmsWL_Jeza1GVAwnk3GTZEy.3 2024-09-12T17:56:15.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.41__multipart_key1.2~UrMNE0TMmmsWL_Jeza1GVAwnk3GTZEy.4 2024-09-12T17:56:15.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.41__multipart_key1.2~UrMNE0TMmmsWL_Jeza1GVAwnk3GTZEy.5 2024-09-12T17:56:15.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.10501723676862427446', time=2024-09-12T19:55:57.046063+0000, chain.objs.size()=5 2024-09-12T17:56:15.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~yQeTkRSU5EUIB9Dw4kKDJRlM1_nDrUf.1 2024-09-12T17:56:15.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~yQeTkRSU5EUIB9Dw4kKDJRlM1_nDrUf.2 2024-09-12T17:56:15.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~yQeTkRSU5EUIB9Dw4kKDJRlM1_nDrUf.3 2024-09-12T17:56:15.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~yQeTkRSU5EUIB9Dw4kKDJRlM1_nDrUf.4 2024-09-12T17:56:15.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~yQeTkRSU5EUIB9Dw4kKDJRlM1_nDrUf.5 2024-09-12T17:56:15.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.16792896615016114313', time=2024-09-12T19:56:11.293575+0000, chain.objs.size()=5 2024-09-12T17:56:15.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.57__multipart_key1.2~nx4QTv2Kl1n1uyLiS-OsS35mVrKPNO_.1 2024-09-12T17:56:15.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.585+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.57__multipart_key1.2~nx4QTv2Kl1n1uyLiS-OsS35mVrKPNO_.2 2024-09-12T17:56:15.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.588+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.57__multipart_key1.2~nx4QTv2Kl1n1uyLiS-OsS35mVrKPNO_.3 2024-09-12T17:56:15.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.590+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.57__multipart_key1.2~nx4QTv2Kl1n1uyLiS-OsS35mVrKPNO_.4 2024-09-12T17:56:15.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.590+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.57__multipart_key1.2~nx4QTv2Kl1n1uyLiS-OsS35mVrKPNO_.5 2024-09-12T17:56:15.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.592+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.595+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:56:15.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.596+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.596+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.596+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:56:15.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.596+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.493604022837504152', time=2024-09-12T19:55:54.404601+0000, chain.objs.size()=5 2024-09-12T17:56:15.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.596+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.45__multipart_key1.2~Lq05gj3m-7Ayknnrb8lXYXzbND2q0W9.1 2024-09-12T17:56:15.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.596+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.45__multipart_key1.2~Lq05gj3m-7Ayknnrb8lXYXzbND2q0W9.2 2024-09-12T17:56:15.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.596+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.45__multipart_key1.2~Lq05gj3m-7Ayknnrb8lXYXzbND2q0W9.3 2024-09-12T17:56:15.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.596+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.45__multipart_key1.2~Lq05gj3m-7Ayknnrb8lXYXzbND2q0W9.4 2024-09-12T17:56:15.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.596+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.45__multipart_key1.2~Lq05gj3m-7Ayknnrb8lXYXzbND2q0W9.5 2024-09-12T17:56:15.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.596+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.14346532157393045299', time=2024-09-12T19:55:56.475458+0000, chain.objs.size()=5 2024-09-12T17:56:15.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.597+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~a_bPjZt0_Vom7OBonSmWODHEwJ7D9lG.1 2024-09-12T17:56:15.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.597+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~a_bPjZt0_Vom7OBonSmWODHEwJ7D9lG.2 2024-09-12T17:56:15.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.597+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~a_bPjZt0_Vom7OBonSmWODHEwJ7D9lG.3 2024-09-12T17:56:15.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.597+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~a_bPjZt0_Vom7OBonSmWODHEwJ7D9lG.4 2024-09-12T17:56:15.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.597+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~a_bPjZt0_Vom7OBonSmWODHEwJ7D9lG.5 2024-09-12T17:56:15.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.597+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.8382766382403611727', time=2024-09-12T19:55:57.927490+0000, chain.objs.size()=5 2024-09-12T17:56:15.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.597+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~lWbIC6Xuf1In6f3_Z8xGlFN7gBwoWq1.1 2024-09-12T17:56:15.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.597+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__shadow_key1.2~lWbIC6Xuf1In6f3_Z8xGlFN7gBwoWq1.1_1 2024-09-12T17:56:15.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.599+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~lWbIC6Xuf1In6f3_Z8xGlFN7gBwoWq1.2 2024-09-12T17:56:15.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.601+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__shadow_key1.2~lWbIC6Xuf1In6f3_Z8xGlFN7gBwoWq1.2_1 2024-09-12T17:56:15.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.601+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~lWbIC6Xuf1In6f3_Z8xGlFN7gBwoWq1.3 2024-09-12T17:56:15.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.603+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.606+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:56:15.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.607+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.607+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.608+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.608+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:56:15.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.610+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.610+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.611+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:15.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.611+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.13953379839091267255', time=2024-09-12T19:56:08.622957+0000, chain.objs.size()=10 2024-09-12T17:56:15.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.611+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~-Spwb8ar23buRDPZIcvl0_HAbUGBlMu.1 2024-09-12T17:56:15.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.611+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~-Spwb8ar23buRDPZIcvl0_HAbUGBlMu.2 2024-09-12T17:56:15.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.611+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~-Spwb8ar23buRDPZIcvl0_HAbUGBlMu.3 2024-09-12T17:56:15.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.611+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~-Spwb8ar23buRDPZIcvl0_HAbUGBlMu.4 2024-09-12T17:56:15.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.611+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~-Spwb8ar23buRDPZIcvl0_HAbUGBlMu.5 2024-09-12T17:56:15.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.611+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~-Spwb8ar23buRDPZIcvl0_HAbUGBlMu.6 2024-09-12T17:56:15.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.611+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~-Spwb8ar23buRDPZIcvl0_HAbUGBlMu.7 2024-09-12T17:56:15.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.611+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~-Spwb8ar23buRDPZIcvl0_HAbUGBlMu.8 2024-09-12T17:56:15.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.611+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~-Spwb8ar23buRDPZIcvl0_HAbUGBlMu.9 2024-09-12T17:56:15.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.611+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~-Spwb8ar23buRDPZIcvl0_HAbUGBlMu.10 2024-09-12T17:56:15.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.616+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.619+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:56:15.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:56:15.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.10892347332708150813', time=2024-09-12T19:55:57.482929+0000, chain.objs.size()=5 2024-09-12T17:56:15.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~stj3LM6eipa-q0zStaah1Fei4FDBnmM.1 2024-09-12T17:56:15.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~stj3LM6eipa-q0zStaah1Fei4FDBnmM.2 2024-09-12T17:56:15.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~stj3LM6eipa-q0zStaah1Fei4FDBnmM.3 2024-09-12T17:56:15.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~stj3LM6eipa-q0zStaah1Fei4FDBnmM.4 2024-09-12T17:56:15.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~stj3LM6eipa-q0zStaah1Fei4FDBnmM.5 2024-09-12T17:56:15.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.897349982349591160', time=2024-09-12T19:55:59.161625+0000, chain.objs.size()=5 2024-09-12T17:56:15.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~dtgjr_k_BQxjEmYDzur1noBrSiGvKns.1 2024-09-12T17:56:15.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__shadow_key1.2~dtgjr_k_BQxjEmYDzur1noBrSiGvKns.1_1 2024-09-12T17:56:15.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~dtgjr_k_BQxjEmYDzur1noBrSiGvKns.2 2024-09-12T17:56:15.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.620+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__shadow_key1.2~dtgjr_k_BQxjEmYDzur1noBrSiGvKns.2_1 2024-09-12T17:56:15.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.621+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.48__multipart_key1.2~dtgjr_k_BQxjEmYDzur1noBrSiGvKns.3 2024-09-12T17:56:15.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.625+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.628+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:56:15.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.629+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.630+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.630+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:15.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.630+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.8663710419038974385', time=2024-09-12T19:55:53.240619+0000, chain.objs.size()=5 2024-09-12T17:56:15.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.630+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.43__multipart_key1.2~4bSgz5j9ohW9FyiKgmUNpLoyflmHRNn.1 2024-09-12T17:56:15.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.630+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.43__multipart_key1.2~4bSgz5j9ohW9FyiKgmUNpLoyflmHRNn.2 2024-09-12T17:56:15.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.630+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.43__multipart_key1.2~4bSgz5j9ohW9FyiKgmUNpLoyflmHRNn.3 2024-09-12T17:56:15.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.630+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.43__multipart_key1.2~4bSgz5j9ohW9FyiKgmUNpLoyflmHRNn.4 2024-09-12T17:56:15.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.630+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.43__multipart_key1.2~4bSgz5j9ohW9FyiKgmUNpLoyflmHRNn.5 2024-09-12T17:56:15.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.633+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.635+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:56:15.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.636+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.637+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.637+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.637+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.3527500651217318856', time=2024-09-12T19:56:03.587141+0000, chain.objs.size()=5 2024-09-12T17:56:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.637+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.54__multipart_file2.mpg.2~BPIsuKXyckuq91s7pmk4E6tHUOt6Fki.1 2024-09-12T17:56:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.637+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.54__multipart_file2.mpg.2~BPIsuKXyckuq91s7pmk4E6tHUOt6Fki.2 2024-09-12T17:56:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.637+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.54__multipart_file2.mpg.2~BPIsuKXyckuq91s7pmk4E6tHUOt6Fki.3 2024-09-12T17:56:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.637+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.54__multipart_file2.mpg.2~BPIsuKXyckuq91s7pmk4E6tHUOt6Fki.4 2024-09-12T17:56:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.637+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.54__multipart_file2.mpg.2~BPIsuKXyckuq91s7pmk4E6tHUOt6Fki.5 2024-09-12T17:56:15.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.640+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.642+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:56:15.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.644+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.644+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.645+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.645+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:56:15.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:56:15.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.9468079079976617573', time=2024-09-12T19:56:10.052599+0000, chain.objs.size()=11 2024-09-12T17:56:15.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2M-UOEhcfWX9uNc_jqM-dOt4mr3t4py.1 2024-09-12T17:56:15.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~2M-UOEhcfWX9uNc_jqM-dOt4mr3t4py.1_1 2024-09-12T17:56:15.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2M-UOEhcfWX9uNc_jqM-dOt4mr3t4py.2 2024-09-12T17:56:15.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~2M-UOEhcfWX9uNc_jqM-dOt4mr3t4py.2_1 2024-09-12T17:56:15.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2M-UOEhcfWX9uNc_jqM-dOt4mr3t4py.3 2024-09-12T17:56:15.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~2M-UOEhcfWX9uNc_jqM-dOt4mr3t4py.3_1 2024-09-12T17:56:15.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2M-UOEhcfWX9uNc_jqM-dOt4mr3t4py.4 2024-09-12T17:56:15.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~2M-UOEhcfWX9uNc_jqM-dOt4mr3t4py.4_1 2024-09-12T17:56:15.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2M-UOEhcfWX9uNc_jqM-dOt4mr3t4py.5 2024-09-12T17:56:15.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~2M-UOEhcfWX9uNc_jqM-dOt4mr3t4py.5_1 2024-09-12T17:56:15.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~2M-UOEhcfWX9uNc_jqM-dOt4mr3t4py.6 2024-09-12T17:56:15.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.490809806917916048', time=2024-09-12T19:56:10.192575+0000, chain.objs.size()=11 2024-09-12T17:56:15.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.647+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~YxDCorju4idLXh3uHzGIg41USK6S3T7.1 2024-09-12T17:56:15.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.650+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~YxDCorju4idLXh3uHzGIg41USK6S3T7.1_1 2024-09-12T17:56:15.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.651+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~YxDCorju4idLXh3uHzGIg41USK6S3T7.2 2024-09-12T17:56:15.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.651+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~YxDCorju4idLXh3uHzGIg41USK6S3T7.2_1 2024-09-12T17:56:15.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.652+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~YxDCorju4idLXh3uHzGIg41USK6S3T7.3 2024-09-12T17:56:15.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.652+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~YxDCorju4idLXh3uHzGIg41USK6S3T7.3_1 2024-09-12T17:56:15.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.652+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~YxDCorju4idLXh3uHzGIg41USK6S3T7.4 2024-09-12T17:56:15.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.652+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~YxDCorju4idLXh3uHzGIg41USK6S3T7.4_1 2024-09-12T17:56:15.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.653+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~YxDCorju4idLXh3uHzGIg41USK6S3T7.5 2024-09-12T17:56:15.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.654+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__shadow_key1.2~YxDCorju4idLXh3uHzGIg41USK6S3T7.5_1 2024-09-12T17:56:15.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.654+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.56__multipart_key1.2~YxDCorju4idLXh3uHzGIg41USK6S3T7.6 2024-09-12T17:56:15.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.658+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.661+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:56:15.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.662+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.663+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.663+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.664+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:56:15.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.666+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.666+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.667+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.667+0000 7fd5da696800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.17965942351201143952', time=2024-09-12T19:55:54.295974+0000, chain.objs.size()=5 2024-09-12T17:56:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.667+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.45__multipart_key1.2~Lq05gj3m-7Ayknnrb8lXYXzbND2q0W9.1 2024-09-12T17:56:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.667+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.45__multipart_key1.2~Lq05gj3m-7Ayknnrb8lXYXzbND2q0W9.2 2024-09-12T17:56:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.667+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.45__multipart_key1.2~Lq05gj3m-7Ayknnrb8lXYXzbND2q0W9.3 2024-09-12T17:56:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.667+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.45__multipart_key1.2~Lq05gj3m-7Ayknnrb8lXYXzbND2q0W9.4 2024-09-12T17:56:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.667+0000 7fd5da696800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.45__multipart_key1.2~Lq05gj3m-7Ayknnrb8lXYXzbND2q0W9.5 2024-09-12T17:56:15.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.669+0000 7fd5da696800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:15.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.672+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:56:15.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.673+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.674+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.674+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.675+0000 7fd5da696800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:56:15.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.676+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.676+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:15.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.677+0000 7fd5da696800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:15.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.678+0000 7fd48efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.680+0000 7fd5da696800 20 remove_watcher() i=0 2024-09-12T17:56:15.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.680+0000 7fd5da696800 2 removed watcher, disabling cache 2024-09-12T17:56:15.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.681+0000 7fd5da696800 20 remove_watcher() i=1 2024-09-12T17:56:15.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.682+0000 7fd5da696800 20 remove_watcher() i=2 2024-09-12T17:56:15.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.683+0000 7fd5da696800 20 remove_watcher() i=3 2024-09-12T17:56:15.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.684+0000 7fd5da696800 20 remove_watcher() i=4 2024-09-12T17:56:15.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.685+0000 7fd5da696800 20 remove_watcher() i=5 2024-09-12T17:56:15.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.686+0000 7fd5da696800 20 remove_watcher() i=6 2024-09-12T17:56:15.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.687+0000 7fd5da696800 20 remove_watcher() i=7 2024-09-12T17:56:15.699 DEBUG:teuthology.orchestra.run.smithi107:> radosgw-admin gc process --include-all 2024-09-12T17:56:15.751 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:15.751 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:15.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.786+0000 7fd531c32800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.787+0000 7fd531c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.787+0000 7fd531c32800 20 realm 2024-09-12T17:56:15.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.787+0000 7fd531c32800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.788+0000 7fd531c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.788+0000 7fd531c32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:15.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.788+0000 7fd531c32800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.788+0000 7fd531c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.788+0000 7fd531c32800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.789+0000 7fd531c32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.789+0000 7fd531c32800 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.789+0000 7fd531c32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:15.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.789+0000 7fd531c32800 20 searching for the correct realm 2024-09-12T17:56:15.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.791+0000 7fd527fff640 0 -- 172.21.15.107:0/909205919 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fd518099b10 msgr2=0x7fd518091950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:15.795+0000 7fd52cf53640 0 -- 172.21.15.107:0/909205919 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fd5180a8920 msgr2=0x7fd51807b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:16.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.001+0000 7fd531c32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:16.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.001+0000 7fd531c32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:16.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.001+0000 7fd531c32800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:56:16.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.001+0000 7fd531c32800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:56:16.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.001+0000 7fd531c32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:16.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.001+0000 7fd531c32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:16.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.001+0000 7fd531c32800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.001+0000 7fd531c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.001+0000 7fd531c32800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.002+0000 7fd531c32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:16.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.002+0000 7fd531c32800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.002+0000 7fd531c32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:16.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.002+0000 7fd531c32800 20 zone default found 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.002+0000 7fd531c32800 4 Realm: () 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.002+0000 7fd531c32800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.002+0000 7fd531c32800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.002+0000 7fd531c32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.002+0000 7fd531c32800 20 zonegroup default 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.002+0000 7fd531c32800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.002+0000 7fd531c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.002+0000 7fd531c32800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.003+0000 7fd531c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.003+0000 7fd531c32800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.003+0000 7fd531c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.003+0000 7fd531c32800 20 started sync module instance, tier type = 2024-09-12T17:56:16.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.003+0000 7fd531c32800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:56:16.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.012+0000 7fd531c32800 20 add_watcher() i=0 2024-09-12T17:56:16.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.012+0000 7fd531c32800 20 add_watcher() i=1 2024-09-12T17:56:16.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.012+0000 7fd531c32800 20 add_watcher() i=2 2024-09-12T17:56:16.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.012+0000 7fd531c32800 20 add_watcher() i=3 2024-09-12T17:56:16.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.012+0000 7fd531c32800 20 add_watcher() i=4 2024-09-12T17:56:16.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.012+0000 7fd531c32800 20 add_watcher() i=5 2024-09-12T17:56:16.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.012+0000 7fd531c32800 20 add_watcher() i=6 2024-09-12T17:56:16.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.013+0000 7fd531c32800 20 add_watcher() i=7 2024-09-12T17:56:16.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.013+0000 7fd531c32800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:16.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.015+0000 7fd3e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:16.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.015+0000 7fd531c32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:16.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.015+0000 7fd531c32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:16.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.049+0000 7fd3e1fe3640 20 reqs_thread_entry: start 2024-09-12T17:56:16.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.050+0000 7fd531c32800 20 init_complete bucket index max shards: 1 2024-09-12T17:56:16.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.050+0000 7fd531c32800 20 Filter name: none 2024-09-12T17:56:16.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.050+0000 7fd3537fe640 20 reqs_thread_entry: start 2024-09-12T17:56:16.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.050+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:56:16.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.051+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.051+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.052+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.053+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:56:16.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.054+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.055+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.055+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.056+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:56:16.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.057+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.057+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.058+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.059+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:56:16.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.060+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.060+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.061+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.061+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:56:16.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.063+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.063+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.063+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.064+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:56:16.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.066+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.066+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.066+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.067+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:56:16.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.069+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.069+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.069+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.071+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:56:16.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.072+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.073+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.073+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.074+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:56:16.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.076+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.076+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.076+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.077+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:56:16.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.078+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.079+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.079+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.080+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:56:16.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.081+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.082+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.082+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.083+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:56:16.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.085+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.085+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.086+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.087+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:56:16.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.088+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.088+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.089+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.090+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:56:16.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.091+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.092+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.092+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.093+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:56:16.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.094+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.095+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.095+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.096+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:56:16.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.097+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.098+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.098+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.099+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:56:16.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.101+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.101+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.102+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.103+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:56:16.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.104+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.104+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.104+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.105+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:56:16.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.107+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.107+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.108+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.108+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:56:16.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.110+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.110+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.110+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.111+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:56:16.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.113+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.114+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.114+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.115+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:56:16.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.116+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.117+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.117+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.118+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:56:16.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.120+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.120+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.120+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.121+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:56:16.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.122+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.123+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.123+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.124+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:56:16.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.125+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.126+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.126+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.127+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:56:16.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.128+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.129+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.129+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.130+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:56:16.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.132+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.134+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.135+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.136+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:56:16.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.137+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.138+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.138+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.139+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:56:16.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.140+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.141+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.141+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.142+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:56:16.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.143+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.144+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.144+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.145+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:56:16.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.146+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.146+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.147+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.148+0000 7fd531c32800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:56:16.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.149+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.149+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.150+0000 7fd531c32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.151+0000 7fd3e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:16.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.154+0000 7fd531c32800 20 remove_watcher() i=0 2024-09-12T17:56:16.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.154+0000 7fd531c32800 2 removed watcher, disabling cache 2024-09-12T17:56:16.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.155+0000 7fd531c32800 20 remove_watcher() i=1 2024-09-12T17:56:16.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.156+0000 7fd531c32800 20 remove_watcher() i=2 2024-09-12T17:56:16.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.157+0000 7fd531c32800 20 remove_watcher() i=3 2024-09-12T17:56:16.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.158+0000 7fd531c32800 20 remove_watcher() i=4 2024-09-12T17:56:16.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.159+0000 7fd531c32800 20 remove_watcher() i=5 2024-09-12T17:56:16.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.160+0000 7fd531c32800 20 remove_watcher() i=6 2024-09-12T17:56:16.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.161+0000 7fd531c32800 20 remove_watcher() i=7 2024-09-12T17:56:16.173 DEBUG:teuthology.orchestra.run.smithi107:> radosgw-admin gc process --include-all 2024-09-12T17:56:16.225 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:16.225 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:16.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.260+0000 7f868ad35800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.262+0000 7f868ad35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.262+0000 7f868ad35800 20 realm 2024-09-12T17:56:16.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.262+0000 7f868ad35800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.262+0000 7f868ad35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.262+0000 7f868ad35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:16.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.262+0000 7f868ad35800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.262+0000 7f868ad35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.262+0000 7f868ad35800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.263+0000 7f868ad35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:16.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.263+0000 7f868ad35800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.264+0000 7f868ad35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:16.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.264+0000 7f868ad35800 20 searching for the correct realm 2024-09-12T17:56:16.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.267+0000 7f868727e640 0 -- 172.21.15.107:0/1577984643 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7f867006d370 msgr2=0x7f867006e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:16.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.473+0000 7f8686a7d640 0 -- 172.21.15.107:0/1577984643 >> [v2:172.21.15.148:6800/18671776,v1:172.21.15.148:6801/18671776] conn(0x56344ad0fd20 msgr2=0x56344ad12110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:16.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.481+0000 7f868ad35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:16.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.481+0000 7f868ad35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:16.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.481+0000 7f868ad35800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:56:16.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.481+0000 7f868ad35800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:56:16.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.481+0000 7f868ad35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:16.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.481+0000 7f868ad35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:16.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.481+0000 7f868ad35800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 20 zone default found 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 4 Realm: () 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 20 zonegroup default 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.482+0000 7f868ad35800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.483+0000 7f868ad35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.483+0000 7f868ad35800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.483+0000 7f868ad35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.483+0000 7f868ad35800 20 started sync module instance, tier type = 2024-09-12T17:56:16.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.483+0000 7f868ad35800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:56:16.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.492+0000 7f868ad35800 20 add_watcher() i=0 2024-09-12T17:56:16.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.492+0000 7f868ad35800 20 add_watcher() i=1 2024-09-12T17:56:16.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.492+0000 7f868ad35800 20 add_watcher() i=2 2024-09-12T17:56:16.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.492+0000 7f868ad35800 20 add_watcher() i=3 2024-09-12T17:56:16.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.492+0000 7f868ad35800 20 add_watcher() i=4 2024-09-12T17:56:16.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.492+0000 7f868ad35800 20 add_watcher() i=5 2024-09-12T17:56:16.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.492+0000 7f868ad35800 20 add_watcher() i=6 2024-09-12T17:56:16.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.493+0000 7f868ad35800 20 add_watcher() i=7 2024-09-12T17:56:16.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.493+0000 7f868ad35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:16.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.494+0000 7f853d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:16.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.495+0000 7f868ad35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:16.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.495+0000 7f868ad35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:16.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.529+0000 7f84b7fff640 20 reqs_thread_entry: start 2024-09-12T17:56:16.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.529+0000 7f868ad35800 20 init_complete bucket index max shards: 1 2024-09-12T17:56:16.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.529+0000 7f868ad35800 20 Filter name: none 2024-09-12T17:56:16.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.529+0000 7f84b5ffb640 20 reqs_thread_entry: start 2024-09-12T17:56:16.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.529+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:56:16.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.530+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.531+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.531+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.532+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:56:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.533+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.533+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.534+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.535+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:56:16.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.536+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.536+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.537+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.537+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:56:16.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.539+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.539+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.539+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.540+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:56:16.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.541+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.542+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.542+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.543+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:56:16.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.544+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.545+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.545+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.546+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:56:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.547+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.547+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.547+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.548+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:56:16.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.550+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.550+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.550+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.551+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:56:16.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.552+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.553+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.553+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.554+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:56:16.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.555+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.556+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.556+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.557+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:56:16.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.558+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.559+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.559+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.560+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:56:16.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.561+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.562+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.562+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.563+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:56:16.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.564+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.565+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.565+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.566+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:56:16.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.567+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.568+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.568+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.569+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:56:16.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.571+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.572+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.572+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.573+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:56:16.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.574+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.575+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.575+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.576+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:56:16.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.578+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.578+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.578+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.579+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:56:16.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.580+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.581+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.581+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.582+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:56:16.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.583+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.584+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.584+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.585+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:56:16.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.586+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.586+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.587+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.588+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:56:16.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.589+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.590+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.590+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.591+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:56:16.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.592+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.593+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.593+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.594+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:56:16.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.595+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.596+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.596+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.597+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:56:16.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.598+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.599+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.599+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.600+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:56:16.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.601+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.602+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.602+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.603+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:56:16.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.604+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.605+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.605+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.606+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:56:16.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.607+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.608+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.608+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.609+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:56:16.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.611+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.611+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.611+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.612+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:56:16.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.614+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.614+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.614+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.615+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:56:16.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.617+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.617+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.617+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.618+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:56:16.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.619+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.620+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.620+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.621+0000 7f868ad35800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:56:16.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.622+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.623+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.623+0000 7f868ad35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.624+0000 7f853d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:16.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.627+0000 7f868ad35800 20 remove_watcher() i=0 2024-09-12T17:56:16.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.627+0000 7f868ad35800 2 removed watcher, disabling cache 2024-09-12T17:56:16.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.628+0000 7f868ad35800 20 remove_watcher() i=1 2024-09-12T17:56:16.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.629+0000 7f868ad35800 20 remove_watcher() i=2 2024-09-12T17:56:16.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.630+0000 7f868ad35800 20 remove_watcher() i=3 2024-09-12T17:56:16.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.631+0000 7f868ad35800 20 remove_watcher() i=4 2024-09-12T17:56:16.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.632+0000 7f868ad35800 20 remove_watcher() i=5 2024-09-12T17:56:16.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.633+0000 7f868ad35800 20 remove_watcher() i=6 2024-09-12T17:56:16.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.633+0000 7f868ad35800 20 remove_watcher() i=7 2024-09-12T17:56:16.646 DEBUG:teuthology.orchestra.run.smithi107:> radosgw-admin gc process --include-all 2024-09-12T17:56:16.698 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:16.698 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:16.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.733+0000 7f3ddfa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.734+0000 7f3ddfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.734+0000 7f3ddfa0e800 20 realm 2024-09-12T17:56:16.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.734+0000 7f3ddfa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.734+0000 7f3ddfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.734+0000 7f3ddfa0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:16.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.734+0000 7f3ddfa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.734+0000 7f3ddfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.734+0000 7f3ddfa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.735+0000 7f3ddfa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:16.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.735+0000 7f3ddfa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.736+0000 7f3ddfa0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:16.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.736+0000 7f3ddfa0e800 20 searching for the correct realm 2024-09-12T17:56:16.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.738+0000 7f3ddb16b640 0 -- 172.21.15.107:0/1885887910 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f3dd4028040 msgr2=0x7f3dd4028420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:16.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.742+0000 7f3ddb16b640 0 -- 172.21.15.107:0/1885887910 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f3dd000b040 msgr2=0x7f3dd00203f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:16.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:16.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:16.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:56:16.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:56:16.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:16.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:16.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:16.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 zone default found 2024-09-12T17:56:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 4 Realm: () 2024-09-12T17:56:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:56:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:56:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 zonegroup default 2024-09-12T17:56:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.948+0000 7f3ddfa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.949+0000 7f3ddfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.949+0000 7f3ddfa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.949+0000 7f3ddfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.949+0000 7f3ddfa0e800 20 rados->read ofs=0 len=0 2024-09-12T17:56:16.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.949+0000 7f3ddfa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:16.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.949+0000 7f3ddfa0e800 20 started sync module instance, tier type = 2024-09-12T17:56:16.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.949+0000 7f3ddfa0e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:56:16.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.959+0000 7f3ddfa0e800 20 add_watcher() i=0 2024-09-12T17:56:16.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.959+0000 7f3ddfa0e800 20 add_watcher() i=1 2024-09-12T17:56:16.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.959+0000 7f3ddfa0e800 20 add_watcher() i=2 2024-09-12T17:56:16.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.959+0000 7f3ddfa0e800 20 add_watcher() i=3 2024-09-12T17:56:16.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.959+0000 7f3ddfa0e800 20 add_watcher() i=4 2024-09-12T17:56:16.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.959+0000 7f3ddfa0e800 20 add_watcher() i=5 2024-09-12T17:56:16.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.959+0000 7f3ddfa0e800 20 add_watcher() i=6 2024-09-12T17:56:16.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.960+0000 7f3ddfa0e800 20 add_watcher() i=7 2024-09-12T17:56:16.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.960+0000 7f3ddfa0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:16.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.961+0000 7f3c91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:16.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.962+0000 7f3ddfa0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:16.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.962+0000 7f3ddfa0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:16.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.995+0000 7f3c90fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.995+0000 7f3ddfa0e800 20 init_complete bucket index max shards: 1 2024-09-12T17:56:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.995+0000 7f3ddfa0e800 20 Filter name: none 2024-09-12T17:56:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.995+0000 7f3c0a7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.995+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:56:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.997+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:16.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.998+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:16.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:16.998+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.000+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:56:17.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.002+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.003+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.003+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.004+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:56:17.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.006+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.006+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.006+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.007+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:56:17.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.009+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.009+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.009+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.010+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:56:17.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.011+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.012+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.012+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.013+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:56:17.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.014+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.015+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.015+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.016+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:56:17.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.017+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.017+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.018+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.019+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:56:17.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.020+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.020+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.020+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.021+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:56:17.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.023+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.023+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.024+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.025+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:56:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.027+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.027+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.027+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.028+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:56:17.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.030+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.030+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.031+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.031+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:56:17.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.033+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.033+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.033+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.034+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:56:17.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.035+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.036+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.036+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.037+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:56:17.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.038+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.038+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.039+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.040+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:56:17.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.041+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.041+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.042+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.043+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:56:17.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.044+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.045+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.045+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.046+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:56:17.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.047+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.048+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.048+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.049+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:56:17.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.050+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.051+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.051+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.052+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:56:17.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.053+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.053+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.054+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.054+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:56:17.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.056+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.056+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.056+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.058+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:56:17.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.059+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.059+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.060+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.061+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:56:17.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.062+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.062+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.062+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.063+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:56:17.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.064+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.065+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.065+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.066+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:56:17.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.067+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.068+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.068+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.069+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:56:17.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.070+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.071+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.071+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.072+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:56:17.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.073+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.074+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.074+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.075+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:56:17.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.077+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.077+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.077+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.078+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:56:17.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.079+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.080+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.080+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.081+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:56:17.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.082+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.083+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.083+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.084+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:56:17.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.085+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.086+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.086+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.087+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:56:17.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.089+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.089+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.089+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.090+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:56:17.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.092+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.092+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:17.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.092+0000 7f3ddfa0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.094+0000 7f3c91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:17.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.097+0000 7f3ddfa0e800 20 remove_watcher() i=0 2024-09-12T17:56:17.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.097+0000 7f3ddfa0e800 2 removed watcher, disabling cache 2024-09-12T17:56:17.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.097+0000 7f3ddfa0e800 20 remove_watcher() i=1 2024-09-12T17:56:17.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.098+0000 7f3ddfa0e800 20 remove_watcher() i=2 2024-09-12T17:56:17.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.099+0000 7f3ddfa0e800 20 remove_watcher() i=3 2024-09-12T17:56:17.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.100+0000 7f3ddfa0e800 20 remove_watcher() i=4 2024-09-12T17:56:17.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.101+0000 7f3ddfa0e800 20 remove_watcher() i=5 2024-09-12T17:56:17.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.102+0000 7f3ddfa0e800 20 remove_watcher() i=6 2024-09-12T17:56:17.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:17.103+0000 7f3ddfa0e800 20 remove_watcher() i=7 2024-09-12T17:56:17.115 DEBUG:teuthology.orchestra.run.smithi107:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T17:56:17.597 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :clean 2024-09-12T17:56:18.393 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :compileJava 2024-09-12T17:56:18.393 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :processResources 2024-09-12T17:56:18.393 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :classes 2024-09-12T17:56:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:18.793 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :compileTestJava 2024-09-12T17:56:18.794 INFO:teuthology.orchestra.run.smithi107.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:56:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:18.794 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:56:18.794 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :testClasses 2024-09-12T17:56:18.794 INFO:teuthology.orchestra.run.smithi107.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:56:20.795 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:20.796 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :test 2024-09-12T17:56:20.796 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:20.796 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T17:56:20.796 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12 17:56:19,950 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:56:20.796 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:20.796 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T17:56:20.796 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:20.796 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T17:56:20.796 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:20.796 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T17:56:20.797 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:20.797 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T17:56:20.797 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:20.797 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T17:56:20.797 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:20.797 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T17:56:20.797 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:20.797 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T17:56:20.797 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:20.797 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T17:56:20.893 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:20.893 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T17:56:20.893 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:20.893 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T17:56:21.092 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:21.093 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T17:56:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:21.193 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T17:56:21.293 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:21.293 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T17:56:21.293 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:21.293 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T17:56:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:21.593 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T17:56:21.693 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:21.693 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T17:56:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:21.893 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T17:56:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:21.893 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T17:56:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:21.996 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------- 2024-09-12T17:56:21.996 INFO:teuthology.orchestra.run.smithi107.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T17:56:21.996 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------- 2024-09-12T17:56:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:21.996 INFO:teuthology.orchestra.run.smithi107.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:56:21.996 INFO:teuthology.orchestra.run.smithi107.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:56:21.996 INFO:teuthology.orchestra.run.smithi107.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:56:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:21.996 INFO:teuthology.orchestra.run.smithi107.stdout:BUILD SUCCESSFUL in 4s 2024-09-12T17:56:21.996 INFO:teuthology.orchestra.run.smithi107.stdout:5 actionable tasks: 5 executed 2024-09-12T17:56:22.020 DEBUG:teuthology.orchestra.run.smithi107:> radosgw-admin gc process --include-all 2024-09-12T17:56:22.073 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:22.073 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:22.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.111+0000 7f9309b19800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.113+0000 7f9309b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.113+0000 7f9309b19800 20 realm 2024-09-12T17:56:22.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.113+0000 7f9309b19800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.113+0000 7f9309b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.113+0000 7f9309b19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:22.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.113+0000 7f9309b19800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.114+0000 7f9309b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.114+0000 7f9309b19800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.115+0000 7f9309b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:22.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.115+0000 7f9309b19800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.115+0000 7f9309b19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:22.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.115+0000 7f9309b19800 20 searching for the correct realm 2024-09-12T17:56:22.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.118+0000 7f9307603640 0 -- 172.21.15.107:0/2932254001 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f930000fab0 msgr2=0x7f9300017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:22.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.122+0000 7f9307603640 0 -- 172.21.15.107:0/2932254001 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f92f003bc30 msgr2=0x7f92f003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:22.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.127+0000 7f9309b19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:22.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.127+0000 7f9309b19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:22.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.127+0000 7f9309b19800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:56:22.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.127+0000 7f9309b19800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:56:22.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.127+0000 7f9309b19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:22.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.127+0000 7f9309b19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:22.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.127+0000 7f9309b19800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.127+0000 7f9309b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.127+0000 7f9309b19800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.127+0000 7f9309b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:22.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.127+0000 7f9309b19800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.128+0000 7f9309b19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:22.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.128+0000 7f9309b19800 20 zone default found 2024-09-12T17:56:22.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.128+0000 7f9309b19800 4 Realm: () 2024-09-12T17:56:22.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.128+0000 7f9309b19800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:56:22.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.128+0000 7f9309b19800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:56:22.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.128+0000 7f9309b19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:22.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.128+0000 7f9309b19800 20 zonegroup default 2024-09-12T17:56:22.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.128+0000 7f9309b19800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.128+0000 7f9309b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.128+0000 7f9309b19800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.129+0000 7f9309b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.129+0000 7f9309b19800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.129+0000 7f9309b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.129+0000 7f9309b19800 20 started sync module instance, tier type = 2024-09-12T17:56:22.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.129+0000 7f9309b19800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:56:22.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.138+0000 7f9309b19800 20 add_watcher() i=0 2024-09-12T17:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.138+0000 7f9309b19800 20 add_watcher() i=1 2024-09-12T17:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.138+0000 7f9309b19800 20 add_watcher() i=2 2024-09-12T17:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.138+0000 7f9309b19800 20 add_watcher() i=3 2024-09-12T17:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.138+0000 7f9309b19800 20 add_watcher() i=4 2024-09-12T17:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.138+0000 7f9309b19800 20 add_watcher() i=5 2024-09-12T17:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.138+0000 7f9309b19800 20 add_watcher() i=6 2024-09-12T17:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.139+0000 7f9309b19800 20 add_watcher() i=7 2024-09-12T17:56:22.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.139+0000 7f9309b19800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:22.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.141+0000 7f91bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:22.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.141+0000 7f9309b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:22.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.141+0000 7f9309b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:22.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.178+0000 7f91bcfe1640 20 reqs_thread_entry: start 2024-09-12T17:56:22.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.178+0000 7f9309b19800 20 init_complete bucket index max shards: 1 2024-09-12T17:56:22.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.178+0000 7f9309b19800 20 Filter name: none 2024-09-12T17:56:22.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.178+0000 7f91367fc640 20 reqs_thread_entry: start 2024-09-12T17:56:22.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.179+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:56:22.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.180+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.180+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.181+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.182+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:56:22.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.183+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.184+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.184+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.185+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:56:22.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.187+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.188+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.188+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.189+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:56:22.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.190+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.191+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.191+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.192+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:56:22.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.194+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.194+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.194+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.195+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:56:22.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.197+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.197+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.197+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.198+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:56:22.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.200+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.201+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.201+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.202+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:56:22.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.203+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.204+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.204+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.205+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:56:22.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.206+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.207+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.207+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.208+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:56:22.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.209+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.210+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.210+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.211+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:56:22.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.212+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.212+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.213+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.214+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:56:22.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.216+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.216+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.216+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.218+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:56:22.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.219+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.219+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.220+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.220+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:56:22.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.222+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.222+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.223+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.224+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:56:22.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.225+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.226+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.226+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.227+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:56:22.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.228+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.229+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.229+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.230+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:56:22.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.232+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.232+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.233+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.233+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:56:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.235+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.235+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.236+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.237+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:56:22.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.238+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.238+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.239+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.240+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:56:22.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.241+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.242+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.242+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.243+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:56:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.244+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.244+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.245+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.246+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:56:22.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.247+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.247+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.247+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.248+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:56:22.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.250+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.250+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.251+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.252+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:56:22.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.253+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.253+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.254+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.255+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:56:22.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.256+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.256+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.257+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.258+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:56:22.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.260+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.260+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.260+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.262+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:56:22.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.263+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.264+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.264+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.265+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:56:22.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.266+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.267+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.267+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.268+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:56:22.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.269+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.270+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.270+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.271+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:56:22.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.273+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.273+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.273+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.274+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:56:22.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.276+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.276+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.276+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.277+0000 7f9309b19800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:56:22.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.279+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.279+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.279+0000 7f9309b19800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.281+0000 7f91bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:22.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.283+0000 7f9309b19800 20 remove_watcher() i=0 2024-09-12T17:56:22.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.283+0000 7f9309b19800 2 removed watcher, disabling cache 2024-09-12T17:56:22.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.284+0000 7f9309b19800 20 remove_watcher() i=1 2024-09-12T17:56:22.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.285+0000 7f9309b19800 20 remove_watcher() i=2 2024-09-12T17:56:22.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.286+0000 7f9309b19800 20 remove_watcher() i=3 2024-09-12T17:56:22.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.287+0000 7f9309b19800 20 remove_watcher() i=4 2024-09-12T17:56:22.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.288+0000 7f9309b19800 20 remove_watcher() i=5 2024-09-12T17:56:22.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.289+0000 7f9309b19800 20 remove_watcher() i=6 2024-09-12T17:56:22.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.290+0000 7f9309b19800 20 remove_watcher() i=7 2024-09-12T17:56:22.302 DEBUG:teuthology.orchestra.run.smithi107:> radosgw-admin gc process --include-all 2024-09-12T17:56:22.353 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:22.354 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:22.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.389+0000 7fc6c9b2c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.390+0000 7fc6c9b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.390+0000 7fc6c9b2c800 20 realm 2024-09-12T17:56:22.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.390+0000 7fc6c9b2c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.390+0000 7fc6c9b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.390+0000 7fc6c9b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:22.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.390+0000 7fc6c9b2c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.390+0000 7fc6c9b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.390+0000 7fc6c9b2c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.391+0000 7fc6c9b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:22.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.391+0000 7fc6c9b2c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.392+0000 7fc6c9b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:22.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.392+0000 7fc6c9b2c800 20 searching for the correct realm 2024-09-12T17:56:22.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.394+0000 7fc6bffff640 0 -- 172.21.15.107:0/1883390742 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fc6b007e040 msgr2=0x7fc6b0056470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:22.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.398+0000 7fc6c5745640 0 -- 172.21.15.107:0/1883390742 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc6b008f400 msgr2=0x7fc6b008f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:22.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.606+0000 7fc6c9b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:22.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.606+0000 7fc6c9b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:22.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.606+0000 7fc6c9b2c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:56:22.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.606+0000 7fc6c9b2c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:56:22.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.606+0000 7fc6c9b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:22.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.606+0000 7fc6c9b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:22.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.606+0000 7fc6c9b2c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.606+0000 7fc6c9b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.606+0000 7fc6c9b2c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.607+0000 7fc6c9b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:22.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.607+0000 7fc6c9b2c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.607+0000 7fc6c9b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:22.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.607+0000 7fc6c9b2c800 20 zone default found 2024-09-12T17:56:22.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.607+0000 7fc6c9b2c800 4 Realm: () 2024-09-12T17:56:22.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.607+0000 7fc6c9b2c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:56:22.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.607+0000 7fc6c9b2c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:56:22.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.607+0000 7fc6c9b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:22.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.607+0000 7fc6c9b2c800 20 zonegroup default 2024-09-12T17:56:22.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.607+0000 7fc6c9b2c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.607+0000 7fc6c9b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.607+0000 7fc6c9b2c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.608+0000 7fc6c9b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.608+0000 7fc6c9b2c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.608+0000 7fc6c9b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.608+0000 7fc6c9b2c800 20 started sync module instance, tier type = 2024-09-12T17:56:22.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.608+0000 7fc6c9b2c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:56:22.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.616+0000 7fc6c9b2c800 20 add_watcher() i=0 2024-09-12T17:56:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.616+0000 7fc6c9b2c800 20 add_watcher() i=1 2024-09-12T17:56:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.616+0000 7fc6c9b2c800 20 add_watcher() i=2 2024-09-12T17:56:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.616+0000 7fc6c9b2c800 20 add_watcher() i=3 2024-09-12T17:56:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.616+0000 7fc6c9b2c800 20 add_watcher() i=4 2024-09-12T17:56:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.616+0000 7fc6c9b2c800 20 add_watcher() i=5 2024-09-12T17:56:22.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.616+0000 7fc6c9b2c800 20 add_watcher() i=6 2024-09-12T17:56:22.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.617+0000 7fc6c9b2c800 20 add_watcher() i=7 2024-09-12T17:56:22.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.617+0000 7fc6c9b2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:22.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.619+0000 7fc57bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:22.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.619+0000 7fc6c9b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:22.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.619+0000 7fc6c9b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:22.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.652+0000 7fc57afe5640 20 reqs_thread_entry: start 2024-09-12T17:56:22.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.652+0000 7fc6c9b2c800 20 init_complete bucket index max shards: 1 2024-09-12T17:56:22.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.652+0000 7fc6c9b2c800 20 Filter name: none 2024-09-12T17:56:22.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.652+0000 7fc578fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:22.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.652+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:56:22.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.654+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.654+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.655+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.656+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:56:22.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.657+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.657+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.657+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.658+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:56:22.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.660+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.660+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.660+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.661+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:56:22.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.663+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.663+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.663+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.664+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:56:22.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.665+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.666+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.666+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.667+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:56:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.668+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.669+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.669+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.670+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:56:22.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.671+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.671+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.671+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.672+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:56:22.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.674+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.674+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.674+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.675+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:56:22.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.676+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.677+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.677+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.678+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:56:22.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.679+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.680+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.680+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.681+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:56:22.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.682+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.683+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.683+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.684+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:56:22.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.685+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.686+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.686+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.687+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:56:22.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.688+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.688+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.689+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.690+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:56:22.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.691+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.692+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.692+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.693+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:56:22.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.694+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.694+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.695+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.695+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:56:22.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.697+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.698+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.698+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.699+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:56:22.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.700+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.701+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.701+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.702+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:56:22.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.703+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.704+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.704+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.705+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:56:22.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.706+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.707+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.707+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.708+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:56:22.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.710+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.710+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.711+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.712+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:56:22.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.713+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.713+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.713+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.714+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:56:22.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.715+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.716+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.716+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.717+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:56:22.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.718+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.719+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.719+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.720+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:56:22.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.721+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.721+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.722+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.722+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:56:22.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.724+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.725+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.725+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.726+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:56:22.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.727+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.728+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.728+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.729+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:56:22.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.730+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.731+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.731+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.732+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:56:22.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.733+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.733+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.734+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.735+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:56:22.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.736+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.736+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.737+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.738+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:56:22.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.739+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.739+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.740+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.741+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:56:22.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.742+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.743+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.743+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.744+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:56:22.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.745+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.746+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:22.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.746+0000 7fc6c9b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:22.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.747+0000 7fc57bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:22.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.749+0000 7fc6c9b2c800 20 remove_watcher() i=0 2024-09-12T17:56:22.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.749+0000 7fc6c9b2c800 2 removed watcher, disabling cache 2024-09-12T17:56:22.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.751+0000 7fc6c9b2c800 20 remove_watcher() i=1 2024-09-12T17:56:22.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.752+0000 7fc6c9b2c800 20 remove_watcher() i=2 2024-09-12T17:56:22.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.753+0000 7fc6c9b2c800 20 remove_watcher() i=3 2024-09-12T17:56:22.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.754+0000 7fc6c9b2c800 20 remove_watcher() i=4 2024-09-12T17:56:22.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.755+0000 7fc6c9b2c800 20 remove_watcher() i=5 2024-09-12T17:56:22.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.756+0000 7fc6c9b2c800 20 remove_watcher() i=6 2024-09-12T17:56:22.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.757+0000 7fc6c9b2c800 20 remove_watcher() i=7 2024-09-12T17:56:22.769 DEBUG:teuthology.orchestra.run.smithi107:> radosgw-admin gc process --include-all 2024-09-12T17:56:22.821 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:22.821 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:22.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.857+0000 7fa9f7611800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.859+0000 7fa9f7611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.859+0000 7fa9f7611800 20 realm 2024-09-12T17:56:22.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.859+0000 7fa9f7611800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.859+0000 7fa9f7611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.859+0000 7fa9f7611800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:22.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.859+0000 7fa9f7611800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.859+0000 7fa9f7611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:22.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.859+0000 7fa9f7611800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.860+0000 7fa9f7611800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:22.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.860+0000 7fa9f7611800 20 rados->read ofs=0 len=0 2024-09-12T17:56:22.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.861+0000 7fa9f7611800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:22.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.861+0000 7fa9f7611800 20 searching for the correct realm 2024-09-12T17:56:22.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:22.862+0000 7fa9f2d48640 0 -- 172.21.15.107:0/107082854 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fa9ec083020 msgr2=0x7fa9ec0e30b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:23.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.068+0000 7fa9f2d48640 0 -- 172.21.15.107:0/107082854 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fa9ec083020 msgr2=0x7fa9ec0e30b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:23.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:23.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:23.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:56:23.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:56:23.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:23.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:23.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:23.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:23.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:23.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 zone default found 2024-09-12T17:56:23.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 4 Realm: () 2024-09-12T17:56:23.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:56:23.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:56:23.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:23.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 zonegroup default 2024-09-12T17:56:23.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.074+0000 7fa9f7611800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.075+0000 7fa9f7611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:23.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.075+0000 7fa9f7611800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.075+0000 7fa9f7611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:23.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.075+0000 7fa9f7611800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.075+0000 7fa9f7611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:23.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.075+0000 7fa9f7611800 20 started sync module instance, tier type = 2024-09-12T17:56:23.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.075+0000 7fa9f7611800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:56:23.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.084+0000 7fa9f7611800 20 add_watcher() i=0 2024-09-12T17:56:23.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.084+0000 7fa9f7611800 20 add_watcher() i=1 2024-09-12T17:56:23.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.084+0000 7fa9f7611800 20 add_watcher() i=2 2024-09-12T17:56:23.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.084+0000 7fa9f7611800 20 add_watcher() i=3 2024-09-12T17:56:23.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.084+0000 7fa9f7611800 20 add_watcher() i=4 2024-09-12T17:56:23.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.084+0000 7fa9f7611800 20 add_watcher() i=5 2024-09-12T17:56:23.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.084+0000 7fa9f7611800 20 add_watcher() i=6 2024-09-12T17:56:23.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.084+0000 7fa9f7611800 20 add_watcher() i=7 2024-09-12T17:56:23.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.084+0000 7fa9f7611800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:23.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.086+0000 7fa8a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:23.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.087+0000 7fa9f7611800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:23.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.087+0000 7fa9f7611800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:23.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.120+0000 7fa823fff640 20 reqs_thread_entry: start 2024-09-12T17:56:23.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.120+0000 7fa9f7611800 20 init_complete bucket index max shards: 1 2024-09-12T17:56:23.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.120+0000 7fa9f7611800 20 Filter name: none 2024-09-12T17:56:23.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.120+0000 7fa821ffb640 20 reqs_thread_entry: start 2024-09-12T17:56:23.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.120+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:56:23.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.122+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.122+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.122+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.123+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:56:23.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.124+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.125+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.125+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.126+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:56:23.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.127+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.127+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.128+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.128+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:56:23.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.130+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.130+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.130+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.131+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:56:23.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.132+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.133+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.133+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.134+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:56:23.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.135+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.136+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.136+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.137+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:56:23.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.138+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.138+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.138+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.139+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:56:23.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.141+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.141+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.142+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.143+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:56:23.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.144+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.145+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.145+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.146+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:56:23.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.147+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.147+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.148+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.149+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:56:23.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.150+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.150+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.150+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.151+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:56:23.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.152+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.153+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.153+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.154+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:56:23.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.156+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.156+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.157+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.158+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:56:23.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.159+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.159+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.159+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.160+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:56:23.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.162+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.162+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.163+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.163+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:56:23.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.165+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.165+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.166+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.167+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:56:23.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.168+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.168+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.169+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.169+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:56:23.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.171+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.171+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.172+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.173+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:56:23.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.174+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.174+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.175+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.176+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:56:23.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.177+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.177+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.178+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.179+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:56:23.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.180+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.180+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.181+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.182+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:56:23.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.183+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.183+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.184+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.185+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:56:23.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.186+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.187+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.187+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.188+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:56:23.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.189+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.190+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.190+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.191+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:56:23.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.192+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.192+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.193+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.193+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:56:23.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.194+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.195+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.195+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.196+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:56:23.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.197+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.197+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.198+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.199+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:56:23.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.201+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.201+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.201+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.202+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:56:23.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.203+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.204+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.204+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.205+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:56:23.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.206+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.206+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.207+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.208+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:56:23.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.209+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.209+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.209+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.210+0000 7fa9f7611800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:56:23.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.212+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.212+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.213+0000 7fa9f7611800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.214+0000 7fa8a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:23.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.217+0000 7fa9f7611800 20 remove_watcher() i=0 2024-09-12T17:56:23.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.217+0000 7fa9f7611800 2 removed watcher, disabling cache 2024-09-12T17:56:23.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.218+0000 7fa9f7611800 20 remove_watcher() i=1 2024-09-12T17:56:23.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.219+0000 7fa9f7611800 20 remove_watcher() i=2 2024-09-12T17:56:23.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.220+0000 7fa9f7611800 20 remove_watcher() i=3 2024-09-12T17:56:23.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.221+0000 7fa9f7611800 20 remove_watcher() i=4 2024-09-12T17:56:23.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.222+0000 7fa9f7611800 20 remove_watcher() i=5 2024-09-12T17:56:23.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.223+0000 7fa9f7611800 20 remove_watcher() i=6 2024-09-12T17:56:23.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.224+0000 7fa9f7611800 20 remove_watcher() i=7 2024-09-12T17:56:23.237 DEBUG:teuthology.orchestra.run.smithi107:> radosgw-admin gc process --include-all 2024-09-12T17:56:23.289 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:23.289 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:23.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.324+0000 7f993f720800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.326+0000 7f993f720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:23.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.326+0000 7f993f720800 20 realm 2024-09-12T17:56:23.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.326+0000 7f993f720800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.326+0000 7f993f720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:23.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.326+0000 7f993f720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:23.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.326+0000 7f993f720800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.326+0000 7f993f720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:23.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.326+0000 7f993f720800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.327+0000 7f993f720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:23.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.327+0000 7f993f720800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.328+0000 7f993f720800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:23.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.328+0000 7f993f720800 20 searching for the correct realm 2024-09-12T17:56:23.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.331+0000 7f993b302640 0 -- 172.21.15.107:0/1095702090 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f993407f640 msgr2=0x7f9934010750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:23.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.334+0000 7f993b302640 0 -- 172.21.15.107:0/1095702090 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f992404e930 msgr2=0x7f992400d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:23.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.540+0000 7f993f720800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:23.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.540+0000 7f993f720800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:23.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.540+0000 7f993f720800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:56:23.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.540+0000 7f993f720800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:56:23.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.540+0000 7f993f720800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:23.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.540+0000 7f993f720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:23.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.540+0000 7f993f720800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.540+0000 7f993f720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:23.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.540+0000 7f993f720800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.540+0000 7f993f720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:23.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.540+0000 7f993f720800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.541+0000 7f993f720800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:23.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.541+0000 7f993f720800 20 zone default found 2024-09-12T17:56:23.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.541+0000 7f993f720800 4 Realm: () 2024-09-12T17:56:23.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.541+0000 7f993f720800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:56:23.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.541+0000 7f993f720800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:56:23.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.541+0000 7f993f720800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.541+0000 7f993f720800 20 zonegroup default 2024-09-12T17:56:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.541+0000 7f993f720800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.541+0000 7f993f720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.541+0000 7f993f720800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.541+0000 7f993f720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.541+0000 7f993f720800 20 rados->read ofs=0 len=0 2024-09-12T17:56:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.542+0000 7f993f720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.542+0000 7f993f720800 20 started sync module instance, tier type = 2024-09-12T17:56:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.542+0000 7f993f720800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:56:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.551+0000 7f993f720800 20 add_watcher() i=0 2024-09-12T17:56:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.551+0000 7f993f720800 20 add_watcher() i=1 2024-09-12T17:56:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.551+0000 7f993f720800 20 add_watcher() i=2 2024-09-12T17:56:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.551+0000 7f993f720800 20 add_watcher() i=3 2024-09-12T17:56:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.551+0000 7f993f720800 20 add_watcher() i=4 2024-09-12T17:56:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.551+0000 7f993f720800 20 add_watcher() i=5 2024-09-12T17:56:23.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.551+0000 7f993f720800 20 add_watcher() i=6 2024-09-12T17:56:23.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.552+0000 7f993f720800 20 add_watcher() i=7 2024-09-12T17:56:23.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.552+0000 7f993f720800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:23.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.554+0000 7f97f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:23.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.554+0000 7f993f720800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:23.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.554+0000 7f993f720800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:23.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.588+0000 7f97f0fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:23.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.588+0000 7f993f720800 20 init_complete bucket index max shards: 1 2024-09-12T17:56:23.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.588+0000 7f993f720800 20 Filter name: none 2024-09-12T17:56:23.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.588+0000 7f976a7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:23.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.588+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:56:23.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.590+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.590+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.590+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.592+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:56:23.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.593+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.594+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.594+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.596+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:56:23.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.597+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.598+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.598+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.599+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:56:23.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.600+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.601+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.601+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.602+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:56:23.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.603+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.604+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.604+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.605+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:56:23.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.606+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.607+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.607+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.608+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:56:23.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.609+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.610+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.610+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.611+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:56:23.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.612+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.613+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.613+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.614+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:56:23.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.615+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.615+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.616+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.617+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:56:23.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.618+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.618+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.618+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.619+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:56:23.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.621+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.621+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.621+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.623+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:56:23.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.624+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.624+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.625+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.625+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:56:23.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.627+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.627+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.627+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.628+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:56:23.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.630+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.630+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.630+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.632+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:56:23.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.633+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.633+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.633+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.634+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:56:23.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.636+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.636+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.636+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.637+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:56:23.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.638+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.639+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.639+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.640+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:56:23.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.641+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.642+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.642+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.643+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:56:23.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.644+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.645+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.645+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.646+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:56:23.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.647+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.647+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.648+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.648+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:56:23.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.650+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.650+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.652 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.651+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.652+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:56:23.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.653+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.653+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.654+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.654+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:56:23.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.656+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.656+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.656+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.658+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:56:23.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.659+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.659+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.660+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.661+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:56:23.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.662+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.662+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.663+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.663+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:56:23.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.665+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.665+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.665+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.667+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:56:23.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.668+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.668+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.668+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.669+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:56:23.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.671+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.671+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.671+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.672+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:56:23.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.674+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.674+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.675+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.676+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:56:23.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.678+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.678+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.678+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.679+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:56:23.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.681+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.681+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.682+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.683+0000 7f993f720800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:56:23.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.684+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.684+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:23.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.685+0000 7f993f720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:23.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.686+0000 7f97f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:23.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.688+0000 7f993f720800 20 remove_watcher() i=0 2024-09-12T17:56:23.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.688+0000 7f993f720800 2 removed watcher, disabling cache 2024-09-12T17:56:23.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.689+0000 7f993f720800 20 remove_watcher() i=1 2024-09-12T17:56:23.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.690+0000 7f993f720800 20 remove_watcher() i=2 2024-09-12T17:56:23.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.691+0000 7f993f720800 20 remove_watcher() i=3 2024-09-12T17:56:23.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.692+0000 7f993f720800 20 remove_watcher() i=4 2024-09-12T17:56:23.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.693+0000 7f993f720800 20 remove_watcher() i=5 2024-09-12T17:56:23.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.694+0000 7f993f720800 20 remove_watcher() i=6 2024-09-12T17:56:23.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:23.695+0000 7f993f720800 20 remove_watcher() i=7 2024-09-12T17:56:23.707 DEBUG:teuthology.orchestra.run.smithi107:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T17:56:24.331 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :clean 2024-09-12T17:56:24.929 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :compileJava 2024-09-12T17:56:24.929 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :processResources 2024-09-12T17:56:24.929 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :classes 2024-09-12T17:56:25.429 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:25.429 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :compileTestJava 2024-09-12T17:56:25.430 INFO:teuthology.orchestra.run.smithi107.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:56:25.430 INFO:teuthology.orchestra.run.smithi107.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:56:25.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:25.431 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:56:25.431 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :testClasses 2024-09-12T17:56:27.430 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:27.430 INFO:teuthology.orchestra.run.smithi107.stdout:> Task :test 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests STANDARD_OUT 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12 17:56:26,666 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:27.431 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T17:56:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:27.529 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T17:56:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:27.628 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T17:56:28.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:28.528 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T17:56:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:28.728 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T17:56:28.828 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:28.829 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T17:56:29.029 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:29.029 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T17:56:29.029 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:29.029 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T17:56:29.228 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:29.228 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T17:56:29.329 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:29.329 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T17:56:29.329 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:29.329 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T17:56:29.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:29.428 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T17:56:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:29.528 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T17:56:29.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:29.729 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T17:56:29.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:29.929 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T17:56:29.929 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:29.929 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T17:56:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:30.129 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T17:56:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:30.129 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T17:56:30.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:30.328 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T17:56:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:30.429 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T17:56:30.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:30.528 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T17:56:30.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:30.629 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T17:56:30.829 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:30.829 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T17:56:30.829 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:30.829 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T17:56:31.028 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:31.028 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T17:56:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:31.129 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T17:56:31.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:31.328 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T17:56:31.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:31.428 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T17:56:31.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:31.628 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T17:56:31.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:31.928 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T17:56:32.228 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:32.228 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T17:56:36.729 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:36.729 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T17:56:37.028 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:37.028 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T17:56:37.029 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:37.029 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T17:56:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:37.229 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T17:56:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:37.229 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T17:56:37.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:37.528 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T17:56:37.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:37.928 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T17:56:38.128 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:38.128 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T17:56:38.228 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:38.229 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T17:56:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:38.328 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T17:56:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:39.128 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T17:56:39.228 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:39.228 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:56:39.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:39.728 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:56:39.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:39.928 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T17:56:40.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:40.328 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T17:56:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:40.428 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T17:56:42.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:42.428 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T17:56:42.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:42.628 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T17:56:43.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:43.428 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T17:56:43.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:43.629 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T17:56:44.028 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:44.032 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T17:56:44.128 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:44.128 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T17:56:44.629 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:44.629 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T17:56:44.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:44.929 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T17:56:44.929 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:44.929 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T17:56:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:45.028 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T17:56:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:45.029 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T17:56:45.228 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:45.228 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T17:56:45.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:45.328 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T17:56:45.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:45.529 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T17:56:45.529 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:45.529 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T17:56:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:45.728 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T17:56:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:45.728 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T17:56:45.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:45.928 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T17:56:46.028 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:46.028 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T17:56:46.228 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:46.229 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T17:56:46.229 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:46.229 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T17:56:46.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:46.428 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T17:56:46.429 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:46.429 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T17:56:46.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:46.628 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T17:56:46.729 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:46.729 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T17:56:46.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:46.928 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T17:56:47.028 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:47.028 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T17:56:47.228 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:47.228 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T17:56:47.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:47.328 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T17:56:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:47.528 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T17:56:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:47.529 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T17:56:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:47.728 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T17:56:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:47.828 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T17:56:48.028 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:48.028 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T17:56:48.128 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:48.128 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T17:56:48.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:48.328 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T17:56:48.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:48.329 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T17:56:48.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:48.528 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T17:56:48.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:48.628 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T17:56:48.828 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:48.828 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T17:56:48.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:48.928 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T17:56:49.128 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:49.128 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T17:56:49.129 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:49.129 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T17:56:49.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:49.328 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T17:56:49.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:49.428 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T17:56:49.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:49.628 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T17:56:49.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:49.729 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T17:56:49.828 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:49.829 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T17:56:49.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:49.929 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T17:56:50.129 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:50.129 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T17:56:50.228 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:50.229 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T17:56:50.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:50.428 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T17:56:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:50.529 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T17:56:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:50.729 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T17:56:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:50.729 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T17:56:50.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:50.929 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T17:56:51.029 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:51.029 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T17:56:51.429 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:51.429 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T17:56:51.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:51.528 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T17:56:51.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:51.728 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T17:56:51.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:51.728 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T17:56:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:51.928 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T17:56:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:52.028 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T17:56:52.228 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:52.228 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T17:56:52.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:52.328 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T17:56:52.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:52.428 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T17:56:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:52.528 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T17:56:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:52.729 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T17:56:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:52.729 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T17:56:52.928 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:52.928 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T17:56:52.929 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:52.929 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T17:56:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:53.128 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T17:56:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:53.129 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T17:56:53.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:53.328 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T17:56:53.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:53.428 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T17:56:53.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T17:56:53.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:53.628 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T17:56:53.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:53.728 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T17:56:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:53.828 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T17:56:54.028 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:54.029 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T17:56:54.029 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:54.029 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T17:56:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:54.228 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T17:56:54.328 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:54.328 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T17:56:54.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:54.529 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T17:56:54.529 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:54.529 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T17:56:54.728 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:54.728 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T17:56:55.029 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:55.029 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T17:56:55.228 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:55.228 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T17:56:55.528 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:55.528 INFO:teuthology.orchestra.run.smithi107.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T17:56:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:55.717 INFO:teuthology.orchestra.run.smithi107.stdout:---------------------------------------------------------------------- 2024-09-12T17:56:55.717 INFO:teuthology.orchestra.run.smithi107.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T17:56:55.718 INFO:teuthology.orchestra.run.smithi107.stdout:---------------------------------------------------------------------- 2024-09-12T17:56:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:55.718 INFO:teuthology.orchestra.run.smithi107.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:56:55.718 INFO:teuthology.orchestra.run.smithi107.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:56:55.718 INFO:teuthology.orchestra.run.smithi107.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:56:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:55.718 INFO:teuthology.orchestra.run.smithi107.stdout:BUILD SUCCESSFUL in 31s 2024-09-12T17:56:55.718 INFO:teuthology.orchestra.run.smithi107.stdout:5 actionable tasks: 5 executed 2024-09-12T17:56:55.732 DEBUG:teuthology.orchestra.run.smithi107:> radosgw-admin gc process --include-all 2024-09-12T17:56:55.786 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:55.787 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:55.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.822+0000 7fad2d8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:56:55.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.823+0000 7fad2d8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:55.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.823+0000 7fad2d8bb800 20 realm 2024-09-12T17:56:55.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.823+0000 7fad2d8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:56:55.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.823+0000 7fad2d8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:55.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.823+0000 7fad2d8bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:55.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.823+0000 7fad2d8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:56:55.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.823+0000 7fad2d8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:55.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.823+0000 7fad2d8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:56:55.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.824+0000 7fad2d8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:55.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.824+0000 7fad2d8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:56:55.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.825+0000 7fad2d8bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:55.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.825+0000 7fad2d8bb800 20 searching for the correct realm 2024-09-12T17:56:55.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:55.827+0000 7fad22bab640 0 -- 172.21.15.107:0/1881581389 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fad14098350 msgr2=0x7fad140617e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:56.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.034+0000 7fad2b3ac640 0 -- 172.21.15.107:0/1881581389 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fad140489f0 msgr2=0x7fad14090050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:56.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.241+0000 7fad2d8bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:56.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.241+0000 7fad2d8bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:56.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.241+0000 7fad2d8bb800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:56:56.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.241+0000 7fad2d8bb800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:56:56.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.241+0000 7fad2d8bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:56.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.241+0000 7fad2d8bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:56.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.241+0000 7fad2d8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:56:56.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.241+0000 7fad2d8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:56.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.241+0000 7fad2d8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:56:56.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.241+0000 7fad2d8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:56.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.241+0000 7fad2d8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:56:56.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.242+0000 7fad2d8bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.242+0000 7fad2d8bb800 20 zone default found 2024-09-12T17:56:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.242+0000 7fad2d8bb800 4 Realm: () 2024-09-12T17:56:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.242+0000 7fad2d8bb800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:56:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.242+0000 7fad2d8bb800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:56:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.242+0000 7fad2d8bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.242+0000 7fad2d8bb800 20 zonegroup default 2024-09-12T17:56:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.242+0000 7fad2d8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:56:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.242+0000 7fad2d8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.242+0000 7fad2d8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:56:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.242+0000 7fad2d8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.242+0000 7fad2d8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:56:56.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.243+0000 7fad2d8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:56.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.243+0000 7fad2d8bb800 20 started sync module instance, tier type = 2024-09-12T17:56:56.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.243+0000 7fad2d8bb800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:56:56.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.252+0000 7fad2d8bb800 20 add_watcher() i=0 2024-09-12T17:56:56.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.252+0000 7fad2d8bb800 20 add_watcher() i=1 2024-09-12T17:56:56.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.252+0000 7fad2d8bb800 20 add_watcher() i=2 2024-09-12T17:56:56.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.252+0000 7fad2d8bb800 20 add_watcher() i=3 2024-09-12T17:56:56.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.252+0000 7fad2d8bb800 20 add_watcher() i=4 2024-09-12T17:56:56.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.252+0000 7fad2d8bb800 20 add_watcher() i=5 2024-09-12T17:56:56.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.252+0000 7fad2d8bb800 20 add_watcher() i=6 2024-09-12T17:56:56.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.253+0000 7fad2d8bb800 20 add_watcher() i=7 2024-09-12T17:56:56.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.253+0000 7fad2d8bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:56.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.255+0000 7fabe27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:56.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.255+0000 7fad2d8bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:56.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.255+0000 7fad2d8bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:56.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.291+0000 7fabe17e2640 20 reqs_thread_entry: start 2024-09-12T17:56:56.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.291+0000 7fad2d8bb800 20 init_complete bucket index max shards: 1 2024-09-12T17:56:56.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.292+0000 7fad2d8bb800 20 Filter name: none 2024-09-12T17:56:56.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.292+0000 7fabda7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:56.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.292+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:56:56.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.293+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:56:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.10200644680273510856', time=2024-09-12T19:56:31.983166+0000, chain.objs.size()=5 2024-09-12T17:56:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.92__multipart_key1.2~F2QzPs-Ggr1DCysWmxZfCFFQMr_SJdn.1 2024-09-12T17:56:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.92__multipart_key1.2~F2QzPs-Ggr1DCysWmxZfCFFQMr_SJdn.2 2024-09-12T17:56:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.92__multipart_key1.2~F2QzPs-Ggr1DCysWmxZfCFFQMr_SJdn.3 2024-09-12T17:56:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.92__multipart_key1.2~F2QzPs-Ggr1DCysWmxZfCFFQMr_SJdn.4 2024-09-12T17:56:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.92__multipart_key1.2~F2QzPs-Ggr1DCysWmxZfCFFQMr_SJdn.5 2024-09-12T17:56:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6285690423184353072', time=2024-09-12T19:56:36.728460+0000, chain.objs.size()=4 2024-09-12T17:56:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.94__shadow_.IWZWoD_3AGIjCu0fmv8uiNR8yYHcus7_1 2024-09-12T17:56:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.94__shadow_.IWZWoD_3AGIjCu0fmv8uiNR8yYHcus7_2 2024-09-12T17:56:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.94__shadow_.IWZWoD_3AGIjCu0fmv8uiNR8yYHcus7_3 2024-09-12T17:56:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.294+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.94__shadow_.IWZWoD_3AGIjCu0fmv8uiNR8yYHcus7_4 2024-09-12T17:56:56.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.298+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.301+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:56:56.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.303+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.303+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.304+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.306+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:56:56.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.306+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:56:56.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.9885512036989219996', time=2024-09-12T19:56:39.101529+0000, chain.objs.size()=5 2024-09-12T17:56:56.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.100__multipart_key1.2~eUmCYb3OVPLkb0yXVOiVJBuA-zHpQXC.1 2024-09-12T17:56:56.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.100__multipart_key1.2~eUmCYb3OVPLkb0yXVOiVJBuA-zHpQXC.2 2024-09-12T17:56:56.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.100__multipart_key1.2~eUmCYb3OVPLkb0yXVOiVJBuA-zHpQXC.3 2024-09-12T17:56:56.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.100__multipart_key1.2~eUmCYb3OVPLkb0yXVOiVJBuA-zHpQXC.4 2024-09-12T17:56:56.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.100__multipart_key1.2~eUmCYb3OVPLkb0yXVOiVJBuA-zHpQXC.5 2024-09-12T17:56:56.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.106725704419568454', time=2024-09-12T19:56:55.059646+0000, chain.objs.size()=5 2024-09-12T17:56:56.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.144__multipart_key1.2~kRigz1FxI6f6y_H-DmB6spg1vCZ-HD6.1 2024-09-12T17:56:56.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.144__multipart_key1.2~kRigz1FxI6f6y_H-DmB6spg1vCZ-HD6.2 2024-09-12T17:56:56.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.144__multipart_key1.2~kRigz1FxI6f6y_H-DmB6spg1vCZ-HD6.3 2024-09-12T17:56:56.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.144__multipart_key1.2~kRigz1FxI6f6y_H-DmB6spg1vCZ-HD6.4 2024-09-12T17:56:56.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.307+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.144__multipart_key1.2~kRigz1FxI6f6y_H-DmB6spg1vCZ-HD6.5 2024-09-12T17:56:56.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.312+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.315+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:56:56.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.316+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.317+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.317+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.318+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:56:56.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.319+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.320+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.320+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.321+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:56:56.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.322+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:56:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.10139697801363467784', time=2024-09-12T19:56:36.590625+0000, chain.objs.size()=5 2024-09-12T17:56:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~xuKeqBsScXWjUc5JfCSWnwdL3zQ4nB9.1 2024-09-12T17:56:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__shadow_key1.2~xuKeqBsScXWjUc5JfCSWnwdL3zQ4nB9.1_1 2024-09-12T17:56:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~xuKeqBsScXWjUc5JfCSWnwdL3zQ4nB9.2 2024-09-12T17:56:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__shadow_key1.2~xuKeqBsScXWjUc5JfCSWnwdL3zQ4nB9.2_1 2024-09-12T17:56:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~xuKeqBsScXWjUc5JfCSWnwdL3zQ4nB9.3 2024-09-12T17:56:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6702459798261927171', time=2024-09-12T19:56:36.834015+0000, chain.objs.size()=5 2024-09-12T17:56:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~RGripGJ2ukPTCGTha8ea-_I54CKUjVI.1 2024-09-12T17:56:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__shadow_key1.2~RGripGJ2ukPTCGTha8ea-_I54CKUjVI.1_1 2024-09-12T17:56:56.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~RGripGJ2ukPTCGTha8ea-_I54CKUjVI.2 2024-09-12T17:56:56.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__shadow_key1.2~RGripGJ2ukPTCGTha8ea-_I54CKUjVI.2_1 2024-09-12T17:56:56.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.323+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~RGripGJ2ukPTCGTha8ea-_I54CKUjVI.3 2024-09-12T17:56:56.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.328+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.330+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:56:56.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.331+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.332+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.332+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:56.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.332+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.1167531646516535385', time=2024-09-12T19:56:36.127505+0000, chain.objs.size()=5 2024-09-12T17:56:56.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.332+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~cRBWQ7vcV8oCul-zIVd16CN4EiWEHPc.1 2024-09-12T17:56:56.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.332+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__shadow_key1.2~cRBWQ7vcV8oCul-zIVd16CN4EiWEHPc.1_1 2024-09-12T17:56:56.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.332+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~cRBWQ7vcV8oCul-zIVd16CN4EiWEHPc.2 2024-09-12T17:56:56.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.332+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__shadow_key1.2~cRBWQ7vcV8oCul-zIVd16CN4EiWEHPc.2_1 2024-09-12T17:56:56.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.332+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~cRBWQ7vcV8oCul-zIVd16CN4EiWEHPc.3 2024-09-12T17:56:56.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.335+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.337+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:56:56.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.338+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.339+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.339+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:56.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.339+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.4648320866465068673', time=2024-09-12T19:56:35.671265+0000, chain.objs.size()=5 2024-09-12T17:56:56.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.339+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~BFYv46SJUDK8nL5e6gV4F1qXr1nwIdS.1 2024-09-12T17:56:56.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.339+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~BFYv46SJUDK8nL5e6gV4F1qXr1nwIdS.2 2024-09-12T17:56:56.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.339+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~BFYv46SJUDK8nL5e6gV4F1qXr1nwIdS.3 2024-09-12T17:56:56.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.339+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~BFYv46SJUDK8nL5e6gV4F1qXr1nwIdS.4 2024-09-12T17:56:56.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.339+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~BFYv46SJUDK8nL5e6gV4F1qXr1nwIdS.5 2024-09-12T17:56:56.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.343+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.345+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:56:56.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.346+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:56:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.11147220922150040842', time=2024-09-12T19:56:39.772673+0000, chain.objs.size()=5 2024-09-12T17:56:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.101__multipart_file2.mpg.2~_YPFytamI50xv2MS6nUEkyzfJJ1NeS7.1 2024-09-12T17:56:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.101__multipart_file2.mpg.2~_YPFytamI50xv2MS6nUEkyzfJJ1NeS7.2 2024-09-12T17:56:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.101__multipart_file2.mpg.2~_YPFytamI50xv2MS6nUEkyzfJJ1NeS7.3 2024-09-12T17:56:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.101__multipart_file2.mpg.2~_YPFytamI50xv2MS6nUEkyzfJJ1NeS7.4 2024-09-12T17:56:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.101__multipart_file2.mpg.2~_YPFytamI50xv2MS6nUEkyzfJJ1NeS7.5 2024-09-12T17:56:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.17819173247369750527', time=2024-09-12T19:56:43.436773+0000, chain.objs.size()=5 2024-09-12T17:56:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.104__multipart_key1.2~KqhCRHKeDP_jjcZ8ZC2jq7hPCZwwDlY.1 2024-09-12T17:56:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.104__multipart_key1.2~KqhCRHKeDP_jjcZ8ZC2jq7hPCZwwDlY.2 2024-09-12T17:56:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.104__multipart_key1.2~KqhCRHKeDP_jjcZ8ZC2jq7hPCZwwDlY.3 2024-09-12T17:56:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.104__multipart_key1.2~KqhCRHKeDP_jjcZ8ZC2jq7hPCZwwDlY.4 2024-09-12T17:56:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.347+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.104__multipart_key1.2~KqhCRHKeDP_jjcZ8ZC2jq7hPCZwwDlY.5 2024-09-12T17:56:56.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.352+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.354+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:56:56.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.356+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.356+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.356+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.357+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:56:56.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.359+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.359+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.359+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.360+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:56:56.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.362+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.362+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.362+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:56.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.362+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.13324236561379398962', time=2024-09-12T19:56:32.091442+0000, chain.objs.size()=5 2024-09-12T17:56:56.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.362+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.92__multipart_key1.2~F2QzPs-Ggr1DCysWmxZfCFFQMr_SJdn.1 2024-09-12T17:56:56.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.362+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.92__multipart_key1.2~F2QzPs-Ggr1DCysWmxZfCFFQMr_SJdn.2 2024-09-12T17:56:56.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.362+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.92__multipart_key1.2~F2QzPs-Ggr1DCysWmxZfCFFQMr_SJdn.3 2024-09-12T17:56:56.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.362+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.92__multipart_key1.2~F2QzPs-Ggr1DCysWmxZfCFFQMr_SJdn.4 2024-09-12T17:56:56.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.362+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.92__multipart_key1.2~F2QzPs-Ggr1DCysWmxZfCFFQMr_SJdn.5 2024-09-12T17:56:56.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.365+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.367+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:56:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.368+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.369+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.369+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.370+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:56:56.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.371+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.372+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.373+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.373+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.4725848383771205064', time=2024-09-12T19:56:41.071046+0000, chain.objs.size()=5 2024-09-12T17:56:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.373+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~jfZRythKK-jx338nqTi4baft2MpFFQB.1 2024-09-12T17:56:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.373+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~jfZRythKK-jx338nqTi4baft2MpFFQB.2 2024-09-12T17:56:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.373+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~jfZRythKK-jx338nqTi4baft2MpFFQB.3 2024-09-12T17:56:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.373+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~jfZRythKK-jx338nqTi4baft2MpFFQB.4 2024-09-12T17:56:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.373+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~jfZRythKK-jx338nqTi4baft2MpFFQB.5 2024-09-12T17:56:56.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.375+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.378+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:56:56.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.379+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:56.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag', time=2024-09-12T19:56:44.765393+0000, chain.objs.size()=92 2024-09-12T17:56:56.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.1 2024-09-12T17:56:56.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.2 2024-09-12T17:56:56.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.3 2024-09-12T17:56:56.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.4 2024-09-12T17:56:56.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.5 2024-09-12T17:56:56.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.6 2024-09-12T17:56:56.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.7 2024-09-12T17:56:56.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.8 2024-09-12T17:56:56.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.9 2024-09-12T17:56:56.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.10 2024-09-12T17:56:56.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.11 2024-09-12T17:56:56.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.380+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.12 2024-09-12T17:56:56.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.383+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.13 2024-09-12T17:56:56.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.383+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.14 2024-09-12T17:56:56.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.383+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.15 2024-09-12T17:56:56.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.384+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.16 2024-09-12T17:56:56.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.384+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.17 2024-09-12T17:56:56.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.384+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.18 2024-09-12T17:56:56.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.384+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.19 2024-09-12T17:56:56.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.384+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.20 2024-09-12T17:56:56.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.384+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.21 2024-09-12T17:56:56.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.384+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.22 2024-09-12T17:56:56.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.384+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.23 2024-09-12T17:56:56.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.388+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.24 2024-09-12T17:56:56.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.388+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.25 2024-09-12T17:56:56.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.388+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.26 2024-09-12T17:56:56.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.388+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.27 2024-09-12T17:56:56.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.388+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.28 2024-09-12T17:56:56.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.388+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.29 2024-09-12T17:56:56.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.388+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.30 2024-09-12T17:56:56.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.388+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.31 2024-09-12T17:56:56.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.388+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.32 2024-09-12T17:56:56.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.388+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.33 2024-09-12T17:56:56.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.388+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.34 2024-09-12T17:56:56.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.391+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.35 2024-09-12T17:56:56.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.392+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.36 2024-09-12T17:56:56.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.392+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.37 2024-09-12T17:56:56.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.392+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.38 2024-09-12T17:56:56.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.392+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.39 2024-09-12T17:56:56.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.392+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.40 2024-09-12T17:56:56.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.392+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.41 2024-09-12T17:56:56.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.392+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.42 2024-09-12T17:56:56.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.392+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.43 2024-09-12T17:56:56.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.392+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.44 2024-09-12T17:56:56.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.392+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.45 2024-09-12T17:56:56.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.394+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.46 2024-09-12T17:56:56.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.397+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.47 2024-09-12T17:56:56.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.397+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.48 2024-09-12T17:56:56.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.397+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.49 2024-09-12T17:56:56.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.397+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.50 2024-09-12T17:56:56.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.397+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.51 2024-09-12T17:56:56.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.397+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.52 2024-09-12T17:56:56.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.397+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.53 2024-09-12T17:56:56.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.398+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.54 2024-09-12T17:56:56.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.398+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.55 2024-09-12T17:56:56.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.398+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.56 2024-09-12T17:56:56.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.398+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.57 2024-09-12T17:56:56.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.400+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.58 2024-09-12T17:56:56.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.400+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.59 2024-09-12T17:56:56.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.400+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.60 2024-09-12T17:56:56.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.401+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.61 2024-09-12T17:56:56.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.401+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.62 2024-09-12T17:56:56.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.401+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.63 2024-09-12T17:56:56.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.402+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.64 2024-09-12T17:56:56.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.402+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.65 2024-09-12T17:56:56.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.402+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.66 2024-09-12T17:56:56.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.402+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.67 2024-09-12T17:56:56.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.402+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.68 2024-09-12T17:56:56.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.404+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.69 2024-09-12T17:56:56.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.404+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.70 2024-09-12T17:56:56.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.404+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.71 2024-09-12T17:56:56.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.405+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.72 2024-09-12T17:56:56.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.406+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.73 2024-09-12T17:56:56.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.406+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.74 2024-09-12T17:56:56.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.406+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.75 2024-09-12T17:56:56.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.406+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.76 2024-09-12T17:56:56.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.406+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.77 2024-09-12T17:56:56.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.408+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.78 2024-09-12T17:56:56.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.408+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.79 2024-09-12T17:56:56.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.408+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.80 2024-09-12T17:56:56.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.408+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.81 2024-09-12T17:56:56.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.408+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.82 2024-09-12T17:56:56.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.408+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.83 2024-09-12T17:56:56.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.408+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.84 2024-09-12T17:56:56.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.409+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.85 2024-09-12T17:56:56.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.409+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.86 2024-09-12T17:56:56.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.409+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.87 2024-09-12T17:56:56.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.409+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.88 2024-09-12T17:56:56.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.412+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.89 2024-09-12T17:56:56.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.412+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.90 2024-09-12T17:56:56.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.412+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.91 2024-09-12T17:56:56.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.412+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.106__multipart_key1.2~ybEzmo7EMIQtOTc_XO9KsgrIxoTYyag.92 2024-09-12T17:56:56.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.415+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.418+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:56:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.419+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.419+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.420+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:56.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.420+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6887783065775917815', time=2024-09-12T19:56:35.228405+0000, chain.objs.size()=5 2024-09-12T17:56:56.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.420+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~9DI2L6E1e8lAoW-ZtOJiw5tTV-h-DdC.1 2024-09-12T17:56:56.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.420+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~9DI2L6E1e8lAoW-ZtOJiw5tTV-h-DdC.2 2024-09-12T17:56:56.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.420+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~9DI2L6E1e8lAoW-ZtOJiw5tTV-h-DdC.3 2024-09-12T17:56:56.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.420+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~9DI2L6E1e8lAoW-ZtOJiw5tTV-h-DdC.4 2024-09-12T17:56:56.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.420+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~9DI2L6E1e8lAoW-ZtOJiw5tTV-h-DdC.5 2024-09-12T17:56:56.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.422+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.425+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:56:56.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.426+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.426+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.427+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:56.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.427+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.10991173280615834247', time=2024-09-12T19:56:44.016933+0000, chain.objs.size()=5 2024-09-12T17:56:56.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.427+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.105__multipart_key1.2~4MUOeTYg3mCTar1MMGCS9yLgisUXBCm.1 2024-09-12T17:56:56.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.427+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.105__multipart_key1.2~4MUOeTYg3mCTar1MMGCS9yLgisUXBCm.2 2024-09-12T17:56:56.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.427+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.105__multipart_key1.2~4MUOeTYg3mCTar1MMGCS9yLgisUXBCm.3 2024-09-12T17:56:56.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.427+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.105__multipart_key1.2~4MUOeTYg3mCTar1MMGCS9yLgisUXBCm.4 2024-09-12T17:56:56.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.427+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.105__multipart_key1.2~4MUOeTYg3mCTar1MMGCS9yLgisUXBCm.5 2024-09-12T17:56:56.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.429+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.432+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:56:56.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.433+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.433+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.434+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.435+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:56:56.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.438+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.438+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.439+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:56:56.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.439+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.13026491700978996442', time=2024-09-12T19:56:41.708206+0000, chain.objs.size()=5 2024-09-12T17:56:56.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.439+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~d_-hSYwKlVNjXbdiU75bhmuLbftJtU7.1 2024-09-12T17:56:56.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.439+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~d_-hSYwKlVNjXbdiU75bhmuLbftJtU7.2 2024-09-12T17:56:56.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.439+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~d_-hSYwKlVNjXbdiU75bhmuLbftJtU7.3 2024-09-12T17:56:56.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.439+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~d_-hSYwKlVNjXbdiU75bhmuLbftJtU7.4 2024-09-12T17:56:56.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.439+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~d_-hSYwKlVNjXbdiU75bhmuLbftJtU7.5 2024-09-12T17:56:56.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.441+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.443+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:56:56.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.445+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.445+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:56:56.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~yQUZ7ZiRI1HTCqPxlmCaL0ZX7gZ0GQM', time=2024-09-12T19:56:28.503485+0000, chain.objs.size()=5 2024-09-12T17:56:56.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.80__multipart_key1.2~yQUZ7ZiRI1HTCqPxlmCaL0ZX7gZ0GQM.1 2024-09-12T17:56:56.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.80__multipart_key1.2~yQUZ7ZiRI1HTCqPxlmCaL0ZX7gZ0GQM.2 2024-09-12T17:56:56.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.80__multipart_key1.2~yQUZ7ZiRI1HTCqPxlmCaL0ZX7gZ0GQM.3 2024-09-12T17:56:56.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.80__multipart_key1.2~yQUZ7ZiRI1HTCqPxlmCaL0ZX7gZ0GQM.4 2024-09-12T17:56:56.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.80__multipart_key1.2~yQUZ7ZiRI1HTCqPxlmCaL0ZX7gZ0GQM.5 2024-09-12T17:56:56.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.16059454690651816261', time=2024-09-12T19:56:29.744572+0000, chain.objs.size()=2 2024-09-12T17:56:56.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.84__shadow_.JVuxuP7HgVJl-LUDLdKT-TY1RFnSFag_1 2024-09-12T17:56:56.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.84__shadow_.JVuxuP7HgVJl-LUDLdKT-TY1RFnSFag_2 2024-09-12T17:56:56.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.14881240185018652027', time=2024-09-12T19:56:37.991943+0000, chain.objs.size()=5 2024-09-12T17:56:56.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.99__multipart_key1.2~05esReI-2S674vhGAbY86LgqCH2ICgb.1 2024-09-12T17:56:56.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.99__multipart_key1.2~05esReI-2S674vhGAbY86LgqCH2ICgb.2 2024-09-12T17:56:56.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.99__multipart_key1.2~05esReI-2S674vhGAbY86LgqCH2ICgb.3 2024-09-12T17:56:56.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.99__multipart_key1.2~05esReI-2S674vhGAbY86LgqCH2ICgb.4 2024-09-12T17:56:56.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.446+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.99__multipart_key1.2~05esReI-2S674vhGAbY86LgqCH2ICgb.5 2024-09-12T17:56:56.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.452+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.455+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:56:56.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.456+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:56:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.3288530067141029843', time=2024-09-12T19:56:41.412601+0000, chain.objs.size()=5 2024-09-12T17:56:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~froL7jfrU3cjBsPPpd8mSIYHC8DEwt7.1 2024-09-12T17:56:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~froL7jfrU3cjBsPPpd8mSIYHC8DEwt7.2 2024-09-12T17:56:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~froL7jfrU3cjBsPPpd8mSIYHC8DEwt7.3 2024-09-12T17:56:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~froL7jfrU3cjBsPPpd8mSIYHC8DEwt7.4 2024-09-12T17:56:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~froL7jfrU3cjBsPPpd8mSIYHC8DEwt7.5 2024-09-12T17:56:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.12180024351698362009', time=2024-09-12T19:56:41.994002+0000, chain.objs.size()=5 2024-09-12T17:56:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~3AFPpw97Q5N_VH5Ek82KnMDoclo24ih.1 2024-09-12T17:56:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__shadow_key1.2~3AFPpw97Q5N_VH5Ek82KnMDoclo24ih.1_1 2024-09-12T17:56:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~3AFPpw97Q5N_VH5Ek82KnMDoclo24ih.2 2024-09-12T17:56:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__shadow_key1.2~3AFPpw97Q5N_VH5Ek82KnMDoclo24ih.2_1 2024-09-12T17:56:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.457+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~3AFPpw97Q5N_VH5Ek82KnMDoclo24ih.3 2024-09-12T17:56:56.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.462+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.464+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:56:56.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.465+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.466+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.466+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.467+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:56:56.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.468+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.469+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.469+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.470+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:56:56.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.471+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.471+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:56:56.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.10641468362546649499', time=2024-09-12T19:56:39.762988+0000, chain.objs.size()=5 2024-09-12T17:56:56.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.101__multipart_file.mpg.2~x5j4lXpzEdbrJx7QzDVsQFc-UbkarKM.1 2024-09-12T17:56:56.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.101__multipart_file.mpg.2~x5j4lXpzEdbrJx7QzDVsQFc-UbkarKM.2 2024-09-12T17:56:56.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.101__multipart_file.mpg.2~x5j4lXpzEdbrJx7QzDVsQFc-UbkarKM.3 2024-09-12T17:56:56.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.101__multipart_file.mpg.2~x5j4lXpzEdbrJx7QzDVsQFc-UbkarKM.4 2024-09-12T17:56:56.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.101__multipart_file.mpg.2~x5j4lXpzEdbrJx7QzDVsQFc-UbkarKM.5 2024-09-12T17:56:56.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.3867203809266098200', time=2024-09-12T19:56:55.560674+0000, chain.objs.size()=5 2024-09-12T17:56:56.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.145__multipart_key1/data/file.mpg.2~Nz3D1wnzwntJyxvzXnT5g4ioir3Xl_G.1 2024-09-12T17:56:56.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.145__multipart_key1/data/file.mpg.2~Nz3D1wnzwntJyxvzXnT5g4ioir3Xl_G.2 2024-09-12T17:56:56.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.145__multipart_key1/data/file.mpg.2~Nz3D1wnzwntJyxvzXnT5g4ioir3Xl_G.3 2024-09-12T17:56:56.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.145__multipart_key1/data/file.mpg.2~Nz3D1wnzwntJyxvzXnT5g4ioir3Xl_G.4 2024-09-12T17:56:56.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.472+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.145__multipart_key1/data/file.mpg.2~Nz3D1wnzwntJyxvzXnT5g4ioir3Xl_G.5 2024-09-12T17:56:56.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.475+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.478+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:56:56.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:56:56.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.18411693335823964611', time=2024-09-12T19:56:34.097073+0000, chain.objs.size()=5 2024-09-12T17:56:56.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~VIaJBvPjmyahBB3_H5iGHDz8zRhG2lt.1 2024-09-12T17:56:56.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~VIaJBvPjmyahBB3_H5iGHDz8zRhG2lt.2 2024-09-12T17:56:56.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~VIaJBvPjmyahBB3_H5iGHDz8zRhG2lt.3 2024-09-12T17:56:56.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~VIaJBvPjmyahBB3_H5iGHDz8zRhG2lt.4 2024-09-12T17:56:56.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.95__multipart_key1.2~VIaJBvPjmyahBB3_H5iGHDz8zRhG2lt.5 2024-09-12T17:56:56.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~ytwuDW4gpTy7RTbaYcdZT_c-_P3465h', time=2024-09-12T19:56:40.366621+0000, chain.objs.size()=5 2024-09-12T17:56:56.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.102__multipart_key1.2~ytwuDW4gpTy7RTbaYcdZT_c-_P3465h.7 2024-09-12T17:56:56.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.102__multipart_key1.2~ytwuDW4gpTy7RTbaYcdZT_c-_P3465h.8 2024-09-12T17:56:56.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.102__multipart_key1.2~ytwuDW4gpTy7RTbaYcdZT_c-_P3465h.9 2024-09-12T17:56:56.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.102__multipart_key1.2~ytwuDW4gpTy7RTbaYcdZT_c-_P3465h.10 2024-09-12T17:56:56.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.480+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.102__multipart_key1.2~ytwuDW4gpTy7RTbaYcdZT_c-_P3465h.11 2024-09-12T17:56:56.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.485+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.487+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:56:56.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.489+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.489+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.489+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.491 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.490+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:56:56.492 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.491+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.492+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.492+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.493+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:56:56.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.494+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.495+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.496 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.495+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.496+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:56:56.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.497+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:56:56.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.14141579376369654680', time=2024-09-12T19:56:42.288789+0000, chain.objs.size()=5 2024-09-12T17:56:56.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~M-T-3COM3tZX16TjHcGO0bJV1fR6XcK.1 2024-09-12T17:56:56.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__shadow_key1.2~M-T-3COM3tZX16TjHcGO0bJV1fR6XcK.1_1 2024-09-12T17:56:56.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~M-T-3COM3tZX16TjHcGO0bJV1fR6XcK.2 2024-09-12T17:56:56.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__shadow_key1.2~M-T-3COM3tZX16TjHcGO0bJV1fR6XcK.2_1 2024-09-12T17:56:56.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~M-T-3COM3tZX16TjHcGO0bJV1fR6XcK.3 2024-09-12T17:56:56.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.2209997623356207435', time=2024-09-12T19:56:42.427585+0000, chain.objs.size()=5 2024-09-12T17:56:56.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~xHnC1jcVjeX-gfEZBvCvtG0SADUIdTr.1 2024-09-12T17:56:56.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__shadow_key1.2~xHnC1jcVjeX-gfEZBvCvtG0SADUIdTr.1_1 2024-09-12T17:56:56.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~xHnC1jcVjeX-gfEZBvCvtG0SADUIdTr.2 2024-09-12T17:56:56.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__shadow_key1.2~xHnC1jcVjeX-gfEZBvCvtG0SADUIdTr.2_1 2024-09-12T17:56:56.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.499+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.103__multipart_key1.2~xHnC1jcVjeX-gfEZBvCvtG0SADUIdTr.3 2024-09-12T17:56:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.502+0000 7fad2d8bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:56:56.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.505+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:56:56.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.506+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.507+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.507+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.508+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:56:56.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.509+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.509+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.510+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.510+0000 7fad2d8bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:56:56.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.512+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.512+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:56.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.512+0000 7fad2d8bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:56.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.514+0000 7fabe27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:56.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.516+0000 7fad2d8bb800 20 remove_watcher() i=0 2024-09-12T17:56:56.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.516+0000 7fad2d8bb800 2 removed watcher, disabling cache 2024-09-12T17:56:56.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.517+0000 7fad2d8bb800 20 remove_watcher() i=1 2024-09-12T17:56:56.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.518+0000 7fad2d8bb800 20 remove_watcher() i=2 2024-09-12T17:56:56.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.519+0000 7fad2d8bb800 20 remove_watcher() i=3 2024-09-12T17:56:56.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.520+0000 7fad2d8bb800 20 remove_watcher() i=4 2024-09-12T17:56:56.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.521+0000 7fad2d8bb800 20 remove_watcher() i=5 2024-09-12T17:56:56.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.522+0000 7fad2d8bb800 20 remove_watcher() i=6 2024-09-12T17:56:56.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.523+0000 7fad2d8bb800 20 remove_watcher() i=7 2024-09-12T17:56:56.535 DEBUG:teuthology.orchestra.run.smithi107:> radosgw-admin gc process --include-all 2024-09-12T17:56:56.587 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:56.587 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:56.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.622+0000 7ff618d23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:56.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.623+0000 7ff618d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:56.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.623+0000 7ff618d23800 20 realm 2024-09-12T17:56:56.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.623+0000 7ff618d23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:56.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.623+0000 7ff618d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:56.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.623+0000 7ff618d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:56.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.623+0000 7ff618d23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:56.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.623+0000 7ff618d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:56.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.623+0000 7ff618d23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:56.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.825+0000 7ff618d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:56.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.825+0000 7ff618d23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:56.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.826+0000 7ff618d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:56.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.826+0000 7ff618d23800 20 searching for the correct realm 2024-09-12T17:56:56.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.828+0000 7ff60ffff640 0 -- 172.21.15.107:0/1108287682 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7ff600098c20 msgr2=0x7ff600093440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:56.834 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:56.833+0000 7ff614a0c640 0 -- 172.21.15.107:0/1108287682 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7ff6000247b0 msgr2=0x7ff600069340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:57.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.038+0000 7ff618d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:57.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.038+0000 7ff618d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:57.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.038+0000 7ff618d23800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:56:57.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.038+0000 7ff618d23800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:56:57.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.038+0000 7ff618d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:57.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.038+0000 7ff618d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:57.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.038+0000 7ff618d23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:57.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.038+0000 7ff618d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:57.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.038+0000 7ff618d23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.039+0000 7ff618d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.039+0000 7ff618d23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.039+0000 7ff618d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.039+0000 7ff618d23800 20 zone default found 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.039+0000 7ff618d23800 4 Realm: () 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.039+0000 7ff618d23800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.039+0000 7ff618d23800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.039+0000 7ff618d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.039+0000 7ff618d23800 20 zonegroup default 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.039+0000 7ff618d23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.039+0000 7ff618d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.039+0000 7ff618d23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.040+0000 7ff618d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:57.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.040+0000 7ff618d23800 20 rados->read ofs=0 len=0 2024-09-12T17:56:57.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.040+0000 7ff618d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:57.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.040+0000 7ff618d23800 20 started sync module instance, tier type = 2024-09-12T17:56:57.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.040+0000 7ff618d23800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:56:57.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.049+0000 7ff618d23800 20 add_watcher() i=0 2024-09-12T17:56:57.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.049+0000 7ff618d23800 20 add_watcher() i=1 2024-09-12T17:56:57.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.049+0000 7ff618d23800 20 add_watcher() i=2 2024-09-12T17:56:57.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.049+0000 7ff618d23800 20 add_watcher() i=3 2024-09-12T17:56:57.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.049+0000 7ff618d23800 20 add_watcher() i=4 2024-09-12T17:56:57.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.049+0000 7ff618d23800 20 add_watcher() i=5 2024-09-12T17:56:57.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.049+0000 7ff618d23800 20 add_watcher() i=6 2024-09-12T17:56:57.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.050+0000 7ff618d23800 20 add_watcher() i=7 2024-09-12T17:56:57.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.050+0000 7ff618d23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:57.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.051+0000 7ff4cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:57.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.051+0000 7ff618d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:57.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.051+0000 7ff618d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:57.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.087+0000 7ff4c9fe3640 20 reqs_thread_entry: start 2024-09-12T17:56:57.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.087+0000 7ff618d23800 20 init_complete bucket index max shards: 1 2024-09-12T17:56:57.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.087+0000 7ff618d23800 20 Filter name: none 2024-09-12T17:56:57.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.087+0000 7ff43b7fe640 20 reqs_thread_entry: start 2024-09-12T17:56:57.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.087+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:56:57.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.089+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.090+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.090+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.091+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:56:57.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.092+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.093+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.093+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.094+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:56:57.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.095+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.096+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.096+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.097+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:56:57.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.098+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.098+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.099+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.099+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:56:57.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.101+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.101+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.101+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.102+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:56:57.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.103+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.104+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.104+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.105+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:56:57.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.106+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.107+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.107+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.108+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:56:57.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.109+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.110+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.110+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.111+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:56:57.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.112+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.113+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.113+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.114+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:56:57.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.115+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.116+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.116+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.117+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:56:57.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.119+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.120+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.120+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.121+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:56:57.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.123+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.123+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.123+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.124+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:56:57.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.126+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.126+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.126+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.128+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:56:57.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.129+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.129+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.129+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.130+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:56:57.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.132+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.132+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.132+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.133+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:56:57.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.135+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.136+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.136+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.137+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:56:57.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.138+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.138+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.139+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.140+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:56:57.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.141+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.141+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.142+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.142+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:56:57.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.144+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.144+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.145+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.146+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:56:57.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.147+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.148+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.148+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.149+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:56:57.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.150+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.151+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.151+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.152+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:56:57.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.153+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.153+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.154+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.154+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:56:57.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.156+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.156+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.157+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.158+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:56:57.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.160+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.160+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.160+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.161+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:56:57.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.162+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.163+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.163+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.164+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:56:57.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.165+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.165+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.166+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.167+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:56:57.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.168+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.168+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.169+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.170+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:56:57.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.171+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.171+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.172+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.172+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:56:57.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.174+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.174+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.174+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.175+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:56:57.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.177+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.177+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.177+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.178+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:56:57.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.179+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.180+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.180+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.181+0000 7ff618d23800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:56:57.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.182+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.183+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:56:57.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.183+0000 7ff618d23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:56:57.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.186+0000 7ff4cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:57.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.187+0000 7ff618d23800 20 remove_watcher() i=0 2024-09-12T17:56:57.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.187+0000 7ff618d23800 2 removed watcher, disabling cache 2024-09-12T17:56:57.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.188+0000 7ff618d23800 20 remove_watcher() i=1 2024-09-12T17:56:57.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.189+0000 7ff618d23800 20 remove_watcher() i=2 2024-09-12T17:56:57.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.190+0000 7ff618d23800 20 remove_watcher() i=3 2024-09-12T17:56:57.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.191+0000 7ff618d23800 20 remove_watcher() i=4 2024-09-12T17:56:57.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.192+0000 7ff618d23800 20 remove_watcher() i=5 2024-09-12T17:56:57.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.193+0000 7ff618d23800 20 remove_watcher() i=6 2024-09-12T17:56:57.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:57.194+0000 7ff618d23800 20 remove_watcher() i=7 2024-09-12T17:56:57.206 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T17:56:57.225 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T17:56:57.225 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T17:56:57.225 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T17:56:57.225 DEBUG:teuthology.orchestra.run.smithi107:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:56:57.254 INFO:teuthology.orchestra.run.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T17:56:58.053 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T17:56:58.054 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-12T17:56:58.054 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key TJQENUZVCGGYWURDMZNK --secret vyh9yS7IMVbdESOQBiyccESef55XyiVr+eNgNOlG1ZQEjeD+HJaxhw== --cluster ceph 2024-09-12T17:56:58.158 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:58.159 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:58.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.191+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.193+0000 7f1c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.193+0000 7f1c63e2f800 20 realm 2024-09-12T17:56:58.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.193+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.193+0000 7f1c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.193+0000 7f1c63e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:58.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.193+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.193+0000 7f1c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.193+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.194+0000 7f1c63e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:58.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.194+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.195+0000 7f1c63e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:58.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.195+0000 7f1c63e2f800 20 searching for the correct realm 2024-09-12T17:56:58.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.198+0000 7f1c61118640 0 -- 172.21.15.107:0/650489338 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f1c58028040 msgr2=0x7f1c58044940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:58.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.203+0000 7f1c61919640 0 -- 172.21.15.107:0/650489338 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f1c58060930 msgr2=0x7f1c5800d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.410+0000 7f1c63e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.410+0000 7f1c63e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.410+0000 7f1c63e2f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:56:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.410+0000 7f1c63e2f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:56:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.410+0000 7f1c63e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.410+0000 7f1c63e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.410+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.410+0000 7f1c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.410+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.411+0000 7f1c63e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:58.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.411+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.411+0000 7f1c63e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:58.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.411+0000 7f1c63e2f800 20 zone default found 2024-09-12T17:56:58.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.411+0000 7f1c63e2f800 4 Realm: () 2024-09-12T17:56:58.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.411+0000 7f1c63e2f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:56:58.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.411+0000 7f1c63e2f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:56:58.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.411+0000 7f1c63e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:58.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.411+0000 7f1c63e2f800 20 zonegroup default 2024-09-12T17:56:58.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.411+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.411+0000 7f1c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.411+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.412+0000 7f1c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.412+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.412+0000 7f1c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.412+0000 7f1c63e2f800 20 started sync module instance, tier type = 2024-09-12T17:56:58.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.412+0000 7f1c63e2f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:56:58.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.421+0000 7f1c63e2f800 20 add_watcher() i=0 2024-09-12T17:56:58.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.421+0000 7f1c63e2f800 20 add_watcher() i=1 2024-09-12T17:56:58.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.421+0000 7f1c63e2f800 20 add_watcher() i=2 2024-09-12T17:56:58.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.421+0000 7f1c63e2f800 20 add_watcher() i=3 2024-09-12T17:56:58.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.421+0000 7f1c63e2f800 20 add_watcher() i=4 2024-09-12T17:56:58.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.421+0000 7f1c63e2f800 20 add_watcher() i=5 2024-09-12T17:56:58.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.421+0000 7f1c63e2f800 20 add_watcher() i=6 2024-09-12T17:56:58.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.422+0000 7f1c63e2f800 20 add_watcher() i=7 2024-09-12T17:56:58.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.422+0000 7f1c63e2f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:58.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.423+0000 7f1b137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:58.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.423+0000 7f1c63e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:58.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.423+0000 7f1c63e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:58.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.423+0000 7f1c63e2f800 5 note: GC not initialized 2024-09-12T17:56:58.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1b127fc640 20 reqs_thread_entry: start 2024-09-12T17:56:58.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 20 init_complete bucket index max shards: 1 2024-09-12T17:56:58.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 20 Filter name: none 2024-09-12T17:56:58.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1a83fff640 20 reqs_thread_entry: start 2024-09-12T17:56:58.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:56:58.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T17:56:58.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:56:58.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T17:56:58.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T17:56:58.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:56:58.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 10 cache get: name=default.rgw.meta+users.keys+TJQENUZVCGGYWURDMZNK : miss 2024-09-12T17:56:58.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.424+0000 7f1c63e2f800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.425+0000 7f1c63e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.425+0000 7f1c63e2f800 10 cache put: name=default.rgw.meta+users.keys+TJQENUZVCGGYWURDMZNK info.flags=0x0 2024-09-12T17:56:58.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.425+0000 7f1c63e2f800 10 adding default.rgw.meta+users.keys+TJQENUZVCGGYWURDMZNK to cache LRU end 2024-09-12T17:56:58.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.425+0000 7f1c63e2f800 10 cache get: name=default.rgw.meta+users.keys+TJQENUZVCGGYWURDMZNK : hit (negative entry) 2024-09-12T17:56:58.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.425+0000 7f1c63e2f800 10 cache get: name=default.rgw.meta+users.keys+TJQENUZVCGGYWURDMZNK : hit (negative entry) 2024-09-12T17:56:58.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.426+0000 7f1c63e2f800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:56:58.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.426+0000 7f1c63e2f800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:56:58.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.426+0000 7f1c63e2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:56:58.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.426+0000 7f1b457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464441 cookie 93848751744144 notifier 8423 bl.length()=645 2024-09-12T17:56:58.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.426+0000 7f1b457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:56:58.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.426+0000 7f1b457fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:56:58.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.428+0000 7f1c63e2f800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:56:58.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.428+0000 7f1c63e2f800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:56:58.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.428+0000 7f1c63e2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T17:56:58.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.428+0000 7f1b44ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464442 cookie 93848751757808 notifier 8423 bl.length()=185 2024-09-12T17:56:58.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.428+0000 7f1b44ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:56:58.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.428+0000 7f1b44ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:56:58.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.430+0000 7f1c63e2f800 10 cache put: name=default.rgw.meta+users.keys+TJQENUZVCGGYWURDMZNK info.flags=0x7 2024-09-12T17:56:58.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.430+0000 7f1c63e2f800 10 moving default.rgw.meta+users.keys+TJQENUZVCGGYWURDMZNK to cache LRU end 2024-09-12T17:56:58.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.430+0000 7f1c63e2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:TJQENUZVCGGYWURDMZNK, ofs0, ns] 2024-09-12T17:56:58.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.430+0000 7f1b44ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464430 cookie 93848751742448 notifier 8423 bl.length()=186 2024-09-12T17:56:58.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.430+0000 7f1b44ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TJQENUZVCGGYWURDMZNK info.flags=0x7 2024-09-12T17:56:58.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.430+0000 7f1b44ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TJQENUZVCGGYWURDMZNK to cache LRU end 2024-09-12T17:56:58.431 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:56:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "user_id": "foo.client.0", 2024-09-12T17:56:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "display_name": "Mr.foo.client.0", 2024-09-12T17:56:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "foo+test@test.test", 2024-09-12T17:56:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "suspended": 0, 2024-09-12T17:56:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:56:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "subusers": [], 2024-09-12T17:56:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "keys": [ 2024-09-12T17:56:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:56:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "user": "foo.client.0", 2024-09-12T17:56:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "access_key": "TJQENUZVCGGYWURDMZNK", 2024-09-12T17:56:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "secret_key": "vyh9yS7IMVbdESOQBiyccESef55XyiVr+eNgNOlG1ZQEjeD+HJaxhw==", 2024-09-12T17:56:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "active": true, 2024-09-12T17:56:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:56:58.425217Z" 2024-09-12T17:56:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T17:56:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T17:56:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "swift_keys": [], 2024-09-12T17:56:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": [], 2024-09-12T17:56:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:56:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "default_placement": "", 2024-09-12T17:56:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "placement_tags": [], 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "user_quota": { 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:56:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:56:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:56:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:56:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "rgw", 2024-09-12T17:56:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "mfa_ids": [], 2024-09-12T17:56:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "account_id": "", 2024-09-12T17:56:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2024-09-12T17:56:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:56:58.425206Z", 2024-09-12T17:56:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-09-12T17:56:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "group_ids": [] 2024-09-12T17:56:58.434 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:56:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:56:58.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.431+0000 7f1b137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:58.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.434+0000 7f1c63e2f800 20 remove_watcher() i=0 2024-09-12T17:56:58.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.434+0000 7f1c63e2f800 2 removed watcher, disabling cache 2024-09-12T17:56:58.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.435+0000 7f1c63e2f800 20 remove_watcher() i=1 2024-09-12T17:56:58.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.436+0000 7f1c63e2f800 20 remove_watcher() i=2 2024-09-12T17:56:58.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.438+0000 7f1c63e2f800 20 remove_watcher() i=3 2024-09-12T17:56:58.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.439+0000 7f1c63e2f800 20 remove_watcher() i=4 2024-09-12T17:56:58.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.440+0000 7f1c63e2f800 20 remove_watcher() i=5 2024-09-12T17:56:58.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.441+0000 7f1c63e2f800 20 remove_watcher() i=6 2024-09-12T17:56:58.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.442+0000 7f1c63e2f800 20 remove_watcher() i=7 2024-09-12T17:56:58.453 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 9397280842 --totp-seed GKACFNVIP27AYPQA55JB6UJUNBI3G3RMDCEWFRJNPMFAHRMI2SPWBUMVY7Q7W2AQ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:56:58.519 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:58.519 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:58.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.552+0000 7fea8d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.554+0000 7fea8d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.554+0000 7fea8d92c800 20 realm 2024-09-12T17:56:58.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.554+0000 7fea8d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.554+0000 7fea8d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.554+0000 7fea8d92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:58.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.554+0000 7fea8d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.554+0000 7fea8d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.554+0000 7fea8d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.555+0000 7fea8d92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:58.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.555+0000 7fea8d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.556+0000 7fea8d92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:58.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.556+0000 7fea8d92c800 20 searching for the correct realm 2024-09-12T17:56:58.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.558+0000 7fea88d3d640 0 -- 172.21.15.107:0/3715125323 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7fea8004a070 msgr2=0x7fea8000ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:58.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.562+0000 7fea8953e640 0 -- 172.21.15.107:0/3715125323 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fea8001f060 msgr2=0x7fea8008a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:58.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.769+0000 7fea8d92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:58.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.769+0000 7fea8d92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:58.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.769+0000 7fea8d92c800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.769+0000 7fea8d92c800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.769+0000 7fea8d92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.769+0000 7fea8d92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.769+0000 7fea8d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.769+0000 7fea8d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.769+0000 7fea8d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.770+0000 7fea8d92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.770+0000 7fea8d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.770+0000 7fea8d92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.770+0000 7fea8d92c800 20 zone default found 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.770+0000 7fea8d92c800 4 Realm: () 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.770+0000 7fea8d92c800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:56:58.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.770+0000 7fea8d92c800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:56:58.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.770+0000 7fea8d92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:58.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.770+0000 7fea8d92c800 20 zonegroup default 2024-09-12T17:56:58.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.770+0000 7fea8d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.770+0000 7fea8d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.770+0000 7fea8d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.771+0000 7fea8d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.771+0000 7fea8d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.771+0000 7fea8d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.771+0000 7fea8d92c800 20 started sync module instance, tier type = 2024-09-12T17:56:58.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.771+0000 7fea8d92c800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:56:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.781+0000 7fea8d92c800 20 add_watcher() i=0 2024-09-12T17:56:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.781+0000 7fea8d92c800 20 add_watcher() i=1 2024-09-12T17:56:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.781+0000 7fea8d92c800 20 add_watcher() i=2 2024-09-12T17:56:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.781+0000 7fea8d92c800 20 add_watcher() i=3 2024-09-12T17:56:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.781+0000 7fea8d92c800 20 add_watcher() i=4 2024-09-12T17:56:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.781+0000 7fea8d92c800 20 add_watcher() i=5 2024-09-12T17:56:58.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.781+0000 7fea8d92c800 20 add_watcher() i=6 2024-09-12T17:56:58.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.782+0000 7fea8d92c800 20 add_watcher() i=7 2024-09-12T17:56:58.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.782+0000 7fea8d92c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:58.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.783+0000 7fe93f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:58.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.783+0000 7fea8d92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:58.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.783+0000 7fea8d92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:58.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.783+0000 7fea8d92c800 5 note: GC not initialized 2024-09-12T17:56:58.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.784+0000 7fe93e7e4640 20 reqs_thread_entry: start 2024-09-12T17:56:58.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.784+0000 7fea8d92c800 20 init_complete bucket index max shards: 1 2024-09-12T17:56:58.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.784+0000 7fea8d92c800 20 Filter name: none 2024-09-12T17:56:58.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.784+0000 7fe8affff640 20 reqs_thread_entry: start 2024-09-12T17:56:58.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.784+0000 7fea8d92c800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:56:58.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.784+0000 7fea8d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.784+0000 7fea8d92c800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:56:58.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.784+0000 7fea8d92c800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T17:56:58.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.784+0000 7fea8d92c800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:56:58.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:56:58.784+0000 7fea8d92c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:00.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.469+0000 7fea8d92c800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:57:00.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.469+0000 7fea8d92c800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:57:00.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.469+0000 7fea8d92c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:57:00.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.470+0000 7fe95bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399035 cookie 94216051408832 notifier 9021 bl.length()=659 2024-09-12T17:57:00.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.470+0000 7fe95bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:57:00.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.470+0000 7fe95bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:57:00.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.471+0000 7fe93f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:00.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.473+0000 7fea8d92c800 20 remove_watcher() i=0 2024-09-12T17:57:00.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.473+0000 7fea8d92c800 2 removed watcher, disabling cache 2024-09-12T17:57:00.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.475+0000 7fea8d92c800 20 remove_watcher() i=1 2024-09-12T17:57:00.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.476+0000 7fea8d92c800 20 remove_watcher() i=2 2024-09-12T17:57:00.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.477+0000 7fea8d92c800 20 remove_watcher() i=3 2024-09-12T17:57:00.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.478+0000 7fea8d92c800 20 remove_watcher() i=4 2024-09-12T17:57:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.479+0000 7fea8d92c800 20 remove_watcher() i=5 2024-09-12T17:57:00.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.480+0000 7fea8d92c800 20 remove_watcher() i=6 2024-09-12T17:57:00.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.482+0000 7fea8d92c800 20 remove_watcher() i=7 2024-09-12T17:57:00.494 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T17:57:00.495 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key VARDMCURPTRWMCQZXYIC --secret W3Cn6d23Kf7Mt/GOnef8/rukJxOtEn4UpBHhC14dOSuR8NV2rj5YXg== --cluster ceph 2024-09-12T17:57:00.562 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:00.563 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:00.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.594+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.596+0000 7f9e5e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.596+0000 7f9e5e51f800 20 realm 2024-09-12T17:57:00.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.596+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.596+0000 7f9e5e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.596+0000 7f9e5e51f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:00.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.596+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.596+0000 7f9e5e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.596+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.597+0000 7f9e5e51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:00.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.597+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.598+0000 7f9e5e51f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.598+0000 7f9e5e51f800 20 searching for the correct realm 2024-09-12T17:57:00.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.600+0000 7f9e53fff640 0 -- 172.21.15.107:0/1544731309 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f9e440b36e0 msgr2=0x7f9e440cc0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:00.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.604+0000 7f9e5a2a2640 0 -- 172.21.15.107:0/1544731309 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f9e440b1350 msgr2=0x7f9e440a8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:00.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.810+0000 7f9e5e51f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:00.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.810+0000 7f9e5e51f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:00.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.810+0000 7f9e5e51f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:00.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.810+0000 7f9e5e51f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:00.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.810+0000 7f9e5e51f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:00.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.810+0000 7f9e5e51f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:00.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.810+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.811+0000 7f9e5e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.811+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.811+0000 7f9e5e51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:00.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.811+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.811+0000 7f9e5e51f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:00.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.811+0000 7f9e5e51f800 20 zone default found 2024-09-12T17:57:00.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.811+0000 7f9e5e51f800 4 Realm: () 2024-09-12T17:57:00.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.811+0000 7f9e5e51f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:00.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.811+0000 7f9e5e51f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:00.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.811+0000 7f9e5e51f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:00.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.811+0000 7f9e5e51f800 20 zonegroup default 2024-09-12T17:57:00.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.811+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.812+0000 7f9e5e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.812+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.812+0000 7f9e5e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.812+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.812+0000 7f9e5e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.812+0000 7f9e5e51f800 20 started sync module instance, tier type = 2024-09-12T17:57:00.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.812+0000 7f9e5e51f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:00.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.822+0000 7f9e5e51f800 20 add_watcher() i=0 2024-09-12T17:57:00.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.822+0000 7f9e5e51f800 20 add_watcher() i=1 2024-09-12T17:57:00.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.822+0000 7f9e5e51f800 20 add_watcher() i=2 2024-09-12T17:57:00.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.822+0000 7f9e5e51f800 20 add_watcher() i=3 2024-09-12T17:57:00.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.822+0000 7f9e5e51f800 20 add_watcher() i=4 2024-09-12T17:57:00.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.822+0000 7f9e5e51f800 20 add_watcher() i=5 2024-09-12T17:57:00.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.822+0000 7f9e5e51f800 20 add_watcher() i=6 2024-09-12T17:57:00.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.823+0000 7f9e5e51f800 20 add_watcher() i=7 2024-09-12T17:57:00.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.823+0000 7f9e5e51f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:00.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.824+0000 7f9d10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:00.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.824+0000 7f9e5e51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:00.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.824+0000 7f9e5e51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:00.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.825+0000 7f9e5e51f800 5 note: GC not initialized 2024-09-12T17:57:00.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.825+0000 7f9c8b7fe640 20 reqs_thread_entry: start 2024-09-12T17:57:00.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.825+0000 7f9e5e51f800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:00.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.825+0000 7f9e5e51f800 20 Filter name: none 2024-09-12T17:57:00.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.825+0000 7f9c897fa640 20 reqs_thread_entry: start 2024-09-12T17:57:00.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.825+0000 7f9e5e51f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:57:00.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.825+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.825+0000 7f9e5e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.825+0000 7f9e5e51f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T17:57:00.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.825+0000 7f9e5e51f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:57:00.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.825+0000 7f9e5e51f800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T17:57:00.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.825+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.826+0000 7f9e5e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.826+0000 7f9e5e51f800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T17:57:00.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.826+0000 7f9e5e51f800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:57:00.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.826+0000 7f9e5e51f800 10 cache get: name=default.rgw.meta+users.keys+VARDMCURPTRWMCQZXYIC : miss 2024-09-12T17:57:00.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.826+0000 7f9e5e51f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.826+0000 7f9e5e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.826+0000 7f9e5e51f800 10 cache put: name=default.rgw.meta+users.keys+VARDMCURPTRWMCQZXYIC info.flags=0x0 2024-09-12T17:57:00.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.826+0000 7f9e5e51f800 10 adding default.rgw.meta+users.keys+VARDMCURPTRWMCQZXYIC to cache LRU end 2024-09-12T17:57:00.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.826+0000 7f9e5e51f800 10 cache get: name=default.rgw.meta+users.keys+VARDMCURPTRWMCQZXYIC : hit (negative entry) 2024-09-12T17:57:00.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.826+0000 7f9e5e51f800 10 cache get: name=default.rgw.meta+users.keys+VARDMCURPTRWMCQZXYIC : hit (negative entry) 2024-09-12T17:57:00.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.827+0000 7f9e5e51f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:57:00.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.827+0000 7f9e5e51f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:57:00.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.827+0000 7f9e5e51f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:57:00.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.828+0000 7f9d3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399023 cookie 94586603237920 notifier 8459 bl.length()=645 2024-09-12T17:57:00.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.828+0000 7f9d3dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:57:00.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.828+0000 7f9d3dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:57:00.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.829+0000 7f9e5e51f800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:57:00.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.829+0000 7f9e5e51f800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:57:00.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.829+0000 7f9e5e51f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T17:57:00.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.829+0000 7f9d3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399002 cookie 94586603259904 notifier 8459 bl.length()=185 2024-09-12T17:57:00.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.829+0000 7f9d3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:57:00.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.829+0000 7f9d3d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:57:00.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.831+0000 7f9e5e51f800 10 cache put: name=default.rgw.meta+users.keys+VARDMCURPTRWMCQZXYIC info.flags=0x7 2024-09-12T17:57:00.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.831+0000 7f9e5e51f800 10 moving default.rgw.meta+users.keys+VARDMCURPTRWMCQZXYIC to cache LRU end 2024-09-12T17:57:00.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.831+0000 7f9e5e51f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:VARDMCURPTRWMCQZXYIC, ofs0, ns] 2024-09-12T17:57:00.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.831+0000 7f9d3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398953 cookie 94586603246256 notifier 8459 bl.length()=186 2024-09-12T17:57:00.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.831+0000 7f9d3dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VARDMCURPTRWMCQZXYIC info.flags=0x7 2024-09-12T17:57:00.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.831+0000 7f9d3dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VARDMCURPTRWMCQZXYIC to cache LRU end 2024-09-12T17:57:00.833 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:57:00.833 INFO:teuthology.orchestra.run.smithi107.stdout: "user_id": "bar.client.0", 2024-09-12T17:57:00.833 INFO:teuthology.orchestra.run.smithi107.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T17:57:00.833 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "bar+test@test.test", 2024-09-12T17:57:00.833 INFO:teuthology.orchestra.run.smithi107.stdout: "suspended": 0, 2024-09-12T17:57:00.833 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:57:00.833 INFO:teuthology.orchestra.run.smithi107.stdout: "subusers": [], 2024-09-12T17:57:00.834 INFO:teuthology.orchestra.run.smithi107.stdout: "keys": [ 2024-09-12T17:57:00.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:57:00.834 INFO:teuthology.orchestra.run.smithi107.stdout: "user": "bar.client.0", 2024-09-12T17:57:00.834 INFO:teuthology.orchestra.run.smithi107.stdout: "access_key": "VARDMCURPTRWMCQZXYIC", 2024-09-12T17:57:00.834 INFO:teuthology.orchestra.run.smithi107.stdout: "secret_key": "W3Cn6d23Kf7Mt/GOnef8/rukJxOtEn4UpBHhC14dOSuR8NV2rj5YXg==", 2024-09-12T17:57:00.834 INFO:teuthology.orchestra.run.smithi107.stdout: "active": true, 2024-09-12T17:57:00.834 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:57:00.827500Z" 2024-09-12T17:57:00.834 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T17:57:00.834 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T17:57:00.834 INFO:teuthology.orchestra.run.smithi107.stdout: "swift_keys": [], 2024-09-12T17:57:00.834 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": [], 2024-09-12T17:57:00.834 INFO:teuthology.orchestra.run.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "default_placement": "", 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "placement_tags": [], 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "user_quota": { 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:00.835 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:00.836 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:00.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:00.836 INFO:teuthology.orchestra.run.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:57:00.836 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "rgw", 2024-09-12T17:57:00.836 INFO:teuthology.orchestra.run.smithi107.stdout: "mfa_ids": [], 2024-09-12T17:57:00.836 INFO:teuthology.orchestra.run.smithi107.stdout: "account_id": "", 2024-09-12T17:57:00.836 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2024-09-12T17:57:00.836 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:57:00.827491Z", 2024-09-12T17:57:00.836 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-09-12T17:57:00.836 INFO:teuthology.orchestra.run.smithi107.stdout: "group_ids": [] 2024-09-12T17:57:00.836 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:57:00.837 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:57:00.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.833+0000 7f9d10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:00.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.835+0000 7f9e5e51f800 20 remove_watcher() i=0 2024-09-12T17:57:00.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.835+0000 7f9e5e51f800 2 removed watcher, disabling cache 2024-09-12T17:57:00.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.836+0000 7f9e5e51f800 20 remove_watcher() i=1 2024-09-12T17:57:00.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.837+0000 7f9e5e51f800 20 remove_watcher() i=2 2024-09-12T17:57:00.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.838+0000 7f9e5e51f800 20 remove_watcher() i=3 2024-09-12T17:57:00.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.839+0000 7f9e5e51f800 20 remove_watcher() i=4 2024-09-12T17:57:00.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.840+0000 7f9e5e51f800 20 remove_watcher() i=5 2024-09-12T17:57:00.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.841+0000 7f9e5e51f800 20 remove_watcher() i=6 2024-09-12T17:57:00.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.842+0000 7f9e5e51f800 20 remove_watcher() i=7 2024-09-12T17:57:00.853 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 1639371125 --totp-seed IXV6NXHCOHLKZQJRPBS7OOMGY53LNWCNACJAIEQGQGCJV2IGIWK3XHLYTRQPBDHF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:57:00.919 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:00.919 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:00.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.950+0000 7faf0dc13800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.951+0000 7faf0dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.951+0000 7faf0dc13800 20 realm 2024-09-12T17:57:00.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.951+0000 7faf0dc13800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.952+0000 7faf0dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.952+0000 7faf0dc13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:00.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.952+0000 7faf0dc13800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.952+0000 7faf0dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:00.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.952+0000 7faf0dc13800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.953+0000 7faf0dc13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:00.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.953+0000 7faf0dc13800 20 rados->read ofs=0 len=0 2024-09-12T17:57:00.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.953+0000 7faf0dc13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:00.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.953+0000 7faf0dc13800 20 searching for the correct realm 2024-09-12T17:57:00.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.956+0000 7faf09348640 0 -- 172.21.15.107:0/2967684584 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7faf0401e040 msgr2=0x7faf0402b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:00.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:00.960+0000 7faf09348640 0 -- 172.21.15.107:0/2967684584 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7faef404f2f0 msgr2=0x7faef40ca2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:01.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.167+0000 7faf0dc13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:01.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.167+0000 7faf0dc13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:01.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.167+0000 7faf0dc13800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:01.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.167+0000 7faf0dc13800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:01.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.167+0000 7faf0dc13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:01.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.167+0000 7faf0dc13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:01.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.167+0000 7faf0dc13800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.167+0000 7faf0dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.167+0000 7faf0dc13800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.168+0000 7faf0dc13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:01.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.168+0000 7faf0dc13800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.168+0000 7faf0dc13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:01.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.168+0000 7faf0dc13800 20 zone default found 2024-09-12T17:57:01.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.168+0000 7faf0dc13800 4 Realm: () 2024-09-12T17:57:01.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.168+0000 7faf0dc13800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:01.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.168+0000 7faf0dc13800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:01.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.168+0000 7faf0dc13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:01.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.168+0000 7faf0dc13800 20 zonegroup default 2024-09-12T17:57:01.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.168+0000 7faf0dc13800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.168+0000 7faf0dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.168+0000 7faf0dc13800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.169+0000 7faf0dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.169+0000 7faf0dc13800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.169+0000 7faf0dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.169+0000 7faf0dc13800 20 started sync module instance, tier type = 2024-09-12T17:57:01.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.169+0000 7faf0dc13800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:01.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.179+0000 7faf0dc13800 20 add_watcher() i=0 2024-09-12T17:57:01.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.179+0000 7faf0dc13800 20 add_watcher() i=1 2024-09-12T17:57:01.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.179+0000 7faf0dc13800 20 add_watcher() i=2 2024-09-12T17:57:01.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.179+0000 7faf0dc13800 20 add_watcher() i=3 2024-09-12T17:57:01.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.179+0000 7faf0dc13800 20 add_watcher() i=4 2024-09-12T17:57:01.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.179+0000 7faf0dc13800 20 add_watcher() i=5 2024-09-12T17:57:01.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.179+0000 7faf0dc13800 20 add_watcher() i=6 2024-09-12T17:57:01.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.180+0000 7faf0dc13800 20 add_watcher() i=7 2024-09-12T17:57:01.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.180+0000 7faf0dc13800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.182+0000 7fadbffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.182+0000 7faf0dc13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.182+0000 7faf0dc13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.182+0000 7faf0dc13800 5 note: GC not initialized 2024-09-12T17:57:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.182+0000 7fadbefe5640 20 reqs_thread_entry: start 2024-09-12T17:57:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.182+0000 7faf0dc13800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.182+0000 7faf0dc13800 20 Filter name: none 2024-09-12T17:57:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.182+0000 7fadbcfe1640 20 reqs_thread_entry: start 2024-09-12T17:57:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.182+0000 7faf0dc13800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:57:01.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.182+0000 7faf0dc13800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.183+0000 7faf0dc13800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:57:01.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.183+0000 7faf0dc13800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T17:57:01.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.183+0000 7faf0dc13800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:57:01.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.183+0000 7faf0dc13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:01.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.186+0000 7faf0dc13800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:57:01.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.186+0000 7faf0dc13800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:57:01.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.186+0000 7faf0dc13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:57:01.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.187+0000 7fadecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399024 cookie 94758237848928 notifier 9060 bl.length()=659 2024-09-12T17:57:01.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.187+0000 7fadecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:57:01.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.187+0000 7fadecff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:57:01.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.188+0000 7fadbffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:01.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.191+0000 7faf0dc13800 20 remove_watcher() i=0 2024-09-12T17:57:01.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.191+0000 7faf0dc13800 2 removed watcher, disabling cache 2024-09-12T17:57:01.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.192+0000 7faf0dc13800 20 remove_watcher() i=1 2024-09-12T17:57:01.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.193+0000 7faf0dc13800 20 remove_watcher() i=2 2024-09-12T17:57:01.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.194+0000 7faf0dc13800 20 remove_watcher() i=3 2024-09-12T17:57:01.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.195+0000 7faf0dc13800 20 remove_watcher() i=4 2024-09-12T17:57:01.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.196+0000 7faf0dc13800 20 remove_watcher() i=5 2024-09-12T17:57:01.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.197+0000 7faf0dc13800 20 remove_watcher() i=6 2024-09-12T17:57:01.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.198+0000 7faf0dc13800 20 remove_watcher() i=7 2024-09-12T17:57:01.209 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T17:57:01.271 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:01.272 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:01.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.510+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.511+0000 7f94af525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.511+0000 7f94af525800 20 realm 2024-09-12T17:57:01.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.511+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.511+0000 7f94af525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.511+0000 7f94af525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:01.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.511+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.511+0000 7f94af525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.511+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.512+0000 7f94af525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:01.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.512+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.513+0000 7f94af525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:01.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.513+0000 7f94af525800 20 searching for the correct realm 2024-09-12T17:57:01.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.522+0000 7f94aa932640 0 -- 172.21.15.107:0/2526906850 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f94a0017070 msgr2=0x7f94a00398d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:01.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.733+0000 7f94ab133640 0 -- 172.21.15.107:0/2526906850 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f94a003ae00 msgr2=0x7f94a0043040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:01.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.943+0000 7f94af525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:01.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.943+0000 7f94af525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:01.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.943+0000 7f94af525800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:01.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.943+0000 7f94af525800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:01.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.943+0000 7f94af525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:01.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.943+0000 7f94af525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:01.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.943+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.943+0000 7f94af525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.943+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.943+0000 7f94af525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:01.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.943+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.944+0000 7f94af525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:01.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.944+0000 7f94af525800 20 zone default found 2024-09-12T17:57:01.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.944+0000 7f94af525800 4 Realm: () 2024-09-12T17:57:01.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.944+0000 7f94af525800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:01.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.944+0000 7f94af525800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:01.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.944+0000 7f94af525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:01.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.944+0000 7f94af525800 20 zonegroup default 2024-09-12T17:57:01.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.944+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.944+0000 7f94af525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.944+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.945+0000 7f94af525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.945+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.945+0000 7f94af525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.945+0000 7f94af525800 20 started sync module instance, tier type = 2024-09-12T17:57:01.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.945+0000 7f94af525800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:01.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.955+0000 7f94af525800 20 add_watcher() i=0 2024-09-12T17:57:01.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.955+0000 7f94af525800 20 add_watcher() i=1 2024-09-12T17:57:01.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.955+0000 7f94af525800 20 add_watcher() i=2 2024-09-12T17:57:01.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.955+0000 7f94af525800 20 add_watcher() i=3 2024-09-12T17:57:01.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.955+0000 7f94af525800 20 add_watcher() i=4 2024-09-12T17:57:01.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.955+0000 7f94af525800 20 add_watcher() i=5 2024-09-12T17:57:01.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.955+0000 7f94af525800 20 add_watcher() i=6 2024-09-12T17:57:01.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.956+0000 7f94af525800 20 add_watcher() i=7 2024-09-12T17:57:01.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.956+0000 7f94af525800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:01.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.958+0000 7f9361fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:01.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.958+0000 7f94af525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:01.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.958+0000 7f94af525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:01.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.958+0000 7f94af525800 5 note: GC not initialized 2024-09-12T17:57:01.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.958+0000 7f9360fe1640 20 reqs_thread_entry: start 2024-09-12T17:57:01.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.958+0000 7f94af525800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:01.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.958+0000 7f94af525800 20 Filter name: none 2024-09-12T17:57:01.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.958+0000 7f92da7fc640 20 reqs_thread_entry: start 2024-09-12T17:57:01.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.959+0000 7f94af525800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T17:57:01.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.959+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.959+0000 7f94af525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.959+0000 7f94af525800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T17:57:01.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.959+0000 7f94af525800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T17:57:01.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.959+0000 7f94af525800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T17:57:01.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.959+0000 7f94af525800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T17:57:01.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.959+0000 7f94af525800 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.959+0000 7f94af525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.959+0000 7f94af525800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T17:57:01.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.959+0000 7f94af525800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T17:57:01.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.959+0000 7f94af525800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T17:57:01.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.961+0000 7f94af525800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T17:57:01.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.961+0000 7f94af525800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T17:57:01.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.961+0000 7f94af525800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T17:57:01.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.961+0000 7f938effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366321 cookie 94735035242176 notifier 8489 bl.length()=389 2024-09-12T17:57:01.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.961+0000 7f938effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T17:57:01.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.961+0000 7f938effd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T17:57:01.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.963+0000 7f94af525800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T17:57:01.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.963+0000 7f94af525800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T17:57:01.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.963+0000 7f94af525800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T17:57:01.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.964+0000 7f938e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366332 cookie 94735035251520 notifier 8489 bl.length()=230 2024-09-12T17:57:01.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.964+0000 7f938e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T17:57:01.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.964+0000 7f938e7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T17:57:01.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.966+0000 7f94af525800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T17:57:01.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.966+0000 7f94af525800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T17:57:01.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.966+0000 7f94af525800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T17:57:01.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.966+0000 7f938e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366250 cookie 94735035235072 notifier 8489 bl.length()=234 2024-09-12T17:57:01.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.966+0000 7f938e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T17:57:01.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.966+0000 7f938e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T17:57:01.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.967+0000 7f9361fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:01.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.969+0000 7f94af525800 20 remove_watcher() i=0 2024-09-12T17:57:01.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.969+0000 7f94af525800 2 removed watcher, disabling cache 2024-09-12T17:57:01.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.970+0000 7f94af525800 20 remove_watcher() i=1 2024-09-12T17:57:01.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.971+0000 7f94af525800 20 remove_watcher() i=2 2024-09-12T17:57:01.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.973+0000 7f94af525800 20 remove_watcher() i=3 2024-09-12T17:57:01.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.974+0000 7f94af525800 20 remove_watcher() i=4 2024-09-12T17:57:01.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.975+0000 7f94af525800 20 remove_watcher() i=5 2024-09-12T17:57:01.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.975+0000 7f94af525800 20 remove_watcher() i=6 2024-09-12T17:57:01.977 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:01.976+0000 7f94af525800 20 remove_watcher() i=7 2024-09-12T17:57:01.986 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:57:01.986 INFO:teuthology.orchestra.run.smithi107.stdout: "id": "RGW33333333333333333", 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "tenant": "testx", 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "quota": { 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "max_users": 1000, 2024-09-12T17:57:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "max_roles": 1000, 2024-09-12T17:57:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "max_groups": 1000, 2024-09-12T17:57:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:57:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "max_access_keys": 4 2024-09-12T17:57:01.988 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:57:01.989 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T17:57:01.989 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key FXNXPNOBXWDYASYVVLJR --secret eNHkFkEPlGE6bWd9nK4d9dGXi6FfGzW4xbP1/xK9Xa38K47CC0S0ow== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T17:57:02.056 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:02.057 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:02.089 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.088+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.089+0000 7f65f680f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.089+0000 7f65f680f800 20 realm 2024-09-12T17:57:02.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.089+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.090+0000 7f65f680f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.090+0000 7f65f680f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:02.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.090+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.090+0000 7f65f680f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.090+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.091+0000 7f65f680f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.091+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.091+0000 7f65f680f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:02.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.091+0000 7f65f680f800 20 searching for the correct realm 2024-09-12T17:57:02.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.094+0000 7f65f2793640 0 -- 172.21.15.107:0/1786729640 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x5564c46518e0 msgr2=0x5564c4653da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:02.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.098+0000 7f65f1f92640 0 -- 172.21.15.107:0/1786729640 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f65e807c020 msgr2=0x7f65e809f0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:02.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.102+0000 7f65f680f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:02.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.102+0000 7f65f680f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:02.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.102+0000 7f65f680f800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:02.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.102+0000 7f65f680f800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:02.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.102+0000 7f65f680f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:02.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.102+0000 7f65f680f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:02.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.102+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.103+0000 7f65f680f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.103+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.103+0000 7f65f680f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.103+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.103+0000 7f65f680f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:02.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.103+0000 7f65f680f800 20 zone default found 2024-09-12T17:57:02.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.103+0000 7f65f680f800 4 Realm: () 2024-09-12T17:57:02.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.103+0000 7f65f680f800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:02.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.103+0000 7f65f680f800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:02.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.103+0000 7f65f680f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:02.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.103+0000 7f65f680f800 20 zonegroup default 2024-09-12T17:57:02.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.103+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.104+0000 7f65f680f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.104+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.104+0000 7f65f680f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.104+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.104+0000 7f65f680f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.104+0000 7f65f680f800 20 started sync module instance, tier type = 2024-09-12T17:57:02.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.104+0000 7f65f680f800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:02.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.114+0000 7f65f680f800 20 add_watcher() i=0 2024-09-12T17:57:02.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.114+0000 7f65f680f800 20 add_watcher() i=1 2024-09-12T17:57:02.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.114+0000 7f65f680f800 20 add_watcher() i=2 2024-09-12T17:57:02.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.114+0000 7f65f680f800 20 add_watcher() i=3 2024-09-12T17:57:02.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.114+0000 7f65f680f800 20 add_watcher() i=4 2024-09-12T17:57:02.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.114+0000 7f65f680f800 20 add_watcher() i=5 2024-09-12T17:57:02.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.114+0000 7f65f680f800 20 add_watcher() i=6 2024-09-12T17:57:02.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.115+0000 7f65f680f800 20 add_watcher() i=7 2024-09-12T17:57:02.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.115+0000 7f65f680f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:02.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.116+0000 7f64a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:02.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.116+0000 7f65f680f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:02.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.116+0000 7f65f680f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:02.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.116+0000 7f65f680f800 5 note: GC not initialized 2024-09-12T17:57:02.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.117+0000 7f64a27fc640 20 reqs_thread_entry: start 2024-09-12T17:57:02.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.117+0000 7f65f680f800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:02.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.117+0000 7f65f680f800 20 Filter name: none 2024-09-12T17:57:02.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.117+0000 7f6413fff640 20 reqs_thread_entry: start 2024-09-12T17:57:02.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.117+0000 7f65f680f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.117+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.117+0000 7f65f680f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.117+0000 7f65f680f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.117+0000 7f65f680f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.117+0000 7f65f680f800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.117+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 10 cache get: name=default.rgw.meta+users.keys+FXNXPNOBXWDYASYVVLJR : miss 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 10 cache put: name=default.rgw.meta+users.keys+FXNXPNOBXWDYASYVVLJR info.flags=0x0 2024-09-12T17:57:02.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 10 adding default.rgw.meta+users.keys+FXNXPNOBXWDYASYVVLJR to cache LRU end 2024-09-12T17:57:02.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T17:57:02.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:02.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T17:57:02.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T17:57:02.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:02.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.118+0000 7f65f680f800 10 cache get: name=default.rgw.meta+users.keys+FXNXPNOBXWDYASYVVLJR : hit (negative entry) 2024-09-12T17:57:02.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.119+0000 7f65f680f800 10 cache get: name=default.rgw.meta+users.keys+FXNXPNOBXWDYASYVVLJR : hit (negative entry) 2024-09-12T17:57:02.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.120+0000 7f65f680f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:57:02.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.120+0000 7f65f680f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:57:02.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.120+0000 7f65f680f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:57:02.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.120+0000 7f64d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366299 cookie 93891280076960 notifier 8504 bl.length()=732 2024-09-12T17:57:02.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.120+0000 7f64d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:57:02.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.120+0000 7f64d57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:57:02.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.122+0000 7f65f680f800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:57:02.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.122+0000 7f65f680f800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:57:02.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.122+0000 7f65f680f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T17:57:02.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.122+0000 7f64d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366240 cookie 93891280079200 notifier 8504 bl.length()=215 2024-09-12T17:57:02.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.122+0000 7f64d4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:57:02.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.122+0000 7f64d4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:57:02.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.124+0000 7f65f680f800 10 cache put: name=default.rgw.meta+users.keys+FXNXPNOBXWDYASYVVLJR info.flags=0x7 2024-09-12T17:57:02.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.124+0000 7f65f680f800 10 moving default.rgw.meta+users.keys+FXNXPNOBXWDYASYVVLJR to cache LRU end 2024-09-12T17:57:02.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.124+0000 7f65f680f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:FXNXPNOBXWDYASYVVLJR, ofs0, ns] 2024-09-12T17:57:02.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.124+0000 7f64d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366300 cookie 93891280073248 notifier 8504 bl.length()=201 2024-09-12T17:57:02.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.124+0000 7f64d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FXNXPNOBXWDYASYVVLJR info.flags=0x7 2024-09-12T17:57:02.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.124+0000 7f64d57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FXNXPNOBXWDYASYVVLJR to cache LRU end 2024-09-12T17:57:02.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.126+0000 7f65f680f800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T17:57:02.127 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:57:02.127 INFO:teuthology.orchestra.run.smithi107.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T17:57:02.127 INFO:teuthology.orchestra.run.smithi107.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T17:57:02.127 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T17:57:02.127 INFO:teuthology.orchestra.run.smithi107.stdout: "suspended": 0, 2024-09-12T17:57:02.127 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: "subusers": [], 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: "keys": [ 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: "access_key": "FXNXPNOBXWDYASYVVLJR", 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: "secret_key": "eNHkFkEPlGE6bWd9nK4d9dGXi6FfGzW4xbP1/xK9Xa38K47CC0S0ow==", 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: "active": true, 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:57:02.120045Z" 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: "swift_keys": [], 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": [], 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:57:02.128 INFO:teuthology.orchestra.run.smithi107.stdout: "default_placement": "", 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "placement_tags": [], 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "user_quota": { 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:02.129 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:02.130 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:02.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:02.130 INFO:teuthology.orchestra.run.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:57:02.130 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "root", 2024-09-12T17:57:02.130 INFO:teuthology.orchestra.run.smithi107.stdout: "mfa_ids": [], 2024-09-12T17:57:02.130 INFO:teuthology.orchestra.run.smithi107.stdout: "account_id": "RGW33333333333333333", 2024-09-12T17:57:02.130 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2024-09-12T17:57:02.130 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:57:02.120027Z", 2024-09-12T17:57:02.130 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-09-12T17:57:02.130 INFO:teuthology.orchestra.run.smithi107.stdout: "group_ids": [] 2024-09-12T17:57:02.130 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:57:02.130 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:57:02.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.127+0000 7f64a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:02.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.129+0000 7f65f680f800 20 remove_watcher() i=0 2024-09-12T17:57:02.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.129+0000 7f65f680f800 2 removed watcher, disabling cache 2024-09-12T17:57:02.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.130+0000 7f65f680f800 20 remove_watcher() i=1 2024-09-12T17:57:02.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.131+0000 7f65f680f800 20 remove_watcher() i=2 2024-09-12T17:57:02.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.132+0000 7f65f680f800 20 remove_watcher() i=3 2024-09-12T17:57:02.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.133+0000 7f65f680f800 20 remove_watcher() i=4 2024-09-12T17:57:02.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.134+0000 7f65f680f800 20 remove_watcher() i=5 2024-09-12T17:57:02.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.135+0000 7f65f680f800 20 remove_watcher() i=6 2024-09-12T17:57:02.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.136+0000 7f65f680f800 20 remove_watcher() i=7 2024-09-12T17:57:02.148 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 3484450295 --totp-seed YKTLDBDIDJU4TJPGZF2Z7JJOAMOI5SGCUSCBRRYZEPNQPNFD3HTHRPHZ7VNKE4PI --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:57:02.214 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:02.214 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:02.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.246+0000 7f736cc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.248+0000 7f736cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.248+0000 7f736cc0e800 20 realm 2024-09-12T17:57:02.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.248+0000 7f736cc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.248+0000 7f736cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.248+0000 7f736cc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:02.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.248+0000 7f736cc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.248+0000 7f736cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.248+0000 7f736cc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.249+0000 7f736cc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.249+0000 7f736cc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.250+0000 7f736cc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:02.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.250+0000 7f736cc0e800 20 searching for the correct realm 2024-09-12T17:57:02.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.253+0000 7f7368a5a640 0 -- 172.21.15.107:0/2653368805 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x563e77026280 msgr2=0x563e77028740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:02.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.256+0000 7f7368259640 0 -- 172.21.15.107:0/2653368805 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f73500dc050 msgr2=0x7f73500093c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:02.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.261+0000 7f736cc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:02.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.261+0000 7f736cc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:02.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.261+0000 7f736cc0e800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.261+0000 7f736cc0e800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.261+0000 7f736cc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.261+0000 7f736cc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.261+0000 7f736cc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.261+0000 7f736cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.261+0000 7f736cc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.261+0000 7f736cc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 20 zone default found 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 4 Realm: () 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:02.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 20 zonegroup default 2024-09-12T17:57:02.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.262+0000 7f736cc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.263+0000 7f736cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.263+0000 7f736cc0e800 20 started sync module instance, tier type = 2024-09-12T17:57:02.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.263+0000 7f736cc0e800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:02.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.272+0000 7f736cc0e800 20 add_watcher() i=0 2024-09-12T17:57:02.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.272+0000 7f736cc0e800 20 add_watcher() i=1 2024-09-12T17:57:02.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.272+0000 7f736cc0e800 20 add_watcher() i=2 2024-09-12T17:57:02.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.272+0000 7f736cc0e800 20 add_watcher() i=3 2024-09-12T17:57:02.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.272+0000 7f736cc0e800 20 add_watcher() i=4 2024-09-12T17:57:02.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.272+0000 7f736cc0e800 20 add_watcher() i=5 2024-09-12T17:57:02.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.272+0000 7f736cc0e800 20 add_watcher() i=6 2024-09-12T17:57:02.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.273+0000 7f736cc0e800 20 add_watcher() i=7 2024-09-12T17:57:02.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.273+0000 7f736cc0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:02.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.274+0000 7f721efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:02.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.274+0000 7f736cc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:02.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.274+0000 7f736cc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:02.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.274+0000 7f736cc0e800 5 note: GC not initialized 2024-09-12T17:57:02.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.275+0000 7f721dfdb640 20 reqs_thread_entry: start 2024-09-12T17:57:02.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.275+0000 7f736cc0e800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:02.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.275+0000 7f736cc0e800 20 Filter name: none 2024-09-12T17:57:02.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.275+0000 7f718f7fe640 20 reqs_thread_entry: start 2024-09-12T17:57:02.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.275+0000 7f736cc0e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:57:02.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.275+0000 7f736cc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.275+0000 7f736cc0e800 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T17:57:02.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.275+0000 7f736cc0e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T17:57:02.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.275+0000 7f736cc0e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:57:02.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.275+0000 7f736cc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:02.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.278+0000 7f736cc0e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:57:02.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.278+0000 7f736cc0e800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:57:02.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.278+0000 7f736cc0e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:57:02.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.278+0000 7f723f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366301 cookie 94826284635536 notifier 9114 bl.length()=746 2024-09-12T17:57:02.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.278+0000 7f723f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:57:02.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.278+0000 7f723f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:57:02.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.280+0000 7f721efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:02.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.282+0000 7f736cc0e800 20 remove_watcher() i=0 2024-09-12T17:57:02.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.282+0000 7f736cc0e800 2 removed watcher, disabling cache 2024-09-12T17:57:02.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.283+0000 7f736cc0e800 20 remove_watcher() i=1 2024-09-12T17:57:02.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.284+0000 7f736cc0e800 20 remove_watcher() i=2 2024-09-12T17:57:02.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.285+0000 7f736cc0e800 20 remove_watcher() i=3 2024-09-12T17:57:02.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.286+0000 7f736cc0e800 20 remove_watcher() i=4 2024-09-12T17:57:02.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.287+0000 7f736cc0e800 20 remove_watcher() i=5 2024-09-12T17:57:02.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.288+0000 7f736cc0e800 20 remove_watcher() i=6 2024-09-12T17:57:02.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.289+0000 7f736cc0e800 20 remove_watcher() i=7 2024-09-12T17:57:02.301 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T17:57:02.301 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key NWOVVCRYXTTUGPTBLZRX --secret XJf0twAgdDDWIwlvBWF6pwyl2Zs2kSStLv1mQHuN9FXMAyMwwNfIsg== --cluster ceph 2024-09-12T17:57:02.365 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:02.365 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:02.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.601+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.603+0000 7ff5e2f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.603+0000 7ff5e2f39800 20 realm 2024-09-12T17:57:02.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.603+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.603+0000 7ff5e2f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.603+0000 7ff5e2f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:02.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.603+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.604+0000 7ff5e2f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.604+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.607+0000 7ff5e2f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.607+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.608+0000 7ff5e2f39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:02.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.608+0000 7ff5e2f39800 20 searching for the correct realm 2024-09-12T17:57:02.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.610+0000 7ff5d7fff640 0 -- 172.21.15.107:0/1134325913 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7ff5c8073010 msgr2=0x7ff5c806a8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:02.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:02.818+0000 7ff5debc7640 0 -- 172.21.15.107:0/1134325913 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7ff5c8073c00 msgr2=0x7ff5c801a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:03.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.025+0000 7ff5e2f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:03.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.025+0000 7ff5e2f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:03.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.025+0000 7ff5e2f39800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:03.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.025+0000 7ff5e2f39800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:03.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.025+0000 7ff5e2f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:03.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.025+0000 7ff5e2f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:03.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.025+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.025+0000 7ff5e2f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.025+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.026+0000 7ff5e2f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:03.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.026+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.026+0000 7ff5e2f39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.026+0000 7ff5e2f39800 20 zone default found 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.026+0000 7ff5e2f39800 4 Realm: () 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.026+0000 7ff5e2f39800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.026+0000 7ff5e2f39800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.026+0000 7ff5e2f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.026+0000 7ff5e2f39800 20 zonegroup default 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.026+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.026+0000 7ff5e2f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.026+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.027+0000 7ff5e2f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.027+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.027+0000 7ff5e2f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.027+0000 7ff5e2f39800 20 started sync module instance, tier type = 2024-09-12T17:57:03.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.027+0000 7ff5e2f39800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:03.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.036+0000 7ff5e2f39800 20 add_watcher() i=0 2024-09-12T17:57:03.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.036+0000 7ff5e2f39800 20 add_watcher() i=1 2024-09-12T17:57:03.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.036+0000 7ff5e2f39800 20 add_watcher() i=2 2024-09-12T17:57:03.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.036+0000 7ff5e2f39800 20 add_watcher() i=3 2024-09-12T17:57:03.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.036+0000 7ff5e2f39800 20 add_watcher() i=4 2024-09-12T17:57:03.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.036+0000 7ff5e2f39800 20 add_watcher() i=5 2024-09-12T17:57:03.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.036+0000 7ff5e2f39800 20 add_watcher() i=6 2024-09-12T17:57:03.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.037+0000 7ff5e2f39800 20 add_watcher() i=7 2024-09-12T17:57:03.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.037+0000 7ff5e2f39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:03.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.039+0000 7ff4957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:03.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.039+0000 7ff5e2f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:03.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.039+0000 7ff5e2f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:03.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.039+0000 7ff5e2f39800 5 note: GC not initialized 2024-09-12T17:57:03.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.039+0000 7ff40ffff640 20 reqs_thread_entry: start 2024-09-12T17:57:03.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.039+0000 7ff5e2f39800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:03.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.039+0000 7ff5e2f39800 20 Filter name: none 2024-09-12T17:57:03.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.039+0000 7ff40dffb640 20 reqs_thread_entry: start 2024-09-12T17:57:03.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:57:03.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T17:57:03.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:57:03.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T17:57:03.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T17:57:03.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:57:03.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 10 cache get: name=default.rgw.meta+users.keys+NWOVVCRYXTTUGPTBLZRX : miss 2024-09-12T17:57:03.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 10 cache put: name=default.rgw.meta+users.keys+NWOVVCRYXTTUGPTBLZRX info.flags=0x0 2024-09-12T17:57:03.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 10 adding default.rgw.meta+users.keys+NWOVVCRYXTTUGPTBLZRX to cache LRU end 2024-09-12T17:57:03.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 10 cache get: name=default.rgw.meta+users.keys+NWOVVCRYXTTUGPTBLZRX : hit (negative entry) 2024-09-12T17:57:03.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.040+0000 7ff5e2f39800 10 cache get: name=default.rgw.meta+users.keys+NWOVVCRYXTTUGPTBLZRX : hit (negative entry) 2024-09-12T17:57:03.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.042+0000 7ff5e2f39800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:57:03.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.042+0000 7ff5e2f39800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:57:03.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.042+0000 7ff5e2f39800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:57:03.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.042+0000 7ff4c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366241 cookie 94808291884768 notifier 8540 bl.length()=660 2024-09-12T17:57:03.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.042+0000 7ff4c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:57:03.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.042+0000 7ff4c27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:57:03.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.044+0000 7ff5e2f39800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:57:03.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.044+0000 7ff5e2f39800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:57:03.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.044+0000 7ff5e2f39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T17:57:03.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.044+0000 7ff4c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366322 cookie 94808291864992 notifier 8540 bl.length()=191 2024-09-12T17:57:03.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.044+0000 7ff4c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:57:03.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.044+0000 7ff4c27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:57:03.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.046+0000 7ff5e2f39800 10 cache put: name=default.rgw.meta+users.keys+NWOVVCRYXTTUGPTBLZRX info.flags=0x7 2024-09-12T17:57:03.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.046+0000 7ff5e2f39800 10 moving default.rgw.meta+users.keys+NWOVVCRYXTTUGPTBLZRX to cache LRU end 2024-09-12T17:57:03.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.046+0000 7ff5e2f39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:NWOVVCRYXTTUGPTBLZRX, ofs0, ns] 2024-09-12T17:57:03.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.046+0000 7ff4c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366251 cookie 94808291858176 notifier 8540 bl.length()=189 2024-09-12T17:57:03.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.046+0000 7ff4c1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NWOVVCRYXTTUGPTBLZRX info.flags=0x7 2024-09-12T17:57:03.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.046+0000 7ff4c1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NWOVVCRYXTTUGPTBLZRX to cache LRU end 2024-09-12T17:57:03.049 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:57:03.049 INFO:teuthology.orchestra.run.smithi107.stdout: "user_id": "foobar.client.0", 2024-09-12T17:57:03.049 INFO:teuthology.orchestra.run.smithi107.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:57:03.049 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "foobar+test@test.test", 2024-09-12T17:57:03.049 INFO:teuthology.orchestra.run.smithi107.stdout: "suspended": 0, 2024-09-12T17:57:03.049 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:57:03.049 INFO:teuthology.orchestra.run.smithi107.stdout: "subusers": [], 2024-09-12T17:57:03.049 INFO:teuthology.orchestra.run.smithi107.stdout: "keys": [ 2024-09-12T17:57:03.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: "user": "foobar.client.0", 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: "access_key": "NWOVVCRYXTTUGPTBLZRX", 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: "secret_key": "XJf0twAgdDDWIwlvBWF6pwyl2Zs2kSStLv1mQHuN9FXMAyMwwNfIsg==", 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: "active": true, 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:57:03.041963Z" 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: "swift_keys": [], 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": [], 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: "default_placement": "", 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:57:03.050 INFO:teuthology.orchestra.run.smithi107.stdout: "placement_tags": [], 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: "user_quota": { 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:03.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:03.052 INFO:teuthology.orchestra.run.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:57:03.052 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "rgw", 2024-09-12T17:57:03.052 INFO:teuthology.orchestra.run.smithi107.stdout: "mfa_ids": [], 2024-09-12T17:57:03.052 INFO:teuthology.orchestra.run.smithi107.stdout: "account_id": "", 2024-09-12T17:57:03.052 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2024-09-12T17:57:03.052 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:57:03.041948Z", 2024-09-12T17:57:03.052 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-09-12T17:57:03.052 INFO:teuthology.orchestra.run.smithi107.stdout: "group_ids": [] 2024-09-12T17:57:03.052 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:57:03.052 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:57:03.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.047+0000 7ff4957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:03.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.049+0000 7ff5e2f39800 20 remove_watcher() i=0 2024-09-12T17:57:03.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.049+0000 7ff5e2f39800 2 removed watcher, disabling cache 2024-09-12T17:57:03.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.051+0000 7ff5e2f39800 20 remove_watcher() i=1 2024-09-12T17:57:03.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.052+0000 7ff5e2f39800 20 remove_watcher() i=2 2024-09-12T17:57:03.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.053+0000 7ff5e2f39800 20 remove_watcher() i=3 2024-09-12T17:57:03.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.054+0000 7ff5e2f39800 20 remove_watcher() i=4 2024-09-12T17:57:03.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.055+0000 7ff5e2f39800 20 remove_watcher() i=5 2024-09-12T17:57:03.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.056+0000 7ff5e2f39800 20 remove_watcher() i=6 2024-09-12T17:57:03.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.056+0000 7ff5e2f39800 20 remove_watcher() i=7 2024-09-12T17:57:03.068 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 8847646956 --totp-seed Z3QN4IM37TQET4ZS4GPXMXW43NCIIN26ID4TZVKY3F7FSFPGRELGNTTKETD2SKFC --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:57:03.133 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:03.134 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:03.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.165+0000 7f5491342800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.167+0000 7f5491342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.167+0000 7f5491342800 20 realm 2024-09-12T17:57:03.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.167+0000 7f5491342800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.167+0000 7f5491342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.167+0000 7f5491342800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:03.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.167+0000 7f5491342800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.167+0000 7f5491342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.167+0000 7f5491342800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.168+0000 7f5491342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:03.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.168+0000 7f5491342800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.169+0000 7f5491342800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:03.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.169+0000 7f5491342800 20 searching for the correct realm 2024-09-12T17:57:03.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.171+0000 7f548488c640 0 -- 172.21.15.107:0/2855816902 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f5478017070 msgr2=0x7f54780881f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:03.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.175+0000 7f548d08d640 0 -- 172.21.15.107:0/2855816902 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f547800e070 msgr2=0x7f5478046a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:03.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.382+0000 7f5491342800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:03.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.382+0000 7f5491342800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:03.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.382+0000 7f5491342800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:03.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.382+0000 7f5491342800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:03.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.382+0000 7f5491342800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:03.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.382+0000 7f5491342800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:03.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.382+0000 7f5491342800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.382+0000 7f5491342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.382+0000 7f5491342800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.383+0000 7f5491342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:03.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.383+0000 7f5491342800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.383+0000 7f5491342800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:03.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.383+0000 7f5491342800 20 zone default found 2024-09-12T17:57:03.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.383+0000 7f5491342800 4 Realm: () 2024-09-12T17:57:03.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.383+0000 7f5491342800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:03.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.383+0000 7f5491342800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:03.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.383+0000 7f5491342800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:03.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.383+0000 7f5491342800 20 zonegroup default 2024-09-12T17:57:03.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.383+0000 7f5491342800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.383+0000 7f5491342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.383+0000 7f5491342800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.384+0000 7f5491342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.384+0000 7f5491342800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.384+0000 7f5491342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.384+0000 7f5491342800 20 started sync module instance, tier type = 2024-09-12T17:57:03.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.384+0000 7f5491342800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:03.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.393+0000 7f5491342800 20 add_watcher() i=0 2024-09-12T17:57:03.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.393+0000 7f5491342800 20 add_watcher() i=1 2024-09-12T17:57:03.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.393+0000 7f5491342800 20 add_watcher() i=2 2024-09-12T17:57:03.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.393+0000 7f5491342800 20 add_watcher() i=3 2024-09-12T17:57:03.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.393+0000 7f5491342800 20 add_watcher() i=4 2024-09-12T17:57:03.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.393+0000 7f5491342800 20 add_watcher() i=5 2024-09-12T17:57:03.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.393+0000 7f5491342800 20 add_watcher() i=6 2024-09-12T17:57:03.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.394+0000 7f5491342800 20 add_watcher() i=7 2024-09-12T17:57:03.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.394+0000 7f5491342800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:03.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.396+0000 7f53437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:03.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.396+0000 7f5491342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:03.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.396+0000 7f5491342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:03.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.396+0000 7f5491342800 5 note: GC not initialized 2024-09-12T17:57:03.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.396+0000 7f53427e4640 20 reqs_thread_entry: start 2024-09-12T17:57:03.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.396+0000 7f5491342800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:03.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.396+0000 7f5491342800 20 Filter name: none 2024-09-12T17:57:03.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.396+0000 7f52b3fff640 20 reqs_thread_entry: start 2024-09-12T17:57:03.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.396+0000 7f5491342800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:57:03.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.396+0000 7f5491342800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.397+0000 7f5491342800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T17:57:03.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.397+0000 7f5491342800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:57:03.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.397+0000 7f5491342800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:57:03.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.397+0000 7f5491342800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:03.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.400+0000 7f5491342800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:57:03.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.400+0000 7f5491342800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:57:03.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.400+0000 7f5491342800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:57:03.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.400+0000 7f5370ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366242 cookie 93860459201328 notifier 9147 bl.length()=674 2024-09-12T17:57:03.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.400+0000 7f5370ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:57:03.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.400+0000 7f5370ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:57:03.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.401+0000 7f53437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:03.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.403+0000 7f5491342800 20 remove_watcher() i=0 2024-09-12T17:57:03.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.403+0000 7f5491342800 2 removed watcher, disabling cache 2024-09-12T17:57:03.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.405+0000 7f5491342800 20 remove_watcher() i=1 2024-09-12T17:57:03.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.406+0000 7f5491342800 20 remove_watcher() i=2 2024-09-12T17:57:03.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.407+0000 7f5491342800 20 remove_watcher() i=3 2024-09-12T17:57:03.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.409+0000 7f5491342800 20 remove_watcher() i=4 2024-09-12T17:57:03.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.410+0000 7f5491342800 20 remove_watcher() i=5 2024-09-12T17:57:03.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.411+0000 7f5491342800 20 remove_watcher() i=6 2024-09-12T17:57:03.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.412+0000 7f5491342800 20 remove_watcher() i=7 2024-09-12T17:57:03.423 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T17:57:03.482 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:03.482 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:03.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.514+0000 7f3ae9614800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.515+0000 7f3ae9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.515+0000 7f3ae9614800 20 realm 2024-09-12T17:57:03.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.515+0000 7f3ae9614800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.515+0000 7f3ae9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.515+0000 7f3ae9614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:03.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.515+0000 7f3ae9614800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.515+0000 7f3ae9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.516+0000 7f3ae9614800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.516+0000 7f3ae9614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:03.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.516+0000 7f3ae9614800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.517+0000 7f3ae9614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:03.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.517+0000 7f3ae9614800 20 searching for the correct realm 2024-09-12T17:57:03.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.520+0000 7f3adffff640 0 -- 172.21.15.107:0/4213885861 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f3ad00727d0 msgr2=0x7f3ad0088450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:03.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.523+0000 7f3ae4ccb640 0 -- 172.21.15.107:0/4213885861 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f3ad006cbb0 msgr2=0x7f3ad0088450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:03.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.729+0000 7f3ae9614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:03.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.729+0000 7f3ae9614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:03.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.729+0000 7f3ae9614800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:03.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.729+0000 7f3ae9614800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:03.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.729+0000 7f3ae9614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:03.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.729+0000 7f3ae9614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:03.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.729+0000 7f3ae9614800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.729+0000 7f3ae9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.729+0000 7f3ae9614800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.730+0000 7f3ae9614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:03.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.730+0000 7f3ae9614800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.730+0000 7f3ae9614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:03.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.730+0000 7f3ae9614800 20 zone default found 2024-09-12T17:57:03.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.730+0000 7f3ae9614800 4 Realm: () 2024-09-12T17:57:03.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.730+0000 7f3ae9614800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:03.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.730+0000 7f3ae9614800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:03.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.730+0000 7f3ae9614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:03.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.730+0000 7f3ae9614800 20 zonegroup default 2024-09-12T17:57:03.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.730+0000 7f3ae9614800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.731+0000 7f3ae9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.731+0000 7f3ae9614800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.731+0000 7f3ae9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.731+0000 7f3ae9614800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.731+0000 7f3ae9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.732+0000 7f3ae9614800 20 started sync module instance, tier type = 2024-09-12T17:57:03.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.732+0000 7f3ae9614800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:03.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.741+0000 7f3ae9614800 20 add_watcher() i=0 2024-09-12T17:57:03.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.741+0000 7f3ae9614800 20 add_watcher() i=1 2024-09-12T17:57:03.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.741+0000 7f3ae9614800 20 add_watcher() i=2 2024-09-12T17:57:03.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.741+0000 7f3ae9614800 20 add_watcher() i=3 2024-09-12T17:57:03.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.741+0000 7f3ae9614800 20 add_watcher() i=4 2024-09-12T17:57:03.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.741+0000 7f3ae9614800 20 add_watcher() i=5 2024-09-12T17:57:03.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.741+0000 7f3ae9614800 20 add_watcher() i=6 2024-09-12T17:57:03.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.742+0000 7f3ae9614800 20 add_watcher() i=7 2024-09-12T17:57:03.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.742+0000 7f3ae9614800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:03.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.744+0000 7f399afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:03.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.744+0000 7f3ae9614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:03.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.744+0000 7f3ae9614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.744+0000 7f3ae9614800 5 note: GC not initialized 2024-09-12T17:57:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.744+0000 7f3999fe3640 20 reqs_thread_entry: start 2024-09-12T17:57:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.744+0000 7f3ae9614800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.744+0000 7f3ae9614800 20 Filter name: none 2024-09-12T17:57:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.744+0000 7f390b7fe640 20 reqs_thread_entry: start 2024-09-12T17:57:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.744+0000 7f3ae9614800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:57:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.744+0000 7f3ae9614800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.745+0000 7f3ae9614800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:57:03.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.745+0000 7f3ae9614800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:57:03.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.745+0000 7f3ae9614800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:57:03.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.745+0000 7f3ae9614800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:03.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.746+0000 7f3ae9614800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:57:03.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.746+0000 7f3ae9614800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:57:03.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.746+0000 7f3ae9614800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:57:03.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.746+0000 7f39bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366243 cookie 94658190321264 notifier 8576 bl.length()=727 2024-09-12T17:57:03.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.746+0000 7f39bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:57:03.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.746+0000 7f39bbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:57:03.748 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:57:03.748 INFO:teuthology.orchestra.run.smithi107.stdout: "user_id": "foobar.client.0", 2024-09-12T17:57:03.748 INFO:teuthology.orchestra.run.smithi107.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:57:03.748 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "foobar+test@test.test", 2024-09-12T17:57:03.748 INFO:teuthology.orchestra.run.smithi107.stdout: "suspended": 0, 2024-09-12T17:57:03.748 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:57:03.748 INFO:teuthology.orchestra.run.smithi107.stdout: "subusers": [], 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: "keys": [ 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: "user": "foobar.client.0", 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: "access_key": "NWOVVCRYXTTUGPTBLZRX", 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: "secret_key": "XJf0twAgdDDWIwlvBWF6pwyl2Zs2kSStLv1mQHuN9FXMAyMwwNfIsg==", 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: "active": true, 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:57:03.041963Z" 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: "swift_keys": [], 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": [ 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "oidc-provider", 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: "perm": "*" 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:03.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "roles", 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: "perm": "*" 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "user-policy", 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: "perm": "*" 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: "default_placement": "", 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: "placement_tags": [], 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:03.750 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "user_quota": { 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "rgw", 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "mfa_ids": [ 2024-09-12T17:57:03.751 INFO:teuthology.orchestra.run.smithi107.stdout: "8847646956" 2024-09-12T17:57:03.752 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T17:57:03.752 INFO:teuthology.orchestra.run.smithi107.stdout: "account_id": "", 2024-09-12T17:57:03.752 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2024-09-12T17:57:03.752 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:57:03.041948Z", 2024-09-12T17:57:03.752 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-09-12T17:57:03.752 INFO:teuthology.orchestra.run.smithi107.stdout: "group_ids": [] 2024-09-12T17:57:03.752 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:57:03.752 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:57:03.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.748+0000 7f399afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:03.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.750+0000 7f3ae9614800 20 remove_watcher() i=0 2024-09-12T17:57:03.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.750+0000 7f3ae9614800 2 removed watcher, disabling cache 2024-09-12T17:57:03.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.751+0000 7f3ae9614800 20 remove_watcher() i=1 2024-09-12T17:57:03.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.752+0000 7f3ae9614800 20 remove_watcher() i=2 2024-09-12T17:57:03.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.753+0000 7f3ae9614800 20 remove_watcher() i=3 2024-09-12T17:57:03.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.755+0000 7f3ae9614800 20 remove_watcher() i=4 2024-09-12T17:57:03.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.756+0000 7f3ae9614800 20 remove_watcher() i=5 2024-09-12T17:57:03.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.757+0000 7f3ae9614800 20 remove_watcher() i=6 2024-09-12T17:57:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.757+0000 7f3ae9614800 20 remove_watcher() i=7 2024-09-12T17:57:03.769 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T17:57:03.829 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:03.829 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:03.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.861+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.863+0000 7f40e2e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.863+0000 7f40e2e40800 20 realm 2024-09-12T17:57:03.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.863+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.863+0000 7f40e2e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.863+0000 7f40e2e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:03.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.863+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.863+0000 7f40e2e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.863+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.864+0000 7f40e2e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:03.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.864+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.865+0000 7f40e2e40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:03.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.865+0000 7f40e2e40800 20 searching for the correct realm 2024-09-12T17:57:03.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.867+0000 7f40e112b640 0 -- 172.21.15.107:0/3862025207 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55fc43ad74a0 msgr2=0x55fc43ad9960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:03.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.871+0000 7f40e092a640 0 -- 172.21.15.107:0/3862025207 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f40d40e4880 msgr2=0x7f40d40d31e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:03.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.876+0000 7f40e2e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:03.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.876+0000 7f40e2e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:03.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.876+0000 7f40e2e40800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:03.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.876+0000 7f40e2e40800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:03.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.876+0000 7f40e2e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:03.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.876+0000 7f40e2e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:03.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.876+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.876+0000 7f40e2e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.876+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.876+0000 7f40e2e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:03.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.876+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:03.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 20 zone default found 2024-09-12T17:57:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 4 Realm: () 2024-09-12T17:57:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 20 zonegroup default 2024-09-12T17:57:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 20 started sync module instance, tier type = 2024-09-12T17:57:03.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.877+0000 7f40e2e40800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:03.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.886+0000 7f40e2e40800 20 add_watcher() i=0 2024-09-12T17:57:03.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.886+0000 7f40e2e40800 20 add_watcher() i=1 2024-09-12T17:57:03.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.886+0000 7f40e2e40800 20 add_watcher() i=2 2024-09-12T17:57:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.886+0000 7f40e2e40800 20 add_watcher() i=3 2024-09-12T17:57:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.886+0000 7f40e2e40800 20 add_watcher() i=4 2024-09-12T17:57:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.886+0000 7f40e2e40800 20 add_watcher() i=5 2024-09-12T17:57:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.886+0000 7f40e2e40800 20 add_watcher() i=6 2024-09-12T17:57:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.887+0000 7f40e2e40800 20 add_watcher() i=7 2024-09-12T17:57:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.887+0000 7f40e2e40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:03.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.889+0000 7f3f96fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:03.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.889+0000 7f40e2e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:03.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.889+0000 7f40e2e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:03.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.889+0000 7f40e2e40800 5 note: GC not initialized 2024-09-12T17:57:03.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.889+0000 7f3f95fe3640 20 reqs_thread_entry: start 2024-09-12T17:57:03.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.889+0000 7f40e2e40800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:03.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.889+0000 7f40e2e40800 20 Filter name: none 2024-09-12T17:57:03.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.889+0000 7f3f077fe640 20 reqs_thread_entry: start 2024-09-12T17:57:03.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.889+0000 7f40e2e40800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T17:57:03.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.889+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.890+0000 7f40e2e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.890+0000 7f40e2e40800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T17:57:03.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.890+0000 7f40e2e40800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:57:03.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.890+0000 7f40e2e40800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T17:57:03.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.890+0000 7f40e2e40800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T17:57:03.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.890+0000 7f40e2e40800 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.890+0000 7f40e2e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.890+0000 7f40e2e40800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T17:57:03.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.890+0000 7f40e2e40800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:57:03.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.890+0000 7f40e2e40800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T17:57:03.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.891+0000 7f40e2e40800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:57:03.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.891+0000 7f40e2e40800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:57:03.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.891+0000 7f40e2e40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T17:57:03.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.892+0000 7f3fb7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366323 cookie 94541955565888 notifier 9183 bl.length()=384 2024-09-12T17:57:03.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.892+0000 7f3fb7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:57:03.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.892+0000 7f3fb7fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:57:03.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.894+0000 7f40e2e40800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:57:03.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.894+0000 7f40e2e40800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:57:03.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.894+0000 7f40e2e40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T17:57:03.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.894+0000 7f3fb7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366333 cookie 94541955582160 notifier 9183 bl.length()=225 2024-09-12T17:57:03.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.894+0000 7f3fb7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:57:03.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.894+0000 7f3fb7fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:57:03.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.896+0000 7f40e2e40800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:57:03.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.896+0000 7f40e2e40800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:57:03.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.896+0000 7f40e2e40800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T17:57:03.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.896+0000 7f3fb77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366252 cookie 94541955573136 notifier 9183 bl.length()=234 2024-09-12T17:57:03.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.896+0000 7f3fb77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:57:03.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.896+0000 7f3fb77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:57:03.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.897+0000 7f3f96fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:03.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.900+0000 7f40e2e40800 20 remove_watcher() i=0 2024-09-12T17:57:03.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.900+0000 7f40e2e40800 2 removed watcher, disabling cache 2024-09-12T17:57:03.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.901+0000 7f40e2e40800 20 remove_watcher() i=1 2024-09-12T17:57:03.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.902+0000 7f40e2e40800 20 remove_watcher() i=2 2024-09-12T17:57:03.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.903+0000 7f40e2e40800 20 remove_watcher() i=3 2024-09-12T17:57:03.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.904+0000 7f40e2e40800 20 remove_watcher() i=4 2024-09-12T17:57:03.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.905+0000 7f40e2e40800 20 remove_watcher() i=5 2024-09-12T17:57:03.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.906+0000 7f40e2e40800 20 remove_watcher() i=6 2024-09-12T17:57:03.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:03.907+0000 7f40e2e40800 20 remove_watcher() i=7 2024-09-12T17:57:03.917 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:57:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "id": "RGW88888888888888888", 2024-09-12T17:57:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "tenant": "", 2024-09-12T17:57:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T17:57:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T17:57:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "quota": { 2024-09-12T17:57:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max_users": 1000, 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max_roles": 1000, 2024-09-12T17:57:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max_groups": 1000, 2024-09-12T17:57:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:57:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: "max_access_keys": 4 2024-09-12T17:57:03.919 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:57:03.920 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T17:57:03.920 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key LRZOTYOUMGZVYKRVEPAF --secret DWlKhm/8cPOJ4wqrpg+6+vLM8vigeYgEUoQbthPSX+E3zfTHC4bPeg== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T17:57:03.987 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:03.987 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:04.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.019+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.020+0000 7eff22ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.020+0000 7eff22ebb800 20 realm 2024-09-12T17:57:04.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.020+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.021+0000 7eff22ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.021+0000 7eff22ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:04.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.021+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.021+0000 7eff22ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.021+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.022+0000 7eff22ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:04.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.022+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.022+0000 7eff22ebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:04.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.022+0000 7eff22ebb800 20 searching for the correct realm 2024-09-12T17:57:04.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.026+0000 7eff1bfff640 0 -- 172.21.15.107:0/2502319209 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7eff0c018070 msgr2=0x7eff0c06c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:04.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.030+0000 7eff209a5640 0 -- 172.21.15.107:0/2502319209 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7eff1c00ac20 msgr2=0x7eff1c027940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:04.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.034+0000 7eff22ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:04.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.034+0000 7eff22ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:04.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.034+0000 7eff22ebb800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:04.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.034+0000 7eff22ebb800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:04.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.034+0000 7eff22ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:04.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.034+0000 7eff22ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:04.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.034+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.034+0000 7eff22ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.034+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.034+0000 7eff22ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:04.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.034+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.035+0000 7eff22ebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:04.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.035+0000 7eff22ebb800 20 zone default found 2024-09-12T17:57:04.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.035+0000 7eff22ebb800 4 Realm: () 2024-09-12T17:57:04.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.035+0000 7eff22ebb800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:04.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.035+0000 7eff22ebb800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:04.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.035+0000 7eff22ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:04.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.035+0000 7eff22ebb800 20 zonegroup default 2024-09-12T17:57:04.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.035+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.035+0000 7eff22ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.035+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.035+0000 7eff22ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.035+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.036+0000 7eff22ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.036+0000 7eff22ebb800 20 started sync module instance, tier type = 2024-09-12T17:57:04.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.036+0000 7eff22ebb800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:04.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.045+0000 7eff22ebb800 20 add_watcher() i=0 2024-09-12T17:57:04.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.045+0000 7eff22ebb800 20 add_watcher() i=1 2024-09-12T17:57:04.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.045+0000 7eff22ebb800 20 add_watcher() i=2 2024-09-12T17:57:04.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.045+0000 7eff22ebb800 20 add_watcher() i=3 2024-09-12T17:57:04.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.045+0000 7eff22ebb800 20 add_watcher() i=4 2024-09-12T17:57:04.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.045+0000 7eff22ebb800 20 add_watcher() i=5 2024-09-12T17:57:04.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.045+0000 7eff22ebb800 20 add_watcher() i=6 2024-09-12T17:57:04.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.046+0000 7eff22ebb800 20 add_watcher() i=7 2024-09-12T17:57:04.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.046+0000 7eff22ebb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:04.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.047+0000 7efdd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:04.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.047+0000 7eff22ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:04.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.047+0000 7eff22ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:04.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.047+0000 7eff22ebb800 5 note: GC not initialized 2024-09-12T17:57:04.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7efdd5fe3640 20 reqs_thread_entry: start 2024-09-12T17:57:04.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:04.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 20 Filter name: none 2024-09-12T17:57:04.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7efd477fe640 20 reqs_thread_entry: start 2024-09-12T17:57:04.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:57:04.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T17:57:04.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:57:04.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T17:57:04.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T17:57:04.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:57:04.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 10 cache get: name=default.rgw.meta+users.keys+LRZOTYOUMGZVYKRVEPAF : miss 2024-09-12T17:57:04.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.048+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.049+0000 7eff22ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.049+0000 7eff22ebb800 10 cache put: name=default.rgw.meta+users.keys+LRZOTYOUMGZVYKRVEPAF info.flags=0x0 2024-09-12T17:57:04.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.049+0000 7eff22ebb800 10 adding default.rgw.meta+users.keys+LRZOTYOUMGZVYKRVEPAF to cache LRU end 2024-09-12T17:57:04.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.049+0000 7eff22ebb800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T17:57:04.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.049+0000 7eff22ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.049+0000 7eff22ebb800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:57:04.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.049+0000 7eff22ebb800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:57:04.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.049+0000 7eff22ebb800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:57:04.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.049+0000 7eff22ebb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:04.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.049+0000 7eff22ebb800 10 cache get: name=default.rgw.meta+users.keys+LRZOTYOUMGZVYKRVEPAF : hit (negative entry) 2024-09-12T17:57:04.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.049+0000 7eff22ebb800 10 cache get: name=default.rgw.meta+users.keys+LRZOTYOUMGZVYKRVEPAF : hit (negative entry) 2024-09-12T17:57:04.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.051+0000 7eff22ebb800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:57:04.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.051+0000 7eff22ebb800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:57:04.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.051+0000 7eff22ebb800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:57:04.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.052+0000 7efdf7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366324 cookie 94269047225776 notifier 8609 bl.length()=681 2024-09-12T17:57:04.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.052+0000 7efdf7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:57:04.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.052+0000 7efdf7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:57:04.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.053+0000 7eff22ebb800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:57:04.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.053+0000 7eff22ebb800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:57:04.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.053+0000 7eff22ebb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T17:57:04.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.053+0000 7efdf77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366302 cookie 94269047235488 notifier 8609 bl.length()=189 2024-09-12T17:57:04.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.053+0000 7efdf77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:57:04.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.053+0000 7efdf77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:57:04.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.055+0000 7eff22ebb800 10 cache put: name=default.rgw.meta+users.keys+LRZOTYOUMGZVYKRVEPAF info.flags=0x7 2024-09-12T17:57:04.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.055+0000 7eff22ebb800 10 moving default.rgw.meta+users.keys+LRZOTYOUMGZVYKRVEPAF to cache LRU end 2024-09-12T17:57:04.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.055+0000 7eff22ebb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:LRZOTYOUMGZVYKRVEPAF, ofs0, ns] 2024-09-12T17:57:04.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.055+0000 7efdf7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366334 cookie 94269047234432 notifier 8609 bl.length()=188 2024-09-12T17:57:04.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.055+0000 7efdf7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LRZOTYOUMGZVYKRVEPAF info.flags=0x7 2024-09-12T17:57:04.057 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.055+0000 7efdf7fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LRZOTYOUMGZVYKRVEPAF to cache LRU end 2024-09-12T17:57:04.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.057+0000 7eff22ebb800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T17:57:04.058 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:57:04.058 INFO:teuthology.orchestra.run.smithi107.stdout: "user_id": "root1.client.0", 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "root1+test@test.test", 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: "suspended": 0, 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: "subusers": [], 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: "keys": [ 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: "user": "root1.client.0", 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: "access_key": "LRZOTYOUMGZVYKRVEPAF", 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: "secret_key": "DWlKhm/8cPOJ4wqrpg+6+vLM8vigeYgEUoQbthPSX+E3zfTHC4bPeg==", 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: "active": true, 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:57:04.050990Z" 2024-09-12T17:57:04.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: "swift_keys": [], 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": [], 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: "default_placement": "", 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: "placement_tags": [], 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:04.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "user_quota": { 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "root", 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "mfa_ids": [], 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "account_id": "RGW88888888888888888", 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:57:04.050980Z", 2024-09-12T17:57:04.061 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-09-12T17:57:04.062 INFO:teuthology.orchestra.run.smithi107.stdout: "group_ids": [] 2024-09-12T17:57:04.062 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:57:04.062 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:57:04.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.058+0000 7efdd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:04.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.060+0000 7eff22ebb800 20 remove_watcher() i=0 2024-09-12T17:57:04.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.060+0000 7eff22ebb800 2 removed watcher, disabling cache 2024-09-12T17:57:04.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.061+0000 7eff22ebb800 20 remove_watcher() i=1 2024-09-12T17:57:04.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.062+0000 7eff22ebb800 20 remove_watcher() i=2 2024-09-12T17:57:04.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.064+0000 7eff22ebb800 20 remove_watcher() i=3 2024-09-12T17:57:04.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.065+0000 7eff22ebb800 20 remove_watcher() i=4 2024-09-12T17:57:04.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.066+0000 7eff22ebb800 20 remove_watcher() i=5 2024-09-12T17:57:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.066+0000 7eff22ebb800 20 remove_watcher() i=6 2024-09-12T17:57:04.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.067+0000 7eff22ebb800 20 remove_watcher() i=7 2024-09-12T17:57:04.079 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 2733917126 --totp-seed K6OU5DMY7DDUVS5YBOR7XUGRECWF5MC7LEPS3NR3TNAH6KVNIMP7X2MTJYA6IKQW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:57:04.145 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:04.145 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:04.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.177+0000 7face1d35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.178+0000 7face1d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.178+0000 7face1d35800 20 realm 2024-09-12T17:57:04.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.178+0000 7face1d35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.179+0000 7face1d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.179+0000 7face1d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:04.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.179+0000 7face1d35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.179+0000 7face1d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.179+0000 7face1d35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.180+0000 7face1d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:04.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.180+0000 7face1d35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.180+0000 7face1d35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:04.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.180+0000 7face1d35800 20 searching for the correct realm 2024-09-12T17:57:04.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.184+0000 7facd7fff640 0 -- 172.21.15.107:0/2236410754 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7facc804a040 msgr2=0x7facc8049410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:04.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.187+0000 7facde222640 0 -- 172.21.15.107:0/2236410754 >> [v2:172.21.15.148:6810/1396481160,v1:172.21.15.148:6811/1396481160] conn(0x7facc800b040 msgr2=0x7facc803c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:04.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.191+0000 7face1d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:04.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.191+0000 7face1d35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:04.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.191+0000 7face1d35800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:04.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.191+0000 7face1d35800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:04.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.191+0000 7face1d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:04.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.191+0000 7face1d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:04.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.191+0000 7face1d35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.191+0000 7face1d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.191+0000 7face1d35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.191+0000 7face1d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:04.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 20 zone default found 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 4 Realm: () 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 20 zonegroup default 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.192+0000 7face1d35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.193+0000 7face1d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.193+0000 7face1d35800 20 started sync module instance, tier type = 2024-09-12T17:57:04.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.193+0000 7face1d35800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:04.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.201+0000 7face1d35800 20 add_watcher() i=0 2024-09-12T17:57:04.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.201+0000 7face1d35800 20 add_watcher() i=1 2024-09-12T17:57:04.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.201+0000 7face1d35800 20 add_watcher() i=2 2024-09-12T17:57:04.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.201+0000 7face1d35800 20 add_watcher() i=3 2024-09-12T17:57:04.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.201+0000 7face1d35800 20 add_watcher() i=4 2024-09-12T17:57:04.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.201+0000 7face1d35800 20 add_watcher() i=5 2024-09-12T17:57:04.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.201+0000 7face1d35800 20 add_watcher() i=6 2024-09-12T17:57:04.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.202+0000 7face1d35800 20 add_watcher() i=7 2024-09-12T17:57:04.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.202+0000 7face1d35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:04.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.204+0000 7fab8ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:04.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.204+0000 7face1d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:04.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.204+0000 7face1d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:04.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.204+0000 7face1d35800 5 note: GC not initialized 2024-09-12T17:57:04.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.204+0000 7fab8effd640 20 reqs_thread_entry: start 2024-09-12T17:57:04.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.204+0000 7face1d35800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:04.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.204+0000 7face1d35800 20 Filter name: none 2024-09-12T17:57:04.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.204+0000 7fab8cff9640 20 reqs_thread_entry: start 2024-09-12T17:57:04.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.205+0000 7face1d35800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:57:04.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.205+0000 7face1d35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.205+0000 7face1d35800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:57:04.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.205+0000 7face1d35800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T17:57:04.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.205+0000 7face1d35800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:57:04.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.205+0000 7face1d35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:04.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.207+0000 7face1d35800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:57:04.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.207+0000 7face1d35800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:57:04.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.207+0000 7face1d35800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:57:04.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.208+0000 7fabc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366325 cookie 93974705348016 notifier 9222 bl.length()=695 2024-09-12T17:57:04.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.208+0000 7fabc17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:57:04.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.208+0000 7fabc17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:57:04.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.210+0000 7fab8ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:04.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.212+0000 7face1d35800 20 remove_watcher() i=0 2024-09-12T17:57:04.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.212+0000 7face1d35800 2 removed watcher, disabling cache 2024-09-12T17:57:04.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.213+0000 7face1d35800 20 remove_watcher() i=1 2024-09-12T17:57:04.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.214+0000 7face1d35800 20 remove_watcher() i=2 2024-09-12T17:57:04.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.215+0000 7face1d35800 20 remove_watcher() i=3 2024-09-12T17:57:04.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.216+0000 7face1d35800 20 remove_watcher() i=4 2024-09-12T17:57:04.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.217+0000 7face1d35800 20 remove_watcher() i=5 2024-09-12T17:57:04.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.218+0000 7face1d35800 20 remove_watcher() i=6 2024-09-12T17:57:04.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.219+0000 7face1d35800 20 remove_watcher() i=7 2024-09-12T17:57:04.230 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T17:57:04.291 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:04.291 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:04.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.323+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.324+0000 7f50327ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.324+0000 7f50327ab800 20 realm 2024-09-12T17:57:04.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.324+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.324+0000 7f50327ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.324+0000 7f50327ab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:04.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.324+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.324+0000 7f50327ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.324+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.325+0000 7f50327ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:04.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.325+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.326+0000 7f50327ab800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:04.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.326+0000 7f50327ab800 20 searching for the correct realm 2024-09-12T17:57:04.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.329+0000 7f5030a96640 0 -- 172.21.15.107:0/2227941620 >> [v2:172.21.15.107:6816/1403347761,v1:172.21.15.107:6817/1403347761] conn(0x55702eb957c0 msgr2=0x55702eb97bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:04.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.332+0000 7f5030295640 0 -- 172.21.15.107:0/2227941620 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f501805dca0 msgr2=0x7f50180477f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:04.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.336+0000 7f50327ab800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:04.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.336+0000 7f50327ab800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:04.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.336+0000 7f50327ab800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:04.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.336+0000 7f50327ab800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:04.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.336+0000 7f50327ab800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:04.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.336+0000 7f50327ab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:04.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.336+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.336+0000 7f50327ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.336+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.337+0000 7f50327ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:04.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.337+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.337+0000 7f50327ab800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:04.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.337+0000 7f50327ab800 20 zone default found 2024-09-12T17:57:04.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.337+0000 7f50327ab800 4 Realm: () 2024-09-12T17:57:04.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.337+0000 7f50327ab800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:04.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.337+0000 7f50327ab800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:04.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.337+0000 7f50327ab800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:04.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.337+0000 7f50327ab800 20 zonegroup default 2024-09-12T17:57:04.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.337+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.337+0000 7f50327ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.337+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.338+0000 7f50327ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.338+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.338+0000 7f50327ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.338+0000 7f50327ab800 20 started sync module instance, tier type = 2024-09-12T17:57:04.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.338+0000 7f50327ab800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:04.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.347+0000 7f50327ab800 20 add_watcher() i=0 2024-09-12T17:57:04.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.347+0000 7f50327ab800 20 add_watcher() i=1 2024-09-12T17:57:04.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.347+0000 7f50327ab800 20 add_watcher() i=2 2024-09-12T17:57:04.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.347+0000 7f50327ab800 20 add_watcher() i=3 2024-09-12T17:57:04.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.347+0000 7f50327ab800 20 add_watcher() i=4 2024-09-12T17:57:04.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.347+0000 7f50327ab800 20 add_watcher() i=5 2024-09-12T17:57:04.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.347+0000 7f50327ab800 20 add_watcher() i=6 2024-09-12T17:57:04.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.348+0000 7f50327ab800 20 add_watcher() i=7 2024-09-12T17:57:04.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.348+0000 7f50327ab800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:04.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.349+0000 7f4ee6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:04.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.349+0000 7f50327ab800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:04.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.349+0000 7f50327ab800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:04.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.349+0000 7f50327ab800 5 note: GC not initialized 2024-09-12T17:57:04.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.350+0000 7f4ee5fe3640 20 reqs_thread_entry: start 2024-09-12T17:57:04.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.350+0000 7f50327ab800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:04.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.350+0000 7f50327ab800 20 Filter name: none 2024-09-12T17:57:04.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.350+0000 7f4edf7fe640 20 reqs_thread_entry: start 2024-09-12T17:57:04.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.350+0000 7f50327ab800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T17:57:04.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.350+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.350+0000 7f50327ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.350+0000 7f50327ab800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T17:57:04.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.350+0000 7f50327ab800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:57:04.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.350+0000 7f50327ab800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T17:57:04.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.350+0000 7f50327ab800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T17:57:04.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.350+0000 7f50327ab800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.351+0000 7f50327ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.351+0000 7f50327ab800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T17:57:04.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.351+0000 7f50327ab800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:57:04.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.351+0000 7f50327ab800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T17:57:04.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.352+0000 7f50327ab800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:57:04.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.352+0000 7f50327ab800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:57:04.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.352+0000 7f50327ab800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T17:57:04.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.352+0000 7f4f0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366326 cookie 93940308601264 notifier 9240 bl.length()=384 2024-09-12T17:57:04.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.352+0000 7f4f0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:57:04.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.352+0000 7f4f0f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:57:04.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.354+0000 7f50327ab800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:57:04.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.354+0000 7f50327ab800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:57:04.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.354+0000 7f50327ab800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T17:57:04.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.354+0000 7f4f0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366335 cookie 93940308669440 notifier 9240 bl.length()=225 2024-09-12T17:57:04.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.354+0000 7f4f0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:57:04.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.354+0000 7f4f0f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:57:04.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.356+0000 7f50327ab800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:57:04.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.356+0000 7f50327ab800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:57:04.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.356+0000 7f50327ab800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T17:57:04.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.356+0000 7f4f0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366253 cookie 93940308661888 notifier 9240 bl.length()=234 2024-09-12T17:57:04.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.356+0000 7f4f0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:57:04.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.356+0000 7f4f0effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:57:04.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.357+0000 7f4ee6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:04.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.359+0000 7f50327ab800 20 remove_watcher() i=0 2024-09-12T17:57:04.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.359+0000 7f50327ab800 2 removed watcher, disabling cache 2024-09-12T17:57:04.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.361+0000 7f50327ab800 20 remove_watcher() i=1 2024-09-12T17:57:04.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.362+0000 7f50327ab800 20 remove_watcher() i=2 2024-09-12T17:57:04.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.363+0000 7f50327ab800 20 remove_watcher() i=3 2024-09-12T17:57:04.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.364+0000 7f50327ab800 20 remove_watcher() i=4 2024-09-12T17:57:04.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.365+0000 7f50327ab800 20 remove_watcher() i=5 2024-09-12T17:57:04.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.366+0000 7f50327ab800 20 remove_watcher() i=6 2024-09-12T17:57:04.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.367+0000 7f50327ab800 20 remove_watcher() i=7 2024-09-12T17:57:04.376 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:57:04.376 INFO:teuthology.orchestra.run.smithi107.stdout: "id": "RGW99999999999999999", 2024-09-12T17:57:04.376 INFO:teuthology.orchestra.run.smithi107.stdout: "tenant": "", 2024-09-12T17:57:04.376 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T17:57:04.376 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T17:57:04.376 INFO:teuthology.orchestra.run.smithi107.stdout: "quota": { 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:04.377 INFO:teuthology.orchestra.run.smithi107.stdout: "max_users": 1000, 2024-09-12T17:57:04.378 INFO:teuthology.orchestra.run.smithi107.stdout: "max_roles": 1000, 2024-09-12T17:57:04.378 INFO:teuthology.orchestra.run.smithi107.stdout: "max_groups": 1000, 2024-09-12T17:57:04.378 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:57:04.378 INFO:teuthology.orchestra.run.smithi107.stdout: "max_access_keys": 4 2024-09-12T17:57:04.378 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:57:04.379 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T17:57:04.379 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key SVOJIVDJPFDFXUJSTKUA --secret ZLWJKYqAfcWbaYl+zFOMm/GsrMiwquo2JcsqZ2PV9IxOxiIy2DJL4g== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T17:57:04.446 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:04.446 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:04.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.478+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.479+0000 7f1316326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.479+0000 7f1316326800 20 realm 2024-09-12T17:57:04.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.479+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.479+0000 7f1316326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.480+0000 7f1316326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:04.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.480+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.480+0000 7f1316326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.481 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.480+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.480+0000 7f1316326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:04.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.481+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.481+0000 7f1316326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:04.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.481+0000 7f1316326800 20 searching for the correct realm 2024-09-12T17:57:04.485 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.484+0000 7f1311708640 0 -- 172.21.15.107:0/1137643776 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f130805e270 msgr2=0x7f1308048a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:04.488 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.487+0000 7f1311f09640 0 -- 172.21.15.107:0/1137643776 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f13080700d0 msgr2=0x7f13080918d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:04.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:04.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:04.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:04.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:04.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:04.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:04.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:04.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:04.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 zone default found 2024-09-12T17:57:04.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 4 Realm: () 2024-09-12T17:57:04.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:04.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:04.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:04.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 zonegroup default 2024-09-12T17:57:04.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.694+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.695+0000 7f1316326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.695+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.695+0000 7f1316326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.695+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.695+0000 7f1316326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.695+0000 7f1316326800 20 started sync module instance, tier type = 2024-09-12T17:57:04.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.695+0000 7f1316326800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:04.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.704+0000 7f1316326800 20 add_watcher() i=0 2024-09-12T17:57:04.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.704+0000 7f1316326800 20 add_watcher() i=1 2024-09-12T17:57:04.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.704+0000 7f1316326800 20 add_watcher() i=2 2024-09-12T17:57:04.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.704+0000 7f1316326800 20 add_watcher() i=3 2024-09-12T17:57:04.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.704+0000 7f1316326800 20 add_watcher() i=4 2024-09-12T17:57:04.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.704+0000 7f1316326800 20 add_watcher() i=5 2024-09-12T17:57:04.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.704+0000 7f1316326800 20 add_watcher() i=6 2024-09-12T17:57:04.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.705+0000 7f1316326800 20 add_watcher() i=7 2024-09-12T17:57:04.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.705+0000 7f1316326800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:04.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.707+0000 7f11c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:04.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.707+0000 7f1316326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:04.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.707+0000 7f1316326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:04.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.707+0000 7f1316326800 5 note: GC not initialized 2024-09-12T17:57:04.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.707+0000 7f11c27fc640 20 reqs_thread_entry: start 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.707+0000 7f1316326800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.707+0000 7f1316326800 20 Filter name: none 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.707+0000 7f1133fff640 20 reqs_thread_entry: start 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.707+0000 7f1316326800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.707+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T17:57:04.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:57:04.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 10 cache get: name=default.rgw.meta+users.keys+SVOJIVDJPFDFXUJSTKUA : miss 2024-09-12T17:57:04.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 10 cache put: name=default.rgw.meta+users.keys+SVOJIVDJPFDFXUJSTKUA info.flags=0x0 2024-09-12T17:57:04.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 10 adding default.rgw.meta+users.keys+SVOJIVDJPFDFXUJSTKUA to cache LRU end 2024-09-12T17:57:04.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T17:57:04.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.708+0000 7f1316326800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.709+0000 7f1316326800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:57:04.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.709+0000 7f1316326800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:57:04.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.709+0000 7f1316326800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:57:04.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.709+0000 7f1316326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:04.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.709+0000 7f1316326800 10 cache get: name=default.rgw.meta+users.keys+SVOJIVDJPFDFXUJSTKUA : hit (negative entry) 2024-09-12T17:57:04.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.709+0000 7f1316326800 10 cache get: name=default.rgw.meta+users.keys+SVOJIVDJPFDFXUJSTKUA : hit (negative entry) 2024-09-12T17:57:04.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.710+0000 7f1316326800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:57:04.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.710+0000 7f1316326800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:57:04.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.710+0000 7f1316326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:57:04.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.711+0000 7f11f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366327 cookie 94918015879056 notifier 8660 bl.length()=681 2024-09-12T17:57:04.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.711+0000 7f11f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:57:04.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.711+0000 7f11f57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:57:04.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.713+0000 7f1316326800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:57:04.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.713+0000 7f1316326800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:57:04.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.713+0000 7f1316326800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T17:57:04.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.713+0000 7f11f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366303 cookie 94918015889904 notifier 8660 bl.length()=189 2024-09-12T17:57:04.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.713+0000 7f11f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:57:04.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.713+0000 7f11f4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:57:04.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.715+0000 7f1316326800 10 cache put: name=default.rgw.meta+users.keys+SVOJIVDJPFDFXUJSTKUA info.flags=0x7 2024-09-12T17:57:04.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.715+0000 7f1316326800 10 moving default.rgw.meta+users.keys+SVOJIVDJPFDFXUJSTKUA to cache LRU end 2024-09-12T17:57:04.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.715+0000 7f1316326800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:SVOJIVDJPFDFXUJSTKUA, ofs0, ns] 2024-09-12T17:57:04.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.715+0000 7f11f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366304 cookie 94918015891920 notifier 8660 bl.length()=188 2024-09-12T17:57:04.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.715+0000 7f11f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SVOJIVDJPFDFXUJSTKUA info.flags=0x7 2024-09-12T17:57:04.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.715+0000 7f11f57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SVOJIVDJPFDFXUJSTKUA to cache LRU end 2024-09-12T17:57:04.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.716+0000 7f1316326800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T17:57:04.718 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T17:57:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "user_id": "root2.client.0", 2024-09-12T17:57:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T17:57:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "email": "root2+test@test.test", 2024-09-12T17:57:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "suspended": 0, 2024-09-12T17:57:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "max_buckets": 1000, 2024-09-12T17:57:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "subusers": [], 2024-09-12T17:57:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "keys": [ 2024-09-12T17:57:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-09-12T17:57:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "user": "root2.client.0", 2024-09-12T17:57:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "access_key": "SVOJIVDJPFDFXUJSTKUA", 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "secret_key": "ZLWJKYqAfcWbaYl+zFOMm/GsrMiwquo2JcsqZ2PV9IxOxiIy2DJL4g==", 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "active": true, 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:57:04.710449Z" 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "swift_keys": [], 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": [], 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "op_mask": "read, write, delete", 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "default_placement": "", 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "default_storage_class": "", 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "placement_tags": [], 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "bucket_quota": { 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "user_quota": { 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": false, 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "check_on_raw": false, 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size": -1, 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "max_size_kb": 0, 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "max_objects": -1 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "temp_url_keys": [], 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "root", 2024-09-12T17:57:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "mfa_ids": [], 2024-09-12T17:57:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "account_id": "RGW99999999999999999", 2024-09-12T17:57:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2024-09-12T17:57:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "create_date": "2024-09-12T17:57:04.710439Z", 2024-09-12T17:57:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-09-12T17:57:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "group_ids": [] 2024-09-12T17:57:04.721 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T17:57:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:57:04.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.717+0000 7f11c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:04.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.719+0000 7f1316326800 20 remove_watcher() i=0 2024-09-12T17:57:04.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.719+0000 7f1316326800 2 removed watcher, disabling cache 2024-09-12T17:57:04.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.721+0000 7f1316326800 20 remove_watcher() i=1 2024-09-12T17:57:04.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.722+0000 7f1316326800 20 remove_watcher() i=2 2024-09-12T17:57:04.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.723+0000 7f1316326800 20 remove_watcher() i=3 2024-09-12T17:57:04.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.724+0000 7f1316326800 20 remove_watcher() i=4 2024-09-12T17:57:04.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.724+0000 7f1316326800 20 remove_watcher() i=5 2024-09-12T17:57:04.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.725+0000 7f1316326800 20 remove_watcher() i=6 2024-09-12T17:57:04.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.726+0000 7f1316326800 20 remove_watcher() i=7 2024-09-12T17:57:04.738 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 8088993217 --totp-seed O54UK4NOD65WETWHXC2SCBAF6KLNNJZEZVAYEX32LCVRGXMOBY5O2DRXJJXVHUMZ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:57:04.804 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:04.804 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:04.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.836+0000 7f63c9f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.837+0000 7f63c9f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.837+0000 7f63c9f35800 20 realm 2024-09-12T17:57:04.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.837+0000 7f63c9f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.837+0000 7f63c9f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.837+0000 7f63c9f35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:04.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.837+0000 7f63c9f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.838+0000 7f63c9f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:04.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.838+0000 7f63c9f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.838+0000 7f63c9f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:04.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.838+0000 7f63c9f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:04.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.839+0000 7f63c9f35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:04.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.839+0000 7f63c9f35800 20 searching for the correct realm 2024-09-12T17:57:04.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.842+0000 7f63c5c7d640 0 -- 172.21.15.107:0/609283578 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f63c0037040 msgr2=0x7f63c0018960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:04.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:04.845+0000 7f63c5c7d640 0 -- 172.21.15.107:0/609283578 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f63bc0979c0 msgr2=0x7f63bc09f0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:05.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.051+0000 7f63c9f35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:05.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.051+0000 7f63c9f35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:05.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.051+0000 7f63c9f35800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T17:57:05.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.051+0000 7f63c9f35800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T17:57:05.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.051+0000 7f63c9f35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:05.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.051+0000 7f63c9f35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:05.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.051+0000 7f63c9f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:05.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.052+0000 7f63c9f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:05.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.052+0000 7f63c9f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:05.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.052+0000 7f63c9f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:05.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.052+0000 7f63c9f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:05.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.053+0000 7f63c9f35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:05.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.053+0000 7f63c9f35800 20 zone default found 2024-09-12T17:57:05.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.053+0000 7f63c9f35800 4 Realm: () 2024-09-12T17:57:05.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.053+0000 7f63c9f35800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T17:57:05.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.053+0000 7f63c9f35800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T17:57:05.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.053+0000 7f63c9f35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:05.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.053+0000 7f63c9f35800 20 zonegroup default 2024-09-12T17:57:05.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.053+0000 7f63c9f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:05.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.053+0000 7f63c9f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:05.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.053+0000 7f63c9f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:05.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.054+0000 7f63c9f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:05.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.054+0000 7f63c9f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:05.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.055+0000 7f63c9f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:05.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.055+0000 7f63c9f35800 20 started sync module instance, tier type = 2024-09-12T17:57:05.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.055+0000 7f63c9f35800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T17:57:05.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.064+0000 7f63c9f35800 20 add_watcher() i=0 2024-09-12T17:57:05.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.064+0000 7f63c9f35800 20 add_watcher() i=1 2024-09-12T17:57:05.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.064+0000 7f63c9f35800 20 add_watcher() i=2 2024-09-12T17:57:05.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.064+0000 7f63c9f35800 20 add_watcher() i=3 2024-09-12T17:57:05.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.064+0000 7f63c9f35800 20 add_watcher() i=4 2024-09-12T17:57:05.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.064+0000 7f63c9f35800 20 add_watcher() i=5 2024-09-12T17:57:05.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.064+0000 7f63c9f35800 20 add_watcher() i=6 2024-09-12T17:57:05.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.064+0000 7f63c9f35800 20 add_watcher() i=7 2024-09-12T17:57:05.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.064+0000 7f63c9f35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:05.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.066+0000 7f6277fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:05.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.066+0000 7f63c9f35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:05.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.066+0000 7f63c9f35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:05.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.066+0000 7f63c9f35800 5 note: GC not initialized 2024-09-12T17:57:05.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.066+0000 7f6276ffd640 20 reqs_thread_entry: start 2024-09-12T17:57:05.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.066+0000 7f63c9f35800 20 init_complete bucket index max shards: 1 2024-09-12T17:57:05.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.067+0000 7f63c9f35800 20 Filter name: none 2024-09-12T17:57:05.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.067+0000 7f6274ff9640 20 reqs_thread_entry: start 2024-09-12T17:57:05.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.067+0000 7f63c9f35800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:57:05.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.067+0000 7f63c9f35800 20 rados->read ofs=0 len=0 2024-09-12T17:57:05.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.067+0000 7f63c9f35800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:57:05.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.067+0000 7f63c9f35800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T17:57:05.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.067+0000 7f63c9f35800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:57:05.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.067+0000 7f63c9f35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:05.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.070+0000 7f63c9f35800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:57:05.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.070+0000 7f63c9f35800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:57:05.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.070+0000 7f63c9f35800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:57:05.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.070+0000 7f62a97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366328 cookie 93852313794128 notifier 9276 bl.length()=695 2024-09-12T17:57:05.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.070+0000 7f62a97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:57:05.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.070+0000 7f62a97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:57:05.072 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.071+0000 7f6277fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:05.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.073+0000 7f63c9f35800 20 remove_watcher() i=0 2024-09-12T17:57:05.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.073+0000 7f63c9f35800 2 removed watcher, disabling cache 2024-09-12T17:57:05.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.074+0000 7f63c9f35800 20 remove_watcher() i=1 2024-09-12T17:57:05.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.075+0000 7f63c9f35800 20 remove_watcher() i=2 2024-09-12T17:57:05.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.076+0000 7f63c9f35800 20 remove_watcher() i=3 2024-09-12T17:57:05.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.077+0000 7f63c9f35800 20 remove_watcher() i=4 2024-09-12T17:57:05.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.078+0000 7f63c9f35800 20 remove_watcher() i=5 2024-09-12T17:57:05.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.079+0000 7f63c9f35800 20 remove_watcher() i=6 2024-09-12T17:57:05.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T17:57:05.080+0000 7f63c9f35800 20 remove_watcher() i=7 2024-09-12T17:57:05.092 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T17:57:05.092 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:57:05.092 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T17:57:05.121 INFO:tasks.s3tests:Configuring boto... 2024-09-12T17:57:05.122 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T17:57:05.122 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T17:57:05.192 DEBUG:teuthology.orchestra.run.smithi107:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:57:05.372 INFO:teuthology.orchestra.run.smithi107.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T17:57:05.549 INFO:teuthology.orchestra.run.smithi107.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T17:57:05.813 INFO:teuthology.orchestra.run.smithi107.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:58:56.046 INFO:teuthology.orchestra.run.smithi107.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T17:58:57.439 INFO:teuthology.orchestra.run.smithi107.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=49387df794e0444cfd6e06986f0599ec6e649ce56e1104ff9849c831f1e77e42,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:58:57.440 INFO:teuthology.orchestra.run.smithi107.stdout:py run-test-pre: PYTHONHASHSEED='273427745' 2024-09-12T17:58:57.440 INFO:teuthology.orchestra.run.smithi107.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:58:57.575 INFO:teuthology.orchestra.run.smithi107.stdout:============================= test session starts ============================== 2024-09-12T17:58:57.575 INFO:teuthology.orchestra.run.smithi107.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T17:58:57.575 INFO:teuthology.orchestra.run.smithi107.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:58:57.575 INFO:teuthology.orchestra.run.smithi107.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:58:57.575 INFO:teuthology.orchestra.run.smithi107.stdout:configfile: pytest.ini 2024-09-12T17:58:59.321 INFO:teuthology.orchestra.run.smithi107.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T17:58:59.321 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T17:58:59.445 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T17:58:59.556 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T17:58:59.715 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T17:58:59.871 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T17:58:59.984 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T17:59:00.095 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T17:59:00.255 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T17:59:00.365 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T17:59:00.452 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T17:59:00.539 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T17:59:00.650 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T17:59:00.761 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T17:59:00.872 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T17:59:00.983 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T17:59:01.070 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T17:59:01.157 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T17:59:01.203 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T17:59:01.249 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T17:59:01.295 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T17:59:01.341 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T17:59:01.387 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T17:59:01.431 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T17:59:01.477 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:59:01.522 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:59:01.567 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:59:01.613 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:59:01.659 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:59:01.705 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:59:01.751 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T17:59:01.797 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T17:59:01.844 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:59:01.889 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:59:01.935 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:59:01.981 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:59:02.028 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:59:02.073 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:59:02.118 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T17:59:02.164 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T17:59:02.210 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:59:02.256 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:59:02.302 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T17:59:02.348 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:59:02.393 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:59:02.439 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:59:02.485 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T17:59:02.530 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:59:02.576 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:59:02.622 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:59:02.668 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:59:02.714 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:59:02.760 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:59:02.806 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T17:59:02.852 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T17:59:03.106 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T17:59:03.573 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T17:59:04.558 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T17:59:05.436 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T17:59:07.113 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T17:59:07.528 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T17:59:08.194 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T17:59:08.396 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T17:59:08.465 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T17:59:08.607 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T17:59:08.750 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T17:59:08.917 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T17:59:09.039 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T17:59:09.109 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T17:59:09.110 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:59:09.111 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:59:09.112 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:59:09.112 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:59:09.113 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:59:09.114 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:59:09.115 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T17:59:09.115 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:59:09.116 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:59:09.119 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:59:09.119 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:59:09.119 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T17:59:09.129 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:59:09.130 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:59:09.131 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:59:09.132 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:59:09.132 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:59:09.133 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:59:09.136 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:59:09.136 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T17:59:09.136 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T17:59:09.136 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T17:59:09.136 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T17:59:09.136 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T17:59:09.136 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T17:59:09.137 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T17:59:09.137 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T17:59:09.226 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T17:59:09.229 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T17:59:09.432 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T17:59:16.826 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T17:59:16.949 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T17:59:17.124 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T17:59:17.294 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T17:59:17.468 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T17:59:17.638 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T17:59:17.750 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T17:59:17.951 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T17:59:18.106 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T17:59:18.261 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T17:59:18.375 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T17:59:18.479 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T17:59:18.586 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T17:59:18.622 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T17:59:18.731 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T17:59:18.895 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T17:59:19.093 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T17:59:19.202 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T17:59:19.313 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T17:59:19.424 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T17:59:19.537 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T17:59:19.646 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T17:59:19.750 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T17:59:19.853 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T17:59:19.891 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T17:59:19.966 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T17:59:20.005 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T17:59:20.044 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T17:59:20.083 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T17:59:20.192 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T17:59:20.231 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:59:20.276 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T17:59:20.418 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T17:59:20.554 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T17:59:20.627 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:59:20.762 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T17:59:20.899 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:59:21.135 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:59:21.229 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T17:59:21.368 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T17:59:21.506 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T17:59:21.836 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:59:21.978 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:59:22.180 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:59:22.325 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:59:22.629 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:59:22.828 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:59:23.151 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:59:23.344 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:59:23.610 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:59:23.818 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T17:59:24.080 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T17:59:24.223 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T17:59:24.942 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T17:59:25.388 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T17:59:26.171 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T17:59:27.591 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T17:59:29.588 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T17:59:30.624 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T17:59:31.531 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T17:59:32.133 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T17:59:32.461 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T17:59:33.237 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T17:59:33.742 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T17:59:34.472 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T17:59:34.930 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T17:59:35.976 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T17:59:36.566 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T17:59:37.885 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T17:59:38.981 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T17:59:39.642 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T17:59:40.228 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T17:59:40.684 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T17:59:42.063 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T17:59:43.010 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T17:59:44.143 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T17:59:45.209 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T17:59:46.146 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T17:59:47.083 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T17:59:47.777 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T17:59:48.245 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T17:59:48.808 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T17:59:50.044 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T17:59:51.745 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T17:59:52.343 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T17:59:53.376 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T17:59:54.446 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T17:59:55.305 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:59:56.129 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:59:57.036 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T17:59:57.896 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T17:59:58.701 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T17:59:59.247 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T17:59:59.686 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T18:00:00.128 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T18:00:00.613 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T18:00:01.346 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T18:00:02.078 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T18:00:02.807 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T18:00:03.538 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T18:00:04.268 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T18:00:05.048 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T18:00:05.782 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T18:00:06.510 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T18:00:07.235 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T18:00:07.960 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:00:08.728 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T18:00:09.462 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T18:00:09.818 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T18:00:10.179 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T18:00:10.494 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:00:10.851 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T18:00:11.036 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T18:00:11.312 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T18:00:11.532 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T18:00:11.751 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T18:00:11.970 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T18:00:12.153 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T18:00:12.376 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T18:00:12.559 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T18:00:12.739 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T18:00:12.967 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T18:00:13.197 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T18:00:13.362 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:00:13.560 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:00:13.741 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T18:00:13.922 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T18:00:14.152 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T18:00:14.386 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T18:00:14.606 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T18:00:14.788 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T18:00:14.971 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T18:00:15.153 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T18:00:15.335 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T18:00:15.518 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T18:00:15.699 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T18:00:15.921 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T18:00:16.103 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T18:00:16.286 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T18:00:16.467 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T18:00:16.649 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T18:00:16.822 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T18:00:16.996 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T18:00:17.211 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T18:00:17.396 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T18:00:17.578 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T18:00:26.185 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T18:00:26.363 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T18:00:26.541 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T18:00:26.719 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T18:00:26.896 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T18:00:27.111 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T18:00:27.289 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T18:00:27.465 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T18:00:27.644 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T18:00:27.818 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T18:00:27.995 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T18:00:28.203 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T18:00:28.419 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T18:00:28.603 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T18:00:28.785 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T18:00:28.966 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T18:00:29.150 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T18:00:29.335 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T18:00:29.516 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T18:00:29.736 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:00:29.922 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:00:30.103 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:00:30.285 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:00:30.512 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T18:00:30.739 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T18:00:30.960 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T18:00:31.143 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T18:00:31.326 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T18:00:31.509 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T18:00:31.550 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T18:00:31.713 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T18:00:32.240 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T18:00:32.733 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T18:00:32.916 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T18:00:33.099 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T18:00:33.285 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T18:00:33.468 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T18:00:33.732 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T18:00:33.959 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T18:00:34.144 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T18:00:34.326 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T18:00:34.510 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T18:00:34.695 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T18:00:34.878 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T18:00:35.099 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T18:00:35.455 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T18:00:35.897 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T18:00:36.020 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T18:00:36.140 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T18:00:36.253 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T18:00:36.364 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T18:00:36.444 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T18:00:36.486 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T18:00:36.527 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T18:00:36.693 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T18:00:36.868 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T18:00:36.909 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T18:00:37.070 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T18:00:37.178 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T18:00:37.291 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T18:00:37.438 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T18:00:37.771 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T18:00:38.072 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T18:00:38.378 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T18:00:46.990 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T18:00:55.195 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T18:00:55.359 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T18:00:55.520 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T18:00:55.685 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T18:00:55.847 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T18:00:56.067 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T18:00:56.230 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T18:00:56.396 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T18:00:56.612 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T18:00:56.786 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T18:00:56.988 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T18:00:57.189 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T18:00:57.351 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T18:00:57.552 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T18:00:57.660 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T18:00:57.814 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T18:00:57.968 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T18:00:58.182 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T18:00:58.346 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T18:00:58.506 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T18:00:58.664 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T18:00:58.824 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T18:00:59.027 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T18:00:59.137 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T18:00:59.249 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T18:00:59.362 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T18:00:59.509 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T18:00:59.619 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T18:00:59.731 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T18:00:59.892 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T18:01:00.001 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T18:01:00.113 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T18:01:00.224 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T18:01:00.336 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T18:01:00.519 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T18:01:00.668 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T18:01:00.779 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T18:01:00.891 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T18:01:01.003 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T18:01:01.115 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T18:01:01.227 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T18:01:01.338 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T18:01:01.544 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T18:01:01.655 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T18:01:01.899 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T18:01:02.107 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T18:01:02.273 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T18:01:02.480 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T18:01:02.686 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T18:01:03.868 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T18:01:04.080 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T18:01:04.287 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T18:01:04.581 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T18:01:04.876 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T18:01:05.134 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T18:01:05.333 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T18:01:05.589 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T18:01:05.882 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T18:01:06.089 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T18:01:06.379 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T18:01:06.546 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T18:01:06.666 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T18:01:06.750 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T18:01:06.876 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T18:01:06.987 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T18:01:07.031 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T18:01:07.227 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T18:01:07.388 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T18:01:07.589 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T18:01:10.014 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T18:01:10.184 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T18:01:10.353 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T18:01:10.516 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T18:01:10.678 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T18:01:10.800 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T18:01:10.968 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T18:01:11.167 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T18:01:11.329 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T18:01:11.492 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T18:01:11.653 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T18:01:11.814 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T18:01:11.978 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T18:01:12.148 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T18:01:12.307 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T18:01:12.467 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T18:01:12.629 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T18:01:12.832 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T18:01:12.873 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T18:01:12.914 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T18:01:12.955 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T18:01:13.064 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T18:01:13.172 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T18:01:13.277 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T18:01:13.383 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T18:01:13.535 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T18:01:13.576 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T18:01:13.617 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T18:01:13.722 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T18:01:13.800 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T18:01:13.841 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T18:01:13.882 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T18:01:13.923 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T18:01:14.040 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T18:01:14.189 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T18:01:14.303 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T18:01:14.452 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T18:01:14.603 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T18:01:14.755 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T18:01:14.905 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T18:01:15.103 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T18:01:15.254 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T18:01:15.402 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T18:01:15.605 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T18:01:15.809 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T18:01:16.060 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T18:01:16.261 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T18:01:16.467 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T18:01:16.756 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T18:01:17.007 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T18:01:17.222 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T18:01:17.398 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T18:01:17.511 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T18:01:17.763 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T18:01:18.013 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T18:01:18.264 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T18:01:18.519 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T18:01:18.808 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T18:01:19.047 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T18:01:19.423 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T18:01:19.659 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T18:01:19.848 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T18:01:20.006 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T18:01:20.209 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T18:01:20.417 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T18:01:20.579 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T18:01:20.698 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T18:01:20.953 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T18:01:21.280 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T18:01:21.645 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T18:01:21.969 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T18:01:22.296 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T18:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T18:01:22.951 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T18:01:23.318 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T18:01:23.648 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T18:01:23.978 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T18:01:24.268 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T18:01:24.561 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T18:01:24.855 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T18:01:25.314 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T18:01:25.722 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T18:01:25.760 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T18:01:25.802 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T18:01:25.842 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T18:01:25.962 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T18:01:26.078 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T18:01:26.184 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T18:01:26.292 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T18:01:26.527 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T18:01:27.306 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T18:01:27.503 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T18:01:27.727 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T18:01:28.142 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T18:01:28.398 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T18:01:28.656 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T18:01:28.906 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T18:01:29.120 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T18:01:29.488 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T18:01:29.723 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T18:01:29.961 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T18:01:30.227 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T18:01:30.721 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T18:01:31.127 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T18:01:31.241 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T18:01:31.356 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T18:01:32.252 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T18:01:32.528 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T18:01:33.951 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T18:01:34.077 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T18:01:34.273 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T18:01:34.787 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T18:01:35.008 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T18:01:35.455 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T18:01:36.733 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T18:01:37.777 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T18:01:39.679 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T18:01:45.007 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T18:01:46.003 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T18:01:47.892 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T18:01:48.126 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T18:01:48.572 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T18:01:49.079 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T18:01:49.411 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T18:01:49.618 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T18:01:49.982 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T18:01:50.211 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T18:01:50.392 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T18:01:50.778 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T18:02:04.878 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T18:02:06.688 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T18:02:06.940 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T18:02:07.054 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T18:02:07.264 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T18:02:10.456 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T18:02:16.740 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T18:02:17.087 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T18:02:17.295 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T18:02:17.623 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T18:02:17.787 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T18:02:17.995 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T18:02:18.280 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T18:02:18.609 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T18:02:19.051 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T18:02:19.519 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T18:02:19.843 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T18:02:20.318 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T18:02:20.615 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T18:02:21.068 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T18:02:21.634 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T18:02:22.334 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T18:02:22.728 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T18:02:22.931 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T18:02:26.933 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T18:02:27.184 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T18:02:27.392 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T18:02:27.601 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T18:02:27.807 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T18:02:28.121 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T18:02:34.132 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T18:02:34.430 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T18:02:34.748 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T18:02:35.128 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T18:02:38.008 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T18:02:38.344 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T18:02:41.541 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T18:02:53.916 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T18:02:55.485 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T18:02:56.363 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T18:02:57.368 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T18:02:57.722 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T18:02:58.088 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T18:02:58.343 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T18:02:59.031 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T18:02:59.445 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T18:02:59.566 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T18:02:59.730 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T18:02:59.896 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T18:03:00.011 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T18:03:00.126 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T18:03:00.326 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T18:03:00.450 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T18:03:00.565 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T18:03:00.785 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T18:03:00.904 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T18:03:01.026 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T18:03:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T18:03:01.267 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T18:03:01.380 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T18:03:01.587 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T18:03:01.975 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T18:03:02.221 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T18:03:02.597 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T18:03:02.805 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T18:03:03.113 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T18:03:03.268 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T18:03:04.866 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T18:03:06.224 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T18:03:07.375 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T18:04:07.733 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T18:05:08.040 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T18:05:08.220 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T18:05:08.429 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T18:05:08.628 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T18:05:08.745 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T18:05:09.842 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T18:05:10.460 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T18:05:11.079 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T18:05:11.243 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T18:05:11.448 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T18:05:11.655 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T18:05:11.917 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T18:05:12.122 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T18:05:12.328 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T18:05:12.498 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T18:05:12.669 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T18:05:12.854 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T18:05:13.038 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T18:05:13.213 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T18:05:13.379 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T18:05:13.721 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T18:05:14.062 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T18:05:14.349 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T18:05:14.611 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T18:05:14.898 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T18:05:15.194 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T18:05:15.532 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T18:05:15.815 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T18:05:16.323 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T18:05:16.684 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T18:05:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T18:05:17.259 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T18:05:17.425 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T18:05:17.675 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T18:05:17.964 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T18:05:18.258 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T18:05:18.556 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T18:05:19.100 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T18:05:21.000 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T18:05:21.294 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T18:05:21.630 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T18:05:21.926 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T18:05:22.415 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T18:05:22.812 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T18:05:23.028 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T18:05:23.451 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T18:05:23.566 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T18:05:23.679 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T18:05:23.791 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T18:05:23.906 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T18:05:24.116 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T18:05:24.274 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T18:05:24.612 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T18:05:24.812 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T18:05:24.962 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T18:05:25.116 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T18:05:25.269 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T18:05:25.420 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T18:05:25.616 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T18:05:25.766 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T18:05:25.917 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T18:05:26.070 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T18:05:26.221 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T18:05:26.408 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T18:05:26.650 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T18:05:26.902 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T18:05:27.085 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T18:05:27.234 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T18:05:27.437 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T18:05:27.677 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T18:05:27.862 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T18:05:28.053 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T18:05:28.238 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T18:05:28.469 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T18:05:28.653 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T18:05:28.937 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T18:05:29.179 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T18:05:29.402 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T18:05:29.580 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T18:05:29.784 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T18:05:29.994 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T18:05:30.256 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T18:05:30.457 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T18:05:30.721 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T18:05:31.041 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T18:05:31.178 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T18:05:31.335 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T18:05:31.476 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T18:05:41.585 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T18:05:41.803 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T18:05:51.103 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T18:05:51.366 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T18:05:51.668 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T18:05:51.783 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T18:05:51.941 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:05:52.097 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:05:52.256 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:05:52.412 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T18:05:52.573 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T18:05:52.686 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T18:05:52.846 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T18:05:53.090 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T18:05:53.246 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T18:05:53.534 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T18:05:53.778 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T18:05:53.938 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T18:05:54.054 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T18:05:54.364 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T18:05:55.353 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T18:05:55.511 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:05:55.671 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:05:55.839 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:05:56.049 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T18:05:56.285 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T18:05:56.498 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T18:05:56.942 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T18:05:57.375 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T18:05:57.631 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T18:05:58.395 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T18:05:59.195 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T18:05:59.279 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T18:05:59.437 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T18:06:00.099 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T18:06:00.786 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T18:06:01.168 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T18:06:01.443 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T18:06:01.738 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T18:06:01.952 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T18:06:02.032 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T18:06:02.329 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T18:06:02.695 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T18:06:05.066 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T18:06:05.332 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T18:06:05.579 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T18:06:05.779 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T18:06:05.960 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T18:06:06.230 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T18:06:06.433 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T18:06:06.548 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T18:06:06.805 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T18:06:07.066 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T18:06:07.363 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T18:06:07.615 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T18:06:07.829 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T18:06:07.863 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T18:06:08.179 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T18:06:08.538 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T18:06:08.780 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T18:06:09.007 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T18:06:09.200 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T18:06:19.666 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T18:06:19.702 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T18:06:20.234 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T18:06:20.674 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T18:06:21.052 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T18:06:21.490 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T18:06:21.507 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T18:06:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.507 INFO:teuthology.orchestra.run.smithi107.stdout:=============================== warnings summary =============================== 2024-09-12T18:06:21.507 INFO:teuthology.orchestra.run.smithi107.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T18:06:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T18:06:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: import imp 2024-09-12T18:06:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.507 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py:120 2024-09-12T18:06:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: if boto_type is 'S3Connection': 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_headers.py:124 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3.py:359 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:06:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: if k is 'BucketName': 2024-09-12T18:06:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.509 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T18:06:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T18:06:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: @pytest.mark.timeout(10) 2024-09-12T18:06:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.509 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T18:06:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T18:06:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T18:06:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.509 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T18:06:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:06:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:06:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.511 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T18:06:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:06:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:06:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.511 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T18:06:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:06:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:06:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.511 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T18:06:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:06:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T18:06:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.512 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T18:06:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:06:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:06:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.512 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T18:06:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:06:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:06:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.513 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T18:06:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:06:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:06:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.513 INFO:teuthology.orchestra.run.smithi107.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T18:06:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:06:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:06:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:06:21.513 INFO:teuthology.orchestra.run.smithi107.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T18:06:21.513 INFO:teuthology.orchestra.run.smithi107.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 443.93s (0:07:23) = 2024-09-12T18:06:21.632 INFO:teuthology.orchestra.run.smithi107.stdout:___________________________________ summary ____________________________________ 2024-09-12T18:06:21.632 INFO:teuthology.orchestra.run.smithi107.stdout: py: commands succeeded 2024-09-12T18:06:21.632 INFO:teuthology.orchestra.run.smithi107.stdout: congratulations :) 2024-09-12T18:06:21.650 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T18:06:21.651 DEBUG:teuthology.orchestra.run.smithi107:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:06:21.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:06:21.767 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T18:06:21.767 DEBUG:teuthology.orchestra.run.smithi107:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T18:06:21.795 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T18:06:21.796 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:06:21.985 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:06:21.997 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:06:21.997 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:06:21.997 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:06:22.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:06:22.027 INFO:teuthology.orchestra.run.smithi107.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:06:22.027 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:06:22.095 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:06:22.096 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:06:22.163 INFO:tasks.workunit:timeout=3h 2024-09-12T18:06:22.163 INFO:tasks.workunit:cleanup=True 2024-09-12T18:06:22.164 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:06:22.232 INFO:tasks.workunit.client.0.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:07:21.044 INFO:tasks.workunit.client.0.smithi107.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T18:07:21.044 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T18:07:21.044 INFO:tasks.workunit.client.0.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr: git switch -c 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr:Or undo this operation with: 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr: git switch - 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T18:07:21.045 INFO:tasks.workunit.client.0.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:07:21.046 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T18:07:21.046 INFO:tasks.workunit.client.0.smithi107.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T18:07:21.048 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:07:21.116 INFO:tasks.workunit.client.0.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:07:21.119 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:07:21.119 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:07:21.167 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:07:21.216 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:07:21.254 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:07:21.256 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:07:21.256 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:07:21.295 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:07:21.299 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-09-12T18:07:21.299 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:07:21.368 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T18:07:21.370 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T18:07:21.370 DEBUG:teuthology.orchestra.run.smithi107:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:07:21.443 INFO:tasks.workunit.client.0.smithi107.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:07:21.444 INFO:tasks.workunit.client.0.smithi107.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:07:21.444 INFO:tasks.workunit.client.0.smithi107.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:07:23.942 INFO:tasks.workunit.client.0.smithi107.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T18:07:23.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ deactivate nondestructive 2024-09-12T18:07:23.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T18:07:23.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T18:07:23.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:07:23.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ hash -r 2024-09-12T18:07:23.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T18:07:23.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ unset VIRTUAL_ENV 2024-09-12T18:07:23.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T18:07:23.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:07:23.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ export VIRTUAL_ENV 2024-09-12T18:07:23.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:07:23.943 INFO:tasks.workunit.client.0.smithi107.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:07:23.944 INFO:tasks.workunit.client.0.smithi107.stderr:++ export PATH 2024-09-12T18:07:23.944 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n '' ']' 2024-09-12T18:07:23.944 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -z '' ']' 2024-09-12T18:07:23.945 INFO:tasks.workunit.client.0.smithi107.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T18:07:23.945 INFO:tasks.workunit.client.0.smithi107.stderr:++ PS1='(rgw) ' 2024-09-12T18:07:23.945 INFO:tasks.workunit.client.0.smithi107.stderr:++ export PS1 2024-09-12T18:07:23.945 INFO:tasks.workunit.client.0.smithi107.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:07:23.945 INFO:tasks.workunit.client.0.smithi107.stderr:++ hash -r 2024-09-12T18:07:23.945 INFO:tasks.workunit.client.0.smithi107.stderr:+ pip install pip --upgrade 2024-09-12T18:07:24.170 INFO:tasks.workunit.client.0.smithi107.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T18:07:24.351 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting pip 2024-09-12T18:07:24.356 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:07:24.402 INFO:tasks.workunit.client.0.smithi107.stdout:Installing collected packages: pip 2024-09-12T18:07:24.402 INFO:tasks.workunit.client.0.smithi107.stdout: Attempting uninstall: pip 2024-09-12T18:07:24.402 INFO:tasks.workunit.client.0.smithi107.stdout: Found existing installation: pip 21.3.1 2024-09-12T18:07:24.556 INFO:tasks.workunit.client.0.smithi107.stdout: Uninstalling pip-21.3.1: 2024-09-12T18:07:24.562 INFO:tasks.workunit.client.0.smithi107.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T18:07:25.285 INFO:tasks.workunit.client.0.smithi107.stdout:Successfully installed pip-24.2 2024-09-12T18:07:25.332 INFO:tasks.workunit.client.0.smithi107.stderr:+ pip install boto3 2024-09-12T18:07:26.098 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting boto3 2024-09-12T18:07:26.099 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:07:26.676 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:07:26.677 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:07:26.721 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:07:26.722 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:07:26.775 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:07:26.776 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:07:26.827 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:07:26.828 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:07:26.904 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:07:26.905 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T18:07:27.150 INFO:tasks.workunit.client.0.smithi107.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:07:27.151 INFO:tasks.workunit.client.0.smithi107.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:07:27.155 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:07:27.156 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:07:27.166 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:07:27.167 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:07:27.168 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:07:27.169 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T18:07:27.171 INFO:tasks.workunit.client.0.smithi107.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:07:27.244 INFO:tasks.workunit.client.0.smithi107.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:07:28.279 INFO:tasks.workunit.client.0.smithi107.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T18:07:28.397 INFO:tasks.workunit.client.0.smithi107.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T18:07:28.518 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T18:07:28.553 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:28.553 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:28.591 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.591+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.592+0000 7f79abb20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:28.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.592+0000 7f79abb20800 20 realm 2024-09-12T18:07:28.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.592+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.592+0000 7f79abb20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:28.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.592+0000 7f79abb20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:28.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.593+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.593+0000 7f79abb20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:28.593 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.593+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.594+0000 7f79abb20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:28.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.594+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.594 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.594+0000 7f79abb20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:28.595 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.594+0000 7f79abb20800 20 searching for the correct realm 2024-09-12T18:07:28.596 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.596+0000 7f79a7868640 0 -- 172.21.15.107:0/3315264997 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x55ab7dd83dc0 msgr2=0x7f79a00a4280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:28.600 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.600+0000 7f79a7067640 0 -- 172.21.15.107:0/3315264997 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x55ab7df2d320 msgr2=0x55ab7df2f710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:28.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.606+0000 7f79abb20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:28.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.606+0000 7f79abb20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:28.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.606+0000 7f79abb20800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T18:07:28.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.606+0000 7f79abb20800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T18:07:28.606 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.606+0000 7f79abb20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:28.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.606+0000 7f79abb20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:28.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.606+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.606+0000 7f79abb20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:28.607 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.606+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.606+0000 7f79abb20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:28.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.606+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.607+0000 7f79abb20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:28.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.607+0000 7f79abb20800 20 zone default found 2024-09-12T18:07:28.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.607+0000 7f79abb20800 4 Realm: () 2024-09-12T18:07:28.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.607+0000 7f79abb20800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T18:07:28.608 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.607+0000 7f79abb20800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T18:07:28.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.607+0000 7f79abb20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:28.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.607+0000 7f79abb20800 20 zonegroup default 2024-09-12T18:07:28.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.607+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.607+0000 7f79abb20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:28.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.607+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.607+0000 7f79abb20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:28.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.607+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.608+0000 7f79abb20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:28.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.608+0000 7f79abb20800 20 started sync module instance, tier type = 2024-09-12T18:07:28.609 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.608+0000 7f79abb20800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T18:07:28.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.617+0000 7f79abb20800 20 add_watcher() i=0 2024-09-12T18:07:28.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.617+0000 7f79abb20800 20 add_watcher() i=1 2024-09-12T18:07:28.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.617+0000 7f79abb20800 20 add_watcher() i=2 2024-09-12T18:07:28.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.617+0000 7f79abb20800 20 add_watcher() i=3 2024-09-12T18:07:28.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.617+0000 7f79abb20800 20 add_watcher() i=4 2024-09-12T18:07:28.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.617+0000 7f79abb20800 20 add_watcher() i=5 2024-09-12T18:07:28.617 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.617+0000 7f79abb20800 20 add_watcher() i=6 2024-09-12T18:07:28.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.618+0000 7f79abb20800 20 add_watcher() i=7 2024-09-12T18:07:28.618 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.618+0000 7f79abb20800 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:28.619 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.619+0000 7f785dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:28.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.620+0000 7f79abb20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:28.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.620+0000 7f79abb20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:28.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.620+0000 7f79abb20800 5 note: GC not initialized 2024-09-12T18:07:28.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.620+0000 7f785cfe1640 20 reqs_thread_entry: start 2024-09-12T18:07:28.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.620+0000 7f79abb20800 20 init_complete bucket index max shards: 1 2024-09-12T18:07:28.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.620+0000 7f79abb20800 20 Filter name: none 2024-09-12T18:07:28.621 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.620+0000 7f77d67fc640 20 reqs_thread_entry: start 2024-09-12T18:07:28.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.620+0000 7f79abb20800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T18:07:28.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.620+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.621+0000 7f79abb20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:28.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.621+0000 7f79abb20800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T18:07:28.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.621+0000 7f79abb20800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:07:28.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.621+0000 7f79abb20800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T18:07:28.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.621+0000 7f79abb20800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.621+0000 7f79abb20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:28.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.621+0000 7f79abb20800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T18:07:28.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.621+0000 7f79abb20800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:07:28.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.621+0000 7f79abb20800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:07:28.622 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.621+0000 7f79abb20800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:07:28.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.622+0000 7f79abb20800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:07:28.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.622+0000 7f79abb20800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:07:28.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.622+0000 7f79abb20800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T18:07:28.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.623+0000 7f7886ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366440 cookie 94195040886480 notifier 8693 bl.length()=613 2024-09-12T18:07:28.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.623+0000 7f7886ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:07:28.623 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.623+0000 7f7886ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:07:28.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.624+0000 7f79abb20800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:07:28.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.624+0000 7f79abb20800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:07:28.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.624+0000 7f79abb20800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T18:07:28.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.625+0000 7f78867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367415 cookie 94195040883712 notifier 8693 bl.length()=191 2024-09-12T18:07:28.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.625+0000 7f78867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:07:28.625 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.625+0000 7f78867fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:07:28.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.626+0000 7f785dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:28.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.628+0000 7f79abb20800 20 remove_watcher() i=0 2024-09-12T18:07:28.628 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.628+0000 7f79abb20800 2 removed watcher, disabling cache 2024-09-12T18:07:28.629 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.629+0000 7f79abb20800 20 remove_watcher() i=1 2024-09-12T18:07:28.630 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.630+0000 7f79abb20800 20 remove_watcher() i=2 2024-09-12T18:07:28.631 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.631+0000 7f79abb20800 20 remove_watcher() i=3 2024-09-12T18:07:28.632 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.632+0000 7f79abb20800 20 remove_watcher() i=4 2024-09-12T18:07:28.633 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.633+0000 7f79abb20800 20 remove_watcher() i=5 2024-09-12T18:07:28.634 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.634+0000 7f79abb20800 20 remove_watcher() i=6 2024-09-12T18:07:28.635 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.635+0000 7f79abb20800 20 remove_watcher() i=7 2024-09-12T18:07:28.811 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T18:07:28.812 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T18:07:28.840 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:07:28.868 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:28.868 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:28.904 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.904+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.906+0000 7f399bd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:28.906 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.906+0000 7f399bd25800 20 realm 2024-09-12T18:07:28.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.906+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.906+0000 7f399bd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:28.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.906+0000 7f399bd25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:28.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.906+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.906+0000 7f399bd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:28.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.906+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.907+0000 7f399bd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:28.907 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.907+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:28.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.908+0000 7f399bd25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:28.908 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.908+0000 7f399bd25800 20 searching for the correct realm 2024-09-12T18:07:28.909 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:28.909+0000 7f39979b5640 0 -- 172.21.15.107:0/3758911203 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f3990037040 msgr2=0x7f399002d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:29.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.119+0000 7f398ffff640 0 -- 172.21.15.107:0/3758911203 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x55aa02149720 msgr2=0x55aa0214bb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:29.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.125+0000 7f399bd25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:29.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.125+0000 7f399bd25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:29.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.125+0000 7f399bd25800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T18:07:29.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.125+0000 7f399bd25800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T18:07:29.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.125+0000 7f399bd25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:29.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.125+0000 7f399bd25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:29.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.125+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:29.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.125+0000 7f399bd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:29.126 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.125+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:29.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.126+0000 7f399bd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:29.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.126+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:29.127 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.126+0000 7f399bd25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.126+0000 7f399bd25800 20 zone default found 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.126+0000 7f399bd25800 4 Realm: () 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.126+0000 7f399bd25800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.126+0000 7f399bd25800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.126+0000 7f399bd25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.126+0000 7f399bd25800 20 zonegroup default 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.126+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.126+0000 7f399bd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.126+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.127+0000 7f399bd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.127+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.127+0000 7f399bd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:29.128 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.127+0000 7f399bd25800 20 started sync module instance, tier type = 2024-09-12T18:07:29.129 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.127+0000 7f399bd25800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T18:07:29.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.136+0000 7f399bd25800 20 add_watcher() i=0 2024-09-12T18:07:29.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.136+0000 7f399bd25800 20 add_watcher() i=1 2024-09-12T18:07:29.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.136+0000 7f399bd25800 20 add_watcher() i=2 2024-09-12T18:07:29.136 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.136+0000 7f399bd25800 20 add_watcher() i=3 2024-09-12T18:07:29.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.136+0000 7f399bd25800 20 add_watcher() i=4 2024-09-12T18:07:29.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.136+0000 7f399bd25800 20 add_watcher() i=5 2024-09-12T18:07:29.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.136+0000 7f399bd25800 20 add_watcher() i=6 2024-09-12T18:07:29.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.137+0000 7f399bd25800 20 add_watcher() i=7 2024-09-12T18:07:29.137 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.137+0000 7f399bd25800 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:29.139 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.139+0000 7f384dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:29.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.139+0000 7f399bd25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:29.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.139+0000 7f399bd25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:29.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.139+0000 7f399bd25800 5 note: GC not initialized 2024-09-12T18:07:29.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.139+0000 7f384cfe1640 20 reqs_thread_entry: start 2024-09-12T18:07:29.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.139+0000 7f399bd25800 20 init_complete bucket index max shards: 1 2024-09-12T18:07:29.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.139+0000 7f399bd25800 20 Filter name: none 2024-09-12T18:07:29.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.139+0000 7f37c67fc640 20 reqs_thread_entry: start 2024-09-12T18:07:29.140 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.140+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:29.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.140+0000 7f399bd25800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:07:29.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.140+0000 7f399bd25800 20 rados->read ofs=0 len=0 2024-09-12T18:07:29.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.141+0000 7f399bd25800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:07:29.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.141+0000 7f399bd25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:29.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.141+0000 7f399bd25800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T18:07:29.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.141+0000 7f399bd25800 20 INFO: main: starting shard=0 2024-09-12T18:07:29.141 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.141+0000 7f399bd25800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.783.0 2024-09-12T18:07:29.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.141+0000 7f399bd25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:07:29.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.141+0000 7f399bd25800 20 INFO: main: done 2024-09-12T18:07:29.142 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.142+0000 7f384dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:29.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.144+0000 7f399bd25800 20 remove_watcher() i=0 2024-09-12T18:07:29.144 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.144+0000 7f399bd25800 2 removed watcher, disabling cache 2024-09-12T18:07:29.145 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.145+0000 7f399bd25800 20 remove_watcher() i=1 2024-09-12T18:07:29.146 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.146+0000 7f399bd25800 20 remove_watcher() i=2 2024-09-12T18:07:29.147 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.147+0000 7f399bd25800 20 remove_watcher() i=3 2024-09-12T18:07:29.148 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.148+0000 7f399bd25800 20 remove_watcher() i=4 2024-09-12T18:07:29.149 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.149+0000 7f399bd25800 20 remove_watcher() i=5 2024-09-12T18:07:29.150 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.150+0000 7f399bd25800 20 remove_watcher() i=6 2024-09-12T18:07:29.151 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.151+0000 7f399bd25800 20 remove_watcher() i=7 2024-09-12T18:07:29.163 INFO:tasks.workunit.client.0.smithi107.stderr:rados -p default.rgw.buckets.data ls | grep 1fb5507f-af99-4500-9dea-42ee740df02c 2024-09-12T18:07:29.187 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:29.187 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:29.227 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:29.227+0000 7f192d14d640 0 -- 172.21.15.107:0/3977488891 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f1920034330 msgr2=0x7f1920034770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:29.234 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T18:07:29.234 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T18:07:29.236 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:07:30.644 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:07:31.039 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:07:31.067 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:31.067 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:31.291 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.290+0000 7fbdd381b640 0 --2- 172.21.15.107:0/2374809726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55dbfae531a0 0x55dbfaf4dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:07:31.306 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.305+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.307+0000 7fbdd7333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:31.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.307+0000 7fbdd7333800 20 realm 2024-09-12T18:07:31.308 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.307+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.307+0000 7fbdd7333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:31.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.307+0000 7fbdd7333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:31.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.307+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.307+0000 7fbdd7333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:31.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.307+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.308+0000 7fbdd7333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:31.309 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.308+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.309+0000 7fbdd7333800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:31.310 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.309+0000 7fbdd7333800 20 searching for the correct realm 2024-09-12T18:07:31.311 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.310+0000 7fbdd301a640 0 -- 172.21.15.107:0/149628897 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7fbdcc032070 msgr2=0x7fbdcc093680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:31.518 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.516+0000 7fbdcbfff640 0 -- 172.21.15.107:0/149628897 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x55dbfaff7040 msgr2=0x55dbfaff9430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:31.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.523+0000 7fbdd7333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:31.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.523+0000 7fbdd7333800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:31.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.523+0000 7fbdd7333800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T18:07:31.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.523+0000 7fbdd7333800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T18:07:31.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.523+0000 7fbdd7333800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:31.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.523+0000 7fbdd7333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:31.524 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.523+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.523+0000 7fbdd7333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:31.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.523+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:31.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:31.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 20 zone default found 2024-09-12T18:07:31.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 4 Realm: () 2024-09-12T18:07:31.526 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T18:07:31.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T18:07:31.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:31.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 20 zonegroup default 2024-09-12T18:07:31.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:31.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:31.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.524+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.525+0000 7fbdd7333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:31.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.525+0000 7fbdd7333800 20 started sync module instance, tier type = 2024-09-12T18:07:31.527 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.525+0000 7fbdd7333800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T18:07:31.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.534+0000 7fbdd7333800 20 add_watcher() i=0 2024-09-12T18:07:31.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.534+0000 7fbdd7333800 20 add_watcher() i=1 2024-09-12T18:07:31.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.534+0000 7fbdd7333800 20 add_watcher() i=2 2024-09-12T18:07:31.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.534+0000 7fbdd7333800 20 add_watcher() i=3 2024-09-12T18:07:31.535 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.534+0000 7fbdd7333800 20 add_watcher() i=4 2024-09-12T18:07:31.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.534+0000 7fbdd7333800 20 add_watcher() i=5 2024-09-12T18:07:31.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.534+0000 7fbdd7333800 20 add_watcher() i=6 2024-09-12T18:07:31.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.535+0000 7fbdd7333800 20 add_watcher() i=7 2024-09-12T18:07:31.536 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.535+0000 7fbdd7333800 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:31.538 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.537+0000 7fbc89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:31.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.537+0000 7fbdd7333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:31.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.537+0000 7fbdd7333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:31.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.537+0000 7fbdd7333800 5 note: GC not initialized 2024-09-12T18:07:31.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.537+0000 7fbc88fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:31.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.537+0000 7fbdd7333800 20 init_complete bucket index max shards: 1 2024-09-12T18:07:31.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.538+0000 7fbdd7333800 20 Filter name: none 2024-09-12T18:07:31.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.538+0000 7fbc027fc640 20 reqs_thread_entry: start 2024-09-12T18:07:31.539 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.538+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.538+0000 7fbdd7333800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:07:31.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.538+0000 7fbdd7333800 20 rados->read ofs=0 len=0 2024-09-12T18:07:31.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.538+0000 7fbdd7333800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:07:31.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.538+0000 7fbdd7333800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:07:31.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.538+0000 7fbdd7333800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T18:07:31.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.538+0000 7fbdd7333800 20 INFO: main: starting shard=0 2024-09-12T18:07:31.540 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.538+0000 7fbdd7333800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.783.0 2024-09-12T18:07:31.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.539+0000 7fbdd7333800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:07:31.541 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.539+0000 7fbdd7333800 20 INFO: main: done 2024-09-12T18:07:31.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.540+0000 7fbc89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:31.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.542+0000 7fbdd7333800 20 remove_watcher() i=0 2024-09-12T18:07:31.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.542+0000 7fbdd7333800 2 removed watcher, disabling cache 2024-09-12T18:07:31.545 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.543+0000 7fbdd7333800 20 remove_watcher() i=1 2024-09-12T18:07:31.546 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.545+0000 7fbdd7333800 20 remove_watcher() i=2 2024-09-12T18:07:31.547 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.546+0000 7fbdd7333800 20 remove_watcher() i=3 2024-09-12T18:07:31.548 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.547+0000 7fbdd7333800 20 remove_watcher() i=4 2024-09-12T18:07:31.549 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.548+0000 7fbdd7333800 20 remove_watcher() i=5 2024-09-12T18:07:31.550 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.549+0000 7fbdd7333800 20 remove_watcher() i=6 2024-09-12T18:07:31.551 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.550+0000 7fbdd7333800 20 remove_watcher() i=7 2024-09-12T18:07:31.562 INFO:tasks.workunit.client.0.smithi107.stderr:rados -p default.rgw.buckets.data ls | grep d25f8fbd-b872-46ea-8901-4319c350e771 2024-09-12T18:07:31.585 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:31.585 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:31.626 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:31.625+0000 7f6d3a8ff640 0 -- 172.21.15.107:0/623662653 >> [v2:172.21.15.107:6824/1525535229,v1:172.21.15.107:6825/1525535229] conn(0x7f6d300233e0 msgr2=0x7f6d30023840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:31.633 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T18:07:31.633 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T18:07:31.670 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:07:33.116 INFO:tasks.workunit.client.0.smithi107.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:07:33.118 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:07:33.521 INFO:tasks.workunit.client.0.smithi107.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T18:07:33.521 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-09-12T18:07:33.621 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T18:07:37.038 INFO:tasks.workunit.client.0.smithi107.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T18:07:37.432 INFO:tasks.workunit.client.0.smithi107.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T18:07:37.461 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:37.461 INFO:tasks.workunit.client.0.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:37.498 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.497+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.498+0000 7f9337942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:37.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.498+0000 7f9337942800 20 realm 2024-09-12T18:07:37.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.498+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.499+0000 7f9337942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:37.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.499+0000 7f9337942800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:37.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.499+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.500 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.499+0000 7f9337942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:37.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.499+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.500+0000 7f9337942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:37.501 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.500+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.500+0000 7f9337942800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:37.502 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.500+0000 7f9337942800 20 searching for the correct realm 2024-09-12T18:07:37.504 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.503+0000 7f9333686640 0 -- 172.21.15.107:0/3740604873 >> [v2:172.21.15.148:6818/357097900,v1:172.21.15.148:6819/357097900] conn(0x7f932c09f070 msgr2=0x7f932c089990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:37.508 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.507+0000 7f9333686640 0 -- 172.21.15.107:0/3740604873 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7f9328067950 msgr2=0x7f9328056470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:37.716 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.714+0000 7f9337942800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.714+0000 7f9337942800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.714+0000 7f9337942800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.714+0000 7f9337942800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.714+0000 7f9337942800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.714+0000 7f9337942800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.714+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.714+0000 7f9337942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.714+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.715+0000 7f9337942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.715+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.715+0000 7f9337942800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.715+0000 7f9337942800 20 zone default found 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.715+0000 7f9337942800 4 Realm: () 2024-09-12T18:07:37.717 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.715+0000 7f9337942800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T18:07:37.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.715+0000 7f9337942800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T18:07:37.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.715+0000 7f9337942800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:37.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.715+0000 7f9337942800 20 zonegroup default 2024-09-12T18:07:37.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.715+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.715+0000 7f9337942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:37.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.715+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.718 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.716+0000 7f9337942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:37.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.716+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.716+0000 7f9337942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:37.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.716+0000 7f9337942800 20 started sync module instance, tier type = 2024-09-12T18:07:37.719 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.716+0000 7f9337942800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T18:07:37.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.725+0000 7f9337942800 20 add_watcher() i=0 2024-09-12T18:07:37.726 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.725+0000 7f9337942800 20 add_watcher() i=1 2024-09-12T18:07:37.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.725+0000 7f9337942800 20 add_watcher() i=2 2024-09-12T18:07:37.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.725+0000 7f9337942800 20 add_watcher() i=3 2024-09-12T18:07:37.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.725+0000 7f9337942800 20 add_watcher() i=4 2024-09-12T18:07:37.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.725+0000 7f9337942800 20 add_watcher() i=5 2024-09-12T18:07:37.727 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.725+0000 7f9337942800 20 add_watcher() i=6 2024-09-12T18:07:37.728 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.726+0000 7f9337942800 20 add_watcher() i=7 2024-09-12T18:07:37.728 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.726+0000 7f9337942800 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:37.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.728+0000 7f91e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:37.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.728+0000 7f9337942800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:37.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.728+0000 7f9337942800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:37.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.728+0000 7f9337942800 5 note: GC not initialized 2024-09-12T18:07:37.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.728+0000 7f91e8fe1640 20 reqs_thread_entry: start 2024-09-12T18:07:37.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.728+0000 7f9337942800 20 init_complete bucket index max shards: 1 2024-09-12T18:07:37.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.729+0000 7f9337942800 20 Filter name: none 2024-09-12T18:07:37.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.729+0000 7f91627fc640 20 reqs_thread_entry: start 2024-09-12T18:07:37.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.729+0000 7f9337942800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T18:07:37.730 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.729+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.731 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.729+0000 7f9337942800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:07:37.731 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.729+0000 7f9337942800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T18:07:37.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.729+0000 7f9337942800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T18:07:37.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.729+0000 7f9337942800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.783 : miss 2024-09-12T18:07:37.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.729+0000 7f9337942800 20 rados->read ofs=0 len=0 2024-09-12T18:07:37.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.730+0000 7f9337942800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:07:37.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.730+0000 7f9337942800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.783 info.flags=0x17 2024-09-12T18:07:37.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.730+0000 7f9337942800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.783 to cache LRU end 2024-09-12T18:07:37.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.730+0000 7f9337942800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:37.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.730+0000 7f9337942800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:07:37.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.730+0000 7f9337942800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:35ed0db6-4f54-4e96-b306-71079c84e007.4596.783 2024-09-12T18:07:37.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.730+0000 7f9337942800 20 bucket index object: :.dir.35ed0db6-4f54-4e96-b306-71079c84e007.4596.783.0 2024-09-12T18:07:37.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.730+0000 7f9337942800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:07:37.732 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.730+0000 7f9337942800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T18:07:37.733 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.731+0000 7f91e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:37.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.733+0000 7f9337942800 20 remove_watcher() i=0 2024-09-12T18:07:37.734 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.733+0000 7f9337942800 2 removed watcher, disabling cache 2024-09-12T18:07:37.735 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.735+0000 7f9337942800 20 remove_watcher() i=1 2024-09-12T18:07:37.737 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.736+0000 7f9337942800 20 remove_watcher() i=2 2024-09-12T18:07:37.738 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.737+0000 7f9337942800 20 remove_watcher() i=3 2024-09-12T18:07:37.739 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.738+0000 7f9337942800 20 remove_watcher() i=4 2024-09-12T18:07:37.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.739+0000 7f9337942800 20 remove_watcher() i=5 2024-09-12T18:07:37.740 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.740+0000 7f9337942800 20 remove_watcher() i=6 2024-09-12T18:07:37.741 INFO:tasks.workunit.client.0.smithi107.stderr:2024-09-12T18:07:37.740+0000 7f9337942800 20 remove_watcher() i=7 2024-09-12T18:07:37.752 INFO:tasks.workunit.client.0.smithi107.stderr:Deleting bucket versioning-bucket 2024-09-12T18:07:37.772 INFO:tasks.workunit.client.0.smithi107.stderr:Completed bucket versioning tests 2024-09-12T18:07:37.772 INFO:tasks.workunit.client.0.smithi107.stdout:connected to http://localhost:80 2024-09-12T18:07:37.830 INFO:tasks.workunit.client.0.smithi107.stderr:+ deactivate 2024-09-12T18:07:37.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T18:07:37.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:07:37.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ export PATH 2024-09-12T18:07:37.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:07:37.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n '' ']' 2024-09-12T18:07:37.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:07:37.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ hash -r 2024-09-12T18:07:37.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' -n '' ']' 2024-09-12T18:07:37.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:07:37.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:07:37.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ unset -f deactivate 2024-09-12T18:07:37.831 INFO:tasks.workunit.client.0.smithi107.stderr:+ echo OK. 2024-09-12T18:07:37.832 INFO:tasks.workunit.client.0.smithi107.stdout:OK. 2024-09-12T18:07:37.832 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:07:37.833 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:07:37.913 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T18:07:37.914 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:07:38.269 DEBUG:teuthology.parallel:result is None 2024-09-12T18:07:38.270 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:07:38.308 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:07:38.308 DEBUG:teuthology.orchestra.run.smithi107:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:07:38.377 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:07:38.377 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T18:07:38.391 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T18:07:38.453 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T18:07:38.453 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T18:07:38.453 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:07:38.517 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T18:07:38.517 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T18:07:38.575 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:07:38.575 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:07:38.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.607+0000 7f6b00930800 20 rados->read ofs=0 len=0 2024-09-12T18:07:38.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.608+0000 7f6b00930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:38.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.608+0000 7f6b00930800 20 realm 2024-09-12T18:07:38.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.608+0000 7f6b00930800 20 rados->read ofs=0 len=0 2024-09-12T18:07:38.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.608+0000 7f6b00930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:38.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.608+0000 7f6b00930800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:07:38.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.608+0000 7f6b00930800 20 rados->read ofs=0 len=0 2024-09-12T18:07:38.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.609+0000 7f6b00930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:38.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.609+0000 7f6b00930800 20 rados->read ofs=0 len=0 2024-09-12T18:07:38.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.609+0000 7f6b00930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:38.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.609+0000 7f6b00930800 20 rados->read ofs=0 len=0 2024-09-12T18:07:38.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.610+0000 7f6b00930800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:07:38.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.610+0000 7f6b00930800 20 searching for the correct realm 2024-09-12T18:07:38.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.613+0000 7f6afceb1640 0 -- 172.21.15.107:0/3599489789 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x559d750d61c0 msgr2=0x559d750d8680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:38.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.617+0000 7f6afbeaf640 0 -- 172.21.15.107:0/3599489789 >> [v2:172.21.15.148:6826/3050464724,v1:172.21.15.148:6827/3050464724] conn(0x7f6af0006400 msgr2=0x7f6af0006840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:07:38.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.621+0000 7f6b00930800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:07:38.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.621+0000 7f6b00930800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:07:38.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.621+0000 7f6b00930800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T18:07:38.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.621+0000 7f6b00930800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T18:07:38.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.621+0000 7f6b00930800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:07:38.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.621+0000 7f6b00930800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:07:38.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.621+0000 7f6b00930800 20 rados->read ofs=0 len=0 2024-09-12T18:07:38.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:38.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 20 rados->read ofs=0 len=0 2024-09-12T18:07:38.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:07:38.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 20 rados->read ofs=0 len=0 2024-09-12T18:07:38.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:07:38.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 20 zone default found 2024-09-12T18:07:38.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 4 Realm: () 2024-09-12T18:07:38.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T18:07:38.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T18:07:38.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:07:38.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 20 zonegroup default 2024-09-12T18:07:38.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 20 rados->read ofs=0 len=0 2024-09-12T18:07:38.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.622+0000 7f6b00930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:38.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.623+0000 7f6b00930800 20 rados->read ofs=0 len=0 2024-09-12T18:07:38.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.623+0000 7f6b00930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:38.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.623+0000 7f6b00930800 20 rados->read ofs=0 len=0 2024-09-12T18:07:38.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.623+0000 7f6b00930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:07:38.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.623+0000 7f6b00930800 20 started sync module instance, tier type = 2024-09-12T18:07:38.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.623+0000 7f6b00930800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T18:07:38.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.632+0000 7f6b00930800 20 add_watcher() i=0 2024-09-12T18:07:38.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.632+0000 7f6b00930800 20 add_watcher() i=1 2024-09-12T18:07:38.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.632+0000 7f6b00930800 20 add_watcher() i=2 2024-09-12T18:07:38.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.632+0000 7f6b00930800 20 add_watcher() i=3 2024-09-12T18:07:38.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.632+0000 7f6b00930800 20 add_watcher() i=4 2024-09-12T18:07:38.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.632+0000 7f6b00930800 20 add_watcher() i=5 2024-09-12T18:07:38.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.632+0000 7f6b00930800 20 add_watcher() i=6 2024-09-12T18:07:38.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.633+0000 7f6b00930800 20 add_watcher() i=7 2024-09-12T18:07:38.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.633+0000 7f6b00930800 2 all 8 watchers are set, enabling cache 2024-09-12T18:07:38.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.634+0000 7f69b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:38.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.634+0000 7f6b00930800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:07:38.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.634+0000 7f6b00930800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:07:38.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.670+0000 7f69b17e2640 20 reqs_thread_entry: start 2024-09-12T18:07:38.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.670+0000 7f6b00930800 20 init_complete bucket index max shards: 1 2024-09-12T18:07:38.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.670+0000 7f6b00930800 20 Filter name: none 2024-09-12T18:07:38.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.670+0000 7f6922ffd640 20 reqs_thread_entry: start 2024-09-12T18:07:38.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.670+0000 7f6b00930800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:07:38.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.670+0000 7f6b00930800 20 rados->read ofs=0 len=0 2024-09-12T18:07:38.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.671+0000 7f6b00930800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T18:07:38.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.671+0000 7f6b00930800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T18:07:38.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.671+0000 7f6b00930800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:07:38.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.671+0000 7f6b00930800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:07:38.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.672+0000 7f6b00930800 10 removing key index: PCZJRJXYDKAAWCXQLOVA 2024-09-12T18:07:38.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.673+0000 7f6b00930800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:PCZJRJXYDKAAWCXQLOVA, ofs0, ns] 2024-09-12T18:07:38.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.673+0000 7f69db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366467 cookie 94134762042080 notifier 8807 bl.length()=170 2024-09-12T18:07:38.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.674+0000 7f6b00930800 10 removing email index: tester.client.0_test@test.test 2024-09-12T18:07:38.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.674+0000 7f6b00930800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:07:38.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.675+0000 7f69db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366479 cookie 94134762045856 notifier 8807 bl.length()=181 2024-09-12T18:07:38.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.675+0000 7f6b00930800 10 removing user buckets index 2024-09-12T18:07:38.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.676+0000 7f6b00930800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T18:07:38.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.677+0000 7f69daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366441 cookie 94134762055920 notifier 8807 bl.length()=172 2024-09-12T18:07:38.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.677+0000 7f6b00930800 10 removing user index: tester.client.0 2024-09-12T18:07:38.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.679+0000 7f6b00930800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T18:07:38.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.679+0000 7f6b00930800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:07:38.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.680+0000 7f69db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367419 cookie 94134762057664 notifier 8807 bl.length()=164 2024-09-12T18:07:38.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.681+0000 7f69b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:07:38.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.683+0000 7f6b00930800 20 remove_watcher() i=0 2024-09-12T18:07:38.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.683+0000 7f6b00930800 2 removed watcher, disabling cache 2024-09-12T18:07:38.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.685+0000 7f6b00930800 20 remove_watcher() i=1 2024-09-12T18:07:38.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.685+0000 7f6b00930800 20 remove_watcher() i=2 2024-09-12T18:07:38.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.687+0000 7f6b00930800 20 remove_watcher() i=3 2024-09-12T18:07:38.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.688+0000 7f6b00930800 20 remove_watcher() i=4 2024-09-12T18:07:38.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.689+0000 7f6b00930800 20 remove_watcher() i=5 2024-09-12T18:07:38.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.690+0000 7f6b00930800 20 remove_watcher() i=6 2024-09-12T18:07:38.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:07:38.691+0000 7f6b00930800 20 remove_watcher() i=7 2024-09-12T18:07:38.703 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T18:07:38.714 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T18:07:38.767 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T18:07:38.823 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T18:07:38.834 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T18:07:38.834 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:07:38.835 INFO:tasks.rgw.client.0.smithi107.stdout:2024-09-12T18:07:38.834+0000 7ff3ea3a1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 44368) UID: 0 2024-09-12T18:07:38.835 INFO:tasks.rgw.client.0.smithi107.stdout:2024-09-12T18:07:38.834+0000 7ff3efb26880 -1 shutting down 2024-09-12T18:08:00.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T18:08:03.240 INFO:tasks.rgw.client.0:Stopped 2024-09-12T18:08:03.241 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T18:08:03.275 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T18:08:03.360 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T18:08:03.401 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T18:08:03.401 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T18:08:03.402 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T18:08:03.500 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:08:03.501 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:08:03.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.533+0000 7fc3bf9af800 20 rados->read ofs=0 len=0 2024-09-12T18:08:03.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.534+0000 7fc3bf9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:03.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.534+0000 7fc3bf9af800 20 realm 2024-09-12T18:08:03.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.534+0000 7fc3bf9af800 20 rados->read ofs=0 len=0 2024-09-12T18:08:03.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.535+0000 7fc3bf9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:03.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.535+0000 7fc3bf9af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:08:03.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.535+0000 7fc3bf9af800 20 rados->read ofs=0 len=0 2024-09-12T18:08:03.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.535+0000 7fc3bf9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:03.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.535+0000 7fc3bf9af800 20 rados->read ofs=0 len=0 2024-09-12T18:08:03.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.536+0000 7fc3bf9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:03.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.536+0000 7fc3bf9af800 20 rados->read ofs=0 len=0 2024-09-12T18:08:03.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.537+0000 7fc3bf9af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:08:03.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.537+0000 7fc3bf9af800 20 searching for the correct realm 2024-09-12T18:08:03.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.540+0000 7fc3bdc9a640 0 -- 172.21.15.107:0/689306883 >> [v2:172.21.15.107:6808/3471033075,v1:172.21.15.107:6809/3471033075] conn(0x55c96fb28750 msgr2=0x55c96fb2ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:03.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.543+0000 7fc3bd499640 0 -- 172.21.15.107:0/689306883 >> [v2:172.21.15.107:6800/3240254390,v1:172.21.15.107:6801/3240254390] conn(0x7fc3a80a3420 msgr2=0x7fc3a80a38a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:08:03.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.547+0000 7fc3bf9af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:08:03.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.547+0000 7fc3bf9af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:08:03.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.547+0000 7fc3bf9af800 20 RGWRados::pool_iterate: got zonegroup_info.57026f04-6b51-4ea0-9f60-2318269d6417 2024-09-12T18:08:03.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.547+0000 7fc3bf9af800 20 RGWRados::pool_iterate: got zone_info.35ed0db6-4f54-4e96-b306-71079c84e007 2024-09-12T18:08:03.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.547+0000 7fc3bf9af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:08:03.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.547+0000 7fc3bf9af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:08:03.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.547+0000 7fc3bf9af800 20 rados->read ofs=0 len=0 2024-09-12T18:08:03.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.548+0000 7fc3bf9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:03.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.548+0000 7fc3bf9af800 20 rados->read ofs=0 len=0 2024-09-12T18:08:03.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.548+0000 7fc3bf9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:08:03.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.548+0000 7fc3bf9af800 20 rados->read ofs=0 len=0 2024-09-12T18:08:03.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.548+0000 7fc3bf9af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:08:03.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.548+0000 7fc3bf9af800 20 zone default found 2024-09-12T18:08:03.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.548+0000 7fc3bf9af800 4 Realm: () 2024-09-12T18:08:03.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.548+0000 7fc3bf9af800 4 ZoneGroup: default (57026f04-6b51-4ea0-9f60-2318269d6417) 2024-09-12T18:08:03.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.548+0000 7fc3bf9af800 4 Zone: default (35ed0db6-4f54-4e96-b306-71079c84e007) 2024-09-12T18:08:03.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.548+0000 7fc3bf9af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:08:03.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.548+0000 7fc3bf9af800 20 zonegroup default 2024-09-12T18:08:03.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.548+0000 7fc3bf9af800 20 rados->read ofs=0 len=0 2024-09-12T18:08:03.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.549+0000 7fc3bf9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:03.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.549+0000 7fc3bf9af800 20 rados->read ofs=0 len=0 2024-09-12T18:08:03.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.549+0000 7fc3bf9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:03.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.549+0000 7fc3bf9af800 20 rados->read ofs=0 len=0 2024-09-12T18:08:03.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.549+0000 7fc3bf9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:08:03.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.549+0000 7fc3bf9af800 20 started sync module instance, tier type = 2024-09-12T18:08:03.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.549+0000 7fc3bf9af800 20 started zone id=35ed0db6-4f54-4e96-b306-71079c84e007 (name=default) with tier type = 2024-09-12T18:08:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.559+0000 7fc3bf9af800 20 add_watcher() i=0 2024-09-12T18:08:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.559+0000 7fc3bf9af800 20 add_watcher() i=1 2024-09-12T18:08:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.559+0000 7fc3bf9af800 20 add_watcher() i=2 2024-09-12T18:08:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.559+0000 7fc3bf9af800 20 add_watcher() i=3 2024-09-12T18:08:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.559+0000 7fc3bf9af800 20 add_watcher() i=4 2024-09-12T18:08:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.559+0000 7fc3bf9af800 20 add_watcher() i=5 2024-09-12T18:08:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.559+0000 7fc3bf9af800 20 add_watcher() i=6 2024-09-12T18:08:03.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.560+0000 7fc3bf9af800 20 add_watcher() i=7 2024-09-12T18:08:03.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.560+0000 7fc3bf9af800 2 all 8 watchers are set, enabling cache 2024-09-12T18:08:03.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.561+0000 7fc273fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:03.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.561+0000 7fc3bf9af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:08:03.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.561+0000 7fc3bf9af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:08:03.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.598+0000 7fc272fe5640 20 reqs_thread_entry: start 2024-09-12T18:08:03.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.598+0000 7fc3bf9af800 20 init_complete bucket index max shards: 1 2024-09-12T18:08:03.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.598+0000 7fc3bf9af800 20 Filter name: none 2024-09-12T18:08:03.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.598+0000 7fc270fe1640 20 reqs_thread_entry: start 2024-09-12T18:08:03.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.598+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:08:03.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.600+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.600+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.600+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:08:03.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.600+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6056648137432990045', time=2024-09-12T20:01:33.736763+0000, chain.objs.size()=6 2024-09-12T18:08:03.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.600+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.1 2024-09-12T18:08:03.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.600+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.2 2024-09-12T18:08:03.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.601+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.3 2024-09-12T18:08:03.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.601+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.4 2024-09-12T18:08:03.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.601+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.5 2024-09-12T18:08:03.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.601+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.6 2024-09-12T18:08:03.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.601+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6661203718229228594', time=2024-09-12T20:01:39.379884+0000, chain.objs.size()=3 2024-09-12T18:08:03.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.601+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.522__multipart_mymultipart.2~54NaOdby7itk4OA7XK--3Pn8K1zKGjQ.1 2024-09-12T18:08:03.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.601+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.522__multipart_mymultipart.2~54NaOdby7itk4OA7XK--3Pn8K1zKGjQ.2 2024-09-12T18:08:03.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.601+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.522__multipart_mymultipart.2~54NaOdby7itk4OA7XK--3Pn8K1zKGjQ.3 2024-09-12T18:08:03.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.601+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.16243738475603968202', time=2024-09-12T20:01:44.933987+0000, chain.objs.size()=6 2024-09-12T18:08:03.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.601+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.yl2ug4w_xtRXD3Emmu_mWnU9hAGm0Hkn.1 2024-09-12T18:08:03.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.601+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.0yYbSYbvI5hywZZTcvzQnhqUm3y7XKyG.2 2024-09-12T18:08:03.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.601+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.JLGjzUegBkutQI14NWRrF4-fZ1_egiNU.3 2024-09-12T18:08:03.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.604+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.X0HJbkd5VpiYsXy7YzCRI-DHsOBN7vl8.4 2024-09-12T18:08:03.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.605+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.xYUXG_Cwj_kZfQcuwkJk8ewrMVsygSNN.5 2024-09-12T18:08:03.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.605+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.MACcr-0dQ4qav7nZmx3I47khwkJVciw7.6 2024-09-12T18:08:03.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.605+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.15508629457375407679', time=2024-09-12T20:05:55.276969+0000, chain.objs.size()=10 2024-09-12T18:08:03.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.605+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.736__multipart_foo.2~z7TkU3MCkBuY19oEcJJMcaoC0PWPxJj.1 2024-09-12T18:08:03.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.606+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.736__multipart_foo.2~z7TkU3MCkBuY19oEcJJMcaoC0PWPxJj.2 2024-09-12T18:08:03.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.606+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.736__multipart_foo.2~z7TkU3MCkBuY19oEcJJMcaoC0PWPxJj.3 2024-09-12T18:08:03.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.606+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.736__multipart_foo.2~z7TkU3MCkBuY19oEcJJMcaoC0PWPxJj.4 2024-09-12T18:08:03.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.606+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.736__multipart_foo.2~z7TkU3MCkBuY19oEcJJMcaoC0PWPxJj.5 2024-09-12T18:08:03.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.606+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.736__multipart_foo.2~z7TkU3MCkBuY19oEcJJMcaoC0PWPxJj.6 2024-09-12T18:08:03.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.606+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.736__multipart_foo.2~z7TkU3MCkBuY19oEcJJMcaoC0PWPxJj.7 2024-09-12T18:08:03.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.606+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.736__multipart_foo.2~z7TkU3MCkBuY19oEcJJMcaoC0PWPxJj.8 2024-09-12T18:08:03.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.607+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.736__multipart_foo.2~z7TkU3MCkBuY19oEcJJMcaoC0PWPxJj.9 2024-09-12T18:08:03.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.608+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.736__multipart_foo.2~z7TkU3MCkBuY19oEcJJMcaoC0PWPxJj.10 2024-09-12T18:08:03.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.613+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.615+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:08:03.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.617+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.617+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:08:03.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~Vxgb30WmLSYYBt2kUKCXlMr__bIWL5C', time=2024-09-12T20:01:41.346528+0000, chain.objs.size()=1 2024-09-12T18:08:03.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~Vxgb30WmLSYYBt2kUKCXlMr__bIWL5C.2 2024-09-12T18:08:03.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.9609375369098223404', time=2024-09-12T20:03:06.930975+0000, chain.objs.size()=6 2024-09-12T18:08:03.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.616__multipart_multipart_enc.2~2vYB7TXjqhIqHLsfIoVv9P5E50tPBBd.1 2024-09-12T18:08:03.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.616__multipart_multipart_enc.2~2vYB7TXjqhIqHLsfIoVv9P5E50tPBBd.2 2024-09-12T18:08:03.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.616__multipart_multipart_enc.2~2vYB7TXjqhIqHLsfIoVv9P5E50tPBBd.3 2024-09-12T18:08:03.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.616__multipart_multipart_enc.2~2vYB7TXjqhIqHLsfIoVv9P5E50tPBBd.4 2024-09-12T18:08:03.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.616__multipart_multipart_enc.2~2vYB7TXjqhIqHLsfIoVv9P5E50tPBBd.5 2024-09-12T18:08:03.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.616__multipart_multipart_enc.2~2vYB7TXjqhIqHLsfIoVv9P5E50tPBBd.6 2024-09-12T18:08:03.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.10753095889223008318', time=2024-09-12T20:05:09.758984+0000, chain.objs.size()=6 2024-09-12T18:08:03.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.624__multipart_multipart_enc.2~f8am08RzI895If53PcN7je_WppeJmgP.1 2024-09-12T18:08:03.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.624__multipart_multipart_enc.2~f8am08RzI895If53PcN7je_WppeJmgP.2 2024-09-12T18:08:03.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.624__multipart_multipart_enc.2~f8am08RzI895If53PcN7je_WppeJmgP.3 2024-09-12T18:08:03.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.624__multipart_multipart_enc.2~f8am08RzI895If53PcN7je_WppeJmgP.4 2024-09-12T18:08:03.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.618+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.624__multipart_multipart_enc.2~f8am08RzI895If53PcN7je_WppeJmgP.5 2024-09-12T18:08:03.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.622+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.624__multipart_multipart_enc.2~f8am08RzI895If53PcN7je_WppeJmgP.6 2024-09-12T18:08:03.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.626+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.629 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.628+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:08:03.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.629+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:08:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.17997949058734698358', time=2024-09-12T20:01:34.196891+0000, chain.objs.size()=1 2024-09-12T18:08:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.512__multipart_mymultipart.2~clxZaBM07ewXgGeZ7MC3iWKRyLgKcri.1 2024-09-12T18:08:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.1816589894235535483', time=2024-09-12T20:01:45.680638+0000, chain.objs.size()=3 2024-09-12T18:08:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~f3_-WQbLsKtsHASL0P71Zz6cY_LHcWa.1 2024-09-12T18:08:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~f3_-WQbLsKtsHASL0P71Zz6cY_LHcWa.2 2024-09-12T18:08:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~f3_-WQbLsKtsHASL0P71Zz6cY_LHcWa.3 2024-09-12T18:08:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~rtBDapawlar-g2xLme1lBon0xbDyyhv', time=2024-09-12T20:01:49.270824+0000, chain.objs.size()=2 2024-09-12T18:08:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.530__multipart_mymultipart.2~rtBDapawlar-g2xLme1lBon0xbDyyhv.1 2024-09-12T18:08:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.530__multipart_mymultipart.2~rtBDapawlar-g2xLme1lBon0xbDyyhv.2 2024-09-12T18:08:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.13785747478445123612', time=2024-09-12T20:02:55.151127+0000, chain.objs.size()=4 2024-09-12T18:08:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.579__multipart_testobj.2~5CfE9RUu1J6ChMj-BFpNs6hf5Nm8WbM.1 2024-09-12T18:08:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.579__multipart_testobj.2~5CfE9RUu1J6ChMj-BFpNs6hf5Nm8WbM.2 2024-09-12T18:08:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.579__multipart_testobj.2~5CfE9RUu1J6ChMj-BFpNs6hf5Nm8WbM.3 2024-09-12T18:08:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.579__multipart_testobj.2~5CfE9RUu1J6ChMj-BFpNs6hf5Nm8WbM.4 2024-09-12T18:08:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.15846541630111273723', time=2024-09-12T20:05:57.301885+0000, chain.objs.size()=3 2024-09-12T18:08:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.630+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.744__multipart_mymultipart3.2~pN2E-5Yu65Z48DX2km336VotQHsVOEv.1 2024-09-12T18:08:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.631+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.744__multipart_mymultipart3.2~pN2E-5Yu65Z48DX2km336VotQHsVOEv.2 2024-09-12T18:08:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.633+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.744__multipart_mymultipart3.2~pN2E-5Yu65Z48DX2km336VotQHsVOEv.3 2024-09-12T18:08:03.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.635+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.638+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:08:03.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.639+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:08:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.12763706223795162396', time=2024-09-12T19:59:08.111610+0000, chain.objs.size()=2 2024-09-12T18:08:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.165__multipart_foo.2~FYVHmSFStNGNqGZ2UIqC1anlsnhJC2S.1 2024-09-12T18:08:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.165__multipart_foo.2~FYVHmSFStNGNqGZ2UIqC1anlsnhJC2S.2 2024-09-12T18:08:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.11342037896174732991', time=2024-09-12T20:01:45.930289+0000, chain.objs.size()=2 2024-09-12T18:08:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~rG8wlhtihDd47sxLehtm3iIPVUHP-1f.1 2024-09-12T18:08:03.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~rG8wlhtihDd47sxLehtm3iIPVUHP-1f.2 2024-09-12T18:08:03.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~fydye_BCyw4CE68iR_LjetJzHy21L_H', time=2024-09-12T20:05:11.041198+0000, chain.objs.size()=6 2024-09-12T18:08:03.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.626__multipart_multipart_enc.2~fydye_BCyw4CE68iR_LjetJzHy21L_H.1 2024-09-12T18:08:03.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.626__multipart_multipart_enc.2~fydye_BCyw4CE68iR_LjetJzHy21L_H.2 2024-09-12T18:08:03.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.626__multipart_multipart_enc.2~fydye_BCyw4CE68iR_LjetJzHy21L_H.3 2024-09-12T18:08:03.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.626__multipart_multipart_enc.2~fydye_BCyw4CE68iR_LjetJzHy21L_H.4 2024-09-12T18:08:03.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.626__multipart_multipart_enc.2~fydye_BCyw4CE68iR_LjetJzHy21L_H.5 2024-09-12T18:08:03.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.640+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.626__multipart_multipart_enc.2~fydye_BCyw4CE68iR_LjetJzHy21L_H.6 2024-09-12T18:08:03.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.644+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.646+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:08:03.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.648+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.648+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.649+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:08:03.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.649+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_kr0iiCjNm4H6k_IYzkwHn9gVLTgfI1K', time=2024-09-12T19:59:05.414340+0000, chain.objs.size()=2 2024-09-12T18:08:03.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.649+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.161__shadow_.FHrzyNs1gdecE6tjbjd0GGL1YyKTLh9_0 2024-09-12T18:08:03.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.649+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.161__shadow_.FHrzyNs1gdecE6tjbjd0GGL1YyKTLh9_1 2024-09-12T18:08:03.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.649+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_qPZzK04g-3P_mzyiAnUil81t7yB_0eM', time=2024-09-12T19:59:07.091776+0000, chain.objs.size()=2 2024-09-12T18:08:03.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.649+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__shadow_.BGhz_iC09hnciUUpwYg5dgxIRPGwQzo_0 2024-09-12T18:08:03.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.649+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__shadow_.BGhz_iC09hnciUUpwYg5dgxIRPGwQzo_1 2024-09-12T18:08:03.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.649+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.3069769929806734971', time=2024-09-12T20:01:48.833154+0000, chain.objs.size()=1 2024-09-12T18:08:03.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.649+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.529__shadow_.ZwZVnBvhHZyzuWCli4BZRjVtYwAHDym_1 2024-09-12T18:08:03.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.649+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~kARBbR3AUTtCRaTs16de2JMM_U_GikF', time=2024-09-12T20:02:22.490251+0000, chain.objs.size()=1 2024-09-12T18:08:03.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.649+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.562__multipart_mymultipart.2~kARBbR3AUTtCRaTs16de2JMM_U_GikF.1 2024-09-12T18:08:03.653 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.652+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.654+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:08:03.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.655+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.655+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:08:03.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.8317353911593814798', time=2024-09-12T19:59:03.550432+0000, chain.objs.size()=2 2024-09-12T18:08:03.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.159__shadow_.ZsGLXtEyeHXf9hkjY94ozsPlpAoA5WQ_0 2024-09-12T18:08:03.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.159__shadow_.ZsGLXtEyeHXf9hkjY94ozsPlpAoA5WQ_1 2024-09-12T18:08:03.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.17720152205488396596', time=2024-09-12T19:59:05.204491+0000, chain.objs.size()=2 2024-09-12T18:08:03.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.161__shadow_.4jciZwsq-9hBJhW8SeyxSr19pZCnMS9_0 2024-09-12T18:08:03.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.161__shadow_.4jciZwsq-9hBJhW8SeyxSr19pZCnMS9_1 2024-09-12T18:08:03.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_UgOQzqWZJjqEIOjghvIOJEZ4K2LiSaq', time=2024-09-12T19:59:07.506697+0000, chain.objs.size()=1 2024-09-12T18:08:03.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.164__shadow_.gMgiPYSGD2vkaBPuerv71gW-HaHSfcv_0 2024-09-12T18:08:03.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.3694540233018369584', time=2024-09-12T20:01:36.388445+0000, chain.objs.size()=1 2024-09-12T18:08:03.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.519__multipart_mymultipart.2~j2rmDfXVsehKU99DSPtun2bFVFb47rC.1 2024-09-12T18:08:03.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.14577721885615030543', time=2024-09-12T20:01:36.559941+0000, chain.objs.size()=1 2024-09-12T18:08:03.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.656+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.518__shadow_.WWrqMDOD7ZZoTmOk8nhfjo3YKMqugZs_1 2024-09-12T18:08:03.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.659+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.661+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:08:03.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.662+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.662+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.663+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:03.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.663+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.4424569920897678862', time=2024-09-12T20:01:42.107385+0000, chain.objs.size()=6 2024-09-12T18:08:03.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.663+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~Vxgb30WmLSYYBt2kUKCXlMr__bIWL5C.1 2024-09-12T18:08:03.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.663+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.Zpw0V6lHTvhAUV9EySp70EiM1-urf2c-.2 2024-09-12T18:08:03.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.663+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~Vxgb30WmLSYYBt2kUKCXlMr__bIWL5C.3 2024-09-12T18:08:03.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.663+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~Vxgb30WmLSYYBt2kUKCXlMr__bIWL5C.4 2024-09-12T18:08:03.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.663+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~Vxgb30WmLSYYBt2kUKCXlMr__bIWL5C.5 2024-09-12T18:08:03.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.663+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~Vxgb30WmLSYYBt2kUKCXlMr__bIWL5C.6 2024-09-12T18:08:03.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.663+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~Wil4A-Lc7vhBUXbwSslFNZk11ln__RB', time=2024-09-12T20:01:50.355369+0000, chain.objs.size()=1 2024-09-12T18:08:03.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.663+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.534__multipart_mymultipart.2~Wil4A-Lc7vhBUXbwSslFNZk11ln__RB.1 2024-09-12T18:08:03.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.665+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.668+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:08:03.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.669+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.670+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.670+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:08:03.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.670+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_zdKAy7C6FZDjdcp_RXfyFYNoE2zOv7c', time=2024-09-12T19:59:07.511809+0000, chain.objs.size()=1 2024-09-12T18:08:03.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.670+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.164__shadow_.ky338-lJaezRly592Hwn04oHd46t6_h_0 2024-09-12T18:08:03.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.670+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.13549841798425539253', time=2024-09-12T20:01:39.078311+0000, chain.objs.size()=3 2024-09-12T18:08:03.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.670+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.522__multipart_mymultipart.2~RrKiSQP54R3anjV-huQJXkLXftTE1J3.1 2024-09-12T18:08:03.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.670+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.522__multipart_mymultipart.2~RrKiSQP54R3anjV-huQJXkLXftTE1J3.2 2024-09-12T18:08:03.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.670+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.522__multipart_mymultipart.2~RrKiSQP54R3anjV-huQJXkLXftTE1J3.3 2024-09-12T18:08:03.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.670+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.8622006540064282183', time=2024-09-12T20:02:21.325806+0000, chain.objs.size()=1 2024-09-12T18:08:03.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.670+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.559__shadow_.GoN0hK1oiSEdHdD17xHFCcarlzEfsjc_1 2024-09-12T18:08:03.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.672+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.675+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:08:03.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.676+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:08:03.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.16725378754089565813', time=2024-09-12T19:59:04.528594+0000, chain.objs.size()=3 2024-09-12T18:08:03.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.160__multipart_mymultipart-FROZEN.2~y2X_rfaZZyQ3K1iYf75GxUlBs-eLF2j.1 2024-09-12T18:08:03.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.160__multipart_mymultipart-FROZEN.2~y2X_rfaZZyQ3K1iYf75GxUlBs-eLF2j.2 2024-09-12T18:08:03.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.160__multipart_mymultipart-FROZEN.2~y2X_rfaZZyQ3K1iYf75GxUlBs-eLF2j.3 2024-09-12T18:08:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_vjA1VObdRdXeRsQKbr0TGnDigwlxt3v', time=2024-09-12T19:59:06.423630+0000, chain.objs.size()=2 2024-09-12T18:08:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__shadow_.VgyZnykkNmSwGVHdiuXdLpBlBy7yDzP_1 2024-09-12T18:08:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__shadow_.VgyZnykkNmSwGVHdiuXdLpBlBy7yDzP_2 2024-09-12T18:08:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.10181432885667242529', time=2024-09-12T20:01:33.640399+0000, chain.objs.size()=6 2024-09-12T18:08:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.1 2024-09-12T18:08:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.2 2024-09-12T18:08:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.3 2024-09-12T18:08:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.4 2024-09-12T18:08:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.5 2024-09-12T18:08:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.677+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.6 2024-09-12T18:08:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.678+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.5147391259363500966', time=2024-09-12T20:01:47.601097+0000, chain.objs.size()=3 2024-09-12T18:08:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.678+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~HQpMrYTzfdccopHh-hCq-l-tl9IA_tp.1 2024-09-12T18:08:03.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.681+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~HQpMrYTzfdccopHh-hCq-l-tl9IA_tp.2 2024-09-12T18:08:03.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.681+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~HQpMrYTzfdccopHh-hCq-l-tl9IA_tp.3 2024-09-12T18:08:03.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.682+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6607399870358894249', time=2024-09-12T20:01:48.962636+0000, chain.objs.size()=2 2024-09-12T18:08:03.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.682+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.529__multipart_mymultipart.2~2W2uIE8_v37n05-ulCJoWQZGlqEUH7w.1 2024-09-12T18:08:03.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.682+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.529__multipart_mymultipart.2~2W2uIE8_v37n05-ulCJoWQZGlqEUH7w.2 2024-09-12T18:08:03.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.684+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.686+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:08:03.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.688+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.688+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.688+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:03.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.688+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.13163811248761484783', time=2024-09-12T19:59:04.539603+0000, chain.objs.size()=3 2024-09-12T18:08:03.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.688+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.160__multipart_mymultipart-STANDARD.2~x5vuyCXlLywStKm1KYDgIM5QOt2hPvz.1 2024-09-12T18:08:03.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.688+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.160__multipart_mymultipart-STANDARD.2~x5vuyCXlLywStKm1KYDgIM5QOt2hPvz.2 2024-09-12T18:08:03.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.688+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.160__multipart_mymultipart-STANDARD.2~x5vuyCXlLywStKm1KYDgIM5QOt2hPvz.3 2024-09-12T18:08:03.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.688+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.1635990124835735796', time=2024-09-12T20:01:47.818218+0000, chain.objs.size()=2 2024-09-12T18:08:03.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.688+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~JWxWDfHimZWlUKq_YSwKIx0rbStuP23.1 2024-09-12T18:08:03.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.688+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~JWxWDfHimZWlUKq_YSwKIx0rbStuP23.2 2024-09-12T18:08:03.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.692+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.694+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:08:03.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.695+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.695+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.696+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:03.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.696+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.1275386609754397013', time=2024-09-12T19:59:04.909697+0000, chain.objs.size()=2 2024-09-12T18:08:03.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.696+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.161__shadow_.Wjuw_4OGN9Yf3mIbEQXiwtI1dGszJu7_0 2024-09-12T18:08:03.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.696+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.161__shadow_.Wjuw_4OGN9Yf3mIbEQXiwtI1dGszJu7_1 2024-09-12T18:08:03.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.696+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.9609070363903867914', time=2024-09-12T20:01:45.862284+0000, chain.objs.size()=3 2024-09-12T18:08:03.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.696+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~qKA6CJS1duNfUmpE1kYDa7D23HQT8ub.1 2024-09-12T18:08:03.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.696+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~qKA6CJS1duNfUmpE1kYDa7D23HQT8ub.2 2024-09-12T18:08:03.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.696+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~qKA6CJS1duNfUmpE1kYDa7D23HQT8ub.3 2024-09-12T18:08:03.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.698+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.700+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:08:03.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.702+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.702+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.703+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:03.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.703+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~IskpzSJ6IUuAZe9fsBZnqsGhldUQBXi', time=2024-09-12T20:01:49.875979+0000, chain.objs.size()=2 2024-09-12T18:08:03.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.703+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.532__multipart_mymultipart.2~IskpzSJ6IUuAZe9fsBZnqsGhldUQBXi.1 2024-09-12T18:08:03.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.703+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.532__multipart_mymultipart.2~IskpzSJ6IUuAZe9fsBZnqsGhldUQBXi.2 2024-09-12T18:08:03.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.703+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6416321445513041030', time=2024-09-12T20:02:22.651439+0000, chain.objs.size()=1 2024-09-12T18:08:03.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.703+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.562__multipart_mymultipart.A7l2ia4kMYWljFBmjuDtvIrAmTivxJaB.1 2024-09-12T18:08:03.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.704+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.706+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:08:03.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.708+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.708+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.7766964124836777379', time=2024-09-12T20:01:39.603022+0000, chain.objs.size()=3 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.522__multipart_mymultipart.2~hD0IYdPz9PEIpe6voznyDVyRVitT4uu.1 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.522__multipart_mymultipart.2~hD0IYdPz9PEIpe6voznyDVyRVitT4uu.2 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.522__multipart_mymultipart.2~hD0IYdPz9PEIpe6voznyDVyRVitT4uu.3 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.14072286930591152441', time=2024-09-12T20:01:45.496168+0000, chain.objs.size()=2 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~zd4tBHktSz2ZdVJrPaHWrsTFqduMXTh.1 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~zd4tBHktSz2ZdVJrPaHWrsTFqduMXTh.2 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.9012855137992455488', time=2024-09-12T20:01:47.719133+0000, chain.objs.size()=2 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.525__shadow_.91ip9Wi7wFn1SrpF7BTOLwvGURJhDuP_1 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.525__shadow_.91ip9Wi7wFn1SrpF7BTOLwvGURJhDuP_2 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.13543179704407314394', time=2024-09-12T20:01:48.498797+0000, chain.objs.size()=4 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.528__multipart_mymultipart.2~hdo8MDZnAijCR-ppnBwZmnaqn5ZPwUA.1 2024-09-12T18:08:03.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.528__multipart_mymultipart.2~hdo8MDZnAijCR-ppnBwZmnaqn5ZPwUA.2 2024-09-12T18:08:03.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.528__multipart_mymultipart.2~hdo8MDZnAijCR-ppnBwZmnaqn5ZPwUA.3 2024-09-12T18:08:03.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.528__multipart_mymultipart.2~hdo8MDZnAijCR-ppnBwZmnaqn5ZPwUA.4 2024-09-12T18:08:03.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6465857887857944335', time=2024-09-12T20:03:06.151283+0000, chain.objs.size()=6 2024-09-12T18:08:03.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.709+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.615__multipart_multipart_enc.2~EuVudJeLzVTF0pSh-Fg-5LV5D43EHZI.1 2024-09-12T18:08:03.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.712+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.615__multipart_multipart_enc.2~EuVudJeLzVTF0pSh-Fg-5LV5D43EHZI.2 2024-09-12T18:08:03.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.712+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.615__multipart_multipart_enc.2~EuVudJeLzVTF0pSh-Fg-5LV5D43EHZI.3 2024-09-12T18:08:03.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.712+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.615__multipart_multipart_enc.2~EuVudJeLzVTF0pSh-Fg-5LV5D43EHZI.4 2024-09-12T18:08:03.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.713+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.615__multipart_multipart_enc.2~EuVudJeLzVTF0pSh-Fg-5LV5D43EHZI.5 2024-09-12T18:08:03.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.713+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.615__multipart_multipart_enc.2~EuVudJeLzVTF0pSh-Fg-5LV5D43EHZI.6 2024-09-12T18:08:03.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.714+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~QuhIirZgImaxg2qBLKwr6p_O4UMMg7j', time=2024-09-12T20:05:56.904390+0000, chain.objs.size()=1 2024-09-12T18:08:03.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.714+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.743__multipart_mymultipart2.2~QuhIirZgImaxg2qBLKwr6p_O4UMMg7j.1 2024-09-12T18:08:03.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.717+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.719+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:08:03.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.721+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.721+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.721+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:08:03.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.721+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6207673258594912251', time=2024-09-12T20:05:14.535552+0000, chain.objs.size()=1 2024-09-12T18:08:03.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.721+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.644__shadow_.XAXCSSdAG8kfRDpukljMFtJvZ0_sq3m_1 2024-09-12T18:08:03.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.723+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.725+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:08:03.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.726+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:08:03.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.10759128359730884948', time=2024-09-12T19:59:05.847496+0000, chain.objs.size()=3 2024-09-12T18:08:03.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__multipart_foo-STANDARD.2~iXOJswKdmKOz8YHJ2jehkHIlNc-QmMo.1 2024-09-12T18:08:03.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__multipart_foo-STANDARD.2~iXOJswKdmKOz8YHJ2jehkHIlNc-QmMo.2 2024-09-12T18:08:03.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__multipart_foo-STANDARD.2~iXOJswKdmKOz8YHJ2jehkHIlNc-QmMo.3 2024-09-12T18:08:03.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_i5n2tv_HfpWi_7LnVUh9eC1z-VOG577', time=2024-09-12T19:59:06.950045+0000, chain.objs.size()=2 2024-09-12T18:08:03.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__shadow_.pzMDhDP6eKKw9lijD0OgN7iOkZ68qKD_1 2024-09-12T18:08:03.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__shadow_.pzMDhDP6eKKw9lijD0OgN7iOkZ68qKD_2 2024-09-12T18:08:03.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6338401221241549082', time=2024-09-12T20:01:33.641246+0000, chain.objs.size()=6 2024-09-12T18:08:03.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.1 2024-09-12T18:08:03.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.2 2024-09-12T18:08:03.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.3 2024-09-12T18:08:03.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.4 2024-09-12T18:08:03.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.727+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.5 2024-09-12T18:08:03.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.728+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.6 2024-09-12T18:08:03.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.728+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6488297266122750231', time=2024-09-12T20:01:36.659000+0000, chain.objs.size()=1 2024-09-12T18:08:03.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.728+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.519__multipart_mymultipart.2~t2AdM42GNaPOogJcI446wKvaP8up0iW.1 2024-09-12T18:08:03.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.731+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.4772689846192436589', time=2024-09-12T20:01:43.054825+0000, chain.objs.size()=6 2024-09-12T18:08:03.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.731+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~9mEPz6SR2rXtpQmsEd9i_kMJv66ps09.1 2024-09-12T18:08:03.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.731+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~9mEPz6SR2rXtpQmsEd9i_kMJv66ps09.2 2024-09-12T18:08:03.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.732+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.sUExsX00UEhtiCm2mVQ6Y6aB6YMbxg-G.3 2024-09-12T18:08:03.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.732+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~9mEPz6SR2rXtpQmsEd9i_kMJv66ps09.4 2024-09-12T18:08:03.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.732+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~9mEPz6SR2rXtpQmsEd9i_kMJv66ps09.5 2024-09-12T18:08:03.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.733+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~9mEPz6SR2rXtpQmsEd9i_kMJv66ps09.6 2024-09-12T18:08:03.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.733+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.13329318528859206491', time=2024-09-12T20:01:47.356134+0000, chain.objs.size()=3 2024-09-12T18:08:03.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.733+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~5n3HqgRmxVJPdPfPBywo-ZZzaxsMuAp.1 2024-09-12T18:08:03.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.733+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~5n3HqgRmxVJPdPfPBywo-ZZzaxsMuAp.2 2024-09-12T18:08:03.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.733+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~5n3HqgRmxVJPdPfPBywo-ZZzaxsMuAp.3 2024-09-12T18:08:03.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.733+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.4962743928354644755', time=2024-09-12T20:03:04.791796+0000, chain.objs.size()=6 2024-09-12T18:08:03.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.733+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.614__multipart_multipart_enc.2~o1bOC49PqTmV_nZs_DxTnZPXWk96jIh.1 2024-09-12T18:08:03.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.733+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.614__multipart_multipart_enc.2~o1bOC49PqTmV_nZs_DxTnZPXWk96jIh.2 2024-09-12T18:08:03.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.734+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.614__multipart_multipart_enc.2~o1bOC49PqTmV_nZs_DxTnZPXWk96jIh.3 2024-09-12T18:08:03.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.736+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.614__multipart_multipart_enc.2~o1bOC49PqTmV_nZs_DxTnZPXWk96jIh.4 2024-09-12T18:08:03.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.736+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.614__multipart_multipart_enc.2~o1bOC49PqTmV_nZs_DxTnZPXWk96jIh.5 2024-09-12T18:08:03.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.736+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.614__multipart_multipart_enc.2~o1bOC49PqTmV_nZs_DxTnZPXWk96jIh.6 2024-09-12T18:08:03.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.736+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.5655683197450207456', time=2024-09-12T20:05:28.835761+0000, chain.objs.size()=1 2024-09-12T18:08:03.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.736+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.703__multipart_file1.2~kUH8TLPOP9n19IxhVeU34MhQpU9elqG.1 2024-09-12T18:08:03.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.739+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.743+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:08:03.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.744+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.745+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.745+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.745+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.13124002264056624739', time=2024-09-12T20:01:36.144814+0000, chain.objs.size()=1 2024-09-12T18:08:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.745+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.519__multipart_mymultipart.2~DvgNflEGhJnlcCMlt4Uu573BxhUB1W-.1 2024-09-12T18:08:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.745+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.11653544688956457908', time=2024-09-12T20:01:45.242483+0000, chain.objs.size()=1 2024-09-12T18:08:03.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.745+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~1mvbEbX4u8SxyR90vX2SiR8qKIJNXbP.1 2024-09-12T18:08:03.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.746+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.749+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:08:03.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.750+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.750+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.751+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:08:03.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.751+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~PfRrPTUyxuAxgvF4lXfdrnEk7LTUZHA', time=2024-09-12T20:01:50.739068+0000, chain.objs.size()=1 2024-09-12T18:08:03.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.751+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.535__multipart_mymultipart.2~PfRrPTUyxuAxgvF4lXfdrnEk7LTUZHA.1 2024-09-12T18:08:03.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.752+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.754+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:08:03.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.755+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.755+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:08:03.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_4fpszAvV4l_Bawob1KSr8-pB2Umi-0i', time=2024-09-12T19:59:07.086233+0000, chain.objs.size()=2 2024-09-12T18:08:03.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__shadow_.mgl_q5cIr9C1U3rUs9ulDLBtBsVaTTM_0 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__shadow_.mgl_q5cIr9C1U3rUs9ulDLBtBsVaTTM_1 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_cI9yDT5k5JssBsPp1Br7vp0ZsoMitLe', time=2024-09-12T19:59:08.172311+0000, chain.objs.size()=2 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.166__shadow_.hySMQJ1nSvzV3CGuJ2pnhiFyMEmOpMt_0 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.166__shadow_.hySMQJ1nSvzV3CGuJ2pnhiFyMEmOpMt_1 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_2Ei0aCA1oWgl2jwSziT364DGszr5RRY', time=2024-09-12T19:59:08.177124+0000, chain.objs.size()=2 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.166__shadow_.Y-HxeWA0Ra14aX3sjyvOIHOO4qUzvlf_0 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.166__shadow_.Y-HxeWA0Ra14aX3sjyvOIHOO4qUzvlf_1 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.14993910129889985606', time=2024-09-12T20:05:20.731027+0000, chain.objs.size()=6 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.661__multipart_bar.2~IDCMAaDEsKQK6aDhvqCDSTiik604pZF.1 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.661__multipart_bar.2~IDCMAaDEsKQK6aDhvqCDSTiik604pZF.2 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.661__multipart_bar.2~IDCMAaDEsKQK6aDhvqCDSTiik604pZF.3 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.661__multipart_bar.2~IDCMAaDEsKQK6aDhvqCDSTiik604pZF.4 2024-09-12T18:08:03.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.661__multipart_bar.2~IDCMAaDEsKQK6aDhvqCDSTiik604pZF.5 2024-09-12T18:08:03.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.756+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.661__multipart_bar.2~IDCMAaDEsKQK6aDhvqCDSTiik604pZF.6 2024-09-12T18:08:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.762+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.764+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:08:03.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.766+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.766+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.766+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:08:03.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.766+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.1003384670515844215', time=2024-09-12T20:01:45.342163+0000, chain.objs.size()=2 2024-09-12T18:08:03.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.766+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~zdV2fl88F0aLAtMTCgGz7kfQs36G0Nh.1 2024-09-12T18:08:03.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.766+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.524__multipart_mymultipart.2~zdV2fl88F0aLAtMTCgGz7kfQs36G0Nh.2 2024-09-12T18:08:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.768+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.770+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:08:03.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.771+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T18:08:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_9lAz7DqLxGESa9PCP4wFj_p22O-I8r4', time=2024-09-12T19:59:04.723206+0000, chain.objs.size()=1 2024-09-12T18:08:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.161__shadow_.vhc7cgEBG1SUPYjbA6vAlFpSpXbFGzw_0 2024-09-12T18:08:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_UjpOIwdGBN5xmJWFizi_CCpoAW_hFNd', time=2024-09-12T19:59:05.930797+0000, chain.objs.size()=2 2024-09-12T18:08:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__shadow_.PYTH6PKDMghbp80C8TyJcfG7yf-9lFk_0 2024-09-12T18:08:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__shadow_.PYTH6PKDMghbp80C8TyJcfG7yf-9lFk_1 2024-09-12T18:08:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.14761864337119852389', time=2024-09-12T20:01:37.701781+0000, chain.objs.size()=6 2024-09-12T18:08:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.520__multipart_mymultipart.2~d4BI5OSv0iHMq_M5m46FVQfSv7tbRQ8.1 2024-09-12T18:08:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.520__multipart_mymultipart.2~d4BI5OSv0iHMq_M5m46FVQfSv7tbRQ8.2 2024-09-12T18:08:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.520__multipart_mymultipart.2~d4BI5OSv0iHMq_M5m46FVQfSv7tbRQ8.3 2024-09-12T18:08:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.520__multipart_mymultipart.2~d4BI5OSv0iHMq_M5m46FVQfSv7tbRQ8.4 2024-09-12T18:08:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.772+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.520__multipart_mymultipart.2~d4BI5OSv0iHMq_M5m46FVQfSv7tbRQ8.5 2024-09-12T18:08:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.773+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.520__multipart_mymultipart.2~d4BI5OSv0iHMq_M5m46FVQfSv7tbRQ8.6 2024-09-12T18:08:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.773+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.13026293933367261960', time=2024-09-12T20:01:41.352303+0000, chain.objs.size()=6 2024-09-12T18:08:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.773+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.8G3bSjjltfZ-YMulIoPOCvVx9ylYgNyA.1 2024-09-12T18:08:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.773+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~69rW6kIHmXGkRJb01lo-Cth8XlhEynD.2 2024-09-12T18:08:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.773+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~69rW6kIHmXGkRJb01lo-Cth8XlhEynD.3 2024-09-12T18:08:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.775+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~69rW6kIHmXGkRJb01lo-Cth8XlhEynD.4 2024-09-12T18:08:03.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~69rW6kIHmXGkRJb01lo-Cth8XlhEynD.5 2024-09-12T18:08:03.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~69rW6kIHmXGkRJb01lo-Cth8XlhEynD.6 2024-09-12T18:08:03.779 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~bcuQJAGMiyU4yKlXZxr4l91pdXYaVId', time=2024-09-12T20:01:44.551788+0000, chain.objs.size()=1 2024-09-12T18:08:03.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~bcuQJAGMiyU4yKlXZxr4l91pdXYaVId.1 2024-09-12T18:08:03.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~bcuQJAGMiyU4yKlXZxr4l91pdXYaVId', time=2024-09-12T20:01:44.553138+0000, chain.objs.size()=1 2024-09-12T18:08:03.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~bcuQJAGMiyU4yKlXZxr4l91pdXYaVId.2 2024-09-12T18:08:03.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~bcuQJAGMiyU4yKlXZxr4l91pdXYaVId', time=2024-09-12T20:01:44.554334+0000, chain.objs.size()=1 2024-09-12T18:08:03.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~bcuQJAGMiyU4yKlXZxr4l91pdXYaVId.3 2024-09-12T18:08:03.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~bcuQJAGMiyU4yKlXZxr4l91pdXYaVId', time=2024-09-12T20:01:44.555474+0000, chain.objs.size()=1 2024-09-12T18:08:03.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~bcuQJAGMiyU4yKlXZxr4l91pdXYaVId.4 2024-09-12T18:08:03.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~bcuQJAGMiyU4yKlXZxr4l91pdXYaVId', time=2024-09-12T20:01:44.556562+0000, chain.objs.size()=1 2024-09-12T18:08:03.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~bcuQJAGMiyU4yKlXZxr4l91pdXYaVId.5 2024-09-12T18:08:03.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~bcuQJAGMiyU4yKlXZxr4l91pdXYaVId', time=2024-09-12T20:01:44.557616+0000, chain.objs.size()=1 2024-09-12T18:08:03.780 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~bcuQJAGMiyU4yKlXZxr4l91pdXYaVId.6 2024-09-12T18:08:03.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.18037231706110997661', time=2024-09-12T20:02:55.282732+0000, chain.objs.size()=4 2024-09-12T18:08:03.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.579__multipart_testobj.2~oA7MNTF6oZNsmPMkKlnA5hBwEQgDo3F.1 2024-09-12T18:08:03.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.777+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.579__multipart_testobj.2~oA7MNTF6oZNsmPMkKlnA5hBwEQgDo3F.2 2024-09-12T18:08:03.781 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.779+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.579__multipart_testobj.2~oA7MNTF6oZNsmPMkKlnA5hBwEQgDo3F.3 2024-09-12T18:08:03.783 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.782+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.579__multipart_testobj.2~oA7MNTF6oZNsmPMkKlnA5hBwEQgDo3F.4 2024-09-12T18:08:03.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.784+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.786+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:08:03.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:08:03.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.11985527462616206316', time=2024-09-12T19:59:03.544690+0000, chain.objs.size()=2 2024-09-12T18:08:03.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.159__shadow_.wX76WnxCy9ioNN9Hef_qkv3DW0FjImj_0 2024-09-12T18:08:03.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.159__shadow_.wX76WnxCy9ioNN9Hef_qkv3DW0FjImj_1 2024-09-12T18:08:03.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_tcPYdm9w6xuv3PY3nrTWVSM3js7QoZT', time=2024-09-12T19:59:05.282468+0000, chain.objs.size()=1 2024-09-12T18:08:03.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.161__shadow_.KjXWTpCh_5up-cMtbjp5rG--z6lj4vS_1 2024-09-12T18:08:03.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_L12Xnpnz-Mya-8rP_MPJdoMfzUWAxz2', time=2024-09-12T19:59:05.419450+0000, chain.objs.size()=1 2024-09-12T18:08:03.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.161__shadow_.GZGJ_bxVWrvHiAmEgSolBCO0FW_whfX_0 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.4363534388873918238', time=2024-09-12T19:59:06.331681+0000, chain.objs.size()=3 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__multipart_foo-LUKEWARM.2~zSkx-U1F3w0RV60QgxKjk7NZfmLtEr9.1 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__multipart_foo-LUKEWARM.2~zSkx-U1F3w0RV60QgxKjk7NZfmLtEr9.2 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__multipart_foo-LUKEWARM.2~zSkx-U1F3w0RV60QgxKjk7NZfmLtEr9.3 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.18154380325454844773', time=2024-09-12T20:01:34.713715+0000, chain.objs.size()=1 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.514__multipart_mymultipart.2~mmp67L-0vr5UHD-PNG6ydoyExLKjrqt.1 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~zk-q7amh_HCg7-zKA9AC5bb7j75UmXQ', time=2024-09-12T20:01:43.047845+0000, chain.objs.size()=1 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.788+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~zk-q7amh_HCg7-zKA9AC5bb7j75UmXQ.2 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.789+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~zk-q7amh_HCg7-zKA9AC5bb7j75UmXQ', time=2024-09-12T20:01:43.049203+0000, chain.objs.size()=1 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.789+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~zk-q7amh_HCg7-zKA9AC5bb7j75UmXQ.3 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.789+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.530354453644499063', time=2024-09-12T20:05:20.929968+0000, chain.objs.size()=6 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.789+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.663__multipart_foo.2~jt1U7UWOjkzFoP2kZUPfJ60UtLXf5Oc.1 2024-09-12T18:08:03.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.789+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.663__multipart_foo.2~jt1U7UWOjkzFoP2kZUPfJ60UtLXf5Oc.2 2024-09-12T18:08:03.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.792+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.663__multipart_foo.2~jt1U7UWOjkzFoP2kZUPfJ60UtLXf5Oc.3 2024-09-12T18:08:03.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.792+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.663__multipart_foo.2~jt1U7UWOjkzFoP2kZUPfJ60UtLXf5Oc.4 2024-09-12T18:08:03.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.792+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.663__multipart_foo.2~jt1U7UWOjkzFoP2kZUPfJ60UtLXf5Oc.5 2024-09-12T18:08:03.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.792+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.663__multipart_foo.2~jt1U7UWOjkzFoP2kZUPfJ60UtLXf5Oc.6 2024-09-12T18:08:03.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.795+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.797+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:08:03.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.798+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.799+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.799+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.799+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~ogQpdwYh_1eT82tTq9L1wXen8wZ80yY', time=2024-09-12T20:01:49.869415+0000, chain.objs.size()=1 2024-09-12T18:08:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.799+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.532__multipart_mymultipart.2~ogQpdwYh_1eT82tTq9L1wXen8wZ80yY.1 2024-09-12T18:08:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.799+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.7019179899651181903', time=2024-09-12T20:02:21.451356+0000, chain.objs.size()=1 2024-09-12T18:08:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.799+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.559__shadow_.y3dK12Uf5gCVgl4s2kdeQSCkkSVa87d_1 2024-09-12T18:08:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.800+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.803+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:08:03.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.804+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.804+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.805+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:08:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.805+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.8547472765092339385', time=2024-09-12T20:01:47.042604+0000, chain.objs.size()=2 2024-09-12T18:08:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.805+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~G511kD3lc8AQeDyqSwAouxEKu2DBVez.1 2024-09-12T18:08:03.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.805+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~G511kD3lc8AQeDyqSwAouxEKu2DBVez.2 2024-09-12T18:08:03.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.805+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.15354358097218495887', time=2024-09-12T20:02:06.571335+0000, chain.objs.size()=1 2024-09-12T18:08:03.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.805+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.537__multipart_mymultipart.2~thX9NsCxDD89oSvuzXndC08sMTuZh8b.1 2024-09-12T18:08:03.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.805+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.8612266521694089325', time=2024-09-12T20:05:30.968492+0000, chain.objs.size()=1 2024-09-12T18:08:03.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.805+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.712__multipart_file1.2~S2b4-CS5b4chDRRQCtY6qU3gkCCQnq8.1 2024-09-12T18:08:03.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.808+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.810+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:08:03.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.812+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.812+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:08:03.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~aFOAhSunxcotRpQ0Jg0vvN1MfuEIOU4', time=2024-09-12T19:59:22.767431+0000, chain.objs.size()=1 2024-09-12T18:08:03.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.202__multipart_mymultipart.2~aFOAhSunxcotRpQ0Jg0vvN1MfuEIOU4.1 2024-09-12T18:08:03.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.14852456517032676642', time=2024-09-12T20:01:33.833322+0000, chain.objs.size()=6 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.1 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.2 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.3 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.4 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.5 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.6 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~9mEPz6SR2rXtpQmsEd9i_kMJv66ps09', time=2024-09-12T20:01:42.101759+0000, chain.objs.size()=1 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~9mEPz6SR2rXtpQmsEd9i_kMJv66ps09.3 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.5437759047682308654', time=2024-09-12T20:01:44.563094+0000, chain.objs.size()=6 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~zk-q7amh_HCg7-zKA9AC5bb7j75UmXQ.1 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.SFxqdHkuttWy8o04mt5G0uLEc4ragLou.2 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.JQFp_suLkpG9-B4vnQ5gX3QgkUihQg6f.3 2024-09-12T18:08:03.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.813+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~zk-q7amh_HCg7-zKA9AC5bb7j75UmXQ.4 2024-09-12T18:08:03.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.815+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~zk-q7amh_HCg7-zKA9AC5bb7j75UmXQ.5 2024-09-12T18:08:03.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.816+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~zk-q7amh_HCg7-zKA9AC5bb7j75UmXQ.6 2024-09-12T18:08:03.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.818+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.821+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:08:03.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.822+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.822+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.823+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:08:03.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.823+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.15464906255807119240', time=2024-09-12T20:01:35.923762+0000, chain.objs.size()=1 2024-09-12T18:08:03.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.823+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.519__multipart_mymultipart.2~mo_4MHBS-MD65OijZM55sJrBdwUB0uh.1 2024-09-12T18:08:03.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.824+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.826+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:08:03.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.827+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.827+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.828+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:03.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.828+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.15595599126148870404', time=2024-09-12T20:01:28.068256+0000, chain.objs.size()=2 2024-09-12T18:08:03.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.828+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.487__shadow_.EWh5JQAJEwl3TRiYYVXOBq92kWg5y8Y_1 2024-09-12T18:08:03.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.828+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.487__shadow_.EWh5JQAJEwl3TRiYYVXOBq92kWg5y8Y_2 2024-09-12T18:08:03.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.828+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.8736956580656720242', time=2024-09-12T20:01:33.639966+0000, chain.objs.size()=6 2024-09-12T18:08:03.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.828+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.1 2024-09-12T18:08:03.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.828+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.2 2024-09-12T18:08:03.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.828+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.3 2024-09-12T18:08:03.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.828+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.4 2024-09-12T18:08:03.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.828+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.5 2024-09-12T18:08:03.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.828+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.6 2024-09-12T18:08:03.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.831+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.833+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:08:03.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.834+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:08:03.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_aTfy-t01SVNX0db-63pKUUemOGcgmNA', time=2024-09-12T19:59:05.408682+0000, chain.objs.size()=2 2024-09-12T18:08:03.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.161__shadow_.2ca2ZOBB-xOxGiqQeGooTJ2ak2BUAkR_0 2024-09-12T18:08:03.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.161__shadow_.2ca2ZOBB-xOxGiqQeGooTJ2ak2BUAkR_1 2024-09-12T18:08:03.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.18422740307937417322', time=2024-09-12T19:59:06.846201+0000, chain.objs.size()=3 2024-09-12T18:08:03.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__multipart_foo-FROZEN.2~CIWzNsL-ZMx9yGLdDl6ne-tHFtLKRkn.1 2024-09-12T18:08:03.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__multipart_foo-FROZEN.2~CIWzNsL-ZMx9yGLdDl6ne-tHFtLKRkn.2 2024-09-12T18:08:03.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__multipart_foo-FROZEN.2~CIWzNsL-ZMx9yGLdDl6ne-tHFtLKRkn.3 2024-09-12T18:08:03.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.7272812981161328352', time=2024-09-12T20:01:46.706889+0000, chain.objs.size()=2 2024-09-12T18:08:03.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~j3r1S-Mzj9ijOZNK3wO0f1b1GCSIMbd.1 2024-09-12T18:08:03.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~j3r1S-Mzj9ijOZNK3wO0f1b1GCSIMbd.2 2024-09-12T18:08:03.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.10358618073511558766', time=2024-09-12T20:05:56.857167+0000, chain.objs.size()=1 2024-09-12T18:08:03.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.743__multipart_mymultipart3.2~E-kJssH7kGx_QwduRb-4BobG7rN7w-V.1 2024-09-12T18:08:03.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~HXUrjB596w5HAio51369WdS7mOXUt4F', time=2024-09-12T20:05:56.899010+0000, chain.objs.size()=1 2024-09-12T18:08:03.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.835+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.743__multipart_mymultipart.2~HXUrjB596w5HAio51369WdS7mOXUt4F.1 2024-09-12T18:08:03.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.839+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.842+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:08:03.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.843+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:08:03.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6922332319355955543', time=2024-09-12T20:01:33.833859+0000, chain.objs.size()=6 2024-09-12T18:08:03.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.1 2024-09-12T18:08:03.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.2 2024-09-12T18:08:03.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.3 2024-09-12T18:08:03.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.4 2024-09-12T18:08:03.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.5 2024-09-12T18:08:03.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.508__multipart_srcmultipart.2~ULQGVyKiOVxI4WrhE04FcJBBZffIsQS.6 2024-09-12T18:08:03.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~NuFZysdW91M18A5ALcwofu0PMeBmWra', time=2024-09-12T20:01:49.882209+0000, chain.objs.size()=1 2024-09-12T18:08:03.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.532__multipart_mymultipart2.2~NuFZysdW91M18A5ALcwofu0PMeBmWra.1 2024-09-12T18:08:03.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~tY5hEjR9qLyo7AMAsDKS1myK7SDY4bd', time=2024-09-12T20:01:51.131309+0000, chain.objs.size()=1 2024-09-12T18:08:03.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.844+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.536__multipart_mymultipart.2~tY5hEjR9qLyo7AMAsDKS1myK7SDY4bd.3 2024-09-12T18:08:03.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.848+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.851+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:08:03.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.852+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.852+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:08:03.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.17523439830383782187', time=2024-09-12T20:01:46.497149+0000, chain.objs.size()=1 2024-09-12T18:08:03.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.526__multipart_mymultipart.2~HmnYm7oLO4jSobiuIJ0_XviY560V5PM.1 2024-09-12T18:08:03.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~1S67DwbVYWToFY-aaIbLQymNY23LHO9', time=2024-09-12T20:01:48.089296+0000, chain.objs.size()=10 2024-09-12T18:08:03.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.527__multipart_mymultipart.2~1S67DwbVYWToFY-aaIbLQymNY23LHO9.1 2024-09-12T18:08:03.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.527__multipart_mymultipart.2~1S67DwbVYWToFY-aaIbLQymNY23LHO9.2 2024-09-12T18:08:03.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.527__multipart_mymultipart.2~1S67DwbVYWToFY-aaIbLQymNY23LHO9.3 2024-09-12T18:08:03.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.527__multipart_mymultipart.2~1S67DwbVYWToFY-aaIbLQymNY23LHO9.4 2024-09-12T18:08:03.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.527__multipart_mymultipart.2~1S67DwbVYWToFY-aaIbLQymNY23LHO9.5 2024-09-12T18:08:03.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.527__multipart_mymultipart.2~1S67DwbVYWToFY-aaIbLQymNY23LHO9.6 2024-09-12T18:08:03.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.527__multipart_mymultipart.2~1S67DwbVYWToFY-aaIbLQymNY23LHO9.7 2024-09-12T18:08:03.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.527__multipart_mymultipart.2~1S67DwbVYWToFY-aaIbLQymNY23LHO9.8 2024-09-12T18:08:03.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.527__multipart_mymultipart.2~1S67DwbVYWToFY-aaIbLQymNY23LHO9.9 2024-09-12T18:08:03.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.527__multipart_mymultipart.2~1S67DwbVYWToFY-aaIbLQymNY23LHO9.10 2024-09-12T18:08:03.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6859404416375395036', time=2024-09-12T20:02:04.800192+0000, chain.objs.size()=4 2024-09-12T18:08:03.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.853+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.536__multipart_mymultipart.2~tY5hEjR9qLyo7AMAsDKS1myK7SDY4bd.1 2024-09-12T18:08:03.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.536__multipart_mymultipart.2~tY5hEjR9qLyo7AMAsDKS1myK7SDY4bd.2 2024-09-12T18:08:03.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.536__multipart_mymultipart.9k3J_kQEXHo9gLv2Rw83CuG0tc6umMED.3 2024-09-12T18:08:03.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.536__multipart_mymultipart.2~tY5hEjR9qLyo7AMAsDKS1myK7SDY4bd.4 2024-09-12T18:08:03.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.10785842099275105957', time=2024-09-12T20:02:22.422560+0000, chain.objs.size()=1 2024-09-12T18:08:03.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.562__multipart_mymultipart.2~_ZZaZiiU0dSSDrlC10YgBTrw3mLJrjy.1 2024-09-12T18:08:03.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.15872798630669115268', time=2024-09-12T20:02:26.854067+0000, chain.objs.size()=1 2024-09-12T18:08:03.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.564__shadow_.x56PZ9zpDKm3UkDhnYIia-aQWGKwQ_b_1 2024-09-12T18:08:03.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.5668361548347888795', time=2024-09-12T20:05:15.119539+0000, chain.objs.size()=1 2024-09-12T18:08:03.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.646__shadow_.kzOz7SCNYf4t858n1h76wh9aw-DBaWW_1 2024-09-12T18:08:03.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.13810522246272697832', time=2024-09-12T20:05:20.826875+0000, chain.objs.size()=6 2024-09-12T18:08:03.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.662__multipart_baz.2~gglu6RKEtOeiTICd6NC7PkglosqocAQ.1 2024-09-12T18:08:03.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.662__multipart_baz.2~gglu6RKEtOeiTICd6NC7PkglosqocAQ.2 2024-09-12T18:08:03.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.662__multipart_baz.2~gglu6RKEtOeiTICd6NC7PkglosqocAQ.3 2024-09-12T18:08:03.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.662__multipart_baz.2~gglu6RKEtOeiTICd6NC7PkglosqocAQ.4 2024-09-12T18:08:03.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.856+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.662__multipart_baz.2~gglu6RKEtOeiTICd6NC7PkglosqocAQ.5 2024-09-12T18:08:03.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.860+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.662__multipart_baz.2~gglu6RKEtOeiTICd6NC7PkglosqocAQ.6 2024-09-12T18:08:03.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.864+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.866+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:08:03.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.867+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:08:03.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.8182192195889123482', time=2024-09-12T19:59:04.533953+0000, chain.objs.size()=3 2024-09-12T18:08:03.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.160__multipart_mymultipart-LUKEWARM.2~nrwHTrlTffW4yRIjXF085vbYmeBZDTw.1 2024-09-12T18:08:03.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.160__multipart_mymultipart-LUKEWARM.2~nrwHTrlTffW4yRIjXF085vbYmeBZDTw.2 2024-09-12T18:08:03.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:35ed0db6-4f54-4e96-b306-71079c84e007.4596.160__multipart_mymultipart-LUKEWARM.2~nrwHTrlTffW4yRIjXF085vbYmeBZDTw.3 2024-09-12T18:08:03.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_TdAs71SbCYNYt3sYjjy-qyu8H6LB_Mm', time=2024-09-12T19:59:04.995002+0000, chain.objs.size()=1 2024-09-12T18:08:03.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.161__shadow_.FP5mAL_S-CFqPYL7HR8aSXEZKPtQB3y_1 2024-09-12T18:08:03.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.7651605326860581235', time=2024-09-12T20:01:35.381668+0000, chain.objs.size()=1 2024-09-12T18:08:03.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.517__multipart_mymultipartcopy.2~gr2dGf-WMIG6LlBfq1HoSyzUAQDnCnJ.1 2024-09-12T18:08:03.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6727166026465043443', time=2024-09-12T20:01:36.559155+0000, chain.objs.size()=1 2024-09-12T18:08:03.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.518__shadow_.u2eten3gif7g85EUvsIqKQB2RXkkXSS_1 2024-09-12T18:08:03.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~zej-Q2sr9goNDiXe4XStrMeAiBp7Ybc', time=2024-09-12T20:05:10.420722+0000, chain.objs.size()=6 2024-09-12T18:08:03.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.625__multipart_multipart_enc.2~zej-Q2sr9goNDiXe4XStrMeAiBp7Ybc.1 2024-09-12T18:08:03.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.625__multipart_multipart_enc.2~zej-Q2sr9goNDiXe4XStrMeAiBp7Ybc.2 2024-09-12T18:08:03.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.625__multipart_multipart_enc.2~zej-Q2sr9goNDiXe4XStrMeAiBp7Ybc.3 2024-09-12T18:08:03.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.625__multipart_multipart_enc.2~zej-Q2sr9goNDiXe4XStrMeAiBp7Ybc.4 2024-09-12T18:08:03.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.625__multipart_multipart_enc.2~zej-Q2sr9goNDiXe4XStrMeAiBp7Ybc.5 2024-09-12T18:08:03.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.868+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.625__multipart_multipart_enc.2~zej-Q2sr9goNDiXe4XStrMeAiBp7Ybc.6 2024-09-12T18:08:03.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.874+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.877+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:08:03.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.878+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.878+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.878+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:08:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.878+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='_qhp4aFlgP873OCjQ6RpG4SdfocjXsv4', time=2024-09-12T19:59:07.096615+0000, chain.objs.size()=2 2024-09-12T18:08:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.878+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__shadow_.d9KZAxycpp1bnVXAWK1PAt5vp1yvNn-_0 2024-09-12T18:08:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.878+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:35ed0db6-4f54-4e96-b306-71079c84e007.4596.162__shadow_.d9KZAxycpp1bnVXAWK1PAt5vp1yvNn-_1 2024-09-12T18:08:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.878+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.9697666077070434015', time=2024-09-12T20:01:28.068419+0000, chain.objs.size()=2 2024-09-12T18:08:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.878+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.487__shadow_.EWh5JQAJEwl3TRiYYVXOBq92kWg5y8Y_1 2024-09-12T18:08:03.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.878+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.487__shadow_.EWh5JQAJEwl3TRiYYVXOBq92kWg5y8Y_2 2024-09-12T18:08:03.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.881+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.883+0000 7fc3bf9af800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:08:03.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.885+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:08:03.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.885+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:08:03.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.886+0000 7fc3bf9af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:08:03.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.886+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~kk31Kqw6WLDSe5IsbZQT-bHrCZiNS6X', time=2024-09-12T19:59:23.054609+0000, chain.objs.size()=1 2024-09-12T18:08:03.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.886+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.203__multipart_mymultipart.2~kk31Kqw6WLDSe5IsbZQT-bHrCZiNS6X.1 2024-09-12T18:08:03.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.886+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='2~69rW6kIHmXGkRJb01lo-Cth8XlhEynD', time=2024-09-12T20:01:40.266275+0000, chain.objs.size()=1 2024-09-12T18:08:03.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.886+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.523__multipart_mymultipart.2~69rW6kIHmXGkRJb01lo-Cth8XlhEynD.1 2024-09-12T18:08:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.886+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.5267269476338305412', time=2024-09-12T20:02:55.383228+0000, chain.objs.size()=4 2024-09-12T18:08:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.886+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.579__multipart_testobj.2~4ZLTk5UYstXBFIy9-uRAO0HzOs__k11.1 2024-09-12T18:08:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.886+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.579__multipart_testobj.2~4ZLTk5UYstXBFIy9-uRAO0HzOs__k11.2 2024-09-12T18:08:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.886+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.579__multipart_testobj.2~4ZLTk5UYstXBFIy9-uRAO0HzOs__k11.3 2024-09-12T18:08:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.886+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.579__multipart_testobj.2~4ZLTk5UYstXBFIy9-uRAO0HzOs__k11.4 2024-09-12T18:08:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.886+0000 7fc3bf9af800 20 garbage collection: RGWGC::process iterating over entry tag='35ed0db6-4f54-4e96-b306-71079c84e007.4596.6562395897372868933', time=2024-09-12T20:05:16.044239+0000, chain.objs.size()=1 2024-09-12T18:08:03.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.886+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:35ed0db6-4f54-4e96-b306-71079c84e007.4596.649__shadow_.QRo--zHX3HMt8ZgN-8xH3g63gULqMef_1 2024-09-12T18:08:03.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.889+0000 7fc3bf9af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:08:03.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.892+0000 7fc273fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:08:03.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.894+0000 7fc3bf9af800 20 remove_watcher() i=0 2024-09-12T18:08:03.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.894+0000 7fc3bf9af800 2 removed watcher, disabling cache 2024-09-12T18:08:03.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.895+0000 7fc3bf9af800 20 remove_watcher() i=1 2024-09-12T18:08:03.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.896+0000 7fc3bf9af800 20 remove_watcher() i=2 2024-09-12T18:08:03.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.897+0000 7fc3bf9af800 20 remove_watcher() i=3 2024-09-12T18:08:03.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.898+0000 7fc3bf9af800 20 remove_watcher() i=4 2024-09-12T18:08:03.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.899+0000 7fc3bf9af800 20 remove_watcher() i=5 2024-09-12T18:08:03.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.900+0000 7fc3bf9af800 20 remove_watcher() i=6 2024-09-12T18:08:03.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-09-12T18:08:03.901+0000 7fc3bf9af800 20 remove_watcher() i=7 2024-09-12T18:08:03.913 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T18:08:03.924 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T18:08:04.000 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:08:04.001 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:08:04.327 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:08:04.342 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-09-12T18:08:04.344 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":1411,"stamp":"2024-09-12T18:08:03.281802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":794521547,"num_objects":843,"num_object_clones":0,"num_object_copies":2160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":843,"num_whiteouts":0,"num_read":167731,"num_read_kb":2951399,"num_write":124121,"num_write_kb":2564852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14449,"ondisk_log_size":14449,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2540440,"kb_used_data":1283288,"kb_used_omap":12,"kb_used_meta":1257011,"kb_avail":752434280,"statfs":{"total":773094113280,"available":770492702720,"internally_reserved":0,"allocated":1314086912,"data_stored":1298157592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1287179826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005475"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.634310+0000","last_change":"2024-09-12T17:57:00.464809+0000","last_active":"2024-09-12T18:04:29.634310+0000","last_peered":"2024-09-12T18:04:29.634310+0000","last_clean":"2024-09-12T18:04:29.634310+0000","last_became_active":"2024-09-12T17:57:00.464331+0000","last_became_peered":"2024-09-12T17:57:00.464331+0000","last_unstale":"2024-09-12T18:04:29.634310+0000","last_undegraded":"2024-09-12T18:04:29.634310+0000","last_fullsized":"2024-09-12T18:04:29.634310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:20.663580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.631990+0000","last_change":"2024-09-12T17:46:45.211816+0000","last_active":"2024-09-12T18:04:14.631990+0000","last_peered":"2024-09-12T18:04:14.631990+0000","last_clean":"2024-09-12T18:04:14.631990+0000","last_became_active":"2024-09-12T17:46:45.211533+0000","last_became_peered":"2024-09-12T17:46:45.211533+0000","last_unstale":"2024-09-12T18:04:14.631990+0000","last_undegraded":"2024-09-12T18:04:14.631990+0000","last_fullsized":"2024-09-12T18:04:14.631990+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:29.748663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519223+0000","last_change":"2024-09-12T17:46:42.179842+0000","last_active":"2024-09-12T18:04:14.519223+0000","last_peered":"2024-09-12T18:04:14.519223+0000","last_clean":"2024-09-12T18:04:14.519223+0000","last_became_active":"2024-09-12T17:46:42.179372+0000","last_became_peered":"2024-09-12T17:46:42.179372+0000","last_unstale":"2024-09-12T18:04:14.519223+0000","last_undegraded":"2024-09-12T18:04:14.519223+0000","last_fullsized":"2024-09-12T18:04:14.519223+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:29.561145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6875819,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6715,"num_write":3,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'32","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.172145+0000","last_change":"2024-09-12T17:45:03.890371+0000","last_active":"2024-09-12T18:05:55.172145+0000","last_peered":"2024-09-12T18:05:55.172145+0000","last_clean":"2024-09-12T18:05:55.172145+0000","last_became_active":"2024-09-12T17:45:03.890104+0000","last_became_peered":"2024-09-12T17:45:03.890104+0000","last_unstale":"2024-09-12T18:05:55.172145+0000","last_undegraded":"2024-09-12T18:05:55.172145+0000","last_fullsized":"2024-09-12T18:05:55.172145+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:20.406460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":111,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.637454+0000","last_change":"2024-09-12T17:57:00.466568+0000","last_active":"2024-09-12T18:04:29.637454+0000","last_peered":"2024-09-12T18:04:29.637454+0000","last_clean":"2024-09-12T18:04:29.637454+0000","last_became_active":"2024-09-12T17:57:00.466304+0000","last_became_peered":"2024-09-12T17:57:00.466304+0000","last_unstale":"2024-09-12T18:04:29.637454+0000","last_undegraded":"2024-09-12T18:04:29.637454+0000","last_fullsized":"2024-09-12T18:04:29.637454+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:52.603747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508649+0000","last_change":"2024-09-12T17:46:45.202607+0000","last_active":"2024-09-12T18:04:14.508649+0000","last_peered":"2024-09-12T18:04:14.508649+0000","last_clean":"2024-09-12T18:04:14.508649+0000","last_became_active":"2024-09-12T17:46:45.202290+0000","last_became_peered":"2024-09-12T17:46:45.202290+0000","last_unstale":"2024-09-12T18:04:14.508649+0000","last_undegraded":"2024-09-12T18:04:14.508649+0000","last_fullsized":"2024-09-12T18:04:14.508649+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:30.467678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.636351+0000","last_change":"2024-09-12T17:46:42.177978+0000","last_active":"2024-09-12T18:04:14.636351+0000","last_peered":"2024-09-12T18:04:14.636351+0000","last_clean":"2024-09-12T18:04:14.636351+0000","last_became_active":"2024-09-12T17:46:42.177112+0000","last_became_peered":"2024-09-12T17:46:42.177112+0000","last_unstale":"2024-09-12T18:04:14.636351+0000","last_undegraded":"2024-09-12T18:04:14.636351+0000","last_fullsized":"2024-09-12T18:04:14.636351+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:37.077362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11070123,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":10811,"num_write":15,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'16","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.642269+0000","last_change":"2024-09-12T17:45:03.893271+0000","last_active":"2024-09-12T18:05:04.642269+0000","last_peered":"2024-09-12T18:05:04.642269+0000","last_clean":"2024-09-12T18:05:04.642269+0000","last_became_active":"2024-09-12T17:45:03.893002+0000","last_became_peered":"2024-09-12T17:45:03.893002+0000","last_unstale":"2024-09-12T18:05:04.642269+0000","last_undegraded":"2024-09-12T18:05:04.642269+0000","last_fullsized":"2024-09-12T18:05:04.642269+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:22.163418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508520+0000","last_change":"2024-09-12T17:57:00.457762+0000","last_active":"2024-09-12T18:04:14.508520+0000","last_peered":"2024-09-12T18:04:14.508520+0000","last_clean":"2024-09-12T18:04:14.508520+0000","last_became_active":"2024-09-12T17:57:00.456939+0000","last_became_peered":"2024-09-12T17:57:00.456939+0000","last_unstale":"2024-09-12T18:04:14.508520+0000","last_undegraded":"2024-09-12T18:04:14.508520+0000","last_fullsized":"2024-09-12T18:04:14.508520+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:16.042163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648157+0000","last_change":"2024-09-12T17:46:45.537660+0000","last_active":"2024-09-12T18:05:29.648157+0000","last_peered":"2024-09-12T18:05:29.648157+0000","last_clean":"2024-09-12T18:05:29.648157+0000","last_became_active":"2024-09-12T17:46:45.536920+0000","last_became_peered":"2024-09-12T17:46:45.536920+0000","last_unstale":"2024-09-12T18:05:29.648157+0000","last_undegraded":"2024-09-12T18:05:29.648157+0000","last_fullsized":"2024-09-12T18:05:29.648157+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.487169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639526+0000","last_change":"2024-09-12T17:46:42.186263+0000","last_active":"2024-09-12T18:04:44.639526+0000","last_peered":"2024-09-12T18:04:44.639526+0000","last_clean":"2024-09-12T18:04:44.639526+0000","last_became_active":"2024-09-12T17:46:42.185870+0000","last_became_peered":"2024-09-12T17:46:42.185870+0000","last_unstale":"2024-09-12T18:04:44.639526+0000","last_undegraded":"2024-09-12T18:04:44.639526+0000","last_fullsized":"2024-09-12T18:04:44.639526+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:49.932340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'49","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644429+0000","last_change":"2024-09-12T17:45:03.895036+0000","last_active":"2024-09-12T18:05:04.644429+0000","last_peered":"2024-09-12T18:05:04.644429+0000","last_clean":"2024-09-12T18:05:04.644429+0000","last_became_active":"2024-09-12T17:45:03.894537+0000","last_became_peered":"2024-09-12T17:45:03.894537+0000","last_unstale":"2024-09-12T18:05:04.644429+0000","last_undegraded":"2024-09-12T18:05:04.644429+0000","last_fullsized":"2024-09-12T18:05:04.644429+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:15.446699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":186,"num_write":90,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:19.519960+0000","last_change":"2024-09-12T17:57:00.465664+0000","last_active":"2024-09-12T18:04:19.519960+0000","last_peered":"2024-09-12T18:04:19.519960+0000","last_clean":"2024-09-12T18:04:19.519960+0000","last_became_active":"2024-09-12T17:57:00.464157+0000","last_became_peered":"2024-09-12T17:57:00.464157+0000","last_unstale":"2024-09-12T18:04:19.519960+0000","last_undegraded":"2024-09-12T18:04:19.519960+0000","last_fullsized":"2024-09-12T18:04:19.519960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:27.777117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.524896+0000","last_change":"2024-09-12T17:46:45.538613+0000","last_active":"2024-09-12T18:04:49.524896+0000","last_peered":"2024-09-12T18:04:49.524896+0000","last_clean":"2024-09-12T18:04:49.524896+0000","last_became_active":"2024-09-12T17:46:45.538295+0000","last_became_peered":"2024-09-12T17:46:45.538295+0000","last_unstale":"2024-09-12T18:04:49.524896+0000","last_undegraded":"2024-09-12T18:04:49.524896+0000","last_fullsized":"2024-09-12T18:04:49.524896+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:12.638632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519162+0000","last_change":"2024-09-12T17:46:42.184099+0000","last_active":"2024-09-12T18:05:29.519162+0000","last_peered":"2024-09-12T18:05:29.519162+0000","last_clean":"2024-09-12T18:05:29.519162+0000","last_became_active":"2024-09-12T17:46:42.183792+0000","last_became_peered":"2024-09-12T17:46:42.183792+0000","last_unstale":"2024-09-12T18:05:29.519162+0000","last_undegraded":"2024-09-12T18:05:29.519162+0000","last_fullsized":"2024-09-12T18:05:29.519162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:38.522171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'18","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527497+0000","last_change":"2024-09-12T17:45:03.893407+0000","last_active":"2024-09-12T18:05:04.527497+0000","last_peered":"2024-09-12T18:05:04.527497+0000","last_clean":"2024-09-12T18:05:04.527497+0000","last_became_active":"2024-09-12T17:45:03.893108+0000","last_became_peered":"2024-09-12T17:45:03.893108+0000","last_unstale":"2024-09-12T18:05:04.527497+0000","last_undegraded":"2024-09-12T18:05:04.527497+0000","last_fullsized":"2024-09-12T18:05:04.527497+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:43.333855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":71,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527532+0000","last_change":"2024-09-12T17:57:00.463065+0000","last_active":"2024-09-12T18:05:04.527532+0000","last_peered":"2024-09-12T18:05:04.527532+0000","last_clean":"2024-09-12T18:05:04.527532+0000","last_became_active":"2024-09-12T17:57:00.462657+0000","last_became_peered":"2024-09-12T17:57:00.462657+0000","last_unstale":"2024-09-12T18:05:04.527532+0000","last_undegraded":"2024-09-12T18:05:04.527532+0000","last_fullsized":"2024-09-12T18:05:04.527532+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:24.423220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.627036+0000","last_change":"2024-09-12T17:46:45.210708+0000","last_active":"2024-09-12T18:03:44.627036+0000","last_peered":"2024-09-12T18:03:44.627036+0000","last_clean":"2024-09-12T18:03:44.627036+0000","last_became_active":"2024-09-12T17:46:45.210259+0000","last_became_peered":"2024-09-12T17:46:45.210259+0000","last_unstale":"2024-09-12T18:03:44.627036+0000","last_undegraded":"2024-09-12T18:03:44.627036+0000","last_fullsized":"2024-09-12T18:03:44.627036+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:01.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6189,"num_write":3,"num_write_kb":3117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.630954+0000","last_change":"2024-09-12T17:46:42.179361+0000","last_active":"2024-09-12T18:03:39.630954+0000","last_peered":"2024-09-12T18:03:39.630954+0000","last_clean":"2024-09-12T18:03:39.630954+0000","last_became_active":"2024-09-12T17:46:42.178782+0000","last_became_peered":"2024-09-12T17:46:42.178782+0000","last_unstale":"2024-09-12T18:03:39.630954+0000","last_undegraded":"2024-09-12T18:03:39.630954+0000","last_fullsized":"2024-09-12T18:03:39.630954+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:21.705278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'101","reported_seq":355,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.903517+0000","last_change":"2024-09-12T17:45:03.899922+0000","last_active":"2024-09-12T18:05:56.903517+0000","last_peered":"2024-09-12T18:05:56.903517+0000","last_clean":"2024-09-12T18:05:56.903517+0000","last_became_active":"2024-09-12T17:45:03.899635+0000","last_became_peered":"2024-09-12T17:45:03.899635+0000","last_unstale":"2024-09-12T18:05:56.903517+0000","last_undegraded":"2024-09-12T18:05:56.903517+0000","last_fullsized":"2024-09-12T18:05:56.903517+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:27.634887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":455,"num_write":132,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646813+0000","last_change":"2024-09-12T17:57:00.462866+0000","last_active":"2024-09-12T18:05:19.646813+0000","last_peered":"2024-09-12T18:05:19.646813+0000","last_clean":"2024-09-12T18:05:19.646813+0000","last_became_active":"2024-09-12T17:57:00.462532+0000","last_became_peered":"2024-09-12T17:57:00.462532+0000","last_unstale":"2024-09-12T18:05:19.646813+0000","last_undegraded":"2024-09-12T18:05:19.646813+0000","last_fullsized":"2024-09-12T18:05:19.646813+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:39.678951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.503221+0000","last_change":"2024-09-12T17:47:29.324227+0000","last_active":"2024-09-12T18:03:39.503221+0000","last_peered":"2024-09-12T18:03:39.503221+0000","last_clean":"2024-09-12T18:03:39.503221+0000","last_became_active":"2024-09-12T17:47:29.305275+0000","last_became_peered":"2024-09-12T17:47:29.305275+0000","last_unstale":"2024-09-12T18:03:39.503221+0000","last_undegraded":"2024-09-12T18:03:39.503221+0000","last_fullsized":"2024-09-12T18:03:39.503221+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:21.892809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.504106+0000","last_change":"2024-09-12T17:46:42.183120+0000","last_active":"2024-09-12T18:03:44.504106+0000","last_peered":"2024-09-12T18:03:44.504106+0000","last_clean":"2024-09-12T18:03:44.504106+0000","last_became_active":"2024-09-12T17:46:42.182797+0000","last_became_peered":"2024-09-12T17:46:42.182797+0000","last_unstale":"2024-09-12T18:03:44.504106+0000","last_undegraded":"2024-09-12T18:03:44.504106+0000","last_fullsized":"2024-09-12T18:03:44.504106+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:02.336324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.192756+0000","last_change":"2024-09-12T17:45:03.900065+0000","last_active":"2024-09-12T18:05:57.192756+0000","last_peered":"2024-09-12T18:05:57.192756+0000","last_clean":"2024-09-12T18:05:57.192756+0000","last_became_active":"2024-09-12T17:45:03.899684+0000","last_became_peered":"2024-09-12T17:45:03.899684+0000","last_unstale":"2024-09-12T18:05:57.192756+0000","last_undegraded":"2024-09-12T18:05:57.192756+0000","last_fullsized":"2024-09-12T18:05:57.192756+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:45.656746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.676639+0000","last_change":"2024-09-12T17:57:00.464844+0000","last_active":"2024-09-12T18:04:29.676639+0000","last_peered":"2024-09-12T18:04:29.676639+0000","last_clean":"2024-09-12T18:04:29.676639+0000","last_became_active":"2024-09-12T17:57:00.464581+0000","last_became_peered":"2024-09-12T17:57:00.464581+0000","last_unstale":"2024-09-12T18:04:29.676639+0000","last_undegraded":"2024-09-12T18:04:29.676639+0000","last_fullsized":"2024-09-12T18:04:29.676639+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:41.808967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508601+0000","last_change":"2024-09-12T17:46:45.208867+0000","last_active":"2024-09-12T18:04:14.508601+0000","last_peered":"2024-09-12T18:04:14.508601+0000","last_clean":"2024-09-12T18:04:14.508601+0000","last_became_active":"2024-09-12T17:46:45.208580+0000","last_became_peered":"2024-09-12T17:46:45.208580+0000","last_unstale":"2024-09-12T18:04:14.508601+0000","last_undegraded":"2024-09-12T18:04:14.508601+0000","last_fullsized":"2024-09-12T18:04:14.508601+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:28.654102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508572+0000","last_change":"2024-09-12T17:46:42.182258+0000","last_active":"2024-09-12T18:04:14.508572+0000","last_peered":"2024-09-12T18:04:14.508572+0000","last_clean":"2024-09-12T18:04:14.508572+0000","last_became_active":"2024-09-12T17:46:42.181972+0000","last_became_peered":"2024-09-12T17:46:42.181972+0000","last_unstale":"2024-09-12T18:04:14.508572+0000","last_undegraded":"2024-09-12T18:04:14.508572+0000","last_fullsized":"2024-09-12T18:04:14.508572+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:16.906107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637435+0000","last_change":"2024-09-12T17:45:03.900188+0000","last_active":"2024-09-12T18:04:24.637435+0000","last_peered":"2024-09-12T18:04:24.637435+0000","last_clean":"2024-09-12T18:04:24.637435+0000","last_became_active":"2024-09-12T17:45:03.899876+0000","last_became_peered":"2024-09-12T17:45:03.899876+0000","last_unstale":"2024-09-12T18:04:24.637435+0000","last_undegraded":"2024-09-12T18:04:24.637435+0000","last_fullsized":"2024-09-12T18:04:24.637435+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:14.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.676688+0000","last_change":"2024-09-12T17:57:00.467655+0000","last_active":"2024-09-12T18:04:29.676688+0000","last_peered":"2024-09-12T18:04:29.676688+0000","last_clean":"2024-09-12T18:04:29.676688+0000","last_became_active":"2024-09-12T17:57:00.467385+0000","last_became_peered":"2024-09-12T17:57:00.467385+0000","last_unstale":"2024-09-12T18:04:29.676688+0000","last_undegraded":"2024-09-12T18:04:29.676688+0000","last_fullsized":"2024-09-12T18:04:29.676688+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:10.181468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519179+0000","last_change":"2024-09-12T17:46:45.206159+0000","last_active":"2024-09-12T18:04:14.519179+0000","last_peered":"2024-09-12T18:04:14.519179+0000","last_clean":"2024-09-12T18:04:14.519179+0000","last_became_active":"2024-09-12T17:46:45.205742+0000","last_became_peered":"2024-09-12T17:46:45.205742+0000","last_unstale":"2024-09-12T18:04:14.519179+0000","last_undegraded":"2024-09-12T18:04:14.519179+0000","last_fullsized":"2024-09-12T18:04:14.519179+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:07.179448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.635933+0000","last_change":"2024-09-12T17:46:42.175938+0000","last_active":"2024-09-12T18:04:14.635933+0000","last_peered":"2024-09-12T18:04:14.635933+0000","last_clean":"2024-09-12T18:04:14.635933+0000","last_became_active":"2024-09-12T17:46:42.175501+0000","last_became_peered":"2024-09-12T17:46:42.175501+0000","last_unstale":"2024-09-12T18:04:14.635933+0000","last_undegraded":"2024-09-12T18:04:14.635933+0000","last_fullsized":"2024-09-12T18:04:14.635933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:32.128694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637725+0000","last_change":"2024-09-12T17:45:03.895224+0000","last_active":"2024-09-12T18:04:24.637725+0000","last_peered":"2024-09-12T18:04:24.637725+0000","last_clean":"2024-09-12T18:04:24.637725+0000","last_became_active":"2024-09-12T17:45:03.894942+0000","last_became_peered":"2024-09-12T17:45:03.894942+0000","last_unstale":"2024-09-12T18:04:24.637725+0000","last_undegraded":"2024-09-12T18:04:24.637725+0000","last_fullsized":"2024-09-12T18:04:24.637725+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:52.737392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.634058+0000","last_change":"2024-09-12T17:57:00.463459+0000","last_active":"2024-09-12T18:03:59.634058+0000","last_peered":"2024-09-12T18:03:59.634058+0000","last_clean":"2024-09-12T18:03:59.634058+0000","last_became_active":"2024-09-12T17:57:00.463134+0000","last_became_peered":"2024-09-12T17:57:00.463134+0000","last_unstale":"2024-09-12T18:03:59.634058+0000","last_undegraded":"2024-09-12T18:03:59.634058+0000","last_fullsized":"2024-09-12T18:03:59.634058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:21.197817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.514362+0000","last_change":"2024-09-12T17:46:45.536892+0000","last_active":"2024-09-12T18:03:39.514362+0000","last_peered":"2024-09-12T18:03:39.514362+0000","last_clean":"2024-09-12T18:03:39.514362+0000","last_became_active":"2024-09-12T17:46:45.536581+0000","last_became_peered":"2024-09-12T17:46:45.536581+0000","last_unstale":"2024-09-12T18:03:39.514362+0000","last_undegraded":"2024-09-12T18:03:39.514362+0000","last_fullsized":"2024-09-12T18:03:39.514362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:18.649337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.643082+0000","last_change":"2024-09-12T17:46:42.180809+0000","last_active":"2024-09-12T18:05:29.643082+0000","last_peered":"2024-09-12T18:05:29.643082+0000","last_clean":"2024-09-12T18:05:29.643082+0000","last_became_active":"2024-09-12T17:46:42.179981+0000","last_became_peered":"2024-09-12T17:46:42.179981+0000","last_unstale":"2024-09-12T18:05:29.643082+0000","last_undegraded":"2024-09-12T18:05:29.643082+0000","last_fullsized":"2024-09-12T18:05:29.643082+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:19.357865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.810540+0000","last_change":"2024-09-12T17:45:03.892892+0000","last_active":"2024-09-12T18:05:30.810540+0000","last_peered":"2024-09-12T18:05:30.810540+0000","last_clean":"2024-09-12T18:05:30.810540+0000","last_became_active":"2024-09-12T17:45:03.892625+0000","last_became_peered":"2024-09-12T17:45:03.892625+0000","last_unstale":"2024-09-12T18:05:30.810540+0000","last_undegraded":"2024-09-12T18:05:30.810540+0000","last_fullsized":"2024-09-12T18:05:30.810540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:58.968922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.633098+0000","last_change":"2024-09-12T17:57:00.461660+0000","last_active":"2024-09-12T18:03:59.633098+0000","last_peered":"2024-09-12T18:03:59.633098+0000","last_clean":"2024-09-12T18:03:59.633098+0000","last_became_active":"2024-09-12T17:57:00.461347+0000","last_became_peered":"2024-09-12T17:57:00.461347+0000","last_unstale":"2024-09-12T18:03:59.633098+0000","last_undegraded":"2024-09-12T18:03:59.633098+0000","last_fullsized":"2024-09-12T18:03:59.633098+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:19.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.534906+0000","last_change":"2024-09-12T17:46:45.537765+0000","last_active":"2024-09-12T18:05:29.534906+0000","last_peered":"2024-09-12T18:05:29.534906+0000","last_clean":"2024-09-12T18:05:29.534906+0000","last_became_active":"2024-09-12T17:46:45.537463+0000","last_became_peered":"2024-09-12T17:46:45.537463+0000","last_unstale":"2024-09-12T18:05:29.534906+0000","last_undegraded":"2024-09-12T18:05:29.534906+0000","last_fullsized":"2024-09-12T18:05:29.534906+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:28.915955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.668771+0000","last_change":"2024-09-12T17:46:42.181302+0000","last_active":"2024-09-12T18:03:39.668771+0000","last_peered":"2024-09-12T18:03:39.668771+0000","last_clean":"2024-09-12T18:03:39.668771+0000","last_became_active":"2024-09-12T17:46:42.178809+0000","last_became_peered":"2024-09-12T17:46:42.178809+0000","last_unstale":"2024-09-12T18:03:39.668771+0000","last_undegraded":"2024-09-12T18:03:39.668771+0000","last_fullsized":"2024-09-12T18:03:39.668771+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:58.601763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'40","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.520902+0000","last_change":"2024-09-12T17:45:03.892705+0000","last_active":"2024-09-12T18:04:24.520902+0000","last_peered":"2024-09-12T18:04:24.520902+0000","last_clean":"2024-09-12T18:04:24.520902+0000","last_became_active":"2024-09-12T17:45:03.892417+0000","last_became_peered":"2024-09-12T17:45:03.892417+0000","last_unstale":"2024-09-12T18:04:24.520902+0000","last_undegraded":"2024-09-12T18:04:24.520902+0000","last_fullsized":"2024-09-12T18:04:24.520902+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:19.505017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":139,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.671898+0000","last_change":"2024-09-12T17:57:00.463497+0000","last_active":"2024-09-12T18:03:59.671898+0000","last_peered":"2024-09-12T18:03:59.671898+0000","last_clean":"2024-09-12T18:03:59.671898+0000","last_became_active":"2024-09-12T17:57:00.463245+0000","last_became_peered":"2024-09-12T17:57:00.463245+0000","last_unstale":"2024-09-12T18:03:59.671898+0000","last_undegraded":"2024-09-12T18:03:59.671898+0000","last_fullsized":"2024-09-12T18:03:59.671898+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:38.750487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.514393+0000","last_change":"2024-09-12T17:46:45.538651+0000","last_active":"2024-09-12T18:03:39.514393+0000","last_peered":"2024-09-12T18:03:39.514393+0000","last_clean":"2024-09-12T18:03:39.514393+0000","last_became_active":"2024-09-12T17:46:45.538337+0000","last_became_peered":"2024-09-12T17:46:45.538337+0000","last_unstale":"2024-09-12T18:03:39.514393+0000","last_undegraded":"2024-09-12T18:03:39.514393+0000","last_fullsized":"2024-09-12T18:03:39.514393+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:48.298979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.630162+0000","last_change":"2024-09-12T17:46:42.183384+0000","last_active":"2024-09-12T18:03:39.630162+0000","last_peered":"2024-09-12T18:03:39.630162+0000","last_clean":"2024-09-12T18:03:39.630162+0000","last_became_active":"2024-09-12T17:46:42.183098+0000","last_became_peered":"2024-09-12T17:46:42.183098+0000","last_unstale":"2024-09-12T18:03:39.630162+0000","last_undegraded":"2024-09-12T18:03:39.630162+0000","last_fullsized":"2024-09-12T18:03:39.630162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:06.980322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'35","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.149147+0000","last_change":"2024-09-12T17:45:03.896813+0000","last_active":"2024-09-12T18:05:20.149147+0000","last_peered":"2024-09-12T18:05:20.149147+0000","last_clean":"2024-09-12T18:05:20.149147+0000","last_became_active":"2024-09-12T17:45:03.896299+0000","last_became_peered":"2024-09-12T17:45:03.896299+0000","last_unstale":"2024-09-12T18:05:20.149147+0000","last_undegraded":"2024-09-12T18:05:20.149147+0000","last_fullsized":"2024-09-12T18:05:20.149147+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:31.025568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":68,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.629360+0000","last_change":"2024-09-12T17:57:00.462016+0000","last_active":"2024-09-12T18:03:59.629360+0000","last_peered":"2024-09-12T18:03:59.629360+0000","last_clean":"2024-09-12T18:03:59.629360+0000","last_became_active":"2024-09-12T17:57:00.461706+0000","last_became_peered":"2024-09-12T17:57:00.461706+0000","last_unstale":"2024-09-12T18:03:59.629360+0000","last_undegraded":"2024-09-12T18:03:59.629360+0000","last_fullsized":"2024-09-12T18:03:59.629360+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:47.107872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.503300+0000","last_change":"2024-09-12T17:46:45.207863+0000","last_active":"2024-09-12T18:03:39.503300+0000","last_peered":"2024-09-12T18:03:39.503300+0000","last_clean":"2024-09-12T18:03:39.503300+0000","last_became_active":"2024-09-12T17:46:45.207610+0000","last_became_peered":"2024-09-12T17:46:45.207610+0000","last_unstale":"2024-09-12T18:03:39.503300+0000","last_undegraded":"2024-09-12T18:03:39.503300+0000","last_fullsized":"2024-09-12T18:03:39.503300+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:02.945511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.631136+0000","last_change":"2024-09-12T17:46:42.182800+0000","last_active":"2024-09-12T18:03:39.631136+0000","last_peered":"2024-09-12T18:03:39.631136+0000","last_clean":"2024-09-12T18:03:39.631136+0000","last_became_active":"2024-09-12T17:46:42.182412+0000","last_became_peered":"2024-09-12T17:46:42.182412+0000","last_unstale":"2024-09-12T18:03:39.631136+0000","last_undegraded":"2024-09-12T18:03:39.631136+0000","last_fullsized":"2024-09-12T18:03:39.631136+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:58.438274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'49","reported_seq":173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:28.740711+0000","last_change":"2024-09-12T17:45:03.900251+0000","last_active":"2024-09-12T18:05:28.740711+0000","last_peered":"2024-09-12T18:05:28.740711+0000","last_clean":"2024-09-12T18:05:28.740711+0000","last_became_active":"2024-09-12T17:45:03.899885+0000","last_became_peered":"2024-09-12T17:45:03.899885+0000","last_unstale":"2024-09-12T18:05:28.740711+0000","last_undegraded":"2024-09-12T18:05:28.740711+0000","last_fullsized":"2024-09-12T18:05:28.740711+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:29.712954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":167,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519268+0000","last_change":"2024-09-12T17:57:00.468941+0000","last_active":"2024-09-12T18:04:14.519268+0000","last_peered":"2024-09-12T18:04:14.519268+0000","last_clean":"2024-09-12T18:04:14.519268+0000","last_became_active":"2024-09-12T17:57:00.468592+0000","last_became_peered":"2024-09-12T17:57:00.468592+0000","last_unstale":"2024-09-12T18:04:14.519268+0000","last_undegraded":"2024-09-12T18:04:14.519268+0000","last_fullsized":"2024-09-12T18:04:14.519268+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:05.976634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647467+0000","last_change":"2024-09-12T17:46:45.210723+0000","last_active":"2024-09-12T18:05:24.647467+0000","last_peered":"2024-09-12T18:05:24.647467+0000","last_clean":"2024-09-12T18:05:24.647467+0000","last_became_active":"2024-09-12T17:46:45.210413+0000","last_became_peered":"2024-09-12T17:46:45.210413+0000","last_unstale":"2024-09-12T18:05:24.647467+0000","last_undegraded":"2024-09-12T18:05:24.647467+0000","last_fullsized":"2024-09-12T18:05:24.647467+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:35.068995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518445+0000","last_change":"2024-09-12T17:46:42.177074+0000","last_active":"2024-09-12T18:05:24.518445+0000","last_peered":"2024-09-12T18:05:24.518445+0000","last_clean":"2024-09-12T18:05:24.518445+0000","last_became_active":"2024-09-12T17:46:42.176505+0000","last_became_peered":"2024-09-12T17:46:42.176505+0000","last_unstale":"2024-09-12T18:05:24.518445+0000","last_undegraded":"2024-09-12T18:05:24.518445+0000","last_fullsized":"2024-09-12T18:05:24.518445+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:43.326678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.669496+0000","last_change":"2024-09-12T17:45:03.900017+0000","last_active":"2024-09-12T18:03:44.669496+0000","last_peered":"2024-09-12T18:03:44.669496+0000","last_clean":"2024-09-12T18:03:44.669496+0000","last_became_active":"2024-09-12T17:45:03.899726+0000","last_became_peered":"2024-09-12T17:45:03.899726+0000","last_unstale":"2024-09-12T18:03:44.669496+0000","last_undegraded":"2024-09-12T18:03:44.669496+0000","last_fullsized":"2024-09-12T18:03:44.669496+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:05.783642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.636058+0000","last_change":"2024-09-12T17:57:00.464086+0000","last_active":"2024-09-12T18:04:14.636058+0000","last_peered":"2024-09-12T18:04:14.636058+0000","last_clean":"2024-09-12T18:04:14.636058+0000","last_became_active":"2024-09-12T17:57:00.463766+0000","last_became_peered":"2024-09-12T17:57:00.463766+0000","last_unstale":"2024-09-12T18:04:14.636058+0000","last_undegraded":"2024-09-12T18:04:14.636058+0000","last_fullsized":"2024-09-12T18:04:14.636058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:28.897896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'6","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647409+0000","last_change":"2024-09-12T17:46:45.201582+0000","last_active":"2024-09-12T18:05:24.647409+0000","last_peered":"2024-09-12T18:05:24.647409+0000","last_clean":"2024-09-12T18:05:24.647409+0000","last_became_active":"2024-09-12T17:46:45.201278+0000","last_became_peered":"2024-09-12T17:46:45.201278+0000","last_unstale":"2024-09-12T18:05:24.647409+0000","last_undegraded":"2024-09-12T18:05:24.647409+0000","last_fullsized":"2024-09-12T18:05:24.647409+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:48.055531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":19456,"num_write":11,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'6","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534213+0000","last_change":"2024-09-12T17:46:42.182936+0000","last_active":"2024-09-12T18:05:24.534213+0000","last_peered":"2024-09-12T18:05:24.534213+0000","last_clean":"2024-09-12T18:05:24.534213+0000","last_became_active":"2024-09-12T17:46:42.182658+0000","last_became_peered":"2024-09-12T17:46:42.182658+0000","last_unstale":"2024-09-12T18:05:24.534213+0000","last_undegraded":"2024-09-12T18:05:24.534213+0000","last_fullsized":"2024-09-12T18:05:24.534213+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:02.557846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":16,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.277595+0000","last_change":"2024-09-12T17:45:03.891474+0000","last_active":"2024-09-12T18:05:09.277595+0000","last_peered":"2024-09-12T18:05:09.277595+0000","last_clean":"2024-09-12T18:05:09.277595+0000","last_became_active":"2024-09-12T17:45:03.891186+0000","last_became_peered":"2024-09-12T17:45:03.891186+0000","last_unstale":"2024-09-12T18:05:09.277595+0000","last_undegraded":"2024-09-12T18:05:09.277595+0000","last_fullsized":"2024-09-12T18:05:09.277595+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:08.125248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":128,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.633745+0000","last_change":"2024-09-12T17:57:00.465754+0000","last_active":"2024-09-12T18:03:59.633745+0000","last_peered":"2024-09-12T18:03:59.633745+0000","last_clean":"2024-09-12T18:03:59.633745+0000","last_became_active":"2024-09-12T17:57:00.464910+0000","last_became_peered":"2024-09-12T17:57:00.464910+0000","last_unstale":"2024-09-12T18:03:59.633745+0000","last_undegraded":"2024-09-12T18:03:59.633745+0000","last_fullsized":"2024-09-12T18:03:59.633745+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:15.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534265+0000","last_change":"2024-09-12T17:46:45.206745+0000","last_active":"2024-09-12T18:05:24.534265+0000","last_peered":"2024-09-12T18:05:24.534265+0000","last_clean":"2024-09-12T18:05:24.534265+0000","last_became_active":"2024-09-12T17:46:45.206402+0000","last_became_peered":"2024-09-12T17:46:45.206402+0000","last_unstale":"2024-09-12T18:05:24.534265+0000","last_undegraded":"2024-09-12T18:05:24.534265+0000","last_fullsized":"2024-09-12T18:05:24.534265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:55.547505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518486+0000","last_change":"2024-09-12T17:46:42.185043+0000","last_active":"2024-09-12T18:05:24.518486+0000","last_peered":"2024-09-12T18:05:24.518486+0000","last_clean":"2024-09-12T18:05:24.518486+0000","last_became_active":"2024-09-12T17:46:42.184760+0000","last_became_peered":"2024-09-12T17:46:42.184760+0000","last_unstale":"2024-09-12T18:05:24.518486+0000","last_undegraded":"2024-09-12T18:05:24.518486+0000","last_fullsized":"2024-09-12T18:05:24.518486+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:44.853687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'36","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.504092+0000","last_change":"2024-09-12T17:45:03.897900+0000","last_active":"2024-09-12T18:03:44.504092+0000","last_peered":"2024-09-12T18:03:44.504092+0000","last_clean":"2024-09-12T18:03:44.504092+0000","last_became_active":"2024-09-12T17:45:03.897616+0000","last_became_peered":"2024-09-12T17:45:03.897616+0000","last_unstale":"2024-09-12T18:03:44.504092+0000","last_undegraded":"2024-09-12T18:03:44.504092+0000","last_fullsized":"2024-09-12T18:03:44.504092+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:50.190493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":138,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519243+0000","last_change":"2024-09-12T17:57:00.464276+0000","last_active":"2024-09-12T18:04:14.519243+0000","last_peered":"2024-09-12T18:04:14.519243+0000","last_clean":"2024-09-12T18:04:14.519243+0000","last_became_active":"2024-09-12T17:57:00.463881+0000","last_became_peered":"2024-09-12T17:57:00.463881+0000","last_unstale":"2024-09-12T18:04:14.519243+0000","last_undegraded":"2024-09-12T18:04:14.519243+0000","last_fullsized":"2024-09-12T18:04:14.519243+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:03.028160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518466+0000","last_change":"2024-09-12T17:46:45.206370+0000","last_active":"2024-09-12T18:05:24.518466+0000","last_peered":"2024-09-12T18:05:24.518466+0000","last_clean":"2024-09-12T18:05:24.518466+0000","last_became_active":"2024-09-12T17:46:45.205987+0000","last_became_peered":"2024-09-12T17:46:45.205987+0000","last_unstale":"2024-09-12T18:05:24.518466+0000","last_undegraded":"2024-09-12T18:05:24.518466+0000","last_fullsized":"2024-09-12T18:05:24.518466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:04.606065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.642468+0000","last_change":"2024-09-12T17:46:42.180412+0000","last_active":"2024-09-12T18:05:24.642468+0000","last_peered":"2024-09-12T18:05:24.642468+0000","last_clean":"2024-09-12T18:05:24.642468+0000","last_became_active":"2024-09-12T17:46:42.178941+0000","last_became_peered":"2024-09-12T17:46:42.178941+0000","last_unstale":"2024-09-12T18:05:24.642468+0000","last_undegraded":"2024-09-12T18:05:24.642468+0000","last_fullsized":"2024-09-12T18:05:24.642468+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:53.889661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'33","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.633278+0000","last_change":"2024-09-12T17:45:03.893625+0000","last_active":"2024-09-12T18:05:19.633278+0000","last_peered":"2024-09-12T18:05:19.633278+0000","last_clean":"2024-09-12T18:05:19.633278+0000","last_became_active":"2024-09-12T17:45:03.893332+0000","last_became_peered":"2024-09-12T17:45:03.893332+0000","last_unstale":"2024-09-12T18:05:19.633278+0000","last_undegraded":"2024-09-12T18:05:19.633278+0000","last_fullsized":"2024-09-12T18:05:19.633278+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:59.606201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.646279+0000","last_change":"2024-09-12T17:57:00.461421+0000","last_active":"2024-09-12T18:05:39.646279+0000","last_peered":"2024-09-12T18:05:39.646279+0000","last_clean":"2024-09-12T18:05:39.646279+0000","last_became_active":"2024-09-12T17:57:00.461130+0000","last_became_peered":"2024-09-12T17:57:00.461130+0000","last_unstale":"2024-09-12T18:05:39.646279+0000","last_undegraded":"2024-09-12T18:05:39.646279+0000","last_fullsized":"2024-09-12T18:05:39.646279+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:49.944764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.524097+0000","last_change":"2024-09-12T17:46:45.208179+0000","last_active":"2024-09-12T18:04:44.524097+0000","last_peered":"2024-09-12T18:04:44.524097+0000","last_clean":"2024-09-12T18:04:44.524097+0000","last_became_active":"2024-09-12T17:46:45.207899+0000","last_became_peered":"2024-09-12T17:46:45.207899+0000","last_unstale":"2024-09-12T18:04:44.524097+0000","last_undegraded":"2024-09-12T18:04:44.524097+0000","last_fullsized":"2024-09-12T18:04:44.524097+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:40.530867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5827243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.679250+0000","last_change":"2024-09-12T17:46:42.178168+0000","last_active":"2024-09-12T18:04:44.679250+0000","last_peered":"2024-09-12T18:04:44.679250+0000","last_clean":"2024-09-12T18:04:44.679250+0000","last_became_active":"2024-09-12T17:46:42.177867+0000","last_became_peered":"2024-09-12T17:46:42.177867+0000","last_unstale":"2024-09-12T18:04:44.679250+0000","last_undegraded":"2024-09-12T18:04:44.679250+0000","last_fullsized":"2024-09-12T18:04:44.679250+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:40.404324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'22","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534323+0000","last_change":"2024-09-12T17:45:03.895504+0000","last_active":"2024-09-12T18:05:24.534323+0000","last_peered":"2024-09-12T18:05:24.534323+0000","last_clean":"2024-09-12T18:05:24.534323+0000","last_became_active":"2024-09-12T17:45:03.895229+0000","last_became_peered":"2024-09-12T17:45:03.895229+0000","last_unstale":"2024-09-12T18:05:24.534323+0000","last_undegraded":"2024-09-12T18:05:24.534323+0000","last_fullsized":"2024-09-12T18:05:24.534323+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:49.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.669484+0000","last_change":"2024-09-12T17:57:00.466936+0000","last_active":"2024-09-12T18:03:44.669484+0000","last_peered":"2024-09-12T18:03:44.669484+0000","last_clean":"2024-09-12T18:03:44.669484+0000","last_became_active":"2024-09-12T17:57:00.466328+0000","last_became_peered":"2024-09-12T17:57:00.466328+0000","last_unstale":"2024-09-12T18:03:44.669484+0000","last_undegraded":"2024-09-12T18:03:44.669484+0000","last_fullsized":"2024-09-12T18:03:44.669484+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:21.500416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.524062+0000","last_change":"2024-09-12T17:46:45.204918+0000","last_active":"2024-09-12T18:04:44.524062+0000","last_peered":"2024-09-12T18:04:44.524062+0000","last_clean":"2024-09-12T18:04:44.524062+0000","last_became_active":"2024-09-12T17:46:45.204628+0000","last_became_peered":"2024-09-12T17:46:45.204628+0000","last_unstale":"2024-09-12T18:04:44.524062+0000","last_undegraded":"2024-09-12T18:04:44.524062+0000","last_fullsized":"2024-09-12T18:04:44.524062+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:44.729741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639499+0000","last_change":"2024-09-12T17:46:42.183988+0000","last_active":"2024-09-12T18:04:44.639499+0000","last_peered":"2024-09-12T18:04:44.639499+0000","last_clean":"2024-09-12T18:04:44.639499+0000","last_became_active":"2024-09-12T17:46:42.183710+0000","last_became_peered":"2024-09-12T17:46:42.183710+0000","last_unstale":"2024-09-12T18:04:44.639499+0000","last_undegraded":"2024-09-12T18:04:44.639499+0000","last_fullsized":"2024-09-12T18:04:44.639499+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:52.515375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'20","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.641966+0000","last_change":"2024-09-12T17:45:03.897931+0000","last_active":"2024-09-12T18:05:19.641966+0000","last_peered":"2024-09-12T18:05:19.641966+0000","last_clean":"2024-09-12T18:05:19.641966+0000","last_became_active":"2024-09-12T17:45:03.897609+0000","last_became_peered":"2024-09-12T17:45:03.897609+0000","last_unstale":"2024-09-12T18:05:19.641966+0000","last_undegraded":"2024-09-12T18:05:19.641966+0000","last_fullsized":"2024-09-12T18:05:19.641966+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:57.004403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.520491+0000","last_change":"2024-09-12T17:57:00.459052+0000","last_active":"2024-09-12T18:05:39.520491+0000","last_peered":"2024-09-12T18:05:39.520491+0000","last_clean":"2024-09-12T18:05:39.520491+0000","last_became_active":"2024-09-12T17:57:00.458777+0000","last_became_peered":"2024-09-12T17:57:00.458777+0000","last_unstale":"2024-09-12T18:05:39.520491+0000","last_undegraded":"2024-09-12T18:05:39.520491+0000","last_fullsized":"2024-09-12T18:05:39.520491+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:12.952038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640853+0000","last_change":"2024-09-12T17:46:45.537482+0000","last_active":"2024-09-12T18:04:44.640853+0000","last_peered":"2024-09-12T18:04:44.640853+0000","last_clean":"2024-09-12T18:04:44.640853+0000","last_became_active":"2024-09-12T17:46:45.536980+0000","last_became_peered":"2024-09-12T17:46:45.536980+0000","last_unstale":"2024-09-12T18:04:44.640853+0000","last_undegraded":"2024-09-12T18:04:44.640853+0000","last_fullsized":"2024-09-12T18:04:44.640853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:14.427774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640687+0000","last_change":"2024-09-12T17:46:42.180818+0000","last_active":"2024-09-12T18:04:44.640687+0000","last_peered":"2024-09-12T18:04:44.640687+0000","last_clean":"2024-09-12T18:04:44.640687+0000","last_became_active":"2024-09-12T17:46:42.180565+0000","last_became_peered":"2024-09-12T17:46:42.180565+0000","last_unstale":"2024-09-12T18:04:44.640687+0000","last_undegraded":"2024-09-12T18:04:44.640687+0000","last_fullsized":"2024-09-12T18:04:44.640687+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:16.219991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'33","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517834+0000","last_change":"2024-09-12T17:45:03.892503+0000","last_active":"2024-09-12T18:05:19.517834+0000","last_peered":"2024-09-12T18:05:19.517834+0000","last_clean":"2024-09-12T18:05:19.517834+0000","last_became_active":"2024-09-12T17:45:03.892226+0000","last_became_peered":"2024-09-12T17:45:03.892226+0000","last_unstale":"2024-09-12T18:05:19.517834+0000","last_undegraded":"2024-09-12T18:05:19.517834+0000","last_fullsized":"2024-09-12T18:05:19.517834+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:41.497858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":124,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.687364+0000","last_change":"2024-09-12T17:57:00.464984+0000","last_active":"2024-09-12T18:05:39.687364+0000","last_peered":"2024-09-12T18:05:39.687364+0000","last_clean":"2024-09-12T18:05:39.687364+0000","last_became_active":"2024-09-12T17:57:00.464707+0000","last_became_peered":"2024-09-12T17:57:00.464707+0000","last_unstale":"2024-09-12T18:05:39.687364+0000","last_undegraded":"2024-09-12T18:05:39.687364+0000","last_fullsized":"2024-09-12T18:05:39.687364+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:25.768696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.524117+0000","last_change":"2024-09-12T17:46:45.205067+0000","last_active":"2024-09-12T18:04:44.524117+0000","last_peered":"2024-09-12T18:04:44.524117+0000","last_clean":"2024-09-12T18:04:44.524117+0000","last_became_active":"2024-09-12T17:46:45.204759+0000","last_became_peered":"2024-09-12T17:46:45.204759+0000","last_unstale":"2024-09-12T18:04:44.524117+0000","last_undegraded":"2024-09-12T18:04:44.524117+0000","last_fullsized":"2024-09-12T18:04:44.524117+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:47.314625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640815+0000","last_change":"2024-09-12T17:46:42.183190+0000","last_active":"2024-09-12T18:04:44.640815+0000","last_peered":"2024-09-12T18:04:44.640815+0000","last_clean":"2024-09-12T18:04:44.640815+0000","last_became_active":"2024-09-12T17:46:42.182805+0000","last_became_peered":"2024-09-12T17:46:42.182805+0000","last_unstale":"2024-09-12T18:04:44.640815+0000","last_undegraded":"2024-09-12T18:04:44.640815+0000","last_fullsized":"2024-09-12T18:04:44.640815+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:54.005006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'42","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.643914+0000","last_change":"2024-09-12T17:45:03.898048+0000","last_active":"2024-09-12T18:05:19.643914+0000","last_peered":"2024-09-12T18:05:19.643914+0000","last_clean":"2024-09-12T18:05:19.643914+0000","last_became_active":"2024-09-12T17:45:03.897752+0000","last_became_peered":"2024-09-12T17:45:03.897752+0000","last_unstale":"2024-09-12T18:05:19.643914+0000","last_undegraded":"2024-09-12T18:05:19.643914+0000","last_fullsized":"2024-09-12T18:05:19.643914+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:59.048003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":75,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.515086+0000","last_change":"2024-09-12T17:57:00.469400+0000","last_active":"2024-09-12T18:03:44.515086+0000","last_peered":"2024-09-12T18:03:44.515086+0000","last_clean":"2024-09-12T18:03:44.515086+0000","last_became_active":"2024-09-12T17:57:00.469072+0000","last_became_peered":"2024-09-12T17:57:00.469072+0000","last_unstale":"2024-09-12T18:03:44.515086+0000","last_undegraded":"2024-09-12T18:03:44.515086+0000","last_fullsized":"2024-09-12T18:03:44.515086+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:37.442197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.507138+0000","last_change":"2024-09-12T17:46:45.203169+0000","last_active":"2024-09-12T18:04:04.507138+0000","last_peered":"2024-09-12T18:04:04.507138+0000","last_clean":"2024-09-12T18:04:04.507138+0000","last_became_active":"2024-09-12T17:46:45.202892+0000","last_became_peered":"2024-09-12T17:46:45.202892+0000","last_unstale":"2024-09-12T18:04:04.507138+0000","last_undegraded":"2024-09-12T18:04:04.507138+0000","last_fullsized":"2024-09-12T18:04:04.507138+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:50.179992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634333+0000","last_change":"2024-09-12T17:46:42.179076+0000","last_active":"2024-09-12T18:04:04.634333+0000","last_peered":"2024-09-12T18:04:04.634333+0000","last_clean":"2024-09-12T18:04:04.634333+0000","last_became_active":"2024-09-12T17:46:42.178411+0000","last_became_peered":"2024-09-12T17:46:42.178411+0000","last_unstale":"2024-09-12T18:04:04.634333+0000","last_undegraded":"2024-09-12T18:04:04.634333+0000","last_fullsized":"2024-09-12T18:04:04.634333+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:26.191877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'24","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646723+0000","last_change":"2024-09-12T17:45:03.891655+0000","last_active":"2024-09-12T18:05:19.646723+0000","last_peered":"2024-09-12T18:05:19.646723+0000","last_clean":"2024-09-12T18:05:19.646723+0000","last_became_active":"2024-09-12T17:45:03.891369+0000","last_became_peered":"2024-09-12T17:45:03.891369+0000","last_unstale":"2024-09-12T18:05:19.646723+0000","last_undegraded":"2024-09-12T18:05:19.646723+0000","last_fullsized":"2024-09-12T18:05:19.646723+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:45.970204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.670237+0000","last_change":"2024-09-12T17:57:00.465652+0000","last_active":"2024-09-12T18:03:49.670237+0000","last_peered":"2024-09-12T18:03:49.670237+0000","last_clean":"2024-09-12T18:03:49.670237+0000","last_became_active":"2024-09-12T17:57:00.465360+0000","last_became_peered":"2024-09-12T17:57:00.465360+0000","last_unstale":"2024-09-12T18:03:49.670237+0000","last_undegraded":"2024-09-12T18:03:49.670237+0000","last_fullsized":"2024-09-12T18:03:49.670237+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:56.997962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.672845+0000","last_change":"2024-09-12T17:46:45.536369+0000","last_active":"2024-09-12T18:04:04.672845+0000","last_peered":"2024-09-12T18:04:04.672845+0000","last_clean":"2024-09-12T18:04:04.672845+0000","last_became_active":"2024-09-12T17:46:45.536056+0000","last_became_peered":"2024-09-12T17:46:45.536056+0000","last_unstale":"2024-09-12T18:04:04.672845+0000","last_undegraded":"2024-09-12T18:04:04.672845+0000","last_fullsized":"2024-09-12T18:04:04.672845+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:32.199489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634773+0000","last_change":"2024-09-12T17:46:42.183083+0000","last_active":"2024-09-12T18:04:04.634773+0000","last_peered":"2024-09-12T18:04:04.634773+0000","last_clean":"2024-09-12T18:04:04.634773+0000","last_became_active":"2024-09-12T17:46:42.182831+0000","last_became_peered":"2024-09-12T17:46:42.182831+0000","last_unstale":"2024-09-12T18:04:04.634773+0000","last_undegraded":"2024-09-12T18:04:04.634773+0000","last_fullsized":"2024-09-12T18:04:04.634773+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:04.590775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'86","reported_seq":281,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.623576+0000","last_change":"2024-09-12T17:45:03.893737+0000","last_active":"2024-09-12T18:05:20.623576+0000","last_peered":"2024-09-12T18:05:20.623576+0000","last_clean":"2024-09-12T18:05:20.623576+0000","last_became_active":"2024-09-12T17:45:03.893452+0000","last_became_peered":"2024-09-12T17:45:03.893452+0000","last_unstale":"2024-09-12T18:05:20.623576+0000","last_undegraded":"2024-09-12T18:05:20.623576+0000","last_fullsized":"2024-09-12T18:05:20.623576+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:29.372853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":321,"num_write":137,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.669517+0000","last_change":"2024-09-12T17:57:00.464389+0000","last_active":"2024-09-12T18:03:44.669517+0000","last_peered":"2024-09-12T18:03:44.669517+0000","last_clean":"2024-09-12T18:03:44.669517+0000","last_became_active":"2024-09-12T17:57:00.464068+0000","last_became_peered":"2024-09-12T17:57:00.464068+0000","last_unstale":"2024-09-12T18:03:44.669517+0000","last_undegraded":"2024-09-12T18:03:44.669517+0000","last_fullsized":"2024-09-12T18:03:44.669517+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:52.387690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640740+0000","last_change":"2024-09-12T17:46:45.206955+0000","last_active":"2024-09-12T18:04:44.640740+0000","last_peered":"2024-09-12T18:04:44.640740+0000","last_clean":"2024-09-12T18:04:44.640740+0000","last_became_active":"2024-09-12T17:46:45.206644+0000","last_became_peered":"2024-09-12T17:46:45.206644+0000","last_unstale":"2024-09-12T18:04:44.640740+0000","last_undegraded":"2024-09-12T18:04:44.640740+0000","last_fullsized":"2024-09-12T18:04:44.640740+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:01.211515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634414+0000","last_change":"2024-09-12T17:46:42.184536+0000","last_active":"2024-09-12T18:04:04.634414+0000","last_peered":"2024-09-12T18:04:04.634414+0000","last_clean":"2024-09-12T18:04:04.634414+0000","last_became_active":"2024-09-12T17:46:42.184232+0000","last_became_peered":"2024-09-12T17:46:42.184232+0000","last_unstale":"2024-09-12T18:04:04.634414+0000","last_undegraded":"2024-09-12T18:04:04.634414+0000","last_fullsized":"2024-09-12T18:04:04.634414+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:05.091740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.522427+0000","last_change":"2024-09-12T17:45:03.897167+0000","last_active":"2024-09-12T18:04:34.522427+0000","last_peered":"2024-09-12T18:04:34.522427+0000","last_clean":"2024-09-12T18:04:34.522427+0000","last_became_active":"2024-09-12T17:45:03.896663+0000","last_became_peered":"2024-09-12T17:45:03.896663+0000","last_unstale":"2024-09-12T18:04:34.522427+0000","last_undegraded":"2024-09-12T18:04:34.522427+0000","last_fullsized":"2024-09-12T18:04:34.522427+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:00.166379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.631728+0000","last_change":"2024-09-12T17:57:00.465893+0000","last_active":"2024-09-12T18:03:44.631728+0000","last_peered":"2024-09-12T18:03:44.631728+0000","last_clean":"2024-09-12T18:03:44.631728+0000","last_became_active":"2024-09-12T17:57:00.465596+0000","last_became_peered":"2024-09-12T17:57:00.465596+0000","last_unstale":"2024-09-12T18:03:44.631728+0000","last_undegraded":"2024-09-12T18:03:44.631728+0000","last_fullsized":"2024-09-12T18:03:44.631728+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:13.446382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.673723+0000","last_change":"2024-09-12T17:46:45.208374+0000","last_active":"2024-09-12T18:04:09.673723+0000","last_peered":"2024-09-12T18:04:09.673723+0000","last_clean":"2024-09-12T18:04:09.673723+0000","last_became_active":"2024-09-12T17:46:45.208019+0000","last_became_peered":"2024-09-12T17:46:45.208019+0000","last_unstale":"2024-09-12T18:04:09.673723+0000","last_undegraded":"2024-09-12T18:04:09.673723+0000","last_fullsized":"2024-09-12T18:04:09.673723+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:03.347779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.512748+0000","last_change":"2024-09-12T17:46:42.184553+0000","last_active":"2024-09-12T18:04:44.512748+0000","last_peered":"2024-09-12T18:04:44.512748+0000","last_clean":"2024-09-12T18:04:44.512748+0000","last_became_active":"2024-09-12T17:46:42.184250+0000","last_became_peered":"2024-09-12T17:46:42.184250+0000","last_unstale":"2024-09-12T18:04:44.512748+0000","last_undegraded":"2024-09-12T18:04:44.512748+0000","last_fullsized":"2024-09-12T18:04:44.512748+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:49.433698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'40","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.511355+0000","last_change":"2024-09-12T17:45:03.897601+0000","last_active":"2024-09-12T18:04:34.511355+0000","last_peered":"2024-09-12T18:04:34.511355+0000","last_clean":"2024-09-12T18:04:34.511355+0000","last_became_active":"2024-09-12T17:45:03.897291+0000","last_became_peered":"2024-09-12T17:45:03.897291+0000","last_unstale":"2024-09-12T18:04:34.511355+0000","last_undegraded":"2024-09-12T18:04:34.511355+0000","last_fullsized":"2024-09-12T18:04:34.511355+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:56.938763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.684325+0000","last_change":"2024-09-12T17:57:00.465725+0000","last_active":"2024-09-12T18:05:19.684325+0000","last_peered":"2024-09-12T18:05:19.684325+0000","last_clean":"2024-09-12T18:05:19.684325+0000","last_became_active":"2024-09-12T17:57:00.465454+0000","last_became_peered":"2024-09-12T17:57:00.465454+0000","last_unstale":"2024-09-12T18:05:19.684325+0000","last_undegraded":"2024-09-12T18:05:19.684325+0000","last_fullsized":"2024-09-12T18:05:19.684325+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.552904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648118+0000","last_change":"2024-09-12T17:46:45.207902+0000","last_active":"2024-09-12T18:05:29.648118+0000","last_peered":"2024-09-12T18:05:29.648118+0000","last_clean":"2024-09-12T18:05:29.648118+0000","last_became_active":"2024-09-12T17:46:45.207607+0000","last_became_peered":"2024-09-12T17:46:45.207607+0000","last_unstale":"2024-09-12T18:05:29.648118+0000","last_undegraded":"2024-09-12T18:05:29.648118+0000","last_fullsized":"2024-09-12T18:05:29.648118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:31.661695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.685860+0000","last_change":"2024-09-12T17:46:42.182625+0000","last_active":"2024-09-12T18:05:29.685860+0000","last_peered":"2024-09-12T18:05:29.685860+0000","last_clean":"2024-09-12T18:05:29.685860+0000","last_became_active":"2024-09-12T17:46:42.182267+0000","last_became_peered":"2024-09-12T17:46:42.182267+0000","last_unstale":"2024-09-12T18:05:29.685860+0000","last_undegraded":"2024-09-12T18:05:29.685860+0000","last_fullsized":"2024-09-12T18:05:29.685860+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:39.753698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'54","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.639121+0000","last_change":"2024-09-12T17:45:03.892593+0000","last_active":"2024-09-12T18:04:34.639121+0000","last_peered":"2024-09-12T18:04:34.639121+0000","last_clean":"2024-09-12T18:04:34.639121+0000","last_became_active":"2024-09-12T17:45:03.891861+0000","last_became_peered":"2024-09-12T17:45:03.891861+0000","last_unstale":"2024-09-12T18:04:34.639121+0000","last_undegraded":"2024-09-12T18:04:34.639121+0000","last_fullsized":"2024-09-12T18:04:34.639121+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:11.906724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":286,"num_read_kb":219,"num_write":84,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.641923+0000","last_change":"2024-09-12T17:57:00.467076+0000","last_active":"2024-09-12T18:05:19.641923+0000","last_peered":"2024-09-12T18:05:19.641923+0000","last_clean":"2024-09-12T18:05:19.641923+0000","last_became_active":"2024-09-12T17:57:00.466761+0000","last_became_peered":"2024-09-12T17:57:00.466761+0000","last_unstale":"2024-09-12T18:05:19.641923+0000","last_undegraded":"2024-09-12T18:05:19.641923+0000","last_fullsized":"2024-09-12T18:05:19.641923+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:37.302553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648100+0000","last_change":"2024-09-12T17:46:45.537244+0000","last_active":"2024-09-12T18:05:29.648100+0000","last_peered":"2024-09-12T18:05:29.648100+0000","last_clean":"2024-09-12T18:05:29.648100+0000","last_became_active":"2024-09-12T17:46:45.536927+0000","last_became_peered":"2024-09-12T17:46:45.536927+0000","last_unstale":"2024-09-12T18:05:29.648100+0000","last_undegraded":"2024-09-12T18:05:29.648100+0000","last_fullsized":"2024-09-12T18:05:29.648100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:06.976539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.644905+0000","last_change":"2024-09-12T17:46:42.182617+0000","last_active":"2024-09-12T18:05:29.644905+0000","last_peered":"2024-09-12T18:05:29.644905+0000","last_clean":"2024-09-12T18:05:29.644905+0000","last_became_active":"2024-09-12T17:46:42.182346+0000","last_became_peered":"2024-09-12T17:46:42.182346+0000","last_unstale":"2024-09-12T18:05:29.644905+0000","last_undegraded":"2024-09-12T18:05:29.644905+0000","last_fullsized":"2024-09-12T18:05:29.644905+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:54.314647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'22","reported_seq":105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.511454+0000","last_change":"2024-09-12T17:45:03.895804+0000","last_active":"2024-09-12T18:04:34.511454+0000","last_peered":"2024-09-12T18:04:34.511454+0000","last_clean":"2024-09-12T18:04:34.511454+0000","last_became_active":"2024-09-12T17:45:03.895580+0000","last_became_peered":"2024-09-12T17:45:03.895580+0000","last_unstale":"2024-09-12T18:04:34.511454+0000","last_undegraded":"2024-09-12T18:04:34.511454+0000","last_fullsized":"2024-09-12T18:04:34.511454+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.580183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643446+0000","last_change":"2024-09-12T17:57:00.463170+0000","last_active":"2024-09-12T18:04:59.643446+0000","last_peered":"2024-09-12T18:04:59.643446+0000","last_clean":"2024-09-12T18:04:59.643446+0000","last_became_active":"2024-09-12T17:57:00.462863+0000","last_became_peered":"2024-09-12T17:57:00.462863+0000","last_unstale":"2024-09-12T18:04:59.643446+0000","last_undegraded":"2024-09-12T18:04:59.643446+0000","last_fullsized":"2024-09-12T18:04:59.643446+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:40.563317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.672968+0000","last_change":"2024-09-12T17:46:45.537210+0000","last_active":"2024-09-12T18:04:04.672968+0000","last_peered":"2024-09-12T18:04:04.672968+0000","last_clean":"2024-09-12T18:04:04.672968+0000","last_became_active":"2024-09-12T17:46:45.536831+0000","last_became_peered":"2024-09-12T17:46:45.536831+0000","last_unstale":"2024-09-12T18:04:04.672968+0000","last_undegraded":"2024-09-12T18:04:04.672968+0000","last_fullsized":"2024-09-12T18:04:04.672968+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:29.700931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'6","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.630406+0000","last_change":"2024-09-12T17:46:42.185520+0000","last_active":"2024-09-12T18:04:04.630406+0000","last_peered":"2024-09-12T18:04:04.630406+0000","last_clean":"2024-09-12T18:04:04.630406+0000","last_became_active":"2024-09-12T17:46:42.185216+0000","last_became_peered":"2024-09-12T17:46:42.185216+0000","last_unstale":"2024-09-12T18:04:04.630406+0000","last_undegraded":"2024-09-12T18:04:04.630406+0000","last_fullsized":"2024-09-12T18:04:04.630406+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:37.439176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":23554,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.671044+0000","last_change":"2024-09-12T17:45:03.894942+0000","last_active":"2024-09-12T18:03:54.671044+0000","last_peered":"2024-09-12T18:03:54.671044+0000","last_clean":"2024-09-12T18:03:54.671044+0000","last_became_active":"2024-09-12T17:45:03.894642+0000","last_became_peered":"2024-09-12T17:45:03.894642+0000","last_unstale":"2024-09-12T18:03:54.671044+0000","last_undegraded":"2024-09-12T18:03:54.671044+0000","last_fullsized":"2024-09-12T18:03:54.671044+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:17.879728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517749+0000","last_change":"2024-09-12T17:57:00.465804+0000","last_active":"2024-09-12T18:05:19.517749+0000","last_peered":"2024-09-12T18:05:19.517749+0000","last_clean":"2024-09-12T18:05:19.517749+0000","last_became_active":"2024-09-12T17:57:00.465546+0000","last_became_peered":"2024-09-12T17:57:00.465546+0000","last_unstale":"2024-09-12T18:05:19.517749+0000","last_undegraded":"2024-09-12T18:05:19.517749+0000","last_fullsized":"2024-09-12T18:05:19.517749+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.264688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'9","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.507233+0000","last_change":"2024-09-12T17:46:45.206808+0000","last_active":"2024-09-12T18:04:04.507233+0000","last_peered":"2024-09-12T18:04:04.507233+0000","last_clean":"2024-09-12T18:04:04.507233+0000","last_became_active":"2024-09-12T17:46:45.206537+0000","last_became_peered":"2024-09-12T17:46:45.206537+0000","last_unstale":"2024-09-12T18:04:04.507233+0000","last_undegraded":"2024-09-12T18:04:04.507233+0000","last_fullsized":"2024-09-12T18:04:04.507233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.731520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14215851,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":29814,"num_write":14,"num_write_kb":19003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.672982+0000","last_change":"2024-09-12T17:46:42.177736+0000","last_active":"2024-09-12T18:04:04.672982+0000","last_peered":"2024-09-12T18:04:04.672982+0000","last_clean":"2024-09-12T18:04:04.672982+0000","last_became_active":"2024-09-12T17:46:42.177427+0000","last_became_peered":"2024-09-12T17:46:42.177427+0000","last_unstale":"2024-09-12T18:04:04.672982+0000","last_undegraded":"2024-09-12T18:04:04.672982+0000","last_fullsized":"2024-09-12T18:04:04.672982+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:07.172378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'156","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.651994+0000","last_change":"2024-09-12T17:45:03.898576+0000","last_active":"2024-09-12T18:05:54.651994+0000","last_peered":"2024-09-12T18:05:54.651994+0000","last_clean":"2024-09-12T18:05:54.651994+0000","last_became_active":"2024-09-12T17:45:03.898292+0000","last_became_peered":"2024-09-12T17:45:03.898292+0000","last_unstale":"2024-09-12T18:05:54.651994+0000","last_undegraded":"2024-09-12T18:05:54.651994+0000","last_fullsized":"2024-09-12T18:05:54.651994+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:55.707973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":951,"num_read_kb":701,"num_write":196,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.646344+0000","last_change":"2024-09-12T17:57:00.464364+0000","last_active":"2024-09-12T18:05:39.646344+0000","last_peered":"2024-09-12T18:05:39.646344+0000","last_clean":"2024-09-12T18:05:39.646344+0000","last_became_active":"2024-09-12T17:57:00.464090+0000","last_became_peered":"2024-09-12T17:57:00.464090+0000","last_unstale":"2024-09-12T18:05:39.646344+0000","last_undegraded":"2024-09-12T18:05:39.646344+0000","last_fullsized":"2024-09-12T18:05:39.646344+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.615989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648116+0000","last_change":"2024-09-12T17:46:45.205661+0000","last_active":"2024-09-12T18:05:29.648116+0000","last_peered":"2024-09-12T18:05:29.648116+0000","last_clean":"2024-09-12T18:05:29.648116+0000","last_became_active":"2024-09-12T17:46:45.205357+0000","last_became_peered":"2024-09-12T17:46:45.205357+0000","last_unstale":"2024-09-12T18:05:29.648116+0000","last_undegraded":"2024-09-12T18:05:29.648116+0000","last_fullsized":"2024-09-12T18:05:29.648116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:35.096441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'1","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.679945+0000","last_change":"2024-09-12T17:46:42.176715+0000","last_active":"2024-09-12T18:04:49.679945+0000","last_peered":"2024-09-12T18:04:49.679945+0000","last_clean":"2024-09-12T18:04:49.679945+0000","last_became_active":"2024-09-12T17:46:42.176415+0000","last_became_peered":"2024-09-12T17:46:42.176415+0000","last_unstale":"2024-09-12T18:04:49.679945+0000","last_undegraded":"2024-09-12T18:04:49.679945+0000","last_fullsized":"2024-09-12T18:04:49.679945+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:04.586483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'25","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.647144+0000","last_change":"2024-09-12T17:45:03.889617+0000","last_active":"2024-09-12T18:05:54.647144+0000","last_peered":"2024-09-12T18:05:54.647144+0000","last_clean":"2024-09-12T18:05:54.647144+0000","last_became_active":"2024-09-12T17:45:03.889334+0000","last_became_peered":"2024-09-12T17:45:03.889334+0000","last_unstale":"2024-09-12T18:05:54.647144+0000","last_undegraded":"2024-09-12T18:05:54.647144+0000","last_fullsized":"2024-09-12T18:05:54.647144+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:08.253653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.649616+0000","last_change":"2024-09-12T17:57:00.453730+0000","last_active":"2024-09-12T18:05:39.649616+0000","last_peered":"2024-09-12T18:05:39.649616+0000","last_clean":"2024-09-12T18:05:39.649616+0000","last_became_active":"2024-09-12T17:57:00.453435+0000","last_became_peered":"2024-09-12T17:57:00.453435+0000","last_unstale":"2024-09-12T18:05:39.649616+0000","last_undegraded":"2024-09-12T18:05:39.649616+0000","last_fullsized":"2024-09-12T18:05:39.649616+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:47.161486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"261'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.637517+0000","last_change":"2024-09-12T17:46:45.211314+0000","last_active":"2024-09-12T18:04:49.637517+0000","last_peered":"2024-09-12T18:04:49.637517+0000","last_clean":"2024-09-12T18:04:49.637517+0000","last_became_active":"2024-09-12T17:46:45.210669+0000","last_became_peered":"2024-09-12T17:46:45.210669+0000","last_unstale":"2024-09-12T18:04:49.637517+0000","last_undegraded":"2024-09-12T18:04:49.637517+0000","last_fullsized":"2024-09-12T18:04:49.637517+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:28.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.685819+0000","last_change":"2024-09-12T17:46:42.179654+0000","last_active":"2024-09-12T18:05:29.685819+0000","last_peered":"2024-09-12T18:05:29.685819+0000","last_clean":"2024-09-12T18:05:29.685819+0000","last_became_active":"2024-09-12T17:46:42.179369+0000","last_became_peered":"2024-09-12T17:46:42.179369+0000","last_unstale":"2024-09-12T18:05:29.685819+0000","last_undegraded":"2024-09-12T18:05:29.685819+0000","last_fullsized":"2024-09-12T18:05:29.685819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:46.896690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'11","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.522442+0000","last_change":"2024-09-12T17:45:03.892044+0000","last_active":"2024-09-12T18:05:54.522442+0000","last_peered":"2024-09-12T18:05:54.522442+0000","last_clean":"2024-09-12T18:05:54.522442+0000","last_became_active":"2024-09-12T17:45:03.891751+0000","last_became_peered":"2024-09-12T17:45:03.891751+0000","last_unstale":"2024-09-12T18:05:54.522442+0000","last_undegraded":"2024-09-12T18:05:54.522442+0000","last_fullsized":"2024-09-12T18:05:54.522442+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:57.974426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646774+0000","last_change":"2024-09-12T17:57:00.466635+0000","last_active":"2024-09-12T18:05:19.646774+0000","last_peered":"2024-09-12T18:05:19.646774+0000","last_clean":"2024-09-12T18:05:19.646774+0000","last_became_active":"2024-09-12T17:57:00.465706+0000","last_became_peered":"2024-09-12T17:57:00.465706+0000","last_unstale":"2024-09-12T18:05:19.646774+0000","last_undegraded":"2024-09-12T18:05:19.646774+0000","last_fullsized":"2024-09-12T18:05:19.646774+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:50.291887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'6","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519086+0000","last_change":"2024-09-12T17:46:45.207296+0000","last_active":"2024-09-12T18:05:29.519086+0000","last_peered":"2024-09-12T18:05:29.519086+0000","last_clean":"2024-09-12T18:05:29.519086+0000","last_became_active":"2024-09-12T17:46:45.206384+0000","last_became_peered":"2024-09-12T17:46:45.206384+0000","last_unstale":"2024-09-12T18:05:29.519086+0000","last_undegraded":"2024-09-12T18:05:29.519086+0000","last_fullsized":"2024-09-12T18:05:29.519086+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:12.346318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":22528,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648169+0000","last_change":"2024-09-12T17:46:42.177668+0000","last_active":"2024-09-12T18:05:29.648169+0000","last_peered":"2024-09-12T18:05:29.648169+0000","last_clean":"2024-09-12T18:05:29.648169+0000","last_became_active":"2024-09-12T17:46:42.177381+0000","last_became_peered":"2024-09-12T17:46:42.177381+0000","last_unstale":"2024-09-12T18:05:29.648169+0000","last_undegraded":"2024-09-12T18:05:29.648169+0000","last_fullsized":"2024-09-12T18:05:29.648169+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:48.797003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.908163+0000","last_change":"2024-09-12T17:45:03.893535+0000","last_active":"2024-09-12T18:05:56.908163+0000","last_peered":"2024-09-12T18:05:56.908163+0000","last_clean":"2024-09-12T18:05:56.908163+0000","last_became_active":"2024-09-12T17:45:03.893234+0000","last_became_peered":"2024-09-12T17:45:03.893234+0000","last_unstale":"2024-09-12T18:05:56.908163+0000","last_undegraded":"2024-09-12T18:05:56.908163+0000","last_fullsized":"2024-09-12T18:05:56.908163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:56.134844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":127,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.685120+0000","last_change":"2024-09-12T17:57:00.467265+0000","last_active":"2024-09-12T18:05:24.685120+0000","last_peered":"2024-09-12T18:05:24.685120+0000","last_clean":"2024-09-12T18:05:24.685120+0000","last_became_active":"2024-09-12T17:57:00.466994+0000","last_became_peered":"2024-09-12T17:57:00.466994+0000","last_unstale":"2024-09-12T18:05:24.685120+0000","last_undegraded":"2024-09-12T18:05:24.685120+0000","last_fullsized":"2024-09-12T18:05:24.685120+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:10.618141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519076+0000","last_change":"2024-09-12T17:46:45.207817+0000","last_active":"2024-09-12T18:05:29.519076+0000","last_peered":"2024-09-12T18:05:29.519076+0000","last_clean":"2024-09-12T18:05:29.519076+0000","last_became_active":"2024-09-12T17:46:45.207552+0000","last_became_peered":"2024-09-12T17:46:45.207552+0000","last_unstale":"2024-09-12T18:05:29.519076+0000","last_undegraded":"2024-09-12T18:05:29.519076+0000","last_fullsized":"2024-09-12T18:05:29.519076+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.256254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'5","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519111+0000","last_change":"2024-09-12T17:46:42.182084+0000","last_active":"2024-09-12T18:05:29.519111+0000","last_peered":"2024-09-12T18:05:29.519111+0000","last_clean":"2024-09-12T18:05:29.519111+0000","last_became_active":"2024-09-12T17:46:42.181805+0000","last_became_peered":"2024-09-12T17:46:42.181805+0000","last_unstale":"2024-09-12T18:05:29.519111+0000","last_undegraded":"2024-09-12T18:05:29.519111+0000","last_fullsized":"2024-09-12T18:05:29.519111+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:10.912482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'23","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.747227+0000","last_change":"2024-09-12T17:45:03.893633+0000","last_active":"2024-09-12T18:05:56.747227+0000","last_peered":"2024-09-12T18:05:56.747227+0000","last_clean":"2024-09-12T18:05:56.747227+0000","last_became_active":"2024-09-12T17:45:03.893361+0000","last_became_peered":"2024-09-12T17:45:03.893361+0000","last_unstale":"2024-09-12T18:05:56.747227+0000","last_undegraded":"2024-09-12T18:05:56.747227+0000","last_fullsized":"2024-09-12T18:05:56.747227+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:44.155033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":77,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'207","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.242849+0000","last_change":"2024-09-12T17:29:52.955507+0000","last_active":"2024-09-12T18:05:59.242849+0000","last_peered":"2024-09-12T18:05:59.242849+0000","last_clean":"2024-09-12T18:05:59.242849+0000","last_became_active":"2024-09-12T17:29:52.955124+0000","last_became_peered":"2024-09-12T17:29:52.955124+0000","last_unstale":"2024-09-12T18:05:59.242849+0000","last_undegraded":"2024-09-12T18:05:59.242849+0000","last_fullsized":"2024-09-12T18:05:59.242849+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:32.089966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":3241,"num_write":1056,"num_write_kb":28474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'166","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.325382+0000","last_change":"2024-09-12T17:29:54.957835+0000","last_active":"2024-09-12T18:05:55.325382+0000","last_peered":"2024-09-12T18:05:55.325382+0000","last_clean":"2024-09-12T18:05:55.325382+0000","last_became_active":"2024-09-12T17:29:54.957047+0000","last_became_peered":"2024-09-12T17:29:54.957047+0000","last_unstale":"2024-09-12T18:05:55.325382+0000","last_undegraded":"2024-09-12T18:05:55.325382+0000","last_fullsized":"2024-09-12T18:05:55.325382+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:17.894082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":598,"num_write":253,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'208","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:30.640024+0000","last_change":"2024-09-12T17:29:52.954589+0000","last_active":"2024-09-12T18:07:30.640024+0000","last_peered":"2024-09-12T18:07:30.640024+0000","last_clean":"2024-09-12T18:07:30.640024+0000","last_became_active":"2024-09-12T17:29:52.954249+0000","last_became_peered":"2024-09-12T17:29:52.954249+0000","last_unstale":"2024-09-12T18:07:30.640024+0000","last_undegraded":"2024-09-12T18:07:30.640024+0000","last_fullsized":"2024-09-12T18:07:30.640024+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:36.461295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16377941,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":492,"num_read_kb":62367,"num_write":1035,"num_write_kb":21747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'277","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:58.408944+0000","last_change":"2024-09-12T17:29:54.959793+0000","last_active":"2024-09-12T18:05:58.408944+0000","last_peered":"2024-09-12T18:05:58.408944+0000","last_clean":"2024-09-12T18:05:58.408944+0000","last_became_active":"2024-09-12T17:29:54.959503+0000","last_became_peered":"2024-09-12T17:29:54.959503+0000","last_unstale":"2024-09-12T18:05:58.408944+0000","last_undegraded":"2024-09-12T18:05:58.408944+0000","last_fullsized":"2024-09-12T18:05:58.408944+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:15.895941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1203,"num_read_kb":968,"num_write":436,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'249","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:05.733364+0000","last_change":"2024-09-12T17:29:52.957963+0000","last_active":"2024-09-12T18:06:05.733364+0000","last_peered":"2024-09-12T18:06:05.733364+0000","last_clean":"2024-09-12T18:06:05.733364+0000","last_became_active":"2024-09-12T17:29:52.957594+0000","last_became_peered":"2024-09-12T17:29:52.957594+0000","last_unstale":"2024-09-12T18:06:05.733364+0000","last_undegraded":"2024-09-12T18:06:05.733364+0000","last_fullsized":"2024-09-12T18:06:05.733364+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:50.942076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5844893,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":697,"num_read_kb":82538,"num_write":1030,"num_write_kb":35611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'90","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.508667+0000","last_change":"2024-09-12T17:29:54.955262+0000","last_active":"2024-09-12T18:05:53.508667+0000","last_peered":"2024-09-12T18:05:53.508667+0000","last_clean":"2024-09-12T18:05:53.508667+0000","last_became_active":"2024-09-12T17:29:54.954764+0000","last_became_peered":"2024-09-12T17:29:54.954764+0000","last_unstale":"2024-09-12T18:05:53.508667+0000","last_undegraded":"2024-09-12T18:05:53.508667+0000","last_fullsized":"2024-09-12T18:05:53.508667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:12.643057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":371,"num_write":125,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'203","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.209592+0000","last_change":"2024-09-12T17:29:52.957193+0000","last_active":"2024-09-12T18:05:56.209592+0000","last_peered":"2024-09-12T18:05:56.209592+0000","last_clean":"2024-09-12T18:05:56.209592+0000","last_became_active":"2024-09-12T17:29:52.956816+0000","last_became_peered":"2024-09-12T17:29:52.956816+0000","last_unstale":"2024-09-12T18:05:56.209592+0000","last_undegraded":"2024-09-12T18:05:56.209592+0000","last_fullsized":"2024-09-12T18:05:56.209592+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:23.693578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16094916,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":502,"num_read_kb":70330,"num_write":992,"num_write_kb":42186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4089","reported_seq":4667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.194774+0000","last_change":"2024-09-12T17:29:54.945238+0000","last_active":"2024-09-12T18:05:26.194774+0000","last_peered":"2024-09-12T18:05:26.194774+0000","last_clean":"2024-09-12T18:05:26.194774+0000","last_became_active":"2024-09-12T17:29:54.944959+0000","last_became_peered":"2024-09-12T17:29:54.944959+0000","last_unstale":"2024-09-12T18:05:26.194774+0000","last_undegraded":"2024-09-12T18:05:26.194774+0000","last_fullsized":"2024-09-12T18:05:26.194774+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":3000,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:46.528319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16426,"num_read_kb":13705,"num_write":6135,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'161","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.680867+0000","last_change":"2024-09-12T17:29:52.961055+0000","last_active":"2024-09-12T18:04:54.680867+0000","last_peered":"2024-09-12T18:04:54.680867+0000","last_clean":"2024-09-12T18:04:54.680867+0000","last_became_active":"2024-09-12T17:29:52.960666+0000","last_became_peered":"2024-09-12T17:29:52.960666+0000","last_unstale":"2024-09-12T18:04:54.680867+0000","last_undegraded":"2024-09-12T18:04:54.680867+0000","last_fullsized":"2024-09-12T18:04:54.680867+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:19.974025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23698,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":498,"num_read_kb":127585,"num_write":824,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'125","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.071213+0000","last_change":"2024-09-12T17:29:54.955474+0000","last_active":"2024-09-12T18:05:52.071213+0000","last_peered":"2024-09-12T18:05:52.071213+0000","last_clean":"2024-09-12T18:05:52.071213+0000","last_became_active":"2024-09-12T17:29:54.955205+0000","last_became_peered":"2024-09-12T17:29:54.955205+0000","last_unstale":"2024-09-12T18:05:52.071213+0000","last_undegraded":"2024-09-12T18:05:52.071213+0000","last_fullsized":"2024-09-12T18:05:52.071213+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:25.759255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":437,"num_write":181,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'213","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:21.850266+0000","last_change":"2024-09-12T17:29:52.960833+0000","last_active":"2024-09-12T18:05:21.850266+0000","last_peered":"2024-09-12T18:05:21.850266+0000","last_clean":"2024-09-12T18:05:21.850266+0000","last_became_active":"2024-09-12T17:29:52.955926+0000","last_became_peered":"2024-09-12T17:29:52.955926+0000","last_unstale":"2024-09-12T18:05:21.850266+0000","last_undegraded":"2024-09-12T18:05:21.850266+0000","last_fullsized":"2024-09-12T18:05:21.850266+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:53.948085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609549,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":499,"num_read_kb":5634,"num_write":1055,"num_write_kb":27185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'203","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.854752+0000","last_change":"2024-09-12T17:29:54.955413+0000","last_active":"2024-09-12T18:06:20.854752+0000","last_peered":"2024-09-12T18:06:20.854752+0000","last_clean":"2024-09-12T18:06:20.854752+0000","last_became_active":"2024-09-12T17:29:54.955119+0000","last_became_peered":"2024-09-12T17:29:54.955119+0000","last_unstale":"2024-09-12T18:06:20.854752+0000","last_undegraded":"2024-09-12T18:06:20.854752+0000","last_fullsized":"2024-09-12T18:06:20.854752+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:34.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":872,"num_read_kb":697,"num_write":351,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'193","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:24.702189+0000","last_change":"2024-09-12T17:29:52.962572+0000","last_active":"2024-09-12T18:07:24.702189+0000","last_peered":"2024-09-12T18:07:24.702189+0000","last_clean":"2024-09-12T18:07:24.702189+0000","last_became_active":"2024-09-12T17:29:52.962236+0000","last_became_peered":"2024-09-12T17:29:52.962236+0000","last_unstale":"2024-09-12T18:07:24.702189+0000","last_undegraded":"2024-09-12T18:07:24.702189+0000","last_fullsized":"2024-09-12T18:07:24.702189+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3350960,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":5167,"num_write":1011,"num_write_kb":25714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'272","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:18.420389+0000","last_change":"2024-09-12T17:29:54.963988+0000","last_active":"2024-09-12T18:06:18.420389+0000","last_peered":"2024-09-12T18:06:18.420389+0000","last_clean":"2024-09-12T18:06:18.420389+0000","last_became_active":"2024-09-12T17:29:54.963665+0000","last_became_peered":"2024-09-12T17:29:54.963665+0000","last_unstale":"2024-09-12T18:06:18.420389+0000","last_undegraded":"2024-09-12T18:06:18.420389+0000","last_fullsized":"2024-09-12T18:06:18.420389+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:56.293772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1246,"num_read_kb":1040,"num_write":431,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'225","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.912375+0000","last_change":"2024-09-12T17:29:52.956163+0000","last_active":"2024-09-12T18:06:01.912375+0000","last_peered":"2024-09-12T18:06:01.912375+0000","last_clean":"2024-09-12T18:06:01.912375+0000","last_became_active":"2024-09-12T17:29:52.955333+0000","last_became_peered":"2024-09-12T17:29:52.955333+0000","last_unstale":"2024-09-12T18:06:01.912375+0000","last_undegraded":"2024-09-12T18:06:01.912375+0000","last_fullsized":"2024-09-12T18:06:01.912375+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:31.003485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804154,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":522,"num_read_kb":94260,"num_write":1112,"num_write_kb":40355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'158","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.172360+0000","last_change":"2024-09-12T17:29:54.952797+0000","last_active":"2024-09-12T18:06:07.172360+0000","last_peered":"2024-09-12T18:06:07.172360+0000","last_clean":"2024-09-12T18:06:07.172360+0000","last_became_active":"2024-09-12T17:29:54.952536+0000","last_became_peered":"2024-09-12T17:29:54.952536+0000","last_unstale":"2024-09-12T18:06:07.172360+0000","last_undegraded":"2024-09-12T18:06:07.172360+0000","last_fullsized":"2024-09-12T18:06:07.172360+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:50.999631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":604,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'401","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.229784+0000","last_change":"2024-09-12T17:29:54.955472+0000","last_active":"2024-09-12T18:05:52.229784+0000","last_peered":"2024-09-12T18:05:52.229784+0000","last_clean":"2024-09-12T18:05:52.229784+0000","last_became_active":"2024-09-12T17:29:54.954401+0000","last_became_peered":"2024-09-12T17:29:54.954401+0000","last_unstale":"2024-09-12T18:05:52.229784+0000","last_undegraded":"2024-09-12T18:05:52.229784+0000","last_fullsized":"2024-09-12T18:05:52.229784+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:16.926597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1720,"num_read_kb":1358,"num_write":655,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'181","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:41.511352+0000","last_change":"2024-09-12T17:29:52.958556+0000","last_active":"2024-09-12T18:05:41.511352+0000","last_peered":"2024-09-12T18:05:41.511352+0000","last_clean":"2024-09-12T18:05:41.511352+0000","last_became_active":"2024-09-12T17:29:52.957715+0000","last_became_peered":"2024-09-12T17:29:52.957715+0000","last_unstale":"2024-09-12T18:05:41.511352+0000","last_undegraded":"2024-09-12T18:05:41.511352+0000","last_fullsized":"2024-09-12T18:05:41.511352+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:48.046592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2064,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":321,"num_read_kb":380,"num_write":907,"num_write_kb":20925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'91","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.680830+0000","last_change":"2024-09-12T17:29:54.960764+0000","last_active":"2024-09-12T18:04:54.680830+0000","last_peered":"2024-09-12T18:04:54.680830+0000","last_clean":"2024-09-12T18:04:54.680830+0000","last_became_active":"2024-09-12T17:29:54.960430+0000","last_became_peered":"2024-09-12T17:29:54.960430+0000","last_unstale":"2024-09-12T18:04:54.680830+0000","last_undegraded":"2024-09-12T18:04:54.680830+0000","last_fullsized":"2024-09-12T18:04:54.680830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:51.078408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":446,"num_read_kb":372,"num_write":151,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'239","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.298482+0000","last_change":"2024-09-12T17:29:52.961437+0000","last_active":"2024-09-12T18:06:19.298482+0000","last_peered":"2024-09-12T18:06:19.298482+0000","last_clean":"2024-09-12T18:06:19.298482+0000","last_became_active":"2024-09-12T17:29:52.960770+0000","last_became_peered":"2024-09-12T17:29:52.960770+0000","last_unstale":"2024-09-12T18:06:19.298482+0000","last_undegraded":"2024-09-12T18:06:19.298482+0000","last_fullsized":"2024-09-12T18:06:19.298482+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:52.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16858859,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":819,"num_read_kb":13405,"num_write":1109,"num_write_kb":28936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'257","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.245805+0000","last_change":"2024-09-12T17:29:54.963348+0000","last_active":"2024-09-12T18:06:21.245805+0000","last_peered":"2024-09-12T18:06:21.245805+0000","last_clean":"2024-09-12T18:06:21.245805+0000","last_became_active":"2024-09-12T17:29:54.962822+0000","last_became_peered":"2024-09-12T17:29:54.962822+0000","last_unstale":"2024-09-12T18:06:21.245805+0000","last_undegraded":"2024-09-12T18:06:21.245805+0000","last_fullsized":"2024-09-12T18:06:21.245805+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:14.125505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1220,"num_read_kb":1023,"num_write":434,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'204","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.559749+0000","last_change":"2024-09-12T17:29:52.956896+0000","last_active":"2024-09-12T18:06:07.559749+0000","last_peered":"2024-09-12T18:06:07.559749+0000","last_clean":"2024-09-12T18:06:07.559749+0000","last_became_active":"2024-09-12T17:29:52.956432+0000","last_became_peered":"2024-09-12T17:29:52.956432+0000","last_unstale":"2024-09-12T18:06:07.559749+0000","last_undegraded":"2024-09-12T18:06:07.559749+0000","last_fullsized":"2024-09-12T18:06:07.559749+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:34.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11441510,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":42949,"num_write":1039,"num_write_kb":37671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'84","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.247939+0000","last_change":"2024-09-12T17:29:54.944847+0000","last_active":"2024-09-12T18:05:24.247939+0000","last_peered":"2024-09-12T18:05:24.247939+0000","last_clean":"2024-09-12T18:05:24.247939+0000","last_became_active":"2024-09-12T17:29:54.944588+0000","last_became_peered":"2024-09-12T17:29:54.944588+0000","last_unstale":"2024-09-12T18:05:24.247939+0000","last_undegraded":"2024-09-12T18:05:24.247939+0000","last_fullsized":"2024-09-12T18:05:24.247939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:15.044680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":342,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'223","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.832826+0000","last_change":"2024-09-12T17:29:52.963156+0000","last_active":"2024-09-12T18:05:26.832826+0000","last_peered":"2024-09-12T18:05:26.832826+0000","last_clean":"2024-09-12T18:05:26.832826+0000","last_became_active":"2024-09-12T17:29:52.962814+0000","last_became_peered":"2024-09-12T17:29:52.962814+0000","last_unstale":"2024-09-12T18:05:26.832826+0000","last_undegraded":"2024-09-12T18:05:26.832826+0000","last_fullsized":"2024-09-12T18:05:26.832826+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:05.435586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10837622,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":48243,"num_write":1121,"num_write_kb":37209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'125","reported_seq":719,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:18.231406+0000","last_change":"2024-09-12T17:29:54.957275+0000","last_active":"2024-09-12T18:05:18.231406+0000","last_peered":"2024-09-12T18:05:18.231406+0000","last_clean":"2024-09-12T18:05:18.231406+0000","last_became_active":"2024-09-12T17:29:54.956975+0000","last_became_peered":"2024-09-12T17:29:54.956975+0000","last_unstale":"2024-09-12T18:05:18.231406+0000","last_undegraded":"2024-09-12T18:05:18.231406+0000","last_fullsized":"2024-09-12T18:05:18.231406+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:35.436729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":592,"num_read_kb":498,"num_write":187,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'254","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.651610+0000","last_change":"2024-09-12T17:29:52.954983+0000","last_active":"2024-09-12T18:05:30.651610+0000","last_peered":"2024-09-12T18:05:30.651610+0000","last_clean":"2024-09-12T18:05:30.651610+0000","last_became_active":"2024-09-12T17:29:52.954630+0000","last_became_peered":"2024-09-12T17:29:52.954630+0000","last_unstale":"2024-09-12T18:05:30.651610+0000","last_undegraded":"2024-09-12T18:05:30.651610+0000","last_fullsized":"2024-09-12T18:05:30.651610+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:32.291580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15348488,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":833,"num_read_kb":67261,"num_write":1121,"num_write_kb":48740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'283","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.230047+0000","last_change":"2024-09-12T17:29:54.959334+0000","last_active":"2024-09-12T18:05:30.230047+0000","last_peered":"2024-09-12T18:05:30.230047+0000","last_clean":"2024-09-12T18:05:30.230047+0000","last_became_active":"2024-09-12T17:29:54.958852+0000","last_became_peered":"2024-09-12T17:29:54.958852+0000","last_unstale":"2024-09-12T18:05:30.230047+0000","last_undegraded":"2024-09-12T18:05:30.230047+0000","last_fullsized":"2024-09-12T18:05:30.230047+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:21.982711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1254,"num_read_kb":1035,"num_write":436,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'169","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:17.890071+0000","last_change":"2024-09-12T17:29:52.959483+0000","last_active":"2024-09-12T18:05:17.890071+0000","last_peered":"2024-09-12T18:05:17.890071+0000","last_clean":"2024-09-12T18:05:17.890071+0000","last_became_active":"2024-09-12T17:29:52.959175+0000","last_became_peered":"2024-09-12T17:29:52.959175+0000","last_unstale":"2024-09-12T18:05:17.890071+0000","last_undegraded":"2024-09-12T18:05:17.890071+0000","last_fullsized":"2024-09-12T18:05:17.890071+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:39.671271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242932,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":327,"num_read_kb":1243,"num_write":850,"num_write_kb":36341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'154","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.297485+0000","last_change":"2024-09-12T17:30:02.964799+0000","last_active":"2024-09-12T18:06:21.297485+0000","last_peered":"2024-09-12T18:06:21.297485+0000","last_clean":"2024-09-12T18:06:21.297485+0000","last_became_active":"2024-09-12T17:30:02.964492+0000","last_became_peered":"2024-09-12T17:30:02.964492+0000","last_unstale":"2024-09-12T18:06:21.297485+0000","last_undegraded":"2024-09-12T18:06:21.297485+0000","last_fullsized":"2024-09-12T18:06:21.297485+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:49.837441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":218,"num_read_kb":205,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'110","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.335050+0000","last_change":"2024-09-12T17:29:54.951914+0000","last_active":"2024-09-12T18:05:59.335050+0000","last_peered":"2024-09-12T18:05:59.335050+0000","last_clean":"2024-09-12T18:05:59.335050+0000","last_became_active":"2024-09-12T17:29:54.950633+0000","last_became_peered":"2024-09-12T17:29:54.950633+0000","last_unstale":"2024-09-12T18:05:59.335050+0000","last_undegraded":"2024-09-12T18:05:59.335050+0000","last_fullsized":"2024-09-12T18:05:59.335050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:07.589708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":400,"num_write":147,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'196","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.159300+0000","last_change":"2024-09-12T17:30:28.007547+0000","last_active":"2024-09-12T18:05:59.159300+0000","last_peered":"2024-09-12T18:05:59.159300+0000","last_clean":"2024-09-12T18:05:59.159300+0000","last_became_active":"2024-09-12T17:30:28.007183+0000","last_became_peered":"2024-09-12T17:30:28.007183+0000","last_unstale":"2024-09-12T18:05:59.159300+0000","last_undegraded":"2024-09-12T18:05:59.159300+0000","last_fullsized":"2024-09-12T18:05:59.159300+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:49.159102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":968005,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":913,"num_read_kb":19617,"num_write":946,"num_write_kb":33635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.600586+0000","last_change":"2024-09-12T17:29:56.954842+0000","last_active":"2024-09-12T18:07:38.600586+0000","last_peered":"2024-09-12T18:07:38.600586+0000","last_clean":"2024-09-12T18:07:38.600586+0000","last_became_active":"2024-09-12T17:29:56.954488+0000","last_became_peered":"2024-09-12T17:29:56.954488+0000","last_unstale":"2024-09-12T18:07:38.600586+0000","last_undegraded":"2024-09-12T18:07:38.600586+0000","last_fullsized":"2024-09-12T18:07:38.600586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:16.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":721,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'174","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.654293+0000","last_change":"2024-09-12T17:29:58.957203+0000","last_active":"2024-09-12T18:06:14.654293+0000","last_peered":"2024-09-12T18:06:14.654293+0000","last_clean":"2024-09-12T18:06:14.654293+0000","last_became_active":"2024-09-12T17:29:58.956916+0000","last_became_peered":"2024-09-12T17:29:58.956916+0000","last_unstale":"2024-09-12T18:06:14.654293+0000","last_undegraded":"2024-09-12T18:06:14.654293+0000","last_fullsized":"2024-09-12T18:06:14.654293+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:23.529305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5073,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":227,"num_read_kb":264,"num_write":128,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.671162+0000","last_change":"2024-09-12T17:30:00.960720+0000","last_active":"2024-09-12T18:03:54.671162+0000","last_peered":"2024-09-12T18:03:54.671162+0000","last_clean":"2024-09-12T18:03:54.671162+0000","last_became_active":"2024-09-12T17:30:00.960409+0000","last_became_peered":"2024-09-12T17:30:00.960409+0000","last_unstale":"2024-09-12T18:03:54.671162+0000","last_undegraded":"2024-09-12T18:03:54.671162+0000","last_fullsized":"2024-09-12T18:03:54.671162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:36.986925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2442","reported_seq":4366,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.852848+0000","last_change":"2024-09-12T17:30:02.968528+0000","last_active":"2024-09-12T18:06:20.852848+0000","last_peered":"2024-09-12T18:06:20.852848+0000","last_clean":"2024-09-12T18:06:20.852848+0000","last_became_active":"2024-09-12T17:30:02.967718+0000","last_became_peered":"2024-09-12T17:30:02.967718+0000","last_unstale":"2024-09-12T18:06:20.852848+0000","last_undegraded":"2024-09-12T18:06:20.852848+0000","last_fullsized":"2024-09-12T18:06:20.852848+0000","mapping_epoch":34,"log_start":"264'2400","ondisk_log_start":"264'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":2400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:40.278625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1044,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6319,"num_read_kb":6274,"num_write":4873,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'136","reported_seq":718,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.219639+0000","last_change":"2024-09-12T17:29:54.958156+0000","last_active":"2024-09-12T18:05:53.219639+0000","last_peered":"2024-09-12T18:05:53.219639+0000","last_clean":"2024-09-12T18:05:53.219639+0000","last_became_active":"2024-09-12T17:29:54.957747+0000","last_became_peered":"2024-09-12T17:29:54.957747+0000","last_unstale":"2024-09-12T18:05:53.219639+0000","last_undegraded":"2024-09-12T18:05:53.219639+0000","last_fullsized":"2024-09-12T18:05:53.219639+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:45.769420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":552,"num_write":215,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'209","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.315455+0000","last_change":"2024-09-12T17:29:52.950951+0000","last_active":"2024-09-12T18:05:20.315455+0000","last_peered":"2024-09-12T18:05:20.315455+0000","last_clean":"2024-09-12T18:05:20.315455+0000","last_became_active":"2024-09-12T17:29:52.950612+0000","last_became_peered":"2024-09-12T17:29:52.950612+0000","last_unstale":"2024-09-12T18:05:20.315455+0000","last_undegraded":"2024-09-12T18:05:20.315455+0000","last_fullsized":"2024-09-12T18:05:20.315455+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:09.873785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44593,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":10994,"num_write":1023,"num_write_kb":32732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.528200+0000","last_change":"2024-09-12T17:29:56.953819+0000","last_active":"2024-09-12T18:05:09.528200+0000","last_peered":"2024-09-12T18:05:09.528200+0000","last_clean":"2024-09-12T18:05:09.528200+0000","last_became_active":"2024-09-12T17:29:56.953546+0000","last_became_peered":"2024-09-12T17:29:56.953546+0000","last_unstale":"2024-09-12T18:05:09.528200+0000","last_undegraded":"2024-09-12T18:05:09.528200+0000","last_fullsized":"2024-09-12T18:05:09.528200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:02.063377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'85","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.814472+0000","last_change":"2024-09-12T17:29:58.951397+0000","last_active":"2024-09-12T18:05:55.814472+0000","last_peered":"2024-09-12T18:05:55.814472+0000","last_clean":"2024-09-12T18:05:55.814472+0000","last_became_active":"2024-09-12T17:29:58.951077+0000","last_became_peered":"2024-09-12T17:29:58.951077+0000","last_unstale":"2024-09-12T18:05:55.814472+0000","last_undegraded":"2024-09-12T18:05:55.814472+0000","last_fullsized":"2024-09-12T18:05:55.814472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:32.229853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.505635+0000","last_change":"2024-09-12T17:30:00.969561+0000","last_active":"2024-09-12T18:03:54.505635+0000","last_peered":"2024-09-12T18:03:54.505635+0000","last_clean":"2024-09-12T18:03:54.505635+0000","last_became_active":"2024-09-12T17:30:00.969291+0000","last_became_peered":"2024-09-12T17:30:00.969291+0000","last_unstale":"2024-09-12T18:03:54.505635+0000","last_undegraded":"2024-09-12T18:03:54.505635+0000","last_fullsized":"2024-09-12T18:03:54.505635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:59.191519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'123","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:03.288660+0000","last_change":"2024-09-12T17:30:02.972169+0000","last_active":"2024-09-12T18:06:03.288660+0000","last_peered":"2024-09-12T18:06:03.288660+0000","last_clean":"2024-09-12T18:06:03.288660+0000","last_became_active":"2024-09-12T17:30:02.971843+0000","last_became_peered":"2024-09-12T17:30:02.971843+0000","last_unstale":"2024-09-12T18:06:03.288660+0000","last_undegraded":"2024-09-12T18:06:03.288660+0000","last_fullsized":"2024-09-12T18:06:03.288660+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:27.791607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'129","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.234318+0000","last_change":"2024-09-12T17:29:54.945375+0000","last_active":"2024-09-12T18:06:00.234318+0000","last_peered":"2024-09-12T18:06:00.234318+0000","last_clean":"2024-09-12T18:06:00.234318+0000","last_became_active":"2024-09-12T17:29:54.944698+0000","last_became_peered":"2024-09-12T17:29:54.944698+0000","last_unstale":"2024-09-12T18:06:00.234318+0000","last_undegraded":"2024-09-12T18:06:00.234318+0000","last_fullsized":"2024-09-12T18:06:00.234318+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:02.736469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":422,"num_write":199,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'176","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:05.291120+0000","last_change":"2024-09-12T17:29:52.963403+0000","last_active":"2024-09-12T18:06:05.291120+0000","last_peered":"2024-09-12T18:06:05.291120+0000","last_clean":"2024-09-12T18:06:05.291120+0000","last_became_active":"2024-09-12T17:29:52.963087+0000","last_became_peered":"2024-09-12T17:29:52.963087+0000","last_unstale":"2024-09-12T18:06:05.291120+0000","last_undegraded":"2024-09-12T18:06:05.291120+0000","last_fullsized":"2024-09-12T18:06:05.291120+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:31.829205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10614291,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":3190,"num_write":915,"num_write_kb":30863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.515779+0000","last_change":"2024-09-12T17:29:56.953137+0000","last_active":"2024-09-12T18:03:49.515779+0000","last_peered":"2024-09-12T18:03:49.515779+0000","last_clean":"2024-09-12T18:03:49.515779+0000","last_became_active":"2024-09-12T17:29:56.952827+0000","last_became_peered":"2024-09-12T17:29:56.952827+0000","last_unstale":"2024-09-12T18:03:49.515779+0000","last_undegraded":"2024-09-12T18:03:49.515779+0000","last_fullsized":"2024-09-12T18:03:49.515779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:28.816718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'97","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.555493+0000","last_change":"2024-09-12T17:29:58.952475+0000","last_active":"2024-09-12T18:05:29.555493+0000","last_peered":"2024-09-12T18:05:29.555493+0000","last_clean":"2024-09-12T18:05:29.555493+0000","last_became_active":"2024-09-12T17:29:58.952169+0000","last_became_peered":"2024-09-12T17:29:58.952169+0000","last_unstale":"2024-09-12T18:05:29.555493+0000","last_undegraded":"2024-09-12T18:05:29.555493+0000","last_fullsized":"2024-09-12T18:05:29.555493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:14.255681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":103,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'751","reported_seq":2401,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.686944+0000","last_change":"2024-09-12T17:30:00.954478+0000","last_active":"2024-09-12T18:07:38.686944+0000","last_peered":"2024-09-12T18:07:38.686944+0000","last_clean":"2024-09-12T18:07:38.686944+0000","last_became_active":"2024-09-12T17:30:00.954180+0000","last_became_peered":"2024-09-12T17:30:00.954180+0000","last_unstale":"2024-09-12T18:07:38.686944+0000","last_undegraded":"2024-09-12T18:07:38.686944+0000","last_fullsized":"2024-09-12T18:07:38.686944+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:51.847365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'180","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.347847+0000","last_change":"2024-09-12T17:30:02.962486+0000","last_active":"2024-09-12T18:06:21.347847+0000","last_peered":"2024-09-12T18:06:21.347847+0000","last_clean":"2024-09-12T18:06:21.347847+0000","last_became_active":"2024-09-12T17:30:02.961198+0000","last_became_peered":"2024-09-12T17:30:02.961198+0000","last_unstale":"2024-09-12T18:06:21.347847+0000","last_undegraded":"2024-09-12T18:06:21.347847+0000","last_fullsized":"2024-09-12T18:06:21.347847+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:59.034236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":624,"num_write":393,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'95","reported_seq":671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.293469+0000","last_change":"2024-09-12T17:29:54.956913+0000","last_active":"2024-09-12T18:06:06.293469+0000","last_peered":"2024-09-12T18:06:06.293469+0000","last_clean":"2024-09-12T18:06:06.293469+0000","last_became_active":"2024-09-12T17:29:54.956663+0000","last_became_peered":"2024-09-12T17:29:54.956663+0000","last_unstale":"2024-09-12T18:06:06.293469+0000","last_undegraded":"2024-09-12T18:06:06.293469+0000","last_fullsized":"2024-09-12T18:06:06.293469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:29.330762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":356,"num_write":140,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'158","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.735808+0000","last_change":"2024-09-12T17:29:52.963393+0000","last_active":"2024-09-12T18:05:56.735808+0000","last_peered":"2024-09-12T18:05:56.735808+0000","last_clean":"2024-09-12T18:05:56.735808+0000","last_became_active":"2024-09-12T17:29:52.962665+0000","last_became_peered":"2024-09-12T17:29:52.962665+0000","last_unstale":"2024-09-12T18:05:56.735808+0000","last_undegraded":"2024-09-12T18:05:56.735808+0000","last_fullsized":"2024-09-12T18:05:56.735808+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:43.499509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17855108,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":345,"num_read_kb":5731,"num_write":807,"num_write_kb":29128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.627887+0000","last_change":"2024-09-12T17:29:56.953011+0000","last_active":"2024-09-12T18:03:49.627887+0000","last_peered":"2024-09-12T18:03:49.627887+0000","last_clean":"2024-09-12T18:03:49.627887+0000","last_became_active":"2024-09-12T17:29:56.952625+0000","last_became_peered":"2024-09-12T17:29:56.952625+0000","last_unstale":"2024-09-12T18:03:49.627887+0000","last_undegraded":"2024-09-12T18:03:49.627887+0000","last_fullsized":"2024-09-12T18:03:49.627887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:37.754261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'101","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.692414+0000","last_change":"2024-09-12T17:29:58.978681+0000","last_active":"2024-09-12T18:06:14.692414+0000","last_peered":"2024-09-12T18:06:14.692414+0000","last_clean":"2024-09-12T18:06:14.692414+0000","last_became_active":"2024-09-12T17:29:58.978299+0000","last_became_peered":"2024-09-12T17:29:58.978299+0000","last_unstale":"2024-09-12T18:06:14.692414+0000","last_undegraded":"2024-09-12T18:06:14.692414+0000","last_fullsized":"2024-09-12T18:06:14.692414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:51.821063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4431,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":58,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'772","reported_seq":3915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.691525+0000","last_change":"2024-09-12T17:30:00.963021+0000","last_active":"2024-09-12T18:07:38.691525+0000","last_peered":"2024-09-12T18:07:38.691525+0000","last_clean":"2024-09-12T18:07:38.691525+0000","last_became_active":"2024-09-12T17:30:00.962754+0000","last_became_peered":"2024-09-12T17:30:00.962754+0000","last_unstale":"2024-09-12T18:07:38.691525+0000","last_undegraded":"2024-09-12T18:07:38.691525+0000","last_fullsized":"2024-09-12T18:07:38.691525+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:34.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'251","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.889819+0000","last_change":"2024-09-12T17:29:54.957456+0000","last_active":"2024-09-12T18:06:00.889819+0000","last_peered":"2024-09-12T18:06:00.889819+0000","last_clean":"2024-09-12T18:06:00.889819+0000","last_became_active":"2024-09-12T17:29:54.957148+0000","last_became_peered":"2024-09-12T17:29:54.957148+0000","last_unstale":"2024-09-12T18:06:00.889819+0000","last_undegraded":"2024-09-12T18:06:00.889819+0000","last_fullsized":"2024-09-12T18:06:00.889819+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:19.628837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":968,"num_write":398,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'233","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:51.286563+0000","last_change":"2024-09-12T17:29:52.964771+0000","last_active":"2024-09-12T18:05:51.286563+0000","last_peered":"2024-09-12T18:05:51.286563+0000","last_clean":"2024-09-12T18:05:51.286563+0000","last_became_active":"2024-09-12T17:29:52.964421+0000","last_became_peered":"2024-09-12T17:29:52.964421+0000","last_unstale":"2024-09-12T18:05:51.286563+0000","last_undegraded":"2024-09-12T18:05:51.286563+0000","last_fullsized":"2024-09-12T18:05:51.286563+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:13.642050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6103136,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":5176,"num_write":1040,"num_write_kb":56179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.678374+0000","last_change":"2024-09-12T17:29:56.953482+0000","last_active":"2024-09-12T18:04:39.678374+0000","last_peered":"2024-09-12T18:04:39.678374+0000","last_clean":"2024-09-12T18:04:39.678374+0000","last_became_active":"2024-09-12T17:29:56.953204+0000","last_became_peered":"2024-09-12T17:29:56.953204+0000","last_unstale":"2024-09-12T18:04:39.678374+0000","last_undegraded":"2024-09-12T18:04:39.678374+0000","last_fullsized":"2024-09-12T18:04:39.678374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:49.409852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'177","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:54.655776+0000","last_change":"2024-09-12T17:29:58.979003+0000","last_active":"2024-09-12T18:06:54.655776+0000","last_peered":"2024-09-12T18:06:54.655776+0000","last_clean":"2024-09-12T18:06:54.655776+0000","last_became_active":"2024-09-12T17:29:58.978213+0000","last_became_peered":"2024-09-12T17:29:58.978213+0000","last_unstale":"2024-09-12T18:06:54.655776+0000","last_undegraded":"2024-09-12T18:06:54.655776+0000","last_fullsized":"2024-09-12T18:06:54.655776+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:29.055630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11558,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":242,"num_read_kb":287,"num_write":136,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.632793+0000","last_change":"2024-09-12T17:30:00.959136+0000","last_active":"2024-09-12T18:03:49.632793+0000","last_peered":"2024-09-12T18:03:49.632793+0000","last_clean":"2024-09-12T18:03:49.632793+0000","last_became_active":"2024-09-12T17:30:00.958723+0000","last_became_peered":"2024-09-12T17:30:00.958723+0000","last_unstale":"2024-09-12T18:03:49.632793+0000","last_undegraded":"2024-09-12T18:03:49.632793+0000","last_fullsized":"2024-09-12T18:03:49.632793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:07.523774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'549","reported_seq":1353,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.673110+0000","last_change":"2024-09-12T17:30:02.968872+0000","last_active":"2024-09-12T18:07:38.673110+0000","last_peered":"2024-09-12T18:07:38.673110+0000","last_clean":"2024-09-12T18:07:38.673110+0000","last_became_active":"2024-09-12T17:30:02.968515+0000","last_became_peered":"2024-09-12T17:30:02.968515+0000","last_unstale":"2024-09-12T18:07:38.673110+0000","last_undegraded":"2024-09-12T18:07:38.673110+0000","last_fullsized":"2024-09-12T18:07:38.673110+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:33.814672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1325,"num_read_kb":1316,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'153","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.308857+0000","last_change":"2024-09-12T17:29:54.959404+0000","last_active":"2024-09-12T18:06:08.308857+0000","last_peered":"2024-09-12T18:06:08.308857+0000","last_clean":"2024-09-12T18:06:08.308857+0000","last_became_active":"2024-09-12T17:29:54.959140+0000","last_became_peered":"2024-09-12T17:29:54.959140+0000","last_unstale":"2024-09-12T18:06:08.308857+0000","last_undegraded":"2024-09-12T18:06:08.308857+0000","last_fullsized":"2024-09-12T18:06:08.308857+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:46.796125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":582,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'173","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.234904+0000","last_change":"2024-09-12T17:29:52.964678+0000","last_active":"2024-09-12T18:05:29.234904+0000","last_peered":"2024-09-12T18:05:29.234904+0000","last_clean":"2024-09-12T18:05:29.234904+0000","last_became_active":"2024-09-12T17:29:52.964339+0000","last_became_peered":"2024-09-12T17:29:52.964339+0000","last_unstale":"2024-09-12T18:05:29.234904+0000","last_undegraded":"2024-09-12T18:05:29.234904+0000","last_fullsized":"2024-09-12T18:05:29.234904+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:23.502950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4544464,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":377,"num_read_kb":1621,"num_write":862,"num_write_kb":10562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.638636+0000","last_change":"2024-09-12T17:29:56.954142+0000","last_active":"2024-09-12T18:04:39.638636+0000","last_peered":"2024-09-12T18:04:39.638636+0000","last_clean":"2024-09-12T18:04:39.638636+0000","last_became_active":"2024-09-12T17:29:56.953551+0000","last_became_peered":"2024-09-12T17:29:56.953551+0000","last_unstale":"2024-09-12T18:04:39.638636+0000","last_undegraded":"2024-09-12T18:04:39.638636+0000","last_fullsized":"2024-09-12T18:04:39.638636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:50.189739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'121","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.538665+0000","last_change":"2024-09-12T17:29:58.953621+0000","last_active":"2024-09-12T18:05:59.538665+0000","last_peered":"2024-09-12T18:05:59.538665+0000","last_clean":"2024-09-12T18:05:59.538665+0000","last_became_active":"2024-09-12T17:29:58.953107+0000","last_became_peered":"2024-09-12T17:29:58.953107+0000","last_unstale":"2024-09-12T18:05:59.538665+0000","last_undegraded":"2024-09-12T18:05:59.538665+0000","last_fullsized":"2024-09-12T18:05:59.538665+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:20.703344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11955,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":154,"num_read_kb":222,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.525616+0000","last_change":"2024-09-12T17:30:00.961851+0000","last_active":"2024-09-12T18:04:54.525616+0000","last_peered":"2024-09-12T18:04:54.525616+0000","last_clean":"2024-09-12T18:04:54.525616+0000","last_became_active":"2024-09-12T17:30:00.961545+0000","last_became_peered":"2024-09-12T17:30:00.961545+0000","last_unstale":"2024-09-12T18:04:54.525616+0000","last_undegraded":"2024-09-12T18:04:54.525616+0000","last_fullsized":"2024-09-12T18:04:54.525616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:46.146649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'85","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:28.622892+0000","last_change":"2024-09-12T17:30:02.967776+0000","last_active":"2024-09-12T18:07:28.622892+0000","last_peered":"2024-09-12T18:07:28.622892+0000","last_clean":"2024-09-12T18:07:28.622892+0000","last_became_active":"2024-09-12T17:30:02.967500+0000","last_became_peered":"2024-09-12T17:30:02.967500+0000","last_unstale":"2024-09-12T18:07:28.622892+0000","last_undegraded":"2024-09-12T18:07:28.622892+0000","last_fullsized":"2024-09-12T18:07:28.622892+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:21.856163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":199,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'67","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:28.210721+0000","last_change":"2024-09-12T17:29:54.960258+0000","last_active":"2024-09-12T18:05:28.210721+0000","last_peered":"2024-09-12T18:05:28.210721+0000","last_clean":"2024-09-12T18:05:28.210721+0000","last_became_active":"2024-09-12T17:29:54.959979+0000","last_became_peered":"2024-09-12T17:29:54.959979+0000","last_unstale":"2024-09-12T18:05:28.210721+0000","last_undegraded":"2024-09-12T18:05:28.210721+0000","last_fullsized":"2024-09-12T18:05:28.210721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:30.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":252,"num_write":105,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'335","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:41.731550+0000","last_change":"2024-09-12T17:29:52.957702+0000","last_active":"2024-09-12T18:05:41.731550+0000","last_peered":"2024-09-12T18:05:41.731550+0000","last_clean":"2024-09-12T18:05:41.731550+0000","last_became_active":"2024-09-12T17:29:52.957308+0000","last_became_peered":"2024-09-12T17:29:52.957308+0000","last_unstale":"2024-09-12T18:05:41.731550+0000","last_undegraded":"2024-09-12T18:05:41.731550+0000","last_fullsized":"2024-09-12T18:05:41.731550+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:52.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1994342,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":830,"num_read_kb":24052,"num_write":1266,"num_write_kb":42343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'4","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.599934+0000","last_change":"2024-09-12T17:29:56.959495+0000","last_active":"2024-09-12T18:07:38.599934+0000","last_peered":"2024-09-12T18:07:38.599934+0000","last_clean":"2024-09-12T18:07:38.599934+0000","last_became_active":"2024-09-12T17:29:56.959206+0000","last_became_peered":"2024-09-12T17:29:56.959206+0000","last_unstale":"2024-09-12T18:07:38.599934+0000","last_undegraded":"2024-09-12T18:07:38.599934+0000","last_fullsized":"2024-09-12T18:07:38.599934+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:54.257647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'154","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.770021+0000","last_change":"2024-09-12T17:29:58.956025+0000","last_active":"2024-09-12T18:07:37.770021+0000","last_peered":"2024-09-12T18:07:37.770021+0000","last_clean":"2024-09-12T18:07:37.770021+0000","last_became_active":"2024-09-12T17:29:58.955698+0000","last_became_peered":"2024-09-12T17:29:58.955698+0000","last_unstale":"2024-09-12T18:07:37.770021+0000","last_undegraded":"2024-09-12T18:07:37.770021+0000","last_fullsized":"2024-09-12T18:07:37.770021+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:21.001386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9820,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":188,"num_read_kb":244,"num_write":108,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'760","reported_seq":2323,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.692388+0000","last_change":"2024-09-12T17:30:00.967003+0000","last_active":"2024-09-12T18:07:38.692388+0000","last_peered":"2024-09-12T18:07:38.692388+0000","last_clean":"2024-09-12T18:07:38.692388+0000","last_became_active":"2024-09-12T17:30:00.966661+0000","last_became_peered":"2024-09-12T17:30:00.966661+0000","last_unstale":"2024-09-12T18:07:38.692388+0000","last_undegraded":"2024-09-12T18:07:38.692388+0000","last_fullsized":"2024-09-12T18:07:38.692388+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:57.546741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'107","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.730576+0000","last_change":"2024-09-12T17:30:02.970504+0000","last_active":"2024-09-12T18:07:37.730576+0000","last_peered":"2024-09-12T18:07:37.730576+0000","last_clean":"2024-09-12T18:07:37.730576+0000","last_became_active":"2024-09-12T17:30:02.969837+0000","last_became_peered":"2024-09-12T17:30:02.969837+0000","last_unstale":"2024-09-12T18:07:37.730576+0000","last_undegraded":"2024-09-12T18:07:37.730576+0000","last_fullsized":"2024-09-12T18:07:37.730576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:09.306140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":259,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'232","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.631061+0000","last_change":"2024-09-12T17:30:28.004554+0000","last_active":"2024-09-12T18:03:39.631061+0000","last_peered":"2024-09-12T18:03:39.631061+0000","last_clean":"2024-09-12T18:03:39.631061+0000","last_became_active":"2024-09-12T17:30:28.004234+0000","last_became_peered":"2024-09-12T17:30:28.004234+0000","last_unstale":"2024-09-12T18:03:39.631061+0000","last_undegraded":"2024-09-12T18:03:39.631061+0000","last_fullsized":"2024-09-12T18:03:39.631061+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:30.577975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":779,"num_write":354,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'201","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.300333+0000","last_change":"2024-09-12T17:29:52.952108+0000","last_active":"2024-09-12T18:06:19.300333+0000","last_peered":"2024-09-12T18:06:19.300333+0000","last_clean":"2024-09-12T18:06:19.300333+0000","last_became_active":"2024-09-12T17:29:52.951442+0000","last_became_peered":"2024-09-12T17:29:52.951442+0000","last_unstale":"2024-09-12T18:06:19.300333+0000","last_undegraded":"2024-09-12T18:06:19.300333+0000","last_fullsized":"2024-09-12T18:06:19.300333+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:21.862788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11973788,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":473,"num_read_kb":16166,"num_write":928,"num_write_kb":36148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639431+0000","last_change":"2024-09-12T17:29:56.956309+0000","last_active":"2024-09-12T18:04:44.639431+0000","last_peered":"2024-09-12T18:04:44.639431+0000","last_clean":"2024-09-12T18:04:44.639431+0000","last_became_active":"2024-09-12T17:29:56.955948+0000","last_became_peered":"2024-09-12T17:29:56.955948+0000","last_unstale":"2024-09-12T18:04:44.639431+0000","last_undegraded":"2024-09-12T18:04:44.639431+0000","last_fullsized":"2024-09-12T18:04:44.639431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:39.319625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'194","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.642522+0000","last_change":"2024-09-12T17:29:58.958169+0000","last_active":"2024-09-12T18:07:38.642522+0000","last_peered":"2024-09-12T18:07:38.642522+0000","last_clean":"2024-09-12T18:07:38.642522+0000","last_became_active":"2024-09-12T17:29:58.957183+0000","last_became_peered":"2024-09-12T17:29:58.957183+0000","last_unstale":"2024-09-12T18:07:38.642522+0000","last_undegraded":"2024-09-12T18:07:38.642522+0000","last_fullsized":"2024-09-12T18:07:38.642522+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:19.712371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18981,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":356,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639403+0000","last_change":"2024-09-12T17:30:00.958337+0000","last_active":"2024-09-12T18:04:44.639403+0000","last_peered":"2024-09-12T18:04:44.639403+0000","last_clean":"2024-09-12T18:04:44.639403+0000","last_became_active":"2024-09-12T17:30:00.958049+0000","last_became_peered":"2024-09-12T17:30:00.958049+0000","last_unstale":"2024-09-12T18:04:44.639403+0000","last_undegraded":"2024-09-12T18:04:44.639403+0000","last_fullsized":"2024-09-12T18:04:44.639403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:24.880580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'146","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.020504+0000","last_change":"2024-09-12T17:30:02.970369+0000","last_active":"2024-09-12T18:05:56.020504+0000","last_peered":"2024-09-12T18:05:56.020504+0000","last_clean":"2024-09-12T18:05:56.020504+0000","last_became_active":"2024-09-12T17:30:02.970095+0000","last_became_peered":"2024-09-12T17:30:02.970095+0000","last_unstale":"2024-09-12T18:05:56.020504+0000","last_undegraded":"2024-09-12T18:05:56.020504+0000","last_fullsized":"2024-09-12T18:05:56.020504+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:20.676163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":173,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'179","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.253509+0000","last_change":"2024-09-12T17:29:54.957178+0000","last_active":"2024-09-12T18:05:56.253509+0000","last_peered":"2024-09-12T18:05:56.253509+0000","last_clean":"2024-09-12T18:05:56.253509+0000","last_became_active":"2024-09-12T17:29:54.956850+0000","last_became_peered":"2024-09-12T17:29:54.956850+0000","last_unstale":"2024-09-12T18:05:56.253509+0000","last_undegraded":"2024-09-12T18:05:56.253509+0000","last_fullsized":"2024-09-12T18:05:56.253509+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:59.322551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":712,"num_read_kb":607,"num_write":242,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'174","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.297648+0000","last_change":"2024-09-12T17:29:52.959240+0000","last_active":"2024-09-12T18:06:19.297648+0000","last_peered":"2024-09-12T18:06:19.297648+0000","last_clean":"2024-09-12T18:06:19.297648+0000","last_became_active":"2024-09-12T17:29:52.958919+0000","last_became_peered":"2024-09-12T17:29:52.958919+0000","last_unstale":"2024-09-12T18:06:19.297648+0000","last_undegraded":"2024-09-12T18:06:19.297648+0000","last_fullsized":"2024-09-12T18:06:19.297648+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:33.354065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12930272,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":324,"num_read_kb":13812,"num_write":936,"num_write_kb":31717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.630825+0000","last_change":"2024-09-12T17:29:56.955564+0000","last_active":"2024-09-12T18:03:44.630825+0000","last_peered":"2024-09-12T18:03:44.630825+0000","last_clean":"2024-09-12T18:03:44.630825+0000","last_became_active":"2024-09-12T17:29:56.955288+0000","last_became_peered":"2024-09-12T17:29:56.955288+0000","last_unstale":"2024-09-12T18:03:44.630825+0000","last_undegraded":"2024-09-12T18:03:44.630825+0000","last_fullsized":"2024-09-12T18:03:44.630825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:03.688076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'136","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.523117+0000","last_change":"2024-09-12T17:29:58.953188+0000","last_active":"2024-09-12T18:05:59.523117+0000","last_peered":"2024-09-12T18:05:59.523117+0000","last_clean":"2024-09-12T18:05:59.523117+0000","last_became_active":"2024-09-12T17:29:58.952878+0000","last_became_peered":"2024-09-12T17:29:58.952878+0000","last_unstale":"2024-09-12T18:05:59.523117+0000","last_undegraded":"2024-09-12T18:05:59.523117+0000","last_fullsized":"2024-09-12T18:05:59.523117+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:06.356317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7441,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":233,"num_write":152,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633179+0000","last_change":"2024-09-12T17:30:00.970962+0000","last_active":"2024-09-12T18:03:54.633179+0000","last_peered":"2024-09-12T18:03:54.633179+0000","last_clean":"2024-09-12T18:03:54.633179+0000","last_became_active":"2024-09-12T17:30:00.970668+0000","last_became_peered":"2024-09-12T17:30:00.970668+0000","last_unstale":"2024-09-12T18:03:54.633179+0000","last_undegraded":"2024-09-12T18:03:54.633179+0000","last_fullsized":"2024-09-12T18:03:54.633179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:09.749573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'138","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.302849+0000","last_change":"2024-09-12T17:30:02.964408+0000","last_active":"2024-09-12T18:06:21.302849+0000","last_peered":"2024-09-12T18:06:21.302849+0000","last_clean":"2024-09-12T18:06:21.302849+0000","last_became_active":"2024-09-12T17:30:02.964125+0000","last_became_peered":"2024-09-12T17:30:02.964125+0000","last_unstale":"2024-09-12T18:06:21.302849+0000","last_undegraded":"2024-09-12T18:06:21.302849+0000","last_fullsized":"2024-09-12T18:06:21.302849+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:51.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":200,"num_read_kb":186,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'123","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.807408+0000","last_change":"2024-09-12T17:29:54.958681+0000","last_active":"2024-09-12T18:05:55.807408+0000","last_peered":"2024-09-12T18:05:55.807408+0000","last_clean":"2024-09-12T18:05:55.807408+0000","last_became_active":"2024-09-12T17:29:54.956019+0000","last_became_peered":"2024-09-12T17:29:54.956019+0000","last_unstale":"2024-09-12T18:05:55.807408+0000","last_undegraded":"2024-09-12T18:05:55.807408+0000","last_fullsized":"2024-09-12T18:05:55.807408+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:52.410372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":560,"num_read_kb":466,"num_write":179,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'194","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:15.446945+0000","last_change":"2024-09-12T17:29:52.951444+0000","last_active":"2024-09-12T18:05:15.446945+0000","last_peered":"2024-09-12T18:05:15.446945+0000","last_clean":"2024-09-12T18:05:15.446945+0000","last_became_active":"2024-09-12T17:29:52.951013+0000","last_became_peered":"2024-09-12T17:29:52.951013+0000","last_unstale":"2024-09-12T18:05:15.446945+0000","last_undegraded":"2024-09-12T18:05:15.446945+0000","last_fullsized":"2024-09-12T18:05:15.446945+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:26.659611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24709,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":472,"num_read_kb":90183,"num_write":905,"num_write_kb":29071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.632112+0000","last_change":"2024-09-12T17:29:56.959688+0000","last_active":"2024-09-12T18:03:44.632112+0000","last_peered":"2024-09-12T18:03:44.632112+0000","last_clean":"2024-09-12T18:03:44.632112+0000","last_became_active":"2024-09-12T17:29:56.959436+0000","last_became_peered":"2024-09-12T17:29:56.959436+0000","last_unstale":"2024-09-12T18:03:44.632112+0000","last_undegraded":"2024-09-12T18:03:44.632112+0000","last_fullsized":"2024-09-12T18:03:44.632112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:17.810253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'138","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.649246+0000","last_change":"2024-09-12T17:29:58.954865+0000","last_active":"2024-09-12T18:06:04.649246+0000","last_peered":"2024-09-12T18:06:04.649246+0000","last_clean":"2024-09-12T18:06:04.649246+0000","last_became_active":"2024-09-12T17:29:58.954548+0000","last_became_peered":"2024-09-12T17:29:58.954548+0000","last_unstale":"2024-09-12T18:06:04.649246+0000","last_undegraded":"2024-09-12T18:06:04.649246+0000","last_fullsized":"2024-09-12T18:06:04.649246+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:57.732564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15394,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":183,"num_read_kb":244,"num_write":102,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'730","reported_seq":2374,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.688693+0000","last_change":"2024-09-12T17:30:00.960694+0000","last_active":"2024-09-12T18:07:38.688693+0000","last_peered":"2024-09-12T18:07:38.688693+0000","last_clean":"2024-09-12T18:07:38.688693+0000","last_became_active":"2024-09-12T17:30:00.960402+0000","last_became_peered":"2024-09-12T17:30:00.960402+0000","last_unstale":"2024-09-12T18:07:38.688693+0000","last_undegraded":"2024-09-12T18:07:38.688693+0000","last_fullsized":"2024-09-12T18:07:38.688693+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:14.850575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'95","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.486123+0000","last_change":"2024-09-12T17:30:02.969918+0000","last_active":"2024-09-12T18:06:20.486123+0000","last_peered":"2024-09-12T18:06:20.486123+0000","last_clean":"2024-09-12T18:06:20.486123+0000","last_became_active":"2024-09-12T17:30:02.969617+0000","last_became_peered":"2024-09-12T17:30:02.969617+0000","last_unstale":"2024-09-12T18:06:20.486123+0000","last_undegraded":"2024-09-12T18:06:20.486123+0000","last_fullsized":"2024-09-12T18:06:20.486123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:08.908464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":242,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'118","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.647063+0000","last_change":"2024-09-12T17:29:54.959321+0000","last_active":"2024-09-12T18:06:06.647063+0000","last_peered":"2024-09-12T18:06:06.647063+0000","last_clean":"2024-09-12T18:06:06.647063+0000","last_became_active":"2024-09-12T17:29:54.958362+0000","last_became_peered":"2024-09-12T17:29:54.958362+0000","last_unstale":"2024-09-12T18:06:06.647063+0000","last_undegraded":"2024-09-12T18:06:06.647063+0000","last_fullsized":"2024-09-12T18:06:06.647063+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:49.275936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":415,"num_write":164,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'161","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.481795+0000","last_change":"2024-09-12T17:30:28.005494+0000","last_active":"2024-09-12T18:05:57.481795+0000","last_peered":"2024-09-12T18:05:57.481795+0000","last_clean":"2024-09-12T18:05:57.481795+0000","last_became_active":"2024-09-12T17:30:28.005099+0000","last_became_peered":"2024-09-12T17:30:28.005099+0000","last_unstale":"2024-09-12T18:05:57.481795+0000","last_undegraded":"2024-09-12T18:05:57.481795+0000","last_fullsized":"2024-09-12T18:05:57.481795+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:40.351778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27238,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":402,"num_read_kb":6854,"num_write":852,"num_write_kb":33010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.610781+0000","last_change":"2024-09-12T17:29:56.955646+0000","last_active":"2024-09-12T18:07:38.610781+0000","last_peered":"2024-09-12T18:07:38.610781+0000","last_clean":"2024-09-12T18:07:38.610781+0000","last_became_active":"2024-09-12T17:29:56.955321+0000","last_became_peered":"2024-09-12T17:29:56.955321+0000","last_unstale":"2024-09-12T18:07:38.610781+0000","last_undegraded":"2024-09-12T18:07:38.610781+0000","last_fullsized":"2024-09-12T18:07:38.610781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:06.863842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'79","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.538704+0000","last_change":"2024-09-12T17:29:58.978790+0000","last_active":"2024-09-12T18:05:59.538704+0000","last_peered":"2024-09-12T18:05:59.538704+0000","last_clean":"2024-09-12T18:05:59.538704+0000","last_became_active":"2024-09-12T17:29:58.978480+0000","last_became_peered":"2024-09-12T17:29:58.978480+0000","last_unstale":"2024-09-12T18:05:59.538704+0000","last_undegraded":"2024-09-12T18:05:59.538704+0000","last_fullsized":"2024-09-12T18:05:59.538704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:05.359700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'756","reported_seq":4524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.689646+0000","last_change":"2024-09-12T17:30:00.959471+0000","last_active":"2024-09-12T18:07:38.689646+0000","last_peered":"2024-09-12T18:07:38.689646+0000","last_clean":"2024-09-12T18:07:38.689646+0000","last_became_active":"2024-09-12T17:30:00.959015+0000","last_became_peered":"2024-09-12T17:30:00.959015+0000","last_unstale":"2024-09-12T18:07:38.689646+0000","last_undegraded":"2024-09-12T18:07:38.689646+0000","last_fullsized":"2024-09-12T18:07:38.689646+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:29.861180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'126","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.966308+0000","last_change":"2024-09-12T17:30:02.972327+0000","last_active":"2024-09-12T18:06:01.966308+0000","last_peered":"2024-09-12T18:06:01.966308+0000","last_clean":"2024-09-12T18:06:01.966308+0000","last_became_active":"2024-09-12T17:30:02.972020+0000","last_became_peered":"2024-09-12T17:30:02.972020+0000","last_unstale":"2024-09-12T18:06:01.966308+0000","last_undegraded":"2024-09-12T18:06:01.966308+0000","last_fullsized":"2024-09-12T18:06:01.966308+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.485323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":156,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.376221+0000","last_change":"2024-09-12T17:29:54.951231+0000","last_active":"2024-09-12T18:05:29.376221+0000","last_peered":"2024-09-12T18:05:29.376221+0000","last_clean":"2024-09-12T18:05:29.376221+0000","last_became_active":"2024-09-12T17:29:54.950966+0000","last_became_peered":"2024-09-12T17:29:54.950966+0000","last_unstale":"2024-09-12T18:05:29.376221+0000","last_undegraded":"2024-09-12T18:05:29.376221+0000","last_fullsized":"2024-09-12T18:05:29.376221+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:59.344136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":955,"num_read_kb":788,"num_write":339,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'175","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.456384+0000","last_change":"2024-09-12T17:29:52.948919+0000","last_active":"2024-09-12T18:06:08.456384+0000","last_peered":"2024-09-12T18:06:08.456384+0000","last_clean":"2024-09-12T18:06:08.456384+0000","last_became_active":"2024-09-12T17:29:52.948591+0000","last_became_peered":"2024-09-12T17:29:52.948591+0000","last_unstale":"2024-09-12T18:06:08.456384+0000","last_undegraded":"2024-09-12T18:06:08.456384+0000","last_fullsized":"2024-09-12T18:06:08.456384+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:40.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7552392,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":2966,"num_write":840,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.504222+0000","last_change":"2024-09-12T17:29:56.953681+0000","last_active":"2024-09-12T18:03:44.504222+0000","last_peered":"2024-09-12T18:03:44.504222+0000","last_clean":"2024-09-12T18:03:44.504222+0000","last_became_active":"2024-09-12T17:29:56.953198+0000","last_became_peered":"2024-09-12T17:29:56.953198+0000","last_unstale":"2024-09-12T18:03:44.504222+0000","last_undegraded":"2024-09-12T18:03:44.504222+0000","last_fullsized":"2024-09-12T18:03:44.504222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:26.233204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'186","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:35.847732+0000","last_change":"2024-09-12T17:29:58.957118+0000","last_active":"2024-09-12T18:06:35.847732+0000","last_peered":"2024-09-12T18:06:35.847732+0000","last_clean":"2024-09-12T18:06:35.847732+0000","last_became_active":"2024-09-12T17:29:58.956828+0000","last_became_peered":"2024-09-12T17:29:58.956828+0000","last_unstale":"2024-09-12T18:06:35.847732+0000","last_undegraded":"2024-09-12T18:06:35.847732+0000","last_fullsized":"2024-09-12T18:06:35.847732+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:05.359700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12042,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":832,"num_read_kb":892,"num_write":1324,"num_write_kb":1208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.504747+0000","last_change":"2024-09-12T17:30:00.963569+0000","last_active":"2024-09-12T18:03:49.504747+0000","last_peered":"2024-09-12T18:03:49.504747+0000","last_clean":"2024-09-12T18:03:49.504747+0000","last_became_active":"2024-09-12T17:30:00.963117+0000","last_became_peered":"2024-09-12T17:30:00.963117+0000","last_unstale":"2024-09-12T18:03:49.504747+0000","last_undegraded":"2024-09-12T18:03:49.504747+0000","last_fullsized":"2024-09-12T18:03:49.504747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:47.856522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'115","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.931424+0000","last_change":"2024-09-12T17:30:02.963673+0000","last_active":"2024-09-12T18:06:00.931424+0000","last_peered":"2024-09-12T18:06:00.931424+0000","last_clean":"2024-09-12T18:06:00.931424+0000","last_became_active":"2024-09-12T17:30:02.963368+0000","last_became_peered":"2024-09-12T17:30:02.963368+0000","last_unstale":"2024-09-12T18:06:00.931424+0000","last_undegraded":"2024-09-12T18:06:00.931424+0000","last_fullsized":"2024-09-12T18:06:00.931424+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:30.008139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":267,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'271","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:51.069613+0000","last_change":"2024-09-12T17:29:54.960752+0000","last_active":"2024-09-12T18:05:51.069613+0000","last_peered":"2024-09-12T18:05:51.069613+0000","last_clean":"2024-09-12T18:05:51.069613+0000","last_became_active":"2024-09-12T17:29:54.960486+0000","last_became_peered":"2024-09-12T17:29:54.960486+0000","last_unstale":"2024-09-12T18:05:51.069613+0000","last_undegraded":"2024-09-12T18:05:51.069613+0000","last_fullsized":"2024-09-12T18:05:51.069613+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:09.952438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1268,"num_write":469,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:44.688092+0000","last_change":"2024-09-12T17:29:36.164552+0000","last_active":"2024-09-12T18:05:44.688092+0000","last_peered":"2024-09-12T18:05:44.688092+0000","last_clean":"2024-09-12T18:05:44.688092+0000","last_became_active":"2024-09-12T17:29:36.163604+0000","last_became_peered":"2024-09-12T17:29:36.163604+0000","last_unstale":"2024-09-12T18:05:44.688092+0000","last_undegraded":"2024-09-12T18:05:44.688092+0000","last_fullsized":"2024-09-12T18:05:44.688092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.896766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.896766+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.896766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:35.293197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.640572+0000","last_change":"2024-09-12T17:29:43.975243+0000","last_active":"2024-09-12T18:05:09.640572+0000","last_peered":"2024-09-12T18:05:09.640572+0000","last_clean":"2024-09-12T18:05:09.640572+0000","last_became_active":"2024-09-12T17:29:41.963643+0000","last_became_peered":"2024-09-12T17:29:41.963643+0000","last_unstale":"2024-09-12T18:05:09.640572+0000","last_undegraded":"2024-09-12T18:05:09.640572+0000","last_fullsized":"2024-09-12T18:05:09.640572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:57.226626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056994999999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'200","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.275860+0000","last_change":"2024-09-12T17:29:52.955756+0000","last_active":"2024-09-12T18:05:29.275860+0000","last_peered":"2024-09-12T18:05:29.275860+0000","last_clean":"2024-09-12T18:05:29.275860+0000","last_became_active":"2024-09-12T17:29:52.954839+0000","last_became_peered":"2024-09-12T17:29:52.954839+0000","last_unstale":"2024-09-12T18:05:29.275860+0000","last_undegraded":"2024-09-12T18:05:29.275860+0000","last_fullsized":"2024-09-12T18:05:29.275860+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:54.464363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7720365,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":442,"num_read_kb":3372,"num_write":1034,"num_write_kb":36567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.685110+0000","last_change":"2024-09-12T17:29:56.955566+0000","last_active":"2024-09-12T18:05:24.685110+0000","last_peered":"2024-09-12T18:05:24.685110+0000","last_clean":"2024-09-12T18:05:24.685110+0000","last_became_active":"2024-09-12T17:29:56.955260+0000","last_became_peered":"2024-09-12T17:29:56.955260+0000","last_unstale":"2024-09-12T18:05:24.685110+0000","last_undegraded":"2024-09-12T18:05:24.685110+0000","last_fullsized":"2024-09-12T18:05:24.685110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:09.539939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'287","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.658767+0000","last_change":"2024-09-12T17:29:58.954504+0000","last_active":"2024-09-12T18:07:38.658767+0000","last_peered":"2024-09-12T18:07:38.658767+0000","last_clean":"2024-09-12T18:07:38.658767+0000","last_became_active":"2024-09-12T17:29:58.954205+0000","last_became_peered":"2024-09-12T17:29:58.954205+0000","last_unstale":"2024-09-12T18:07:38.658767+0000","last_undegraded":"2024-09-12T18:07:38.658767+0000","last_fullsized":"2024-09-12T18:07:38.658767+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:15.729749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":698,"num_write":486,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640713+0000","last_change":"2024-09-12T17:30:00.964518+0000","last_active":"2024-09-12T18:04:44.640713+0000","last_peered":"2024-09-12T18:04:44.640713+0000","last_clean":"2024-09-12T18:04:44.640713+0000","last_became_active":"2024-09-12T17:30:00.964241+0000","last_became_peered":"2024-09-12T17:30:00.964241+0000","last_unstale":"2024-09-12T18:04:44.640713+0000","last_undegraded":"2024-09-12T18:04:44.640713+0000","last_fullsized":"2024-09-12T18:04:44.640713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:14.242835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'221","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.251802+0000","last_change":"2024-09-12T17:30:02.964194+0000","last_active":"2024-09-12T18:06:21.251802+0000","last_peered":"2024-09-12T18:06:21.251802+0000","last_clean":"2024-09-12T18:06:21.251802+0000","last_became_active":"2024-09-12T17:30:02.963890+0000","last_became_peered":"2024-09-12T17:30:02.963890+0000","last_unstale":"2024-09-12T18:06:21.251802+0000","last_undegraded":"2024-09-12T18:06:21.251802+0000","last_fullsized":"2024-09-12T18:06:21.251802+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.997124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":552,"num_write":485,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'384","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.127003+0000","last_change":"2024-09-12T17:29:54.946209+0000","last_active":"2024-09-12T18:06:19.127003+0000","last_peered":"2024-09-12T18:06:19.127003+0000","last_clean":"2024-09-12T18:06:19.127003+0000","last_became_active":"2024-09-12T17:29:54.944624+0000","last_became_peered":"2024-09-12T17:29:54.944624+0000","last_unstale":"2024-09-12T18:06:19.127003+0000","last_undegraded":"2024-09-12T18:06:19.127003+0000","last_fullsized":"2024-09-12T18:06:19.127003+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:39.689437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1668,"num_read_kb":1443,"num_write":651,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:49.688854+0000","last_change":"2024-09-12T17:29:43.985359+0000","last_active":"2024-09-12T18:05:49.688854+0000","last_peered":"2024-09-12T18:05:49.688854+0000","last_clean":"2024-09-12T18:05:49.688854+0000","last_became_active":"2024-09-12T17:29:41.963499+0000","last_became_peered":"2024-09-12T17:29:41.963499+0000","last_unstale":"2024-09-12T18:05:49.688854+0000","last_undegraded":"2024-09-12T18:05:49.688854+0000","last_fullsized":"2024-09-12T18:05:49.688854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:34.267982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470655,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'146","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.500222+0000","last_change":"2024-09-12T17:29:52.949670+0000","last_active":"2024-09-12T18:05:54.500222+0000","last_peered":"2024-09-12T18:05:54.500222+0000","last_clean":"2024-09-12T18:05:54.500222+0000","last_became_active":"2024-09-12T17:29:52.949339+0000","last_became_peered":"2024-09-12T17:29:52.949339+0000","last_unstale":"2024-09-12T18:05:54.500222+0000","last_undegraded":"2024-09-12T18:05:54.500222+0000","last_fullsized":"2024-09-12T18:05:54.500222+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:19.928095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244268,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":390,"num_read_kb":3075,"num_write":748,"num_write_kb":23555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.635977+0000","last_change":"2024-09-12T17:29:56.954436+0000","last_active":"2024-09-12T18:04:39.635977+0000","last_peered":"2024-09-12T18:04:39.635977+0000","last_clean":"2024-09-12T18:04:39.635977+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:04:39.635977+0000","last_undegraded":"2024-09-12T18:04:39.635977+0000","last_fullsized":"2024-09-12T18:04:39.635977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:38.720237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'773","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.683830+0000","last_change":"2024-09-12T17:29:58.958558+0000","last_active":"2024-09-12T18:07:38.683830+0000","last_peered":"2024-09-12T18:07:38.683830+0000","last_clean":"2024-09-12T18:07:38.683830+0000","last_became_active":"2024-09-12T17:29:58.958269+0000","last_became_peered":"2024-09-12T17:29:58.958269+0000","last_unstale":"2024-09-12T18:07:38.683830+0000","last_undegraded":"2024-09-12T18:07:38.683830+0000","last_fullsized":"2024-09-12T18:07:38.683830+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:14.582465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44041,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1107,"num_read_kb":1266,"num_write":230,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:34.686581+0000","last_change":"2024-09-12T17:30:00.958433+0000","last_active":"2024-09-12T18:05:34.686581+0000","last_peered":"2024-09-12T18:05:34.686581+0000","last_clean":"2024-09-12T18:05:34.686581+0000","last_became_active":"2024-09-12T17:30:00.957628+0000","last_became_peered":"2024-09-12T17:30:00.957628+0000","last_unstale":"2024-09-12T18:05:34.686581+0000","last_undegraded":"2024-09-12T18:05:34.686581+0000","last_fullsized":"2024-09-12T18:05:34.686581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.962381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'136","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.227859+0000","last_change":"2024-09-12T17:30:02.960607+0000","last_active":"2024-09-12T18:05:52.227859+0000","last_peered":"2024-09-12T18:05:52.227859+0000","last_clean":"2024-09-12T18:05:52.227859+0000","last_became_active":"2024-09-12T17:30:02.960109+0000","last_became_peered":"2024-09-12T17:30:02.960109+0000","last_unstale":"2024-09-12T18:05:52.227859+0000","last_undegraded":"2024-09-12T18:05:52.227859+0000","last_fullsized":"2024-09-12T18:05:52.227859+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:27.244929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":318,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'88","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.991113+0000","last_change":"2024-09-12T17:29:54.958561+0000","last_active":"2024-09-12T18:06:07.991113+0000","last_peered":"2024-09-12T18:06:07.991113+0000","last_clean":"2024-09-12T18:06:07.991113+0000","last_became_active":"2024-09-12T17:29:54.958310+0000","last_became_peered":"2024-09-12T17:29:54.958310+0000","last_unstale":"2024-09-12T18:06:07.991113+0000","last_undegraded":"2024-09-12T18:06:07.991113+0000","last_fullsized":"2024-09-12T18:06:07.991113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:54.864495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":367,"num_read_kb":311,"num_write":135,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.642763+0000","last_change":"2024-09-12T17:29:44.204001+0000","last_active":"2024-09-12T18:05:09.642763+0000","last_peered":"2024-09-12T18:05:09.642763+0000","last_clean":"2024-09-12T18:05:09.642763+0000","last_became_active":"2024-09-12T17:29:42.064972+0000","last_became_peered":"2024-09-12T17:29:42.064972+0000","last_unstale":"2024-09-12T18:05:09.642763+0000","last_undegraded":"2024-09-12T18:05:09.642763+0000","last_fullsized":"2024-09-12T18:05:09.642763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.574136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047741400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'206","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.652642+0000","last_change":"2024-09-12T17:29:52.949699+0000","last_active":"2024-09-12T18:05:59.652642+0000","last_peered":"2024-09-12T18:05:59.652642+0000","last_clean":"2024-09-12T18:05:59.652642+0000","last_became_active":"2024-09-12T17:29:52.949301+0000","last_became_peered":"2024-09-12T17:29:52.949301+0000","last_unstale":"2024-09-12T18:05:59.652642+0000","last_undegraded":"2024-09-12T18:05:59.652642+0000","last_fullsized":"2024-09-12T18:05:59.652642+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:56.930560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6416875,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":2667,"num_write":1029,"num_write_kb":7887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.638711+0000","last_change":"2024-09-12T17:29:56.956881+0000","last_active":"2024-09-12T18:04:39.638711+0000","last_peered":"2024-09-12T18:04:39.638711+0000","last_clean":"2024-09-12T18:04:39.638711+0000","last_became_active":"2024-09-12T17:29:56.956623+0000","last_became_peered":"2024-09-12T17:29:56.956623+0000","last_unstale":"2024-09-12T18:04:39.638711+0000","last_undegraded":"2024-09-12T18:04:39.638711+0000","last_fullsized":"2024-09-12T18:04:39.638711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:54.110865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'210","reported_seq":1203,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:35.761738+0000","last_change":"2024-09-12T17:29:58.980974+0000","last_active":"2024-09-12T18:07:35.761738+0000","last_peered":"2024-09-12T18:07:35.761738+0000","last_clean":"2024-09-12T18:07:35.761738+0000","last_became_active":"2024-09-12T17:29:58.980697+0000","last_became_peered":"2024-09-12T17:29:58.980697+0000","last_unstale":"2024-09-12T18:07:35.761738+0000","last_undegraded":"2024-09-12T18:07:35.761738+0000","last_fullsized":"2024-09-12T18:07:35.761738+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:02.768234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":123,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648081+0000","last_change":"2024-09-12T17:30:00.968730+0000","last_active":"2024-09-12T18:05:29.648081+0000","last_peered":"2024-09-12T18:05:29.648081+0000","last_clean":"2024-09-12T18:05:29.648081+0000","last_became_active":"2024-09-12T17:30:00.968468+0000","last_became_peered":"2024-09-12T17:30:00.968468+0000","last_unstale":"2024-09-12T18:05:29.648081+0000","last_undegraded":"2024-09-12T18:05:29.648081+0000","last_fullsized":"2024-09-12T18:05:29.648081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:49.912468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'248","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.956406+0000","last_change":"2024-09-12T17:30:02.967215+0000","last_active":"2024-09-12T18:06:20.956406+0000","last_peered":"2024-09-12T18:06:20.956406+0000","last_clean":"2024-09-12T18:06:20.956406+0000","last_became_active":"2024-09-12T17:30:02.966910+0000","last_became_peered":"2024-09-12T17:30:02.966910+0000","last_unstale":"2024-09-12T18:06:20.956406+0000","last_undegraded":"2024-09-12T18:06:20.956406+0000","last_fullsized":"2024-09-12T18:06:20.956406+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":529,"num_write":537,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'112","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.763591+0000","last_change":"2024-09-12T17:29:54.948794+0000","last_active":"2024-09-12T18:07:37.763591+0000","last_peered":"2024-09-12T18:07:37.763591+0000","last_clean":"2024-09-12T18:07:37.763591+0000","last_became_active":"2024-09-12T17:29:54.948402+0000","last_became_peered":"2024-09-12T17:29:54.948402+0000","last_unstale":"2024-09-12T18:07:37.763591+0000","last_undegraded":"2024-09-12T18:07:37.763591+0000","last_fullsized":"2024-09-12T18:07:37.763591+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:23.995374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":452,"num_write":172,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.640533+0000","last_change":"2024-09-12T17:29:43.975620+0000","last_active":"2024-09-12T18:05:09.640533+0000","last_peered":"2024-09-12T18:05:09.640533+0000","last_clean":"2024-09-12T18:05:09.640533+0000","last_became_active":"2024-09-12T17:29:41.961122+0000","last_became_peered":"2024-09-12T17:29:41.961122+0000","last_unstale":"2024-09-12T18:05:09.640533+0000","last_undegraded":"2024-09-12T18:05:09.640533+0000","last_fullsized":"2024-09-12T18:05:09.640533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.143106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095277999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'240","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.721978+0000","last_change":"2024-09-12T17:29:52.958960+0000","last_active":"2024-09-12T18:05:54.721978+0000","last_peered":"2024-09-12T18:05:54.721978+0000","last_clean":"2024-09-12T18:05:54.721978+0000","last_became_active":"2024-09-12T17:29:52.958406+0000","last_became_peered":"2024-09-12T17:29:52.958406+0000","last_unstale":"2024-09-12T18:05:54.721978+0000","last_undegraded":"2024-09-12T18:05:54.721978+0000","last_fullsized":"2024-09-12T18:05:54.721978+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:53.477079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728679,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":48737,"num_write":1096,"num_write_kb":63490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648110+0000","last_change":"2024-09-12T17:29:56.954279+0000","last_active":"2024-09-12T18:05:29.648110+0000","last_peered":"2024-09-12T18:05:29.648110+0000","last_clean":"2024-09-12T18:05:29.648110+0000","last_became_active":"2024-09-12T17:29:56.954018+0000","last_became_peered":"2024-09-12T17:29:56.954018+0000","last_unstale":"2024-09-12T18:05:29.648110+0000","last_undegraded":"2024-09-12T18:05:29.648110+0000","last_fullsized":"2024-09-12T18:05:29.648110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.921260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'111","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:35.852981+0000","last_change":"2024-09-12T17:29:58.954279+0000","last_active":"2024-09-12T18:07:35.852981+0000","last_peered":"2024-09-12T18:07:35.852981+0000","last_clean":"2024-09-12T18:07:35.852981+0000","last_became_active":"2024-09-12T17:29:58.953909+0000","last_became_peered":"2024-09-12T17:29:58.953909+0000","last_unstale":"2024-09-12T18:07:35.852981+0000","last_undegraded":"2024-09-12T18:07:35.852981+0000","last_fullsized":"2024-09-12T18:07:35.852981+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:29.055630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":90,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.512851+0000","last_change":"2024-09-12T17:30:00.967582+0000","last_active":"2024-09-12T18:04:44.512851+0000","last_peered":"2024-09-12T18:04:44.512851+0000","last_clean":"2024-09-12T18:04:44.512851+0000","last_became_active":"2024-09-12T17:30:00.967279+0000","last_became_peered":"2024-09-12T17:30:00.967279+0000","last_unstale":"2024-09-12T18:04:44.512851+0000","last_undegraded":"2024-09-12T18:04:44.512851+0000","last_fullsized":"2024-09-12T18:04:44.512851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:05.249822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'207","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.809120+0000","last_change":"2024-09-12T17:30:02.969741+0000","last_active":"2024-09-12T18:05:55.809120+0000","last_peered":"2024-09-12T18:05:55.809120+0000","last_clean":"2024-09-12T18:05:55.809120+0000","last_became_active":"2024-09-12T17:30:02.969486+0000","last_became_peered":"2024-09-12T17:30:02.969486+0000","last_unstale":"2024-09-12T18:05:55.809120+0000","last_undegraded":"2024-09-12T18:05:55.809120+0000","last_fullsized":"2024-09-12T18:05:55.809120+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:39.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":397,"num_write":473,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'156","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.910434+0000","last_change":"2024-09-12T17:29:54.963961+0000","last_active":"2024-09-12T18:06:06.910434+0000","last_peered":"2024-09-12T18:06:06.910434+0000","last_clean":"2024-09-12T18:06:06.910434+0000","last_became_active":"2024-09-12T17:29:54.963669+0000","last_became_peered":"2024-09-12T17:29:54.963669+0000","last_unstale":"2024-09-12T18:06:06.910434+0000","last_undegraded":"2024-09-12T18:06:06.910434+0000","last_fullsized":"2024-09-12T18:06:06.910434+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:24.840068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":549,"num_write":259,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'200","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:31.236102+0000","last_change":"2024-09-12T17:29:52.954700+0000","last_active":"2024-09-12T18:05:31.236102+0000","last_peered":"2024-09-12T18:05:31.236102+0000","last_clean":"2024-09-12T18:05:31.236102+0000","last_became_active":"2024-09-12T17:29:52.954220+0000","last_became_peered":"2024-09-12T17:29:52.954220+0000","last_unstale":"2024-09-12T18:05:31.236102+0000","last_undegraded":"2024-09-12T18:05:31.236102+0000","last_fullsized":"2024-09-12T18:05:31.236102+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:30.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16799934,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":520,"num_read_kb":74998,"num_write":1061,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.645181+0000","last_change":"2024-09-12T17:29:43.966855+0000","last_active":"2024-09-12T18:05:09.645181+0000","last_peered":"2024-09-12T18:05:09.645181+0000","last_clean":"2024-09-12T18:05:09.645181+0000","last_became_active":"2024-09-12T17:29:42.064741+0000","last_became_peered":"2024-09-12T17:29:42.064741+0000","last_unstale":"2024-09-12T18:05:09.645181+0000","last_undegraded":"2024-09-12T18:05:09.645181+0000","last_fullsized":"2024-09-12T18:05:09.645181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:56.698152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043924099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647471+0000","last_change":"2024-09-12T17:29:56.955865+0000","last_active":"2024-09-12T18:05:24.647471+0000","last_peered":"2024-09-12T18:05:24.647471+0000","last_clean":"2024-09-12T18:05:24.647471+0000","last_became_active":"2024-09-12T17:29:56.955562+0000","last_became_peered":"2024-09-12T17:29:56.955562+0000","last_unstale":"2024-09-12T18:05:24.647471+0000","last_undegraded":"2024-09-12T18:05:24.647471+0000","last_fullsized":"2024-09-12T18:05:24.647471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:02.094255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'256","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.651372+0000","last_change":"2024-09-12T17:29:58.960788+0000","last_active":"2024-09-12T18:07:38.651372+0000","last_peered":"2024-09-12T18:07:38.651372+0000","last_clean":"2024-09-12T18:07:38.651372+0000","last_became_active":"2024-09-12T17:29:58.960410+0000","last_became_peered":"2024-09-12T17:29:58.960410+0000","last_unstale":"2024-09-12T18:07:38.651372+0000","last_undegraded":"2024-09-12T18:07:38.651372+0000","last_fullsized":"2024-09-12T18:07:38.651372+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:42.521026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21141,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":360,"num_read_kb":468,"num_write":234,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519052+0000","last_change":"2024-09-12T17:30:00.963954+0000","last_active":"2024-09-12T18:05:29.519052+0000","last_peered":"2024-09-12T18:05:29.519052+0000","last_clean":"2024-09-12T18:05:29.519052+0000","last_became_active":"2024-09-12T17:30:00.963660+0000","last_became_peered":"2024-09-12T17:30:00.963660+0000","last_unstale":"2024-09-12T18:05:29.519052+0000","last_undegraded":"2024-09-12T18:05:29.519052+0000","last_fullsized":"2024-09-12T18:05:29.519052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:07.402246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'169","reported_seq":678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.937429+0000","last_change":"2024-09-12T17:30:02.972165+0000","last_active":"2024-09-12T18:06:00.937429+0000","last_peered":"2024-09-12T18:06:00.937429+0000","last_clean":"2024-09-12T18:06:00.937429+0000","last_became_active":"2024-09-12T17:30:02.971807+0000","last_became_peered":"2024-09-12T17:30:02.971807+0000","last_unstale":"2024-09-12T18:06:00.937429+0000","last_undegraded":"2024-09-12T18:06:00.937429+0000","last_fullsized":"2024-09-12T18:06:00.937429+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:12.197480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":246,"num_write":442,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'190","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.624295+0000","last_change":"2024-09-12T17:29:54.959312+0000","last_active":"2024-09-12T18:05:26.624295+0000","last_peered":"2024-09-12T18:05:26.624295+0000","last_clean":"2024-09-12T18:05:26.624295+0000","last_became_active":"2024-09-12T17:29:54.958998+0000","last_became_peered":"2024-09-12T17:29:54.958998+0000","last_unstale":"2024-09-12T18:05:26.624295+0000","last_undegraded":"2024-09-12T18:05:26.624295+0000","last_fullsized":"2024-09-12T18:05:26.624295+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:32.259773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":764,"num_write":273,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'221","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:33.577392+0000","last_change":"2024-09-12T17:29:52.955784+0000","last_active":"2024-09-12T18:07:33.577392+0000","last_peered":"2024-09-12T18:07:33.577392+0000","last_clean":"2024-09-12T18:07:33.577392+0000","last_became_active":"2024-09-12T17:29:52.955429+0000","last_became_peered":"2024-09-12T17:29:52.955429+0000","last_unstale":"2024-09-12T18:07:33.577392+0000","last_undegraded":"2024-09-12T18:07:33.577392+0000","last_fullsized":"2024-09-12T18:07:33.577392+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:09.456649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3642728,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":39247,"num_write":987,"num_write_kb":44156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:14.683770+0000","last_change":"2024-09-12T17:29:43.985392+0000","last_active":"2024-09-12T18:05:14.683770+0000","last_peered":"2024-09-12T18:05:14.683770+0000","last_clean":"2024-09-12T18:05:14.683770+0000","last_became_active":"2024-09-12T17:29:42.064736+0000","last_became_peered":"2024-09-12T17:29:42.064736+0000","last_unstale":"2024-09-12T18:05:14.683770+0000","last_undegraded":"2024-09-12T18:05:14.683770+0000","last_fullsized":"2024-09-12T18:05:14.683770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:58.936927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045118300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518499+0000","last_change":"2024-09-12T17:29:56.957783+0000","last_active":"2024-09-12T18:05:24.518499+0000","last_peered":"2024-09-12T18:05:24.518499+0000","last_clean":"2024-09-12T18:05:24.518499+0000","last_became_active":"2024-09-12T17:29:56.957503+0000","last_became_peered":"2024-09-12T17:29:56.957503+0000","last_unstale":"2024-09-12T18:05:24.518499+0000","last_undegraded":"2024-09-12T18:05:24.518499+0000","last_fullsized":"2024-09-12T18:05:24.518499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:58.375801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'150","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.753445+0000","last_change":"2024-09-12T17:29:58.978826+0000","last_active":"2024-09-12T18:05:53.753445+0000","last_peered":"2024-09-12T18:05:53.753445+0000","last_clean":"2024-09-12T18:05:53.753445+0000","last_became_active":"2024-09-12T17:29:58.978487+0000","last_became_peered":"2024-09-12T17:29:58.978487+0000","last_unstale":"2024-09-12T18:05:53.753445+0000","last_undegraded":"2024-09-12T18:05:53.753445+0000","last_fullsized":"2024-09-12T18:05:53.753445+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:07.080227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":172,"num_read_kb":165,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'768","reported_seq":2440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.685983+0000","last_change":"2024-09-12T17:30:00.957003+0000","last_active":"2024-09-12T18:07:38.685983+0000","last_peered":"2024-09-12T18:07:38.685983+0000","last_clean":"2024-09-12T18:07:38.685983+0000","last_became_active":"2024-09-12T17:30:00.956655+0000","last_became_peered":"2024-09-12T17:30:00.956655+0000","last_unstale":"2024-09-12T18:07:38.685983+0000","last_undegraded":"2024-09-12T18:07:38.685983+0000","last_fullsized":"2024-09-12T18:07:38.685983+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:00.807981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'117","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:18.421406+0000","last_change":"2024-09-12T17:30:02.969523+0000","last_active":"2024-09-12T18:06:18.421406+0000","last_peered":"2024-09-12T18:06:18.421406+0000","last_clean":"2024-09-12T18:06:18.421406+0000","last_became_active":"2024-09-12T17:30:02.968978+0000","last_became_peered":"2024-09-12T17:30:02.968978+0000","last_unstale":"2024-09-12T18:06:18.421406+0000","last_undegraded":"2024-09-12T18:06:18.421406+0000","last_fullsized":"2024-09-12T18:06:18.421406+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:20.219209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1365,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":174,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'406","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.911679+0000","last_change":"2024-09-12T17:29:54.955693+0000","last_active":"2024-09-12T18:05:53.911679+0000","last_peered":"2024-09-12T18:05:53.911679+0000","last_clean":"2024-09-12T18:05:53.911679+0000","last_became_active":"2024-09-12T17:29:54.955170+0000","last_became_peered":"2024-09-12T17:29:54.955170+0000","last_unstale":"2024-09-12T18:05:53.911679+0000","last_undegraded":"2024-09-12T18:05:53.911679+0000","last_fullsized":"2024-09-12T18:05:53.911679+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:25.653731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1829,"num_read_kb":1585,"num_write":674,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'157","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.642860+0000","last_change":"2024-09-12T17:30:28.005223+0000","last_active":"2024-09-12T18:05:09.642860+0000","last_peered":"2024-09-12T18:05:09.642860+0000","last_clean":"2024-09-12T18:05:09.642860+0000","last_became_active":"2024-09-12T17:30:28.004804+0000","last_became_peered":"2024-09-12T17:30:28.004804+0000","last_unstale":"2024-09-12T18:05:09.642860+0000","last_undegraded":"2024-09-12T18:05:09.642860+0000","last_fullsized":"2024-09-12T18:05:09.642860+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:07.880016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10850256,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":331,"num_read_kb":56975,"num_write":791,"num_write_kb":25989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637817+0000","last_change":"2024-09-12T17:29:43.966900+0000","last_active":"2024-09-12T18:04:24.637817+0000","last_peered":"2024-09-12T18:04:24.637817+0000","last_clean":"2024-09-12T18:04:24.637817+0000","last_became_active":"2024-09-12T17:29:41.961194+0000","last_became_peered":"2024-09-12T17:29:41.961194+0000","last_unstale":"2024-09-12T18:04:24.637817+0000","last_undegraded":"2024-09-12T18:04:24.637817+0000","last_fullsized":"2024-09-12T18:04:24.637817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:52.853132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049442699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518488+0000","last_change":"2024-09-12T17:29:56.956156+0000","last_active":"2024-09-12T18:05:24.518488+0000","last_peered":"2024-09-12T18:05:24.518488+0000","last_clean":"2024-09-12T18:05:24.518488+0000","last_became_active":"2024-09-12T17:29:56.955865+0000","last_became_peered":"2024-09-12T17:29:56.955865+0000","last_unstale":"2024-09-12T18:05:24.518488+0000","last_undegraded":"2024-09-12T18:05:24.518488+0000","last_fullsized":"2024-09-12T18:05:24.518488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:29.721519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'96","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.072656+0000","last_change":"2024-09-12T17:29:58.954437+0000","last_active":"2024-09-12T18:05:52.072656+0000","last_peered":"2024-09-12T18:05:52.072656+0000","last_clean":"2024-09-12T18:05:52.072656+0000","last_became_active":"2024-09-12T17:29:58.953924+0000","last_became_peered":"2024-09-12T17:29:58.953924+0000","last_unstale":"2024-09-12T18:05:52.072656+0000","last_undegraded":"2024-09-12T18:05:52.072656+0000","last_fullsized":"2024-09-12T18:05:52.072656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:40.076452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":108,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'776","reported_seq":2089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.690589+0000","last_change":"2024-09-12T17:30:00.967465+0000","last_active":"2024-09-12T18:07:38.690589+0000","last_peered":"2024-09-12T18:07:38.690589+0000","last_clean":"2024-09-12T18:07:38.690589+0000","last_became_active":"2024-09-12T17:30:00.967168+0000","last_became_peered":"2024-09-12T17:30:00.967168+0000","last_unstale":"2024-09-12T18:07:38.690589+0000","last_undegraded":"2024-09-12T18:07:38.690589+0000","last_fullsized":"2024-09-12T18:07:38.690589+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:34.280045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'300","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.843665+0000","last_change":"2024-09-12T17:30:02.969830+0000","last_active":"2024-09-12T18:06:01.843665+0000","last_peered":"2024-09-12T18:06:01.843665+0000","last_clean":"2024-09-12T18:06:01.843665+0000","last_became_active":"2024-09-12T17:30:02.969526+0000","last_became_peered":"2024-09-12T17:30:02.969526+0000","last_unstale":"2024-09-12T18:06:01.843665+0000","last_undegraded":"2024-09-12T18:06:01.843665+0000","last_fullsized":"2024-09-12T18:06:01.843665+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:15.996494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":439,"num_write":657,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'44","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:23.880167+0000","last_change":"2024-09-12T17:29:54.958269+0000","last_active":"2024-09-12T18:05:23.880167+0000","last_peered":"2024-09-12T18:05:23.880167+0000","last_clean":"2024-09-12T18:05:23.880167+0000","last_became_active":"2024-09-12T17:29:54.957906+0000","last_became_peered":"2024-09-12T17:29:54.957906+0000","last_unstale":"2024-09-12T18:05:23.880167+0000","last_undegraded":"2024-09-12T18:05:23.880167+0000","last_fullsized":"2024-09-12T18:05:23.880167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:40.016834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":180,"num_write":59,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'208","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:22.236915+0000","last_change":"2024-09-12T17:30:28.007323+0000","last_active":"2024-09-12T18:05:22.236915+0000","last_peered":"2024-09-12T18:05:22.236915+0000","last_clean":"2024-09-12T18:05:22.236915+0000","last_became_active":"2024-09-12T17:30:28.006884+0000","last_became_peered":"2024-09-12T17:30:28.006884+0000","last_unstale":"2024-09-12T18:05:22.236915+0000","last_undegraded":"2024-09-12T18:05:22.236915+0000","last_fullsized":"2024-09-12T18:05:22.236915+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:19.123396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6643300,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":14673,"num_write":987,"num_write_kb":46674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.509953+0000","last_change":"2024-09-12T17:29:43.986874+0000","last_active":"2024-09-12T18:04:24.509953+0000","last_peered":"2024-09-12T18:04:24.509953+0000","last_clean":"2024-09-12T18:04:24.509953+0000","last_became_active":"2024-09-12T17:29:41.961477+0000","last_became_peered":"2024-09-12T17:29:41.961477+0000","last_unstale":"2024-09-12T18:04:24.509953+0000","last_undegraded":"2024-09-12T18:04:24.509953+0000","last_fullsized":"2024-09-12T18:04:24.509953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:09.932105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041855800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.518421+0000","last_change":"2024-09-12T17:29:56.954444+0000","last_active":"2024-09-12T18:04:09.518421+0000","last_peered":"2024-09-12T18:04:09.518421+0000","last_clean":"2024-09-12T18:04:09.518421+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:04:09.518421+0000","last_undegraded":"2024-09-12T18:04:09.518421+0000","last_fullsized":"2024-09-12T18:04:09.518421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:02.231915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'303","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.648148+0000","last_change":"2024-09-12T17:29:58.978547+0000","last_active":"2024-09-12T18:07:38.648148+0000","last_peered":"2024-09-12T18:07:38.648148+0000","last_clean":"2024-09-12T18:07:38.648148+0000","last_became_active":"2024-09-12T17:29:58.978222+0000","last_became_peered":"2024-09-12T17:29:58.978222+0000","last_unstale":"2024-09-12T18:07:38.648148+0000","last_undegraded":"2024-09-12T18:07:38.648148+0000","last_fullsized":"2024-09-12T18:07:38.648148+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.293800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43074,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":453,"num_read_kb":643,"num_write":242,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.534853+0000","last_change":"2024-09-12T17:30:00.968813+0000","last_active":"2024-09-12T18:05:29.534853+0000","last_peered":"2024-09-12T18:05:29.534853+0000","last_clean":"2024-09-12T18:05:29.534853+0000","last_became_active":"2024-09-12T17:30:00.968527+0000","last_became_peered":"2024-09-12T17:30:00.968527+0000","last_unstale":"2024-09-12T18:05:29.534853+0000","last_undegraded":"2024-09-12T18:05:29.534853+0000","last_fullsized":"2024-09-12T18:05:29.534853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:25.372195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'123","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.301030+0000","last_change":"2024-09-12T17:30:02.966314+0000","last_active":"2024-09-12T18:06:21.301030+0000","last_peered":"2024-09-12T18:06:21.301030+0000","last_clean":"2024-09-12T18:06:21.301030+0000","last_became_active":"2024-09-12T17:30:02.966018+0000","last_became_peered":"2024-09-12T17:30:02.966018+0000","last_unstale":"2024-09-12T18:06:21.301030+0000","last_undegraded":"2024-09-12T18:06:21.301030+0000","last_fullsized":"2024-09-12T18:06:21.301030+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:36.046680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":226,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'154","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.350541+0000","last_change":"2024-09-12T17:30:02.964433+0000","last_active":"2024-09-12T18:06:21.350541+0000","last_peered":"2024-09-12T18:06:21.350541+0000","last_clean":"2024-09-12T18:06:21.350541+0000","last_became_active":"2024-09-12T17:30:02.964133+0000","last_became_peered":"2024-09-12T17:30:02.964133+0000","last_unstale":"2024-09-12T18:06:21.350541+0000","last_undegraded":"2024-09-12T18:06:21.350541+0000","last_fullsized":"2024-09-12T18:06:21.350541+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:49.035962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":286,"num_write":383,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'104","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:05.138023+0000","last_change":"2024-09-12T17:29:54.955997+0000","last_active":"2024-09-12T18:06:05.138023+0000","last_peered":"2024-09-12T18:06:05.138023+0000","last_clean":"2024-09-12T18:06:05.138023+0000","last_became_active":"2024-09-12T17:29:54.955716+0000","last_became_peered":"2024-09-12T17:29:54.955716+0000","last_unstale":"2024-09-12T18:06:05.138023+0000","last_undegraded":"2024-09-12T18:06:05.138023+0000","last_fullsized":"2024-09-12T18:06:05.138023+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:34.910648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":383,"num_write":153,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'178","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:34.645556+0000","last_change":"2024-09-12T17:30:28.200904+0000","last_active":"2024-09-12T18:05:34.645556+0000","last_peered":"2024-09-12T18:05:34.645556+0000","last_clean":"2024-09-12T18:05:34.645556+0000","last_became_active":"2024-09-12T17:30:28.200487+0000","last_became_peered":"2024-09-12T17:30:28.200487+0000","last_unstale":"2024-09-12T18:05:34.645556+0000","last_undegraded":"2024-09-12T18:05:34.645556+0000","last_fullsized":"2024-09-12T18:05:34.645556+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:12.443062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485827,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":70105,"num_write":887,"num_write_kb":56875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643518+0000","last_change":"2024-09-12T17:29:56.952926+0000","last_active":"2024-09-12T18:04:59.643518+0000","last_peered":"2024-09-12T18:04:59.643518+0000","last_clean":"2024-09-12T18:04:59.643518+0000","last_became_active":"2024-09-12T17:29:56.952578+0000","last_became_peered":"2024-09-12T17:29:56.952578+0000","last_unstale":"2024-09-12T18:04:59.643518+0000","last_undegraded":"2024-09-12T18:04:59.643518+0000","last_fullsized":"2024-09-12T18:04:59.643518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:45.935353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'121","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.550099+0000","last_change":"2024-09-12T17:29:58.955397+0000","last_active":"2024-09-12T18:07:19.550099+0000","last_peered":"2024-09-12T18:07:19.550099+0000","last_clean":"2024-09-12T18:07:19.550099+0000","last_became_active":"2024-09-12T17:29:58.955111+0000","last_became_peered":"2024-09-12T17:29:58.955111+0000","last_unstale":"2024-09-12T18:07:19.550099+0000","last_undegraded":"2024-09-12T18:07:19.550099+0000","last_fullsized":"2024-09-12T18:07:19.550099+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.069692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31460,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":154,"num_read_kb":247,"num_write":80,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527389+0000","last_change":"2024-09-12T17:30:00.966432+0000","last_active":"2024-09-12T18:05:04.527389+0000","last_peered":"2024-09-12T18:05:04.527389+0000","last_clean":"2024-09-12T18:05:04.527389+0000","last_became_active":"2024-09-12T17:30:00.965975+0000","last_became_peered":"2024-09-12T17:30:00.965975+0000","last_unstale":"2024-09-12T18:05:04.527389+0000","last_undegraded":"2024-09-12T18:05:04.527389+0000","last_fullsized":"2024-09-12T18:05:04.527389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:47.435596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.885555+0000","last_change":"2024-09-12T17:30:02.966210+0000","last_active":"2024-09-12T18:06:08.885555+0000","last_peered":"2024-09-12T18:06:08.885555+0000","last_clean":"2024-09-12T18:06:08.885555+0000","last_became_active":"2024-09-12T17:30:02.965919+0000","last_became_peered":"2024-09-12T17:30:02.965919+0000","last_unstale":"2024-09-12T18:06:08.885555+0000","last_undegraded":"2024-09-12T18:06:08.885555+0000","last_fullsized":"2024-09-12T18:06:08.885555+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:02.212105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":165,"num_read_kb":151,"num_write":248,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'420","reported_seq":1167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.973572+0000","last_change":"2024-09-12T17:29:54.956088+0000","last_active":"2024-09-12T18:05:20.973572+0000","last_peered":"2024-09-12T18:05:20.973572+0000","last_clean":"2024-09-12T18:05:20.973572+0000","last_became_active":"2024-09-12T17:29:54.954477+0000","last_became_peered":"2024-09-12T17:29:54.954477+0000","last_unstale":"2024-09-12T18:05:20.973572+0000","last_undegraded":"2024-09-12T18:05:20.973572+0000","last_fullsized":"2024-09-12T18:05:20.973572+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:23.380497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1777,"num_write":781,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'209","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:27.766770+0000","last_change":"2024-09-12T17:29:52.956760+0000","last_active":"2024-09-12T18:05:27.766770+0000","last_peered":"2024-09-12T18:05:27.766770+0000","last_clean":"2024-09-12T18:05:27.766770+0000","last_became_active":"2024-09-12T17:29:52.956376+0000","last_became_peered":"2024-09-12T17:29:52.956376+0000","last_unstale":"2024-09-12T18:05:27.766770+0000","last_undegraded":"2024-09-12T18:05:27.766770+0000","last_fullsized":"2024-09-12T18:05:27.766770+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:50.307316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242984,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":420,"num_read_kb":36390,"num_write":985,"num_write_kb":36751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.526513+0000","last_change":"2024-09-12T17:29:56.955510+0000","last_active":"2024-09-12T18:04:59.526513+0000","last_peered":"2024-09-12T18:04:59.526513+0000","last_clean":"2024-09-12T18:04:59.526513+0000","last_became_active":"2024-09-12T17:29:56.955256+0000","last_became_peered":"2024-09-12T17:29:56.955256+0000","last_unstale":"2024-09-12T18:04:59.526513+0000","last_undegraded":"2024-09-12T18:04:59.526513+0000","last_fullsized":"2024-09-12T18:04:59.526513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:56.582465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'51","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.247475+0000","last_change":"2024-09-12T17:29:58.961027+0000","last_active":"2024-09-12T18:06:21.247475+0000","last_peered":"2024-09-12T18:06:21.247475+0000","last_clean":"2024-09-12T18:06:21.247475+0000","last_became_active":"2024-09-12T17:29:58.960476+0000","last_became_peered":"2024-09-12T17:29:58.960476+0000","last_unstale":"2024-09-12T18:06:21.247475+0000","last_undegraded":"2024-09-12T18:06:21.247475+0000","last_fullsized":"2024-09-12T18:06:21.247475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:15.254313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.682338+0000","last_change":"2024-09-12T17:30:00.958998+0000","last_active":"2024-09-12T18:05:04.682338+0000","last_peered":"2024-09-12T18:05:04.682338+0000","last_clean":"2024-09-12T18:05:04.682338+0000","last_became_active":"2024-09-12T17:30:00.958739+0000","last_became_peered":"2024-09-12T17:30:00.958739+0000","last_unstale":"2024-09-12T18:05:04.682338+0000","last_undegraded":"2024-09-12T18:05:04.682338+0000","last_fullsized":"2024-09-12T18:05:04.682338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:23.108221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'186","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.857340+0000","last_change":"2024-09-12T17:30:02.973036+0000","last_active":"2024-09-12T18:06:20.857340+0000","last_peered":"2024-09-12T18:06:20.857340+0000","last_clean":"2024-09-12T18:06:20.857340+0000","last_became_active":"2024-09-12T17:30:02.972717+0000","last_became_peered":"2024-09-12T17:30:02.972717+0000","last_unstale":"2024-09-12T18:06:20.857340+0000","last_undegraded":"2024-09-12T18:06:20.857340+0000","last_fullsized":"2024-09-12T18:06:20.857340+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:17.417135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":309,"num_read_kb":305,"num_write":411,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'235","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.884486+0000","last_change":"2024-09-12T17:29:54.956165+0000","last_active":"2024-09-12T18:06:08.884486+0000","last_peered":"2024-09-12T18:06:08.884486+0000","last_clean":"2024-09-12T18:06:08.884486+0000","last_became_active":"2024-09-12T17:29:54.955897+0000","last_became_peered":"2024-09-12T17:29:54.955897+0000","last_unstale":"2024-09-12T18:06:08.884486+0000","last_undegraded":"2024-09-12T18:06:08.884486+0000","last_fullsized":"2024-09-12T18:06:08.884486+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:12.755846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":344,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'242","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:02.614774+0000","last_change":"2024-09-12T17:29:52.955479+0000","last_active":"2024-09-12T18:06:02.614774+0000","last_peered":"2024-09-12T18:06:02.614774+0000","last_clean":"2024-09-12T18:06:02.614774+0000","last_became_active":"2024-09-12T17:29:52.954956+0000","last_became_peered":"2024-09-12T17:29:52.954956+0000","last_unstale":"2024-09-12T18:06:02.614774+0000","last_undegraded":"2024-09-12T18:06:02.614774+0000","last_fullsized":"2024-09-12T18:06:02.614774+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:37.430521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5794956,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":5380,"num_write":1206,"num_write_kb":40346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.681595+0000","last_change":"2024-09-12T17:29:56.959871+0000","last_active":"2024-09-12T18:04:59.681595+0000","last_peered":"2024-09-12T18:04:59.681595+0000","last_clean":"2024-09-12T18:04:59.681595+0000","last_became_active":"2024-09-12T17:29:56.959460+0000","last_became_peered":"2024-09-12T17:29:56.959460+0000","last_unstale":"2024-09-12T18:04:59.681595+0000","last_undegraded":"2024-09-12T18:04:59.681595+0000","last_fullsized":"2024-09-12T18:04:59.681595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:11.274542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'145","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.550161+0000","last_change":"2024-09-12T17:29:58.961137+0000","last_active":"2024-09-12T18:07:19.550161+0000","last_peered":"2024-09-12T18:07:19.550161+0000","last_clean":"2024-09-12T18:07:19.550161+0000","last_became_active":"2024-09-12T17:29:58.960824+0000","last_became_peered":"2024-09-12T17:29:58.960824+0000","last_unstale":"2024-09-12T18:07:19.550161+0000","last_undegraded":"2024-09-12T18:07:19.550161+0000","last_fullsized":"2024-09-12T18:07:19.550161+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:15.729749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6167,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":223,"num_write":102,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.515733+0000","last_change":"2024-09-12T17:30:00.967592+0000","last_active":"2024-09-12T18:05:04.515733+0000","last_peered":"2024-09-12T18:05:04.515733+0000","last_clean":"2024-09-12T18:05:04.515733+0000","last_became_active":"2024-09-12T17:30:00.967299+0000","last_became_peered":"2024-09-12T17:30:00.967299+0000","last_unstale":"2024-09-12T18:05:04.515733+0000","last_undegraded":"2024-09-12T18:05:04.515733+0000","last_fullsized":"2024-09-12T18:05:04.515733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:31.645270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'93","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.484386+0000","last_change":"2024-09-12T17:30:02.966660+0000","last_active":"2024-09-12T18:06:20.484386+0000","last_peered":"2024-09-12T18:06:20.484386+0000","last_clean":"2024-09-12T18:06:20.484386+0000","last_became_active":"2024-09-12T17:30:02.965644+0000","last_became_peered":"2024-09-12T17:30:02.965644+0000","last_unstale":"2024-09-12T18:06:20.484386+0000","last_undegraded":"2024-09-12T18:06:20.484386+0000","last_fullsized":"2024-09-12T18:06:20.484386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:15.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":207,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'4299","reported_seq":4944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.467541+0000","last_change":"2024-09-12T17:29:54.951955+0000","last_active":"2024-09-12T18:06:07.467541+0000","last_peered":"2024-09-12T18:06:07.467541+0000","last_clean":"2024-09-12T18:06:07.467541+0000","last_became_active":"2024-09-12T17:29:54.950407+0000","last_became_peered":"2024-09-12T17:29:54.950407+0000","last_unstale":"2024-09-12T18:06:07.467541+0000","last_undegraded":"2024-09-12T18:06:07.467541+0000","last_fullsized":"2024-09-12T18:06:07.467541+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:23.507143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17237,"num_read_kb":14347,"num_write":6471,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'174","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.126319+0000","last_change":"2024-09-12T17:29:52.963110+0000","last_active":"2024-09-12T18:06:01.126319+0000","last_peered":"2024-09-12T18:06:01.126319+0000","last_clean":"2024-09-12T18:06:01.126319+0000","last_became_active":"2024-09-12T17:29:52.962836+0000","last_became_peered":"2024-09-12T17:29:52.962836+0000","last_unstale":"2024-09-12T18:06:01.126319+0000","last_undegraded":"2024-09-12T18:06:01.126319+0000","last_fullsized":"2024-09-12T18:06:01.126319+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:33.047304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27545556,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":390,"num_read_kb":45090,"num_write":883,"num_write_kb":58788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.514939+0000","last_change":"2024-09-12T17:29:56.957363+0000","last_active":"2024-09-12T18:04:59.514939+0000","last_peered":"2024-09-12T18:04:59.514939+0000","last_clean":"2024-09-12T18:04:59.514939+0000","last_became_active":"2024-09-12T17:29:56.957066+0000","last_became_peered":"2024-09-12T17:29:56.957066+0000","last_unstale":"2024-09-12T18:04:59.514939+0000","last_undegraded":"2024-09-12T18:04:59.514939+0000","last_fullsized":"2024-09-12T18:04:59.514939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:23.450708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'148","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.701524+0000","last_change":"2024-09-12T17:29:58.955841+0000","last_active":"2024-09-12T18:07:19.701524+0000","last_peered":"2024-09-12T18:07:19.701524+0000","last_clean":"2024-09-12T18:07:19.701524+0000","last_became_active":"2024-09-12T17:29:58.955585+0000","last_became_peered":"2024-09-12T17:29:58.955585+0000","last_unstale":"2024-09-12T18:07:19.701524+0000","last_undegraded":"2024-09-12T18:07:19.701524+0000","last_fullsized":"2024-09-12T18:07:19.701524+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:03.552605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12664,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":164,"num_read_kb":221,"num_write":98,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644380+0000","last_change":"2024-09-12T17:30:00.965228+0000","last_active":"2024-09-12T18:05:04.644380+0000","last_peered":"2024-09-12T18:05:04.644380+0000","last_clean":"2024-09-12T18:05:04.644380+0000","last_became_active":"2024-09-12T17:30:00.964621+0000","last_became_peered":"2024-09-12T17:30:00.964621+0000","last_unstale":"2024-09-12T18:05:04.644380+0000","last_undegraded":"2024-09-12T18:05:04.644380+0000","last_fullsized":"2024-09-12T18:05:04.644380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:28.006617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'546","reported_seq":1344,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517857+0000","last_change":"2024-09-12T17:29:54.959133+0000","last_active":"2024-09-12T18:05:19.517857+0000","last_peered":"2024-09-12T18:05:19.517857+0000","last_clean":"2024-09-12T18:05:19.517857+0000","last_became_active":"2024-09-12T17:29:54.958758+0000","last_became_peered":"2024-09-12T17:29:54.958758+0000","last_unstale":"2024-09-12T18:05:19.517857+0000","last_undegraded":"2024-09-12T18:05:19.517857+0000","last_fullsized":"2024-09-12T18:05:19.517857+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:49.827603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2571,"num_read_kb":2181,"num_write":951,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'207","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.106442+0000","last_change":"2024-09-12T17:30:28.007406+0000","last_active":"2024-09-12T18:05:57.106442+0000","last_peered":"2024-09-12T18:05:57.106442+0000","last_clean":"2024-09-12T18:05:57.106442+0000","last_became_active":"2024-09-12T17:30:28.007001+0000","last_became_peered":"2024-09-12T17:30:28.007001+0000","last_unstale":"2024-09-12T18:05:57.106442+0000","last_undegraded":"2024-09-12T18:05:57.106442+0000","last_fullsized":"2024-09-12T18:05:57.106442+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:46.585635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15991744,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":573,"num_read_kb":31262,"num_write":913,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634516+0000","last_change":"2024-09-12T17:29:56.954814+0000","last_active":"2024-09-12T18:04:04.634516+0000","last_peered":"2024-09-12T18:04:04.634516+0000","last_clean":"2024-09-12T18:04:04.634516+0000","last_became_active":"2024-09-12T17:29:56.954498+0000","last_became_peered":"2024-09-12T17:29:56.954498+0000","last_unstale":"2024-09-12T18:04:04.634516+0000","last_undegraded":"2024-09-12T18:04:04.634516+0000","last_fullsized":"2024-09-12T18:04:04.634516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:39.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'182","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.644829+0000","last_change":"2024-09-12T17:29:58.958482+0000","last_active":"2024-09-12T18:07:38.644829+0000","last_peered":"2024-09-12T18:07:38.644829+0000","last_clean":"2024-09-12T18:07:38.644829+0000","last_became_active":"2024-09-12T17:29:58.958198+0000","last_became_peered":"2024-09-12T17:29:58.958198+0000","last_unstale":"2024-09-12T18:07:38.644829+0000","last_undegraded":"2024-09-12T18:07:38.644829+0000","last_fullsized":"2024-09-12T18:07:38.644829+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:03.636909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23630,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":276,"num_read_kb":397,"num_write":176,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.639853+0000","last_change":"2024-09-12T17:30:00.964218+0000","last_active":"2024-09-12T18:05:04.639853+0000","last_peered":"2024-09-12T18:05:04.639853+0000","last_clean":"2024-09-12T18:05:04.639853+0000","last_became_active":"2024-09-12T17:30:00.963706+0000","last_became_peered":"2024-09-12T17:30:00.963706+0000","last_unstale":"2024-09-12T18:05:04.639853+0000","last_undegraded":"2024-09-12T18:05:04.639853+0000","last_fullsized":"2024-09-12T18:05:04.639853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:42.210305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'175","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.667499+0000","last_change":"2024-09-12T17:30:02.964954+0000","last_active":"2024-09-12T18:06:08.667499+0000","last_peered":"2024-09-12T18:06:08.667499+0000","last_clean":"2024-09-12T18:06:08.667499+0000","last_became_active":"2024-09-12T17:30:02.964682+0000","last_became_peered":"2024-09-12T17:30:02.964682+0000","last_unstale":"2024-09-12T18:06:08.667499+0000","last_undegraded":"2024-09-12T18:06:08.667499+0000","last_fullsized":"2024-09-12T18:06:08.667499+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:18.544576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":239,"num_read_kb":250,"num_write":415,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'100","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.652523+0000","last_change":"2024-09-12T17:29:54.955631+0000","last_active":"2024-09-12T18:05:59.652523+0000","last_peered":"2024-09-12T18:05:59.652523+0000","last_clean":"2024-09-12T18:05:59.652523+0000","last_became_active":"2024-09-12T17:29:54.955326+0000","last_became_peered":"2024-09-12T17:29:54.955326+0000","last_unstale":"2024-09-12T18:05:59.652523+0000","last_undegraded":"2024-09-12T18:05:59.652523+0000","last_fullsized":"2024-09-12T18:05:59.652523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:49.289784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":334,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'216","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.390956+0000","last_change":"2024-09-12T17:29:52.946176+0000","last_active":"2024-09-12T18:06:06.390956+0000","last_peered":"2024-09-12T18:06:06.390956+0000","last_clean":"2024-09-12T18:06:06.390956+0000","last_became_active":"2024-09-12T17:29:52.945616+0000","last_became_peered":"2024-09-12T17:29:52.945616+0000","last_unstale":"2024-09-12T18:06:06.390956+0000","last_undegraded":"2024-09-12T18:06:06.390956+0000","last_fullsized":"2024-09-12T18:06:06.390956+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.047653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16164918,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":15300,"num_write":1079,"num_write_kb":27395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518557+0000","last_change":"2024-09-12T17:29:56.959423+0000","last_active":"2024-09-12T18:05:24.518557+0000","last_peered":"2024-09-12T18:05:24.518557+0000","last_clean":"2024-09-12T18:05:24.518557+0000","last_became_active":"2024-09-12T17:29:56.959047+0000","last_became_peered":"2024-09-12T17:29:56.959047+0000","last_unstale":"2024-09-12T18:05:24.518557+0000","last_undegraded":"2024-09-12T18:05:24.518557+0000","last_fullsized":"2024-09-12T18:05:24.518557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:03.525338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'141","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:29.703006+0000","last_change":"2024-09-12T17:29:58.955055+0000","last_active":"2024-09-12T18:07:29.703006+0000","last_peered":"2024-09-12T18:07:29.703006+0000","last_clean":"2024-09-12T18:07:29.703006+0000","last_became_active":"2024-09-12T17:29:58.954747+0000","last_became_peered":"2024-09-12T17:29:58.954747+0000","last_unstale":"2024-09-12T18:07:29.703006+0000","last_undegraded":"2024-09-12T18:07:29.703006+0000","last_fullsized":"2024-09-12T18:07:29.703006+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:01.106668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10981,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":186,"num_read_kb":237,"num_write":116,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644390+0000","last_change":"2024-09-12T17:30:00.960182+0000","last_active":"2024-09-12T18:05:04.644390+0000","last_peered":"2024-09-12T18:05:04.644390+0000","last_clean":"2024-09-12T18:05:04.644390+0000","last_became_active":"2024-09-12T17:30:00.959708+0000","last_became_peered":"2024-09-12T17:30:00.959708+0000","last_unstale":"2024-09-12T18:05:04.644390+0000","last_undegraded":"2024-09-12T18:05:04.644390+0000","last_fullsized":"2024-09-12T18:05:04.644390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:04.130612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'214","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.731228+0000","last_change":"2024-09-12T17:30:02.961235+0000","last_active":"2024-09-12T18:07:37.731228+0000","last_peered":"2024-09-12T18:07:37.731228+0000","last_clean":"2024-09-12T18:07:37.731228+0000","last_became_active":"2024-09-12T17:30:02.960928+0000","last_became_peered":"2024-09-12T17:30:02.960928+0000","last_unstale":"2024-09-12T18:07:37.731228+0000","last_undegraded":"2024-09-12T18:07:37.731228+0000","last_fullsized":"2024-09-12T18:07:37.731228+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:02.653466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":219,"num_write":570,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'158","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:03.287640+0000","last_change":"2024-09-12T17:29:54.951640+0000","last_active":"2024-09-12T18:06:03.287640+0000","last_peered":"2024-09-12T18:06:03.287640+0000","last_clean":"2024-09-12T18:06:03.287640+0000","last_became_active":"2024-09-12T17:29:54.950294+0000","last_became_peered":"2024-09-12T17:29:54.950294+0000","last_unstale":"2024-09-12T18:06:03.287640+0000","last_undegraded":"2024-09-12T18:06:03.287640+0000","last_fullsized":"2024-09-12T18:06:03.287640+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:35.954198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":567,"num_write":224,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'194","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.301434+0000","last_change":"2024-09-12T17:29:52.947774+0000","last_active":"2024-09-12T18:05:57.301434+0000","last_peered":"2024-09-12T18:05:57.301434+0000","last_clean":"2024-09-12T18:05:57.301434+0000","last_became_active":"2024-09-12T17:29:52.947363+0000","last_became_peered":"2024-09-12T17:29:52.947363+0000","last_unstale":"2024-09-12T18:05:57.301434+0000","last_undegraded":"2024-09-12T18:05:57.301434+0000","last_fullsized":"2024-09-12T18:05:57.301434+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:04.661665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6376533,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":718,"num_read_kb":129945,"num_write":976,"num_write_kb":26137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.515065+0000","last_change":"2024-09-12T17:29:56.952220+0000","last_active":"2024-09-12T18:04:59.515065+0000","last_peered":"2024-09-12T18:04:59.515065+0000","last_clean":"2024-09-12T18:04:59.515065+0000","last_became_active":"2024-09-12T17:29:56.951825+0000","last_became_peered":"2024-09-12T17:29:56.951825+0000","last_unstale":"2024-09-12T18:04:59.515065+0000","last_undegraded":"2024-09-12T18:04:59.515065+0000","last_fullsized":"2024-09-12T18:04:59.515065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.728224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'127","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:29.551350+0000","last_change":"2024-09-12T17:29:58.978881+0000","last_active":"2024-09-12T18:07:29.551350+0000","last_peered":"2024-09-12T18:07:29.551350+0000","last_clean":"2024-09-12T18:07:29.551350+0000","last_became_active":"2024-09-12T17:29:58.978506+0000","last_became_peered":"2024-09-12T17:29:58.978506+0000","last_unstale":"2024-09-12T18:07:29.551350+0000","last_undegraded":"2024-09-12T18:07:29.551350+0000","last_fullsized":"2024-09-12T18:07:29.551350+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:23.505523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8546,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":154,"num_read_kb":204,"num_write":82,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.635596+0000","last_change":"2024-09-12T17:30:00.965903+0000","last_active":"2024-09-12T18:04:09.635596+0000","last_peered":"2024-09-12T18:04:09.635596+0000","last_clean":"2024-09-12T18:04:09.635596+0000","last_became_active":"2024-09-12T17:30:00.965628+0000","last_became_peered":"2024-09-12T17:30:00.965628+0000","last_unstale":"2024-09-12T18:04:09.635596+0000","last_undegraded":"2024-09-12T18:04:09.635596+0000","last_fullsized":"2024-09-12T18:04:09.635596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:59.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'111","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.672413+0000","last_change":"2024-09-12T17:30:02.963569+0000","last_active":"2024-09-12T18:07:38.672413+0000","last_peered":"2024-09-12T18:07:38.672413+0000","last_clean":"2024-09-12T18:07:38.672413+0000","last_became_active":"2024-09-12T17:30:02.963242+0000","last_became_peered":"2024-09-12T17:30:02.963242+0000","last_unstale":"2024-09-12T18:07:38.672413+0000","last_undegraded":"2024-09-12T18:07:38.672413+0000","last_fullsized":"2024-09-12T18:07:38.672413+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:33.404263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'168","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.875016+0000","last_change":"2024-09-12T17:29:54.950700+0000","last_active":"2024-09-12T18:05:26.875016+0000","last_peered":"2024-09-12T18:05:26.875016+0000","last_clean":"2024-09-12T18:05:26.875016+0000","last_became_active":"2024-09-12T17:29:54.950429+0000","last_became_peered":"2024-09-12T17:29:54.950429+0000","last_unstale":"2024-09-12T18:05:26.875016+0000","last_undegraded":"2024-09-12T18:05:26.875016+0000","last_fullsized":"2024-09-12T18:05:26.875016+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:03.561091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":726,"num_read_kb":598,"num_write":255,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'194","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.730592+0000","last_change":"2024-09-12T17:29:52.967135+0000","last_active":"2024-09-12T18:05:20.730592+0000","last_peered":"2024-09-12T18:05:20.730592+0000","last_clean":"2024-09-12T18:05:20.730592+0000","last_became_active":"2024-09-12T17:29:52.966561+0000","last_became_peered":"2024-09-12T17:29:52.966561+0000","last_unstale":"2024-09-12T18:05:20.730592+0000","last_undegraded":"2024-09-12T18:05:20.730592+0000","last_fullsized":"2024-09-12T18:05:20.730592+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:12.665280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":383,"num_read_kb":24994,"num_write":950,"num_write_kb":31573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643585+0000","last_change":"2024-09-12T17:29:56.959683+0000","last_active":"2024-09-12T18:04:59.643585+0000","last_peered":"2024-09-12T18:04:59.643585+0000","last_clean":"2024-09-12T18:04:59.643585+0000","last_became_active":"2024-09-12T17:29:56.959185+0000","last_became_peered":"2024-09-12T17:29:56.959185+0000","last_unstale":"2024-09-12T18:04:59.643585+0000","last_undegraded":"2024-09-12T18:04:59.643585+0000","last_fullsized":"2024-09-12T18:04:59.643585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:49.577878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'60","reported_seq":573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.221013+0000","last_change":"2024-09-12T17:29:58.978897+0000","last_active":"2024-09-12T18:05:53.221013+0000","last_peered":"2024-09-12T18:05:53.221013+0000","last_clean":"2024-09-12T18:05:53.221013+0000","last_became_active":"2024-09-12T17:29:58.978247+0000","last_became_peered":"2024-09-12T17:29:58.978247+0000","last_unstale":"2024-09-12T18:05:53.221013+0000","last_undegraded":"2024-09-12T18:05:53.221013+0000","last_fullsized":"2024-09-12T18:05:53.221013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:21.292974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":59,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'756","reported_seq":2182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.684833+0000","last_change":"2024-09-12T17:30:00.962301+0000","last_active":"2024-09-12T18:07:38.684833+0000","last_peered":"2024-09-12T18:07:38.684833+0000","last_clean":"2024-09-12T18:07:38.684833+0000","last_became_active":"2024-09-12T17:30:00.961928+0000","last_became_peered":"2024-09-12T17:30:00.961928+0000","last_unstale":"2024-09-12T18:07:38.684833+0000","last_undegraded":"2024-09-12T18:07:38.684833+0000","last_fullsized":"2024-09-12T18:07:38.684833+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:21.176614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'103","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.850274+0000","last_change":"2024-09-12T17:30:02.963767+0000","last_active":"2024-09-12T18:06:20.850274+0000","last_peered":"2024-09-12T18:06:20.850274+0000","last_clean":"2024-09-12T18:06:20.850274+0000","last_became_active":"2024-09-12T17:30:02.963474+0000","last_became_peered":"2024-09-12T17:30:02.963474+0000","last_unstale":"2024-09-12T18:06:20.850274+0000","last_undegraded":"2024-09-12T18:06:20.850274+0000","last_fullsized":"2024-09-12T18:06:20.850274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:06.653540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'461","reported_seq":1185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.916766+0000","last_change":"2024-09-12T17:29:54.956245+0000","last_active":"2024-09-12T18:05:56.916766+0000","last_peered":"2024-09-12T18:05:56.916766+0000","last_clean":"2024-09-12T18:05:56.916766+0000","last_became_active":"2024-09-12T17:29:54.954344+0000","last_became_peered":"2024-09-12T17:29:54.954344+0000","last_unstale":"2024-09-12T18:05:56.916766+0000","last_undegraded":"2024-09-12T18:05:56.916766+0000","last_fullsized":"2024-09-12T18:05:56.916766+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:54.059931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":1813,"num_write":696,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'213","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:28.839278+0000","last_change":"2024-09-12T17:30:28.008322+0000","last_active":"2024-09-12T18:05:28.839278+0000","last_peered":"2024-09-12T18:05:28.839278+0000","last_clean":"2024-09-12T18:05:28.839278+0000","last_became_active":"2024-09-12T17:30:28.008012+0000","last_became_peered":"2024-09-12T17:30:28.008012+0000","last_unstale":"2024-09-12T18:05:28.839278+0000","last_undegraded":"2024-09-12T18:05:28.839278+0000","last_fullsized":"2024-09-12T18:05:28.839278+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:35.056975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11908801,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":11221,"num_write":1054,"num_write_kb":38249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.681643+0000","last_change":"2024-09-12T17:29:56.959803+0000","last_active":"2024-09-12T18:04:59.681643+0000","last_peered":"2024-09-12T18:04:59.681643+0000","last_clean":"2024-09-12T18:04:59.681643+0000","last_became_active":"2024-09-12T17:29:56.959496+0000","last_became_peered":"2024-09-12T17:29:56.959496+0000","last_unstale":"2024-09-12T18:04:59.681643+0000","last_undegraded":"2024-09-12T18:04:59.681643+0000","last_fullsized":"2024-09-12T18:04:59.681643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:24.096051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'140","reported_seq":703,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.650628+0000","last_change":"2024-09-12T17:29:58.956511+0000","last_active":"2024-09-12T18:06:19.650628+0000","last_peered":"2024-09-12T18:06:19.650628+0000","last_clean":"2024-09-12T18:06:19.650628+0000","last_became_active":"2024-09-12T17:29:58.956214+0000","last_became_peered":"2024-09-12T17:29:58.956214+0000","last_unstale":"2024-09-12T18:06:19.650628+0000","last_undegraded":"2024-09-12T18:06:19.650628+0000","last_fullsized":"2024-09-12T18:06:19.650628+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.069692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9446,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":184,"num_read_kb":237,"num_write":104,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633054+0000","last_change":"2024-09-12T17:30:00.964427+0000","last_active":"2024-09-12T18:03:54.633054+0000","last_peered":"2024-09-12T18:03:54.633054+0000","last_clean":"2024-09-12T18:03:54.633054+0000","last_became_active":"2024-09-12T17:30:00.964150+0000","last_became_peered":"2024-09-12T17:30:00.964150+0000","last_unstale":"2024-09-12T18:03:54.633054+0000","last_undegraded":"2024-09-12T18:03:54.633054+0000","last_fullsized":"2024-09-12T18:03:54.633054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:38.024178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'176","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.255174+0000","last_change":"2024-09-12T17:30:02.972717+0000","last_active":"2024-09-12T18:05:56.255174+0000","last_peered":"2024-09-12T18:05:56.255174+0000","last_clean":"2024-09-12T18:05:56.255174+0000","last_became_active":"2024-09-12T17:30:02.972420+0000","last_became_peered":"2024-09-12T17:30:02.972420+0000","last_unstale":"2024-09-12T18:05:56.255174+0000","last_undegraded":"2024-09-12T18:05:56.255174+0000","last_fullsized":"2024-09-12T18:05:56.255174+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:00.149423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":302,"num_write":451,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'323","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.064215+0000","last_change":"2024-09-12T17:29:54.954336+0000","last_active":"2024-09-12T18:05:53.064215+0000","last_peered":"2024-09-12T18:05:53.064215+0000","last_clean":"2024-09-12T18:05:53.064215+0000","last_became_active":"2024-09-12T17:29:54.953626+0000","last_became_peered":"2024-09-12T17:29:54.953626+0000","last_unstale":"2024-09-12T18:05:53.064215+0000","last_undegraded":"2024-09-12T18:05:53.064215+0000","last_fullsized":"2024-09-12T18:05:53.064215+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:50.673324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1393,"num_read_kb":1115,"num_write":522,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'166","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.015143+0000","last_change":"2024-09-12T17:30:28.201293+0000","last_active":"2024-09-12T18:06:00.015143+0000","last_peered":"2024-09-12T18:06:00.015143+0000","last_clean":"2024-09-12T18:06:00.015143+0000","last_became_active":"2024-09-12T17:30:28.200981+0000","last_became_peered":"2024-09-12T17:30:28.200981+0000","last_unstale":"2024-09-12T18:06:00.015143+0000","last_undegraded":"2024-09-12T18:06:00.015143+0000","last_fullsized":"2024-09-12T18:06:00.015143+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:11.575396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6329538,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":372,"num_read_kb":41427,"num_write":830,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.639179+0000","last_change":"2024-09-12T17:29:56.955843+0000","last_active":"2024-09-12T18:04:59.639179+0000","last_peered":"2024-09-12T18:04:59.639179+0000","last_clean":"2024-09-12T18:04:59.639179+0000","last_became_active":"2024-09-12T17:29:56.955532+0000","last_became_peered":"2024-09-12T17:29:56.955532+0000","last_unstale":"2024-09-12T18:04:59.639179+0000","last_undegraded":"2024-09-12T18:04:59.639179+0000","last_fullsized":"2024-09-12T18:04:59.639179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:32.340336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'119","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.654225+0000","last_change":"2024-09-12T17:29:58.961115+0000","last_active":"2024-09-12T18:06:14.654225+0000","last_peered":"2024-09-12T18:06:14.654225+0000","last_clean":"2024-09-12T18:06:14.654225+0000","last_became_active":"2024-09-12T17:29:58.960733+0000","last_became_peered":"2024-09-12T17:29:58.960733+0000","last_unstale":"2024-09-12T18:06:14.654225+0000","last_undegraded":"2024-09-12T18:06:14.654225+0000","last_fullsized":"2024-09-12T18:06:14.654225+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:12.596344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11189,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":226,"num_write":80,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.507102+0000","last_change":"2024-09-12T17:30:00.960684+0000","last_active":"2024-09-12T18:04:04.507102+0000","last_peered":"2024-09-12T18:04:04.507102+0000","last_clean":"2024-09-12T18:04:04.507102+0000","last_became_active":"2024-09-12T17:30:00.960358+0000","last_became_peered":"2024-09-12T17:30:00.960358+0000","last_unstale":"2024-09-12T18:04:04.507102+0000","last_undegraded":"2024-09-12T18:04:04.507102+0000","last_fullsized":"2024-09-12T18:04:04.507102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:41.585720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'157","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.309864+0000","last_change":"2024-09-12T17:30:02.964368+0000","last_active":"2024-09-12T18:06:08.309864+0000","last_peered":"2024-09-12T18:06:08.309864+0000","last_clean":"2024-09-12T18:06:08.309864+0000","last_became_active":"2024-09-12T17:30:02.964082+0000","last_became_peered":"2024-09-12T17:30:02.964082+0000","last_unstale":"2024-09-12T18:06:08.309864+0000","last_undegraded":"2024-09-12T18:06:08.309864+0000","last_fullsized":"2024-09-12T18:06:08.309864+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:51.607971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":313,"num_read_kb":292,"num_write":397,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'219","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.313861+0000","last_change":"2024-09-12T17:29:54.945900+0000","last_active":"2024-09-12T18:06:01.313861+0000","last_peered":"2024-09-12T18:06:01.313861+0000","last_clean":"2024-09-12T18:06:01.313861+0000","last_became_active":"2024-09-12T17:29:54.945602+0000","last_became_peered":"2024-09-12T17:29:54.945602+0000","last_unstale":"2024-09-12T18:06:01.313861+0000","last_undegraded":"2024-09-12T18:06:01.313861+0000","last_fullsized":"2024-09-12T18:06:01.313861+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:32.630682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":778,"num_write":336,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'195","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.792203+0000","last_change":"2024-09-12T17:29:52.954797+0000","last_active":"2024-09-12T18:05:30.792203+0000","last_peered":"2024-09-12T18:05:30.792203+0000","last_clean":"2024-09-12T18:05:30.792203+0000","last_became_active":"2024-09-12T17:29:52.954457+0000","last_became_peered":"2024-09-12T17:29:52.954457+0000","last_unstale":"2024-09-12T18:05:30.792203+0000","last_undegraded":"2024-09-12T18:05:30.792203+0000","last_fullsized":"2024-09-12T18:05:30.792203+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:04.967724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10811276,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":410,"num_read_kb":114782,"num_write":974,"num_write_kb":45150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.504802+0000","last_change":"2024-09-12T17:29:56.953213+0000","last_active":"2024-09-12T18:03:49.504802+0000","last_peered":"2024-09-12T18:03:49.504802+0000","last_clean":"2024-09-12T18:03:49.504802+0000","last_became_active":"2024-09-12T17:29:56.952946+0000","last_became_peered":"2024-09-12T17:29:56.952946+0000","last_unstale":"2024-09-12T18:03:49.504802+0000","last_undegraded":"2024-09-12T18:03:49.504802+0000","last_fullsized":"2024-09-12T18:03:49.504802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:44.459531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'101","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:29.551281+0000","last_change":"2024-09-12T17:29:58.956494+0000","last_active":"2024-09-12T18:07:29.551281+0000","last_peered":"2024-09-12T18:07:29.551281+0000","last_clean":"2024-09-12T18:07:29.551281+0000","last_became_active":"2024-09-12T17:29:58.953283+0000","last_became_peered":"2024-09-12T17:29:58.953283+0000","last_unstale":"2024-09-12T18:07:29.551281+0000","last_undegraded":"2024-09-12T18:07:29.551281+0000","last_fullsized":"2024-09-12T18:07:29.551281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:18.253475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12298,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":145,"num_write":56,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.515722+0000","last_change":"2024-09-12T17:30:00.963002+0000","last_active":"2024-09-12T18:05:04.515722+0000","last_peered":"2024-09-12T18:05:04.515722+0000","last_clean":"2024-09-12T18:05:04.515722+0000","last_became_active":"2024-09-12T17:30:00.962703+0000","last_became_peered":"2024-09-12T17:30:00.962703+0000","last_unstale":"2024-09-12T18:05:04.515722+0000","last_undegraded":"2024-09-12T18:05:04.515722+0000","last_fullsized":"2024-09-12T18:05:04.515722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:05.219468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'181","reported_seq":1637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.718070+0000","last_change":"2024-09-12T17:30:02.970877+0000","last_active":"2024-09-12T18:06:19.718070+0000","last_peered":"2024-09-12T18:06:19.718070+0000","last_clean":"2024-09-12T18:06:19.718070+0000","last_became_active":"2024-09-12T17:30:02.970633+0000","last_became_peered":"2024-09-12T17:30:02.970633+0000","last_unstale":"2024-09-12T18:06:19.718070+0000","last_undegraded":"2024-09-12T18:06:19.718070+0000","last_fullsized":"2024-09-12T18:06:19.718070+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:13.976443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1219,"num_read_kb":1215,"num_write":406,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'173","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.446097+0000","last_change":"2024-09-12T17:29:54.955106+0000","last_active":"2024-09-12T18:06:06.446097+0000","last_peered":"2024-09-12T18:06:06.446097+0000","last_clean":"2024-09-12T18:06:06.446097+0000","last_became_active":"2024-09-12T17:29:54.954585+0000","last_became_peered":"2024-09-12T17:29:54.954585+0000","last_unstale":"2024-09-12T18:06:06.446097+0000","last_undegraded":"2024-09-12T18:06:06.446097+0000","last_fullsized":"2024-09-12T18:06:06.446097+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:16.804269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":606,"num_write":278,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'196","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.947535+0000","last_change":"2024-09-12T17:29:52.957088+0000","last_active":"2024-09-12T18:06:08.947535+0000","last_peered":"2024-09-12T18:06:08.947535+0000","last_clean":"2024-09-12T18:06:08.947535+0000","last_became_active":"2024-09-12T17:29:52.956621+0000","last_became_peered":"2024-09-12T17:29:52.956621+0000","last_unstale":"2024-09-12T18:06:08.947535+0000","last_undegraded":"2024-09-12T18:06:08.947535+0000","last_fullsized":"2024-09-12T18:06:08.947535+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:04.500292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13590676,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":906,"num_read_kb":17688,"num_write":1017,"num_write_kb":27781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633423+0000","last_change":"2024-09-12T17:29:56.955247+0000","last_active":"2024-09-12T18:03:54.633423+0000","last_peered":"2024-09-12T18:03:54.633423+0000","last_clean":"2024-09-12T18:03:54.633423+0000","last_became_active":"2024-09-12T17:29:56.954952+0000","last_became_peered":"2024-09-12T17:29:56.954952+0000","last_unstale":"2024-09-12T18:03:54.633423+0000","last_undegraded":"2024-09-12T18:03:54.633423+0000","last_fullsized":"2024-09-12T18:03:54.633423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:49.854222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'134","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:29.536122+0000","last_change":"2024-09-12T17:29:58.953367+0000","last_active":"2024-09-12T18:07:29.536122+0000","last_peered":"2024-09-12T18:07:29.536122+0000","last_clean":"2024-09-12T18:07:29.536122+0000","last_became_active":"2024-09-12T17:29:58.953076+0000","last_became_peered":"2024-09-12T17:29:58.953076+0000","last_unstale":"2024-09-12T18:07:29.536122+0000","last_undegraded":"2024-09-12T18:07:29.536122+0000","last_fullsized":"2024-09-12T18:07:29.536122+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:10.729622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11140,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":195,"num_read_kb":267,"num_write":108,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644366+0000","last_change":"2024-09-12T17:30:00.967059+0000","last_active":"2024-09-12T18:05:04.644366+0000","last_peered":"2024-09-12T18:05:04.644366+0000","last_clean":"2024-09-12T18:05:04.644366+0000","last_became_active":"2024-09-12T17:30:00.964942+0000","last_became_peered":"2024-09-12T17:30:00.964942+0000","last_unstale":"2024-09-12T18:05:04.644366+0000","last_undegraded":"2024-09-12T18:05:04.644366+0000","last_fullsized":"2024-09-12T18:05:04.644366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:59.160654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'116","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.763230+0000","last_change":"2024-09-12T17:30:02.969660+0000","last_active":"2024-09-12T18:07:37.763230+0000","last_peered":"2024-09-12T18:07:37.763230+0000","last_clean":"2024-09-12T18:07:37.763230+0000","last_became_active":"2024-09-12T17:30:02.969327+0000","last_became_peered":"2024-09-12T17:30:02.969327+0000","last_unstale":"2024-09-12T18:07:37.763230+0000","last_undegraded":"2024-09-12T18:07:37.763230+0000","last_fullsized":"2024-09-12T18:07:37.763230+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:11.229944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":150,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'198","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:02.136940+0000","last_change":"2024-09-12T17:29:54.956426+0000","last_active":"2024-09-12T18:06:02.136940+0000","last_peered":"2024-09-12T18:06:02.136940+0000","last_clean":"2024-09-12T18:06:02.136940+0000","last_became_active":"2024-09-12T17:29:54.956020+0000","last_became_peered":"2024-09-12T17:29:54.956020+0000","last_unstale":"2024-09-12T18:06:02.136940+0000","last_undegraded":"2024-09-12T18:06:02.136940+0000","last_fullsized":"2024-09-12T18:06:02.136940+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:46.756727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":702,"num_write":286,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'207","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.184629+0000","last_change":"2024-09-12T17:29:52.963730+0000","last_active":"2024-09-12T18:05:30.184629+0000","last_peered":"2024-09-12T18:05:30.184629+0000","last_clean":"2024-09-12T18:05:30.184629+0000","last_became_active":"2024-09-12T17:29:52.963118+0000","last_became_peered":"2024-09-12T17:29:52.963118+0000","last_unstale":"2024-09-12T18:05:30.184629+0000","last_undegraded":"2024-09-12T18:05:30.184629+0000","last_fullsized":"2024-09-12T18:05:30.184629+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:48.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5675346,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":2786,"num_write":993,"num_write_kb":44194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'222","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:27.059176+0000","last_change":"2024-09-12T17:29:54.947947+0000","last_active":"2024-09-12T18:05:27.059176+0000","last_peered":"2024-09-12T18:05:27.059176+0000","last_clean":"2024-09-12T18:05:27.059176+0000","last_became_active":"2024-09-12T17:29:54.947659+0000","last_became_peered":"2024-09-12T17:29:54.947659+0000","last_unstale":"2024-09-12T18:05:27.059176+0000","last_undegraded":"2024-09-12T18:05:27.059176+0000","last_fullsized":"2024-09-12T18:05:27.059176+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:03.080124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":954,"num_read_kb":780,"num_write":336,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'185","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:28.835935+0000","last_change":"2024-09-12T17:29:52.955863+0000","last_active":"2024-09-12T18:07:28.835935+0000","last_peered":"2024-09-12T18:07:28.835935+0000","last_clean":"2024-09-12T18:07:28.835935+0000","last_became_active":"2024-09-12T17:29:52.955546+0000","last_became_peered":"2024-09-12T17:29:52.955546+0000","last_unstale":"2024-09-12T18:07:28.835935+0000","last_undegraded":"2024-09-12T18:07:28.835935+0000","last_fullsized":"2024-09-12T18:07:28.835935+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:42.412076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10957292,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":626,"num_read_kb":171668,"num_write":900,"num_write_kb":49213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'156","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.113845+0000","last_change":"2024-09-12T17:29:54.958380+0000","last_active":"2024-09-12T18:06:09.113845+0000","last_peered":"2024-09-12T18:06:09.113845+0000","last_clean":"2024-09-12T18:06:09.113845+0000","last_became_active":"2024-09-12T17:29:54.958047+0000","last_became_peered":"2024-09-12T17:29:54.958047+0000","last_unstale":"2024-09-12T18:06:09.113845+0000","last_undegraded":"2024-09-12T18:06:09.113845+0000","last_fullsized":"2024-09-12T18:06:09.113845+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:44.328756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":718,"num_read_kb":592,"num_write":271,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'176","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.113932+0000","last_change":"2024-09-12T17:29:52.960525+0000","last_active":"2024-09-12T18:06:01.113932+0000","last_peered":"2024-09-12T18:06:01.113932+0000","last_clean":"2024-09-12T18:06:01.113932+0000","last_became_active":"2024-09-12T17:29:52.955924+0000","last_became_peered":"2024-09-12T17:29:52.955924+0000","last_unstale":"2024-09-12T18:06:01.113932+0000","last_undegraded":"2024-09-12T18:06:01.113932+0000","last_fullsized":"2024-09-12T18:06:01.113932+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:05.866424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4133406,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":445,"num_read_kb":86465,"num_write":875,"num_write_kb":34463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'67","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.807467+0000","last_change":"2024-09-12T17:29:54.956853+0000","last_active":"2024-09-12T18:05:09.807467+0000","last_peered":"2024-09-12T18:05:09.807467+0000","last_clean":"2024-09-12T18:05:09.807467+0000","last_became_active":"2024-09-12T17:29:54.956587+0000","last_became_peered":"2024-09-12T17:29:54.956587+0000","last_unstale":"2024-09-12T18:05:09.807467+0000","last_undegraded":"2024-09-12T18:05:09.807467+0000","last_fullsized":"2024-09-12T18:05:09.807467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:30.162589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":238,"num_write":111,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'188","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.507312+0000","last_change":"2024-09-12T17:29:52.961431+0000","last_active":"2024-09-12T18:05:29.507312+0000","last_peered":"2024-09-12T18:05:29.507312+0000","last_clean":"2024-09-12T18:05:29.507312+0000","last_became_active":"2024-09-12T17:29:52.961103+0000","last_became_peered":"2024-09-12T17:29:52.961103+0000","last_unstale":"2024-09-12T18:05:29.507312+0000","last_undegraded":"2024-09-12T18:05:29.507312+0000","last_fullsized":"2024-09-12T18:05:29.507312+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:36.469288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11159765,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":887,"num_read_kb":61034,"num_write":898,"num_write_kb":21974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'80","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.348999+0000","last_change":"2024-09-12T17:29:54.956259+0000","last_active":"2024-09-12T18:05:57.348999+0000","last_peered":"2024-09-12T18:05:57.348999+0000","last_clean":"2024-09-12T18:05:57.348999+0000","last_became_active":"2024-09-12T17:29:54.955986+0000","last_became_peered":"2024-09-12T17:29:54.955986+0000","last_unstale":"2024-09-12T18:05:57.348999+0000","last_undegraded":"2024-09-12T18:05:57.348999+0000","last_fullsized":"2024-09-12T18:05:57.348999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:45.758007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":303,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'230","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.138167+0000","last_change":"2024-09-12T17:31:28.509450+0000","last_active":"2024-09-12T18:06:08.138167+0000","last_peered":"2024-09-12T18:06:08.138167+0000","last_clean":"2024-09-12T18:06:08.138167+0000","last_became_active":"2024-09-12T17:31:28.509017+0000","last_became_peered":"2024-09-12T17:31:28.509017+0000","last_unstale":"2024-09-12T18:06:08.138167+0000","last_undegraded":"2024-09-12T18:06:08.138167+0000","last_fullsized":"2024-09-12T18:06:08.138167+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:24.346593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41098116,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":497,"num_read_kb":51267,"num_write":1099,"num_write_kb":73287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"264'52","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.531280+0000","last_change":"2024-09-12T17:29:54.957796+0000","last_active":"2024-09-12T18:05:57.531280+0000","last_peered":"2024-09-12T18:05:57.531280+0000","last_clean":"2024-09-12T18:05:57.531280+0000","last_became_active":"2024-09-12T17:29:54.957480+0000","last_became_peered":"2024-09-12T17:29:54.957480+0000","last_unstale":"2024-09-12T18:05:57.531280+0000","last_undegraded":"2024-09-12T18:05:57.531280+0000","last_fullsized":"2024-09-12T18:05:57.531280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:21.784834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":218,"num_write":68,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'170","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:27.136141+0000","last_change":"2024-09-12T17:29:52.946263+0000","last_active":"2024-09-12T18:05:27.136141+0000","last_peered":"2024-09-12T18:05:27.136141+0000","last_clean":"2024-09-12T18:05:27.136141+0000","last_became_active":"2024-09-12T17:29:52.945750+0000","last_became_peered":"2024-09-12T17:29:52.945750+0000","last_unstale":"2024-09-12T18:05:27.136141+0000","last_undegraded":"2024-09-12T18:05:27.136141+0000","last_fullsized":"2024-09-12T18:05:27.136141+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:34.049238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505957,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":12063,"num_write":841,"num_write_kb":23165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'78","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.533490+0000","last_change":"2024-09-12T17:29:54.950489+0000","last_active":"2024-09-12T18:05:19.533490+0000","last_peered":"2024-09-12T18:05:19.533490+0000","last_clean":"2024-09-12T18:05:19.533490+0000","last_became_active":"2024-09-12T17:29:54.949704+0000","last_became_peered":"2024-09-12T17:29:54.949704+0000","last_unstale":"2024-09-12T18:05:19.533490+0000","last_undegraded":"2024-09-12T18:05:19.533490+0000","last_fullsized":"2024-09-12T18:05:19.533490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:17.371079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":312,"num_write":123,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'199","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.031221+0000","last_change":"2024-09-12T17:29:52.961104+0000","last_active":"2024-09-12T18:07:37.031221+0000","last_peered":"2024-09-12T18:07:37.031221+0000","last_clean":"2024-09-12T18:07:37.031221+0000","last_became_active":"2024-09-12T17:29:52.960336+0000","last_became_peered":"2024-09-12T17:29:52.960336+0000","last_unstale":"2024-09-12T18:07:37.031221+0000","last_undegraded":"2024-09-12T18:07:37.031221+0000","last_fullsized":"2024-09-12T18:07:37.031221+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:31.941705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16275719,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":506,"num_read_kb":45667,"num_write":958,"num_write_kb":42266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'76","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517786+0000","last_change":"2024-09-12T17:29:54.956588+0000","last_active":"2024-09-12T18:05:19.517786+0000","last_peered":"2024-09-12T18:05:19.517786+0000","last_clean":"2024-09-12T18:05:19.517786+0000","last_became_active":"2024-09-12T17:29:54.956296+0000","last_became_peered":"2024-09-12T17:29:54.956296+0000","last_unstale":"2024-09-12T18:05:19.517786+0000","last_undegraded":"2024-09-12T18:05:19.517786+0000","last_fullsized":"2024-09-12T18:05:19.517786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:05.987373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":291,"num_write":101,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'195","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:18.481264+0000","last_change":"2024-09-12T17:29:52.953430+0000","last_active":"2024-09-12T18:05:18.481264+0000","last_peered":"2024-09-12T18:05:18.481264+0000","last_clean":"2024-09-12T18:05:18.481264+0000","last_became_active":"2024-09-12T17:29:52.953110+0000","last_became_peered":"2024-09-12T17:29:52.953110+0000","last_unstale":"2024-09-12T18:05:18.481264+0000","last_undegraded":"2024-09-12T18:05:18.481264+0000","last_fullsized":"2024-09-12T18:05:18.481264+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:17.347005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12859753,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":433,"num_read_kb":64376,"num_write":924,"num_write_kb":39967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'142","reported_seq":727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.024368+0000","last_change":"2024-09-12T17:29:54.945058+0000","last_active":"2024-09-12T18:06:06.024368+0000","last_peered":"2024-09-12T18:06:06.024368+0000","last_clean":"2024-09-12T18:06:06.024368+0000","last_became_active":"2024-09-12T17:29:54.944775+0000","last_became_peered":"2024-09-12T17:29:54.944775+0000","last_unstale":"2024-09-12T18:06:06.024368+0000","last_undegraded":"2024-09-12T18:06:06.024368+0000","last_fullsized":"2024-09-12T18:06:06.024368+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:36.057705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":576,"num_read_kb":470,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'232","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.738541+0000","last_change":"2024-09-12T17:29:52.953267+0000","last_active":"2024-09-12T18:06:08.738541+0000","last_peered":"2024-09-12T18:06:08.738541+0000","last_clean":"2024-09-12T18:06:08.738541+0000","last_became_active":"2024-09-12T17:29:52.952892+0000","last_became_peered":"2024-09-12T17:29:52.952892+0000","last_unstale":"2024-09-12T18:06:08.738541+0000","last_undegraded":"2024-09-12T18:06:08.738541+0000","last_fullsized":"2024-09-12T18:06:08.738541+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:09.264458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13312570,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":794,"num_read_kb":90532,"num_write":1288,"num_write_kb":28113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'4190","reported_seq":4816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.965248+0000","last_change":"2024-09-12T17:29:54.956378+0000","last_active":"2024-09-12T18:06:01.965248+0000","last_peered":"2024-09-12T18:06:01.965248+0000","last_clean":"2024-09-12T18:06:01.965248+0000","last_became_active":"2024-09-12T17:29:54.956030+0000","last_became_peered":"2024-09-12T17:29:54.956030+0000","last_unstale":"2024-09-12T18:06:01.965248+0000","last_undegraded":"2024-09-12T18:06:01.965248+0000","last_fullsized":"2024-09-12T18:06:01.965248+0000","mapping_epoch":26,"log_start":"264'4100","ondisk_log_start":"264'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":3000,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:59.132944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16971,"num_read_kb":14174,"num_write":6344,"num_write_kb":3204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'193","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.709664+0000","last_change":"2024-09-12T17:29:52.955756+0000","last_active":"2024-09-12T18:06:06.709664+0000","last_peered":"2024-09-12T18:06:06.709664+0000","last_clean":"2024-09-12T18:06:06.709664+0000","last_became_active":"2024-09-12T17:29:52.953694+0000","last_became_peered":"2024-09-12T17:29:52.953694+0000","last_unstale":"2024-09-12T18:06:06.709664+0000","last_undegraded":"2024-09-12T18:06:06.709664+0000","last_fullsized":"2024-09-12T18:06:06.709664+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:25.200873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13436243,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":421,"num_read_kb":9241,"num_write":943,"num_write_kb":54194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'298","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.645212+0000","last_change":"2024-09-12T17:29:54.954876+0000","last_active":"2024-09-12T18:05:55.645212+0000","last_peered":"2024-09-12T18:05:55.645212+0000","last_clean":"2024-09-12T18:05:55.645212+0000","last_became_active":"2024-09-12T17:29:54.954593+0000","last_became_peered":"2024-09-12T17:29:54.954593+0000","last_unstale":"2024-09-12T18:05:55.645212+0000","last_undegraded":"2024-09-12T18:05:55.645212+0000","last_fullsized":"2024-09-12T18:05:55.645212+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:15.447562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1407,"num_read_kb":1154,"num_write":474,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'208","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.674515+0000","last_change":"2024-09-12T17:29:52.959010+0000","last_active":"2024-09-12T18:06:01.674515+0000","last_peered":"2024-09-12T18:06:01.674515+0000","last_clean":"2024-09-12T18:06:01.674515+0000","last_became_active":"2024-09-12T17:29:52.958021+0000","last_became_peered":"2024-09-12T17:29:52.958021+0000","last_unstale":"2024-09-12T18:06:01.674515+0000","last_undegraded":"2024-09-12T18:06:01.674515+0000","last_fullsized":"2024-09-12T18:06:01.674515+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:23.137050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15903366,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":26305,"num_write":959,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'301","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:12.095784+0000","last_change":"2024-09-12T17:29:54.957925+0000","last_active":"2024-09-12T18:05:12.095784+0000","last_peered":"2024-09-12T18:05:12.095784+0000","last_clean":"2024-09-12T18:05:12.095784+0000","last_became_active":"2024-09-12T17:29:54.957636+0000","last_became_peered":"2024-09-12T17:29:54.957636+0000","last_unstale":"2024-09-12T18:05:12.095784+0000","last_undegraded":"2024-09-12T18:05:12.095784+0000","last_fullsized":"2024-09-12T18:05:12.095784+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:31.541263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1037,"num_write":475,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'225","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.677629+0000","last_change":"2024-09-12T17:29:52.966860+0000","last_active":"2024-09-12T18:05:59.677629+0000","last_peered":"2024-09-12T18:05:59.677629+0000","last_clean":"2024-09-12T18:05:59.677629+0000","last_became_active":"2024-09-12T17:29:52.966500+0000","last_became_peered":"2024-09-12T17:29:52.966500+0000","last_unstale":"2024-09-12T18:05:59.677629+0000","last_undegraded":"2024-09-12T18:05:59.677629+0000","last_fullsized":"2024-09-12T18:05:59.677629+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:52.632541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5504834,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":34941,"num_write":1116,"num_write_kb":28764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'173","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.713791+0000","last_change":"2024-09-12T17:30:28.010302+0000","last_active":"2024-09-12T18:06:07.713791+0000","last_peered":"2024-09-12T18:06:07.713791+0000","last_clean":"2024-09-12T18:06:07.713791+0000","last_became_active":"2024-09-12T17:30:28.010055+0000","last_became_peered":"2024-09-12T17:30:28.010055+0000","last_unstale":"2024-09-12T18:06:07.713791+0000","last_undegraded":"2024-09-12T18:06:07.713791+0000","last_fullsized":"2024-09-12T18:06:07.713791+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:49.191682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":614,"num_write":281,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'196","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.536940+0000","last_change":"2024-09-12T17:29:52.954562+0000","last_active":"2024-09-12T18:05:24.536940+0000","last_peered":"2024-09-12T18:05:24.536940+0000","last_clean":"2024-09-12T18:05:24.536940+0000","last_became_active":"2024-09-12T17:29:52.954238+0000","last_became_peered":"2024-09-12T17:29:52.954238+0000","last_unstale":"2024-09-12T18:05:24.536940+0000","last_undegraded":"2024-09-12T18:05:24.536940+0000","last_fullsized":"2024-09-12T18:05:24.536940+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:31.094284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874420,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":33290,"num_write":853,"num_write_kb":39696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'173","reported_seq":736,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.661699+0000","last_change":"2024-09-12T17:29:54.944911+0000","last_active":"2024-09-12T18:06:08.661699+0000","last_peered":"2024-09-12T18:06:08.661699+0000","last_clean":"2024-09-12T18:06:08.661699+0000","last_became_active":"2024-09-12T17:29:54.944623+0000","last_became_peered":"2024-09-12T17:29:54.944623+0000","last_unstale":"2024-09-12T18:06:08.661699+0000","last_undegraded":"2024-09-12T18:06:08.661699+0000","last_fullsized":"2024-09-12T18:06:08.661699+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:42.419447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":587,"num_write":256,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'215","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.019643+0000","last_change":"2024-09-12T17:29:52.952178+0000","last_active":"2024-09-12T18:06:07.019643+0000","last_peered":"2024-09-12T18:06:07.019643+0000","last_clean":"2024-09-12T18:06:07.019643+0000","last_became_active":"2024-09-12T17:29:52.951819+0000","last_became_peered":"2024-09-12T17:29:52.951819+0000","last_unstale":"2024-09-12T18:06:07.019643+0000","last_undegraded":"2024-09-12T18:06:07.019643+0000","last_fullsized":"2024-09-12T18:06:07.019643+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:53.052744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2432528,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":4445,"num_write":1037,"num_write_kb":38455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'247","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:02.429830+0000","last_change":"2024-09-12T17:29:54.952227+0000","last_active":"2024-09-12T18:06:02.429830+0000","last_peered":"2024-09-12T18:06:02.429830+0000","last_clean":"2024-09-12T18:06:02.429830+0000","last_became_active":"2024-09-12T17:29:54.950941+0000","last_became_peered":"2024-09-12T17:29:54.950941+0000","last_unstale":"2024-09-12T18:06:02.429830+0000","last_undegraded":"2024-09-12T18:06:02.429830+0000","last_fullsized":"2024-09-12T18:06:02.429830+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:47.854196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":842,"num_write":398,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'203","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.640910+0000","last_change":"2024-09-12T17:29:52.953913+0000","last_active":"2024-09-12T18:04:54.640910+0000","last_peered":"2024-09-12T18:04:54.640910+0000","last_clean":"2024-09-12T18:04:54.640910+0000","last_became_active":"2024-09-12T17:29:52.953569+0000","last_became_peered":"2024-09-12T17:29:52.953569+0000","last_unstale":"2024-09-12T18:04:54.640910+0000","last_undegraded":"2024-09-12T18:04:54.640910+0000","last_fullsized":"2024-09-12T18:04:54.640910+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:45.959383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2568203,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":11537,"num_write":1035,"num_write_kb":39628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'119","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.659784+0000","last_change":"2024-09-12T17:29:54.961906+0000","last_active":"2024-09-12T18:05:52.659784+0000","last_peered":"2024-09-12T18:05:52.659784+0000","last_clean":"2024-09-12T18:05:52.659784+0000","last_became_active":"2024-09-12T17:29:54.961615+0000","last_became_peered":"2024-09-12T17:29:54.961615+0000","last_unstale":"2024-09-12T18:05:52.659784+0000","last_undegraded":"2024-09-12T18:05:52.659784+0000","last_fullsized":"2024-09-12T18:05:52.659784+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:47.744907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":544,"num_read_kb":456,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'259","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.188541+0000","last_change":"2024-09-12T17:29:52.956926+0000","last_active":"2024-09-12T18:06:06.188541+0000","last_peered":"2024-09-12T18:06:06.188541+0000","last_clean":"2024-09-12T18:06:06.188541+0000","last_became_active":"2024-09-12T17:29:52.954363+0000","last_became_peered":"2024-09-12T17:29:52.954363+0000","last_unstale":"2024-09-12T18:06:06.188541+0000","last_undegraded":"2024-09-12T18:06:06.188541+0000","last_fullsized":"2024-09-12T18:06:06.188541+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:03.699758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12188635,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":605,"num_read_kb":60789,"num_write":1178,"num_write_kb":24093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'148","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.787667+0000","last_change":"2024-09-12T17:29:52.953182+0000","last_active":"2024-09-12T18:06:07.787667+0000","last_peered":"2024-09-12T18:06:07.787667+0000","last_clean":"2024-09-12T18:06:07.787667+0000","last_became_active":"2024-09-12T17:29:52.952766+0000","last_became_peered":"2024-09-12T17:29:52.952766+0000","last_unstale":"2024-09-12T18:06:07.787667+0000","last_undegraded":"2024-09-12T18:06:07.787667+0000","last_fullsized":"2024-09-12T18:06:07.787667+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:33.543180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20385387,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":390,"num_read_kb":30421,"num_write":774,"num_write_kb":28733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'81","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.545153+0000","last_change":"2024-09-12T17:29:54.944959+0000","last_active":"2024-09-12T18:05:52.545153+0000","last_peered":"2024-09-12T18:05:52.545153+0000","last_clean":"2024-09-12T18:05:52.545153+0000","last_became_active":"2024-09-12T17:29:54.944681+0000","last_became_peered":"2024-09-12T17:29:54.944681+0000","last_unstale":"2024-09-12T18:05:52.545153+0000","last_undegraded":"2024-09-12T18:05:52.545153+0000","last_fullsized":"2024-09-12T18:05:52.545153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:39.628805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":330,"num_write":124,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'185","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.255368+0000","last_change":"2024-09-12T17:29:52.942936+0000","last_active":"2024-09-12T18:06:19.255368+0000","last_peered":"2024-09-12T18:06:19.255368+0000","last_clean":"2024-09-12T18:06:19.255368+0000","last_became_active":"2024-09-12T17:29:52.942331+0000","last_became_peered":"2024-09-12T17:29:52.942331+0000","last_unstale":"2024-09-12T18:06:19.255368+0000","last_undegraded":"2024-09-12T18:06:19.255368+0000","last_fullsized":"2024-09-12T18:06:19.255368+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:29.868639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4365672,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":15046,"num_write":965,"num_write_kb":38540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'194","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.022497+0000","last_change":"2024-09-12T17:29:54.963259+0000","last_active":"2024-09-12T18:05:56.022497+0000","last_peered":"2024-09-12T18:05:56.022497+0000","last_clean":"2024-09-12T18:05:56.022497+0000","last_became_active":"2024-09-12T17:29:54.962921+0000","last_became_peered":"2024-09-12T17:29:54.962921+0000","last_unstale":"2024-09-12T18:05:56.022497+0000","last_undegraded":"2024-09-12T18:05:56.022497+0000","last_fullsized":"2024-09-12T18:05:56.022497+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:02.447215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":851,"num_read_kb":702,"num_write":304,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":4389,"num_write":1992,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1063,"ondisk_log_size":1063,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":16199,"num_read_kb":15887,"num_write":16770,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1852,"ondisk_log_size":1852,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":469,"ondisk_log_size":469,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":371539,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7530,"num_read_kb":9197,"num_write":5063,"num_write_kb":2472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":696320,"data_stored":191346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1997,"ondisk_log_size":1997,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2394,"num_read_kb":2858,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102452,"num_read_kb":85292,"num_write":37168,"num_write_kb":18720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4224,"ondisk_log_size":4224,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":623432097,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":474,"num_whiteouts":0,"num_read":32696,"num_read_kb":2424166,"num_write":62705,"num_write_kb":2261412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":938360832,"data_stored":938360832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4590,"ondisk_log_size":4590,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":85054806,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":124,"num_read_kb":207617,"num_write":141,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170115072,"data_stored":170109612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":85054806,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":121,"num_read_kb":201926,"num_write":141,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170115072,"data_stored":170109612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542610,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316056,"kb_used_data":96072,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94055784,"statfs":{"total":96636764160,"available":96313122816,"internally_reserved":0,"allocated":98377728,"data_stored":96341523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542609,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409564,"kb_used_data":189580,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93962276,"statfs":{"total":96636764160,"available":96217370624,"internally_reserved":0,"allocated":194129920,"data_stored":192165815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542611,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252852,"kb_used_data":159268,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94118988,"statfs":{"total":96636764160,"available":96377843712,"internally_reserved":0,"allocated":163090432,"data_stored":161046070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542610,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238164,"kb_used_data":170884,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94133676,"statfs":{"total":96636764160,"available":96392884224,"internally_reserved":0,"allocated":174985216,"data_stored":173066278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542608,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429780,"kb_used_data":200068,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93942060,"statfs":{"total":96636764160,"available":96196669440,"internally_reserved":0,"allocated":204869632,"data_stored":202846428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542609,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217292,"kb_used_data":132028,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94154548,"statfs":{"total":96636764160,"available":96414257152,"internally_reserved":0,"allocated":135196672,"data_stored":133257194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542610,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255836,"kb_used_data":148364,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94116004,"statfs":{"total":96636764160,"available":96374788096,"internally_reserved":0,"allocated":151924736,"data_stored":149927987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542609,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":420896,"kb_used_data":187024,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93950944,"statfs":{"total":96636764160,"available":96205766656,"internally_reserved":0,"allocated":191512576,"data_stored":189506297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":138264576,"data_stored":138264576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":88326144,"data_stored":88326144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":92172288,"data_stored":92172288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":133304320,"data_stored":133304320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":133967872,"data_stored":133967872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":140910592,"data_stored":140910592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":134758400,"data_stored":134758400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":76656640,"data_stored":76656640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":19594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":21787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":10890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":36226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":34789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":22099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":42141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30994432,"data_stored":30993067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28897280,"data_stored":28895915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13168640,"data_stored":13167275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24117248,"data_stored":24117248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24702976,"data_stored":24701611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28311552,"data_stored":28311552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38334464,"data_stored":38333099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":30994432,"data_stored":30993067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:08:04.366 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:08:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:08:04.699 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-09-12T18:08:04.702 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":1411,"stamp":"2024-09-12T18:08:03.281802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":794521547,"num_objects":843,"num_object_clones":0,"num_object_copies":2160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":843,"num_whiteouts":0,"num_read":167731,"num_read_kb":2951399,"num_write":124121,"num_write_kb":2564852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14449,"ondisk_log_size":14449,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2540440,"kb_used_data":1283288,"kb_used_omap":12,"kb_used_meta":1257011,"kb_avail":752434280,"statfs":{"total":773094113280,"available":770492702720,"internally_reserved":0,"allocated":1314086912,"data_stored":1298157592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1287179826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005475"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.634310+0000","last_change":"2024-09-12T17:57:00.464809+0000","last_active":"2024-09-12T18:04:29.634310+0000","last_peered":"2024-09-12T18:04:29.634310+0000","last_clean":"2024-09-12T18:04:29.634310+0000","last_became_active":"2024-09-12T17:57:00.464331+0000","last_became_peered":"2024-09-12T17:57:00.464331+0000","last_unstale":"2024-09-12T18:04:29.634310+0000","last_undegraded":"2024-09-12T18:04:29.634310+0000","last_fullsized":"2024-09-12T18:04:29.634310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:20.663580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.631990+0000","last_change":"2024-09-12T17:46:45.211816+0000","last_active":"2024-09-12T18:04:14.631990+0000","last_peered":"2024-09-12T18:04:14.631990+0000","last_clean":"2024-09-12T18:04:14.631990+0000","last_became_active":"2024-09-12T17:46:45.211533+0000","last_became_peered":"2024-09-12T17:46:45.211533+0000","last_unstale":"2024-09-12T18:04:14.631990+0000","last_undegraded":"2024-09-12T18:04:14.631990+0000","last_fullsized":"2024-09-12T18:04:14.631990+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:29.748663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519223+0000","last_change":"2024-09-12T17:46:42.179842+0000","last_active":"2024-09-12T18:04:14.519223+0000","last_peered":"2024-09-12T18:04:14.519223+0000","last_clean":"2024-09-12T18:04:14.519223+0000","last_became_active":"2024-09-12T17:46:42.179372+0000","last_became_peered":"2024-09-12T17:46:42.179372+0000","last_unstale":"2024-09-12T18:04:14.519223+0000","last_undegraded":"2024-09-12T18:04:14.519223+0000","last_fullsized":"2024-09-12T18:04:14.519223+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:29.561145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6875819,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6715,"num_write":3,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'32","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.172145+0000","last_change":"2024-09-12T17:45:03.890371+0000","last_active":"2024-09-12T18:05:55.172145+0000","last_peered":"2024-09-12T18:05:55.172145+0000","last_clean":"2024-09-12T18:05:55.172145+0000","last_became_active":"2024-09-12T17:45:03.890104+0000","last_became_peered":"2024-09-12T17:45:03.890104+0000","last_unstale":"2024-09-12T18:05:55.172145+0000","last_undegraded":"2024-09-12T18:05:55.172145+0000","last_fullsized":"2024-09-12T18:05:55.172145+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:20.406460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":111,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.637454+0000","last_change":"2024-09-12T17:57:00.466568+0000","last_active":"2024-09-12T18:04:29.637454+0000","last_peered":"2024-09-12T18:04:29.637454+0000","last_clean":"2024-09-12T18:04:29.637454+0000","last_became_active":"2024-09-12T17:57:00.466304+0000","last_became_peered":"2024-09-12T17:57:00.466304+0000","last_unstale":"2024-09-12T18:04:29.637454+0000","last_undegraded":"2024-09-12T18:04:29.637454+0000","last_fullsized":"2024-09-12T18:04:29.637454+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:52.603747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508649+0000","last_change":"2024-09-12T17:46:45.202607+0000","last_active":"2024-09-12T18:04:14.508649+0000","last_peered":"2024-09-12T18:04:14.508649+0000","last_clean":"2024-09-12T18:04:14.508649+0000","last_became_active":"2024-09-12T17:46:45.202290+0000","last_became_peered":"2024-09-12T17:46:45.202290+0000","last_unstale":"2024-09-12T18:04:14.508649+0000","last_undegraded":"2024-09-12T18:04:14.508649+0000","last_fullsized":"2024-09-12T18:04:14.508649+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:30.467678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.636351+0000","last_change":"2024-09-12T17:46:42.177978+0000","last_active":"2024-09-12T18:04:14.636351+0000","last_peered":"2024-09-12T18:04:14.636351+0000","last_clean":"2024-09-12T18:04:14.636351+0000","last_became_active":"2024-09-12T17:46:42.177112+0000","last_became_peered":"2024-09-12T17:46:42.177112+0000","last_unstale":"2024-09-12T18:04:14.636351+0000","last_undegraded":"2024-09-12T18:04:14.636351+0000","last_fullsized":"2024-09-12T18:04:14.636351+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:37.077362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11070123,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":10811,"num_write":15,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'16","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.642269+0000","last_change":"2024-09-12T17:45:03.893271+0000","last_active":"2024-09-12T18:05:04.642269+0000","last_peered":"2024-09-12T18:05:04.642269+0000","last_clean":"2024-09-12T18:05:04.642269+0000","last_became_active":"2024-09-12T17:45:03.893002+0000","last_became_peered":"2024-09-12T17:45:03.893002+0000","last_unstale":"2024-09-12T18:05:04.642269+0000","last_undegraded":"2024-09-12T18:05:04.642269+0000","last_fullsized":"2024-09-12T18:05:04.642269+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:22.163418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508520+0000","last_change":"2024-09-12T17:57:00.457762+0000","last_active":"2024-09-12T18:04:14.508520+0000","last_peered":"2024-09-12T18:04:14.508520+0000","last_clean":"2024-09-12T18:04:14.508520+0000","last_became_active":"2024-09-12T17:57:00.456939+0000","last_became_peered":"2024-09-12T17:57:00.456939+0000","last_unstale":"2024-09-12T18:04:14.508520+0000","last_undegraded":"2024-09-12T18:04:14.508520+0000","last_fullsized":"2024-09-12T18:04:14.508520+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:16.042163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648157+0000","last_change":"2024-09-12T17:46:45.537660+0000","last_active":"2024-09-12T18:05:29.648157+0000","last_peered":"2024-09-12T18:05:29.648157+0000","last_clean":"2024-09-12T18:05:29.648157+0000","last_became_active":"2024-09-12T17:46:45.536920+0000","last_became_peered":"2024-09-12T17:46:45.536920+0000","last_unstale":"2024-09-12T18:05:29.648157+0000","last_undegraded":"2024-09-12T18:05:29.648157+0000","last_fullsized":"2024-09-12T18:05:29.648157+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.487169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639526+0000","last_change":"2024-09-12T17:46:42.186263+0000","last_active":"2024-09-12T18:04:44.639526+0000","last_peered":"2024-09-12T18:04:44.639526+0000","last_clean":"2024-09-12T18:04:44.639526+0000","last_became_active":"2024-09-12T17:46:42.185870+0000","last_became_peered":"2024-09-12T17:46:42.185870+0000","last_unstale":"2024-09-12T18:04:44.639526+0000","last_undegraded":"2024-09-12T18:04:44.639526+0000","last_fullsized":"2024-09-12T18:04:44.639526+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:49.932340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'49","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644429+0000","last_change":"2024-09-12T17:45:03.895036+0000","last_active":"2024-09-12T18:05:04.644429+0000","last_peered":"2024-09-12T18:05:04.644429+0000","last_clean":"2024-09-12T18:05:04.644429+0000","last_became_active":"2024-09-12T17:45:03.894537+0000","last_became_peered":"2024-09-12T17:45:03.894537+0000","last_unstale":"2024-09-12T18:05:04.644429+0000","last_undegraded":"2024-09-12T18:05:04.644429+0000","last_fullsized":"2024-09-12T18:05:04.644429+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:15.446699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":186,"num_write":90,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:19.519960+0000","last_change":"2024-09-12T17:57:00.465664+0000","last_active":"2024-09-12T18:04:19.519960+0000","last_peered":"2024-09-12T18:04:19.519960+0000","last_clean":"2024-09-12T18:04:19.519960+0000","last_became_active":"2024-09-12T17:57:00.464157+0000","last_became_peered":"2024-09-12T17:57:00.464157+0000","last_unstale":"2024-09-12T18:04:19.519960+0000","last_undegraded":"2024-09-12T18:04:19.519960+0000","last_fullsized":"2024-09-12T18:04:19.519960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:27.777117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.524896+0000","last_change":"2024-09-12T17:46:45.538613+0000","last_active":"2024-09-12T18:04:49.524896+0000","last_peered":"2024-09-12T18:04:49.524896+0000","last_clean":"2024-09-12T18:04:49.524896+0000","last_became_active":"2024-09-12T17:46:45.538295+0000","last_became_peered":"2024-09-12T17:46:45.538295+0000","last_unstale":"2024-09-12T18:04:49.524896+0000","last_undegraded":"2024-09-12T18:04:49.524896+0000","last_fullsized":"2024-09-12T18:04:49.524896+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:12.638632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519162+0000","last_change":"2024-09-12T17:46:42.184099+0000","last_active":"2024-09-12T18:05:29.519162+0000","last_peered":"2024-09-12T18:05:29.519162+0000","last_clean":"2024-09-12T18:05:29.519162+0000","last_became_active":"2024-09-12T17:46:42.183792+0000","last_became_peered":"2024-09-12T17:46:42.183792+0000","last_unstale":"2024-09-12T18:05:29.519162+0000","last_undegraded":"2024-09-12T18:05:29.519162+0000","last_fullsized":"2024-09-12T18:05:29.519162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:38.522171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'18","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527497+0000","last_change":"2024-09-12T17:45:03.893407+0000","last_active":"2024-09-12T18:05:04.527497+0000","last_peered":"2024-09-12T18:05:04.527497+0000","last_clean":"2024-09-12T18:05:04.527497+0000","last_became_active":"2024-09-12T17:45:03.893108+0000","last_became_peered":"2024-09-12T17:45:03.893108+0000","last_unstale":"2024-09-12T18:05:04.527497+0000","last_undegraded":"2024-09-12T18:05:04.527497+0000","last_fullsized":"2024-09-12T18:05:04.527497+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:43.333855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":71,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527532+0000","last_change":"2024-09-12T17:57:00.463065+0000","last_active":"2024-09-12T18:05:04.527532+0000","last_peered":"2024-09-12T18:05:04.527532+0000","last_clean":"2024-09-12T18:05:04.527532+0000","last_became_active":"2024-09-12T17:57:00.462657+0000","last_became_peered":"2024-09-12T17:57:00.462657+0000","last_unstale":"2024-09-12T18:05:04.527532+0000","last_undegraded":"2024-09-12T18:05:04.527532+0000","last_fullsized":"2024-09-12T18:05:04.527532+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:24.423220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.627036+0000","last_change":"2024-09-12T17:46:45.210708+0000","last_active":"2024-09-12T18:03:44.627036+0000","last_peered":"2024-09-12T18:03:44.627036+0000","last_clean":"2024-09-12T18:03:44.627036+0000","last_became_active":"2024-09-12T17:46:45.210259+0000","last_became_peered":"2024-09-12T17:46:45.210259+0000","last_unstale":"2024-09-12T18:03:44.627036+0000","last_undegraded":"2024-09-12T18:03:44.627036+0000","last_fullsized":"2024-09-12T18:03:44.627036+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:01.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6189,"num_write":3,"num_write_kb":3117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.630954+0000","last_change":"2024-09-12T17:46:42.179361+0000","last_active":"2024-09-12T18:03:39.630954+0000","last_peered":"2024-09-12T18:03:39.630954+0000","last_clean":"2024-09-12T18:03:39.630954+0000","last_became_active":"2024-09-12T17:46:42.178782+0000","last_became_peered":"2024-09-12T17:46:42.178782+0000","last_unstale":"2024-09-12T18:03:39.630954+0000","last_undegraded":"2024-09-12T18:03:39.630954+0000","last_fullsized":"2024-09-12T18:03:39.630954+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:21.705278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'101","reported_seq":355,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.903517+0000","last_change":"2024-09-12T17:45:03.899922+0000","last_active":"2024-09-12T18:05:56.903517+0000","last_peered":"2024-09-12T18:05:56.903517+0000","last_clean":"2024-09-12T18:05:56.903517+0000","last_became_active":"2024-09-12T17:45:03.899635+0000","last_became_peered":"2024-09-12T17:45:03.899635+0000","last_unstale":"2024-09-12T18:05:56.903517+0000","last_undegraded":"2024-09-12T18:05:56.903517+0000","last_fullsized":"2024-09-12T18:05:56.903517+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:27.634887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":455,"num_write":132,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646813+0000","last_change":"2024-09-12T17:57:00.462866+0000","last_active":"2024-09-12T18:05:19.646813+0000","last_peered":"2024-09-12T18:05:19.646813+0000","last_clean":"2024-09-12T18:05:19.646813+0000","last_became_active":"2024-09-12T17:57:00.462532+0000","last_became_peered":"2024-09-12T17:57:00.462532+0000","last_unstale":"2024-09-12T18:05:19.646813+0000","last_undegraded":"2024-09-12T18:05:19.646813+0000","last_fullsized":"2024-09-12T18:05:19.646813+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:39.678951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.503221+0000","last_change":"2024-09-12T17:47:29.324227+0000","last_active":"2024-09-12T18:03:39.503221+0000","last_peered":"2024-09-12T18:03:39.503221+0000","last_clean":"2024-09-12T18:03:39.503221+0000","last_became_active":"2024-09-12T17:47:29.305275+0000","last_became_peered":"2024-09-12T17:47:29.305275+0000","last_unstale":"2024-09-12T18:03:39.503221+0000","last_undegraded":"2024-09-12T18:03:39.503221+0000","last_fullsized":"2024-09-12T18:03:39.503221+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:21.892809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.504106+0000","last_change":"2024-09-12T17:46:42.183120+0000","last_active":"2024-09-12T18:03:44.504106+0000","last_peered":"2024-09-12T18:03:44.504106+0000","last_clean":"2024-09-12T18:03:44.504106+0000","last_became_active":"2024-09-12T17:46:42.182797+0000","last_became_peered":"2024-09-12T17:46:42.182797+0000","last_unstale":"2024-09-12T18:03:44.504106+0000","last_undegraded":"2024-09-12T18:03:44.504106+0000","last_fullsized":"2024-09-12T18:03:44.504106+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:02.336324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.192756+0000","last_change":"2024-09-12T17:45:03.900065+0000","last_active":"2024-09-12T18:05:57.192756+0000","last_peered":"2024-09-12T18:05:57.192756+0000","last_clean":"2024-09-12T18:05:57.192756+0000","last_became_active":"2024-09-12T17:45:03.899684+0000","last_became_peered":"2024-09-12T17:45:03.899684+0000","last_unstale":"2024-09-12T18:05:57.192756+0000","last_undegraded":"2024-09-12T18:05:57.192756+0000","last_fullsized":"2024-09-12T18:05:57.192756+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:45.656746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.676639+0000","last_change":"2024-09-12T17:57:00.464844+0000","last_active":"2024-09-12T18:04:29.676639+0000","last_peered":"2024-09-12T18:04:29.676639+0000","last_clean":"2024-09-12T18:04:29.676639+0000","last_became_active":"2024-09-12T17:57:00.464581+0000","last_became_peered":"2024-09-12T17:57:00.464581+0000","last_unstale":"2024-09-12T18:04:29.676639+0000","last_undegraded":"2024-09-12T18:04:29.676639+0000","last_fullsized":"2024-09-12T18:04:29.676639+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:41.808967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508601+0000","last_change":"2024-09-12T17:46:45.208867+0000","last_active":"2024-09-12T18:04:14.508601+0000","last_peered":"2024-09-12T18:04:14.508601+0000","last_clean":"2024-09-12T18:04:14.508601+0000","last_became_active":"2024-09-12T17:46:45.208580+0000","last_became_peered":"2024-09-12T17:46:45.208580+0000","last_unstale":"2024-09-12T18:04:14.508601+0000","last_undegraded":"2024-09-12T18:04:14.508601+0000","last_fullsized":"2024-09-12T18:04:14.508601+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:28.654102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508572+0000","last_change":"2024-09-12T17:46:42.182258+0000","last_active":"2024-09-12T18:04:14.508572+0000","last_peered":"2024-09-12T18:04:14.508572+0000","last_clean":"2024-09-12T18:04:14.508572+0000","last_became_active":"2024-09-12T17:46:42.181972+0000","last_became_peered":"2024-09-12T17:46:42.181972+0000","last_unstale":"2024-09-12T18:04:14.508572+0000","last_undegraded":"2024-09-12T18:04:14.508572+0000","last_fullsized":"2024-09-12T18:04:14.508572+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:16.906107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637435+0000","last_change":"2024-09-12T17:45:03.900188+0000","last_active":"2024-09-12T18:04:24.637435+0000","last_peered":"2024-09-12T18:04:24.637435+0000","last_clean":"2024-09-12T18:04:24.637435+0000","last_became_active":"2024-09-12T17:45:03.899876+0000","last_became_peered":"2024-09-12T17:45:03.899876+0000","last_unstale":"2024-09-12T18:04:24.637435+0000","last_undegraded":"2024-09-12T18:04:24.637435+0000","last_fullsized":"2024-09-12T18:04:24.637435+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:14.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.676688+0000","last_change":"2024-09-12T17:57:00.467655+0000","last_active":"2024-09-12T18:04:29.676688+0000","last_peered":"2024-09-12T18:04:29.676688+0000","last_clean":"2024-09-12T18:04:29.676688+0000","last_became_active":"2024-09-12T17:57:00.467385+0000","last_became_peered":"2024-09-12T17:57:00.467385+0000","last_unstale":"2024-09-12T18:04:29.676688+0000","last_undegraded":"2024-09-12T18:04:29.676688+0000","last_fullsized":"2024-09-12T18:04:29.676688+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:10.181468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519179+0000","last_change":"2024-09-12T17:46:45.206159+0000","last_active":"2024-09-12T18:04:14.519179+0000","last_peered":"2024-09-12T18:04:14.519179+0000","last_clean":"2024-09-12T18:04:14.519179+0000","last_became_active":"2024-09-12T17:46:45.205742+0000","last_became_peered":"2024-09-12T17:46:45.205742+0000","last_unstale":"2024-09-12T18:04:14.519179+0000","last_undegraded":"2024-09-12T18:04:14.519179+0000","last_fullsized":"2024-09-12T18:04:14.519179+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:07.179448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.635933+0000","last_change":"2024-09-12T17:46:42.175938+0000","last_active":"2024-09-12T18:04:14.635933+0000","last_peered":"2024-09-12T18:04:14.635933+0000","last_clean":"2024-09-12T18:04:14.635933+0000","last_became_active":"2024-09-12T17:46:42.175501+0000","last_became_peered":"2024-09-12T17:46:42.175501+0000","last_unstale":"2024-09-12T18:04:14.635933+0000","last_undegraded":"2024-09-12T18:04:14.635933+0000","last_fullsized":"2024-09-12T18:04:14.635933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:32.128694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637725+0000","last_change":"2024-09-12T17:45:03.895224+0000","last_active":"2024-09-12T18:04:24.637725+0000","last_peered":"2024-09-12T18:04:24.637725+0000","last_clean":"2024-09-12T18:04:24.637725+0000","last_became_active":"2024-09-12T17:45:03.894942+0000","last_became_peered":"2024-09-12T17:45:03.894942+0000","last_unstale":"2024-09-12T18:04:24.637725+0000","last_undegraded":"2024-09-12T18:04:24.637725+0000","last_fullsized":"2024-09-12T18:04:24.637725+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:52.737392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.634058+0000","last_change":"2024-09-12T17:57:00.463459+0000","last_active":"2024-09-12T18:03:59.634058+0000","last_peered":"2024-09-12T18:03:59.634058+0000","last_clean":"2024-09-12T18:03:59.634058+0000","last_became_active":"2024-09-12T17:57:00.463134+0000","last_became_peered":"2024-09-12T17:57:00.463134+0000","last_unstale":"2024-09-12T18:03:59.634058+0000","last_undegraded":"2024-09-12T18:03:59.634058+0000","last_fullsized":"2024-09-12T18:03:59.634058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:21.197817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.514362+0000","last_change":"2024-09-12T17:46:45.536892+0000","last_active":"2024-09-12T18:03:39.514362+0000","last_peered":"2024-09-12T18:03:39.514362+0000","last_clean":"2024-09-12T18:03:39.514362+0000","last_became_active":"2024-09-12T17:46:45.536581+0000","last_became_peered":"2024-09-12T17:46:45.536581+0000","last_unstale":"2024-09-12T18:03:39.514362+0000","last_undegraded":"2024-09-12T18:03:39.514362+0000","last_fullsized":"2024-09-12T18:03:39.514362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:18.649337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.643082+0000","last_change":"2024-09-12T17:46:42.180809+0000","last_active":"2024-09-12T18:05:29.643082+0000","last_peered":"2024-09-12T18:05:29.643082+0000","last_clean":"2024-09-12T18:05:29.643082+0000","last_became_active":"2024-09-12T17:46:42.179981+0000","last_became_peered":"2024-09-12T17:46:42.179981+0000","last_unstale":"2024-09-12T18:05:29.643082+0000","last_undegraded":"2024-09-12T18:05:29.643082+0000","last_fullsized":"2024-09-12T18:05:29.643082+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:19.357865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.810540+0000","last_change":"2024-09-12T17:45:03.892892+0000","last_active":"2024-09-12T18:05:30.810540+0000","last_peered":"2024-09-12T18:05:30.810540+0000","last_clean":"2024-09-12T18:05:30.810540+0000","last_became_active":"2024-09-12T17:45:03.892625+0000","last_became_peered":"2024-09-12T17:45:03.892625+0000","last_unstale":"2024-09-12T18:05:30.810540+0000","last_undegraded":"2024-09-12T18:05:30.810540+0000","last_fullsized":"2024-09-12T18:05:30.810540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:58.968922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.633098+0000","last_change":"2024-09-12T17:57:00.461660+0000","last_active":"2024-09-12T18:03:59.633098+0000","last_peered":"2024-09-12T18:03:59.633098+0000","last_clean":"2024-09-12T18:03:59.633098+0000","last_became_active":"2024-09-12T17:57:00.461347+0000","last_became_peered":"2024-09-12T17:57:00.461347+0000","last_unstale":"2024-09-12T18:03:59.633098+0000","last_undegraded":"2024-09-12T18:03:59.633098+0000","last_fullsized":"2024-09-12T18:03:59.633098+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:19.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.534906+0000","last_change":"2024-09-12T17:46:45.537765+0000","last_active":"2024-09-12T18:05:29.534906+0000","last_peered":"2024-09-12T18:05:29.534906+0000","last_clean":"2024-09-12T18:05:29.534906+0000","last_became_active":"2024-09-12T17:46:45.537463+0000","last_became_peered":"2024-09-12T17:46:45.537463+0000","last_unstale":"2024-09-12T18:05:29.534906+0000","last_undegraded":"2024-09-12T18:05:29.534906+0000","last_fullsized":"2024-09-12T18:05:29.534906+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:28.915955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.668771+0000","last_change":"2024-09-12T17:46:42.181302+0000","last_active":"2024-09-12T18:03:39.668771+0000","last_peered":"2024-09-12T18:03:39.668771+0000","last_clean":"2024-09-12T18:03:39.668771+0000","last_became_active":"2024-09-12T17:46:42.178809+0000","last_became_peered":"2024-09-12T17:46:42.178809+0000","last_unstale":"2024-09-12T18:03:39.668771+0000","last_undegraded":"2024-09-12T18:03:39.668771+0000","last_fullsized":"2024-09-12T18:03:39.668771+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:58.601763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'40","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.520902+0000","last_change":"2024-09-12T17:45:03.892705+0000","last_active":"2024-09-12T18:04:24.520902+0000","last_peered":"2024-09-12T18:04:24.520902+0000","last_clean":"2024-09-12T18:04:24.520902+0000","last_became_active":"2024-09-12T17:45:03.892417+0000","last_became_peered":"2024-09-12T17:45:03.892417+0000","last_unstale":"2024-09-12T18:04:24.520902+0000","last_undegraded":"2024-09-12T18:04:24.520902+0000","last_fullsized":"2024-09-12T18:04:24.520902+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:19.505017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":139,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.671898+0000","last_change":"2024-09-12T17:57:00.463497+0000","last_active":"2024-09-12T18:03:59.671898+0000","last_peered":"2024-09-12T18:03:59.671898+0000","last_clean":"2024-09-12T18:03:59.671898+0000","last_became_active":"2024-09-12T17:57:00.463245+0000","last_became_peered":"2024-09-12T17:57:00.463245+0000","last_unstale":"2024-09-12T18:03:59.671898+0000","last_undegraded":"2024-09-12T18:03:59.671898+0000","last_fullsized":"2024-09-12T18:03:59.671898+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:38.750487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.514393+0000","last_change":"2024-09-12T17:46:45.538651+0000","last_active":"2024-09-12T18:03:39.514393+0000","last_peered":"2024-09-12T18:03:39.514393+0000","last_clean":"2024-09-12T18:03:39.514393+0000","last_became_active":"2024-09-12T17:46:45.538337+0000","last_became_peered":"2024-09-12T17:46:45.538337+0000","last_unstale":"2024-09-12T18:03:39.514393+0000","last_undegraded":"2024-09-12T18:03:39.514393+0000","last_fullsized":"2024-09-12T18:03:39.514393+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:48.298979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.630162+0000","last_change":"2024-09-12T17:46:42.183384+0000","last_active":"2024-09-12T18:03:39.630162+0000","last_peered":"2024-09-12T18:03:39.630162+0000","last_clean":"2024-09-12T18:03:39.630162+0000","last_became_active":"2024-09-12T17:46:42.183098+0000","last_became_peered":"2024-09-12T17:46:42.183098+0000","last_unstale":"2024-09-12T18:03:39.630162+0000","last_undegraded":"2024-09-12T18:03:39.630162+0000","last_fullsized":"2024-09-12T18:03:39.630162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:06.980322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'35","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.149147+0000","last_change":"2024-09-12T17:45:03.896813+0000","last_active":"2024-09-12T18:05:20.149147+0000","last_peered":"2024-09-12T18:05:20.149147+0000","last_clean":"2024-09-12T18:05:20.149147+0000","last_became_active":"2024-09-12T17:45:03.896299+0000","last_became_peered":"2024-09-12T17:45:03.896299+0000","last_unstale":"2024-09-12T18:05:20.149147+0000","last_undegraded":"2024-09-12T18:05:20.149147+0000","last_fullsized":"2024-09-12T18:05:20.149147+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:31.025568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":68,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.629360+0000","last_change":"2024-09-12T17:57:00.462016+0000","last_active":"2024-09-12T18:03:59.629360+0000","last_peered":"2024-09-12T18:03:59.629360+0000","last_clean":"2024-09-12T18:03:59.629360+0000","last_became_active":"2024-09-12T17:57:00.461706+0000","last_became_peered":"2024-09-12T17:57:00.461706+0000","last_unstale":"2024-09-12T18:03:59.629360+0000","last_undegraded":"2024-09-12T18:03:59.629360+0000","last_fullsized":"2024-09-12T18:03:59.629360+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:47.107872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.503300+0000","last_change":"2024-09-12T17:46:45.207863+0000","last_active":"2024-09-12T18:03:39.503300+0000","last_peered":"2024-09-12T18:03:39.503300+0000","last_clean":"2024-09-12T18:03:39.503300+0000","last_became_active":"2024-09-12T17:46:45.207610+0000","last_became_peered":"2024-09-12T17:46:45.207610+0000","last_unstale":"2024-09-12T18:03:39.503300+0000","last_undegraded":"2024-09-12T18:03:39.503300+0000","last_fullsized":"2024-09-12T18:03:39.503300+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:02.945511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.631136+0000","last_change":"2024-09-12T17:46:42.182800+0000","last_active":"2024-09-12T18:03:39.631136+0000","last_peered":"2024-09-12T18:03:39.631136+0000","last_clean":"2024-09-12T18:03:39.631136+0000","last_became_active":"2024-09-12T17:46:42.182412+0000","last_became_peered":"2024-09-12T17:46:42.182412+0000","last_unstale":"2024-09-12T18:03:39.631136+0000","last_undegraded":"2024-09-12T18:03:39.631136+0000","last_fullsized":"2024-09-12T18:03:39.631136+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:58.438274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'49","reported_seq":173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:28.740711+0000","last_change":"2024-09-12T17:45:03.900251+0000","last_active":"2024-09-12T18:05:28.740711+0000","last_peered":"2024-09-12T18:05:28.740711+0000","last_clean":"2024-09-12T18:05:28.740711+0000","last_became_active":"2024-09-12T17:45:03.899885+0000","last_became_peered":"2024-09-12T17:45:03.899885+0000","last_unstale":"2024-09-12T18:05:28.740711+0000","last_undegraded":"2024-09-12T18:05:28.740711+0000","last_fullsized":"2024-09-12T18:05:28.740711+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:29.712954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":167,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519268+0000","last_change":"2024-09-12T17:57:00.468941+0000","last_active":"2024-09-12T18:04:14.519268+0000","last_peered":"2024-09-12T18:04:14.519268+0000","last_clean":"2024-09-12T18:04:14.519268+0000","last_became_active":"2024-09-12T17:57:00.468592+0000","last_became_peered":"2024-09-12T17:57:00.468592+0000","last_unstale":"2024-09-12T18:04:14.519268+0000","last_undegraded":"2024-09-12T18:04:14.519268+0000","last_fullsized":"2024-09-12T18:04:14.519268+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:05.976634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647467+0000","last_change":"2024-09-12T17:46:45.210723+0000","last_active":"2024-09-12T18:05:24.647467+0000","last_peered":"2024-09-12T18:05:24.647467+0000","last_clean":"2024-09-12T18:05:24.647467+0000","last_became_active":"2024-09-12T17:46:45.210413+0000","last_became_peered":"2024-09-12T17:46:45.210413+0000","last_unstale":"2024-09-12T18:05:24.647467+0000","last_undegraded":"2024-09-12T18:05:24.647467+0000","last_fullsized":"2024-09-12T18:05:24.647467+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:35.068995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518445+0000","last_change":"2024-09-12T17:46:42.177074+0000","last_active":"2024-09-12T18:05:24.518445+0000","last_peered":"2024-09-12T18:05:24.518445+0000","last_clean":"2024-09-12T18:05:24.518445+0000","last_became_active":"2024-09-12T17:46:42.176505+0000","last_became_peered":"2024-09-12T17:46:42.176505+0000","last_unstale":"2024-09-12T18:05:24.518445+0000","last_undegraded":"2024-09-12T18:05:24.518445+0000","last_fullsized":"2024-09-12T18:05:24.518445+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:43.326678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.669496+0000","last_change":"2024-09-12T17:45:03.900017+0000","last_active":"2024-09-12T18:03:44.669496+0000","last_peered":"2024-09-12T18:03:44.669496+0000","last_clean":"2024-09-12T18:03:44.669496+0000","last_became_active":"2024-09-12T17:45:03.899726+0000","last_became_peered":"2024-09-12T17:45:03.899726+0000","last_unstale":"2024-09-12T18:03:44.669496+0000","last_undegraded":"2024-09-12T18:03:44.669496+0000","last_fullsized":"2024-09-12T18:03:44.669496+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:05.783642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.636058+0000","last_change":"2024-09-12T17:57:00.464086+0000","last_active":"2024-09-12T18:04:14.636058+0000","last_peered":"2024-09-12T18:04:14.636058+0000","last_clean":"2024-09-12T18:04:14.636058+0000","last_became_active":"2024-09-12T17:57:00.463766+0000","last_became_peered":"2024-09-12T17:57:00.463766+0000","last_unstale":"2024-09-12T18:04:14.636058+0000","last_undegraded":"2024-09-12T18:04:14.636058+0000","last_fullsized":"2024-09-12T18:04:14.636058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:28.897896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'6","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647409+0000","last_change":"2024-09-12T17:46:45.201582+0000","last_active":"2024-09-12T18:05:24.647409+0000","last_peered":"2024-09-12T18:05:24.647409+0000","last_clean":"2024-09-12T18:05:24.647409+0000","last_became_active":"2024-09-12T17:46:45.201278+0000","last_became_peered":"2024-09-12T17:46:45.201278+0000","last_unstale":"2024-09-12T18:05:24.647409+0000","last_undegraded":"2024-09-12T18:05:24.647409+0000","last_fullsized":"2024-09-12T18:05:24.647409+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:48.055531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":19456,"num_write":11,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'6","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534213+0000","last_change":"2024-09-12T17:46:42.182936+0000","last_active":"2024-09-12T18:05:24.534213+0000","last_peered":"2024-09-12T18:05:24.534213+0000","last_clean":"2024-09-12T18:05:24.534213+0000","last_became_active":"2024-09-12T17:46:42.182658+0000","last_became_peered":"2024-09-12T17:46:42.182658+0000","last_unstale":"2024-09-12T18:05:24.534213+0000","last_undegraded":"2024-09-12T18:05:24.534213+0000","last_fullsized":"2024-09-12T18:05:24.534213+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:02.557846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":16,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.277595+0000","last_change":"2024-09-12T17:45:03.891474+0000","last_active":"2024-09-12T18:05:09.277595+0000","last_peered":"2024-09-12T18:05:09.277595+0000","last_clean":"2024-09-12T18:05:09.277595+0000","last_became_active":"2024-09-12T17:45:03.891186+0000","last_became_peered":"2024-09-12T17:45:03.891186+0000","last_unstale":"2024-09-12T18:05:09.277595+0000","last_undegraded":"2024-09-12T18:05:09.277595+0000","last_fullsized":"2024-09-12T18:05:09.277595+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:08.125248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":128,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.633745+0000","last_change":"2024-09-12T17:57:00.465754+0000","last_active":"2024-09-12T18:03:59.633745+0000","last_peered":"2024-09-12T18:03:59.633745+0000","last_clean":"2024-09-12T18:03:59.633745+0000","last_became_active":"2024-09-12T17:57:00.464910+0000","last_became_peered":"2024-09-12T17:57:00.464910+0000","last_unstale":"2024-09-12T18:03:59.633745+0000","last_undegraded":"2024-09-12T18:03:59.633745+0000","last_fullsized":"2024-09-12T18:03:59.633745+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:15.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534265+0000","last_change":"2024-09-12T17:46:45.206745+0000","last_active":"2024-09-12T18:05:24.534265+0000","last_peered":"2024-09-12T18:05:24.534265+0000","last_clean":"2024-09-12T18:05:24.534265+0000","last_became_active":"2024-09-12T17:46:45.206402+0000","last_became_peered":"2024-09-12T17:46:45.206402+0000","last_unstale":"2024-09-12T18:05:24.534265+0000","last_undegraded":"2024-09-12T18:05:24.534265+0000","last_fullsized":"2024-09-12T18:05:24.534265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:55.547505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518486+0000","last_change":"2024-09-12T17:46:42.185043+0000","last_active":"2024-09-12T18:05:24.518486+0000","last_peered":"2024-09-12T18:05:24.518486+0000","last_clean":"2024-09-12T18:05:24.518486+0000","last_became_active":"2024-09-12T17:46:42.184760+0000","last_became_peered":"2024-09-12T17:46:42.184760+0000","last_unstale":"2024-09-12T18:05:24.518486+0000","last_undegraded":"2024-09-12T18:05:24.518486+0000","last_fullsized":"2024-09-12T18:05:24.518486+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:44.853687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'36","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.504092+0000","last_change":"2024-09-12T17:45:03.897900+0000","last_active":"2024-09-12T18:03:44.504092+0000","last_peered":"2024-09-12T18:03:44.504092+0000","last_clean":"2024-09-12T18:03:44.504092+0000","last_became_active":"2024-09-12T17:45:03.897616+0000","last_became_peered":"2024-09-12T17:45:03.897616+0000","last_unstale":"2024-09-12T18:03:44.504092+0000","last_undegraded":"2024-09-12T18:03:44.504092+0000","last_fullsized":"2024-09-12T18:03:44.504092+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:50.190493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":138,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519243+0000","last_change":"2024-09-12T17:57:00.464276+0000","last_active":"2024-09-12T18:04:14.519243+0000","last_peered":"2024-09-12T18:04:14.519243+0000","last_clean":"2024-09-12T18:04:14.519243+0000","last_became_active":"2024-09-12T17:57:00.463881+0000","last_became_peered":"2024-09-12T17:57:00.463881+0000","last_unstale":"2024-09-12T18:04:14.519243+0000","last_undegraded":"2024-09-12T18:04:14.519243+0000","last_fullsized":"2024-09-12T18:04:14.519243+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:03.028160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518466+0000","last_change":"2024-09-12T17:46:45.206370+0000","last_active":"2024-09-12T18:05:24.518466+0000","last_peered":"2024-09-12T18:05:24.518466+0000","last_clean":"2024-09-12T18:05:24.518466+0000","last_became_active":"2024-09-12T17:46:45.205987+0000","last_became_peered":"2024-09-12T17:46:45.205987+0000","last_unstale":"2024-09-12T18:05:24.518466+0000","last_undegraded":"2024-09-12T18:05:24.518466+0000","last_fullsized":"2024-09-12T18:05:24.518466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:04.606065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.642468+0000","last_change":"2024-09-12T17:46:42.180412+0000","last_active":"2024-09-12T18:05:24.642468+0000","last_peered":"2024-09-12T18:05:24.642468+0000","last_clean":"2024-09-12T18:05:24.642468+0000","last_became_active":"2024-09-12T17:46:42.178941+0000","last_became_peered":"2024-09-12T17:46:42.178941+0000","last_unstale":"2024-09-12T18:05:24.642468+0000","last_undegraded":"2024-09-12T18:05:24.642468+0000","last_fullsized":"2024-09-12T18:05:24.642468+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:53.889661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'33","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.633278+0000","last_change":"2024-09-12T17:45:03.893625+0000","last_active":"2024-09-12T18:05:19.633278+0000","last_peered":"2024-09-12T18:05:19.633278+0000","last_clean":"2024-09-12T18:05:19.633278+0000","last_became_active":"2024-09-12T17:45:03.893332+0000","last_became_peered":"2024-09-12T17:45:03.893332+0000","last_unstale":"2024-09-12T18:05:19.633278+0000","last_undegraded":"2024-09-12T18:05:19.633278+0000","last_fullsized":"2024-09-12T18:05:19.633278+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:59.606201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.646279+0000","last_change":"2024-09-12T17:57:00.461421+0000","last_active":"2024-09-12T18:05:39.646279+0000","last_peered":"2024-09-12T18:05:39.646279+0000","last_clean":"2024-09-12T18:05:39.646279+0000","last_became_active":"2024-09-12T17:57:00.461130+0000","last_became_peered":"2024-09-12T17:57:00.461130+0000","last_unstale":"2024-09-12T18:05:39.646279+0000","last_undegraded":"2024-09-12T18:05:39.646279+0000","last_fullsized":"2024-09-12T18:05:39.646279+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:49.944764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.524097+0000","last_change":"2024-09-12T17:46:45.208179+0000","last_active":"2024-09-12T18:04:44.524097+0000","last_peered":"2024-09-12T18:04:44.524097+0000","last_clean":"2024-09-12T18:04:44.524097+0000","last_became_active":"2024-09-12T17:46:45.207899+0000","last_became_peered":"2024-09-12T17:46:45.207899+0000","last_unstale":"2024-09-12T18:04:44.524097+0000","last_undegraded":"2024-09-12T18:04:44.524097+0000","last_fullsized":"2024-09-12T18:04:44.524097+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:40.530867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5827243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.679250+0000","last_change":"2024-09-12T17:46:42.178168+0000","last_active":"2024-09-12T18:04:44.679250+0000","last_peered":"2024-09-12T18:04:44.679250+0000","last_clean":"2024-09-12T18:04:44.679250+0000","last_became_active":"2024-09-12T17:46:42.177867+0000","last_became_peered":"2024-09-12T17:46:42.177867+0000","last_unstale":"2024-09-12T18:04:44.679250+0000","last_undegraded":"2024-09-12T18:04:44.679250+0000","last_fullsized":"2024-09-12T18:04:44.679250+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:40.404324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'22","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534323+0000","last_change":"2024-09-12T17:45:03.895504+0000","last_active":"2024-09-12T18:05:24.534323+0000","last_peered":"2024-09-12T18:05:24.534323+0000","last_clean":"2024-09-12T18:05:24.534323+0000","last_became_active":"2024-09-12T17:45:03.895229+0000","last_became_peered":"2024-09-12T17:45:03.895229+0000","last_unstale":"2024-09-12T18:05:24.534323+0000","last_undegraded":"2024-09-12T18:05:24.534323+0000","last_fullsized":"2024-09-12T18:05:24.534323+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:49.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.669484+0000","last_change":"2024-09-12T17:57:00.466936+0000","last_active":"2024-09-12T18:03:44.669484+0000","last_peered":"2024-09-12T18:03:44.669484+0000","last_clean":"2024-09-12T18:03:44.669484+0000","last_became_active":"2024-09-12T17:57:00.466328+0000","last_became_peered":"2024-09-12T17:57:00.466328+0000","last_unstale":"2024-09-12T18:03:44.669484+0000","last_undegraded":"2024-09-12T18:03:44.669484+0000","last_fullsized":"2024-09-12T18:03:44.669484+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:21.500416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.524062+0000","last_change":"2024-09-12T17:46:45.204918+0000","last_active":"2024-09-12T18:04:44.524062+0000","last_peered":"2024-09-12T18:04:44.524062+0000","last_clean":"2024-09-12T18:04:44.524062+0000","last_became_active":"2024-09-12T17:46:45.204628+0000","last_became_peered":"2024-09-12T17:46:45.204628+0000","last_unstale":"2024-09-12T18:04:44.524062+0000","last_undegraded":"2024-09-12T18:04:44.524062+0000","last_fullsized":"2024-09-12T18:04:44.524062+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:44.729741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639499+0000","last_change":"2024-09-12T17:46:42.183988+0000","last_active":"2024-09-12T18:04:44.639499+0000","last_peered":"2024-09-12T18:04:44.639499+0000","last_clean":"2024-09-12T18:04:44.639499+0000","last_became_active":"2024-09-12T17:46:42.183710+0000","last_became_peered":"2024-09-12T17:46:42.183710+0000","last_unstale":"2024-09-12T18:04:44.639499+0000","last_undegraded":"2024-09-12T18:04:44.639499+0000","last_fullsized":"2024-09-12T18:04:44.639499+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:52.515375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'20","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.641966+0000","last_change":"2024-09-12T17:45:03.897931+0000","last_active":"2024-09-12T18:05:19.641966+0000","last_peered":"2024-09-12T18:05:19.641966+0000","last_clean":"2024-09-12T18:05:19.641966+0000","last_became_active":"2024-09-12T17:45:03.897609+0000","last_became_peered":"2024-09-12T17:45:03.897609+0000","last_unstale":"2024-09-12T18:05:19.641966+0000","last_undegraded":"2024-09-12T18:05:19.641966+0000","last_fullsized":"2024-09-12T18:05:19.641966+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:57.004403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.520491+0000","last_change":"2024-09-12T17:57:00.459052+0000","last_active":"2024-09-12T18:05:39.520491+0000","last_peered":"2024-09-12T18:05:39.520491+0000","last_clean":"2024-09-12T18:05:39.520491+0000","last_became_active":"2024-09-12T17:57:00.458777+0000","last_became_peered":"2024-09-12T17:57:00.458777+0000","last_unstale":"2024-09-12T18:05:39.520491+0000","last_undegraded":"2024-09-12T18:05:39.520491+0000","last_fullsized":"2024-09-12T18:05:39.520491+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:12.952038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640853+0000","last_change":"2024-09-12T17:46:45.537482+0000","last_active":"2024-09-12T18:04:44.640853+0000","last_peered":"2024-09-12T18:04:44.640853+0000","last_clean":"2024-09-12T18:04:44.640853+0000","last_became_active":"2024-09-12T17:46:45.536980+0000","last_became_peered":"2024-09-12T17:46:45.536980+0000","last_unstale":"2024-09-12T18:04:44.640853+0000","last_undegraded":"2024-09-12T18:04:44.640853+0000","last_fullsized":"2024-09-12T18:04:44.640853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:14.427774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640687+0000","last_change":"2024-09-12T17:46:42.180818+0000","last_active":"2024-09-12T18:04:44.640687+0000","last_peered":"2024-09-12T18:04:44.640687+0000","last_clean":"2024-09-12T18:04:44.640687+0000","last_became_active":"2024-09-12T17:46:42.180565+0000","last_became_peered":"2024-09-12T17:46:42.180565+0000","last_unstale":"2024-09-12T18:04:44.640687+0000","last_undegraded":"2024-09-12T18:04:44.640687+0000","last_fullsized":"2024-09-12T18:04:44.640687+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:16.219991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'33","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517834+0000","last_change":"2024-09-12T17:45:03.892503+0000","last_active":"2024-09-12T18:05:19.517834+0000","last_peered":"2024-09-12T18:05:19.517834+0000","last_clean":"2024-09-12T18:05:19.517834+0000","last_became_active":"2024-09-12T17:45:03.892226+0000","last_became_peered":"2024-09-12T17:45:03.892226+0000","last_unstale":"2024-09-12T18:05:19.517834+0000","last_undegraded":"2024-09-12T18:05:19.517834+0000","last_fullsized":"2024-09-12T18:05:19.517834+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:41.497858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":124,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.687364+0000","last_change":"2024-09-12T17:57:00.464984+0000","last_active":"2024-09-12T18:05:39.687364+0000","last_peered":"2024-09-12T18:05:39.687364+0000","last_clean":"2024-09-12T18:05:39.687364+0000","last_became_active":"2024-09-12T17:57:00.464707+0000","last_became_peered":"2024-09-12T17:57:00.464707+0000","last_unstale":"2024-09-12T18:05:39.687364+0000","last_undegraded":"2024-09-12T18:05:39.687364+0000","last_fullsized":"2024-09-12T18:05:39.687364+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:25.768696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.524117+0000","last_change":"2024-09-12T17:46:45.205067+0000","last_active":"2024-09-12T18:04:44.524117+0000","last_peered":"2024-09-12T18:04:44.524117+0000","last_clean":"2024-09-12T18:04:44.524117+0000","last_became_active":"2024-09-12T17:46:45.204759+0000","last_became_peered":"2024-09-12T17:46:45.204759+0000","last_unstale":"2024-09-12T18:04:44.524117+0000","last_undegraded":"2024-09-12T18:04:44.524117+0000","last_fullsized":"2024-09-12T18:04:44.524117+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:47.314625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640815+0000","last_change":"2024-09-12T17:46:42.183190+0000","last_active":"2024-09-12T18:04:44.640815+0000","last_peered":"2024-09-12T18:04:44.640815+0000","last_clean":"2024-09-12T18:04:44.640815+0000","last_became_active":"2024-09-12T17:46:42.182805+0000","last_became_peered":"2024-09-12T17:46:42.182805+0000","last_unstale":"2024-09-12T18:04:44.640815+0000","last_undegraded":"2024-09-12T18:04:44.640815+0000","last_fullsized":"2024-09-12T18:04:44.640815+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:54.005006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'42","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.643914+0000","last_change":"2024-09-12T17:45:03.898048+0000","last_active":"2024-09-12T18:05:19.643914+0000","last_peered":"2024-09-12T18:05:19.643914+0000","last_clean":"2024-09-12T18:05:19.643914+0000","last_became_active":"2024-09-12T17:45:03.897752+0000","last_became_peered":"2024-09-12T17:45:03.897752+0000","last_unstale":"2024-09-12T18:05:19.643914+0000","last_undegraded":"2024-09-12T18:05:19.643914+0000","last_fullsized":"2024-09-12T18:05:19.643914+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:59.048003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":75,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.515086+0000","last_change":"2024-09-12T17:57:00.469400+0000","last_active":"2024-09-12T18:03:44.515086+0000","last_peered":"2024-09-12T18:03:44.515086+0000","last_clean":"2024-09-12T18:03:44.515086+0000","last_became_active":"2024-09-12T17:57:00.469072+0000","last_became_peered":"2024-09-12T17:57:00.469072+0000","last_unstale":"2024-09-12T18:03:44.515086+0000","last_undegraded":"2024-09-12T18:03:44.515086+0000","last_fullsized":"2024-09-12T18:03:44.515086+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:37.442197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.507138+0000","last_change":"2024-09-12T17:46:45.203169+0000","last_active":"2024-09-12T18:04:04.507138+0000","last_peered":"2024-09-12T18:04:04.507138+0000","last_clean":"2024-09-12T18:04:04.507138+0000","last_became_active":"2024-09-12T17:46:45.202892+0000","last_became_peered":"2024-09-12T17:46:45.202892+0000","last_unstale":"2024-09-12T18:04:04.507138+0000","last_undegraded":"2024-09-12T18:04:04.507138+0000","last_fullsized":"2024-09-12T18:04:04.507138+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:50.179992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634333+0000","last_change":"2024-09-12T17:46:42.179076+0000","last_active":"2024-09-12T18:04:04.634333+0000","last_peered":"2024-09-12T18:04:04.634333+0000","last_clean":"2024-09-12T18:04:04.634333+0000","last_became_active":"2024-09-12T17:46:42.178411+0000","last_became_peered":"2024-09-12T17:46:42.178411+0000","last_unstale":"2024-09-12T18:04:04.634333+0000","last_undegraded":"2024-09-12T18:04:04.634333+0000","last_fullsized":"2024-09-12T18:04:04.634333+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:26.191877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'24","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646723+0000","last_change":"2024-09-12T17:45:03.891655+0000","last_active":"2024-09-12T18:05:19.646723+0000","last_peered":"2024-09-12T18:05:19.646723+0000","last_clean":"2024-09-12T18:05:19.646723+0000","last_became_active":"2024-09-12T17:45:03.891369+0000","last_became_peered":"2024-09-12T17:45:03.891369+0000","last_unstale":"2024-09-12T18:05:19.646723+0000","last_undegraded":"2024-09-12T18:05:19.646723+0000","last_fullsized":"2024-09-12T18:05:19.646723+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:45.970204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.670237+0000","last_change":"2024-09-12T17:57:00.465652+0000","last_active":"2024-09-12T18:03:49.670237+0000","last_peered":"2024-09-12T18:03:49.670237+0000","last_clean":"2024-09-12T18:03:49.670237+0000","last_became_active":"2024-09-12T17:57:00.465360+0000","last_became_peered":"2024-09-12T17:57:00.465360+0000","last_unstale":"2024-09-12T18:03:49.670237+0000","last_undegraded":"2024-09-12T18:03:49.670237+0000","last_fullsized":"2024-09-12T18:03:49.670237+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:56.997962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.672845+0000","last_change":"2024-09-12T17:46:45.536369+0000","last_active":"2024-09-12T18:04:04.672845+0000","last_peered":"2024-09-12T18:04:04.672845+0000","last_clean":"2024-09-12T18:04:04.672845+0000","last_became_active":"2024-09-12T17:46:45.536056+0000","last_became_peered":"2024-09-12T17:46:45.536056+0000","last_unstale":"2024-09-12T18:04:04.672845+0000","last_undegraded":"2024-09-12T18:04:04.672845+0000","last_fullsized":"2024-09-12T18:04:04.672845+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:32.199489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634773+0000","last_change":"2024-09-12T17:46:42.183083+0000","last_active":"2024-09-12T18:04:04.634773+0000","last_peered":"2024-09-12T18:04:04.634773+0000","last_clean":"2024-09-12T18:04:04.634773+0000","last_became_active":"2024-09-12T17:46:42.182831+0000","last_became_peered":"2024-09-12T17:46:42.182831+0000","last_unstale":"2024-09-12T18:04:04.634773+0000","last_undegraded":"2024-09-12T18:04:04.634773+0000","last_fullsized":"2024-09-12T18:04:04.634773+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:04.590775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'86","reported_seq":281,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.623576+0000","last_change":"2024-09-12T17:45:03.893737+0000","last_active":"2024-09-12T18:05:20.623576+0000","last_peered":"2024-09-12T18:05:20.623576+0000","last_clean":"2024-09-12T18:05:20.623576+0000","last_became_active":"2024-09-12T17:45:03.893452+0000","last_became_peered":"2024-09-12T17:45:03.893452+0000","last_unstale":"2024-09-12T18:05:20.623576+0000","last_undegraded":"2024-09-12T18:05:20.623576+0000","last_fullsized":"2024-09-12T18:05:20.623576+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:29.372853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":321,"num_write":137,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.669517+0000","last_change":"2024-09-12T17:57:00.464389+0000","last_active":"2024-09-12T18:03:44.669517+0000","last_peered":"2024-09-12T18:03:44.669517+0000","last_clean":"2024-09-12T18:03:44.669517+0000","last_became_active":"2024-09-12T17:57:00.464068+0000","last_became_peered":"2024-09-12T17:57:00.464068+0000","last_unstale":"2024-09-12T18:03:44.669517+0000","last_undegraded":"2024-09-12T18:03:44.669517+0000","last_fullsized":"2024-09-12T18:03:44.669517+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:52.387690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640740+0000","last_change":"2024-09-12T17:46:45.206955+0000","last_active":"2024-09-12T18:04:44.640740+0000","last_peered":"2024-09-12T18:04:44.640740+0000","last_clean":"2024-09-12T18:04:44.640740+0000","last_became_active":"2024-09-12T17:46:45.206644+0000","last_became_peered":"2024-09-12T17:46:45.206644+0000","last_unstale":"2024-09-12T18:04:44.640740+0000","last_undegraded":"2024-09-12T18:04:44.640740+0000","last_fullsized":"2024-09-12T18:04:44.640740+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:01.211515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634414+0000","last_change":"2024-09-12T17:46:42.184536+0000","last_active":"2024-09-12T18:04:04.634414+0000","last_peered":"2024-09-12T18:04:04.634414+0000","last_clean":"2024-09-12T18:04:04.634414+0000","last_became_active":"2024-09-12T17:46:42.184232+0000","last_became_peered":"2024-09-12T17:46:42.184232+0000","last_unstale":"2024-09-12T18:04:04.634414+0000","last_undegraded":"2024-09-12T18:04:04.634414+0000","last_fullsized":"2024-09-12T18:04:04.634414+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:05.091740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.522427+0000","last_change":"2024-09-12T17:45:03.897167+0000","last_active":"2024-09-12T18:04:34.522427+0000","last_peered":"2024-09-12T18:04:34.522427+0000","last_clean":"2024-09-12T18:04:34.522427+0000","last_became_active":"2024-09-12T17:45:03.896663+0000","last_became_peered":"2024-09-12T17:45:03.896663+0000","last_unstale":"2024-09-12T18:04:34.522427+0000","last_undegraded":"2024-09-12T18:04:34.522427+0000","last_fullsized":"2024-09-12T18:04:34.522427+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:00.166379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.631728+0000","last_change":"2024-09-12T17:57:00.465893+0000","last_active":"2024-09-12T18:03:44.631728+0000","last_peered":"2024-09-12T18:03:44.631728+0000","last_clean":"2024-09-12T18:03:44.631728+0000","last_became_active":"2024-09-12T17:57:00.465596+0000","last_became_peered":"2024-09-12T17:57:00.465596+0000","last_unstale":"2024-09-12T18:03:44.631728+0000","last_undegraded":"2024-09-12T18:03:44.631728+0000","last_fullsized":"2024-09-12T18:03:44.631728+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:13.446382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.673723+0000","last_change":"2024-09-12T17:46:45.208374+0000","last_active":"2024-09-12T18:04:09.673723+0000","last_peered":"2024-09-12T18:04:09.673723+0000","last_clean":"2024-09-12T18:04:09.673723+0000","last_became_active":"2024-09-12T17:46:45.208019+0000","last_became_peered":"2024-09-12T17:46:45.208019+0000","last_unstale":"2024-09-12T18:04:09.673723+0000","last_undegraded":"2024-09-12T18:04:09.673723+0000","last_fullsized":"2024-09-12T18:04:09.673723+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:03.347779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.512748+0000","last_change":"2024-09-12T17:46:42.184553+0000","last_active":"2024-09-12T18:04:44.512748+0000","last_peered":"2024-09-12T18:04:44.512748+0000","last_clean":"2024-09-12T18:04:44.512748+0000","last_became_active":"2024-09-12T17:46:42.184250+0000","last_became_peered":"2024-09-12T17:46:42.184250+0000","last_unstale":"2024-09-12T18:04:44.512748+0000","last_undegraded":"2024-09-12T18:04:44.512748+0000","last_fullsized":"2024-09-12T18:04:44.512748+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:49.433698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'40","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.511355+0000","last_change":"2024-09-12T17:45:03.897601+0000","last_active":"2024-09-12T18:04:34.511355+0000","last_peered":"2024-09-12T18:04:34.511355+0000","last_clean":"2024-09-12T18:04:34.511355+0000","last_became_active":"2024-09-12T17:45:03.897291+0000","last_became_peered":"2024-09-12T17:45:03.897291+0000","last_unstale":"2024-09-12T18:04:34.511355+0000","last_undegraded":"2024-09-12T18:04:34.511355+0000","last_fullsized":"2024-09-12T18:04:34.511355+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:56.938763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.684325+0000","last_change":"2024-09-12T17:57:00.465725+0000","last_active":"2024-09-12T18:05:19.684325+0000","last_peered":"2024-09-12T18:05:19.684325+0000","last_clean":"2024-09-12T18:05:19.684325+0000","last_became_active":"2024-09-12T17:57:00.465454+0000","last_became_peered":"2024-09-12T17:57:00.465454+0000","last_unstale":"2024-09-12T18:05:19.684325+0000","last_undegraded":"2024-09-12T18:05:19.684325+0000","last_fullsized":"2024-09-12T18:05:19.684325+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.552904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648118+0000","last_change":"2024-09-12T17:46:45.207902+0000","last_active":"2024-09-12T18:05:29.648118+0000","last_peered":"2024-09-12T18:05:29.648118+0000","last_clean":"2024-09-12T18:05:29.648118+0000","last_became_active":"2024-09-12T17:46:45.207607+0000","last_became_peered":"2024-09-12T17:46:45.207607+0000","last_unstale":"2024-09-12T18:05:29.648118+0000","last_undegraded":"2024-09-12T18:05:29.648118+0000","last_fullsized":"2024-09-12T18:05:29.648118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:31.661695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.685860+0000","last_change":"2024-09-12T17:46:42.182625+0000","last_active":"2024-09-12T18:05:29.685860+0000","last_peered":"2024-09-12T18:05:29.685860+0000","last_clean":"2024-09-12T18:05:29.685860+0000","last_became_active":"2024-09-12T17:46:42.182267+0000","last_became_peered":"2024-09-12T17:46:42.182267+0000","last_unstale":"2024-09-12T18:05:29.685860+0000","last_undegraded":"2024-09-12T18:05:29.685860+0000","last_fullsized":"2024-09-12T18:05:29.685860+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:39.753698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'54","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.639121+0000","last_change":"2024-09-12T17:45:03.892593+0000","last_active":"2024-09-12T18:04:34.639121+0000","last_peered":"2024-09-12T18:04:34.639121+0000","last_clean":"2024-09-12T18:04:34.639121+0000","last_became_active":"2024-09-12T17:45:03.891861+0000","last_became_peered":"2024-09-12T17:45:03.891861+0000","last_unstale":"2024-09-12T18:04:34.639121+0000","last_undegraded":"2024-09-12T18:04:34.639121+0000","last_fullsized":"2024-09-12T18:04:34.639121+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:11.906724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":286,"num_read_kb":219,"num_write":84,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.641923+0000","last_change":"2024-09-12T17:57:00.467076+0000","last_active":"2024-09-12T18:05:19.641923+0000","last_peered":"2024-09-12T18:05:19.641923+0000","last_clean":"2024-09-12T18:05:19.641923+0000","last_became_active":"2024-09-12T17:57:00.466761+0000","last_became_peered":"2024-09-12T17:57:00.466761+0000","last_unstale":"2024-09-12T18:05:19.641923+0000","last_undegraded":"2024-09-12T18:05:19.641923+0000","last_fullsized":"2024-09-12T18:05:19.641923+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:37.302553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648100+0000","last_change":"2024-09-12T17:46:45.537244+0000","last_active":"2024-09-12T18:05:29.648100+0000","last_peered":"2024-09-12T18:05:29.648100+0000","last_clean":"2024-09-12T18:05:29.648100+0000","last_became_active":"2024-09-12T17:46:45.536927+0000","last_became_peered":"2024-09-12T17:46:45.536927+0000","last_unstale":"2024-09-12T18:05:29.648100+0000","last_undegraded":"2024-09-12T18:05:29.648100+0000","last_fullsized":"2024-09-12T18:05:29.648100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:06.976539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.644905+0000","last_change":"2024-09-12T17:46:42.182617+0000","last_active":"2024-09-12T18:05:29.644905+0000","last_peered":"2024-09-12T18:05:29.644905+0000","last_clean":"2024-09-12T18:05:29.644905+0000","last_became_active":"2024-09-12T17:46:42.182346+0000","last_became_peered":"2024-09-12T17:46:42.182346+0000","last_unstale":"2024-09-12T18:05:29.644905+0000","last_undegraded":"2024-09-12T18:05:29.644905+0000","last_fullsized":"2024-09-12T18:05:29.644905+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:54.314647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'22","reported_seq":105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.511454+0000","last_change":"2024-09-12T17:45:03.895804+0000","last_active":"2024-09-12T18:04:34.511454+0000","last_peered":"2024-09-12T18:04:34.511454+0000","last_clean":"2024-09-12T18:04:34.511454+0000","last_became_active":"2024-09-12T17:45:03.895580+0000","last_became_peered":"2024-09-12T17:45:03.895580+0000","last_unstale":"2024-09-12T18:04:34.511454+0000","last_undegraded":"2024-09-12T18:04:34.511454+0000","last_fullsized":"2024-09-12T18:04:34.511454+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.580183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643446+0000","last_change":"2024-09-12T17:57:00.463170+0000","last_active":"2024-09-12T18:04:59.643446+0000","last_peered":"2024-09-12T18:04:59.643446+0000","last_clean":"2024-09-12T18:04:59.643446+0000","last_became_active":"2024-09-12T17:57:00.462863+0000","last_became_peered":"2024-09-12T17:57:00.462863+0000","last_unstale":"2024-09-12T18:04:59.643446+0000","last_undegraded":"2024-09-12T18:04:59.643446+0000","last_fullsized":"2024-09-12T18:04:59.643446+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:40.563317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.672968+0000","last_change":"2024-09-12T17:46:45.537210+0000","last_active":"2024-09-12T18:04:04.672968+0000","last_peered":"2024-09-12T18:04:04.672968+0000","last_clean":"2024-09-12T18:04:04.672968+0000","last_became_active":"2024-09-12T17:46:45.536831+0000","last_became_peered":"2024-09-12T17:46:45.536831+0000","last_unstale":"2024-09-12T18:04:04.672968+0000","last_undegraded":"2024-09-12T18:04:04.672968+0000","last_fullsized":"2024-09-12T18:04:04.672968+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:29.700931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'6","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.630406+0000","last_change":"2024-09-12T17:46:42.185520+0000","last_active":"2024-09-12T18:04:04.630406+0000","last_peered":"2024-09-12T18:04:04.630406+0000","last_clean":"2024-09-12T18:04:04.630406+0000","last_became_active":"2024-09-12T17:46:42.185216+0000","last_became_peered":"2024-09-12T17:46:42.185216+0000","last_unstale":"2024-09-12T18:04:04.630406+0000","last_undegraded":"2024-09-12T18:04:04.630406+0000","last_fullsized":"2024-09-12T18:04:04.630406+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:37.439176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":23554,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.671044+0000","last_change":"2024-09-12T17:45:03.894942+0000","last_active":"2024-09-12T18:03:54.671044+0000","last_peered":"2024-09-12T18:03:54.671044+0000","last_clean":"2024-09-12T18:03:54.671044+0000","last_became_active":"2024-09-12T17:45:03.894642+0000","last_became_peered":"2024-09-12T17:45:03.894642+0000","last_unstale":"2024-09-12T18:03:54.671044+0000","last_undegraded":"2024-09-12T18:03:54.671044+0000","last_fullsized":"2024-09-12T18:03:54.671044+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:17.879728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517749+0000","last_change":"2024-09-12T17:57:00.465804+0000","last_active":"2024-09-12T18:05:19.517749+0000","last_peered":"2024-09-12T18:05:19.517749+0000","last_clean":"2024-09-12T18:05:19.517749+0000","last_became_active":"2024-09-12T17:57:00.465546+0000","last_became_peered":"2024-09-12T17:57:00.465546+0000","last_unstale":"2024-09-12T18:05:19.517749+0000","last_undegraded":"2024-09-12T18:05:19.517749+0000","last_fullsized":"2024-09-12T18:05:19.517749+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.264688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'9","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.507233+0000","last_change":"2024-09-12T17:46:45.206808+0000","last_active":"2024-09-12T18:04:04.507233+0000","last_peered":"2024-09-12T18:04:04.507233+0000","last_clean":"2024-09-12T18:04:04.507233+0000","last_became_active":"2024-09-12T17:46:45.206537+0000","last_became_peered":"2024-09-12T17:46:45.206537+0000","last_unstale":"2024-09-12T18:04:04.507233+0000","last_undegraded":"2024-09-12T18:04:04.507233+0000","last_fullsized":"2024-09-12T18:04:04.507233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.731520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14215851,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":29814,"num_write":14,"num_write_kb":19003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.672982+0000","last_change":"2024-09-12T17:46:42.177736+0000","last_active":"2024-09-12T18:04:04.672982+0000","last_peered":"2024-09-12T18:04:04.672982+0000","last_clean":"2024-09-12T18:04:04.672982+0000","last_became_active":"2024-09-12T17:46:42.177427+0000","last_became_peered":"2024-09-12T17:46:42.177427+0000","last_unstale":"2024-09-12T18:04:04.672982+0000","last_undegraded":"2024-09-12T18:04:04.672982+0000","last_fullsized":"2024-09-12T18:04:04.672982+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:07.172378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'156","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.651994+0000","last_change":"2024-09-12T17:45:03.898576+0000","last_active":"2024-09-12T18:05:54.651994+0000","last_peered":"2024-09-12T18:05:54.651994+0000","last_clean":"2024-09-12T18:05:54.651994+0000","last_became_active":"2024-09-12T17:45:03.898292+0000","last_became_peered":"2024-09-12T17:45:03.898292+0000","last_unstale":"2024-09-12T18:05:54.651994+0000","last_undegraded":"2024-09-12T18:05:54.651994+0000","last_fullsized":"2024-09-12T18:05:54.651994+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:55.707973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":951,"num_read_kb":701,"num_write":196,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.646344+0000","last_change":"2024-09-12T17:57:00.464364+0000","last_active":"2024-09-12T18:05:39.646344+0000","last_peered":"2024-09-12T18:05:39.646344+0000","last_clean":"2024-09-12T18:05:39.646344+0000","last_became_active":"2024-09-12T17:57:00.464090+0000","last_became_peered":"2024-09-12T17:57:00.464090+0000","last_unstale":"2024-09-12T18:05:39.646344+0000","last_undegraded":"2024-09-12T18:05:39.646344+0000","last_fullsized":"2024-09-12T18:05:39.646344+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.615989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648116+0000","last_change":"2024-09-12T17:46:45.205661+0000","last_active":"2024-09-12T18:05:29.648116+0000","last_peered":"2024-09-12T18:05:29.648116+0000","last_clean":"2024-09-12T18:05:29.648116+0000","last_became_active":"2024-09-12T17:46:45.205357+0000","last_became_peered":"2024-09-12T17:46:45.205357+0000","last_unstale":"2024-09-12T18:05:29.648116+0000","last_undegraded":"2024-09-12T18:05:29.648116+0000","last_fullsized":"2024-09-12T18:05:29.648116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:35.096441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'1","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.679945+0000","last_change":"2024-09-12T17:46:42.176715+0000","last_active":"2024-09-12T18:04:49.679945+0000","last_peered":"2024-09-12T18:04:49.679945+0000","last_clean":"2024-09-12T18:04:49.679945+0000","last_became_active":"2024-09-12T17:46:42.176415+0000","last_became_peered":"2024-09-12T17:46:42.176415+0000","last_unstale":"2024-09-12T18:04:49.679945+0000","last_undegraded":"2024-09-12T18:04:49.679945+0000","last_fullsized":"2024-09-12T18:04:49.679945+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:04.586483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'25","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.647144+0000","last_change":"2024-09-12T17:45:03.889617+0000","last_active":"2024-09-12T18:05:54.647144+0000","last_peered":"2024-09-12T18:05:54.647144+0000","last_clean":"2024-09-12T18:05:54.647144+0000","last_became_active":"2024-09-12T17:45:03.889334+0000","last_became_peered":"2024-09-12T17:45:03.889334+0000","last_unstale":"2024-09-12T18:05:54.647144+0000","last_undegraded":"2024-09-12T18:05:54.647144+0000","last_fullsized":"2024-09-12T18:05:54.647144+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:08.253653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.649616+0000","last_change":"2024-09-12T17:57:00.453730+0000","last_active":"2024-09-12T18:05:39.649616+0000","last_peered":"2024-09-12T18:05:39.649616+0000","last_clean":"2024-09-12T18:05:39.649616+0000","last_became_active":"2024-09-12T17:57:00.453435+0000","last_became_peered":"2024-09-12T17:57:00.453435+0000","last_unstale":"2024-09-12T18:05:39.649616+0000","last_undegraded":"2024-09-12T18:05:39.649616+0000","last_fullsized":"2024-09-12T18:05:39.649616+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:47.161486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"261'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.637517+0000","last_change":"2024-09-12T17:46:45.211314+0000","last_active":"2024-09-12T18:04:49.637517+0000","last_peered":"2024-09-12T18:04:49.637517+0000","last_clean":"2024-09-12T18:04:49.637517+0000","last_became_active":"2024-09-12T17:46:45.210669+0000","last_became_peered":"2024-09-12T17:46:45.210669+0000","last_unstale":"2024-09-12T18:04:49.637517+0000","last_undegraded":"2024-09-12T18:04:49.637517+0000","last_fullsized":"2024-09-12T18:04:49.637517+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:28.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.685819+0000","last_change":"2024-09-12T17:46:42.179654+0000","last_active":"2024-09-12T18:05:29.685819+0000","last_peered":"2024-09-12T18:05:29.685819+0000","last_clean":"2024-09-12T18:05:29.685819+0000","last_became_active":"2024-09-12T17:46:42.179369+0000","last_became_peered":"2024-09-12T17:46:42.179369+0000","last_unstale":"2024-09-12T18:05:29.685819+0000","last_undegraded":"2024-09-12T18:05:29.685819+0000","last_fullsized":"2024-09-12T18:05:29.685819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:46.896690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'11","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.522442+0000","last_change":"2024-09-12T17:45:03.892044+0000","last_active":"2024-09-12T18:05:54.522442+0000","last_peered":"2024-09-12T18:05:54.522442+0000","last_clean":"2024-09-12T18:05:54.522442+0000","last_became_active":"2024-09-12T17:45:03.891751+0000","last_became_peered":"2024-09-12T17:45:03.891751+0000","last_unstale":"2024-09-12T18:05:54.522442+0000","last_undegraded":"2024-09-12T18:05:54.522442+0000","last_fullsized":"2024-09-12T18:05:54.522442+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:57.974426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646774+0000","last_change":"2024-09-12T17:57:00.466635+0000","last_active":"2024-09-12T18:05:19.646774+0000","last_peered":"2024-09-12T18:05:19.646774+0000","last_clean":"2024-09-12T18:05:19.646774+0000","last_became_active":"2024-09-12T17:57:00.465706+0000","last_became_peered":"2024-09-12T17:57:00.465706+0000","last_unstale":"2024-09-12T18:05:19.646774+0000","last_undegraded":"2024-09-12T18:05:19.646774+0000","last_fullsized":"2024-09-12T18:05:19.646774+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:50.291887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'6","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519086+0000","last_change":"2024-09-12T17:46:45.207296+0000","last_active":"2024-09-12T18:05:29.519086+0000","last_peered":"2024-09-12T18:05:29.519086+0000","last_clean":"2024-09-12T18:05:29.519086+0000","last_became_active":"2024-09-12T17:46:45.206384+0000","last_became_peered":"2024-09-12T17:46:45.206384+0000","last_unstale":"2024-09-12T18:05:29.519086+0000","last_undegraded":"2024-09-12T18:05:29.519086+0000","last_fullsized":"2024-09-12T18:05:29.519086+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:12.346318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":22528,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648169+0000","last_change":"2024-09-12T17:46:42.177668+0000","last_active":"2024-09-12T18:05:29.648169+0000","last_peered":"2024-09-12T18:05:29.648169+0000","last_clean":"2024-09-12T18:05:29.648169+0000","last_became_active":"2024-09-12T17:46:42.177381+0000","last_became_peered":"2024-09-12T17:46:42.177381+0000","last_unstale":"2024-09-12T18:05:29.648169+0000","last_undegraded":"2024-09-12T18:05:29.648169+0000","last_fullsized":"2024-09-12T18:05:29.648169+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:48.797003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.908163+0000","last_change":"2024-09-12T17:45:03.893535+0000","last_active":"2024-09-12T18:05:56.908163+0000","last_peered":"2024-09-12T18:05:56.908163+0000","last_clean":"2024-09-12T18:05:56.908163+0000","last_became_active":"2024-09-12T17:45:03.893234+0000","last_became_peered":"2024-09-12T17:45:03.893234+0000","last_unstale":"2024-09-12T18:05:56.908163+0000","last_undegraded":"2024-09-12T18:05:56.908163+0000","last_fullsized":"2024-09-12T18:05:56.908163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:56.134844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":127,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.685120+0000","last_change":"2024-09-12T17:57:00.467265+0000","last_active":"2024-09-12T18:05:24.685120+0000","last_peered":"2024-09-12T18:05:24.685120+0000","last_clean":"2024-09-12T18:05:24.685120+0000","last_became_active":"2024-09-12T17:57:00.466994+0000","last_became_peered":"2024-09-12T17:57:00.466994+0000","last_unstale":"2024-09-12T18:05:24.685120+0000","last_undegraded":"2024-09-12T18:05:24.685120+0000","last_fullsized":"2024-09-12T18:05:24.685120+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:10.618141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519076+0000","last_change":"2024-09-12T17:46:45.207817+0000","last_active":"2024-09-12T18:05:29.519076+0000","last_peered":"2024-09-12T18:05:29.519076+0000","last_clean":"2024-09-12T18:05:29.519076+0000","last_became_active":"2024-09-12T17:46:45.207552+0000","last_became_peered":"2024-09-12T17:46:45.207552+0000","last_unstale":"2024-09-12T18:05:29.519076+0000","last_undegraded":"2024-09-12T18:05:29.519076+0000","last_fullsized":"2024-09-12T18:05:29.519076+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.256254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'5","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519111+0000","last_change":"2024-09-12T17:46:42.182084+0000","last_active":"2024-09-12T18:05:29.519111+0000","last_peered":"2024-09-12T18:05:29.519111+0000","last_clean":"2024-09-12T18:05:29.519111+0000","last_became_active":"2024-09-12T17:46:42.181805+0000","last_became_peered":"2024-09-12T17:46:42.181805+0000","last_unstale":"2024-09-12T18:05:29.519111+0000","last_undegraded":"2024-09-12T18:05:29.519111+0000","last_fullsized":"2024-09-12T18:05:29.519111+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:10.912482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'23","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.747227+0000","last_change":"2024-09-12T17:45:03.893633+0000","last_active":"2024-09-12T18:05:56.747227+0000","last_peered":"2024-09-12T18:05:56.747227+0000","last_clean":"2024-09-12T18:05:56.747227+0000","last_became_active":"2024-09-12T17:45:03.893361+0000","last_became_peered":"2024-09-12T17:45:03.893361+0000","last_unstale":"2024-09-12T18:05:56.747227+0000","last_undegraded":"2024-09-12T18:05:56.747227+0000","last_fullsized":"2024-09-12T18:05:56.747227+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:44.155033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":77,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'207","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.242849+0000","last_change":"2024-09-12T17:29:52.955507+0000","last_active":"2024-09-12T18:05:59.242849+0000","last_peered":"2024-09-12T18:05:59.242849+0000","last_clean":"2024-09-12T18:05:59.242849+0000","last_became_active":"2024-09-12T17:29:52.955124+0000","last_became_peered":"2024-09-12T17:29:52.955124+0000","last_unstale":"2024-09-12T18:05:59.242849+0000","last_undegraded":"2024-09-12T18:05:59.242849+0000","last_fullsized":"2024-09-12T18:05:59.242849+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:32.089966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":3241,"num_write":1056,"num_write_kb":28474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'166","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.325382+0000","last_change":"2024-09-12T17:29:54.957835+0000","last_active":"2024-09-12T18:05:55.325382+0000","last_peered":"2024-09-12T18:05:55.325382+0000","last_clean":"2024-09-12T18:05:55.325382+0000","last_became_active":"2024-09-12T17:29:54.957047+0000","last_became_peered":"2024-09-12T17:29:54.957047+0000","last_unstale":"2024-09-12T18:05:55.325382+0000","last_undegraded":"2024-09-12T18:05:55.325382+0000","last_fullsized":"2024-09-12T18:05:55.325382+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:17.894082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":598,"num_write":253,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'208","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:30.640024+0000","last_change":"2024-09-12T17:29:52.954589+0000","last_active":"2024-09-12T18:07:30.640024+0000","last_peered":"2024-09-12T18:07:30.640024+0000","last_clean":"2024-09-12T18:07:30.640024+0000","last_became_active":"2024-09-12T17:29:52.954249+0000","last_became_peered":"2024-09-12T17:29:52.954249+0000","last_unstale":"2024-09-12T18:07:30.640024+0000","last_undegraded":"2024-09-12T18:07:30.640024+0000","last_fullsized":"2024-09-12T18:07:30.640024+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:36.461295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16377941,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":492,"num_read_kb":62367,"num_write":1035,"num_write_kb":21747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'277","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:58.408944+0000","last_change":"2024-09-12T17:29:54.959793+0000","last_active":"2024-09-12T18:05:58.408944+0000","last_peered":"2024-09-12T18:05:58.408944+0000","last_clean":"2024-09-12T18:05:58.408944+0000","last_became_active":"2024-09-12T17:29:54.959503+0000","last_became_peered":"2024-09-12T17:29:54.959503+0000","last_unstale":"2024-09-12T18:05:58.408944+0000","last_undegraded":"2024-09-12T18:05:58.408944+0000","last_fullsized":"2024-09-12T18:05:58.408944+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:15.895941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1203,"num_read_kb":968,"num_write":436,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'249","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:05.733364+0000","last_change":"2024-09-12T17:29:52.957963+0000","last_active":"2024-09-12T18:06:05.733364+0000","last_peered":"2024-09-12T18:06:05.733364+0000","last_clean":"2024-09-12T18:06:05.733364+0000","last_became_active":"2024-09-12T17:29:52.957594+0000","last_became_peered":"2024-09-12T17:29:52.957594+0000","last_unstale":"2024-09-12T18:06:05.733364+0000","last_undegraded":"2024-09-12T18:06:05.733364+0000","last_fullsized":"2024-09-12T18:06:05.733364+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:50.942076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5844893,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":697,"num_read_kb":82538,"num_write":1030,"num_write_kb":35611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'90","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.508667+0000","last_change":"2024-09-12T17:29:54.955262+0000","last_active":"2024-09-12T18:05:53.508667+0000","last_peered":"2024-09-12T18:05:53.508667+0000","last_clean":"2024-09-12T18:05:53.508667+0000","last_became_active":"2024-09-12T17:29:54.954764+0000","last_became_peered":"2024-09-12T17:29:54.954764+0000","last_unstale":"2024-09-12T18:05:53.508667+0000","last_undegraded":"2024-09-12T18:05:53.508667+0000","last_fullsized":"2024-09-12T18:05:53.508667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:12.643057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":371,"num_write":125,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'203","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.209592+0000","last_change":"2024-09-12T17:29:52.957193+0000","last_active":"2024-09-12T18:05:56.209592+0000","last_peered":"2024-09-12T18:05:56.209592+0000","last_clean":"2024-09-12T18:05:56.209592+0000","last_became_active":"2024-09-12T17:29:52.956816+0000","last_became_peered":"2024-09-12T17:29:52.956816+0000","last_unstale":"2024-09-12T18:05:56.209592+0000","last_undegraded":"2024-09-12T18:05:56.209592+0000","last_fullsized":"2024-09-12T18:05:56.209592+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:23.693578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16094916,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":502,"num_read_kb":70330,"num_write":992,"num_write_kb":42186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4089","reported_seq":4667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.194774+0000","last_change":"2024-09-12T17:29:54.945238+0000","last_active":"2024-09-12T18:05:26.194774+0000","last_peered":"2024-09-12T18:05:26.194774+0000","last_clean":"2024-09-12T18:05:26.194774+0000","last_became_active":"2024-09-12T17:29:54.944959+0000","last_became_peered":"2024-09-12T17:29:54.944959+0000","last_unstale":"2024-09-12T18:05:26.194774+0000","last_undegraded":"2024-09-12T18:05:26.194774+0000","last_fullsized":"2024-09-12T18:05:26.194774+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":3000,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:46.528319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16426,"num_read_kb":13705,"num_write":6135,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'161","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.680867+0000","last_change":"2024-09-12T17:29:52.961055+0000","last_active":"2024-09-12T18:04:54.680867+0000","last_peered":"2024-09-12T18:04:54.680867+0000","last_clean":"2024-09-12T18:04:54.680867+0000","last_became_active":"2024-09-12T17:29:52.960666+0000","last_became_peered":"2024-09-12T17:29:52.960666+0000","last_unstale":"2024-09-12T18:04:54.680867+0000","last_undegraded":"2024-09-12T18:04:54.680867+0000","last_fullsized":"2024-09-12T18:04:54.680867+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:19.974025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23698,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":498,"num_read_kb":127585,"num_write":824,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'125","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.071213+0000","last_change":"2024-09-12T17:29:54.955474+0000","last_active":"2024-09-12T18:05:52.071213+0000","last_peered":"2024-09-12T18:05:52.071213+0000","last_clean":"2024-09-12T18:05:52.071213+0000","last_became_active":"2024-09-12T17:29:54.955205+0000","last_became_peered":"2024-09-12T17:29:54.955205+0000","last_unstale":"2024-09-12T18:05:52.071213+0000","last_undegraded":"2024-09-12T18:05:52.071213+0000","last_fullsized":"2024-09-12T18:05:52.071213+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:25.759255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":437,"num_write":181,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'213","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:21.850266+0000","last_change":"2024-09-12T17:29:52.960833+0000","last_active":"2024-09-12T18:05:21.850266+0000","last_peered":"2024-09-12T18:05:21.850266+0000","last_clean":"2024-09-12T18:05:21.850266+0000","last_became_active":"2024-09-12T17:29:52.955926+0000","last_became_peered":"2024-09-12T17:29:52.955926+0000","last_unstale":"2024-09-12T18:05:21.850266+0000","last_undegraded":"2024-09-12T18:05:21.850266+0000","last_fullsized":"2024-09-12T18:05:21.850266+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:53.948085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609549,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":499,"num_read_kb":5634,"num_write":1055,"num_write_kb":27185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'203","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.854752+0000","last_change":"2024-09-12T17:29:54.955413+0000","last_active":"2024-09-12T18:06:20.854752+0000","last_peered":"2024-09-12T18:06:20.854752+0000","last_clean":"2024-09-12T18:06:20.854752+0000","last_became_active":"2024-09-12T17:29:54.955119+0000","last_became_peered":"2024-09-12T17:29:54.955119+0000","last_unstale":"2024-09-12T18:06:20.854752+0000","last_undegraded":"2024-09-12T18:06:20.854752+0000","last_fullsized":"2024-09-12T18:06:20.854752+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:34.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":872,"num_read_kb":697,"num_write":351,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'193","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:24.702189+0000","last_change":"2024-09-12T17:29:52.962572+0000","last_active":"2024-09-12T18:07:24.702189+0000","last_peered":"2024-09-12T18:07:24.702189+0000","last_clean":"2024-09-12T18:07:24.702189+0000","last_became_active":"2024-09-12T17:29:52.962236+0000","last_became_peered":"2024-09-12T17:29:52.962236+0000","last_unstale":"2024-09-12T18:07:24.702189+0000","last_undegraded":"2024-09-12T18:07:24.702189+0000","last_fullsized":"2024-09-12T18:07:24.702189+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3350960,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":5167,"num_write":1011,"num_write_kb":25714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'272","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:18.420389+0000","last_change":"2024-09-12T17:29:54.963988+0000","last_active":"2024-09-12T18:06:18.420389+0000","last_peered":"2024-09-12T18:06:18.420389+0000","last_clean":"2024-09-12T18:06:18.420389+0000","last_became_active":"2024-09-12T17:29:54.963665+0000","last_became_peered":"2024-09-12T17:29:54.963665+0000","last_unstale":"2024-09-12T18:06:18.420389+0000","last_undegraded":"2024-09-12T18:06:18.420389+0000","last_fullsized":"2024-09-12T18:06:18.420389+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:56.293772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1246,"num_read_kb":1040,"num_write":431,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'225","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.912375+0000","last_change":"2024-09-12T17:29:52.956163+0000","last_active":"2024-09-12T18:06:01.912375+0000","last_peered":"2024-09-12T18:06:01.912375+0000","last_clean":"2024-09-12T18:06:01.912375+0000","last_became_active":"2024-09-12T17:29:52.955333+0000","last_became_peered":"2024-09-12T17:29:52.955333+0000","last_unstale":"2024-09-12T18:06:01.912375+0000","last_undegraded":"2024-09-12T18:06:01.912375+0000","last_fullsized":"2024-09-12T18:06:01.912375+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:31.003485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804154,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":522,"num_read_kb":94260,"num_write":1112,"num_write_kb":40355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'158","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.172360+0000","last_change":"2024-09-12T17:29:54.952797+0000","last_active":"2024-09-12T18:06:07.172360+0000","last_peered":"2024-09-12T18:06:07.172360+0000","last_clean":"2024-09-12T18:06:07.172360+0000","last_became_active":"2024-09-12T17:29:54.952536+0000","last_became_peered":"2024-09-12T17:29:54.952536+0000","last_unstale":"2024-09-12T18:06:07.172360+0000","last_undegraded":"2024-09-12T18:06:07.172360+0000","last_fullsized":"2024-09-12T18:06:07.172360+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:50.999631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":604,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'401","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.229784+0000","last_change":"2024-09-12T17:29:54.955472+0000","last_active":"2024-09-12T18:05:52.229784+0000","last_peered":"2024-09-12T18:05:52.229784+0000","last_clean":"2024-09-12T18:05:52.229784+0000","last_became_active":"2024-09-12T17:29:54.954401+0000","last_became_peered":"2024-09-12T17:29:54.954401+0000","last_unstale":"2024-09-12T18:05:52.229784+0000","last_undegraded":"2024-09-12T18:05:52.229784+0000","last_fullsized":"2024-09-12T18:05:52.229784+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:16.926597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1720,"num_read_kb":1358,"num_write":655,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'181","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:41.511352+0000","last_change":"2024-09-12T17:29:52.958556+0000","last_active":"2024-09-12T18:05:41.511352+0000","last_peered":"2024-09-12T18:05:41.511352+0000","last_clean":"2024-09-12T18:05:41.511352+0000","last_became_active":"2024-09-12T17:29:52.957715+0000","last_became_peered":"2024-09-12T17:29:52.957715+0000","last_unstale":"2024-09-12T18:05:41.511352+0000","last_undegraded":"2024-09-12T18:05:41.511352+0000","last_fullsized":"2024-09-12T18:05:41.511352+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:48.046592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2064,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":321,"num_read_kb":380,"num_write":907,"num_write_kb":20925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'91","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.680830+0000","last_change":"2024-09-12T17:29:54.960764+0000","last_active":"2024-09-12T18:04:54.680830+0000","last_peered":"2024-09-12T18:04:54.680830+0000","last_clean":"2024-09-12T18:04:54.680830+0000","last_became_active":"2024-09-12T17:29:54.960430+0000","last_became_peered":"2024-09-12T17:29:54.960430+0000","last_unstale":"2024-09-12T18:04:54.680830+0000","last_undegraded":"2024-09-12T18:04:54.680830+0000","last_fullsized":"2024-09-12T18:04:54.680830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:51.078408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":446,"num_read_kb":372,"num_write":151,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'239","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.298482+0000","last_change":"2024-09-12T17:29:52.961437+0000","last_active":"2024-09-12T18:06:19.298482+0000","last_peered":"2024-09-12T18:06:19.298482+0000","last_clean":"2024-09-12T18:06:19.298482+0000","last_became_active":"2024-09-12T17:29:52.960770+0000","last_became_peered":"2024-09-12T17:29:52.960770+0000","last_unstale":"2024-09-12T18:06:19.298482+0000","last_undegraded":"2024-09-12T18:06:19.298482+0000","last_fullsized":"2024-09-12T18:06:19.298482+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:52.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16858859,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":819,"num_read_kb":13405,"num_write":1109,"num_write_kb":28936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'257","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.245805+0000","last_change":"2024-09-12T17:29:54.963348+0000","last_active":"2024-09-12T18:06:21.245805+0000","last_peered":"2024-09-12T18:06:21.245805+0000","last_clean":"2024-09-12T18:06:21.245805+0000","last_became_active":"2024-09-12T17:29:54.962822+0000","last_became_peered":"2024-09-12T17:29:54.962822+0000","last_unstale":"2024-09-12T18:06:21.245805+0000","last_undegraded":"2024-09-12T18:06:21.245805+0000","last_fullsized":"2024-09-12T18:06:21.245805+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:14.125505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1220,"num_read_kb":1023,"num_write":434,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'204","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.559749+0000","last_change":"2024-09-12T17:29:52.956896+0000","last_active":"2024-09-12T18:06:07.559749+0000","last_peered":"2024-09-12T18:06:07.559749+0000","last_clean":"2024-09-12T18:06:07.559749+0000","last_became_active":"2024-09-12T17:29:52.956432+0000","last_became_peered":"2024-09-12T17:29:52.956432+0000","last_unstale":"2024-09-12T18:06:07.559749+0000","last_undegraded":"2024-09-12T18:06:07.559749+0000","last_fullsized":"2024-09-12T18:06:07.559749+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:34.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11441510,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":42949,"num_write":1039,"num_write_kb":37671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'84","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.247939+0000","last_change":"2024-09-12T17:29:54.944847+0000","last_active":"2024-09-12T18:05:24.247939+0000","last_peered":"2024-09-12T18:05:24.247939+0000","last_clean":"2024-09-12T18:05:24.247939+0000","last_became_active":"2024-09-12T17:29:54.944588+0000","last_became_peered":"2024-09-12T17:29:54.944588+0000","last_unstale":"2024-09-12T18:05:24.247939+0000","last_undegraded":"2024-09-12T18:05:24.247939+0000","last_fullsized":"2024-09-12T18:05:24.247939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:15.044680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":342,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'223","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.832826+0000","last_change":"2024-09-12T17:29:52.963156+0000","last_active":"2024-09-12T18:05:26.832826+0000","last_peered":"2024-09-12T18:05:26.832826+0000","last_clean":"2024-09-12T18:05:26.832826+0000","last_became_active":"2024-09-12T17:29:52.962814+0000","last_became_peered":"2024-09-12T17:29:52.962814+0000","last_unstale":"2024-09-12T18:05:26.832826+0000","last_undegraded":"2024-09-12T18:05:26.832826+0000","last_fullsized":"2024-09-12T18:05:26.832826+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:05.435586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10837622,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":48243,"num_write":1121,"num_write_kb":37209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'125","reported_seq":719,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:18.231406+0000","last_change":"2024-09-12T17:29:54.957275+0000","last_active":"2024-09-12T18:05:18.231406+0000","last_peered":"2024-09-12T18:05:18.231406+0000","last_clean":"2024-09-12T18:05:18.231406+0000","last_became_active":"2024-09-12T17:29:54.956975+0000","last_became_peered":"2024-09-12T17:29:54.956975+0000","last_unstale":"2024-09-12T18:05:18.231406+0000","last_undegraded":"2024-09-12T18:05:18.231406+0000","last_fullsized":"2024-09-12T18:05:18.231406+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:35.436729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":592,"num_read_kb":498,"num_write":187,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'254","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.651610+0000","last_change":"2024-09-12T17:29:52.954983+0000","last_active":"2024-09-12T18:05:30.651610+0000","last_peered":"2024-09-12T18:05:30.651610+0000","last_clean":"2024-09-12T18:05:30.651610+0000","last_became_active":"2024-09-12T17:29:52.954630+0000","last_became_peered":"2024-09-12T17:29:52.954630+0000","last_unstale":"2024-09-12T18:05:30.651610+0000","last_undegraded":"2024-09-12T18:05:30.651610+0000","last_fullsized":"2024-09-12T18:05:30.651610+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:32.291580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15348488,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":833,"num_read_kb":67261,"num_write":1121,"num_write_kb":48740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'283","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.230047+0000","last_change":"2024-09-12T17:29:54.959334+0000","last_active":"2024-09-12T18:05:30.230047+0000","last_peered":"2024-09-12T18:05:30.230047+0000","last_clean":"2024-09-12T18:05:30.230047+0000","last_became_active":"2024-09-12T17:29:54.958852+0000","last_became_peered":"2024-09-12T17:29:54.958852+0000","last_unstale":"2024-09-12T18:05:30.230047+0000","last_undegraded":"2024-09-12T18:05:30.230047+0000","last_fullsized":"2024-09-12T18:05:30.230047+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:21.982711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1254,"num_read_kb":1035,"num_write":436,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'169","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:17.890071+0000","last_change":"2024-09-12T17:29:52.959483+0000","last_active":"2024-09-12T18:05:17.890071+0000","last_peered":"2024-09-12T18:05:17.890071+0000","last_clean":"2024-09-12T18:05:17.890071+0000","last_became_active":"2024-09-12T17:29:52.959175+0000","last_became_peered":"2024-09-12T17:29:52.959175+0000","last_unstale":"2024-09-12T18:05:17.890071+0000","last_undegraded":"2024-09-12T18:05:17.890071+0000","last_fullsized":"2024-09-12T18:05:17.890071+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:39.671271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242932,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":327,"num_read_kb":1243,"num_write":850,"num_write_kb":36341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'154","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.297485+0000","last_change":"2024-09-12T17:30:02.964799+0000","last_active":"2024-09-12T18:06:21.297485+0000","last_peered":"2024-09-12T18:06:21.297485+0000","last_clean":"2024-09-12T18:06:21.297485+0000","last_became_active":"2024-09-12T17:30:02.964492+0000","last_became_peered":"2024-09-12T17:30:02.964492+0000","last_unstale":"2024-09-12T18:06:21.297485+0000","last_undegraded":"2024-09-12T18:06:21.297485+0000","last_fullsized":"2024-09-12T18:06:21.297485+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:49.837441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":218,"num_read_kb":205,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'110","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.335050+0000","last_change":"2024-09-12T17:29:54.951914+0000","last_active":"2024-09-12T18:05:59.335050+0000","last_peered":"2024-09-12T18:05:59.335050+0000","last_clean":"2024-09-12T18:05:59.335050+0000","last_became_active":"2024-09-12T17:29:54.950633+0000","last_became_peered":"2024-09-12T17:29:54.950633+0000","last_unstale":"2024-09-12T18:05:59.335050+0000","last_undegraded":"2024-09-12T18:05:59.335050+0000","last_fullsized":"2024-09-12T18:05:59.335050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:07.589708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":400,"num_write":147,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'196","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.159300+0000","last_change":"2024-09-12T17:30:28.007547+0000","last_active":"2024-09-12T18:05:59.159300+0000","last_peered":"2024-09-12T18:05:59.159300+0000","last_clean":"2024-09-12T18:05:59.159300+0000","last_became_active":"2024-09-12T17:30:28.007183+0000","last_became_peered":"2024-09-12T17:30:28.007183+0000","last_unstale":"2024-09-12T18:05:59.159300+0000","last_undegraded":"2024-09-12T18:05:59.159300+0000","last_fullsized":"2024-09-12T18:05:59.159300+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:49.159102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":968005,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":913,"num_read_kb":19617,"num_write":946,"num_write_kb":33635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.600586+0000","last_change":"2024-09-12T17:29:56.954842+0000","last_active":"2024-09-12T18:07:38.600586+0000","last_peered":"2024-09-12T18:07:38.600586+0000","last_clean":"2024-09-12T18:07:38.600586+0000","last_became_active":"2024-09-12T17:29:56.954488+0000","last_became_peered":"2024-09-12T17:29:56.954488+0000","last_unstale":"2024-09-12T18:07:38.600586+0000","last_undegraded":"2024-09-12T18:07:38.600586+0000","last_fullsized":"2024-09-12T18:07:38.600586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:16.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":721,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'174","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.654293+0000","last_change":"2024-09-12T17:29:58.957203+0000","last_active":"2024-09-12T18:06:14.654293+0000","last_peered":"2024-09-12T18:06:14.654293+0000","last_clean":"2024-09-12T18:06:14.654293+0000","last_became_active":"2024-09-12T17:29:58.956916+0000","last_became_peered":"2024-09-12T17:29:58.956916+0000","last_unstale":"2024-09-12T18:06:14.654293+0000","last_undegraded":"2024-09-12T18:06:14.654293+0000","last_fullsized":"2024-09-12T18:06:14.654293+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:23.529305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5073,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":227,"num_read_kb":264,"num_write":128,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.671162+0000","last_change":"2024-09-12T17:30:00.960720+0000","last_active":"2024-09-12T18:03:54.671162+0000","last_peered":"2024-09-12T18:03:54.671162+0000","last_clean":"2024-09-12T18:03:54.671162+0000","last_became_active":"2024-09-12T17:30:00.960409+0000","last_became_peered":"2024-09-12T17:30:00.960409+0000","last_unstale":"2024-09-12T18:03:54.671162+0000","last_undegraded":"2024-09-12T18:03:54.671162+0000","last_fullsized":"2024-09-12T18:03:54.671162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:36.986925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2442","reported_seq":4366,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.852848+0000","last_change":"2024-09-12T17:30:02.968528+0000","last_active":"2024-09-12T18:06:20.852848+0000","last_peered":"2024-09-12T18:06:20.852848+0000","last_clean":"2024-09-12T18:06:20.852848+0000","last_became_active":"2024-09-12T17:30:02.967718+0000","last_became_peered":"2024-09-12T17:30:02.967718+0000","last_unstale":"2024-09-12T18:06:20.852848+0000","last_undegraded":"2024-09-12T18:06:20.852848+0000","last_fullsized":"2024-09-12T18:06:20.852848+0000","mapping_epoch":34,"log_start":"264'2400","ondisk_log_start":"264'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":2400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:40.278625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1044,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6319,"num_read_kb":6274,"num_write":4873,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'136","reported_seq":718,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.219639+0000","last_change":"2024-09-12T17:29:54.958156+0000","last_active":"2024-09-12T18:05:53.219639+0000","last_peered":"2024-09-12T18:05:53.219639+0000","last_clean":"2024-09-12T18:05:53.219639+0000","last_became_active":"2024-09-12T17:29:54.957747+0000","last_became_peered":"2024-09-12T17:29:54.957747+0000","last_unstale":"2024-09-12T18:05:53.219639+0000","last_undegraded":"2024-09-12T18:05:53.219639+0000","last_fullsized":"2024-09-12T18:05:53.219639+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:45.769420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":552,"num_write":215,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'209","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.315455+0000","last_change":"2024-09-12T17:29:52.950951+0000","last_active":"2024-09-12T18:05:20.315455+0000","last_peered":"2024-09-12T18:05:20.315455+0000","last_clean":"2024-09-12T18:05:20.315455+0000","last_became_active":"2024-09-12T17:29:52.950612+0000","last_became_peered":"2024-09-12T17:29:52.950612+0000","last_unstale":"2024-09-12T18:05:20.315455+0000","last_undegraded":"2024-09-12T18:05:20.315455+0000","last_fullsized":"2024-09-12T18:05:20.315455+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:09.873785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44593,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":10994,"num_write":1023,"num_write_kb":32732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.528200+0000","last_change":"2024-09-12T17:29:56.953819+0000","last_active":"2024-09-12T18:05:09.528200+0000","last_peered":"2024-09-12T18:05:09.528200+0000","last_clean":"2024-09-12T18:05:09.528200+0000","last_became_active":"2024-09-12T17:29:56.953546+0000","last_became_peered":"2024-09-12T17:29:56.953546+0000","last_unstale":"2024-09-12T18:05:09.528200+0000","last_undegraded":"2024-09-12T18:05:09.528200+0000","last_fullsized":"2024-09-12T18:05:09.528200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:02.063377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'85","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.814472+0000","last_change":"2024-09-12T17:29:58.951397+0000","last_active":"2024-09-12T18:05:55.814472+0000","last_peered":"2024-09-12T18:05:55.814472+0000","last_clean":"2024-09-12T18:05:55.814472+0000","last_became_active":"2024-09-12T17:29:58.951077+0000","last_became_peered":"2024-09-12T17:29:58.951077+0000","last_unstale":"2024-09-12T18:05:55.814472+0000","last_undegraded":"2024-09-12T18:05:55.814472+0000","last_fullsized":"2024-09-12T18:05:55.814472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:32.229853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.505635+0000","last_change":"2024-09-12T17:30:00.969561+0000","last_active":"2024-09-12T18:03:54.505635+0000","last_peered":"2024-09-12T18:03:54.505635+0000","last_clean":"2024-09-12T18:03:54.505635+0000","last_became_active":"2024-09-12T17:30:00.969291+0000","last_became_peered":"2024-09-12T17:30:00.969291+0000","last_unstale":"2024-09-12T18:03:54.505635+0000","last_undegraded":"2024-09-12T18:03:54.505635+0000","last_fullsized":"2024-09-12T18:03:54.505635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:59.191519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'123","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:03.288660+0000","last_change":"2024-09-12T17:30:02.972169+0000","last_active":"2024-09-12T18:06:03.288660+0000","last_peered":"2024-09-12T18:06:03.288660+0000","last_clean":"2024-09-12T18:06:03.288660+0000","last_became_active":"2024-09-12T17:30:02.971843+0000","last_became_peered":"2024-09-12T17:30:02.971843+0000","last_unstale":"2024-09-12T18:06:03.288660+0000","last_undegraded":"2024-09-12T18:06:03.288660+0000","last_fullsized":"2024-09-12T18:06:03.288660+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:27.791607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'129","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.234318+0000","last_change":"2024-09-12T17:29:54.945375+0000","last_active":"2024-09-12T18:06:00.234318+0000","last_peered":"2024-09-12T18:06:00.234318+0000","last_clean":"2024-09-12T18:06:00.234318+0000","last_became_active":"2024-09-12T17:29:54.944698+0000","last_became_peered":"2024-09-12T17:29:54.944698+0000","last_unstale":"2024-09-12T18:06:00.234318+0000","last_undegraded":"2024-09-12T18:06:00.234318+0000","last_fullsized":"2024-09-12T18:06:00.234318+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:02.736469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":422,"num_write":199,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'176","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:05.291120+0000","last_change":"2024-09-12T17:29:52.963403+0000","last_active":"2024-09-12T18:06:05.291120+0000","last_peered":"2024-09-12T18:06:05.291120+0000","last_clean":"2024-09-12T18:06:05.291120+0000","last_became_active":"2024-09-12T17:29:52.963087+0000","last_became_peered":"2024-09-12T17:29:52.963087+0000","last_unstale":"2024-09-12T18:06:05.291120+0000","last_undegraded":"2024-09-12T18:06:05.291120+0000","last_fullsized":"2024-09-12T18:06:05.291120+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:31.829205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10614291,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":3190,"num_write":915,"num_write_kb":30863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.515779+0000","last_change":"2024-09-12T17:29:56.953137+0000","last_active":"2024-09-12T18:03:49.515779+0000","last_peered":"2024-09-12T18:03:49.515779+0000","last_clean":"2024-09-12T18:03:49.515779+0000","last_became_active":"2024-09-12T17:29:56.952827+0000","last_became_peered":"2024-09-12T17:29:56.952827+0000","last_unstale":"2024-09-12T18:03:49.515779+0000","last_undegraded":"2024-09-12T18:03:49.515779+0000","last_fullsized":"2024-09-12T18:03:49.515779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:28.816718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'97","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.555493+0000","last_change":"2024-09-12T17:29:58.952475+0000","last_active":"2024-09-12T18:05:29.555493+0000","last_peered":"2024-09-12T18:05:29.555493+0000","last_clean":"2024-09-12T18:05:29.555493+0000","last_became_active":"2024-09-12T17:29:58.952169+0000","last_became_peered":"2024-09-12T17:29:58.952169+0000","last_unstale":"2024-09-12T18:05:29.555493+0000","last_undegraded":"2024-09-12T18:05:29.555493+0000","last_fullsized":"2024-09-12T18:05:29.555493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:14.255681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":103,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'751","reported_seq":2401,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.686944+0000","last_change":"2024-09-12T17:30:00.954478+0000","last_active":"2024-09-12T18:07:38.686944+0000","last_peered":"2024-09-12T18:07:38.686944+0000","last_clean":"2024-09-12T18:07:38.686944+0000","last_became_active":"2024-09-12T17:30:00.954180+0000","last_became_peered":"2024-09-12T17:30:00.954180+0000","last_unstale":"2024-09-12T18:07:38.686944+0000","last_undegraded":"2024-09-12T18:07:38.686944+0000","last_fullsized":"2024-09-12T18:07:38.686944+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:51.847365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'180","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.347847+0000","last_change":"2024-09-12T17:30:02.962486+0000","last_active":"2024-09-12T18:06:21.347847+0000","last_peered":"2024-09-12T18:06:21.347847+0000","last_clean":"2024-09-12T18:06:21.347847+0000","last_became_active":"2024-09-12T17:30:02.961198+0000","last_became_peered":"2024-09-12T17:30:02.961198+0000","last_unstale":"2024-09-12T18:06:21.347847+0000","last_undegraded":"2024-09-12T18:06:21.347847+0000","last_fullsized":"2024-09-12T18:06:21.347847+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:59.034236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":624,"num_write":393,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'95","reported_seq":671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.293469+0000","last_change":"2024-09-12T17:29:54.956913+0000","last_active":"2024-09-12T18:06:06.293469+0000","last_peered":"2024-09-12T18:06:06.293469+0000","last_clean":"2024-09-12T18:06:06.293469+0000","last_became_active":"2024-09-12T17:29:54.956663+0000","last_became_peered":"2024-09-12T17:29:54.956663+0000","last_unstale":"2024-09-12T18:06:06.293469+0000","last_undegraded":"2024-09-12T18:06:06.293469+0000","last_fullsized":"2024-09-12T18:06:06.293469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:29.330762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":356,"num_write":140,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'158","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.735808+0000","last_change":"2024-09-12T17:29:52.963393+0000","last_active":"2024-09-12T18:05:56.735808+0000","last_peered":"2024-09-12T18:05:56.735808+0000","last_clean":"2024-09-12T18:05:56.735808+0000","last_became_active":"2024-09-12T17:29:52.962665+0000","last_became_peered":"2024-09-12T17:29:52.962665+0000","last_unstale":"2024-09-12T18:05:56.735808+0000","last_undegraded":"2024-09-12T18:05:56.735808+0000","last_fullsized":"2024-09-12T18:05:56.735808+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:43.499509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17855108,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":345,"num_read_kb":5731,"num_write":807,"num_write_kb":29128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.627887+0000","last_change":"2024-09-12T17:29:56.953011+0000","last_active":"2024-09-12T18:03:49.627887+0000","last_peered":"2024-09-12T18:03:49.627887+0000","last_clean":"2024-09-12T18:03:49.627887+0000","last_became_active":"2024-09-12T17:29:56.952625+0000","last_became_peered":"2024-09-12T17:29:56.952625+0000","last_unstale":"2024-09-12T18:03:49.627887+0000","last_undegraded":"2024-09-12T18:03:49.627887+0000","last_fullsized":"2024-09-12T18:03:49.627887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:37.754261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'101","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.692414+0000","last_change":"2024-09-12T17:29:58.978681+0000","last_active":"2024-09-12T18:06:14.692414+0000","last_peered":"2024-09-12T18:06:14.692414+0000","last_clean":"2024-09-12T18:06:14.692414+0000","last_became_active":"2024-09-12T17:29:58.978299+0000","last_became_peered":"2024-09-12T17:29:58.978299+0000","last_unstale":"2024-09-12T18:06:14.692414+0000","last_undegraded":"2024-09-12T18:06:14.692414+0000","last_fullsized":"2024-09-12T18:06:14.692414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:51.821063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4431,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":58,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'772","reported_seq":3915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.691525+0000","last_change":"2024-09-12T17:30:00.963021+0000","last_active":"2024-09-12T18:07:38.691525+0000","last_peered":"2024-09-12T18:07:38.691525+0000","last_clean":"2024-09-12T18:07:38.691525+0000","last_became_active":"2024-09-12T17:30:00.962754+0000","last_became_peered":"2024-09-12T17:30:00.962754+0000","last_unstale":"2024-09-12T18:07:38.691525+0000","last_undegraded":"2024-09-12T18:07:38.691525+0000","last_fullsized":"2024-09-12T18:07:38.691525+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:34.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'251","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.889819+0000","last_change":"2024-09-12T17:29:54.957456+0000","last_active":"2024-09-12T18:06:00.889819+0000","last_peered":"2024-09-12T18:06:00.889819+0000","last_clean":"2024-09-12T18:06:00.889819+0000","last_became_active":"2024-09-12T17:29:54.957148+0000","last_became_peered":"2024-09-12T17:29:54.957148+0000","last_unstale":"2024-09-12T18:06:00.889819+0000","last_undegraded":"2024-09-12T18:06:00.889819+0000","last_fullsized":"2024-09-12T18:06:00.889819+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:19.628837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":968,"num_write":398,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'233","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:51.286563+0000","last_change":"2024-09-12T17:29:52.964771+0000","last_active":"2024-09-12T18:05:51.286563+0000","last_peered":"2024-09-12T18:05:51.286563+0000","last_clean":"2024-09-12T18:05:51.286563+0000","last_became_active":"2024-09-12T17:29:52.964421+0000","last_became_peered":"2024-09-12T17:29:52.964421+0000","last_unstale":"2024-09-12T18:05:51.286563+0000","last_undegraded":"2024-09-12T18:05:51.286563+0000","last_fullsized":"2024-09-12T18:05:51.286563+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:13.642050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6103136,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":5176,"num_write":1040,"num_write_kb":56179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.678374+0000","last_change":"2024-09-12T17:29:56.953482+0000","last_active":"2024-09-12T18:04:39.678374+0000","last_peered":"2024-09-12T18:04:39.678374+0000","last_clean":"2024-09-12T18:04:39.678374+0000","last_became_active":"2024-09-12T17:29:56.953204+0000","last_became_peered":"2024-09-12T17:29:56.953204+0000","last_unstale":"2024-09-12T18:04:39.678374+0000","last_undegraded":"2024-09-12T18:04:39.678374+0000","last_fullsized":"2024-09-12T18:04:39.678374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:49.409852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'177","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:54.655776+0000","last_change":"2024-09-12T17:29:58.979003+0000","last_active":"2024-09-12T18:06:54.655776+0000","last_peered":"2024-09-12T18:06:54.655776+0000","last_clean":"2024-09-12T18:06:54.655776+0000","last_became_active":"2024-09-12T17:29:58.978213+0000","last_became_peered":"2024-09-12T17:29:58.978213+0000","last_unstale":"2024-09-12T18:06:54.655776+0000","last_undegraded":"2024-09-12T18:06:54.655776+0000","last_fullsized":"2024-09-12T18:06:54.655776+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:29.055630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11558,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":242,"num_read_kb":287,"num_write":136,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.632793+0000","last_change":"2024-09-12T17:30:00.959136+0000","last_active":"2024-09-12T18:03:49.632793+0000","last_peered":"2024-09-12T18:03:49.632793+0000","last_clean":"2024-09-12T18:03:49.632793+0000","last_became_active":"2024-09-12T17:30:00.958723+0000","last_became_peered":"2024-09-12T17:30:00.958723+0000","last_unstale":"2024-09-12T18:03:49.632793+0000","last_undegraded":"2024-09-12T18:03:49.632793+0000","last_fullsized":"2024-09-12T18:03:49.632793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:07.523774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'549","reported_seq":1353,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.673110+0000","last_change":"2024-09-12T17:30:02.968872+0000","last_active":"2024-09-12T18:07:38.673110+0000","last_peered":"2024-09-12T18:07:38.673110+0000","last_clean":"2024-09-12T18:07:38.673110+0000","last_became_active":"2024-09-12T17:30:02.968515+0000","last_became_peered":"2024-09-12T17:30:02.968515+0000","last_unstale":"2024-09-12T18:07:38.673110+0000","last_undegraded":"2024-09-12T18:07:38.673110+0000","last_fullsized":"2024-09-12T18:07:38.673110+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:33.814672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1325,"num_read_kb":1316,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'153","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.308857+0000","last_change":"2024-09-12T17:29:54.959404+0000","last_active":"2024-09-12T18:06:08.308857+0000","last_peered":"2024-09-12T18:06:08.308857+0000","last_clean":"2024-09-12T18:06:08.308857+0000","last_became_active":"2024-09-12T17:29:54.959140+0000","last_became_peered":"2024-09-12T17:29:54.959140+0000","last_unstale":"2024-09-12T18:06:08.308857+0000","last_undegraded":"2024-09-12T18:06:08.308857+0000","last_fullsized":"2024-09-12T18:06:08.308857+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:46.796125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":582,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'173","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.234904+0000","last_change":"2024-09-12T17:29:52.964678+0000","last_active":"2024-09-12T18:05:29.234904+0000","last_peered":"2024-09-12T18:05:29.234904+0000","last_clean":"2024-09-12T18:05:29.234904+0000","last_became_active":"2024-09-12T17:29:52.964339+0000","last_became_peered":"2024-09-12T17:29:52.964339+0000","last_unstale":"2024-09-12T18:05:29.234904+0000","last_undegraded":"2024-09-12T18:05:29.234904+0000","last_fullsized":"2024-09-12T18:05:29.234904+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:23.502950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4544464,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":377,"num_read_kb":1621,"num_write":862,"num_write_kb":10562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.638636+0000","last_change":"2024-09-12T17:29:56.954142+0000","last_active":"2024-09-12T18:04:39.638636+0000","last_peered":"2024-09-12T18:04:39.638636+0000","last_clean":"2024-09-12T18:04:39.638636+0000","last_became_active":"2024-09-12T17:29:56.953551+0000","last_became_peered":"2024-09-12T17:29:56.953551+0000","last_unstale":"2024-09-12T18:04:39.638636+0000","last_undegraded":"2024-09-12T18:04:39.638636+0000","last_fullsized":"2024-09-12T18:04:39.638636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:50.189739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'121","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.538665+0000","last_change":"2024-09-12T17:29:58.953621+0000","last_active":"2024-09-12T18:05:59.538665+0000","last_peered":"2024-09-12T18:05:59.538665+0000","last_clean":"2024-09-12T18:05:59.538665+0000","last_became_active":"2024-09-12T17:29:58.953107+0000","last_became_peered":"2024-09-12T17:29:58.953107+0000","last_unstale":"2024-09-12T18:05:59.538665+0000","last_undegraded":"2024-09-12T18:05:59.538665+0000","last_fullsized":"2024-09-12T18:05:59.538665+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:20.703344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11955,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":154,"num_read_kb":222,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.525616+0000","last_change":"2024-09-12T17:30:00.961851+0000","last_active":"2024-09-12T18:04:54.525616+0000","last_peered":"2024-09-12T18:04:54.525616+0000","last_clean":"2024-09-12T18:04:54.525616+0000","last_became_active":"2024-09-12T17:30:00.961545+0000","last_became_peered":"2024-09-12T17:30:00.961545+0000","last_unstale":"2024-09-12T18:04:54.525616+0000","last_undegraded":"2024-09-12T18:04:54.525616+0000","last_fullsized":"2024-09-12T18:04:54.525616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:46.146649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'85","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:28.622892+0000","last_change":"2024-09-12T17:30:02.967776+0000","last_active":"2024-09-12T18:07:28.622892+0000","last_peered":"2024-09-12T18:07:28.622892+0000","last_clean":"2024-09-12T18:07:28.622892+0000","last_became_active":"2024-09-12T17:30:02.967500+0000","last_became_peered":"2024-09-12T17:30:02.967500+0000","last_unstale":"2024-09-12T18:07:28.622892+0000","last_undegraded":"2024-09-12T18:07:28.622892+0000","last_fullsized":"2024-09-12T18:07:28.622892+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:21.856163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":199,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'67","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:28.210721+0000","last_change":"2024-09-12T17:29:54.960258+0000","last_active":"2024-09-12T18:05:28.210721+0000","last_peered":"2024-09-12T18:05:28.210721+0000","last_clean":"2024-09-12T18:05:28.210721+0000","last_became_active":"2024-09-12T17:29:54.959979+0000","last_became_peered":"2024-09-12T17:29:54.959979+0000","last_unstale":"2024-09-12T18:05:28.210721+0000","last_undegraded":"2024-09-12T18:05:28.210721+0000","last_fullsized":"2024-09-12T18:05:28.210721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:30.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":252,"num_write":105,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'335","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:41.731550+0000","last_change":"2024-09-12T17:29:52.957702+0000","last_active":"2024-09-12T18:05:41.731550+0000","last_peered":"2024-09-12T18:05:41.731550+0000","last_clean":"2024-09-12T18:05:41.731550+0000","last_became_active":"2024-09-12T17:29:52.957308+0000","last_became_peered":"2024-09-12T17:29:52.957308+0000","last_unstale":"2024-09-12T18:05:41.731550+0000","last_undegraded":"2024-09-12T18:05:41.731550+0000","last_fullsized":"2024-09-12T18:05:41.731550+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:52.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1994342,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":830,"num_read_kb":24052,"num_write":1266,"num_write_kb":42343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'4","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.599934+0000","last_change":"2024-09-12T17:29:56.959495+0000","last_active":"2024-09-12T18:07:38.599934+0000","last_peered":"2024-09-12T18:07:38.599934+0000","last_clean":"2024-09-12T18:07:38.599934+0000","last_became_active":"2024-09-12T17:29:56.959206+0000","last_became_peered":"2024-09-12T17:29:56.959206+0000","last_unstale":"2024-09-12T18:07:38.599934+0000","last_undegraded":"2024-09-12T18:07:38.599934+0000","last_fullsized":"2024-09-12T18:07:38.599934+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:54.257647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'154","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.770021+0000","last_change":"2024-09-12T17:29:58.956025+0000","last_active":"2024-09-12T18:07:37.770021+0000","last_peered":"2024-09-12T18:07:37.770021+0000","last_clean":"2024-09-12T18:07:37.770021+0000","last_became_active":"2024-09-12T17:29:58.955698+0000","last_became_peered":"2024-09-12T17:29:58.955698+0000","last_unstale":"2024-09-12T18:07:37.770021+0000","last_undegraded":"2024-09-12T18:07:37.770021+0000","last_fullsized":"2024-09-12T18:07:37.770021+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:21.001386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9820,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":188,"num_read_kb":244,"num_write":108,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'760","reported_seq":2323,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.692388+0000","last_change":"2024-09-12T17:30:00.967003+0000","last_active":"2024-09-12T18:07:38.692388+0000","last_peered":"2024-09-12T18:07:38.692388+0000","last_clean":"2024-09-12T18:07:38.692388+0000","last_became_active":"2024-09-12T17:30:00.966661+0000","last_became_peered":"2024-09-12T17:30:00.966661+0000","last_unstale":"2024-09-12T18:07:38.692388+0000","last_undegraded":"2024-09-12T18:07:38.692388+0000","last_fullsized":"2024-09-12T18:07:38.692388+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:57.546741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'107","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.730576+0000","last_change":"2024-09-12T17:30:02.970504+0000","last_active":"2024-09-12T18:07:37.730576+0000","last_peered":"2024-09-12T18:07:37.730576+0000","last_clean":"2024-09-12T18:07:37.730576+0000","last_became_active":"2024-09-12T17:30:02.969837+0000","last_became_peered":"2024-09-12T17:30:02.969837+0000","last_unstale":"2024-09-12T18:07:37.730576+0000","last_undegraded":"2024-09-12T18:07:37.730576+0000","last_fullsized":"2024-09-12T18:07:37.730576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:09.306140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":259,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'232","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.631061+0000","last_change":"2024-09-12T17:30:28.004554+0000","last_active":"2024-09-12T18:03:39.631061+0000","last_peered":"2024-09-12T18:03:39.631061+0000","last_clean":"2024-09-12T18:03:39.631061+0000","last_became_active":"2024-09-12T17:30:28.004234+0000","last_became_peered":"2024-09-12T17:30:28.004234+0000","last_unstale":"2024-09-12T18:03:39.631061+0000","last_undegraded":"2024-09-12T18:03:39.631061+0000","last_fullsized":"2024-09-12T18:03:39.631061+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:30.577975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":779,"num_write":354,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'201","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.300333+0000","last_change":"2024-09-12T17:29:52.952108+0000","last_active":"2024-09-12T18:06:19.300333+0000","last_peered":"2024-09-12T18:06:19.300333+0000","last_clean":"2024-09-12T18:06:19.300333+0000","last_became_active":"2024-09-12T17:29:52.951442+0000","last_became_peered":"2024-09-12T17:29:52.951442+0000","last_unstale":"2024-09-12T18:06:19.300333+0000","last_undegraded":"2024-09-12T18:06:19.300333+0000","last_fullsized":"2024-09-12T18:06:19.300333+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:21.862788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11973788,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":473,"num_read_kb":16166,"num_write":928,"num_write_kb":36148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639431+0000","last_change":"2024-09-12T17:29:56.956309+0000","last_active":"2024-09-12T18:04:44.639431+0000","last_peered":"2024-09-12T18:04:44.639431+0000","last_clean":"2024-09-12T18:04:44.639431+0000","last_became_active":"2024-09-12T17:29:56.955948+0000","last_became_peered":"2024-09-12T17:29:56.955948+0000","last_unstale":"2024-09-12T18:04:44.639431+0000","last_undegraded":"2024-09-12T18:04:44.639431+0000","last_fullsized":"2024-09-12T18:04:44.639431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:39.319625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'194","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.642522+0000","last_change":"2024-09-12T17:29:58.958169+0000","last_active":"2024-09-12T18:07:38.642522+0000","last_peered":"2024-09-12T18:07:38.642522+0000","last_clean":"2024-09-12T18:07:38.642522+0000","last_became_active":"2024-09-12T17:29:58.957183+0000","last_became_peered":"2024-09-12T17:29:58.957183+0000","last_unstale":"2024-09-12T18:07:38.642522+0000","last_undegraded":"2024-09-12T18:07:38.642522+0000","last_fullsized":"2024-09-12T18:07:38.642522+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:19.712371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18981,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":356,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639403+0000","last_change":"2024-09-12T17:30:00.958337+0000","last_active":"2024-09-12T18:04:44.639403+0000","last_peered":"2024-09-12T18:04:44.639403+0000","last_clean":"2024-09-12T18:04:44.639403+0000","last_became_active":"2024-09-12T17:30:00.958049+0000","last_became_peered":"2024-09-12T17:30:00.958049+0000","last_unstale":"2024-09-12T18:04:44.639403+0000","last_undegraded":"2024-09-12T18:04:44.639403+0000","last_fullsized":"2024-09-12T18:04:44.639403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:24.880580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'146","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.020504+0000","last_change":"2024-09-12T17:30:02.970369+0000","last_active":"2024-09-12T18:05:56.020504+0000","last_peered":"2024-09-12T18:05:56.020504+0000","last_clean":"2024-09-12T18:05:56.020504+0000","last_became_active":"2024-09-12T17:30:02.970095+0000","last_became_peered":"2024-09-12T17:30:02.970095+0000","last_unstale":"2024-09-12T18:05:56.020504+0000","last_undegraded":"2024-09-12T18:05:56.020504+0000","last_fullsized":"2024-09-12T18:05:56.020504+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:20.676163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":173,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'179","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.253509+0000","last_change":"2024-09-12T17:29:54.957178+0000","last_active":"2024-09-12T18:05:56.253509+0000","last_peered":"2024-09-12T18:05:56.253509+0000","last_clean":"2024-09-12T18:05:56.253509+0000","last_became_active":"2024-09-12T17:29:54.956850+0000","last_became_peered":"2024-09-12T17:29:54.956850+0000","last_unstale":"2024-09-12T18:05:56.253509+0000","last_undegraded":"2024-09-12T18:05:56.253509+0000","last_fullsized":"2024-09-12T18:05:56.253509+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:59.322551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":712,"num_read_kb":607,"num_write":242,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'174","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.297648+0000","last_change":"2024-09-12T17:29:52.959240+0000","last_active":"2024-09-12T18:06:19.297648+0000","last_peered":"2024-09-12T18:06:19.297648+0000","last_clean":"2024-09-12T18:06:19.297648+0000","last_became_active":"2024-09-12T17:29:52.958919+0000","last_became_peered":"2024-09-12T17:29:52.958919+0000","last_unstale":"2024-09-12T18:06:19.297648+0000","last_undegraded":"2024-09-12T18:06:19.297648+0000","last_fullsized":"2024-09-12T18:06:19.297648+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:33.354065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12930272,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":324,"num_read_kb":13812,"num_write":936,"num_write_kb":31717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.630825+0000","last_change":"2024-09-12T17:29:56.955564+0000","last_active":"2024-09-12T18:03:44.630825+0000","last_peered":"2024-09-12T18:03:44.630825+0000","last_clean":"2024-09-12T18:03:44.630825+0000","last_became_active":"2024-09-12T17:29:56.955288+0000","last_became_peered":"2024-09-12T17:29:56.955288+0000","last_unstale":"2024-09-12T18:03:44.630825+0000","last_undegraded":"2024-09-12T18:03:44.630825+0000","last_fullsized":"2024-09-12T18:03:44.630825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:03.688076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'136","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.523117+0000","last_change":"2024-09-12T17:29:58.953188+0000","last_active":"2024-09-12T18:05:59.523117+0000","last_peered":"2024-09-12T18:05:59.523117+0000","last_clean":"2024-09-12T18:05:59.523117+0000","last_became_active":"2024-09-12T17:29:58.952878+0000","last_became_peered":"2024-09-12T17:29:58.952878+0000","last_unstale":"2024-09-12T18:05:59.523117+0000","last_undegraded":"2024-09-12T18:05:59.523117+0000","last_fullsized":"2024-09-12T18:05:59.523117+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:06.356317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7441,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":233,"num_write":152,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633179+0000","last_change":"2024-09-12T17:30:00.970962+0000","last_active":"2024-09-12T18:03:54.633179+0000","last_peered":"2024-09-12T18:03:54.633179+0000","last_clean":"2024-09-12T18:03:54.633179+0000","last_became_active":"2024-09-12T17:30:00.970668+0000","last_became_peered":"2024-09-12T17:30:00.970668+0000","last_unstale":"2024-09-12T18:03:54.633179+0000","last_undegraded":"2024-09-12T18:03:54.633179+0000","last_fullsized":"2024-09-12T18:03:54.633179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:09.749573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'138","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.302849+0000","last_change":"2024-09-12T17:30:02.964408+0000","last_active":"2024-09-12T18:06:21.302849+0000","last_peered":"2024-09-12T18:06:21.302849+0000","last_clean":"2024-09-12T18:06:21.302849+0000","last_became_active":"2024-09-12T17:30:02.964125+0000","last_became_peered":"2024-09-12T17:30:02.964125+0000","last_unstale":"2024-09-12T18:06:21.302849+0000","last_undegraded":"2024-09-12T18:06:21.302849+0000","last_fullsized":"2024-09-12T18:06:21.302849+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:51.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":200,"num_read_kb":186,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'123","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.807408+0000","last_change":"2024-09-12T17:29:54.958681+0000","last_active":"2024-09-12T18:05:55.807408+0000","last_peered":"2024-09-12T18:05:55.807408+0000","last_clean":"2024-09-12T18:05:55.807408+0000","last_became_active":"2024-09-12T17:29:54.956019+0000","last_became_peered":"2024-09-12T17:29:54.956019+0000","last_unstale":"2024-09-12T18:05:55.807408+0000","last_undegraded":"2024-09-12T18:05:55.807408+0000","last_fullsized":"2024-09-12T18:05:55.807408+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:52.410372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":560,"num_read_kb":466,"num_write":179,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'194","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:15.446945+0000","last_change":"2024-09-12T17:29:52.951444+0000","last_active":"2024-09-12T18:05:15.446945+0000","last_peered":"2024-09-12T18:05:15.446945+0000","last_clean":"2024-09-12T18:05:15.446945+0000","last_became_active":"2024-09-12T17:29:52.951013+0000","last_became_peered":"2024-09-12T17:29:52.951013+0000","last_unstale":"2024-09-12T18:05:15.446945+0000","last_undegraded":"2024-09-12T18:05:15.446945+0000","last_fullsized":"2024-09-12T18:05:15.446945+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:26.659611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24709,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":472,"num_read_kb":90183,"num_write":905,"num_write_kb":29071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.632112+0000","last_change":"2024-09-12T17:29:56.959688+0000","last_active":"2024-09-12T18:03:44.632112+0000","last_peered":"2024-09-12T18:03:44.632112+0000","last_clean":"2024-09-12T18:03:44.632112+0000","last_became_active":"2024-09-12T17:29:56.959436+0000","last_became_peered":"2024-09-12T17:29:56.959436+0000","last_unstale":"2024-09-12T18:03:44.632112+0000","last_undegraded":"2024-09-12T18:03:44.632112+0000","last_fullsized":"2024-09-12T18:03:44.632112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:17.810253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'138","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.649246+0000","last_change":"2024-09-12T17:29:58.954865+0000","last_active":"2024-09-12T18:06:04.649246+0000","last_peered":"2024-09-12T18:06:04.649246+0000","last_clean":"2024-09-12T18:06:04.649246+0000","last_became_active":"2024-09-12T17:29:58.954548+0000","last_became_peered":"2024-09-12T17:29:58.954548+0000","last_unstale":"2024-09-12T18:06:04.649246+0000","last_undegraded":"2024-09-12T18:06:04.649246+0000","last_fullsized":"2024-09-12T18:06:04.649246+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:57.732564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15394,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":183,"num_read_kb":244,"num_write":102,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'730","reported_seq":2374,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.688693+0000","last_change":"2024-09-12T17:30:00.960694+0000","last_active":"2024-09-12T18:07:38.688693+0000","last_peered":"2024-09-12T18:07:38.688693+0000","last_clean":"2024-09-12T18:07:38.688693+0000","last_became_active":"2024-09-12T17:30:00.960402+0000","last_became_peered":"2024-09-12T17:30:00.960402+0000","last_unstale":"2024-09-12T18:07:38.688693+0000","last_undegraded":"2024-09-12T18:07:38.688693+0000","last_fullsized":"2024-09-12T18:07:38.688693+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:14.850575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'95","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.486123+0000","last_change":"2024-09-12T17:30:02.969918+0000","last_active":"2024-09-12T18:06:20.486123+0000","last_peered":"2024-09-12T18:06:20.486123+0000","last_clean":"2024-09-12T18:06:20.486123+0000","last_became_active":"2024-09-12T17:30:02.969617+0000","last_became_peered":"2024-09-12T17:30:02.969617+0000","last_unstale":"2024-09-12T18:06:20.486123+0000","last_undegraded":"2024-09-12T18:06:20.486123+0000","last_fullsized":"2024-09-12T18:06:20.486123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:08.908464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":242,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'118","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.647063+0000","last_change":"2024-09-12T17:29:54.959321+0000","last_active":"2024-09-12T18:06:06.647063+0000","last_peered":"2024-09-12T18:06:06.647063+0000","last_clean":"2024-09-12T18:06:06.647063+0000","last_became_active":"2024-09-12T17:29:54.958362+0000","last_became_peered":"2024-09-12T17:29:54.958362+0000","last_unstale":"2024-09-12T18:06:06.647063+0000","last_undegraded":"2024-09-12T18:06:06.647063+0000","last_fullsized":"2024-09-12T18:06:06.647063+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:49.275936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":415,"num_write":164,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'161","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.481795+0000","last_change":"2024-09-12T17:30:28.005494+0000","last_active":"2024-09-12T18:05:57.481795+0000","last_peered":"2024-09-12T18:05:57.481795+0000","last_clean":"2024-09-12T18:05:57.481795+0000","last_became_active":"2024-09-12T17:30:28.005099+0000","last_became_peered":"2024-09-12T17:30:28.005099+0000","last_unstale":"2024-09-12T18:05:57.481795+0000","last_undegraded":"2024-09-12T18:05:57.481795+0000","last_fullsized":"2024-09-12T18:05:57.481795+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:40.351778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27238,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":402,"num_read_kb":6854,"num_write":852,"num_write_kb":33010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.610781+0000","last_change":"2024-09-12T17:29:56.955646+0000","last_active":"2024-09-12T18:07:38.610781+0000","last_peered":"2024-09-12T18:07:38.610781+0000","last_clean":"2024-09-12T18:07:38.610781+0000","last_became_active":"2024-09-12T17:29:56.955321+0000","last_became_peered":"2024-09-12T17:29:56.955321+0000","last_unstale":"2024-09-12T18:07:38.610781+0000","last_undegraded":"2024-09-12T18:07:38.610781+0000","last_fullsized":"2024-09-12T18:07:38.610781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:06.863842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'79","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.538704+0000","last_change":"2024-09-12T17:29:58.978790+0000","last_active":"2024-09-12T18:05:59.538704+0000","last_peered":"2024-09-12T18:05:59.538704+0000","last_clean":"2024-09-12T18:05:59.538704+0000","last_became_active":"2024-09-12T17:29:58.978480+0000","last_became_peered":"2024-09-12T17:29:58.978480+0000","last_unstale":"2024-09-12T18:05:59.538704+0000","last_undegraded":"2024-09-12T18:05:59.538704+0000","last_fullsized":"2024-09-12T18:05:59.538704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:05.359700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'756","reported_seq":4524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.689646+0000","last_change":"2024-09-12T17:30:00.959471+0000","last_active":"2024-09-12T18:07:38.689646+0000","last_peered":"2024-09-12T18:07:38.689646+0000","last_clean":"2024-09-12T18:07:38.689646+0000","last_became_active":"2024-09-12T17:30:00.959015+0000","last_became_peered":"2024-09-12T17:30:00.959015+0000","last_unstale":"2024-09-12T18:07:38.689646+0000","last_undegraded":"2024-09-12T18:07:38.689646+0000","last_fullsized":"2024-09-12T18:07:38.689646+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:29.861180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'126","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.966308+0000","last_change":"2024-09-12T17:30:02.972327+0000","last_active":"2024-09-12T18:06:01.966308+0000","last_peered":"2024-09-12T18:06:01.966308+0000","last_clean":"2024-09-12T18:06:01.966308+0000","last_became_active":"2024-09-12T17:30:02.972020+0000","last_became_peered":"2024-09-12T17:30:02.972020+0000","last_unstale":"2024-09-12T18:06:01.966308+0000","last_undegraded":"2024-09-12T18:06:01.966308+0000","last_fullsized":"2024-09-12T18:06:01.966308+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.485323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":156,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.376221+0000","last_change":"2024-09-12T17:29:54.951231+0000","last_active":"2024-09-12T18:05:29.376221+0000","last_peered":"2024-09-12T18:05:29.376221+0000","last_clean":"2024-09-12T18:05:29.376221+0000","last_became_active":"2024-09-12T17:29:54.950966+0000","last_became_peered":"2024-09-12T17:29:54.950966+0000","last_unstale":"2024-09-12T18:05:29.376221+0000","last_undegraded":"2024-09-12T18:05:29.376221+0000","last_fullsized":"2024-09-12T18:05:29.376221+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:59.344136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":955,"num_read_kb":788,"num_write":339,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'175","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.456384+0000","last_change":"2024-09-12T17:29:52.948919+0000","last_active":"2024-09-12T18:06:08.456384+0000","last_peered":"2024-09-12T18:06:08.456384+0000","last_clean":"2024-09-12T18:06:08.456384+0000","last_became_active":"2024-09-12T17:29:52.948591+0000","last_became_peered":"2024-09-12T17:29:52.948591+0000","last_unstale":"2024-09-12T18:06:08.456384+0000","last_undegraded":"2024-09-12T18:06:08.456384+0000","last_fullsized":"2024-09-12T18:06:08.456384+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:40.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7552392,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":2966,"num_write":840,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.504222+0000","last_change":"2024-09-12T17:29:56.953681+0000","last_active":"2024-09-12T18:03:44.504222+0000","last_peered":"2024-09-12T18:03:44.504222+0000","last_clean":"2024-09-12T18:03:44.504222+0000","last_became_active":"2024-09-12T17:29:56.953198+0000","last_became_peered":"2024-09-12T17:29:56.953198+0000","last_unstale":"2024-09-12T18:03:44.504222+0000","last_undegraded":"2024-09-12T18:03:44.504222+0000","last_fullsized":"2024-09-12T18:03:44.504222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:26.233204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'186","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:35.847732+0000","last_change":"2024-09-12T17:29:58.957118+0000","last_active":"2024-09-12T18:06:35.847732+0000","last_peered":"2024-09-12T18:06:35.847732+0000","last_clean":"2024-09-12T18:06:35.847732+0000","last_became_active":"2024-09-12T17:29:58.956828+0000","last_became_peered":"2024-09-12T17:29:58.956828+0000","last_unstale":"2024-09-12T18:06:35.847732+0000","last_undegraded":"2024-09-12T18:06:35.847732+0000","last_fullsized":"2024-09-12T18:06:35.847732+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:05.359700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12042,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":832,"num_read_kb":892,"num_write":1324,"num_write_kb":1208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.504747+0000","last_change":"2024-09-12T17:30:00.963569+0000","last_active":"2024-09-12T18:03:49.504747+0000","last_peered":"2024-09-12T18:03:49.504747+0000","last_clean":"2024-09-12T18:03:49.504747+0000","last_became_active":"2024-09-12T17:30:00.963117+0000","last_became_peered":"2024-09-12T17:30:00.963117+0000","last_unstale":"2024-09-12T18:03:49.504747+0000","last_undegraded":"2024-09-12T18:03:49.504747+0000","last_fullsized":"2024-09-12T18:03:49.504747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:47.856522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'115","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.931424+0000","last_change":"2024-09-12T17:30:02.963673+0000","last_active":"2024-09-12T18:06:00.931424+0000","last_peered":"2024-09-12T18:06:00.931424+0000","last_clean":"2024-09-12T18:06:00.931424+0000","last_became_active":"2024-09-12T17:30:02.963368+0000","last_became_peered":"2024-09-12T17:30:02.963368+0000","last_unstale":"2024-09-12T18:06:00.931424+0000","last_undegraded":"2024-09-12T18:06:00.931424+0000","last_fullsized":"2024-09-12T18:06:00.931424+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:30.008139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":267,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'271","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:51.069613+0000","last_change":"2024-09-12T17:29:54.960752+0000","last_active":"2024-09-12T18:05:51.069613+0000","last_peered":"2024-09-12T18:05:51.069613+0000","last_clean":"2024-09-12T18:05:51.069613+0000","last_became_active":"2024-09-12T17:29:54.960486+0000","last_became_peered":"2024-09-12T17:29:54.960486+0000","last_unstale":"2024-09-12T18:05:51.069613+0000","last_undegraded":"2024-09-12T18:05:51.069613+0000","last_fullsized":"2024-09-12T18:05:51.069613+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:09.952438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1268,"num_write":469,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:44.688092+0000","last_change":"2024-09-12T17:29:36.164552+0000","last_active":"2024-09-12T18:05:44.688092+0000","last_peered":"2024-09-12T18:05:44.688092+0000","last_clean":"2024-09-12T18:05:44.688092+0000","last_became_active":"2024-09-12T17:29:36.163604+0000","last_became_peered":"2024-09-12T17:29:36.163604+0000","last_unstale":"2024-09-12T18:05:44.688092+0000","last_undegraded":"2024-09-12T18:05:44.688092+0000","last_fullsized":"2024-09-12T18:05:44.688092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.896766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.896766+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.896766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:35.293197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.640572+0000","last_change":"2024-09-12T17:29:43.975243+0000","last_active":"2024-09-12T18:05:09.640572+0000","last_peered":"2024-09-12T18:05:09.640572+0000","last_clean":"2024-09-12T18:05:09.640572+0000","last_became_active":"2024-09-12T17:29:41.963643+0000","last_became_peered":"2024-09-12T17:29:41.963643+0000","last_unstale":"2024-09-12T18:05:09.640572+0000","last_undegraded":"2024-09-12T18:05:09.640572+0000","last_fullsized":"2024-09-12T18:05:09.640572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:57.226626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056994999999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'200","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.275860+0000","last_change":"2024-09-12T17:29:52.955756+0000","last_active":"2024-09-12T18:05:29.275860+0000","last_peered":"2024-09-12T18:05:29.275860+0000","last_clean":"2024-09-12T18:05:29.275860+0000","last_became_active":"2024-09-12T17:29:52.954839+0000","last_became_peered":"2024-09-12T17:29:52.954839+0000","last_unstale":"2024-09-12T18:05:29.275860+0000","last_undegraded":"2024-09-12T18:05:29.275860+0000","last_fullsized":"2024-09-12T18:05:29.275860+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:54.464363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7720365,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":442,"num_read_kb":3372,"num_write":1034,"num_write_kb":36567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.685110+0000","last_change":"2024-09-12T17:29:56.955566+0000","last_active":"2024-09-12T18:05:24.685110+0000","last_peered":"2024-09-12T18:05:24.685110+0000","last_clean":"2024-09-12T18:05:24.685110+0000","last_became_active":"2024-09-12T17:29:56.955260+0000","last_became_peered":"2024-09-12T17:29:56.955260+0000","last_unstale":"2024-09-12T18:05:24.685110+0000","last_undegraded":"2024-09-12T18:05:24.685110+0000","last_fullsized":"2024-09-12T18:05:24.685110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:09.539939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'287","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.658767+0000","last_change":"2024-09-12T17:29:58.954504+0000","last_active":"2024-09-12T18:07:38.658767+0000","last_peered":"2024-09-12T18:07:38.658767+0000","last_clean":"2024-09-12T18:07:38.658767+0000","last_became_active":"2024-09-12T17:29:58.954205+0000","last_became_peered":"2024-09-12T17:29:58.954205+0000","last_unstale":"2024-09-12T18:07:38.658767+0000","last_undegraded":"2024-09-12T18:07:38.658767+0000","last_fullsized":"2024-09-12T18:07:38.658767+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:15.729749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":698,"num_write":486,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640713+0000","last_change":"2024-09-12T17:30:00.964518+0000","last_active":"2024-09-12T18:04:44.640713+0000","last_peered":"2024-09-12T18:04:44.640713+0000","last_clean":"2024-09-12T18:04:44.640713+0000","last_became_active":"2024-09-12T17:30:00.964241+0000","last_became_peered":"2024-09-12T17:30:00.964241+0000","last_unstale":"2024-09-12T18:04:44.640713+0000","last_undegraded":"2024-09-12T18:04:44.640713+0000","last_fullsized":"2024-09-12T18:04:44.640713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:14.242835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'221","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.251802+0000","last_change":"2024-09-12T17:30:02.964194+0000","last_active":"2024-09-12T18:06:21.251802+0000","last_peered":"2024-09-12T18:06:21.251802+0000","last_clean":"2024-09-12T18:06:21.251802+0000","last_became_active":"2024-09-12T17:30:02.963890+0000","last_became_peered":"2024-09-12T17:30:02.963890+0000","last_unstale":"2024-09-12T18:06:21.251802+0000","last_undegraded":"2024-09-12T18:06:21.251802+0000","last_fullsized":"2024-09-12T18:06:21.251802+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.997124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":552,"num_write":485,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'384","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.127003+0000","last_change":"2024-09-12T17:29:54.946209+0000","last_active":"2024-09-12T18:06:19.127003+0000","last_peered":"2024-09-12T18:06:19.127003+0000","last_clean":"2024-09-12T18:06:19.127003+0000","last_became_active":"2024-09-12T17:29:54.944624+0000","last_became_peered":"2024-09-12T17:29:54.944624+0000","last_unstale":"2024-09-12T18:06:19.127003+0000","last_undegraded":"2024-09-12T18:06:19.127003+0000","last_fullsized":"2024-09-12T18:06:19.127003+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:39.689437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1668,"num_read_kb":1443,"num_write":651,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:49.688854+0000","last_change":"2024-09-12T17:29:43.985359+0000","last_active":"2024-09-12T18:05:49.688854+0000","last_peered":"2024-09-12T18:05:49.688854+0000","last_clean":"2024-09-12T18:05:49.688854+0000","last_became_active":"2024-09-12T17:29:41.963499+0000","last_became_peered":"2024-09-12T17:29:41.963499+0000","last_unstale":"2024-09-12T18:05:49.688854+0000","last_undegraded":"2024-09-12T18:05:49.688854+0000","last_fullsized":"2024-09-12T18:05:49.688854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:34.267982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470655,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'146","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.500222+0000","last_change":"2024-09-12T17:29:52.949670+0000","last_active":"2024-09-12T18:05:54.500222+0000","last_peered":"2024-09-12T18:05:54.500222+0000","last_clean":"2024-09-12T18:05:54.500222+0000","last_became_active":"2024-09-12T17:29:52.949339+0000","last_became_peered":"2024-09-12T17:29:52.949339+0000","last_unstale":"2024-09-12T18:05:54.500222+0000","last_undegraded":"2024-09-12T18:05:54.500222+0000","last_fullsized":"2024-09-12T18:05:54.500222+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:19.928095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244268,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":390,"num_read_kb":3075,"num_write":748,"num_write_kb":23555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.635977+0000","last_change":"2024-09-12T17:29:56.954436+0000","last_active":"2024-09-12T18:04:39.635977+0000","last_peered":"2024-09-12T18:04:39.635977+0000","last_clean":"2024-09-12T18:04:39.635977+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:04:39.635977+0000","last_undegraded":"2024-09-12T18:04:39.635977+0000","last_fullsized":"2024-09-12T18:04:39.635977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:38.720237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'773","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.683830+0000","last_change":"2024-09-12T17:29:58.958558+0000","last_active":"2024-09-12T18:07:38.683830+0000","last_peered":"2024-09-12T18:07:38.683830+0000","last_clean":"2024-09-12T18:07:38.683830+0000","last_became_active":"2024-09-12T17:29:58.958269+0000","last_became_peered":"2024-09-12T17:29:58.958269+0000","last_unstale":"2024-09-12T18:07:38.683830+0000","last_undegraded":"2024-09-12T18:07:38.683830+0000","last_fullsized":"2024-09-12T18:07:38.683830+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:14.582465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44041,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1107,"num_read_kb":1266,"num_write":230,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:34.686581+0000","last_change":"2024-09-12T17:30:00.958433+0000","last_active":"2024-09-12T18:05:34.686581+0000","last_peered":"2024-09-12T18:05:34.686581+0000","last_clean":"2024-09-12T18:05:34.686581+0000","last_became_active":"2024-09-12T17:30:00.957628+0000","last_became_peered":"2024-09-12T17:30:00.957628+0000","last_unstale":"2024-09-12T18:05:34.686581+0000","last_undegraded":"2024-09-12T18:05:34.686581+0000","last_fullsized":"2024-09-12T18:05:34.686581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.962381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'136","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.227859+0000","last_change":"2024-09-12T17:30:02.960607+0000","last_active":"2024-09-12T18:05:52.227859+0000","last_peered":"2024-09-12T18:05:52.227859+0000","last_clean":"2024-09-12T18:05:52.227859+0000","last_became_active":"2024-09-12T17:30:02.960109+0000","last_became_peered":"2024-09-12T17:30:02.960109+0000","last_unstale":"2024-09-12T18:05:52.227859+0000","last_undegraded":"2024-09-12T18:05:52.227859+0000","last_fullsized":"2024-09-12T18:05:52.227859+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:27.244929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":318,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'88","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.991113+0000","last_change":"2024-09-12T17:29:54.958561+0000","last_active":"2024-09-12T18:06:07.991113+0000","last_peered":"2024-09-12T18:06:07.991113+0000","last_clean":"2024-09-12T18:06:07.991113+0000","last_became_active":"2024-09-12T17:29:54.958310+0000","last_became_peered":"2024-09-12T17:29:54.958310+0000","last_unstale":"2024-09-12T18:06:07.991113+0000","last_undegraded":"2024-09-12T18:06:07.991113+0000","last_fullsized":"2024-09-12T18:06:07.991113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:54.864495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":367,"num_read_kb":311,"num_write":135,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.642763+0000","last_change":"2024-09-12T17:29:44.204001+0000","last_active":"2024-09-12T18:05:09.642763+0000","last_peered":"2024-09-12T18:05:09.642763+0000","last_clean":"2024-09-12T18:05:09.642763+0000","last_became_active":"2024-09-12T17:29:42.064972+0000","last_became_peered":"2024-09-12T17:29:42.064972+0000","last_unstale":"2024-09-12T18:05:09.642763+0000","last_undegraded":"2024-09-12T18:05:09.642763+0000","last_fullsized":"2024-09-12T18:05:09.642763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.574136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047741400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'206","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.652642+0000","last_change":"2024-09-12T17:29:52.949699+0000","last_active":"2024-09-12T18:05:59.652642+0000","last_peered":"2024-09-12T18:05:59.652642+0000","last_clean":"2024-09-12T18:05:59.652642+0000","last_became_active":"2024-09-12T17:29:52.949301+0000","last_became_peered":"2024-09-12T17:29:52.949301+0000","last_unstale":"2024-09-12T18:05:59.652642+0000","last_undegraded":"2024-09-12T18:05:59.652642+0000","last_fullsized":"2024-09-12T18:05:59.652642+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:56.930560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6416875,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":2667,"num_write":1029,"num_write_kb":7887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.638711+0000","last_change":"2024-09-12T17:29:56.956881+0000","last_active":"2024-09-12T18:04:39.638711+0000","last_peered":"2024-09-12T18:04:39.638711+0000","last_clean":"2024-09-12T18:04:39.638711+0000","last_became_active":"2024-09-12T17:29:56.956623+0000","last_became_peered":"2024-09-12T17:29:56.956623+0000","last_unstale":"2024-09-12T18:04:39.638711+0000","last_undegraded":"2024-09-12T18:04:39.638711+0000","last_fullsized":"2024-09-12T18:04:39.638711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:54.110865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'210","reported_seq":1203,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:35.761738+0000","last_change":"2024-09-12T17:29:58.980974+0000","last_active":"2024-09-12T18:07:35.761738+0000","last_peered":"2024-09-12T18:07:35.761738+0000","last_clean":"2024-09-12T18:07:35.761738+0000","last_became_active":"2024-09-12T17:29:58.980697+0000","last_became_peered":"2024-09-12T17:29:58.980697+0000","last_unstale":"2024-09-12T18:07:35.761738+0000","last_undegraded":"2024-09-12T18:07:35.761738+0000","last_fullsized":"2024-09-12T18:07:35.761738+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:02.768234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":123,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648081+0000","last_change":"2024-09-12T17:30:00.968730+0000","last_active":"2024-09-12T18:05:29.648081+0000","last_peered":"2024-09-12T18:05:29.648081+0000","last_clean":"2024-09-12T18:05:29.648081+0000","last_became_active":"2024-09-12T17:30:00.968468+0000","last_became_peered":"2024-09-12T17:30:00.968468+0000","last_unstale":"2024-09-12T18:05:29.648081+0000","last_undegraded":"2024-09-12T18:05:29.648081+0000","last_fullsized":"2024-09-12T18:05:29.648081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:49.912468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'248","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.956406+0000","last_change":"2024-09-12T17:30:02.967215+0000","last_active":"2024-09-12T18:06:20.956406+0000","last_peered":"2024-09-12T18:06:20.956406+0000","last_clean":"2024-09-12T18:06:20.956406+0000","last_became_active":"2024-09-12T17:30:02.966910+0000","last_became_peered":"2024-09-12T17:30:02.966910+0000","last_unstale":"2024-09-12T18:06:20.956406+0000","last_undegraded":"2024-09-12T18:06:20.956406+0000","last_fullsized":"2024-09-12T18:06:20.956406+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":529,"num_write":537,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'112","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.763591+0000","last_change":"2024-09-12T17:29:54.948794+0000","last_active":"2024-09-12T18:07:37.763591+0000","last_peered":"2024-09-12T18:07:37.763591+0000","last_clean":"2024-09-12T18:07:37.763591+0000","last_became_active":"2024-09-12T17:29:54.948402+0000","last_became_peered":"2024-09-12T17:29:54.948402+0000","last_unstale":"2024-09-12T18:07:37.763591+0000","last_undegraded":"2024-09-12T18:07:37.763591+0000","last_fullsized":"2024-09-12T18:07:37.763591+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:23.995374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":452,"num_write":172,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.640533+0000","last_change":"2024-09-12T17:29:43.975620+0000","last_active":"2024-09-12T18:05:09.640533+0000","last_peered":"2024-09-12T18:05:09.640533+0000","last_clean":"2024-09-12T18:05:09.640533+0000","last_became_active":"2024-09-12T17:29:41.961122+0000","last_became_peered":"2024-09-12T17:29:41.961122+0000","last_unstale":"2024-09-12T18:05:09.640533+0000","last_undegraded":"2024-09-12T18:05:09.640533+0000","last_fullsized":"2024-09-12T18:05:09.640533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.143106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095277999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'240","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.721978+0000","last_change":"2024-09-12T17:29:52.958960+0000","last_active":"2024-09-12T18:05:54.721978+0000","last_peered":"2024-09-12T18:05:54.721978+0000","last_clean":"2024-09-12T18:05:54.721978+0000","last_became_active":"2024-09-12T17:29:52.958406+0000","last_became_peered":"2024-09-12T17:29:52.958406+0000","last_unstale":"2024-09-12T18:05:54.721978+0000","last_undegraded":"2024-09-12T18:05:54.721978+0000","last_fullsized":"2024-09-12T18:05:54.721978+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:53.477079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728679,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":48737,"num_write":1096,"num_write_kb":63490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648110+0000","last_change":"2024-09-12T17:29:56.954279+0000","last_active":"2024-09-12T18:05:29.648110+0000","last_peered":"2024-09-12T18:05:29.648110+0000","last_clean":"2024-09-12T18:05:29.648110+0000","last_became_active":"2024-09-12T17:29:56.954018+0000","last_became_peered":"2024-09-12T17:29:56.954018+0000","last_unstale":"2024-09-12T18:05:29.648110+0000","last_undegraded":"2024-09-12T18:05:29.648110+0000","last_fullsized":"2024-09-12T18:05:29.648110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.921260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'111","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:35.852981+0000","last_change":"2024-09-12T17:29:58.954279+0000","last_active":"2024-09-12T18:07:35.852981+0000","last_peered":"2024-09-12T18:07:35.852981+0000","last_clean":"2024-09-12T18:07:35.852981+0000","last_became_active":"2024-09-12T17:29:58.953909+0000","last_became_peered":"2024-09-12T17:29:58.953909+0000","last_unstale":"2024-09-12T18:07:35.852981+0000","last_undegraded":"2024-09-12T18:07:35.852981+0000","last_fullsized":"2024-09-12T18:07:35.852981+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:29.055630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":90,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.512851+0000","last_change":"2024-09-12T17:30:00.967582+0000","last_active":"2024-09-12T18:04:44.512851+0000","last_peered":"2024-09-12T18:04:44.512851+0000","last_clean":"2024-09-12T18:04:44.512851+0000","last_became_active":"2024-09-12T17:30:00.967279+0000","last_became_peered":"2024-09-12T17:30:00.967279+0000","last_unstale":"2024-09-12T18:04:44.512851+0000","last_undegraded":"2024-09-12T18:04:44.512851+0000","last_fullsized":"2024-09-12T18:04:44.512851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:05.249822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'207","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.809120+0000","last_change":"2024-09-12T17:30:02.969741+0000","last_active":"2024-09-12T18:05:55.809120+0000","last_peered":"2024-09-12T18:05:55.809120+0000","last_clean":"2024-09-12T18:05:55.809120+0000","last_became_active":"2024-09-12T17:30:02.969486+0000","last_became_peered":"2024-09-12T17:30:02.969486+0000","last_unstale":"2024-09-12T18:05:55.809120+0000","last_undegraded":"2024-09-12T18:05:55.809120+0000","last_fullsized":"2024-09-12T18:05:55.809120+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:39.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":397,"num_write":473,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'156","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.910434+0000","last_change":"2024-09-12T17:29:54.963961+0000","last_active":"2024-09-12T18:06:06.910434+0000","last_peered":"2024-09-12T18:06:06.910434+0000","last_clean":"2024-09-12T18:06:06.910434+0000","last_became_active":"2024-09-12T17:29:54.963669+0000","last_became_peered":"2024-09-12T17:29:54.963669+0000","last_unstale":"2024-09-12T18:06:06.910434+0000","last_undegraded":"2024-09-12T18:06:06.910434+0000","last_fullsized":"2024-09-12T18:06:06.910434+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:24.840068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":549,"num_write":259,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'200","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:31.236102+0000","last_change":"2024-09-12T17:29:52.954700+0000","last_active":"2024-09-12T18:05:31.236102+0000","last_peered":"2024-09-12T18:05:31.236102+0000","last_clean":"2024-09-12T18:05:31.236102+0000","last_became_active":"2024-09-12T17:29:52.954220+0000","last_became_peered":"2024-09-12T17:29:52.954220+0000","last_unstale":"2024-09-12T18:05:31.236102+0000","last_undegraded":"2024-09-12T18:05:31.236102+0000","last_fullsized":"2024-09-12T18:05:31.236102+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:30.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16799934,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":520,"num_read_kb":74998,"num_write":1061,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.645181+0000","last_change":"2024-09-12T17:29:43.966855+0000","last_active":"2024-09-12T18:05:09.645181+0000","last_peered":"2024-09-12T18:05:09.645181+0000","last_clean":"2024-09-12T18:05:09.645181+0000","last_became_active":"2024-09-12T17:29:42.064741+0000","last_became_peered":"2024-09-12T17:29:42.064741+0000","last_unstale":"2024-09-12T18:05:09.645181+0000","last_undegraded":"2024-09-12T18:05:09.645181+0000","last_fullsized":"2024-09-12T18:05:09.645181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:56.698152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043924099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647471+0000","last_change":"2024-09-12T17:29:56.955865+0000","last_active":"2024-09-12T18:05:24.647471+0000","last_peered":"2024-09-12T18:05:24.647471+0000","last_clean":"2024-09-12T18:05:24.647471+0000","last_became_active":"2024-09-12T17:29:56.955562+0000","last_became_peered":"2024-09-12T17:29:56.955562+0000","last_unstale":"2024-09-12T18:05:24.647471+0000","last_undegraded":"2024-09-12T18:05:24.647471+0000","last_fullsized":"2024-09-12T18:05:24.647471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:02.094255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'256","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.651372+0000","last_change":"2024-09-12T17:29:58.960788+0000","last_active":"2024-09-12T18:07:38.651372+0000","last_peered":"2024-09-12T18:07:38.651372+0000","last_clean":"2024-09-12T18:07:38.651372+0000","last_became_active":"2024-09-12T17:29:58.960410+0000","last_became_peered":"2024-09-12T17:29:58.960410+0000","last_unstale":"2024-09-12T18:07:38.651372+0000","last_undegraded":"2024-09-12T18:07:38.651372+0000","last_fullsized":"2024-09-12T18:07:38.651372+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:42.521026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21141,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":360,"num_read_kb":468,"num_write":234,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519052+0000","last_change":"2024-09-12T17:30:00.963954+0000","last_active":"2024-09-12T18:05:29.519052+0000","last_peered":"2024-09-12T18:05:29.519052+0000","last_clean":"2024-09-12T18:05:29.519052+0000","last_became_active":"2024-09-12T17:30:00.963660+0000","last_became_peered":"2024-09-12T17:30:00.963660+0000","last_unstale":"2024-09-12T18:05:29.519052+0000","last_undegraded":"2024-09-12T18:05:29.519052+0000","last_fullsized":"2024-09-12T18:05:29.519052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:07.402246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'169","reported_seq":678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.937429+0000","last_change":"2024-09-12T17:30:02.972165+0000","last_active":"2024-09-12T18:06:00.937429+0000","last_peered":"2024-09-12T18:06:00.937429+0000","last_clean":"2024-09-12T18:06:00.937429+0000","last_became_active":"2024-09-12T17:30:02.971807+0000","last_became_peered":"2024-09-12T17:30:02.971807+0000","last_unstale":"2024-09-12T18:06:00.937429+0000","last_undegraded":"2024-09-12T18:06:00.937429+0000","last_fullsized":"2024-09-12T18:06:00.937429+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:12.197480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":246,"num_write":442,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'190","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.624295+0000","last_change":"2024-09-12T17:29:54.959312+0000","last_active":"2024-09-12T18:05:26.624295+0000","last_peered":"2024-09-12T18:05:26.624295+0000","last_clean":"2024-09-12T18:05:26.624295+0000","last_became_active":"2024-09-12T17:29:54.958998+0000","last_became_peered":"2024-09-12T17:29:54.958998+0000","last_unstale":"2024-09-12T18:05:26.624295+0000","last_undegraded":"2024-09-12T18:05:26.624295+0000","last_fullsized":"2024-09-12T18:05:26.624295+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:32.259773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":764,"num_write":273,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'221","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:33.577392+0000","last_change":"2024-09-12T17:29:52.955784+0000","last_active":"2024-09-12T18:07:33.577392+0000","last_peered":"2024-09-12T18:07:33.577392+0000","last_clean":"2024-09-12T18:07:33.577392+0000","last_became_active":"2024-09-12T17:29:52.955429+0000","last_became_peered":"2024-09-12T17:29:52.955429+0000","last_unstale":"2024-09-12T18:07:33.577392+0000","last_undegraded":"2024-09-12T18:07:33.577392+0000","last_fullsized":"2024-09-12T18:07:33.577392+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:09.456649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3642728,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":39247,"num_write":987,"num_write_kb":44156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:14.683770+0000","last_change":"2024-09-12T17:29:43.985392+0000","last_active":"2024-09-12T18:05:14.683770+0000","last_peered":"2024-09-12T18:05:14.683770+0000","last_clean":"2024-09-12T18:05:14.683770+0000","last_became_active":"2024-09-12T17:29:42.064736+0000","last_became_peered":"2024-09-12T17:29:42.064736+0000","last_unstale":"2024-09-12T18:05:14.683770+0000","last_undegraded":"2024-09-12T18:05:14.683770+0000","last_fullsized":"2024-09-12T18:05:14.683770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:58.936927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045118300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518499+0000","last_change":"2024-09-12T17:29:56.957783+0000","last_active":"2024-09-12T18:05:24.518499+0000","last_peered":"2024-09-12T18:05:24.518499+0000","last_clean":"2024-09-12T18:05:24.518499+0000","last_became_active":"2024-09-12T17:29:56.957503+0000","last_became_peered":"2024-09-12T17:29:56.957503+0000","last_unstale":"2024-09-12T18:05:24.518499+0000","last_undegraded":"2024-09-12T18:05:24.518499+0000","last_fullsized":"2024-09-12T18:05:24.518499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:58.375801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'150","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.753445+0000","last_change":"2024-09-12T17:29:58.978826+0000","last_active":"2024-09-12T18:05:53.753445+0000","last_peered":"2024-09-12T18:05:53.753445+0000","last_clean":"2024-09-12T18:05:53.753445+0000","last_became_active":"2024-09-12T17:29:58.978487+0000","last_became_peered":"2024-09-12T17:29:58.978487+0000","last_unstale":"2024-09-12T18:05:53.753445+0000","last_undegraded":"2024-09-12T18:05:53.753445+0000","last_fullsized":"2024-09-12T18:05:53.753445+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:07.080227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":172,"num_read_kb":165,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'768","reported_seq":2440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.685983+0000","last_change":"2024-09-12T17:30:00.957003+0000","last_active":"2024-09-12T18:07:38.685983+0000","last_peered":"2024-09-12T18:07:38.685983+0000","last_clean":"2024-09-12T18:07:38.685983+0000","last_became_active":"2024-09-12T17:30:00.956655+0000","last_became_peered":"2024-09-12T17:30:00.956655+0000","last_unstale":"2024-09-12T18:07:38.685983+0000","last_undegraded":"2024-09-12T18:07:38.685983+0000","last_fullsized":"2024-09-12T18:07:38.685983+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:00.807981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'117","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:18.421406+0000","last_change":"2024-09-12T17:30:02.969523+0000","last_active":"2024-09-12T18:06:18.421406+0000","last_peered":"2024-09-12T18:06:18.421406+0000","last_clean":"2024-09-12T18:06:18.421406+0000","last_became_active":"2024-09-12T17:30:02.968978+0000","last_became_peered":"2024-09-12T17:30:02.968978+0000","last_unstale":"2024-09-12T18:06:18.421406+0000","last_undegraded":"2024-09-12T18:06:18.421406+0000","last_fullsized":"2024-09-12T18:06:18.421406+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:20.219209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1365,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":174,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'406","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.911679+0000","last_change":"2024-09-12T17:29:54.955693+0000","last_active":"2024-09-12T18:05:53.911679+0000","last_peered":"2024-09-12T18:05:53.911679+0000","last_clean":"2024-09-12T18:05:53.911679+0000","last_became_active":"2024-09-12T17:29:54.955170+0000","last_became_peered":"2024-09-12T17:29:54.955170+0000","last_unstale":"2024-09-12T18:05:53.911679+0000","last_undegraded":"2024-09-12T18:05:53.911679+0000","last_fullsized":"2024-09-12T18:05:53.911679+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:25.653731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1829,"num_read_kb":1585,"num_write":674,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'157","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.642860+0000","last_change":"2024-09-12T17:30:28.005223+0000","last_active":"2024-09-12T18:05:09.642860+0000","last_peered":"2024-09-12T18:05:09.642860+0000","last_clean":"2024-09-12T18:05:09.642860+0000","last_became_active":"2024-09-12T17:30:28.004804+0000","last_became_peered":"2024-09-12T17:30:28.004804+0000","last_unstale":"2024-09-12T18:05:09.642860+0000","last_undegraded":"2024-09-12T18:05:09.642860+0000","last_fullsized":"2024-09-12T18:05:09.642860+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:07.880016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10850256,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":331,"num_read_kb":56975,"num_write":791,"num_write_kb":25989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637817+0000","last_change":"2024-09-12T17:29:43.966900+0000","last_active":"2024-09-12T18:04:24.637817+0000","last_peered":"2024-09-12T18:04:24.637817+0000","last_clean":"2024-09-12T18:04:24.637817+0000","last_became_active":"2024-09-12T17:29:41.961194+0000","last_became_peered":"2024-09-12T17:29:41.961194+0000","last_unstale":"2024-09-12T18:04:24.637817+0000","last_undegraded":"2024-09-12T18:04:24.637817+0000","last_fullsized":"2024-09-12T18:04:24.637817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:52.853132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049442699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518488+0000","last_change":"2024-09-12T17:29:56.956156+0000","last_active":"2024-09-12T18:05:24.518488+0000","last_peered":"2024-09-12T18:05:24.518488+0000","last_clean":"2024-09-12T18:05:24.518488+0000","last_became_active":"2024-09-12T17:29:56.955865+0000","last_became_peered":"2024-09-12T17:29:56.955865+0000","last_unstale":"2024-09-12T18:05:24.518488+0000","last_undegraded":"2024-09-12T18:05:24.518488+0000","last_fullsized":"2024-09-12T18:05:24.518488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:29.721519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'96","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.072656+0000","last_change":"2024-09-12T17:29:58.954437+0000","last_active":"2024-09-12T18:05:52.072656+0000","last_peered":"2024-09-12T18:05:52.072656+0000","last_clean":"2024-09-12T18:05:52.072656+0000","last_became_active":"2024-09-12T17:29:58.953924+0000","last_became_peered":"2024-09-12T17:29:58.953924+0000","last_unstale":"2024-09-12T18:05:52.072656+0000","last_undegraded":"2024-09-12T18:05:52.072656+0000","last_fullsized":"2024-09-12T18:05:52.072656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:40.076452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":108,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'776","reported_seq":2089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.690589+0000","last_change":"2024-09-12T17:30:00.967465+0000","last_active":"2024-09-12T18:07:38.690589+0000","last_peered":"2024-09-12T18:07:38.690589+0000","last_clean":"2024-09-12T18:07:38.690589+0000","last_became_active":"2024-09-12T17:30:00.967168+0000","last_became_peered":"2024-09-12T17:30:00.967168+0000","last_unstale":"2024-09-12T18:07:38.690589+0000","last_undegraded":"2024-09-12T18:07:38.690589+0000","last_fullsized":"2024-09-12T18:07:38.690589+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:34.280045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'300","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.843665+0000","last_change":"2024-09-12T17:30:02.969830+0000","last_active":"2024-09-12T18:06:01.843665+0000","last_peered":"2024-09-12T18:06:01.843665+0000","last_clean":"2024-09-12T18:06:01.843665+0000","last_became_active":"2024-09-12T17:30:02.969526+0000","last_became_peered":"2024-09-12T17:30:02.969526+0000","last_unstale":"2024-09-12T18:06:01.843665+0000","last_undegraded":"2024-09-12T18:06:01.843665+0000","last_fullsized":"2024-09-12T18:06:01.843665+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:15.996494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":439,"num_write":657,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'44","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:23.880167+0000","last_change":"2024-09-12T17:29:54.958269+0000","last_active":"2024-09-12T18:05:23.880167+0000","last_peered":"2024-09-12T18:05:23.880167+0000","last_clean":"2024-09-12T18:05:23.880167+0000","last_became_active":"2024-09-12T17:29:54.957906+0000","last_became_peered":"2024-09-12T17:29:54.957906+0000","last_unstale":"2024-09-12T18:05:23.880167+0000","last_undegraded":"2024-09-12T18:05:23.880167+0000","last_fullsized":"2024-09-12T18:05:23.880167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:40.016834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":180,"num_write":59,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'208","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:22.236915+0000","last_change":"2024-09-12T17:30:28.007323+0000","last_active":"2024-09-12T18:05:22.236915+0000","last_peered":"2024-09-12T18:05:22.236915+0000","last_clean":"2024-09-12T18:05:22.236915+0000","last_became_active":"2024-09-12T17:30:28.006884+0000","last_became_peered":"2024-09-12T17:30:28.006884+0000","last_unstale":"2024-09-12T18:05:22.236915+0000","last_undegraded":"2024-09-12T18:05:22.236915+0000","last_fullsized":"2024-09-12T18:05:22.236915+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:19.123396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6643300,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":14673,"num_write":987,"num_write_kb":46674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.509953+0000","last_change":"2024-09-12T17:29:43.986874+0000","last_active":"2024-09-12T18:04:24.509953+0000","last_peered":"2024-09-12T18:04:24.509953+0000","last_clean":"2024-09-12T18:04:24.509953+0000","last_became_active":"2024-09-12T17:29:41.961477+0000","last_became_peered":"2024-09-12T17:29:41.961477+0000","last_unstale":"2024-09-12T18:04:24.509953+0000","last_undegraded":"2024-09-12T18:04:24.509953+0000","last_fullsized":"2024-09-12T18:04:24.509953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:09.932105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041855800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.518421+0000","last_change":"2024-09-12T17:29:56.954444+0000","last_active":"2024-09-12T18:04:09.518421+0000","last_peered":"2024-09-12T18:04:09.518421+0000","last_clean":"2024-09-12T18:04:09.518421+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:04:09.518421+0000","last_undegraded":"2024-09-12T18:04:09.518421+0000","last_fullsized":"2024-09-12T18:04:09.518421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:02.231915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'303","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.648148+0000","last_change":"2024-09-12T17:29:58.978547+0000","last_active":"2024-09-12T18:07:38.648148+0000","last_peered":"2024-09-12T18:07:38.648148+0000","last_clean":"2024-09-12T18:07:38.648148+0000","last_became_active":"2024-09-12T17:29:58.978222+0000","last_became_peered":"2024-09-12T17:29:58.978222+0000","last_unstale":"2024-09-12T18:07:38.648148+0000","last_undegraded":"2024-09-12T18:07:38.648148+0000","last_fullsized":"2024-09-12T18:07:38.648148+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.293800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43074,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":453,"num_read_kb":643,"num_write":242,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.534853+0000","last_change":"2024-09-12T17:30:00.968813+0000","last_active":"2024-09-12T18:05:29.534853+0000","last_peered":"2024-09-12T18:05:29.534853+0000","last_clean":"2024-09-12T18:05:29.534853+0000","last_became_active":"2024-09-12T17:30:00.968527+0000","last_became_peered":"2024-09-12T17:30:00.968527+0000","last_unstale":"2024-09-12T18:05:29.534853+0000","last_undegraded":"2024-09-12T18:05:29.534853+0000","last_fullsized":"2024-09-12T18:05:29.534853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:25.372195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'123","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.301030+0000","last_change":"2024-09-12T17:30:02.966314+0000","last_active":"2024-09-12T18:06:21.301030+0000","last_peered":"2024-09-12T18:06:21.301030+0000","last_clean":"2024-09-12T18:06:21.301030+0000","last_became_active":"2024-09-12T17:30:02.966018+0000","last_became_peered":"2024-09-12T17:30:02.966018+0000","last_unstale":"2024-09-12T18:06:21.301030+0000","last_undegraded":"2024-09-12T18:06:21.301030+0000","last_fullsized":"2024-09-12T18:06:21.301030+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:36.046680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":226,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'154","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.350541+0000","last_change":"2024-09-12T17:30:02.964433+0000","last_active":"2024-09-12T18:06:21.350541+0000","last_peered":"2024-09-12T18:06:21.350541+0000","last_clean":"2024-09-12T18:06:21.350541+0000","last_became_active":"2024-09-12T17:30:02.964133+0000","last_became_peered":"2024-09-12T17:30:02.964133+0000","last_unstale":"2024-09-12T18:06:21.350541+0000","last_undegraded":"2024-09-12T18:06:21.350541+0000","last_fullsized":"2024-09-12T18:06:21.350541+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:49.035962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":286,"num_write":383,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'104","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:05.138023+0000","last_change":"2024-09-12T17:29:54.955997+0000","last_active":"2024-09-12T18:06:05.138023+0000","last_peered":"2024-09-12T18:06:05.138023+0000","last_clean":"2024-09-12T18:06:05.138023+0000","last_became_active":"2024-09-12T17:29:54.955716+0000","last_became_peered":"2024-09-12T17:29:54.955716+0000","last_unstale":"2024-09-12T18:06:05.138023+0000","last_undegraded":"2024-09-12T18:06:05.138023+0000","last_fullsized":"2024-09-12T18:06:05.138023+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:34.910648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":383,"num_write":153,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'178","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:34.645556+0000","last_change":"2024-09-12T17:30:28.200904+0000","last_active":"2024-09-12T18:05:34.645556+0000","last_peered":"2024-09-12T18:05:34.645556+0000","last_clean":"2024-09-12T18:05:34.645556+0000","last_became_active":"2024-09-12T17:30:28.200487+0000","last_became_peered":"2024-09-12T17:30:28.200487+0000","last_unstale":"2024-09-12T18:05:34.645556+0000","last_undegraded":"2024-09-12T18:05:34.645556+0000","last_fullsized":"2024-09-12T18:05:34.645556+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:12.443062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485827,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":70105,"num_write":887,"num_write_kb":56875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643518+0000","last_change":"2024-09-12T17:29:56.952926+0000","last_active":"2024-09-12T18:04:59.643518+0000","last_peered":"2024-09-12T18:04:59.643518+0000","last_clean":"2024-09-12T18:04:59.643518+0000","last_became_active":"2024-09-12T17:29:56.952578+0000","last_became_peered":"2024-09-12T17:29:56.952578+0000","last_unstale":"2024-09-12T18:04:59.643518+0000","last_undegraded":"2024-09-12T18:04:59.643518+0000","last_fullsized":"2024-09-12T18:04:59.643518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:45.935353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'121","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.550099+0000","last_change":"2024-09-12T17:29:58.955397+0000","last_active":"2024-09-12T18:07:19.550099+0000","last_peered":"2024-09-12T18:07:19.550099+0000","last_clean":"2024-09-12T18:07:19.550099+0000","last_became_active":"2024-09-12T17:29:58.955111+0000","last_became_peered":"2024-09-12T17:29:58.955111+0000","last_unstale":"2024-09-12T18:07:19.550099+0000","last_undegraded":"2024-09-12T18:07:19.550099+0000","last_fullsized":"2024-09-12T18:07:19.550099+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.069692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31460,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":154,"num_read_kb":247,"num_write":80,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527389+0000","last_change":"2024-09-12T17:30:00.966432+0000","last_active":"2024-09-12T18:05:04.527389+0000","last_peered":"2024-09-12T18:05:04.527389+0000","last_clean":"2024-09-12T18:05:04.527389+0000","last_became_active":"2024-09-12T17:30:00.965975+0000","last_became_peered":"2024-09-12T17:30:00.965975+0000","last_unstale":"2024-09-12T18:05:04.527389+0000","last_undegraded":"2024-09-12T18:05:04.527389+0000","last_fullsized":"2024-09-12T18:05:04.527389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:47.435596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.885555+0000","last_change":"2024-09-12T17:30:02.966210+0000","last_active":"2024-09-12T18:06:08.885555+0000","last_peered":"2024-09-12T18:06:08.885555+0000","last_clean":"2024-09-12T18:06:08.885555+0000","last_became_active":"2024-09-12T17:30:02.965919+0000","last_became_peered":"2024-09-12T17:30:02.965919+0000","last_unstale":"2024-09-12T18:06:08.885555+0000","last_undegraded":"2024-09-12T18:06:08.885555+0000","last_fullsized":"2024-09-12T18:06:08.885555+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:02.212105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":165,"num_read_kb":151,"num_write":248,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'420","reported_seq":1167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.973572+0000","last_change":"2024-09-12T17:29:54.956088+0000","last_active":"2024-09-12T18:05:20.973572+0000","last_peered":"2024-09-12T18:05:20.973572+0000","last_clean":"2024-09-12T18:05:20.973572+0000","last_became_active":"2024-09-12T17:29:54.954477+0000","last_became_peered":"2024-09-12T17:29:54.954477+0000","last_unstale":"2024-09-12T18:05:20.973572+0000","last_undegraded":"2024-09-12T18:05:20.973572+0000","last_fullsized":"2024-09-12T18:05:20.973572+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:23.380497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1777,"num_write":781,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'209","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:27.766770+0000","last_change":"2024-09-12T17:29:52.956760+0000","last_active":"2024-09-12T18:05:27.766770+0000","last_peered":"2024-09-12T18:05:27.766770+0000","last_clean":"2024-09-12T18:05:27.766770+0000","last_became_active":"2024-09-12T17:29:52.956376+0000","last_became_peered":"2024-09-12T17:29:52.956376+0000","last_unstale":"2024-09-12T18:05:27.766770+0000","last_undegraded":"2024-09-12T18:05:27.766770+0000","last_fullsized":"2024-09-12T18:05:27.766770+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:50.307316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242984,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":420,"num_read_kb":36390,"num_write":985,"num_write_kb":36751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.526513+0000","last_change":"2024-09-12T17:29:56.955510+0000","last_active":"2024-09-12T18:04:59.526513+0000","last_peered":"2024-09-12T18:04:59.526513+0000","last_clean":"2024-09-12T18:04:59.526513+0000","last_became_active":"2024-09-12T17:29:56.955256+0000","last_became_peered":"2024-09-12T17:29:56.955256+0000","last_unstale":"2024-09-12T18:04:59.526513+0000","last_undegraded":"2024-09-12T18:04:59.526513+0000","last_fullsized":"2024-09-12T18:04:59.526513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:56.582465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'51","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.247475+0000","last_change":"2024-09-12T17:29:58.961027+0000","last_active":"2024-09-12T18:06:21.247475+0000","last_peered":"2024-09-12T18:06:21.247475+0000","last_clean":"2024-09-12T18:06:21.247475+0000","last_became_active":"2024-09-12T17:29:58.960476+0000","last_became_peered":"2024-09-12T17:29:58.960476+0000","last_unstale":"2024-09-12T18:06:21.247475+0000","last_undegraded":"2024-09-12T18:06:21.247475+0000","last_fullsized":"2024-09-12T18:06:21.247475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:15.254313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.682338+0000","last_change":"2024-09-12T17:30:00.958998+0000","last_active":"2024-09-12T18:05:04.682338+0000","last_peered":"2024-09-12T18:05:04.682338+0000","last_clean":"2024-09-12T18:05:04.682338+0000","last_became_active":"2024-09-12T17:30:00.958739+0000","last_became_peered":"2024-09-12T17:30:00.958739+0000","last_unstale":"2024-09-12T18:05:04.682338+0000","last_undegraded":"2024-09-12T18:05:04.682338+0000","last_fullsized":"2024-09-12T18:05:04.682338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:23.108221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'186","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.857340+0000","last_change":"2024-09-12T17:30:02.973036+0000","last_active":"2024-09-12T18:06:20.857340+0000","last_peered":"2024-09-12T18:06:20.857340+0000","last_clean":"2024-09-12T18:06:20.857340+0000","last_became_active":"2024-09-12T17:30:02.972717+0000","last_became_peered":"2024-09-12T17:30:02.972717+0000","last_unstale":"2024-09-12T18:06:20.857340+0000","last_undegraded":"2024-09-12T18:06:20.857340+0000","last_fullsized":"2024-09-12T18:06:20.857340+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:17.417135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":309,"num_read_kb":305,"num_write":411,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'235","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.884486+0000","last_change":"2024-09-12T17:29:54.956165+0000","last_active":"2024-09-12T18:06:08.884486+0000","last_peered":"2024-09-12T18:06:08.884486+0000","last_clean":"2024-09-12T18:06:08.884486+0000","last_became_active":"2024-09-12T17:29:54.955897+0000","last_became_peered":"2024-09-12T17:29:54.955897+0000","last_unstale":"2024-09-12T18:06:08.884486+0000","last_undegraded":"2024-09-12T18:06:08.884486+0000","last_fullsized":"2024-09-12T18:06:08.884486+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:12.755846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":344,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'242","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:02.614774+0000","last_change":"2024-09-12T17:29:52.955479+0000","last_active":"2024-09-12T18:06:02.614774+0000","last_peered":"2024-09-12T18:06:02.614774+0000","last_clean":"2024-09-12T18:06:02.614774+0000","last_became_active":"2024-09-12T17:29:52.954956+0000","last_became_peered":"2024-09-12T17:29:52.954956+0000","last_unstale":"2024-09-12T18:06:02.614774+0000","last_undegraded":"2024-09-12T18:06:02.614774+0000","last_fullsized":"2024-09-12T18:06:02.614774+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:37.430521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5794956,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":5380,"num_write":1206,"num_write_kb":40346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.681595+0000","last_change":"2024-09-12T17:29:56.959871+0000","last_active":"2024-09-12T18:04:59.681595+0000","last_peered":"2024-09-12T18:04:59.681595+0000","last_clean":"2024-09-12T18:04:59.681595+0000","last_became_active":"2024-09-12T17:29:56.959460+0000","last_became_peered":"2024-09-12T17:29:56.959460+0000","last_unstale":"2024-09-12T18:04:59.681595+0000","last_undegraded":"2024-09-12T18:04:59.681595+0000","last_fullsized":"2024-09-12T18:04:59.681595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:11.274542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'145","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.550161+0000","last_change":"2024-09-12T17:29:58.961137+0000","last_active":"2024-09-12T18:07:19.550161+0000","last_peered":"2024-09-12T18:07:19.550161+0000","last_clean":"2024-09-12T18:07:19.550161+0000","last_became_active":"2024-09-12T17:29:58.960824+0000","last_became_peered":"2024-09-12T17:29:58.960824+0000","last_unstale":"2024-09-12T18:07:19.550161+0000","last_undegraded":"2024-09-12T18:07:19.550161+0000","last_fullsized":"2024-09-12T18:07:19.550161+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:15.729749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6167,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":223,"num_write":102,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.515733+0000","last_change":"2024-09-12T17:30:00.967592+0000","last_active":"2024-09-12T18:05:04.515733+0000","last_peered":"2024-09-12T18:05:04.515733+0000","last_clean":"2024-09-12T18:05:04.515733+0000","last_became_active":"2024-09-12T17:30:00.967299+0000","last_became_peered":"2024-09-12T17:30:00.967299+0000","last_unstale":"2024-09-12T18:05:04.515733+0000","last_undegraded":"2024-09-12T18:05:04.515733+0000","last_fullsized":"2024-09-12T18:05:04.515733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:31.645270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'93","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.484386+0000","last_change":"2024-09-12T17:30:02.966660+0000","last_active":"2024-09-12T18:06:20.484386+0000","last_peered":"2024-09-12T18:06:20.484386+0000","last_clean":"2024-09-12T18:06:20.484386+0000","last_became_active":"2024-09-12T17:30:02.965644+0000","last_became_peered":"2024-09-12T17:30:02.965644+0000","last_unstale":"2024-09-12T18:06:20.484386+0000","last_undegraded":"2024-09-12T18:06:20.484386+0000","last_fullsized":"2024-09-12T18:06:20.484386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:15.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":207,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'4299","reported_seq":4944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.467541+0000","last_change":"2024-09-12T17:29:54.951955+0000","last_active":"2024-09-12T18:06:07.467541+0000","last_peered":"2024-09-12T18:06:07.467541+0000","last_clean":"2024-09-12T18:06:07.467541+0000","last_became_active":"2024-09-12T17:29:54.950407+0000","last_became_peered":"2024-09-12T17:29:54.950407+0000","last_unstale":"2024-09-12T18:06:07.467541+0000","last_undegraded":"2024-09-12T18:06:07.467541+0000","last_fullsized":"2024-09-12T18:06:07.467541+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:23.507143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17237,"num_read_kb":14347,"num_write":6471,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'174","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.126319+0000","last_change":"2024-09-12T17:29:52.963110+0000","last_active":"2024-09-12T18:06:01.126319+0000","last_peered":"2024-09-12T18:06:01.126319+0000","last_clean":"2024-09-12T18:06:01.126319+0000","last_became_active":"2024-09-12T17:29:52.962836+0000","last_became_peered":"2024-09-12T17:29:52.962836+0000","last_unstale":"2024-09-12T18:06:01.126319+0000","last_undegraded":"2024-09-12T18:06:01.126319+0000","last_fullsized":"2024-09-12T18:06:01.126319+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:33.047304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27545556,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":390,"num_read_kb":45090,"num_write":883,"num_write_kb":58788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.514939+0000","last_change":"2024-09-12T17:29:56.957363+0000","last_active":"2024-09-12T18:04:59.514939+0000","last_peered":"2024-09-12T18:04:59.514939+0000","last_clean":"2024-09-12T18:04:59.514939+0000","last_became_active":"2024-09-12T17:29:56.957066+0000","last_became_peered":"2024-09-12T17:29:56.957066+0000","last_unstale":"2024-09-12T18:04:59.514939+0000","last_undegraded":"2024-09-12T18:04:59.514939+0000","last_fullsized":"2024-09-12T18:04:59.514939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:23.450708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'148","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.701524+0000","last_change":"2024-09-12T17:29:58.955841+0000","last_active":"2024-09-12T18:07:19.701524+0000","last_peered":"2024-09-12T18:07:19.701524+0000","last_clean":"2024-09-12T18:07:19.701524+0000","last_became_active":"2024-09-12T17:29:58.955585+0000","last_became_peered":"2024-09-12T17:29:58.955585+0000","last_unstale":"2024-09-12T18:07:19.701524+0000","last_undegraded":"2024-09-12T18:07:19.701524+0000","last_fullsized":"2024-09-12T18:07:19.701524+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:03.552605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12664,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":164,"num_read_kb":221,"num_write":98,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644380+0000","last_change":"2024-09-12T17:30:00.965228+0000","last_active":"2024-09-12T18:05:04.644380+0000","last_peered":"2024-09-12T18:05:04.644380+0000","last_clean":"2024-09-12T18:05:04.644380+0000","last_became_active":"2024-09-12T17:30:00.964621+0000","last_became_peered":"2024-09-12T17:30:00.964621+0000","last_unstale":"2024-09-12T18:05:04.644380+0000","last_undegraded":"2024-09-12T18:05:04.644380+0000","last_fullsized":"2024-09-12T18:05:04.644380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:28.006617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'546","reported_seq":1344,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517857+0000","last_change":"2024-09-12T17:29:54.959133+0000","last_active":"2024-09-12T18:05:19.517857+0000","last_peered":"2024-09-12T18:05:19.517857+0000","last_clean":"2024-09-12T18:05:19.517857+0000","last_became_active":"2024-09-12T17:29:54.958758+0000","last_became_peered":"2024-09-12T17:29:54.958758+0000","last_unstale":"2024-09-12T18:05:19.517857+0000","last_undegraded":"2024-09-12T18:05:19.517857+0000","last_fullsized":"2024-09-12T18:05:19.517857+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:49.827603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2571,"num_read_kb":2181,"num_write":951,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'207","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.106442+0000","last_change":"2024-09-12T17:30:28.007406+0000","last_active":"2024-09-12T18:05:57.106442+0000","last_peered":"2024-09-12T18:05:57.106442+0000","last_clean":"2024-09-12T18:05:57.106442+0000","last_became_active":"2024-09-12T17:30:28.007001+0000","last_became_peered":"2024-09-12T17:30:28.007001+0000","last_unstale":"2024-09-12T18:05:57.106442+0000","last_undegraded":"2024-09-12T18:05:57.106442+0000","last_fullsized":"2024-09-12T18:05:57.106442+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:46.585635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15991744,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":573,"num_read_kb":31262,"num_write":913,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634516+0000","last_change":"2024-09-12T17:29:56.954814+0000","last_active":"2024-09-12T18:04:04.634516+0000","last_peered":"2024-09-12T18:04:04.634516+0000","last_clean":"2024-09-12T18:04:04.634516+0000","last_became_active":"2024-09-12T17:29:56.954498+0000","last_became_peered":"2024-09-12T17:29:56.954498+0000","last_unstale":"2024-09-12T18:04:04.634516+0000","last_undegraded":"2024-09-12T18:04:04.634516+0000","last_fullsized":"2024-09-12T18:04:04.634516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:39.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'182","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.644829+0000","last_change":"2024-09-12T17:29:58.958482+0000","last_active":"2024-09-12T18:07:38.644829+0000","last_peered":"2024-09-12T18:07:38.644829+0000","last_clean":"2024-09-12T18:07:38.644829+0000","last_became_active":"2024-09-12T17:29:58.958198+0000","last_became_peered":"2024-09-12T17:29:58.958198+0000","last_unstale":"2024-09-12T18:07:38.644829+0000","last_undegraded":"2024-09-12T18:07:38.644829+0000","last_fullsized":"2024-09-12T18:07:38.644829+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:03.636909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23630,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":276,"num_read_kb":397,"num_write":176,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.639853+0000","last_change":"2024-09-12T17:30:00.964218+0000","last_active":"2024-09-12T18:05:04.639853+0000","last_peered":"2024-09-12T18:05:04.639853+0000","last_clean":"2024-09-12T18:05:04.639853+0000","last_became_active":"2024-09-12T17:30:00.963706+0000","last_became_peered":"2024-09-12T17:30:00.963706+0000","last_unstale":"2024-09-12T18:05:04.639853+0000","last_undegraded":"2024-09-12T18:05:04.639853+0000","last_fullsized":"2024-09-12T18:05:04.639853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:42.210305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'175","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.667499+0000","last_change":"2024-09-12T17:30:02.964954+0000","last_active":"2024-09-12T18:06:08.667499+0000","last_peered":"2024-09-12T18:06:08.667499+0000","last_clean":"2024-09-12T18:06:08.667499+0000","last_became_active":"2024-09-12T17:30:02.964682+0000","last_became_peered":"2024-09-12T17:30:02.964682+0000","last_unstale":"2024-09-12T18:06:08.667499+0000","last_undegraded":"2024-09-12T18:06:08.667499+0000","last_fullsized":"2024-09-12T18:06:08.667499+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:18.544576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":239,"num_read_kb":250,"num_write":415,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'100","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.652523+0000","last_change":"2024-09-12T17:29:54.955631+0000","last_active":"2024-09-12T18:05:59.652523+0000","last_peered":"2024-09-12T18:05:59.652523+0000","last_clean":"2024-09-12T18:05:59.652523+0000","last_became_active":"2024-09-12T17:29:54.955326+0000","last_became_peered":"2024-09-12T17:29:54.955326+0000","last_unstale":"2024-09-12T18:05:59.652523+0000","last_undegraded":"2024-09-12T18:05:59.652523+0000","last_fullsized":"2024-09-12T18:05:59.652523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:49.289784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":334,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'216","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.390956+0000","last_change":"2024-09-12T17:29:52.946176+0000","last_active":"2024-09-12T18:06:06.390956+0000","last_peered":"2024-09-12T18:06:06.390956+0000","last_clean":"2024-09-12T18:06:06.390956+0000","last_became_active":"2024-09-12T17:29:52.945616+0000","last_became_peered":"2024-09-12T17:29:52.945616+0000","last_unstale":"2024-09-12T18:06:06.390956+0000","last_undegraded":"2024-09-12T18:06:06.390956+0000","last_fullsized":"2024-09-12T18:06:06.390956+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.047653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16164918,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":15300,"num_write":1079,"num_write_kb":27395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518557+0000","last_change":"2024-09-12T17:29:56.959423+0000","last_active":"2024-09-12T18:05:24.518557+0000","last_peered":"2024-09-12T18:05:24.518557+0000","last_clean":"2024-09-12T18:05:24.518557+0000","last_became_active":"2024-09-12T17:29:56.959047+0000","last_became_peered":"2024-09-12T17:29:56.959047+0000","last_unstale":"2024-09-12T18:05:24.518557+0000","last_undegraded":"2024-09-12T18:05:24.518557+0000","last_fullsized":"2024-09-12T18:05:24.518557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:03.525338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'141","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:29.703006+0000","last_change":"2024-09-12T17:29:58.955055+0000","last_active":"2024-09-12T18:07:29.703006+0000","last_peered":"2024-09-12T18:07:29.703006+0000","last_clean":"2024-09-12T18:07:29.703006+0000","last_became_active":"2024-09-12T17:29:58.954747+0000","last_became_peered":"2024-09-12T17:29:58.954747+0000","last_unstale":"2024-09-12T18:07:29.703006+0000","last_undegraded":"2024-09-12T18:07:29.703006+0000","last_fullsized":"2024-09-12T18:07:29.703006+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:01.106668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10981,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":186,"num_read_kb":237,"num_write":116,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644390+0000","last_change":"2024-09-12T17:30:00.960182+0000","last_active":"2024-09-12T18:05:04.644390+0000","last_peered":"2024-09-12T18:05:04.644390+0000","last_clean":"2024-09-12T18:05:04.644390+0000","last_became_active":"2024-09-12T17:30:00.959708+0000","last_became_peered":"2024-09-12T17:30:00.959708+0000","last_unstale":"2024-09-12T18:05:04.644390+0000","last_undegraded":"2024-09-12T18:05:04.644390+0000","last_fullsized":"2024-09-12T18:05:04.644390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:04.130612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'214","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.731228+0000","last_change":"2024-09-12T17:30:02.961235+0000","last_active":"2024-09-12T18:07:37.731228+0000","last_peered":"2024-09-12T18:07:37.731228+0000","last_clean":"2024-09-12T18:07:37.731228+0000","last_became_active":"2024-09-12T17:30:02.960928+0000","last_became_peered":"2024-09-12T17:30:02.960928+0000","last_unstale":"2024-09-12T18:07:37.731228+0000","last_undegraded":"2024-09-12T18:07:37.731228+0000","last_fullsized":"2024-09-12T18:07:37.731228+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:02.653466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":219,"num_write":570,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'158","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:03.287640+0000","last_change":"2024-09-12T17:29:54.951640+0000","last_active":"2024-09-12T18:06:03.287640+0000","last_peered":"2024-09-12T18:06:03.287640+0000","last_clean":"2024-09-12T18:06:03.287640+0000","last_became_active":"2024-09-12T17:29:54.950294+0000","last_became_peered":"2024-09-12T17:29:54.950294+0000","last_unstale":"2024-09-12T18:06:03.287640+0000","last_undegraded":"2024-09-12T18:06:03.287640+0000","last_fullsized":"2024-09-12T18:06:03.287640+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:35.954198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":567,"num_write":224,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'194","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.301434+0000","last_change":"2024-09-12T17:29:52.947774+0000","last_active":"2024-09-12T18:05:57.301434+0000","last_peered":"2024-09-12T18:05:57.301434+0000","last_clean":"2024-09-12T18:05:57.301434+0000","last_became_active":"2024-09-12T17:29:52.947363+0000","last_became_peered":"2024-09-12T17:29:52.947363+0000","last_unstale":"2024-09-12T18:05:57.301434+0000","last_undegraded":"2024-09-12T18:05:57.301434+0000","last_fullsized":"2024-09-12T18:05:57.301434+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:04.661665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6376533,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":718,"num_read_kb":129945,"num_write":976,"num_write_kb":26137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.515065+0000","last_change":"2024-09-12T17:29:56.952220+0000","last_active":"2024-09-12T18:04:59.515065+0000","last_peered":"2024-09-12T18:04:59.515065+0000","last_clean":"2024-09-12T18:04:59.515065+0000","last_became_active":"2024-09-12T17:29:56.951825+0000","last_became_peered":"2024-09-12T17:29:56.951825+0000","last_unstale":"2024-09-12T18:04:59.515065+0000","last_undegraded":"2024-09-12T18:04:59.515065+0000","last_fullsized":"2024-09-12T18:04:59.515065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.728224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'127","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:29.551350+0000","last_change":"2024-09-12T17:29:58.978881+0000","last_active":"2024-09-12T18:07:29.551350+0000","last_peered":"2024-09-12T18:07:29.551350+0000","last_clean":"2024-09-12T18:07:29.551350+0000","last_became_active":"2024-09-12T17:29:58.978506+0000","last_became_peered":"2024-09-12T17:29:58.978506+0000","last_unstale":"2024-09-12T18:07:29.551350+0000","last_undegraded":"2024-09-12T18:07:29.551350+0000","last_fullsized":"2024-09-12T18:07:29.551350+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:23.505523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8546,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":154,"num_read_kb":204,"num_write":82,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.635596+0000","last_change":"2024-09-12T17:30:00.965903+0000","last_active":"2024-09-12T18:04:09.635596+0000","last_peered":"2024-09-12T18:04:09.635596+0000","last_clean":"2024-09-12T18:04:09.635596+0000","last_became_active":"2024-09-12T17:30:00.965628+0000","last_became_peered":"2024-09-12T17:30:00.965628+0000","last_unstale":"2024-09-12T18:04:09.635596+0000","last_undegraded":"2024-09-12T18:04:09.635596+0000","last_fullsized":"2024-09-12T18:04:09.635596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:59.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'111","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.672413+0000","last_change":"2024-09-12T17:30:02.963569+0000","last_active":"2024-09-12T18:07:38.672413+0000","last_peered":"2024-09-12T18:07:38.672413+0000","last_clean":"2024-09-12T18:07:38.672413+0000","last_became_active":"2024-09-12T17:30:02.963242+0000","last_became_peered":"2024-09-12T17:30:02.963242+0000","last_unstale":"2024-09-12T18:07:38.672413+0000","last_undegraded":"2024-09-12T18:07:38.672413+0000","last_fullsized":"2024-09-12T18:07:38.672413+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:33.404263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'168","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.875016+0000","last_change":"2024-09-12T17:29:54.950700+0000","last_active":"2024-09-12T18:05:26.875016+0000","last_peered":"2024-09-12T18:05:26.875016+0000","last_clean":"2024-09-12T18:05:26.875016+0000","last_became_active":"2024-09-12T17:29:54.950429+0000","last_became_peered":"2024-09-12T17:29:54.950429+0000","last_unstale":"2024-09-12T18:05:26.875016+0000","last_undegraded":"2024-09-12T18:05:26.875016+0000","last_fullsized":"2024-09-12T18:05:26.875016+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:03.561091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":726,"num_read_kb":598,"num_write":255,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'194","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.730592+0000","last_change":"2024-09-12T17:29:52.967135+0000","last_active":"2024-09-12T18:05:20.730592+0000","last_peered":"2024-09-12T18:05:20.730592+0000","last_clean":"2024-09-12T18:05:20.730592+0000","last_became_active":"2024-09-12T17:29:52.966561+0000","last_became_peered":"2024-09-12T17:29:52.966561+0000","last_unstale":"2024-09-12T18:05:20.730592+0000","last_undegraded":"2024-09-12T18:05:20.730592+0000","last_fullsized":"2024-09-12T18:05:20.730592+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:12.665280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":383,"num_read_kb":24994,"num_write":950,"num_write_kb":31573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643585+0000","last_change":"2024-09-12T17:29:56.959683+0000","last_active":"2024-09-12T18:04:59.643585+0000","last_peered":"2024-09-12T18:04:59.643585+0000","last_clean":"2024-09-12T18:04:59.643585+0000","last_became_active":"2024-09-12T17:29:56.959185+0000","last_became_peered":"2024-09-12T17:29:56.959185+0000","last_unstale":"2024-09-12T18:04:59.643585+0000","last_undegraded":"2024-09-12T18:04:59.643585+0000","last_fullsized":"2024-09-12T18:04:59.643585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:49.577878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'60","reported_seq":573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.221013+0000","last_change":"2024-09-12T17:29:58.978897+0000","last_active":"2024-09-12T18:05:53.221013+0000","last_peered":"2024-09-12T18:05:53.221013+0000","last_clean":"2024-09-12T18:05:53.221013+0000","last_became_active":"2024-09-12T17:29:58.978247+0000","last_became_peered":"2024-09-12T17:29:58.978247+0000","last_unstale":"2024-09-12T18:05:53.221013+0000","last_undegraded":"2024-09-12T18:05:53.221013+0000","last_fullsized":"2024-09-12T18:05:53.221013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:21.292974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":59,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'756","reported_seq":2182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.684833+0000","last_change":"2024-09-12T17:30:00.962301+0000","last_active":"2024-09-12T18:07:38.684833+0000","last_peered":"2024-09-12T18:07:38.684833+0000","last_clean":"2024-09-12T18:07:38.684833+0000","last_became_active":"2024-09-12T17:30:00.961928+0000","last_became_peered":"2024-09-12T17:30:00.961928+0000","last_unstale":"2024-09-12T18:07:38.684833+0000","last_undegraded":"2024-09-12T18:07:38.684833+0000","last_fullsized":"2024-09-12T18:07:38.684833+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:21.176614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'103","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.850274+0000","last_change":"2024-09-12T17:30:02.963767+0000","last_active":"2024-09-12T18:06:20.850274+0000","last_peered":"2024-09-12T18:06:20.850274+0000","last_clean":"2024-09-12T18:06:20.850274+0000","last_became_active":"2024-09-12T17:30:02.963474+0000","last_became_peered":"2024-09-12T17:30:02.963474+0000","last_unstale":"2024-09-12T18:06:20.850274+0000","last_undegraded":"2024-09-12T18:06:20.850274+0000","last_fullsized":"2024-09-12T18:06:20.850274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:06.653540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'461","reported_seq":1185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.916766+0000","last_change":"2024-09-12T17:29:54.956245+0000","last_active":"2024-09-12T18:05:56.916766+0000","last_peered":"2024-09-12T18:05:56.916766+0000","last_clean":"2024-09-12T18:05:56.916766+0000","last_became_active":"2024-09-12T17:29:54.954344+0000","last_became_peered":"2024-09-12T17:29:54.954344+0000","last_unstale":"2024-09-12T18:05:56.916766+0000","last_undegraded":"2024-09-12T18:05:56.916766+0000","last_fullsized":"2024-09-12T18:05:56.916766+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:54.059931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":1813,"num_write":696,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'213","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:28.839278+0000","last_change":"2024-09-12T17:30:28.008322+0000","last_active":"2024-09-12T18:05:28.839278+0000","last_peered":"2024-09-12T18:05:28.839278+0000","last_clean":"2024-09-12T18:05:28.839278+0000","last_became_active":"2024-09-12T17:30:28.008012+0000","last_became_peered":"2024-09-12T17:30:28.008012+0000","last_unstale":"2024-09-12T18:05:28.839278+0000","last_undegraded":"2024-09-12T18:05:28.839278+0000","last_fullsized":"2024-09-12T18:05:28.839278+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:35.056975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11908801,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":11221,"num_write":1054,"num_write_kb":38249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.681643+0000","last_change":"2024-09-12T17:29:56.959803+0000","last_active":"2024-09-12T18:04:59.681643+0000","last_peered":"2024-09-12T18:04:59.681643+0000","last_clean":"2024-09-12T18:04:59.681643+0000","last_became_active":"2024-09-12T17:29:56.959496+0000","last_became_peered":"2024-09-12T17:29:56.959496+0000","last_unstale":"2024-09-12T18:04:59.681643+0000","last_undegraded":"2024-09-12T18:04:59.681643+0000","last_fullsized":"2024-09-12T18:04:59.681643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:24.096051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'140","reported_seq":703,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.650628+0000","last_change":"2024-09-12T17:29:58.956511+0000","last_active":"2024-09-12T18:06:19.650628+0000","last_peered":"2024-09-12T18:06:19.650628+0000","last_clean":"2024-09-12T18:06:19.650628+0000","last_became_active":"2024-09-12T17:29:58.956214+0000","last_became_peered":"2024-09-12T17:29:58.956214+0000","last_unstale":"2024-09-12T18:06:19.650628+0000","last_undegraded":"2024-09-12T18:06:19.650628+0000","last_fullsized":"2024-09-12T18:06:19.650628+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.069692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9446,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":184,"num_read_kb":237,"num_write":104,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633054+0000","last_change":"2024-09-12T17:30:00.964427+0000","last_active":"2024-09-12T18:03:54.633054+0000","last_peered":"2024-09-12T18:03:54.633054+0000","last_clean":"2024-09-12T18:03:54.633054+0000","last_became_active":"2024-09-12T17:30:00.964150+0000","last_became_peered":"2024-09-12T17:30:00.964150+0000","last_unstale":"2024-09-12T18:03:54.633054+0000","last_undegraded":"2024-09-12T18:03:54.633054+0000","last_fullsized":"2024-09-12T18:03:54.633054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:38.024178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'176","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.255174+0000","last_change":"2024-09-12T17:30:02.972717+0000","last_active":"2024-09-12T18:05:56.255174+0000","last_peered":"2024-09-12T18:05:56.255174+0000","last_clean":"2024-09-12T18:05:56.255174+0000","last_became_active":"2024-09-12T17:30:02.972420+0000","last_became_peered":"2024-09-12T17:30:02.972420+0000","last_unstale":"2024-09-12T18:05:56.255174+0000","last_undegraded":"2024-09-12T18:05:56.255174+0000","last_fullsized":"2024-09-12T18:05:56.255174+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:00.149423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":302,"num_write":451,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'323","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.064215+0000","last_change":"2024-09-12T17:29:54.954336+0000","last_active":"2024-09-12T18:05:53.064215+0000","last_peered":"2024-09-12T18:05:53.064215+0000","last_clean":"2024-09-12T18:05:53.064215+0000","last_became_active":"2024-09-12T17:29:54.953626+0000","last_became_peered":"2024-09-12T17:29:54.953626+0000","last_unstale":"2024-09-12T18:05:53.064215+0000","last_undegraded":"2024-09-12T18:05:53.064215+0000","last_fullsized":"2024-09-12T18:05:53.064215+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:50.673324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1393,"num_read_kb":1115,"num_write":522,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'166","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.015143+0000","last_change":"2024-09-12T17:30:28.201293+0000","last_active":"2024-09-12T18:06:00.015143+0000","last_peered":"2024-09-12T18:06:00.015143+0000","last_clean":"2024-09-12T18:06:00.015143+0000","last_became_active":"2024-09-12T17:30:28.200981+0000","last_became_peered":"2024-09-12T17:30:28.200981+0000","last_unstale":"2024-09-12T18:06:00.015143+0000","last_undegraded":"2024-09-12T18:06:00.015143+0000","last_fullsized":"2024-09-12T18:06:00.015143+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:11.575396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6329538,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":372,"num_read_kb":41427,"num_write":830,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.639179+0000","last_change":"2024-09-12T17:29:56.955843+0000","last_active":"2024-09-12T18:04:59.639179+0000","last_peered":"2024-09-12T18:04:59.639179+0000","last_clean":"2024-09-12T18:04:59.639179+0000","last_became_active":"2024-09-12T17:29:56.955532+0000","last_became_peered":"2024-09-12T17:29:56.955532+0000","last_unstale":"2024-09-12T18:04:59.639179+0000","last_undegraded":"2024-09-12T18:04:59.639179+0000","last_fullsized":"2024-09-12T18:04:59.639179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:32.340336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'119","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.654225+0000","last_change":"2024-09-12T17:29:58.961115+0000","last_active":"2024-09-12T18:06:14.654225+0000","last_peered":"2024-09-12T18:06:14.654225+0000","last_clean":"2024-09-12T18:06:14.654225+0000","last_became_active":"2024-09-12T17:29:58.960733+0000","last_became_peered":"2024-09-12T17:29:58.960733+0000","last_unstale":"2024-09-12T18:06:14.654225+0000","last_undegraded":"2024-09-12T18:06:14.654225+0000","last_fullsized":"2024-09-12T18:06:14.654225+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:12.596344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11189,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":226,"num_write":80,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.507102+0000","last_change":"2024-09-12T17:30:00.960684+0000","last_active":"2024-09-12T18:04:04.507102+0000","last_peered":"2024-09-12T18:04:04.507102+0000","last_clean":"2024-09-12T18:04:04.507102+0000","last_became_active":"2024-09-12T17:30:00.960358+0000","last_became_peered":"2024-09-12T17:30:00.960358+0000","last_unstale":"2024-09-12T18:04:04.507102+0000","last_undegraded":"2024-09-12T18:04:04.507102+0000","last_fullsized":"2024-09-12T18:04:04.507102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:41.585720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'157","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.309864+0000","last_change":"2024-09-12T17:30:02.964368+0000","last_active":"2024-09-12T18:06:08.309864+0000","last_peered":"2024-09-12T18:06:08.309864+0000","last_clean":"2024-09-12T18:06:08.309864+0000","last_became_active":"2024-09-12T17:30:02.964082+0000","last_became_peered":"2024-09-12T17:30:02.964082+0000","last_unstale":"2024-09-12T18:06:08.309864+0000","last_undegraded":"2024-09-12T18:06:08.309864+0000","last_fullsized":"2024-09-12T18:06:08.309864+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:51.607971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":313,"num_read_kb":292,"num_write":397,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'219","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.313861+0000","last_change":"2024-09-12T17:29:54.945900+0000","last_active":"2024-09-12T18:06:01.313861+0000","last_peered":"2024-09-12T18:06:01.313861+0000","last_clean":"2024-09-12T18:06:01.313861+0000","last_became_active":"2024-09-12T17:29:54.945602+0000","last_became_peered":"2024-09-12T17:29:54.945602+0000","last_unstale":"2024-09-12T18:06:01.313861+0000","last_undegraded":"2024-09-12T18:06:01.313861+0000","last_fullsized":"2024-09-12T18:06:01.313861+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:32.630682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":778,"num_write":336,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'195","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.792203+0000","last_change":"2024-09-12T17:29:52.954797+0000","last_active":"2024-09-12T18:05:30.792203+0000","last_peered":"2024-09-12T18:05:30.792203+0000","last_clean":"2024-09-12T18:05:30.792203+0000","last_became_active":"2024-09-12T17:29:52.954457+0000","last_became_peered":"2024-09-12T17:29:52.954457+0000","last_unstale":"2024-09-12T18:05:30.792203+0000","last_undegraded":"2024-09-12T18:05:30.792203+0000","last_fullsized":"2024-09-12T18:05:30.792203+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:04.967724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10811276,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":410,"num_read_kb":114782,"num_write":974,"num_write_kb":45150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.504802+0000","last_change":"2024-09-12T17:29:56.953213+0000","last_active":"2024-09-12T18:03:49.504802+0000","last_peered":"2024-09-12T18:03:49.504802+0000","last_clean":"2024-09-12T18:03:49.504802+0000","last_became_active":"2024-09-12T17:29:56.952946+0000","last_became_peered":"2024-09-12T17:29:56.952946+0000","last_unstale":"2024-09-12T18:03:49.504802+0000","last_undegraded":"2024-09-12T18:03:49.504802+0000","last_fullsized":"2024-09-12T18:03:49.504802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:44.459531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'101","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:29.551281+0000","last_change":"2024-09-12T17:29:58.956494+0000","last_active":"2024-09-12T18:07:29.551281+0000","last_peered":"2024-09-12T18:07:29.551281+0000","last_clean":"2024-09-12T18:07:29.551281+0000","last_became_active":"2024-09-12T17:29:58.953283+0000","last_became_peered":"2024-09-12T17:29:58.953283+0000","last_unstale":"2024-09-12T18:07:29.551281+0000","last_undegraded":"2024-09-12T18:07:29.551281+0000","last_fullsized":"2024-09-12T18:07:29.551281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:18.253475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12298,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":145,"num_write":56,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.515722+0000","last_change":"2024-09-12T17:30:00.963002+0000","last_active":"2024-09-12T18:05:04.515722+0000","last_peered":"2024-09-12T18:05:04.515722+0000","last_clean":"2024-09-12T18:05:04.515722+0000","last_became_active":"2024-09-12T17:30:00.962703+0000","last_became_peered":"2024-09-12T17:30:00.962703+0000","last_unstale":"2024-09-12T18:05:04.515722+0000","last_undegraded":"2024-09-12T18:05:04.515722+0000","last_fullsized":"2024-09-12T18:05:04.515722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:05.219468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'181","reported_seq":1637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.718070+0000","last_change":"2024-09-12T17:30:02.970877+0000","last_active":"2024-09-12T18:06:19.718070+0000","last_peered":"2024-09-12T18:06:19.718070+0000","last_clean":"2024-09-12T18:06:19.718070+0000","last_became_active":"2024-09-12T17:30:02.970633+0000","last_became_peered":"2024-09-12T17:30:02.970633+0000","last_unstale":"2024-09-12T18:06:19.718070+0000","last_undegraded":"2024-09-12T18:06:19.718070+0000","last_fullsized":"2024-09-12T18:06:19.718070+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:13.976443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1219,"num_read_kb":1215,"num_write":406,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'173","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.446097+0000","last_change":"2024-09-12T17:29:54.955106+0000","last_active":"2024-09-12T18:06:06.446097+0000","last_peered":"2024-09-12T18:06:06.446097+0000","last_clean":"2024-09-12T18:06:06.446097+0000","last_became_active":"2024-09-12T17:29:54.954585+0000","last_became_peered":"2024-09-12T17:29:54.954585+0000","last_unstale":"2024-09-12T18:06:06.446097+0000","last_undegraded":"2024-09-12T18:06:06.446097+0000","last_fullsized":"2024-09-12T18:06:06.446097+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:16.804269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":606,"num_write":278,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'196","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.947535+0000","last_change":"2024-09-12T17:29:52.957088+0000","last_active":"2024-09-12T18:06:08.947535+0000","last_peered":"2024-09-12T18:06:08.947535+0000","last_clean":"2024-09-12T18:06:08.947535+0000","last_became_active":"2024-09-12T17:29:52.956621+0000","last_became_peered":"2024-09-12T17:29:52.956621+0000","last_unstale":"2024-09-12T18:06:08.947535+0000","last_undegraded":"2024-09-12T18:06:08.947535+0000","last_fullsized":"2024-09-12T18:06:08.947535+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:04.500292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13590676,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":906,"num_read_kb":17688,"num_write":1017,"num_write_kb":27781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633423+0000","last_change":"2024-09-12T17:29:56.955247+0000","last_active":"2024-09-12T18:03:54.633423+0000","last_peered":"2024-09-12T18:03:54.633423+0000","last_clean":"2024-09-12T18:03:54.633423+0000","last_became_active":"2024-09-12T17:29:56.954952+0000","last_became_peered":"2024-09-12T17:29:56.954952+0000","last_unstale":"2024-09-12T18:03:54.633423+0000","last_undegraded":"2024-09-12T18:03:54.633423+0000","last_fullsized":"2024-09-12T18:03:54.633423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:49.854222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'134","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:29.536122+0000","last_change":"2024-09-12T17:29:58.953367+0000","last_active":"2024-09-12T18:07:29.536122+0000","last_peered":"2024-09-12T18:07:29.536122+0000","last_clean":"2024-09-12T18:07:29.536122+0000","last_became_active":"2024-09-12T17:29:58.953076+0000","last_became_peered":"2024-09-12T17:29:58.953076+0000","last_unstale":"2024-09-12T18:07:29.536122+0000","last_undegraded":"2024-09-12T18:07:29.536122+0000","last_fullsized":"2024-09-12T18:07:29.536122+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:10.729622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11140,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":195,"num_read_kb":267,"num_write":108,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644366+0000","last_change":"2024-09-12T17:30:00.967059+0000","last_active":"2024-09-12T18:05:04.644366+0000","last_peered":"2024-09-12T18:05:04.644366+0000","last_clean":"2024-09-12T18:05:04.644366+0000","last_became_active":"2024-09-12T17:30:00.964942+0000","last_became_peered":"2024-09-12T17:30:00.964942+0000","last_unstale":"2024-09-12T18:05:04.644366+0000","last_undegraded":"2024-09-12T18:05:04.644366+0000","last_fullsized":"2024-09-12T18:05:04.644366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:59.160654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'116","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.763230+0000","last_change":"2024-09-12T17:30:02.969660+0000","last_active":"2024-09-12T18:07:37.763230+0000","last_peered":"2024-09-12T18:07:37.763230+0000","last_clean":"2024-09-12T18:07:37.763230+0000","last_became_active":"2024-09-12T17:30:02.969327+0000","last_became_peered":"2024-09-12T17:30:02.969327+0000","last_unstale":"2024-09-12T18:07:37.763230+0000","last_undegraded":"2024-09-12T18:07:37.763230+0000","last_fullsized":"2024-09-12T18:07:37.763230+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:11.229944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":150,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'198","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:02.136940+0000","last_change":"2024-09-12T17:29:54.956426+0000","last_active":"2024-09-12T18:06:02.136940+0000","last_peered":"2024-09-12T18:06:02.136940+0000","last_clean":"2024-09-12T18:06:02.136940+0000","last_became_active":"2024-09-12T17:29:54.956020+0000","last_became_peered":"2024-09-12T17:29:54.956020+0000","last_unstale":"2024-09-12T18:06:02.136940+0000","last_undegraded":"2024-09-12T18:06:02.136940+0000","last_fullsized":"2024-09-12T18:06:02.136940+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:46.756727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":702,"num_write":286,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'207","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.184629+0000","last_change":"2024-09-12T17:29:52.963730+0000","last_active":"2024-09-12T18:05:30.184629+0000","last_peered":"2024-09-12T18:05:30.184629+0000","last_clean":"2024-09-12T18:05:30.184629+0000","last_became_active":"2024-09-12T17:29:52.963118+0000","last_became_peered":"2024-09-12T17:29:52.963118+0000","last_unstale":"2024-09-12T18:05:30.184629+0000","last_undegraded":"2024-09-12T18:05:30.184629+0000","last_fullsized":"2024-09-12T18:05:30.184629+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:48.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5675346,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":2786,"num_write":993,"num_write_kb":44194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'222","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:27.059176+0000","last_change":"2024-09-12T17:29:54.947947+0000","last_active":"2024-09-12T18:05:27.059176+0000","last_peered":"2024-09-12T18:05:27.059176+0000","last_clean":"2024-09-12T18:05:27.059176+0000","last_became_active":"2024-09-12T17:29:54.947659+0000","last_became_peered":"2024-09-12T17:29:54.947659+0000","last_unstale":"2024-09-12T18:05:27.059176+0000","last_undegraded":"2024-09-12T18:05:27.059176+0000","last_fullsized":"2024-09-12T18:05:27.059176+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:03.080124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":954,"num_read_kb":780,"num_write":336,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'185","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:28.835935+0000","last_change":"2024-09-12T17:29:52.955863+0000","last_active":"2024-09-12T18:07:28.835935+0000","last_peered":"2024-09-12T18:07:28.835935+0000","last_clean":"2024-09-12T18:07:28.835935+0000","last_became_active":"2024-09-12T17:29:52.955546+0000","last_became_peered":"2024-09-12T17:29:52.955546+0000","last_unstale":"2024-09-12T18:07:28.835935+0000","last_undegraded":"2024-09-12T18:07:28.835935+0000","last_fullsized":"2024-09-12T18:07:28.835935+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:42.412076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10957292,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":626,"num_read_kb":171668,"num_write":900,"num_write_kb":49213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'156","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.113845+0000","last_change":"2024-09-12T17:29:54.958380+0000","last_active":"2024-09-12T18:06:09.113845+0000","last_peered":"2024-09-12T18:06:09.113845+0000","last_clean":"2024-09-12T18:06:09.113845+0000","last_became_active":"2024-09-12T17:29:54.958047+0000","last_became_peered":"2024-09-12T17:29:54.958047+0000","last_unstale":"2024-09-12T18:06:09.113845+0000","last_undegraded":"2024-09-12T18:06:09.113845+0000","last_fullsized":"2024-09-12T18:06:09.113845+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:44.328756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":718,"num_read_kb":592,"num_write":271,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'176","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.113932+0000","last_change":"2024-09-12T17:29:52.960525+0000","last_active":"2024-09-12T18:06:01.113932+0000","last_peered":"2024-09-12T18:06:01.113932+0000","last_clean":"2024-09-12T18:06:01.113932+0000","last_became_active":"2024-09-12T17:29:52.955924+0000","last_became_peered":"2024-09-12T17:29:52.955924+0000","last_unstale":"2024-09-12T18:06:01.113932+0000","last_undegraded":"2024-09-12T18:06:01.113932+0000","last_fullsized":"2024-09-12T18:06:01.113932+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:05.866424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4133406,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":445,"num_read_kb":86465,"num_write":875,"num_write_kb":34463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'67","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.807467+0000","last_change":"2024-09-12T17:29:54.956853+0000","last_active":"2024-09-12T18:05:09.807467+0000","last_peered":"2024-09-12T18:05:09.807467+0000","last_clean":"2024-09-12T18:05:09.807467+0000","last_became_active":"2024-09-12T17:29:54.956587+0000","last_became_peered":"2024-09-12T17:29:54.956587+0000","last_unstale":"2024-09-12T18:05:09.807467+0000","last_undegraded":"2024-09-12T18:05:09.807467+0000","last_fullsized":"2024-09-12T18:05:09.807467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:30.162589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":238,"num_write":111,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'188","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.507312+0000","last_change":"2024-09-12T17:29:52.961431+0000","last_active":"2024-09-12T18:05:29.507312+0000","last_peered":"2024-09-12T18:05:29.507312+0000","last_clean":"2024-09-12T18:05:29.507312+0000","last_became_active":"2024-09-12T17:29:52.961103+0000","last_became_peered":"2024-09-12T17:29:52.961103+0000","last_unstale":"2024-09-12T18:05:29.507312+0000","last_undegraded":"2024-09-12T18:05:29.507312+0000","last_fullsized":"2024-09-12T18:05:29.507312+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:36.469288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11159765,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":887,"num_read_kb":61034,"num_write":898,"num_write_kb":21974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'80","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.348999+0000","last_change":"2024-09-12T17:29:54.956259+0000","last_active":"2024-09-12T18:05:57.348999+0000","last_peered":"2024-09-12T18:05:57.348999+0000","last_clean":"2024-09-12T18:05:57.348999+0000","last_became_active":"2024-09-12T17:29:54.955986+0000","last_became_peered":"2024-09-12T17:29:54.955986+0000","last_unstale":"2024-09-12T18:05:57.348999+0000","last_undegraded":"2024-09-12T18:05:57.348999+0000","last_fullsized":"2024-09-12T18:05:57.348999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:45.758007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":303,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'230","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.138167+0000","last_change":"2024-09-12T17:31:28.509450+0000","last_active":"2024-09-12T18:06:08.138167+0000","last_peered":"2024-09-12T18:06:08.138167+0000","last_clean":"2024-09-12T18:06:08.138167+0000","last_became_active":"2024-09-12T17:31:28.509017+0000","last_became_peered":"2024-09-12T17:31:28.509017+0000","last_unstale":"2024-09-12T18:06:08.138167+0000","last_undegraded":"2024-09-12T18:06:08.138167+0000","last_fullsized":"2024-09-12T18:06:08.138167+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:24.346593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41098116,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":497,"num_read_kb":51267,"num_write":1099,"num_write_kb":73287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"264'52","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.531280+0000","last_change":"2024-09-12T17:29:54.957796+0000","last_active":"2024-09-12T18:05:57.531280+0000","last_peered":"2024-09-12T18:05:57.531280+0000","last_clean":"2024-09-12T18:05:57.531280+0000","last_became_active":"2024-09-12T17:29:54.957480+0000","last_became_peered":"2024-09-12T17:29:54.957480+0000","last_unstale":"2024-09-12T18:05:57.531280+0000","last_undegraded":"2024-09-12T18:05:57.531280+0000","last_fullsized":"2024-09-12T18:05:57.531280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:21.784834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":218,"num_write":68,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'170","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:27.136141+0000","last_change":"2024-09-12T17:29:52.946263+0000","last_active":"2024-09-12T18:05:27.136141+0000","last_peered":"2024-09-12T18:05:27.136141+0000","last_clean":"2024-09-12T18:05:27.136141+0000","last_became_active":"2024-09-12T17:29:52.945750+0000","last_became_peered":"2024-09-12T17:29:52.945750+0000","last_unstale":"2024-09-12T18:05:27.136141+0000","last_undegraded":"2024-09-12T18:05:27.136141+0000","last_fullsized":"2024-09-12T18:05:27.136141+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:34.049238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505957,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":12063,"num_write":841,"num_write_kb":23165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'78","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.533490+0000","last_change":"2024-09-12T17:29:54.950489+0000","last_active":"2024-09-12T18:05:19.533490+0000","last_peered":"2024-09-12T18:05:19.533490+0000","last_clean":"2024-09-12T18:05:19.533490+0000","last_became_active":"2024-09-12T17:29:54.949704+0000","last_became_peered":"2024-09-12T17:29:54.949704+0000","last_unstale":"2024-09-12T18:05:19.533490+0000","last_undegraded":"2024-09-12T18:05:19.533490+0000","last_fullsized":"2024-09-12T18:05:19.533490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:17.371079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":312,"num_write":123,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'199","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.031221+0000","last_change":"2024-09-12T17:29:52.961104+0000","last_active":"2024-09-12T18:07:37.031221+0000","last_peered":"2024-09-12T18:07:37.031221+0000","last_clean":"2024-09-12T18:07:37.031221+0000","last_became_active":"2024-09-12T17:29:52.960336+0000","last_became_peered":"2024-09-12T17:29:52.960336+0000","last_unstale":"2024-09-12T18:07:37.031221+0000","last_undegraded":"2024-09-12T18:07:37.031221+0000","last_fullsized":"2024-09-12T18:07:37.031221+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:31.941705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16275719,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":506,"num_read_kb":45667,"num_write":958,"num_write_kb":42266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'76","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517786+0000","last_change":"2024-09-12T17:29:54.956588+0000","last_active":"2024-09-12T18:05:19.517786+0000","last_peered":"2024-09-12T18:05:19.517786+0000","last_clean":"2024-09-12T18:05:19.517786+0000","last_became_active":"2024-09-12T17:29:54.956296+0000","last_became_peered":"2024-09-12T17:29:54.956296+0000","last_unstale":"2024-09-12T18:05:19.517786+0000","last_undegraded":"2024-09-12T18:05:19.517786+0000","last_fullsized":"2024-09-12T18:05:19.517786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:05.987373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":291,"num_write":101,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'195","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:18.481264+0000","last_change":"2024-09-12T17:29:52.953430+0000","last_active":"2024-09-12T18:05:18.481264+0000","last_peered":"2024-09-12T18:05:18.481264+0000","last_clean":"2024-09-12T18:05:18.481264+0000","last_became_active":"2024-09-12T17:29:52.953110+0000","last_became_peered":"2024-09-12T17:29:52.953110+0000","last_unstale":"2024-09-12T18:05:18.481264+0000","last_undegraded":"2024-09-12T18:05:18.481264+0000","last_fullsized":"2024-09-12T18:05:18.481264+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:17.347005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12859753,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":433,"num_read_kb":64376,"num_write":924,"num_write_kb":39967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'142","reported_seq":727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.024368+0000","last_change":"2024-09-12T17:29:54.945058+0000","last_active":"2024-09-12T18:06:06.024368+0000","last_peered":"2024-09-12T18:06:06.024368+0000","last_clean":"2024-09-12T18:06:06.024368+0000","last_became_active":"2024-09-12T17:29:54.944775+0000","last_became_peered":"2024-09-12T17:29:54.944775+0000","last_unstale":"2024-09-12T18:06:06.024368+0000","last_undegraded":"2024-09-12T18:06:06.024368+0000","last_fullsized":"2024-09-12T18:06:06.024368+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:36.057705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":576,"num_read_kb":470,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'232","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.738541+0000","last_change":"2024-09-12T17:29:52.953267+0000","last_active":"2024-09-12T18:06:08.738541+0000","last_peered":"2024-09-12T18:06:08.738541+0000","last_clean":"2024-09-12T18:06:08.738541+0000","last_became_active":"2024-09-12T17:29:52.952892+0000","last_became_peered":"2024-09-12T17:29:52.952892+0000","last_unstale":"2024-09-12T18:06:08.738541+0000","last_undegraded":"2024-09-12T18:06:08.738541+0000","last_fullsized":"2024-09-12T18:06:08.738541+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:09.264458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13312570,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":794,"num_read_kb":90532,"num_write":1288,"num_write_kb":28113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'4190","reported_seq":4816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.965248+0000","last_change":"2024-09-12T17:29:54.956378+0000","last_active":"2024-09-12T18:06:01.965248+0000","last_peered":"2024-09-12T18:06:01.965248+0000","last_clean":"2024-09-12T18:06:01.965248+0000","last_became_active":"2024-09-12T17:29:54.956030+0000","last_became_peered":"2024-09-12T17:29:54.956030+0000","last_unstale":"2024-09-12T18:06:01.965248+0000","last_undegraded":"2024-09-12T18:06:01.965248+0000","last_fullsized":"2024-09-12T18:06:01.965248+0000","mapping_epoch":26,"log_start":"264'4100","ondisk_log_start":"264'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":3000,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:59.132944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16971,"num_read_kb":14174,"num_write":6344,"num_write_kb":3204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'193","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.709664+0000","last_change":"2024-09-12T17:29:52.955756+0000","last_active":"2024-09-12T18:06:06.709664+0000","last_peered":"2024-09-12T18:06:06.709664+0000","last_clean":"2024-09-12T18:06:06.709664+0000","last_became_active":"2024-09-12T17:29:52.953694+0000","last_became_peered":"2024-09-12T17:29:52.953694+0000","last_unstale":"2024-09-12T18:06:06.709664+0000","last_undegraded":"2024-09-12T18:06:06.709664+0000","last_fullsized":"2024-09-12T18:06:06.709664+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:25.200873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13436243,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":421,"num_read_kb":9241,"num_write":943,"num_write_kb":54194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'298","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.645212+0000","last_change":"2024-09-12T17:29:54.954876+0000","last_active":"2024-09-12T18:05:55.645212+0000","last_peered":"2024-09-12T18:05:55.645212+0000","last_clean":"2024-09-12T18:05:55.645212+0000","last_became_active":"2024-09-12T17:29:54.954593+0000","last_became_peered":"2024-09-12T17:29:54.954593+0000","last_unstale":"2024-09-12T18:05:55.645212+0000","last_undegraded":"2024-09-12T18:05:55.645212+0000","last_fullsized":"2024-09-12T18:05:55.645212+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:15.447562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1407,"num_read_kb":1154,"num_write":474,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'208","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.674515+0000","last_change":"2024-09-12T17:29:52.959010+0000","last_active":"2024-09-12T18:06:01.674515+0000","last_peered":"2024-09-12T18:06:01.674515+0000","last_clean":"2024-09-12T18:06:01.674515+0000","last_became_active":"2024-09-12T17:29:52.958021+0000","last_became_peered":"2024-09-12T17:29:52.958021+0000","last_unstale":"2024-09-12T18:06:01.674515+0000","last_undegraded":"2024-09-12T18:06:01.674515+0000","last_fullsized":"2024-09-12T18:06:01.674515+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:23.137050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15903366,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":26305,"num_write":959,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'301","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:12.095784+0000","last_change":"2024-09-12T17:29:54.957925+0000","last_active":"2024-09-12T18:05:12.095784+0000","last_peered":"2024-09-12T18:05:12.095784+0000","last_clean":"2024-09-12T18:05:12.095784+0000","last_became_active":"2024-09-12T17:29:54.957636+0000","last_became_peered":"2024-09-12T17:29:54.957636+0000","last_unstale":"2024-09-12T18:05:12.095784+0000","last_undegraded":"2024-09-12T18:05:12.095784+0000","last_fullsized":"2024-09-12T18:05:12.095784+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:31.541263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1037,"num_write":475,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'225","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.677629+0000","last_change":"2024-09-12T17:29:52.966860+0000","last_active":"2024-09-12T18:05:59.677629+0000","last_peered":"2024-09-12T18:05:59.677629+0000","last_clean":"2024-09-12T18:05:59.677629+0000","last_became_active":"2024-09-12T17:29:52.966500+0000","last_became_peered":"2024-09-12T17:29:52.966500+0000","last_unstale":"2024-09-12T18:05:59.677629+0000","last_undegraded":"2024-09-12T18:05:59.677629+0000","last_fullsized":"2024-09-12T18:05:59.677629+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:52.632541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5504834,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":34941,"num_write":1116,"num_write_kb":28764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'173","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.713791+0000","last_change":"2024-09-12T17:30:28.010302+0000","last_active":"2024-09-12T18:06:07.713791+0000","last_peered":"2024-09-12T18:06:07.713791+0000","last_clean":"2024-09-12T18:06:07.713791+0000","last_became_active":"2024-09-12T17:30:28.010055+0000","last_became_peered":"2024-09-12T17:30:28.010055+0000","last_unstale":"2024-09-12T18:06:07.713791+0000","last_undegraded":"2024-09-12T18:06:07.713791+0000","last_fullsized":"2024-09-12T18:06:07.713791+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:49.191682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":614,"num_write":281,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'196","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.536940+0000","last_change":"2024-09-12T17:29:52.954562+0000","last_active":"2024-09-12T18:05:24.536940+0000","last_peered":"2024-09-12T18:05:24.536940+0000","last_clean":"2024-09-12T18:05:24.536940+0000","last_became_active":"2024-09-12T17:29:52.954238+0000","last_became_peered":"2024-09-12T17:29:52.954238+0000","last_unstale":"2024-09-12T18:05:24.536940+0000","last_undegraded":"2024-09-12T18:05:24.536940+0000","last_fullsized":"2024-09-12T18:05:24.536940+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:31.094284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874420,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":33290,"num_write":853,"num_write_kb":39696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'173","reported_seq":736,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.661699+0000","last_change":"2024-09-12T17:29:54.944911+0000","last_active":"2024-09-12T18:06:08.661699+0000","last_peered":"2024-09-12T18:06:08.661699+0000","last_clean":"2024-09-12T18:06:08.661699+0000","last_became_active":"2024-09-12T17:29:54.944623+0000","last_became_peered":"2024-09-12T17:29:54.944623+0000","last_unstale":"2024-09-12T18:06:08.661699+0000","last_undegraded":"2024-09-12T18:06:08.661699+0000","last_fullsized":"2024-09-12T18:06:08.661699+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:42.419447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":587,"num_write":256,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'215","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.019643+0000","last_change":"2024-09-12T17:29:52.952178+0000","last_active":"2024-09-12T18:06:07.019643+0000","last_peered":"2024-09-12T18:06:07.019643+0000","last_clean":"2024-09-12T18:06:07.019643+0000","last_became_active":"2024-09-12T17:29:52.951819+0000","last_became_peered":"2024-09-12T17:29:52.951819+0000","last_unstale":"2024-09-12T18:06:07.019643+0000","last_undegraded":"2024-09-12T18:06:07.019643+0000","last_fullsized":"2024-09-12T18:06:07.019643+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:53.052744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2432528,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":4445,"num_write":1037,"num_write_kb":38455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'247","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:02.429830+0000","last_change":"2024-09-12T17:29:54.952227+0000","last_active":"2024-09-12T18:06:02.429830+0000","last_peered":"2024-09-12T18:06:02.429830+0000","last_clean":"2024-09-12T18:06:02.429830+0000","last_became_active":"2024-09-12T17:29:54.950941+0000","last_became_peered":"2024-09-12T17:29:54.950941+0000","last_unstale":"2024-09-12T18:06:02.429830+0000","last_undegraded":"2024-09-12T18:06:02.429830+0000","last_fullsized":"2024-09-12T18:06:02.429830+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:47.854196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":842,"num_write":398,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'203","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.640910+0000","last_change":"2024-09-12T17:29:52.953913+0000","last_active":"2024-09-12T18:04:54.640910+0000","last_peered":"2024-09-12T18:04:54.640910+0000","last_clean":"2024-09-12T18:04:54.640910+0000","last_became_active":"2024-09-12T17:29:52.953569+0000","last_became_peered":"2024-09-12T17:29:52.953569+0000","last_unstale":"2024-09-12T18:04:54.640910+0000","last_undegraded":"2024-09-12T18:04:54.640910+0000","last_fullsized":"2024-09-12T18:04:54.640910+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:45.959383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2568203,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":11537,"num_write":1035,"num_write_kb":39628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'119","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.659784+0000","last_change":"2024-09-12T17:29:54.961906+0000","last_active":"2024-09-12T18:05:52.659784+0000","last_peered":"2024-09-12T18:05:52.659784+0000","last_clean":"2024-09-12T18:05:52.659784+0000","last_became_active":"2024-09-12T17:29:54.961615+0000","last_became_peered":"2024-09-12T17:29:54.961615+0000","last_unstale":"2024-09-12T18:05:52.659784+0000","last_undegraded":"2024-09-12T18:05:52.659784+0000","last_fullsized":"2024-09-12T18:05:52.659784+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:47.744907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":544,"num_read_kb":456,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'259","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.188541+0000","last_change":"2024-09-12T17:29:52.956926+0000","last_active":"2024-09-12T18:06:06.188541+0000","last_peered":"2024-09-12T18:06:06.188541+0000","last_clean":"2024-09-12T18:06:06.188541+0000","last_became_active":"2024-09-12T17:29:52.954363+0000","last_became_peered":"2024-09-12T17:29:52.954363+0000","last_unstale":"2024-09-12T18:06:06.188541+0000","last_undegraded":"2024-09-12T18:06:06.188541+0000","last_fullsized":"2024-09-12T18:06:06.188541+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:03.699758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12188635,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":605,"num_read_kb":60789,"num_write":1178,"num_write_kb":24093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'148","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.787667+0000","last_change":"2024-09-12T17:29:52.953182+0000","last_active":"2024-09-12T18:06:07.787667+0000","last_peered":"2024-09-12T18:06:07.787667+0000","last_clean":"2024-09-12T18:06:07.787667+0000","last_became_active":"2024-09-12T17:29:52.952766+0000","last_became_peered":"2024-09-12T17:29:52.952766+0000","last_unstale":"2024-09-12T18:06:07.787667+0000","last_undegraded":"2024-09-12T18:06:07.787667+0000","last_fullsized":"2024-09-12T18:06:07.787667+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:33.543180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20385387,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":390,"num_read_kb":30421,"num_write":774,"num_write_kb":28733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'81","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.545153+0000","last_change":"2024-09-12T17:29:54.944959+0000","last_active":"2024-09-12T18:05:52.545153+0000","last_peered":"2024-09-12T18:05:52.545153+0000","last_clean":"2024-09-12T18:05:52.545153+0000","last_became_active":"2024-09-12T17:29:54.944681+0000","last_became_peered":"2024-09-12T17:29:54.944681+0000","last_unstale":"2024-09-12T18:05:52.545153+0000","last_undegraded":"2024-09-12T18:05:52.545153+0000","last_fullsized":"2024-09-12T18:05:52.545153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:39.628805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":330,"num_write":124,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'185","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.255368+0000","last_change":"2024-09-12T17:29:52.942936+0000","last_active":"2024-09-12T18:06:19.255368+0000","last_peered":"2024-09-12T18:06:19.255368+0000","last_clean":"2024-09-12T18:06:19.255368+0000","last_became_active":"2024-09-12T17:29:52.942331+0000","last_became_peered":"2024-09-12T17:29:52.942331+0000","last_unstale":"2024-09-12T18:06:19.255368+0000","last_undegraded":"2024-09-12T18:06:19.255368+0000","last_fullsized":"2024-09-12T18:06:19.255368+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:29.868639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4365672,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":15046,"num_write":965,"num_write_kb":38540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'194","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.022497+0000","last_change":"2024-09-12T17:29:54.963259+0000","last_active":"2024-09-12T18:05:56.022497+0000","last_peered":"2024-09-12T18:05:56.022497+0000","last_clean":"2024-09-12T18:05:56.022497+0000","last_became_active":"2024-09-12T17:29:54.962921+0000","last_became_peered":"2024-09-12T17:29:54.962921+0000","last_unstale":"2024-09-12T18:05:56.022497+0000","last_undegraded":"2024-09-12T18:05:56.022497+0000","last_fullsized":"2024-09-12T18:05:56.022497+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:02.447215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":851,"num_read_kb":702,"num_write":304,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":4389,"num_write":1992,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1063,"ondisk_log_size":1063,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":16199,"num_read_kb":15887,"num_write":16770,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1852,"ondisk_log_size":1852,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":469,"ondisk_log_size":469,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":371539,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7530,"num_read_kb":9197,"num_write":5063,"num_write_kb":2472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":696320,"data_stored":191346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1997,"ondisk_log_size":1997,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2394,"num_read_kb":2858,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102452,"num_read_kb":85292,"num_write":37168,"num_write_kb":18720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4224,"ondisk_log_size":4224,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":623432097,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":474,"num_whiteouts":0,"num_read":32696,"num_read_kb":2424166,"num_write":62705,"num_write_kb":2261412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":938360832,"data_stored":938360832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4590,"ondisk_log_size":4590,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":85054806,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":124,"num_read_kb":207617,"num_write":141,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170115072,"data_stored":170109612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":85054806,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":121,"num_read_kb":201926,"num_write":141,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170115072,"data_stored":170109612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542610,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316056,"kb_used_data":96072,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94055784,"statfs":{"total":96636764160,"available":96313122816,"internally_reserved":0,"allocated":98377728,"data_stored":96341523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542609,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409564,"kb_used_data":189580,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93962276,"statfs":{"total":96636764160,"available":96217370624,"internally_reserved":0,"allocated":194129920,"data_stored":192165815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542611,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252852,"kb_used_data":159268,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94118988,"statfs":{"total":96636764160,"available":96377843712,"internally_reserved":0,"allocated":163090432,"data_stored":161046070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542610,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238164,"kb_used_data":170884,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94133676,"statfs":{"total":96636764160,"available":96392884224,"internally_reserved":0,"allocated":174985216,"data_stored":173066278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542608,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429780,"kb_used_data":200068,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93942060,"statfs":{"total":96636764160,"available":96196669440,"internally_reserved":0,"allocated":204869632,"data_stored":202846428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542609,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217292,"kb_used_data":132028,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94154548,"statfs":{"total":96636764160,"available":96414257152,"internally_reserved":0,"allocated":135196672,"data_stored":133257194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542610,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255836,"kb_used_data":148364,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94116004,"statfs":{"total":96636764160,"available":96374788096,"internally_reserved":0,"allocated":151924736,"data_stored":149927987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542609,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":420896,"kb_used_data":187024,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93950944,"statfs":{"total":96636764160,"available":96205766656,"internally_reserved":0,"allocated":191512576,"data_stored":189506297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":138264576,"data_stored":138264576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":88326144,"data_stored":88326144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":92172288,"data_stored":92172288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":133304320,"data_stored":133304320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":133967872,"data_stored":133967872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":140910592,"data_stored":140910592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":134758400,"data_stored":134758400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":76656640,"data_stored":76656640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":19594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":21787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":10890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":36226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":34789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":22099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":42141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30994432,"data_stored":30993067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28897280,"data_stored":28895915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13168640,"data_stored":13167275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24117248,"data_stored":24117248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24702976,"data_stored":24701611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28311552,"data_stored":28311552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38334464,"data_stored":38333099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":30994432,"data_stored":30993067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:08:04.716 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:08:04.717 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:08:05.056 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:08:05.069 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-09-12T18:08:05.071 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":1411,"stamp":"2024-09-12T18:08:03.281802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":794521547,"num_objects":843,"num_object_clones":0,"num_object_copies":2160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":843,"num_whiteouts":0,"num_read":167731,"num_read_kb":2951399,"num_write":124121,"num_write_kb":2564852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14449,"ondisk_log_size":14449,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2540440,"kb_used_data":1283288,"kb_used_omap":12,"kb_used_meta":1257011,"kb_avail":752434280,"statfs":{"total":773094113280,"available":770492702720,"internally_reserved":0,"allocated":1314086912,"data_stored":1298157592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1287179826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005475"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.634310+0000","last_change":"2024-09-12T17:57:00.464809+0000","last_active":"2024-09-12T18:04:29.634310+0000","last_peered":"2024-09-12T18:04:29.634310+0000","last_clean":"2024-09-12T18:04:29.634310+0000","last_became_active":"2024-09-12T17:57:00.464331+0000","last_became_peered":"2024-09-12T17:57:00.464331+0000","last_unstale":"2024-09-12T18:04:29.634310+0000","last_undegraded":"2024-09-12T18:04:29.634310+0000","last_fullsized":"2024-09-12T18:04:29.634310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:20.663580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.631990+0000","last_change":"2024-09-12T17:46:45.211816+0000","last_active":"2024-09-12T18:04:14.631990+0000","last_peered":"2024-09-12T18:04:14.631990+0000","last_clean":"2024-09-12T18:04:14.631990+0000","last_became_active":"2024-09-12T17:46:45.211533+0000","last_became_peered":"2024-09-12T17:46:45.211533+0000","last_unstale":"2024-09-12T18:04:14.631990+0000","last_undegraded":"2024-09-12T18:04:14.631990+0000","last_fullsized":"2024-09-12T18:04:14.631990+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:29.748663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519223+0000","last_change":"2024-09-12T17:46:42.179842+0000","last_active":"2024-09-12T18:04:14.519223+0000","last_peered":"2024-09-12T18:04:14.519223+0000","last_clean":"2024-09-12T18:04:14.519223+0000","last_became_active":"2024-09-12T17:46:42.179372+0000","last_became_peered":"2024-09-12T17:46:42.179372+0000","last_unstale":"2024-09-12T18:04:14.519223+0000","last_undegraded":"2024-09-12T18:04:14.519223+0000","last_fullsized":"2024-09-12T18:04:14.519223+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:29.561145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6875819,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6715,"num_write":3,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'32","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.172145+0000","last_change":"2024-09-12T17:45:03.890371+0000","last_active":"2024-09-12T18:05:55.172145+0000","last_peered":"2024-09-12T18:05:55.172145+0000","last_clean":"2024-09-12T18:05:55.172145+0000","last_became_active":"2024-09-12T17:45:03.890104+0000","last_became_peered":"2024-09-12T17:45:03.890104+0000","last_unstale":"2024-09-12T18:05:55.172145+0000","last_undegraded":"2024-09-12T18:05:55.172145+0000","last_fullsized":"2024-09-12T18:05:55.172145+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:20.406460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":111,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.637454+0000","last_change":"2024-09-12T17:57:00.466568+0000","last_active":"2024-09-12T18:04:29.637454+0000","last_peered":"2024-09-12T18:04:29.637454+0000","last_clean":"2024-09-12T18:04:29.637454+0000","last_became_active":"2024-09-12T17:57:00.466304+0000","last_became_peered":"2024-09-12T17:57:00.466304+0000","last_unstale":"2024-09-12T18:04:29.637454+0000","last_undegraded":"2024-09-12T18:04:29.637454+0000","last_fullsized":"2024-09-12T18:04:29.637454+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:52.603747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508649+0000","last_change":"2024-09-12T17:46:45.202607+0000","last_active":"2024-09-12T18:04:14.508649+0000","last_peered":"2024-09-12T18:04:14.508649+0000","last_clean":"2024-09-12T18:04:14.508649+0000","last_became_active":"2024-09-12T17:46:45.202290+0000","last_became_peered":"2024-09-12T17:46:45.202290+0000","last_unstale":"2024-09-12T18:04:14.508649+0000","last_undegraded":"2024-09-12T18:04:14.508649+0000","last_fullsized":"2024-09-12T18:04:14.508649+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:30.467678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.636351+0000","last_change":"2024-09-12T17:46:42.177978+0000","last_active":"2024-09-12T18:04:14.636351+0000","last_peered":"2024-09-12T18:04:14.636351+0000","last_clean":"2024-09-12T18:04:14.636351+0000","last_became_active":"2024-09-12T17:46:42.177112+0000","last_became_peered":"2024-09-12T17:46:42.177112+0000","last_unstale":"2024-09-12T18:04:14.636351+0000","last_undegraded":"2024-09-12T18:04:14.636351+0000","last_fullsized":"2024-09-12T18:04:14.636351+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:37.077362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11070123,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":10811,"num_write":15,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'16","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.642269+0000","last_change":"2024-09-12T17:45:03.893271+0000","last_active":"2024-09-12T18:05:04.642269+0000","last_peered":"2024-09-12T18:05:04.642269+0000","last_clean":"2024-09-12T18:05:04.642269+0000","last_became_active":"2024-09-12T17:45:03.893002+0000","last_became_peered":"2024-09-12T17:45:03.893002+0000","last_unstale":"2024-09-12T18:05:04.642269+0000","last_undegraded":"2024-09-12T18:05:04.642269+0000","last_fullsized":"2024-09-12T18:05:04.642269+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:22.163418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508520+0000","last_change":"2024-09-12T17:57:00.457762+0000","last_active":"2024-09-12T18:04:14.508520+0000","last_peered":"2024-09-12T18:04:14.508520+0000","last_clean":"2024-09-12T18:04:14.508520+0000","last_became_active":"2024-09-12T17:57:00.456939+0000","last_became_peered":"2024-09-12T17:57:00.456939+0000","last_unstale":"2024-09-12T18:04:14.508520+0000","last_undegraded":"2024-09-12T18:04:14.508520+0000","last_fullsized":"2024-09-12T18:04:14.508520+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:16.042163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648157+0000","last_change":"2024-09-12T17:46:45.537660+0000","last_active":"2024-09-12T18:05:29.648157+0000","last_peered":"2024-09-12T18:05:29.648157+0000","last_clean":"2024-09-12T18:05:29.648157+0000","last_became_active":"2024-09-12T17:46:45.536920+0000","last_became_peered":"2024-09-12T17:46:45.536920+0000","last_unstale":"2024-09-12T18:05:29.648157+0000","last_undegraded":"2024-09-12T18:05:29.648157+0000","last_fullsized":"2024-09-12T18:05:29.648157+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.487169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639526+0000","last_change":"2024-09-12T17:46:42.186263+0000","last_active":"2024-09-12T18:04:44.639526+0000","last_peered":"2024-09-12T18:04:44.639526+0000","last_clean":"2024-09-12T18:04:44.639526+0000","last_became_active":"2024-09-12T17:46:42.185870+0000","last_became_peered":"2024-09-12T17:46:42.185870+0000","last_unstale":"2024-09-12T18:04:44.639526+0000","last_undegraded":"2024-09-12T18:04:44.639526+0000","last_fullsized":"2024-09-12T18:04:44.639526+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:49.932340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'49","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644429+0000","last_change":"2024-09-12T17:45:03.895036+0000","last_active":"2024-09-12T18:05:04.644429+0000","last_peered":"2024-09-12T18:05:04.644429+0000","last_clean":"2024-09-12T18:05:04.644429+0000","last_became_active":"2024-09-12T17:45:03.894537+0000","last_became_peered":"2024-09-12T17:45:03.894537+0000","last_unstale":"2024-09-12T18:05:04.644429+0000","last_undegraded":"2024-09-12T18:05:04.644429+0000","last_fullsized":"2024-09-12T18:05:04.644429+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:15.446699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":186,"num_write":90,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:19.519960+0000","last_change":"2024-09-12T17:57:00.465664+0000","last_active":"2024-09-12T18:04:19.519960+0000","last_peered":"2024-09-12T18:04:19.519960+0000","last_clean":"2024-09-12T18:04:19.519960+0000","last_became_active":"2024-09-12T17:57:00.464157+0000","last_became_peered":"2024-09-12T17:57:00.464157+0000","last_unstale":"2024-09-12T18:04:19.519960+0000","last_undegraded":"2024-09-12T18:04:19.519960+0000","last_fullsized":"2024-09-12T18:04:19.519960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:27.777117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.524896+0000","last_change":"2024-09-12T17:46:45.538613+0000","last_active":"2024-09-12T18:04:49.524896+0000","last_peered":"2024-09-12T18:04:49.524896+0000","last_clean":"2024-09-12T18:04:49.524896+0000","last_became_active":"2024-09-12T17:46:45.538295+0000","last_became_peered":"2024-09-12T17:46:45.538295+0000","last_unstale":"2024-09-12T18:04:49.524896+0000","last_undegraded":"2024-09-12T18:04:49.524896+0000","last_fullsized":"2024-09-12T18:04:49.524896+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:12.638632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519162+0000","last_change":"2024-09-12T17:46:42.184099+0000","last_active":"2024-09-12T18:05:29.519162+0000","last_peered":"2024-09-12T18:05:29.519162+0000","last_clean":"2024-09-12T18:05:29.519162+0000","last_became_active":"2024-09-12T17:46:42.183792+0000","last_became_peered":"2024-09-12T17:46:42.183792+0000","last_unstale":"2024-09-12T18:05:29.519162+0000","last_undegraded":"2024-09-12T18:05:29.519162+0000","last_fullsized":"2024-09-12T18:05:29.519162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:38.522171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'18","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527497+0000","last_change":"2024-09-12T17:45:03.893407+0000","last_active":"2024-09-12T18:05:04.527497+0000","last_peered":"2024-09-12T18:05:04.527497+0000","last_clean":"2024-09-12T18:05:04.527497+0000","last_became_active":"2024-09-12T17:45:03.893108+0000","last_became_peered":"2024-09-12T17:45:03.893108+0000","last_unstale":"2024-09-12T18:05:04.527497+0000","last_undegraded":"2024-09-12T18:05:04.527497+0000","last_fullsized":"2024-09-12T18:05:04.527497+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:43.333855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":71,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527532+0000","last_change":"2024-09-12T17:57:00.463065+0000","last_active":"2024-09-12T18:05:04.527532+0000","last_peered":"2024-09-12T18:05:04.527532+0000","last_clean":"2024-09-12T18:05:04.527532+0000","last_became_active":"2024-09-12T17:57:00.462657+0000","last_became_peered":"2024-09-12T17:57:00.462657+0000","last_unstale":"2024-09-12T18:05:04.527532+0000","last_undegraded":"2024-09-12T18:05:04.527532+0000","last_fullsized":"2024-09-12T18:05:04.527532+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:24.423220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.627036+0000","last_change":"2024-09-12T17:46:45.210708+0000","last_active":"2024-09-12T18:03:44.627036+0000","last_peered":"2024-09-12T18:03:44.627036+0000","last_clean":"2024-09-12T18:03:44.627036+0000","last_became_active":"2024-09-12T17:46:45.210259+0000","last_became_peered":"2024-09-12T17:46:45.210259+0000","last_unstale":"2024-09-12T18:03:44.627036+0000","last_undegraded":"2024-09-12T18:03:44.627036+0000","last_fullsized":"2024-09-12T18:03:44.627036+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:01.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6189,"num_write":3,"num_write_kb":3117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.630954+0000","last_change":"2024-09-12T17:46:42.179361+0000","last_active":"2024-09-12T18:03:39.630954+0000","last_peered":"2024-09-12T18:03:39.630954+0000","last_clean":"2024-09-12T18:03:39.630954+0000","last_became_active":"2024-09-12T17:46:42.178782+0000","last_became_peered":"2024-09-12T17:46:42.178782+0000","last_unstale":"2024-09-12T18:03:39.630954+0000","last_undegraded":"2024-09-12T18:03:39.630954+0000","last_fullsized":"2024-09-12T18:03:39.630954+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:21.705278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'101","reported_seq":355,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.903517+0000","last_change":"2024-09-12T17:45:03.899922+0000","last_active":"2024-09-12T18:05:56.903517+0000","last_peered":"2024-09-12T18:05:56.903517+0000","last_clean":"2024-09-12T18:05:56.903517+0000","last_became_active":"2024-09-12T17:45:03.899635+0000","last_became_peered":"2024-09-12T17:45:03.899635+0000","last_unstale":"2024-09-12T18:05:56.903517+0000","last_undegraded":"2024-09-12T18:05:56.903517+0000","last_fullsized":"2024-09-12T18:05:56.903517+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:27.634887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":455,"num_write":132,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646813+0000","last_change":"2024-09-12T17:57:00.462866+0000","last_active":"2024-09-12T18:05:19.646813+0000","last_peered":"2024-09-12T18:05:19.646813+0000","last_clean":"2024-09-12T18:05:19.646813+0000","last_became_active":"2024-09-12T17:57:00.462532+0000","last_became_peered":"2024-09-12T17:57:00.462532+0000","last_unstale":"2024-09-12T18:05:19.646813+0000","last_undegraded":"2024-09-12T18:05:19.646813+0000","last_fullsized":"2024-09-12T18:05:19.646813+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:39.678951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.503221+0000","last_change":"2024-09-12T17:47:29.324227+0000","last_active":"2024-09-12T18:03:39.503221+0000","last_peered":"2024-09-12T18:03:39.503221+0000","last_clean":"2024-09-12T18:03:39.503221+0000","last_became_active":"2024-09-12T17:47:29.305275+0000","last_became_peered":"2024-09-12T17:47:29.305275+0000","last_unstale":"2024-09-12T18:03:39.503221+0000","last_undegraded":"2024-09-12T18:03:39.503221+0000","last_fullsized":"2024-09-12T18:03:39.503221+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:21.892809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.504106+0000","last_change":"2024-09-12T17:46:42.183120+0000","last_active":"2024-09-12T18:03:44.504106+0000","last_peered":"2024-09-12T18:03:44.504106+0000","last_clean":"2024-09-12T18:03:44.504106+0000","last_became_active":"2024-09-12T17:46:42.182797+0000","last_became_peered":"2024-09-12T17:46:42.182797+0000","last_unstale":"2024-09-12T18:03:44.504106+0000","last_undegraded":"2024-09-12T18:03:44.504106+0000","last_fullsized":"2024-09-12T18:03:44.504106+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:02.336324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.192756+0000","last_change":"2024-09-12T17:45:03.900065+0000","last_active":"2024-09-12T18:05:57.192756+0000","last_peered":"2024-09-12T18:05:57.192756+0000","last_clean":"2024-09-12T18:05:57.192756+0000","last_became_active":"2024-09-12T17:45:03.899684+0000","last_became_peered":"2024-09-12T17:45:03.899684+0000","last_unstale":"2024-09-12T18:05:57.192756+0000","last_undegraded":"2024-09-12T18:05:57.192756+0000","last_fullsized":"2024-09-12T18:05:57.192756+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:45.656746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.676639+0000","last_change":"2024-09-12T17:57:00.464844+0000","last_active":"2024-09-12T18:04:29.676639+0000","last_peered":"2024-09-12T18:04:29.676639+0000","last_clean":"2024-09-12T18:04:29.676639+0000","last_became_active":"2024-09-12T17:57:00.464581+0000","last_became_peered":"2024-09-12T17:57:00.464581+0000","last_unstale":"2024-09-12T18:04:29.676639+0000","last_undegraded":"2024-09-12T18:04:29.676639+0000","last_fullsized":"2024-09-12T18:04:29.676639+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:41.808967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508601+0000","last_change":"2024-09-12T17:46:45.208867+0000","last_active":"2024-09-12T18:04:14.508601+0000","last_peered":"2024-09-12T18:04:14.508601+0000","last_clean":"2024-09-12T18:04:14.508601+0000","last_became_active":"2024-09-12T17:46:45.208580+0000","last_became_peered":"2024-09-12T17:46:45.208580+0000","last_unstale":"2024-09-12T18:04:14.508601+0000","last_undegraded":"2024-09-12T18:04:14.508601+0000","last_fullsized":"2024-09-12T18:04:14.508601+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:28.654102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508572+0000","last_change":"2024-09-12T17:46:42.182258+0000","last_active":"2024-09-12T18:04:14.508572+0000","last_peered":"2024-09-12T18:04:14.508572+0000","last_clean":"2024-09-12T18:04:14.508572+0000","last_became_active":"2024-09-12T17:46:42.181972+0000","last_became_peered":"2024-09-12T17:46:42.181972+0000","last_unstale":"2024-09-12T18:04:14.508572+0000","last_undegraded":"2024-09-12T18:04:14.508572+0000","last_fullsized":"2024-09-12T18:04:14.508572+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:16.906107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637435+0000","last_change":"2024-09-12T17:45:03.900188+0000","last_active":"2024-09-12T18:04:24.637435+0000","last_peered":"2024-09-12T18:04:24.637435+0000","last_clean":"2024-09-12T18:04:24.637435+0000","last_became_active":"2024-09-12T17:45:03.899876+0000","last_became_peered":"2024-09-12T17:45:03.899876+0000","last_unstale":"2024-09-12T18:04:24.637435+0000","last_undegraded":"2024-09-12T18:04:24.637435+0000","last_fullsized":"2024-09-12T18:04:24.637435+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:14.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.676688+0000","last_change":"2024-09-12T17:57:00.467655+0000","last_active":"2024-09-12T18:04:29.676688+0000","last_peered":"2024-09-12T18:04:29.676688+0000","last_clean":"2024-09-12T18:04:29.676688+0000","last_became_active":"2024-09-12T17:57:00.467385+0000","last_became_peered":"2024-09-12T17:57:00.467385+0000","last_unstale":"2024-09-12T18:04:29.676688+0000","last_undegraded":"2024-09-12T18:04:29.676688+0000","last_fullsized":"2024-09-12T18:04:29.676688+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:10.181468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519179+0000","last_change":"2024-09-12T17:46:45.206159+0000","last_active":"2024-09-12T18:04:14.519179+0000","last_peered":"2024-09-12T18:04:14.519179+0000","last_clean":"2024-09-12T18:04:14.519179+0000","last_became_active":"2024-09-12T17:46:45.205742+0000","last_became_peered":"2024-09-12T17:46:45.205742+0000","last_unstale":"2024-09-12T18:04:14.519179+0000","last_undegraded":"2024-09-12T18:04:14.519179+0000","last_fullsized":"2024-09-12T18:04:14.519179+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:07.179448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.635933+0000","last_change":"2024-09-12T17:46:42.175938+0000","last_active":"2024-09-12T18:04:14.635933+0000","last_peered":"2024-09-12T18:04:14.635933+0000","last_clean":"2024-09-12T18:04:14.635933+0000","last_became_active":"2024-09-12T17:46:42.175501+0000","last_became_peered":"2024-09-12T17:46:42.175501+0000","last_unstale":"2024-09-12T18:04:14.635933+0000","last_undegraded":"2024-09-12T18:04:14.635933+0000","last_fullsized":"2024-09-12T18:04:14.635933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:32.128694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":9,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637725+0000","last_change":"2024-09-12T17:45:03.895224+0000","last_active":"2024-09-12T18:04:24.637725+0000","last_peered":"2024-09-12T18:04:24.637725+0000","last_clean":"2024-09-12T18:04:24.637725+0000","last_became_active":"2024-09-12T17:45:03.894942+0000","last_became_peered":"2024-09-12T17:45:03.894942+0000","last_unstale":"2024-09-12T18:04:24.637725+0000","last_undegraded":"2024-09-12T18:04:24.637725+0000","last_fullsized":"2024-09-12T18:04:24.637725+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:52.737392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.634058+0000","last_change":"2024-09-12T17:57:00.463459+0000","last_active":"2024-09-12T18:03:59.634058+0000","last_peered":"2024-09-12T18:03:59.634058+0000","last_clean":"2024-09-12T18:03:59.634058+0000","last_became_active":"2024-09-12T17:57:00.463134+0000","last_became_peered":"2024-09-12T17:57:00.463134+0000","last_unstale":"2024-09-12T18:03:59.634058+0000","last_undegraded":"2024-09-12T18:03:59.634058+0000","last_fullsized":"2024-09-12T18:03:59.634058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:21.197817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.514362+0000","last_change":"2024-09-12T17:46:45.536892+0000","last_active":"2024-09-12T18:03:39.514362+0000","last_peered":"2024-09-12T18:03:39.514362+0000","last_clean":"2024-09-12T18:03:39.514362+0000","last_became_active":"2024-09-12T17:46:45.536581+0000","last_became_peered":"2024-09-12T17:46:45.536581+0000","last_unstale":"2024-09-12T18:03:39.514362+0000","last_undegraded":"2024-09-12T18:03:39.514362+0000","last_fullsized":"2024-09-12T18:03:39.514362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:18.649337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.643082+0000","last_change":"2024-09-12T17:46:42.180809+0000","last_active":"2024-09-12T18:05:29.643082+0000","last_peered":"2024-09-12T18:05:29.643082+0000","last_clean":"2024-09-12T18:05:29.643082+0000","last_became_active":"2024-09-12T17:46:42.179981+0000","last_became_peered":"2024-09-12T17:46:42.179981+0000","last_unstale":"2024-09-12T18:05:29.643082+0000","last_undegraded":"2024-09-12T18:05:29.643082+0000","last_fullsized":"2024-09-12T18:05:29.643082+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:19.357865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.810540+0000","last_change":"2024-09-12T17:45:03.892892+0000","last_active":"2024-09-12T18:05:30.810540+0000","last_peered":"2024-09-12T18:05:30.810540+0000","last_clean":"2024-09-12T18:05:30.810540+0000","last_became_active":"2024-09-12T17:45:03.892625+0000","last_became_peered":"2024-09-12T17:45:03.892625+0000","last_unstale":"2024-09-12T18:05:30.810540+0000","last_undegraded":"2024-09-12T18:05:30.810540+0000","last_fullsized":"2024-09-12T18:05:30.810540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:58.968922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.633098+0000","last_change":"2024-09-12T17:57:00.461660+0000","last_active":"2024-09-12T18:03:59.633098+0000","last_peered":"2024-09-12T18:03:59.633098+0000","last_clean":"2024-09-12T18:03:59.633098+0000","last_became_active":"2024-09-12T17:57:00.461347+0000","last_became_peered":"2024-09-12T17:57:00.461347+0000","last_unstale":"2024-09-12T18:03:59.633098+0000","last_undegraded":"2024-09-12T18:03:59.633098+0000","last_fullsized":"2024-09-12T18:03:59.633098+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:19.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.534906+0000","last_change":"2024-09-12T17:46:45.537765+0000","last_active":"2024-09-12T18:05:29.534906+0000","last_peered":"2024-09-12T18:05:29.534906+0000","last_clean":"2024-09-12T18:05:29.534906+0000","last_became_active":"2024-09-12T17:46:45.537463+0000","last_became_peered":"2024-09-12T17:46:45.537463+0000","last_unstale":"2024-09-12T18:05:29.534906+0000","last_undegraded":"2024-09-12T18:05:29.534906+0000","last_fullsized":"2024-09-12T18:05:29.534906+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:28.915955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.668771+0000","last_change":"2024-09-12T17:46:42.181302+0000","last_active":"2024-09-12T18:03:39.668771+0000","last_peered":"2024-09-12T18:03:39.668771+0000","last_clean":"2024-09-12T18:03:39.668771+0000","last_became_active":"2024-09-12T17:46:42.178809+0000","last_became_peered":"2024-09-12T17:46:42.178809+0000","last_unstale":"2024-09-12T18:03:39.668771+0000","last_undegraded":"2024-09-12T18:03:39.668771+0000","last_fullsized":"2024-09-12T18:03:39.668771+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:58.601763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'40","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.520902+0000","last_change":"2024-09-12T17:45:03.892705+0000","last_active":"2024-09-12T18:04:24.520902+0000","last_peered":"2024-09-12T18:04:24.520902+0000","last_clean":"2024-09-12T18:04:24.520902+0000","last_became_active":"2024-09-12T17:45:03.892417+0000","last_became_peered":"2024-09-12T17:45:03.892417+0000","last_unstale":"2024-09-12T18:04:24.520902+0000","last_undegraded":"2024-09-12T18:04:24.520902+0000","last_fullsized":"2024-09-12T18:04:24.520902+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:19.505017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":139,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.671898+0000","last_change":"2024-09-12T17:57:00.463497+0000","last_active":"2024-09-12T18:03:59.671898+0000","last_peered":"2024-09-12T18:03:59.671898+0000","last_clean":"2024-09-12T18:03:59.671898+0000","last_became_active":"2024-09-12T17:57:00.463245+0000","last_became_peered":"2024-09-12T17:57:00.463245+0000","last_unstale":"2024-09-12T18:03:59.671898+0000","last_undegraded":"2024-09-12T18:03:59.671898+0000","last_fullsized":"2024-09-12T18:03:59.671898+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:38.750487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.514393+0000","last_change":"2024-09-12T17:46:45.538651+0000","last_active":"2024-09-12T18:03:39.514393+0000","last_peered":"2024-09-12T18:03:39.514393+0000","last_clean":"2024-09-12T18:03:39.514393+0000","last_became_active":"2024-09-12T17:46:45.538337+0000","last_became_peered":"2024-09-12T17:46:45.538337+0000","last_unstale":"2024-09-12T18:03:39.514393+0000","last_undegraded":"2024-09-12T18:03:39.514393+0000","last_fullsized":"2024-09-12T18:03:39.514393+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:48.298979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.630162+0000","last_change":"2024-09-12T17:46:42.183384+0000","last_active":"2024-09-12T18:03:39.630162+0000","last_peered":"2024-09-12T18:03:39.630162+0000","last_clean":"2024-09-12T18:03:39.630162+0000","last_became_active":"2024-09-12T17:46:42.183098+0000","last_became_peered":"2024-09-12T17:46:42.183098+0000","last_unstale":"2024-09-12T18:03:39.630162+0000","last_undegraded":"2024-09-12T18:03:39.630162+0000","last_fullsized":"2024-09-12T18:03:39.630162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:06.980322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'35","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.149147+0000","last_change":"2024-09-12T17:45:03.896813+0000","last_active":"2024-09-12T18:05:20.149147+0000","last_peered":"2024-09-12T18:05:20.149147+0000","last_clean":"2024-09-12T18:05:20.149147+0000","last_became_active":"2024-09-12T17:45:03.896299+0000","last_became_peered":"2024-09-12T17:45:03.896299+0000","last_unstale":"2024-09-12T18:05:20.149147+0000","last_undegraded":"2024-09-12T18:05:20.149147+0000","last_fullsized":"2024-09-12T18:05:20.149147+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:31.025568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":68,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.629360+0000","last_change":"2024-09-12T17:57:00.462016+0000","last_active":"2024-09-12T18:03:59.629360+0000","last_peered":"2024-09-12T18:03:59.629360+0000","last_clean":"2024-09-12T18:03:59.629360+0000","last_became_active":"2024-09-12T17:57:00.461706+0000","last_became_peered":"2024-09-12T17:57:00.461706+0000","last_unstale":"2024-09-12T18:03:59.629360+0000","last_undegraded":"2024-09-12T18:03:59.629360+0000","last_fullsized":"2024-09-12T18:03:59.629360+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:47.107872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.503300+0000","last_change":"2024-09-12T17:46:45.207863+0000","last_active":"2024-09-12T18:03:39.503300+0000","last_peered":"2024-09-12T18:03:39.503300+0000","last_clean":"2024-09-12T18:03:39.503300+0000","last_became_active":"2024-09-12T17:46:45.207610+0000","last_became_peered":"2024-09-12T17:46:45.207610+0000","last_unstale":"2024-09-12T18:03:39.503300+0000","last_undegraded":"2024-09-12T18:03:39.503300+0000","last_fullsized":"2024-09-12T18:03:39.503300+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:02.945511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.631136+0000","last_change":"2024-09-12T17:46:42.182800+0000","last_active":"2024-09-12T18:03:39.631136+0000","last_peered":"2024-09-12T18:03:39.631136+0000","last_clean":"2024-09-12T18:03:39.631136+0000","last_became_active":"2024-09-12T17:46:42.182412+0000","last_became_peered":"2024-09-12T17:46:42.182412+0000","last_unstale":"2024-09-12T18:03:39.631136+0000","last_undegraded":"2024-09-12T18:03:39.631136+0000","last_fullsized":"2024-09-12T18:03:39.631136+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:58.438274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'49","reported_seq":173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:28.740711+0000","last_change":"2024-09-12T17:45:03.900251+0000","last_active":"2024-09-12T18:05:28.740711+0000","last_peered":"2024-09-12T18:05:28.740711+0000","last_clean":"2024-09-12T18:05:28.740711+0000","last_became_active":"2024-09-12T17:45:03.899885+0000","last_became_peered":"2024-09-12T17:45:03.899885+0000","last_unstale":"2024-09-12T18:05:28.740711+0000","last_undegraded":"2024-09-12T18:05:28.740711+0000","last_fullsized":"2024-09-12T18:05:28.740711+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:29.712954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":167,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519268+0000","last_change":"2024-09-12T17:57:00.468941+0000","last_active":"2024-09-12T18:04:14.519268+0000","last_peered":"2024-09-12T18:04:14.519268+0000","last_clean":"2024-09-12T18:04:14.519268+0000","last_became_active":"2024-09-12T17:57:00.468592+0000","last_became_peered":"2024-09-12T17:57:00.468592+0000","last_unstale":"2024-09-12T18:04:14.519268+0000","last_undegraded":"2024-09-12T18:04:14.519268+0000","last_fullsized":"2024-09-12T18:04:14.519268+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:05.976634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647467+0000","last_change":"2024-09-12T17:46:45.210723+0000","last_active":"2024-09-12T18:05:24.647467+0000","last_peered":"2024-09-12T18:05:24.647467+0000","last_clean":"2024-09-12T18:05:24.647467+0000","last_became_active":"2024-09-12T17:46:45.210413+0000","last_became_peered":"2024-09-12T17:46:45.210413+0000","last_unstale":"2024-09-12T18:05:24.647467+0000","last_undegraded":"2024-09-12T18:05:24.647467+0000","last_fullsized":"2024-09-12T18:05:24.647467+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:35.068995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518445+0000","last_change":"2024-09-12T17:46:42.177074+0000","last_active":"2024-09-12T18:05:24.518445+0000","last_peered":"2024-09-12T18:05:24.518445+0000","last_clean":"2024-09-12T18:05:24.518445+0000","last_became_active":"2024-09-12T17:46:42.176505+0000","last_became_peered":"2024-09-12T17:46:42.176505+0000","last_unstale":"2024-09-12T18:05:24.518445+0000","last_undegraded":"2024-09-12T18:05:24.518445+0000","last_fullsized":"2024-09-12T18:05:24.518445+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:43.326678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.669496+0000","last_change":"2024-09-12T17:45:03.900017+0000","last_active":"2024-09-12T18:03:44.669496+0000","last_peered":"2024-09-12T18:03:44.669496+0000","last_clean":"2024-09-12T18:03:44.669496+0000","last_became_active":"2024-09-12T17:45:03.899726+0000","last_became_peered":"2024-09-12T17:45:03.899726+0000","last_unstale":"2024-09-12T18:03:44.669496+0000","last_undegraded":"2024-09-12T18:03:44.669496+0000","last_fullsized":"2024-09-12T18:03:44.669496+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:05.783642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.636058+0000","last_change":"2024-09-12T17:57:00.464086+0000","last_active":"2024-09-12T18:04:14.636058+0000","last_peered":"2024-09-12T18:04:14.636058+0000","last_clean":"2024-09-12T18:04:14.636058+0000","last_became_active":"2024-09-12T17:57:00.463766+0000","last_became_peered":"2024-09-12T17:57:00.463766+0000","last_unstale":"2024-09-12T18:04:14.636058+0000","last_undegraded":"2024-09-12T18:04:14.636058+0000","last_fullsized":"2024-09-12T18:04:14.636058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:28.897896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'6","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647409+0000","last_change":"2024-09-12T17:46:45.201582+0000","last_active":"2024-09-12T18:05:24.647409+0000","last_peered":"2024-09-12T18:05:24.647409+0000","last_clean":"2024-09-12T18:05:24.647409+0000","last_became_active":"2024-09-12T17:46:45.201278+0000","last_became_peered":"2024-09-12T17:46:45.201278+0000","last_unstale":"2024-09-12T18:05:24.647409+0000","last_undegraded":"2024-09-12T18:05:24.647409+0000","last_fullsized":"2024-09-12T18:05:24.647409+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:48.055531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":19456,"num_write":11,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'6","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534213+0000","last_change":"2024-09-12T17:46:42.182936+0000","last_active":"2024-09-12T18:05:24.534213+0000","last_peered":"2024-09-12T18:05:24.534213+0000","last_clean":"2024-09-12T18:05:24.534213+0000","last_became_active":"2024-09-12T17:46:42.182658+0000","last_became_peered":"2024-09-12T17:46:42.182658+0000","last_unstale":"2024-09-12T18:05:24.534213+0000","last_undegraded":"2024-09-12T18:05:24.534213+0000","last_fullsized":"2024-09-12T18:05:24.534213+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:02.557846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":16,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.277595+0000","last_change":"2024-09-12T17:45:03.891474+0000","last_active":"2024-09-12T18:05:09.277595+0000","last_peered":"2024-09-12T18:05:09.277595+0000","last_clean":"2024-09-12T18:05:09.277595+0000","last_became_active":"2024-09-12T17:45:03.891186+0000","last_became_peered":"2024-09-12T17:45:03.891186+0000","last_unstale":"2024-09-12T18:05:09.277595+0000","last_undegraded":"2024-09-12T18:05:09.277595+0000","last_fullsized":"2024-09-12T18:05:09.277595+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:08.125248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":128,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.633745+0000","last_change":"2024-09-12T17:57:00.465754+0000","last_active":"2024-09-12T18:03:59.633745+0000","last_peered":"2024-09-12T18:03:59.633745+0000","last_clean":"2024-09-12T18:03:59.633745+0000","last_became_active":"2024-09-12T17:57:00.464910+0000","last_became_peered":"2024-09-12T17:57:00.464910+0000","last_unstale":"2024-09-12T18:03:59.633745+0000","last_undegraded":"2024-09-12T18:03:59.633745+0000","last_fullsized":"2024-09-12T18:03:59.633745+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:15.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534265+0000","last_change":"2024-09-12T17:46:45.206745+0000","last_active":"2024-09-12T18:05:24.534265+0000","last_peered":"2024-09-12T18:05:24.534265+0000","last_clean":"2024-09-12T18:05:24.534265+0000","last_became_active":"2024-09-12T17:46:45.206402+0000","last_became_peered":"2024-09-12T17:46:45.206402+0000","last_unstale":"2024-09-12T18:05:24.534265+0000","last_undegraded":"2024-09-12T18:05:24.534265+0000","last_fullsized":"2024-09-12T18:05:24.534265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:55.547505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518486+0000","last_change":"2024-09-12T17:46:42.185043+0000","last_active":"2024-09-12T18:05:24.518486+0000","last_peered":"2024-09-12T18:05:24.518486+0000","last_clean":"2024-09-12T18:05:24.518486+0000","last_became_active":"2024-09-12T17:46:42.184760+0000","last_became_peered":"2024-09-12T17:46:42.184760+0000","last_unstale":"2024-09-12T18:05:24.518486+0000","last_undegraded":"2024-09-12T18:05:24.518486+0000","last_fullsized":"2024-09-12T18:05:24.518486+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:44.853687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'36","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.504092+0000","last_change":"2024-09-12T17:45:03.897900+0000","last_active":"2024-09-12T18:03:44.504092+0000","last_peered":"2024-09-12T18:03:44.504092+0000","last_clean":"2024-09-12T18:03:44.504092+0000","last_became_active":"2024-09-12T17:45:03.897616+0000","last_became_peered":"2024-09-12T17:45:03.897616+0000","last_unstale":"2024-09-12T18:03:44.504092+0000","last_undegraded":"2024-09-12T18:03:44.504092+0000","last_fullsized":"2024-09-12T18:03:44.504092+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:50.190493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":138,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519243+0000","last_change":"2024-09-12T17:57:00.464276+0000","last_active":"2024-09-12T18:04:14.519243+0000","last_peered":"2024-09-12T18:04:14.519243+0000","last_clean":"2024-09-12T18:04:14.519243+0000","last_became_active":"2024-09-12T17:57:00.463881+0000","last_became_peered":"2024-09-12T17:57:00.463881+0000","last_unstale":"2024-09-12T18:04:14.519243+0000","last_undegraded":"2024-09-12T18:04:14.519243+0000","last_fullsized":"2024-09-12T18:04:14.519243+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:03.028160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518466+0000","last_change":"2024-09-12T17:46:45.206370+0000","last_active":"2024-09-12T18:05:24.518466+0000","last_peered":"2024-09-12T18:05:24.518466+0000","last_clean":"2024-09-12T18:05:24.518466+0000","last_became_active":"2024-09-12T17:46:45.205987+0000","last_became_peered":"2024-09-12T17:46:45.205987+0000","last_unstale":"2024-09-12T18:05:24.518466+0000","last_undegraded":"2024-09-12T18:05:24.518466+0000","last_fullsized":"2024-09-12T18:05:24.518466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:04.606065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.642468+0000","last_change":"2024-09-12T17:46:42.180412+0000","last_active":"2024-09-12T18:05:24.642468+0000","last_peered":"2024-09-12T18:05:24.642468+0000","last_clean":"2024-09-12T18:05:24.642468+0000","last_became_active":"2024-09-12T17:46:42.178941+0000","last_became_peered":"2024-09-12T17:46:42.178941+0000","last_unstale":"2024-09-12T18:05:24.642468+0000","last_undegraded":"2024-09-12T18:05:24.642468+0000","last_fullsized":"2024-09-12T18:05:24.642468+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:53.889661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'33","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.633278+0000","last_change":"2024-09-12T17:45:03.893625+0000","last_active":"2024-09-12T18:05:19.633278+0000","last_peered":"2024-09-12T18:05:19.633278+0000","last_clean":"2024-09-12T18:05:19.633278+0000","last_became_active":"2024-09-12T17:45:03.893332+0000","last_became_peered":"2024-09-12T17:45:03.893332+0000","last_unstale":"2024-09-12T18:05:19.633278+0000","last_undegraded":"2024-09-12T18:05:19.633278+0000","last_fullsized":"2024-09-12T18:05:19.633278+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:59.606201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.646279+0000","last_change":"2024-09-12T17:57:00.461421+0000","last_active":"2024-09-12T18:05:39.646279+0000","last_peered":"2024-09-12T18:05:39.646279+0000","last_clean":"2024-09-12T18:05:39.646279+0000","last_became_active":"2024-09-12T17:57:00.461130+0000","last_became_peered":"2024-09-12T17:57:00.461130+0000","last_unstale":"2024-09-12T18:05:39.646279+0000","last_undegraded":"2024-09-12T18:05:39.646279+0000","last_fullsized":"2024-09-12T18:05:39.646279+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:49.944764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.524097+0000","last_change":"2024-09-12T17:46:45.208179+0000","last_active":"2024-09-12T18:04:44.524097+0000","last_peered":"2024-09-12T18:04:44.524097+0000","last_clean":"2024-09-12T18:04:44.524097+0000","last_became_active":"2024-09-12T17:46:45.207899+0000","last_became_peered":"2024-09-12T17:46:45.207899+0000","last_unstale":"2024-09-12T18:04:44.524097+0000","last_undegraded":"2024-09-12T18:04:44.524097+0000","last_fullsized":"2024-09-12T18:04:44.524097+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:40.530867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5827243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.679250+0000","last_change":"2024-09-12T17:46:42.178168+0000","last_active":"2024-09-12T18:04:44.679250+0000","last_peered":"2024-09-12T18:04:44.679250+0000","last_clean":"2024-09-12T18:04:44.679250+0000","last_became_active":"2024-09-12T17:46:42.177867+0000","last_became_peered":"2024-09-12T17:46:42.177867+0000","last_unstale":"2024-09-12T18:04:44.679250+0000","last_undegraded":"2024-09-12T18:04:44.679250+0000","last_fullsized":"2024-09-12T18:04:44.679250+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:40.404324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'22","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534323+0000","last_change":"2024-09-12T17:45:03.895504+0000","last_active":"2024-09-12T18:05:24.534323+0000","last_peered":"2024-09-12T18:05:24.534323+0000","last_clean":"2024-09-12T18:05:24.534323+0000","last_became_active":"2024-09-12T17:45:03.895229+0000","last_became_peered":"2024-09-12T17:45:03.895229+0000","last_unstale":"2024-09-12T18:05:24.534323+0000","last_undegraded":"2024-09-12T18:05:24.534323+0000","last_fullsized":"2024-09-12T18:05:24.534323+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:49.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.669484+0000","last_change":"2024-09-12T17:57:00.466936+0000","last_active":"2024-09-12T18:03:44.669484+0000","last_peered":"2024-09-12T18:03:44.669484+0000","last_clean":"2024-09-12T18:03:44.669484+0000","last_became_active":"2024-09-12T17:57:00.466328+0000","last_became_peered":"2024-09-12T17:57:00.466328+0000","last_unstale":"2024-09-12T18:03:44.669484+0000","last_undegraded":"2024-09-12T18:03:44.669484+0000","last_fullsized":"2024-09-12T18:03:44.669484+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:21.500416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.524062+0000","last_change":"2024-09-12T17:46:45.204918+0000","last_active":"2024-09-12T18:04:44.524062+0000","last_peered":"2024-09-12T18:04:44.524062+0000","last_clean":"2024-09-12T18:04:44.524062+0000","last_became_active":"2024-09-12T17:46:45.204628+0000","last_became_peered":"2024-09-12T17:46:45.204628+0000","last_unstale":"2024-09-12T18:04:44.524062+0000","last_undegraded":"2024-09-12T18:04:44.524062+0000","last_fullsized":"2024-09-12T18:04:44.524062+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:44.729741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639499+0000","last_change":"2024-09-12T17:46:42.183988+0000","last_active":"2024-09-12T18:04:44.639499+0000","last_peered":"2024-09-12T18:04:44.639499+0000","last_clean":"2024-09-12T18:04:44.639499+0000","last_became_active":"2024-09-12T17:46:42.183710+0000","last_became_peered":"2024-09-12T17:46:42.183710+0000","last_unstale":"2024-09-12T18:04:44.639499+0000","last_undegraded":"2024-09-12T18:04:44.639499+0000","last_fullsized":"2024-09-12T18:04:44.639499+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:52.515375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'20","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.641966+0000","last_change":"2024-09-12T17:45:03.897931+0000","last_active":"2024-09-12T18:05:19.641966+0000","last_peered":"2024-09-12T18:05:19.641966+0000","last_clean":"2024-09-12T18:05:19.641966+0000","last_became_active":"2024-09-12T17:45:03.897609+0000","last_became_peered":"2024-09-12T17:45:03.897609+0000","last_unstale":"2024-09-12T18:05:19.641966+0000","last_undegraded":"2024-09-12T18:05:19.641966+0000","last_fullsized":"2024-09-12T18:05:19.641966+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:57.004403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.520491+0000","last_change":"2024-09-12T17:57:00.459052+0000","last_active":"2024-09-12T18:05:39.520491+0000","last_peered":"2024-09-12T18:05:39.520491+0000","last_clean":"2024-09-12T18:05:39.520491+0000","last_became_active":"2024-09-12T17:57:00.458777+0000","last_became_peered":"2024-09-12T17:57:00.458777+0000","last_unstale":"2024-09-12T18:05:39.520491+0000","last_undegraded":"2024-09-12T18:05:39.520491+0000","last_fullsized":"2024-09-12T18:05:39.520491+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:12.952038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640853+0000","last_change":"2024-09-12T17:46:45.537482+0000","last_active":"2024-09-12T18:04:44.640853+0000","last_peered":"2024-09-12T18:04:44.640853+0000","last_clean":"2024-09-12T18:04:44.640853+0000","last_became_active":"2024-09-12T17:46:45.536980+0000","last_became_peered":"2024-09-12T17:46:45.536980+0000","last_unstale":"2024-09-12T18:04:44.640853+0000","last_undegraded":"2024-09-12T18:04:44.640853+0000","last_fullsized":"2024-09-12T18:04:44.640853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:14.427774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640687+0000","last_change":"2024-09-12T17:46:42.180818+0000","last_active":"2024-09-12T18:04:44.640687+0000","last_peered":"2024-09-12T18:04:44.640687+0000","last_clean":"2024-09-12T18:04:44.640687+0000","last_became_active":"2024-09-12T17:46:42.180565+0000","last_became_peered":"2024-09-12T17:46:42.180565+0000","last_unstale":"2024-09-12T18:04:44.640687+0000","last_undegraded":"2024-09-12T18:04:44.640687+0000","last_fullsized":"2024-09-12T18:04:44.640687+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:16.219991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'33","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517834+0000","last_change":"2024-09-12T17:45:03.892503+0000","last_active":"2024-09-12T18:05:19.517834+0000","last_peered":"2024-09-12T18:05:19.517834+0000","last_clean":"2024-09-12T18:05:19.517834+0000","last_became_active":"2024-09-12T17:45:03.892226+0000","last_became_peered":"2024-09-12T17:45:03.892226+0000","last_unstale":"2024-09-12T18:05:19.517834+0000","last_undegraded":"2024-09-12T18:05:19.517834+0000","last_fullsized":"2024-09-12T18:05:19.517834+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:41.497858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":124,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.687364+0000","last_change":"2024-09-12T17:57:00.464984+0000","last_active":"2024-09-12T18:05:39.687364+0000","last_peered":"2024-09-12T18:05:39.687364+0000","last_clean":"2024-09-12T18:05:39.687364+0000","last_became_active":"2024-09-12T17:57:00.464707+0000","last_became_peered":"2024-09-12T17:57:00.464707+0000","last_unstale":"2024-09-12T18:05:39.687364+0000","last_undegraded":"2024-09-12T18:05:39.687364+0000","last_fullsized":"2024-09-12T18:05:39.687364+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:25.768696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.524117+0000","last_change":"2024-09-12T17:46:45.205067+0000","last_active":"2024-09-12T18:04:44.524117+0000","last_peered":"2024-09-12T18:04:44.524117+0000","last_clean":"2024-09-12T18:04:44.524117+0000","last_became_active":"2024-09-12T17:46:45.204759+0000","last_became_peered":"2024-09-12T17:46:45.204759+0000","last_unstale":"2024-09-12T18:04:44.524117+0000","last_undegraded":"2024-09-12T18:04:44.524117+0000","last_fullsized":"2024-09-12T18:04:44.524117+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:47.314625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640815+0000","last_change":"2024-09-12T17:46:42.183190+0000","last_active":"2024-09-12T18:04:44.640815+0000","last_peered":"2024-09-12T18:04:44.640815+0000","last_clean":"2024-09-12T18:04:44.640815+0000","last_became_active":"2024-09-12T17:46:42.182805+0000","last_became_peered":"2024-09-12T17:46:42.182805+0000","last_unstale":"2024-09-12T18:04:44.640815+0000","last_undegraded":"2024-09-12T18:04:44.640815+0000","last_fullsized":"2024-09-12T18:04:44.640815+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:54.005006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'42","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.643914+0000","last_change":"2024-09-12T17:45:03.898048+0000","last_active":"2024-09-12T18:05:19.643914+0000","last_peered":"2024-09-12T18:05:19.643914+0000","last_clean":"2024-09-12T18:05:19.643914+0000","last_became_active":"2024-09-12T17:45:03.897752+0000","last_became_peered":"2024-09-12T17:45:03.897752+0000","last_unstale":"2024-09-12T18:05:19.643914+0000","last_undegraded":"2024-09-12T18:05:19.643914+0000","last_fullsized":"2024-09-12T18:05:19.643914+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:59.048003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":75,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.515086+0000","last_change":"2024-09-12T17:57:00.469400+0000","last_active":"2024-09-12T18:03:44.515086+0000","last_peered":"2024-09-12T18:03:44.515086+0000","last_clean":"2024-09-12T18:03:44.515086+0000","last_became_active":"2024-09-12T17:57:00.469072+0000","last_became_peered":"2024-09-12T17:57:00.469072+0000","last_unstale":"2024-09-12T18:03:44.515086+0000","last_undegraded":"2024-09-12T18:03:44.515086+0000","last_fullsized":"2024-09-12T18:03:44.515086+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:37.442197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.507138+0000","last_change":"2024-09-12T17:46:45.203169+0000","last_active":"2024-09-12T18:04:04.507138+0000","last_peered":"2024-09-12T18:04:04.507138+0000","last_clean":"2024-09-12T18:04:04.507138+0000","last_became_active":"2024-09-12T17:46:45.202892+0000","last_became_peered":"2024-09-12T17:46:45.202892+0000","last_unstale":"2024-09-12T18:04:04.507138+0000","last_undegraded":"2024-09-12T18:04:04.507138+0000","last_fullsized":"2024-09-12T18:04:04.507138+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:50.179992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634333+0000","last_change":"2024-09-12T17:46:42.179076+0000","last_active":"2024-09-12T18:04:04.634333+0000","last_peered":"2024-09-12T18:04:04.634333+0000","last_clean":"2024-09-12T18:04:04.634333+0000","last_became_active":"2024-09-12T17:46:42.178411+0000","last_became_peered":"2024-09-12T17:46:42.178411+0000","last_unstale":"2024-09-12T18:04:04.634333+0000","last_undegraded":"2024-09-12T18:04:04.634333+0000","last_fullsized":"2024-09-12T18:04:04.634333+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:26.191877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'24","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646723+0000","last_change":"2024-09-12T17:45:03.891655+0000","last_active":"2024-09-12T18:05:19.646723+0000","last_peered":"2024-09-12T18:05:19.646723+0000","last_clean":"2024-09-12T18:05:19.646723+0000","last_became_active":"2024-09-12T17:45:03.891369+0000","last_became_peered":"2024-09-12T17:45:03.891369+0000","last_unstale":"2024-09-12T18:05:19.646723+0000","last_undegraded":"2024-09-12T18:05:19.646723+0000","last_fullsized":"2024-09-12T18:05:19.646723+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:45.970204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.670237+0000","last_change":"2024-09-12T17:57:00.465652+0000","last_active":"2024-09-12T18:03:49.670237+0000","last_peered":"2024-09-12T18:03:49.670237+0000","last_clean":"2024-09-12T18:03:49.670237+0000","last_became_active":"2024-09-12T17:57:00.465360+0000","last_became_peered":"2024-09-12T17:57:00.465360+0000","last_unstale":"2024-09-12T18:03:49.670237+0000","last_undegraded":"2024-09-12T18:03:49.670237+0000","last_fullsized":"2024-09-12T18:03:49.670237+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:56.997962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.672845+0000","last_change":"2024-09-12T17:46:45.536369+0000","last_active":"2024-09-12T18:04:04.672845+0000","last_peered":"2024-09-12T18:04:04.672845+0000","last_clean":"2024-09-12T18:04:04.672845+0000","last_became_active":"2024-09-12T17:46:45.536056+0000","last_became_peered":"2024-09-12T17:46:45.536056+0000","last_unstale":"2024-09-12T18:04:04.672845+0000","last_undegraded":"2024-09-12T18:04:04.672845+0000","last_fullsized":"2024-09-12T18:04:04.672845+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:32.199489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634773+0000","last_change":"2024-09-12T17:46:42.183083+0000","last_active":"2024-09-12T18:04:04.634773+0000","last_peered":"2024-09-12T18:04:04.634773+0000","last_clean":"2024-09-12T18:04:04.634773+0000","last_became_active":"2024-09-12T17:46:42.182831+0000","last_became_peered":"2024-09-12T17:46:42.182831+0000","last_unstale":"2024-09-12T18:04:04.634773+0000","last_undegraded":"2024-09-12T18:04:04.634773+0000","last_fullsized":"2024-09-12T18:04:04.634773+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:04.590775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'86","reported_seq":281,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.623576+0000","last_change":"2024-09-12T17:45:03.893737+0000","last_active":"2024-09-12T18:05:20.623576+0000","last_peered":"2024-09-12T18:05:20.623576+0000","last_clean":"2024-09-12T18:05:20.623576+0000","last_became_active":"2024-09-12T17:45:03.893452+0000","last_became_peered":"2024-09-12T17:45:03.893452+0000","last_unstale":"2024-09-12T18:05:20.623576+0000","last_undegraded":"2024-09-12T18:05:20.623576+0000","last_fullsized":"2024-09-12T18:05:20.623576+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:29.372853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":321,"num_write":137,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.669517+0000","last_change":"2024-09-12T17:57:00.464389+0000","last_active":"2024-09-12T18:03:44.669517+0000","last_peered":"2024-09-12T18:03:44.669517+0000","last_clean":"2024-09-12T18:03:44.669517+0000","last_became_active":"2024-09-12T17:57:00.464068+0000","last_became_peered":"2024-09-12T17:57:00.464068+0000","last_unstale":"2024-09-12T18:03:44.669517+0000","last_undegraded":"2024-09-12T18:03:44.669517+0000","last_fullsized":"2024-09-12T18:03:44.669517+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:52.387690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640740+0000","last_change":"2024-09-12T17:46:45.206955+0000","last_active":"2024-09-12T18:04:44.640740+0000","last_peered":"2024-09-12T18:04:44.640740+0000","last_clean":"2024-09-12T18:04:44.640740+0000","last_became_active":"2024-09-12T17:46:45.206644+0000","last_became_peered":"2024-09-12T17:46:45.206644+0000","last_unstale":"2024-09-12T18:04:44.640740+0000","last_undegraded":"2024-09-12T18:04:44.640740+0000","last_fullsized":"2024-09-12T18:04:44.640740+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:01.211515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634414+0000","last_change":"2024-09-12T17:46:42.184536+0000","last_active":"2024-09-12T18:04:04.634414+0000","last_peered":"2024-09-12T18:04:04.634414+0000","last_clean":"2024-09-12T18:04:04.634414+0000","last_became_active":"2024-09-12T17:46:42.184232+0000","last_became_peered":"2024-09-12T17:46:42.184232+0000","last_unstale":"2024-09-12T18:04:04.634414+0000","last_undegraded":"2024-09-12T18:04:04.634414+0000","last_fullsized":"2024-09-12T18:04:04.634414+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:05.091740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.522427+0000","last_change":"2024-09-12T17:45:03.897167+0000","last_active":"2024-09-12T18:04:34.522427+0000","last_peered":"2024-09-12T18:04:34.522427+0000","last_clean":"2024-09-12T18:04:34.522427+0000","last_became_active":"2024-09-12T17:45:03.896663+0000","last_became_peered":"2024-09-12T17:45:03.896663+0000","last_unstale":"2024-09-12T18:04:34.522427+0000","last_undegraded":"2024-09-12T18:04:34.522427+0000","last_fullsized":"2024-09-12T18:04:34.522427+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:00.166379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.631728+0000","last_change":"2024-09-12T17:57:00.465893+0000","last_active":"2024-09-12T18:03:44.631728+0000","last_peered":"2024-09-12T18:03:44.631728+0000","last_clean":"2024-09-12T18:03:44.631728+0000","last_became_active":"2024-09-12T17:57:00.465596+0000","last_became_peered":"2024-09-12T17:57:00.465596+0000","last_unstale":"2024-09-12T18:03:44.631728+0000","last_undegraded":"2024-09-12T18:03:44.631728+0000","last_fullsized":"2024-09-12T18:03:44.631728+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:13.446382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.673723+0000","last_change":"2024-09-12T17:46:45.208374+0000","last_active":"2024-09-12T18:04:09.673723+0000","last_peered":"2024-09-12T18:04:09.673723+0000","last_clean":"2024-09-12T18:04:09.673723+0000","last_became_active":"2024-09-12T17:46:45.208019+0000","last_became_peered":"2024-09-12T17:46:45.208019+0000","last_unstale":"2024-09-12T18:04:09.673723+0000","last_undegraded":"2024-09-12T18:04:09.673723+0000","last_fullsized":"2024-09-12T18:04:09.673723+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:03.347779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.512748+0000","last_change":"2024-09-12T17:46:42.184553+0000","last_active":"2024-09-12T18:04:44.512748+0000","last_peered":"2024-09-12T18:04:44.512748+0000","last_clean":"2024-09-12T18:04:44.512748+0000","last_became_active":"2024-09-12T17:46:42.184250+0000","last_became_peered":"2024-09-12T17:46:42.184250+0000","last_unstale":"2024-09-12T18:04:44.512748+0000","last_undegraded":"2024-09-12T18:04:44.512748+0000","last_fullsized":"2024-09-12T18:04:44.512748+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:49.433698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'40","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.511355+0000","last_change":"2024-09-12T17:45:03.897601+0000","last_active":"2024-09-12T18:04:34.511355+0000","last_peered":"2024-09-12T18:04:34.511355+0000","last_clean":"2024-09-12T18:04:34.511355+0000","last_became_active":"2024-09-12T17:45:03.897291+0000","last_became_peered":"2024-09-12T17:45:03.897291+0000","last_unstale":"2024-09-12T18:04:34.511355+0000","last_undegraded":"2024-09-12T18:04:34.511355+0000","last_fullsized":"2024-09-12T18:04:34.511355+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:56.938763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.684325+0000","last_change":"2024-09-12T17:57:00.465725+0000","last_active":"2024-09-12T18:05:19.684325+0000","last_peered":"2024-09-12T18:05:19.684325+0000","last_clean":"2024-09-12T18:05:19.684325+0000","last_became_active":"2024-09-12T17:57:00.465454+0000","last_became_peered":"2024-09-12T17:57:00.465454+0000","last_unstale":"2024-09-12T18:05:19.684325+0000","last_undegraded":"2024-09-12T18:05:19.684325+0000","last_fullsized":"2024-09-12T18:05:19.684325+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.552904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648118+0000","last_change":"2024-09-12T17:46:45.207902+0000","last_active":"2024-09-12T18:05:29.648118+0000","last_peered":"2024-09-12T18:05:29.648118+0000","last_clean":"2024-09-12T18:05:29.648118+0000","last_became_active":"2024-09-12T17:46:45.207607+0000","last_became_peered":"2024-09-12T17:46:45.207607+0000","last_unstale":"2024-09-12T18:05:29.648118+0000","last_undegraded":"2024-09-12T18:05:29.648118+0000","last_fullsized":"2024-09-12T18:05:29.648118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:31.661695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.685860+0000","last_change":"2024-09-12T17:46:42.182625+0000","last_active":"2024-09-12T18:05:29.685860+0000","last_peered":"2024-09-12T18:05:29.685860+0000","last_clean":"2024-09-12T18:05:29.685860+0000","last_became_active":"2024-09-12T17:46:42.182267+0000","last_became_peered":"2024-09-12T17:46:42.182267+0000","last_unstale":"2024-09-12T18:05:29.685860+0000","last_undegraded":"2024-09-12T18:05:29.685860+0000","last_fullsized":"2024-09-12T18:05:29.685860+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:39.753698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'54","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.639121+0000","last_change":"2024-09-12T17:45:03.892593+0000","last_active":"2024-09-12T18:04:34.639121+0000","last_peered":"2024-09-12T18:04:34.639121+0000","last_clean":"2024-09-12T18:04:34.639121+0000","last_became_active":"2024-09-12T17:45:03.891861+0000","last_became_peered":"2024-09-12T17:45:03.891861+0000","last_unstale":"2024-09-12T18:04:34.639121+0000","last_undegraded":"2024-09-12T18:04:34.639121+0000","last_fullsized":"2024-09-12T18:04:34.639121+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:11.906724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":286,"num_read_kb":219,"num_write":84,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.641923+0000","last_change":"2024-09-12T17:57:00.467076+0000","last_active":"2024-09-12T18:05:19.641923+0000","last_peered":"2024-09-12T18:05:19.641923+0000","last_clean":"2024-09-12T18:05:19.641923+0000","last_became_active":"2024-09-12T17:57:00.466761+0000","last_became_peered":"2024-09-12T17:57:00.466761+0000","last_unstale":"2024-09-12T18:05:19.641923+0000","last_undegraded":"2024-09-12T18:05:19.641923+0000","last_fullsized":"2024-09-12T18:05:19.641923+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:37.302553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648100+0000","last_change":"2024-09-12T17:46:45.537244+0000","last_active":"2024-09-12T18:05:29.648100+0000","last_peered":"2024-09-12T18:05:29.648100+0000","last_clean":"2024-09-12T18:05:29.648100+0000","last_became_active":"2024-09-12T17:46:45.536927+0000","last_became_peered":"2024-09-12T17:46:45.536927+0000","last_unstale":"2024-09-12T18:05:29.648100+0000","last_undegraded":"2024-09-12T18:05:29.648100+0000","last_fullsized":"2024-09-12T18:05:29.648100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:06.976539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.644905+0000","last_change":"2024-09-12T17:46:42.182617+0000","last_active":"2024-09-12T18:05:29.644905+0000","last_peered":"2024-09-12T18:05:29.644905+0000","last_clean":"2024-09-12T18:05:29.644905+0000","last_became_active":"2024-09-12T17:46:42.182346+0000","last_became_peered":"2024-09-12T17:46:42.182346+0000","last_unstale":"2024-09-12T18:05:29.644905+0000","last_undegraded":"2024-09-12T18:05:29.644905+0000","last_fullsized":"2024-09-12T18:05:29.644905+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:54.314647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'22","reported_seq":105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.511454+0000","last_change":"2024-09-12T17:45:03.895804+0000","last_active":"2024-09-12T18:04:34.511454+0000","last_peered":"2024-09-12T18:04:34.511454+0000","last_clean":"2024-09-12T18:04:34.511454+0000","last_became_active":"2024-09-12T17:45:03.895580+0000","last_became_peered":"2024-09-12T17:45:03.895580+0000","last_unstale":"2024-09-12T18:04:34.511454+0000","last_undegraded":"2024-09-12T18:04:34.511454+0000","last_fullsized":"2024-09-12T18:04:34.511454+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.580183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643446+0000","last_change":"2024-09-12T17:57:00.463170+0000","last_active":"2024-09-12T18:04:59.643446+0000","last_peered":"2024-09-12T18:04:59.643446+0000","last_clean":"2024-09-12T18:04:59.643446+0000","last_became_active":"2024-09-12T17:57:00.462863+0000","last_became_peered":"2024-09-12T17:57:00.462863+0000","last_unstale":"2024-09-12T18:04:59.643446+0000","last_undegraded":"2024-09-12T18:04:59.643446+0000","last_fullsized":"2024-09-12T18:04:59.643446+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:40.563317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.672968+0000","last_change":"2024-09-12T17:46:45.537210+0000","last_active":"2024-09-12T18:04:04.672968+0000","last_peered":"2024-09-12T18:04:04.672968+0000","last_clean":"2024-09-12T18:04:04.672968+0000","last_became_active":"2024-09-12T17:46:45.536831+0000","last_became_peered":"2024-09-12T17:46:45.536831+0000","last_unstale":"2024-09-12T18:04:04.672968+0000","last_undegraded":"2024-09-12T18:04:04.672968+0000","last_fullsized":"2024-09-12T18:04:04.672968+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:29.700931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'6","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.630406+0000","last_change":"2024-09-12T17:46:42.185520+0000","last_active":"2024-09-12T18:04:04.630406+0000","last_peered":"2024-09-12T18:04:04.630406+0000","last_clean":"2024-09-12T18:04:04.630406+0000","last_became_active":"2024-09-12T17:46:42.185216+0000","last_became_peered":"2024-09-12T17:46:42.185216+0000","last_unstale":"2024-09-12T18:04:04.630406+0000","last_undegraded":"2024-09-12T18:04:04.630406+0000","last_fullsized":"2024-09-12T18:04:04.630406+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:37.439176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":23554,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.671044+0000","last_change":"2024-09-12T17:45:03.894942+0000","last_active":"2024-09-12T18:03:54.671044+0000","last_peered":"2024-09-12T18:03:54.671044+0000","last_clean":"2024-09-12T18:03:54.671044+0000","last_became_active":"2024-09-12T17:45:03.894642+0000","last_became_peered":"2024-09-12T17:45:03.894642+0000","last_unstale":"2024-09-12T18:03:54.671044+0000","last_undegraded":"2024-09-12T18:03:54.671044+0000","last_fullsized":"2024-09-12T18:03:54.671044+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:17.879728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517749+0000","last_change":"2024-09-12T17:57:00.465804+0000","last_active":"2024-09-12T18:05:19.517749+0000","last_peered":"2024-09-12T18:05:19.517749+0000","last_clean":"2024-09-12T18:05:19.517749+0000","last_became_active":"2024-09-12T17:57:00.465546+0000","last_became_peered":"2024-09-12T17:57:00.465546+0000","last_unstale":"2024-09-12T18:05:19.517749+0000","last_undegraded":"2024-09-12T18:05:19.517749+0000","last_fullsized":"2024-09-12T18:05:19.517749+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.264688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'9","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.507233+0000","last_change":"2024-09-12T17:46:45.206808+0000","last_active":"2024-09-12T18:04:04.507233+0000","last_peered":"2024-09-12T18:04:04.507233+0000","last_clean":"2024-09-12T18:04:04.507233+0000","last_became_active":"2024-09-12T17:46:45.206537+0000","last_became_peered":"2024-09-12T17:46:45.206537+0000","last_unstale":"2024-09-12T18:04:04.507233+0000","last_undegraded":"2024-09-12T18:04:04.507233+0000","last_fullsized":"2024-09-12T18:04:04.507233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.731520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14215851,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":29814,"num_write":14,"num_write_kb":19003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.672982+0000","last_change":"2024-09-12T17:46:42.177736+0000","last_active":"2024-09-12T18:04:04.672982+0000","last_peered":"2024-09-12T18:04:04.672982+0000","last_clean":"2024-09-12T18:04:04.672982+0000","last_became_active":"2024-09-12T17:46:42.177427+0000","last_became_peered":"2024-09-12T17:46:42.177427+0000","last_unstale":"2024-09-12T18:04:04.672982+0000","last_undegraded":"2024-09-12T18:04:04.672982+0000","last_fullsized":"2024-09-12T18:04:04.672982+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:07.172378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'156","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.651994+0000","last_change":"2024-09-12T17:45:03.898576+0000","last_active":"2024-09-12T18:05:54.651994+0000","last_peered":"2024-09-12T18:05:54.651994+0000","last_clean":"2024-09-12T18:05:54.651994+0000","last_became_active":"2024-09-12T17:45:03.898292+0000","last_became_peered":"2024-09-12T17:45:03.898292+0000","last_unstale":"2024-09-12T18:05:54.651994+0000","last_undegraded":"2024-09-12T18:05:54.651994+0000","last_fullsized":"2024-09-12T18:05:54.651994+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:55.707973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":951,"num_read_kb":701,"num_write":196,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.646344+0000","last_change":"2024-09-12T17:57:00.464364+0000","last_active":"2024-09-12T18:05:39.646344+0000","last_peered":"2024-09-12T18:05:39.646344+0000","last_clean":"2024-09-12T18:05:39.646344+0000","last_became_active":"2024-09-12T17:57:00.464090+0000","last_became_peered":"2024-09-12T17:57:00.464090+0000","last_unstale":"2024-09-12T18:05:39.646344+0000","last_undegraded":"2024-09-12T18:05:39.646344+0000","last_fullsized":"2024-09-12T18:05:39.646344+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.615989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648116+0000","last_change":"2024-09-12T17:46:45.205661+0000","last_active":"2024-09-12T18:05:29.648116+0000","last_peered":"2024-09-12T18:05:29.648116+0000","last_clean":"2024-09-12T18:05:29.648116+0000","last_became_active":"2024-09-12T17:46:45.205357+0000","last_became_peered":"2024-09-12T17:46:45.205357+0000","last_unstale":"2024-09-12T18:05:29.648116+0000","last_undegraded":"2024-09-12T18:05:29.648116+0000","last_fullsized":"2024-09-12T18:05:29.648116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:35.096441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'1","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.679945+0000","last_change":"2024-09-12T17:46:42.176715+0000","last_active":"2024-09-12T18:04:49.679945+0000","last_peered":"2024-09-12T18:04:49.679945+0000","last_clean":"2024-09-12T18:04:49.679945+0000","last_became_active":"2024-09-12T17:46:42.176415+0000","last_became_peered":"2024-09-12T17:46:42.176415+0000","last_unstale":"2024-09-12T18:04:49.679945+0000","last_undegraded":"2024-09-12T18:04:49.679945+0000","last_fullsized":"2024-09-12T18:04:49.679945+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:04.586483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'25","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.647144+0000","last_change":"2024-09-12T17:45:03.889617+0000","last_active":"2024-09-12T18:05:54.647144+0000","last_peered":"2024-09-12T18:05:54.647144+0000","last_clean":"2024-09-12T18:05:54.647144+0000","last_became_active":"2024-09-12T17:45:03.889334+0000","last_became_peered":"2024-09-12T17:45:03.889334+0000","last_unstale":"2024-09-12T18:05:54.647144+0000","last_undegraded":"2024-09-12T18:05:54.647144+0000","last_fullsized":"2024-09-12T18:05:54.647144+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:08.253653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.649616+0000","last_change":"2024-09-12T17:57:00.453730+0000","last_active":"2024-09-12T18:05:39.649616+0000","last_peered":"2024-09-12T18:05:39.649616+0000","last_clean":"2024-09-12T18:05:39.649616+0000","last_became_active":"2024-09-12T17:57:00.453435+0000","last_became_peered":"2024-09-12T17:57:00.453435+0000","last_unstale":"2024-09-12T18:05:39.649616+0000","last_undegraded":"2024-09-12T18:05:39.649616+0000","last_fullsized":"2024-09-12T18:05:39.649616+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:47.161486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"261'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.637517+0000","last_change":"2024-09-12T17:46:45.211314+0000","last_active":"2024-09-12T18:04:49.637517+0000","last_peered":"2024-09-12T18:04:49.637517+0000","last_clean":"2024-09-12T18:04:49.637517+0000","last_became_active":"2024-09-12T17:46:45.210669+0000","last_became_peered":"2024-09-12T17:46:45.210669+0000","last_unstale":"2024-09-12T18:04:49.637517+0000","last_undegraded":"2024-09-12T18:04:49.637517+0000","last_fullsized":"2024-09-12T18:04:49.637517+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:28.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.685819+0000","last_change":"2024-09-12T17:46:42.179654+0000","last_active":"2024-09-12T18:05:29.685819+0000","last_peered":"2024-09-12T18:05:29.685819+0000","last_clean":"2024-09-12T18:05:29.685819+0000","last_became_active":"2024-09-12T17:46:42.179369+0000","last_became_peered":"2024-09-12T17:46:42.179369+0000","last_unstale":"2024-09-12T18:05:29.685819+0000","last_undegraded":"2024-09-12T18:05:29.685819+0000","last_fullsized":"2024-09-12T18:05:29.685819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:46.896690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'11","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.522442+0000","last_change":"2024-09-12T17:45:03.892044+0000","last_active":"2024-09-12T18:05:54.522442+0000","last_peered":"2024-09-12T18:05:54.522442+0000","last_clean":"2024-09-12T18:05:54.522442+0000","last_became_active":"2024-09-12T17:45:03.891751+0000","last_became_peered":"2024-09-12T17:45:03.891751+0000","last_unstale":"2024-09-12T18:05:54.522442+0000","last_undegraded":"2024-09-12T18:05:54.522442+0000","last_fullsized":"2024-09-12T18:05:54.522442+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:57.974426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646774+0000","last_change":"2024-09-12T17:57:00.466635+0000","last_active":"2024-09-12T18:05:19.646774+0000","last_peered":"2024-09-12T18:05:19.646774+0000","last_clean":"2024-09-12T18:05:19.646774+0000","last_became_active":"2024-09-12T17:57:00.465706+0000","last_became_peered":"2024-09-12T17:57:00.465706+0000","last_unstale":"2024-09-12T18:05:19.646774+0000","last_undegraded":"2024-09-12T18:05:19.646774+0000","last_fullsized":"2024-09-12T18:05:19.646774+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:50.291887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'6","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519086+0000","last_change":"2024-09-12T17:46:45.207296+0000","last_active":"2024-09-12T18:05:29.519086+0000","last_peered":"2024-09-12T18:05:29.519086+0000","last_clean":"2024-09-12T18:05:29.519086+0000","last_became_active":"2024-09-12T17:46:45.206384+0000","last_became_peered":"2024-09-12T17:46:45.206384+0000","last_unstale":"2024-09-12T18:05:29.519086+0000","last_undegraded":"2024-09-12T18:05:29.519086+0000","last_fullsized":"2024-09-12T18:05:29.519086+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:12.346318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":22528,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648169+0000","last_change":"2024-09-12T17:46:42.177668+0000","last_active":"2024-09-12T18:05:29.648169+0000","last_peered":"2024-09-12T18:05:29.648169+0000","last_clean":"2024-09-12T18:05:29.648169+0000","last_became_active":"2024-09-12T17:46:42.177381+0000","last_became_peered":"2024-09-12T17:46:42.177381+0000","last_unstale":"2024-09-12T18:05:29.648169+0000","last_undegraded":"2024-09-12T18:05:29.648169+0000","last_fullsized":"2024-09-12T18:05:29.648169+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:48.797003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.908163+0000","last_change":"2024-09-12T17:45:03.893535+0000","last_active":"2024-09-12T18:05:56.908163+0000","last_peered":"2024-09-12T18:05:56.908163+0000","last_clean":"2024-09-12T18:05:56.908163+0000","last_became_active":"2024-09-12T17:45:03.893234+0000","last_became_peered":"2024-09-12T17:45:03.893234+0000","last_unstale":"2024-09-12T18:05:56.908163+0000","last_undegraded":"2024-09-12T18:05:56.908163+0000","last_fullsized":"2024-09-12T18:05:56.908163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:56.134844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":127,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.685120+0000","last_change":"2024-09-12T17:57:00.467265+0000","last_active":"2024-09-12T18:05:24.685120+0000","last_peered":"2024-09-12T18:05:24.685120+0000","last_clean":"2024-09-12T18:05:24.685120+0000","last_became_active":"2024-09-12T17:57:00.466994+0000","last_became_peered":"2024-09-12T17:57:00.466994+0000","last_unstale":"2024-09-12T18:05:24.685120+0000","last_undegraded":"2024-09-12T18:05:24.685120+0000","last_fullsized":"2024-09-12T18:05:24.685120+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:10.618141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519076+0000","last_change":"2024-09-12T17:46:45.207817+0000","last_active":"2024-09-12T18:05:29.519076+0000","last_peered":"2024-09-12T18:05:29.519076+0000","last_clean":"2024-09-12T18:05:29.519076+0000","last_became_active":"2024-09-12T17:46:45.207552+0000","last_became_peered":"2024-09-12T17:46:45.207552+0000","last_unstale":"2024-09-12T18:05:29.519076+0000","last_undegraded":"2024-09-12T18:05:29.519076+0000","last_fullsized":"2024-09-12T18:05:29.519076+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.256254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'5","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519111+0000","last_change":"2024-09-12T17:46:42.182084+0000","last_active":"2024-09-12T18:05:29.519111+0000","last_peered":"2024-09-12T18:05:29.519111+0000","last_clean":"2024-09-12T18:05:29.519111+0000","last_became_active":"2024-09-12T17:46:42.181805+0000","last_became_peered":"2024-09-12T17:46:42.181805+0000","last_unstale":"2024-09-12T18:05:29.519111+0000","last_undegraded":"2024-09-12T18:05:29.519111+0000","last_fullsized":"2024-09-12T18:05:29.519111+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:10.912482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'23","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.747227+0000","last_change":"2024-09-12T17:45:03.893633+0000","last_active":"2024-09-12T18:05:56.747227+0000","last_peered":"2024-09-12T18:05:56.747227+0000","last_clean":"2024-09-12T18:05:56.747227+0000","last_became_active":"2024-09-12T17:45:03.893361+0000","last_became_peered":"2024-09-12T17:45:03.893361+0000","last_unstale":"2024-09-12T18:05:56.747227+0000","last_undegraded":"2024-09-12T18:05:56.747227+0000","last_fullsized":"2024-09-12T18:05:56.747227+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:44.155033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":77,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'207","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.242849+0000","last_change":"2024-09-12T17:29:52.955507+0000","last_active":"2024-09-12T18:05:59.242849+0000","last_peered":"2024-09-12T18:05:59.242849+0000","last_clean":"2024-09-12T18:05:59.242849+0000","last_became_active":"2024-09-12T17:29:52.955124+0000","last_became_peered":"2024-09-12T17:29:52.955124+0000","last_unstale":"2024-09-12T18:05:59.242849+0000","last_undegraded":"2024-09-12T18:05:59.242849+0000","last_fullsized":"2024-09-12T18:05:59.242849+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:32.089966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":3241,"num_write":1056,"num_write_kb":28474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'166","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.325382+0000","last_change":"2024-09-12T17:29:54.957835+0000","last_active":"2024-09-12T18:05:55.325382+0000","last_peered":"2024-09-12T18:05:55.325382+0000","last_clean":"2024-09-12T18:05:55.325382+0000","last_became_active":"2024-09-12T17:29:54.957047+0000","last_became_peered":"2024-09-12T17:29:54.957047+0000","last_unstale":"2024-09-12T18:05:55.325382+0000","last_undegraded":"2024-09-12T18:05:55.325382+0000","last_fullsized":"2024-09-12T18:05:55.325382+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:17.894082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":598,"num_write":253,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'208","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:30.640024+0000","last_change":"2024-09-12T17:29:52.954589+0000","last_active":"2024-09-12T18:07:30.640024+0000","last_peered":"2024-09-12T18:07:30.640024+0000","last_clean":"2024-09-12T18:07:30.640024+0000","last_became_active":"2024-09-12T17:29:52.954249+0000","last_became_peered":"2024-09-12T17:29:52.954249+0000","last_unstale":"2024-09-12T18:07:30.640024+0000","last_undegraded":"2024-09-12T18:07:30.640024+0000","last_fullsized":"2024-09-12T18:07:30.640024+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:36.461295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16377941,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":492,"num_read_kb":62367,"num_write":1035,"num_write_kb":21747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'277","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:58.408944+0000","last_change":"2024-09-12T17:29:54.959793+0000","last_active":"2024-09-12T18:05:58.408944+0000","last_peered":"2024-09-12T18:05:58.408944+0000","last_clean":"2024-09-12T18:05:58.408944+0000","last_became_active":"2024-09-12T17:29:54.959503+0000","last_became_peered":"2024-09-12T17:29:54.959503+0000","last_unstale":"2024-09-12T18:05:58.408944+0000","last_undegraded":"2024-09-12T18:05:58.408944+0000","last_fullsized":"2024-09-12T18:05:58.408944+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:15.895941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1203,"num_read_kb":968,"num_write":436,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'249","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:05.733364+0000","last_change":"2024-09-12T17:29:52.957963+0000","last_active":"2024-09-12T18:06:05.733364+0000","last_peered":"2024-09-12T18:06:05.733364+0000","last_clean":"2024-09-12T18:06:05.733364+0000","last_became_active":"2024-09-12T17:29:52.957594+0000","last_became_peered":"2024-09-12T17:29:52.957594+0000","last_unstale":"2024-09-12T18:06:05.733364+0000","last_undegraded":"2024-09-12T18:06:05.733364+0000","last_fullsized":"2024-09-12T18:06:05.733364+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:50.942076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5844893,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":697,"num_read_kb":82538,"num_write":1030,"num_write_kb":35611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'90","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.508667+0000","last_change":"2024-09-12T17:29:54.955262+0000","last_active":"2024-09-12T18:05:53.508667+0000","last_peered":"2024-09-12T18:05:53.508667+0000","last_clean":"2024-09-12T18:05:53.508667+0000","last_became_active":"2024-09-12T17:29:54.954764+0000","last_became_peered":"2024-09-12T17:29:54.954764+0000","last_unstale":"2024-09-12T18:05:53.508667+0000","last_undegraded":"2024-09-12T18:05:53.508667+0000","last_fullsized":"2024-09-12T18:05:53.508667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:12.643057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":371,"num_write":125,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'203","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.209592+0000","last_change":"2024-09-12T17:29:52.957193+0000","last_active":"2024-09-12T18:05:56.209592+0000","last_peered":"2024-09-12T18:05:56.209592+0000","last_clean":"2024-09-12T18:05:56.209592+0000","last_became_active":"2024-09-12T17:29:52.956816+0000","last_became_peered":"2024-09-12T17:29:52.956816+0000","last_unstale":"2024-09-12T18:05:56.209592+0000","last_undegraded":"2024-09-12T18:05:56.209592+0000","last_fullsized":"2024-09-12T18:05:56.209592+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:23.693578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16094916,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":502,"num_read_kb":70330,"num_write":992,"num_write_kb":42186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4089","reported_seq":4667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.194774+0000","last_change":"2024-09-12T17:29:54.945238+0000","last_active":"2024-09-12T18:05:26.194774+0000","last_peered":"2024-09-12T18:05:26.194774+0000","last_clean":"2024-09-12T18:05:26.194774+0000","last_became_active":"2024-09-12T17:29:54.944959+0000","last_became_peered":"2024-09-12T17:29:54.944959+0000","last_unstale":"2024-09-12T18:05:26.194774+0000","last_undegraded":"2024-09-12T18:05:26.194774+0000","last_fullsized":"2024-09-12T18:05:26.194774+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":3000,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:46.528319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16426,"num_read_kb":13705,"num_write":6135,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'161","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.680867+0000","last_change":"2024-09-12T17:29:52.961055+0000","last_active":"2024-09-12T18:04:54.680867+0000","last_peered":"2024-09-12T18:04:54.680867+0000","last_clean":"2024-09-12T18:04:54.680867+0000","last_became_active":"2024-09-12T17:29:52.960666+0000","last_became_peered":"2024-09-12T17:29:52.960666+0000","last_unstale":"2024-09-12T18:04:54.680867+0000","last_undegraded":"2024-09-12T18:04:54.680867+0000","last_fullsized":"2024-09-12T18:04:54.680867+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:19.974025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23698,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":498,"num_read_kb":127585,"num_write":824,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'125","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.071213+0000","last_change":"2024-09-12T17:29:54.955474+0000","last_active":"2024-09-12T18:05:52.071213+0000","last_peered":"2024-09-12T18:05:52.071213+0000","last_clean":"2024-09-12T18:05:52.071213+0000","last_became_active":"2024-09-12T17:29:54.955205+0000","last_became_peered":"2024-09-12T17:29:54.955205+0000","last_unstale":"2024-09-12T18:05:52.071213+0000","last_undegraded":"2024-09-12T18:05:52.071213+0000","last_fullsized":"2024-09-12T18:05:52.071213+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:25.759255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":437,"num_write":181,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'213","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:21.850266+0000","last_change":"2024-09-12T17:29:52.960833+0000","last_active":"2024-09-12T18:05:21.850266+0000","last_peered":"2024-09-12T18:05:21.850266+0000","last_clean":"2024-09-12T18:05:21.850266+0000","last_became_active":"2024-09-12T17:29:52.955926+0000","last_became_peered":"2024-09-12T17:29:52.955926+0000","last_unstale":"2024-09-12T18:05:21.850266+0000","last_undegraded":"2024-09-12T18:05:21.850266+0000","last_fullsized":"2024-09-12T18:05:21.850266+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:53.948085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609549,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":499,"num_read_kb":5634,"num_write":1055,"num_write_kb":27185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'203","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.854752+0000","last_change":"2024-09-12T17:29:54.955413+0000","last_active":"2024-09-12T18:06:20.854752+0000","last_peered":"2024-09-12T18:06:20.854752+0000","last_clean":"2024-09-12T18:06:20.854752+0000","last_became_active":"2024-09-12T17:29:54.955119+0000","last_became_peered":"2024-09-12T17:29:54.955119+0000","last_unstale":"2024-09-12T18:06:20.854752+0000","last_undegraded":"2024-09-12T18:06:20.854752+0000","last_fullsized":"2024-09-12T18:06:20.854752+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:34.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":872,"num_read_kb":697,"num_write":351,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'193","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:24.702189+0000","last_change":"2024-09-12T17:29:52.962572+0000","last_active":"2024-09-12T18:07:24.702189+0000","last_peered":"2024-09-12T18:07:24.702189+0000","last_clean":"2024-09-12T18:07:24.702189+0000","last_became_active":"2024-09-12T17:29:52.962236+0000","last_became_peered":"2024-09-12T17:29:52.962236+0000","last_unstale":"2024-09-12T18:07:24.702189+0000","last_undegraded":"2024-09-12T18:07:24.702189+0000","last_fullsized":"2024-09-12T18:07:24.702189+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3350960,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":521,"num_read_kb":5167,"num_write":1011,"num_write_kb":25714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'272","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:18.420389+0000","last_change":"2024-09-12T17:29:54.963988+0000","last_active":"2024-09-12T18:06:18.420389+0000","last_peered":"2024-09-12T18:06:18.420389+0000","last_clean":"2024-09-12T18:06:18.420389+0000","last_became_active":"2024-09-12T17:29:54.963665+0000","last_became_peered":"2024-09-12T17:29:54.963665+0000","last_unstale":"2024-09-12T18:06:18.420389+0000","last_undegraded":"2024-09-12T18:06:18.420389+0000","last_fullsized":"2024-09-12T18:06:18.420389+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:56.293772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1246,"num_read_kb":1040,"num_write":431,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'225","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.912375+0000","last_change":"2024-09-12T17:29:52.956163+0000","last_active":"2024-09-12T18:06:01.912375+0000","last_peered":"2024-09-12T18:06:01.912375+0000","last_clean":"2024-09-12T18:06:01.912375+0000","last_became_active":"2024-09-12T17:29:52.955333+0000","last_became_peered":"2024-09-12T17:29:52.955333+0000","last_unstale":"2024-09-12T18:06:01.912375+0000","last_undegraded":"2024-09-12T18:06:01.912375+0000","last_fullsized":"2024-09-12T18:06:01.912375+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:31.003485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804154,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":522,"num_read_kb":94260,"num_write":1112,"num_write_kb":40355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'158","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.172360+0000","last_change":"2024-09-12T17:29:54.952797+0000","last_active":"2024-09-12T18:06:07.172360+0000","last_peered":"2024-09-12T18:06:07.172360+0000","last_clean":"2024-09-12T18:06:07.172360+0000","last_became_active":"2024-09-12T17:29:54.952536+0000","last_became_peered":"2024-09-12T17:29:54.952536+0000","last_unstale":"2024-09-12T18:06:07.172360+0000","last_undegraded":"2024-09-12T18:06:07.172360+0000","last_fullsized":"2024-09-12T18:06:07.172360+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:50.999631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":604,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'401","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.229784+0000","last_change":"2024-09-12T17:29:54.955472+0000","last_active":"2024-09-12T18:05:52.229784+0000","last_peered":"2024-09-12T18:05:52.229784+0000","last_clean":"2024-09-12T18:05:52.229784+0000","last_became_active":"2024-09-12T17:29:54.954401+0000","last_became_peered":"2024-09-12T17:29:54.954401+0000","last_unstale":"2024-09-12T18:05:52.229784+0000","last_undegraded":"2024-09-12T18:05:52.229784+0000","last_fullsized":"2024-09-12T18:05:52.229784+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:16.926597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1720,"num_read_kb":1358,"num_write":655,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'181","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:41.511352+0000","last_change":"2024-09-12T17:29:52.958556+0000","last_active":"2024-09-12T18:05:41.511352+0000","last_peered":"2024-09-12T18:05:41.511352+0000","last_clean":"2024-09-12T18:05:41.511352+0000","last_became_active":"2024-09-12T17:29:52.957715+0000","last_became_peered":"2024-09-12T17:29:52.957715+0000","last_unstale":"2024-09-12T18:05:41.511352+0000","last_undegraded":"2024-09-12T18:05:41.511352+0000","last_fullsized":"2024-09-12T18:05:41.511352+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:48.046592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2064,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":321,"num_read_kb":380,"num_write":907,"num_write_kb":20925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'91","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.680830+0000","last_change":"2024-09-12T17:29:54.960764+0000","last_active":"2024-09-12T18:04:54.680830+0000","last_peered":"2024-09-12T18:04:54.680830+0000","last_clean":"2024-09-12T18:04:54.680830+0000","last_became_active":"2024-09-12T17:29:54.960430+0000","last_became_peered":"2024-09-12T17:29:54.960430+0000","last_unstale":"2024-09-12T18:04:54.680830+0000","last_undegraded":"2024-09-12T18:04:54.680830+0000","last_fullsized":"2024-09-12T18:04:54.680830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:51.078408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":446,"num_read_kb":372,"num_write":151,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'239","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.298482+0000","last_change":"2024-09-12T17:29:52.961437+0000","last_active":"2024-09-12T18:06:19.298482+0000","last_peered":"2024-09-12T18:06:19.298482+0000","last_clean":"2024-09-12T18:06:19.298482+0000","last_became_active":"2024-09-12T17:29:52.960770+0000","last_became_peered":"2024-09-12T17:29:52.960770+0000","last_unstale":"2024-09-12T18:06:19.298482+0000","last_undegraded":"2024-09-12T18:06:19.298482+0000","last_fullsized":"2024-09-12T18:06:19.298482+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:52.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16858859,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":819,"num_read_kb":13405,"num_write":1109,"num_write_kb":28936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'257","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.245805+0000","last_change":"2024-09-12T17:29:54.963348+0000","last_active":"2024-09-12T18:06:21.245805+0000","last_peered":"2024-09-12T18:06:21.245805+0000","last_clean":"2024-09-12T18:06:21.245805+0000","last_became_active":"2024-09-12T17:29:54.962822+0000","last_became_peered":"2024-09-12T17:29:54.962822+0000","last_unstale":"2024-09-12T18:06:21.245805+0000","last_undegraded":"2024-09-12T18:06:21.245805+0000","last_fullsized":"2024-09-12T18:06:21.245805+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:14.125505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1220,"num_read_kb":1023,"num_write":434,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'204","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.559749+0000","last_change":"2024-09-12T17:29:52.956896+0000","last_active":"2024-09-12T18:06:07.559749+0000","last_peered":"2024-09-12T18:06:07.559749+0000","last_clean":"2024-09-12T18:06:07.559749+0000","last_became_active":"2024-09-12T17:29:52.956432+0000","last_became_peered":"2024-09-12T17:29:52.956432+0000","last_unstale":"2024-09-12T18:06:07.559749+0000","last_undegraded":"2024-09-12T18:06:07.559749+0000","last_fullsized":"2024-09-12T18:06:07.559749+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:34.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11441510,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":42949,"num_write":1039,"num_write_kb":37671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'84","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.247939+0000","last_change":"2024-09-12T17:29:54.944847+0000","last_active":"2024-09-12T18:05:24.247939+0000","last_peered":"2024-09-12T18:05:24.247939+0000","last_clean":"2024-09-12T18:05:24.247939+0000","last_became_active":"2024-09-12T17:29:54.944588+0000","last_became_peered":"2024-09-12T17:29:54.944588+0000","last_unstale":"2024-09-12T18:05:24.247939+0000","last_undegraded":"2024-09-12T18:05:24.247939+0000","last_fullsized":"2024-09-12T18:05:24.247939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:15.044680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":342,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'223","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.832826+0000","last_change":"2024-09-12T17:29:52.963156+0000","last_active":"2024-09-12T18:05:26.832826+0000","last_peered":"2024-09-12T18:05:26.832826+0000","last_clean":"2024-09-12T18:05:26.832826+0000","last_became_active":"2024-09-12T17:29:52.962814+0000","last_became_peered":"2024-09-12T17:29:52.962814+0000","last_unstale":"2024-09-12T18:05:26.832826+0000","last_undegraded":"2024-09-12T18:05:26.832826+0000","last_fullsized":"2024-09-12T18:05:26.832826+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:05.435586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10837622,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":48243,"num_write":1121,"num_write_kb":37209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'125","reported_seq":719,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:18.231406+0000","last_change":"2024-09-12T17:29:54.957275+0000","last_active":"2024-09-12T18:05:18.231406+0000","last_peered":"2024-09-12T18:05:18.231406+0000","last_clean":"2024-09-12T18:05:18.231406+0000","last_became_active":"2024-09-12T17:29:54.956975+0000","last_became_peered":"2024-09-12T17:29:54.956975+0000","last_unstale":"2024-09-12T18:05:18.231406+0000","last_undegraded":"2024-09-12T18:05:18.231406+0000","last_fullsized":"2024-09-12T18:05:18.231406+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:35.436729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":592,"num_read_kb":498,"num_write":187,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'254","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.651610+0000","last_change":"2024-09-12T17:29:52.954983+0000","last_active":"2024-09-12T18:05:30.651610+0000","last_peered":"2024-09-12T18:05:30.651610+0000","last_clean":"2024-09-12T18:05:30.651610+0000","last_became_active":"2024-09-12T17:29:52.954630+0000","last_became_peered":"2024-09-12T17:29:52.954630+0000","last_unstale":"2024-09-12T18:05:30.651610+0000","last_undegraded":"2024-09-12T18:05:30.651610+0000","last_fullsized":"2024-09-12T18:05:30.651610+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:32.291580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15348488,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":833,"num_read_kb":67261,"num_write":1121,"num_write_kb":48740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'283","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.230047+0000","last_change":"2024-09-12T17:29:54.959334+0000","last_active":"2024-09-12T18:05:30.230047+0000","last_peered":"2024-09-12T18:05:30.230047+0000","last_clean":"2024-09-12T18:05:30.230047+0000","last_became_active":"2024-09-12T17:29:54.958852+0000","last_became_peered":"2024-09-12T17:29:54.958852+0000","last_unstale":"2024-09-12T18:05:30.230047+0000","last_undegraded":"2024-09-12T18:05:30.230047+0000","last_fullsized":"2024-09-12T18:05:30.230047+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:21.982711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1254,"num_read_kb":1035,"num_write":436,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'169","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:17.890071+0000","last_change":"2024-09-12T17:29:52.959483+0000","last_active":"2024-09-12T18:05:17.890071+0000","last_peered":"2024-09-12T18:05:17.890071+0000","last_clean":"2024-09-12T18:05:17.890071+0000","last_became_active":"2024-09-12T17:29:52.959175+0000","last_became_peered":"2024-09-12T17:29:52.959175+0000","last_unstale":"2024-09-12T18:05:17.890071+0000","last_undegraded":"2024-09-12T18:05:17.890071+0000","last_fullsized":"2024-09-12T18:05:17.890071+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:39.671271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242932,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":327,"num_read_kb":1243,"num_write":850,"num_write_kb":36341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'154","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.297485+0000","last_change":"2024-09-12T17:30:02.964799+0000","last_active":"2024-09-12T18:06:21.297485+0000","last_peered":"2024-09-12T18:06:21.297485+0000","last_clean":"2024-09-12T18:06:21.297485+0000","last_became_active":"2024-09-12T17:30:02.964492+0000","last_became_peered":"2024-09-12T17:30:02.964492+0000","last_unstale":"2024-09-12T18:06:21.297485+0000","last_undegraded":"2024-09-12T18:06:21.297485+0000","last_fullsized":"2024-09-12T18:06:21.297485+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:49.837441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":218,"num_read_kb":205,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'110","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.335050+0000","last_change":"2024-09-12T17:29:54.951914+0000","last_active":"2024-09-12T18:05:59.335050+0000","last_peered":"2024-09-12T18:05:59.335050+0000","last_clean":"2024-09-12T18:05:59.335050+0000","last_became_active":"2024-09-12T17:29:54.950633+0000","last_became_peered":"2024-09-12T17:29:54.950633+0000","last_unstale":"2024-09-12T18:05:59.335050+0000","last_undegraded":"2024-09-12T18:05:59.335050+0000","last_fullsized":"2024-09-12T18:05:59.335050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:07.589708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":400,"num_write":147,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'196","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.159300+0000","last_change":"2024-09-12T17:30:28.007547+0000","last_active":"2024-09-12T18:05:59.159300+0000","last_peered":"2024-09-12T18:05:59.159300+0000","last_clean":"2024-09-12T18:05:59.159300+0000","last_became_active":"2024-09-12T17:30:28.007183+0000","last_became_peered":"2024-09-12T17:30:28.007183+0000","last_unstale":"2024-09-12T18:05:59.159300+0000","last_undegraded":"2024-09-12T18:05:59.159300+0000","last_fullsized":"2024-09-12T18:05:59.159300+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:49.159102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":968005,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":913,"num_read_kb":19617,"num_write":946,"num_write_kb":33635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.600586+0000","last_change":"2024-09-12T17:29:56.954842+0000","last_active":"2024-09-12T18:07:38.600586+0000","last_peered":"2024-09-12T18:07:38.600586+0000","last_clean":"2024-09-12T18:07:38.600586+0000","last_became_active":"2024-09-12T17:29:56.954488+0000","last_became_peered":"2024-09-12T17:29:56.954488+0000","last_unstale":"2024-09-12T18:07:38.600586+0000","last_undegraded":"2024-09-12T18:07:38.600586+0000","last_fullsized":"2024-09-12T18:07:38.600586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:16.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":721,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'174","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.654293+0000","last_change":"2024-09-12T17:29:58.957203+0000","last_active":"2024-09-12T18:06:14.654293+0000","last_peered":"2024-09-12T18:06:14.654293+0000","last_clean":"2024-09-12T18:06:14.654293+0000","last_became_active":"2024-09-12T17:29:58.956916+0000","last_became_peered":"2024-09-12T17:29:58.956916+0000","last_unstale":"2024-09-12T18:06:14.654293+0000","last_undegraded":"2024-09-12T18:06:14.654293+0000","last_fullsized":"2024-09-12T18:06:14.654293+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:23.529305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5073,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":227,"num_read_kb":264,"num_write":128,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.671162+0000","last_change":"2024-09-12T17:30:00.960720+0000","last_active":"2024-09-12T18:03:54.671162+0000","last_peered":"2024-09-12T18:03:54.671162+0000","last_clean":"2024-09-12T18:03:54.671162+0000","last_became_active":"2024-09-12T17:30:00.960409+0000","last_became_peered":"2024-09-12T17:30:00.960409+0000","last_unstale":"2024-09-12T18:03:54.671162+0000","last_undegraded":"2024-09-12T18:03:54.671162+0000","last_fullsized":"2024-09-12T18:03:54.671162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:36.986925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2442","reported_seq":4366,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.852848+0000","last_change":"2024-09-12T17:30:02.968528+0000","last_active":"2024-09-12T18:06:20.852848+0000","last_peered":"2024-09-12T18:06:20.852848+0000","last_clean":"2024-09-12T18:06:20.852848+0000","last_became_active":"2024-09-12T17:30:02.967718+0000","last_became_peered":"2024-09-12T17:30:02.967718+0000","last_unstale":"2024-09-12T18:06:20.852848+0000","last_undegraded":"2024-09-12T18:06:20.852848+0000","last_fullsized":"2024-09-12T18:06:20.852848+0000","mapping_epoch":34,"log_start":"264'2400","ondisk_log_start":"264'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":2400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:40.278625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1044,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6319,"num_read_kb":6274,"num_write":4873,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'136","reported_seq":718,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.219639+0000","last_change":"2024-09-12T17:29:54.958156+0000","last_active":"2024-09-12T18:05:53.219639+0000","last_peered":"2024-09-12T18:05:53.219639+0000","last_clean":"2024-09-12T18:05:53.219639+0000","last_became_active":"2024-09-12T17:29:54.957747+0000","last_became_peered":"2024-09-12T17:29:54.957747+0000","last_unstale":"2024-09-12T18:05:53.219639+0000","last_undegraded":"2024-09-12T18:05:53.219639+0000","last_fullsized":"2024-09-12T18:05:53.219639+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:45.769420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":552,"num_write":215,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'209","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.315455+0000","last_change":"2024-09-12T17:29:52.950951+0000","last_active":"2024-09-12T18:05:20.315455+0000","last_peered":"2024-09-12T18:05:20.315455+0000","last_clean":"2024-09-12T18:05:20.315455+0000","last_became_active":"2024-09-12T17:29:52.950612+0000","last_became_peered":"2024-09-12T17:29:52.950612+0000","last_unstale":"2024-09-12T18:05:20.315455+0000","last_undegraded":"2024-09-12T18:05:20.315455+0000","last_fullsized":"2024-09-12T18:05:20.315455+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:09.873785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44593,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":10994,"num_write":1023,"num_write_kb":32732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.528200+0000","last_change":"2024-09-12T17:29:56.953819+0000","last_active":"2024-09-12T18:05:09.528200+0000","last_peered":"2024-09-12T18:05:09.528200+0000","last_clean":"2024-09-12T18:05:09.528200+0000","last_became_active":"2024-09-12T17:29:56.953546+0000","last_became_peered":"2024-09-12T17:29:56.953546+0000","last_unstale":"2024-09-12T18:05:09.528200+0000","last_undegraded":"2024-09-12T18:05:09.528200+0000","last_fullsized":"2024-09-12T18:05:09.528200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:02.063377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'85","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.814472+0000","last_change":"2024-09-12T17:29:58.951397+0000","last_active":"2024-09-12T18:05:55.814472+0000","last_peered":"2024-09-12T18:05:55.814472+0000","last_clean":"2024-09-12T18:05:55.814472+0000","last_became_active":"2024-09-12T17:29:58.951077+0000","last_became_peered":"2024-09-12T17:29:58.951077+0000","last_unstale":"2024-09-12T18:05:55.814472+0000","last_undegraded":"2024-09-12T18:05:55.814472+0000","last_fullsized":"2024-09-12T18:05:55.814472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:32.229853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.505635+0000","last_change":"2024-09-12T17:30:00.969561+0000","last_active":"2024-09-12T18:03:54.505635+0000","last_peered":"2024-09-12T18:03:54.505635+0000","last_clean":"2024-09-12T18:03:54.505635+0000","last_became_active":"2024-09-12T17:30:00.969291+0000","last_became_peered":"2024-09-12T17:30:00.969291+0000","last_unstale":"2024-09-12T18:03:54.505635+0000","last_undegraded":"2024-09-12T18:03:54.505635+0000","last_fullsized":"2024-09-12T18:03:54.505635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:59.191519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'123","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:03.288660+0000","last_change":"2024-09-12T17:30:02.972169+0000","last_active":"2024-09-12T18:06:03.288660+0000","last_peered":"2024-09-12T18:06:03.288660+0000","last_clean":"2024-09-12T18:06:03.288660+0000","last_became_active":"2024-09-12T17:30:02.971843+0000","last_became_peered":"2024-09-12T17:30:02.971843+0000","last_unstale":"2024-09-12T18:06:03.288660+0000","last_undegraded":"2024-09-12T18:06:03.288660+0000","last_fullsized":"2024-09-12T18:06:03.288660+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:27.791607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'129","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.234318+0000","last_change":"2024-09-12T17:29:54.945375+0000","last_active":"2024-09-12T18:06:00.234318+0000","last_peered":"2024-09-12T18:06:00.234318+0000","last_clean":"2024-09-12T18:06:00.234318+0000","last_became_active":"2024-09-12T17:29:54.944698+0000","last_became_peered":"2024-09-12T17:29:54.944698+0000","last_unstale":"2024-09-12T18:06:00.234318+0000","last_undegraded":"2024-09-12T18:06:00.234318+0000","last_fullsized":"2024-09-12T18:06:00.234318+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:02.736469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":422,"num_write":199,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'176","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:05.291120+0000","last_change":"2024-09-12T17:29:52.963403+0000","last_active":"2024-09-12T18:06:05.291120+0000","last_peered":"2024-09-12T18:06:05.291120+0000","last_clean":"2024-09-12T18:06:05.291120+0000","last_became_active":"2024-09-12T17:29:52.963087+0000","last_became_peered":"2024-09-12T17:29:52.963087+0000","last_unstale":"2024-09-12T18:06:05.291120+0000","last_undegraded":"2024-09-12T18:06:05.291120+0000","last_fullsized":"2024-09-12T18:06:05.291120+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:31.829205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10614291,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":3190,"num_write":915,"num_write_kb":30863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.515779+0000","last_change":"2024-09-12T17:29:56.953137+0000","last_active":"2024-09-12T18:03:49.515779+0000","last_peered":"2024-09-12T18:03:49.515779+0000","last_clean":"2024-09-12T18:03:49.515779+0000","last_became_active":"2024-09-12T17:29:56.952827+0000","last_became_peered":"2024-09-12T17:29:56.952827+0000","last_unstale":"2024-09-12T18:03:49.515779+0000","last_undegraded":"2024-09-12T18:03:49.515779+0000","last_fullsized":"2024-09-12T18:03:49.515779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:28.816718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'97","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.555493+0000","last_change":"2024-09-12T17:29:58.952475+0000","last_active":"2024-09-12T18:05:29.555493+0000","last_peered":"2024-09-12T18:05:29.555493+0000","last_clean":"2024-09-12T18:05:29.555493+0000","last_became_active":"2024-09-12T17:29:58.952169+0000","last_became_peered":"2024-09-12T17:29:58.952169+0000","last_unstale":"2024-09-12T18:05:29.555493+0000","last_undegraded":"2024-09-12T18:05:29.555493+0000","last_fullsized":"2024-09-12T18:05:29.555493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:14.255681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":103,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'751","reported_seq":2401,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.686944+0000","last_change":"2024-09-12T17:30:00.954478+0000","last_active":"2024-09-12T18:07:38.686944+0000","last_peered":"2024-09-12T18:07:38.686944+0000","last_clean":"2024-09-12T18:07:38.686944+0000","last_became_active":"2024-09-12T17:30:00.954180+0000","last_became_peered":"2024-09-12T17:30:00.954180+0000","last_unstale":"2024-09-12T18:07:38.686944+0000","last_undegraded":"2024-09-12T18:07:38.686944+0000","last_fullsized":"2024-09-12T18:07:38.686944+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:51.847365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'180","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.347847+0000","last_change":"2024-09-12T17:30:02.962486+0000","last_active":"2024-09-12T18:06:21.347847+0000","last_peered":"2024-09-12T18:06:21.347847+0000","last_clean":"2024-09-12T18:06:21.347847+0000","last_became_active":"2024-09-12T17:30:02.961198+0000","last_became_peered":"2024-09-12T17:30:02.961198+0000","last_unstale":"2024-09-12T18:06:21.347847+0000","last_undegraded":"2024-09-12T18:06:21.347847+0000","last_fullsized":"2024-09-12T18:06:21.347847+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:59.034236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":624,"num_write":393,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'95","reported_seq":671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.293469+0000","last_change":"2024-09-12T17:29:54.956913+0000","last_active":"2024-09-12T18:06:06.293469+0000","last_peered":"2024-09-12T18:06:06.293469+0000","last_clean":"2024-09-12T18:06:06.293469+0000","last_became_active":"2024-09-12T17:29:54.956663+0000","last_became_peered":"2024-09-12T17:29:54.956663+0000","last_unstale":"2024-09-12T18:06:06.293469+0000","last_undegraded":"2024-09-12T18:06:06.293469+0000","last_fullsized":"2024-09-12T18:06:06.293469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:29.330762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":356,"num_write":140,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'158","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.735808+0000","last_change":"2024-09-12T17:29:52.963393+0000","last_active":"2024-09-12T18:05:56.735808+0000","last_peered":"2024-09-12T18:05:56.735808+0000","last_clean":"2024-09-12T18:05:56.735808+0000","last_became_active":"2024-09-12T17:29:52.962665+0000","last_became_peered":"2024-09-12T17:29:52.962665+0000","last_unstale":"2024-09-12T18:05:56.735808+0000","last_undegraded":"2024-09-12T18:05:56.735808+0000","last_fullsized":"2024-09-12T18:05:56.735808+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:43.499509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17855108,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":345,"num_read_kb":5731,"num_write":807,"num_write_kb":29128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.627887+0000","last_change":"2024-09-12T17:29:56.953011+0000","last_active":"2024-09-12T18:03:49.627887+0000","last_peered":"2024-09-12T18:03:49.627887+0000","last_clean":"2024-09-12T18:03:49.627887+0000","last_became_active":"2024-09-12T17:29:56.952625+0000","last_became_peered":"2024-09-12T17:29:56.952625+0000","last_unstale":"2024-09-12T18:03:49.627887+0000","last_undegraded":"2024-09-12T18:03:49.627887+0000","last_fullsized":"2024-09-12T18:03:49.627887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:37.754261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'101","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.692414+0000","last_change":"2024-09-12T17:29:58.978681+0000","last_active":"2024-09-12T18:06:14.692414+0000","last_peered":"2024-09-12T18:06:14.692414+0000","last_clean":"2024-09-12T18:06:14.692414+0000","last_became_active":"2024-09-12T17:29:58.978299+0000","last_became_peered":"2024-09-12T17:29:58.978299+0000","last_unstale":"2024-09-12T18:06:14.692414+0000","last_undegraded":"2024-09-12T18:06:14.692414+0000","last_fullsized":"2024-09-12T18:06:14.692414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:51.821063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4431,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":119,"num_write":58,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'772","reported_seq":3915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.691525+0000","last_change":"2024-09-12T17:30:00.963021+0000","last_active":"2024-09-12T18:07:38.691525+0000","last_peered":"2024-09-12T18:07:38.691525+0000","last_clean":"2024-09-12T18:07:38.691525+0000","last_became_active":"2024-09-12T17:30:00.962754+0000","last_became_peered":"2024-09-12T17:30:00.962754+0000","last_unstale":"2024-09-12T18:07:38.691525+0000","last_undegraded":"2024-09-12T18:07:38.691525+0000","last_fullsized":"2024-09-12T18:07:38.691525+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:34.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'251","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.889819+0000","last_change":"2024-09-12T17:29:54.957456+0000","last_active":"2024-09-12T18:06:00.889819+0000","last_peered":"2024-09-12T18:06:00.889819+0000","last_clean":"2024-09-12T18:06:00.889819+0000","last_became_active":"2024-09-12T17:29:54.957148+0000","last_became_peered":"2024-09-12T17:29:54.957148+0000","last_unstale":"2024-09-12T18:06:00.889819+0000","last_undegraded":"2024-09-12T18:06:00.889819+0000","last_fullsized":"2024-09-12T18:06:00.889819+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:19.628837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":968,"num_write":398,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'233","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:51.286563+0000","last_change":"2024-09-12T17:29:52.964771+0000","last_active":"2024-09-12T18:05:51.286563+0000","last_peered":"2024-09-12T18:05:51.286563+0000","last_clean":"2024-09-12T18:05:51.286563+0000","last_became_active":"2024-09-12T17:29:52.964421+0000","last_became_peered":"2024-09-12T17:29:52.964421+0000","last_unstale":"2024-09-12T18:05:51.286563+0000","last_undegraded":"2024-09-12T18:05:51.286563+0000","last_fullsized":"2024-09-12T18:05:51.286563+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:13.642050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6103136,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":5176,"num_write":1040,"num_write_kb":56179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.678374+0000","last_change":"2024-09-12T17:29:56.953482+0000","last_active":"2024-09-12T18:04:39.678374+0000","last_peered":"2024-09-12T18:04:39.678374+0000","last_clean":"2024-09-12T18:04:39.678374+0000","last_became_active":"2024-09-12T17:29:56.953204+0000","last_became_peered":"2024-09-12T17:29:56.953204+0000","last_unstale":"2024-09-12T18:04:39.678374+0000","last_undegraded":"2024-09-12T18:04:39.678374+0000","last_fullsized":"2024-09-12T18:04:39.678374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:49.409852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'177","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:54.655776+0000","last_change":"2024-09-12T17:29:58.979003+0000","last_active":"2024-09-12T18:06:54.655776+0000","last_peered":"2024-09-12T18:06:54.655776+0000","last_clean":"2024-09-12T18:06:54.655776+0000","last_became_active":"2024-09-12T17:29:58.978213+0000","last_became_peered":"2024-09-12T17:29:58.978213+0000","last_unstale":"2024-09-12T18:06:54.655776+0000","last_undegraded":"2024-09-12T18:06:54.655776+0000","last_fullsized":"2024-09-12T18:06:54.655776+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:29.055630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11558,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":242,"num_read_kb":287,"num_write":136,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.632793+0000","last_change":"2024-09-12T17:30:00.959136+0000","last_active":"2024-09-12T18:03:49.632793+0000","last_peered":"2024-09-12T18:03:49.632793+0000","last_clean":"2024-09-12T18:03:49.632793+0000","last_became_active":"2024-09-12T17:30:00.958723+0000","last_became_peered":"2024-09-12T17:30:00.958723+0000","last_unstale":"2024-09-12T18:03:49.632793+0000","last_undegraded":"2024-09-12T18:03:49.632793+0000","last_fullsized":"2024-09-12T18:03:49.632793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:07.523774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'549","reported_seq":1353,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.673110+0000","last_change":"2024-09-12T17:30:02.968872+0000","last_active":"2024-09-12T18:07:38.673110+0000","last_peered":"2024-09-12T18:07:38.673110+0000","last_clean":"2024-09-12T18:07:38.673110+0000","last_became_active":"2024-09-12T17:30:02.968515+0000","last_became_peered":"2024-09-12T17:30:02.968515+0000","last_unstale":"2024-09-12T18:07:38.673110+0000","last_undegraded":"2024-09-12T18:07:38.673110+0000","last_fullsized":"2024-09-12T18:07:38.673110+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:33.814672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1325,"num_read_kb":1316,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'153","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.308857+0000","last_change":"2024-09-12T17:29:54.959404+0000","last_active":"2024-09-12T18:06:08.308857+0000","last_peered":"2024-09-12T18:06:08.308857+0000","last_clean":"2024-09-12T18:06:08.308857+0000","last_became_active":"2024-09-12T17:29:54.959140+0000","last_became_peered":"2024-09-12T17:29:54.959140+0000","last_unstale":"2024-09-12T18:06:08.308857+0000","last_undegraded":"2024-09-12T18:06:08.308857+0000","last_fullsized":"2024-09-12T18:06:08.308857+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:46.796125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":582,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'173","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.234904+0000","last_change":"2024-09-12T17:29:52.964678+0000","last_active":"2024-09-12T18:05:29.234904+0000","last_peered":"2024-09-12T18:05:29.234904+0000","last_clean":"2024-09-12T18:05:29.234904+0000","last_became_active":"2024-09-12T17:29:52.964339+0000","last_became_peered":"2024-09-12T17:29:52.964339+0000","last_unstale":"2024-09-12T18:05:29.234904+0000","last_undegraded":"2024-09-12T18:05:29.234904+0000","last_fullsized":"2024-09-12T18:05:29.234904+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:23.502950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4544464,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":377,"num_read_kb":1621,"num_write":862,"num_write_kb":10562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.638636+0000","last_change":"2024-09-12T17:29:56.954142+0000","last_active":"2024-09-12T18:04:39.638636+0000","last_peered":"2024-09-12T18:04:39.638636+0000","last_clean":"2024-09-12T18:04:39.638636+0000","last_became_active":"2024-09-12T17:29:56.953551+0000","last_became_peered":"2024-09-12T17:29:56.953551+0000","last_unstale":"2024-09-12T18:04:39.638636+0000","last_undegraded":"2024-09-12T18:04:39.638636+0000","last_fullsized":"2024-09-12T18:04:39.638636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:50.189739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'121","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.538665+0000","last_change":"2024-09-12T17:29:58.953621+0000","last_active":"2024-09-12T18:05:59.538665+0000","last_peered":"2024-09-12T18:05:59.538665+0000","last_clean":"2024-09-12T18:05:59.538665+0000","last_became_active":"2024-09-12T17:29:58.953107+0000","last_became_peered":"2024-09-12T17:29:58.953107+0000","last_unstale":"2024-09-12T18:05:59.538665+0000","last_undegraded":"2024-09-12T18:05:59.538665+0000","last_fullsized":"2024-09-12T18:05:59.538665+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:20.703344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11955,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":154,"num_read_kb":222,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.525616+0000","last_change":"2024-09-12T17:30:00.961851+0000","last_active":"2024-09-12T18:04:54.525616+0000","last_peered":"2024-09-12T18:04:54.525616+0000","last_clean":"2024-09-12T18:04:54.525616+0000","last_became_active":"2024-09-12T17:30:00.961545+0000","last_became_peered":"2024-09-12T17:30:00.961545+0000","last_unstale":"2024-09-12T18:04:54.525616+0000","last_undegraded":"2024-09-12T18:04:54.525616+0000","last_fullsized":"2024-09-12T18:04:54.525616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:46.146649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'85","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:28.622892+0000","last_change":"2024-09-12T17:30:02.967776+0000","last_active":"2024-09-12T18:07:28.622892+0000","last_peered":"2024-09-12T18:07:28.622892+0000","last_clean":"2024-09-12T18:07:28.622892+0000","last_became_active":"2024-09-12T17:30:02.967500+0000","last_became_peered":"2024-09-12T17:30:02.967500+0000","last_unstale":"2024-09-12T18:07:28.622892+0000","last_undegraded":"2024-09-12T18:07:28.622892+0000","last_fullsized":"2024-09-12T18:07:28.622892+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:21.856163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":199,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'67","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:28.210721+0000","last_change":"2024-09-12T17:29:54.960258+0000","last_active":"2024-09-12T18:05:28.210721+0000","last_peered":"2024-09-12T18:05:28.210721+0000","last_clean":"2024-09-12T18:05:28.210721+0000","last_became_active":"2024-09-12T17:29:54.959979+0000","last_became_peered":"2024-09-12T17:29:54.959979+0000","last_unstale":"2024-09-12T18:05:28.210721+0000","last_undegraded":"2024-09-12T18:05:28.210721+0000","last_fullsized":"2024-09-12T18:05:28.210721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:30.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":252,"num_write":105,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'335","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:41.731550+0000","last_change":"2024-09-12T17:29:52.957702+0000","last_active":"2024-09-12T18:05:41.731550+0000","last_peered":"2024-09-12T18:05:41.731550+0000","last_clean":"2024-09-12T18:05:41.731550+0000","last_became_active":"2024-09-12T17:29:52.957308+0000","last_became_peered":"2024-09-12T17:29:52.957308+0000","last_unstale":"2024-09-12T18:05:41.731550+0000","last_undegraded":"2024-09-12T18:05:41.731550+0000","last_fullsized":"2024-09-12T18:05:41.731550+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:52.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1994342,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":830,"num_read_kb":24052,"num_write":1266,"num_write_kb":42343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'4","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.599934+0000","last_change":"2024-09-12T17:29:56.959495+0000","last_active":"2024-09-12T18:07:38.599934+0000","last_peered":"2024-09-12T18:07:38.599934+0000","last_clean":"2024-09-12T18:07:38.599934+0000","last_became_active":"2024-09-12T17:29:56.959206+0000","last_became_peered":"2024-09-12T17:29:56.959206+0000","last_unstale":"2024-09-12T18:07:38.599934+0000","last_undegraded":"2024-09-12T18:07:38.599934+0000","last_fullsized":"2024-09-12T18:07:38.599934+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:54.257647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'154","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.770021+0000","last_change":"2024-09-12T17:29:58.956025+0000","last_active":"2024-09-12T18:07:37.770021+0000","last_peered":"2024-09-12T18:07:37.770021+0000","last_clean":"2024-09-12T18:07:37.770021+0000","last_became_active":"2024-09-12T17:29:58.955698+0000","last_became_peered":"2024-09-12T17:29:58.955698+0000","last_unstale":"2024-09-12T18:07:37.770021+0000","last_undegraded":"2024-09-12T18:07:37.770021+0000","last_fullsized":"2024-09-12T18:07:37.770021+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:21.001386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9820,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":188,"num_read_kb":244,"num_write":108,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'760","reported_seq":2323,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.692388+0000","last_change":"2024-09-12T17:30:00.967003+0000","last_active":"2024-09-12T18:07:38.692388+0000","last_peered":"2024-09-12T18:07:38.692388+0000","last_clean":"2024-09-12T18:07:38.692388+0000","last_became_active":"2024-09-12T17:30:00.966661+0000","last_became_peered":"2024-09-12T17:30:00.966661+0000","last_unstale":"2024-09-12T18:07:38.692388+0000","last_undegraded":"2024-09-12T18:07:38.692388+0000","last_fullsized":"2024-09-12T18:07:38.692388+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:57.546741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'107","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.730576+0000","last_change":"2024-09-12T17:30:02.970504+0000","last_active":"2024-09-12T18:07:37.730576+0000","last_peered":"2024-09-12T18:07:37.730576+0000","last_clean":"2024-09-12T18:07:37.730576+0000","last_became_active":"2024-09-12T17:30:02.969837+0000","last_became_peered":"2024-09-12T17:30:02.969837+0000","last_unstale":"2024-09-12T18:07:37.730576+0000","last_undegraded":"2024-09-12T18:07:37.730576+0000","last_fullsized":"2024-09-12T18:07:37.730576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:09.306140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":259,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'232","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.631061+0000","last_change":"2024-09-12T17:30:28.004554+0000","last_active":"2024-09-12T18:03:39.631061+0000","last_peered":"2024-09-12T18:03:39.631061+0000","last_clean":"2024-09-12T18:03:39.631061+0000","last_became_active":"2024-09-12T17:30:28.004234+0000","last_became_peered":"2024-09-12T17:30:28.004234+0000","last_unstale":"2024-09-12T18:03:39.631061+0000","last_undegraded":"2024-09-12T18:03:39.631061+0000","last_fullsized":"2024-09-12T18:03:39.631061+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:30.577975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":779,"num_write":354,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'201","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.300333+0000","last_change":"2024-09-12T17:29:52.952108+0000","last_active":"2024-09-12T18:06:19.300333+0000","last_peered":"2024-09-12T18:06:19.300333+0000","last_clean":"2024-09-12T18:06:19.300333+0000","last_became_active":"2024-09-12T17:29:52.951442+0000","last_became_peered":"2024-09-12T17:29:52.951442+0000","last_unstale":"2024-09-12T18:06:19.300333+0000","last_undegraded":"2024-09-12T18:06:19.300333+0000","last_fullsized":"2024-09-12T18:06:19.300333+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:21.862788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11973788,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":473,"num_read_kb":16166,"num_write":928,"num_write_kb":36148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639431+0000","last_change":"2024-09-12T17:29:56.956309+0000","last_active":"2024-09-12T18:04:44.639431+0000","last_peered":"2024-09-12T18:04:44.639431+0000","last_clean":"2024-09-12T18:04:44.639431+0000","last_became_active":"2024-09-12T17:29:56.955948+0000","last_became_peered":"2024-09-12T17:29:56.955948+0000","last_unstale":"2024-09-12T18:04:44.639431+0000","last_undegraded":"2024-09-12T18:04:44.639431+0000","last_fullsized":"2024-09-12T18:04:44.639431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:39.319625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'194","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.642522+0000","last_change":"2024-09-12T17:29:58.958169+0000","last_active":"2024-09-12T18:07:38.642522+0000","last_peered":"2024-09-12T18:07:38.642522+0000","last_clean":"2024-09-12T18:07:38.642522+0000","last_became_active":"2024-09-12T17:29:58.957183+0000","last_became_peered":"2024-09-12T17:29:58.957183+0000","last_unstale":"2024-09-12T18:07:38.642522+0000","last_undegraded":"2024-09-12T18:07:38.642522+0000","last_fullsized":"2024-09-12T18:07:38.642522+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:19.712371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18981,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":356,"num_write":124,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639403+0000","last_change":"2024-09-12T17:30:00.958337+0000","last_active":"2024-09-12T18:04:44.639403+0000","last_peered":"2024-09-12T18:04:44.639403+0000","last_clean":"2024-09-12T18:04:44.639403+0000","last_became_active":"2024-09-12T17:30:00.958049+0000","last_became_peered":"2024-09-12T17:30:00.958049+0000","last_unstale":"2024-09-12T18:04:44.639403+0000","last_undegraded":"2024-09-12T18:04:44.639403+0000","last_fullsized":"2024-09-12T18:04:44.639403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:24.880580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'146","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.020504+0000","last_change":"2024-09-12T17:30:02.970369+0000","last_active":"2024-09-12T18:05:56.020504+0000","last_peered":"2024-09-12T18:05:56.020504+0000","last_clean":"2024-09-12T18:05:56.020504+0000","last_became_active":"2024-09-12T17:30:02.970095+0000","last_became_peered":"2024-09-12T17:30:02.970095+0000","last_unstale":"2024-09-12T18:05:56.020504+0000","last_undegraded":"2024-09-12T18:05:56.020504+0000","last_fullsized":"2024-09-12T18:05:56.020504+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:20.676163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":173,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'179","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.253509+0000","last_change":"2024-09-12T17:29:54.957178+0000","last_active":"2024-09-12T18:05:56.253509+0000","last_peered":"2024-09-12T18:05:56.253509+0000","last_clean":"2024-09-12T18:05:56.253509+0000","last_became_active":"2024-09-12T17:29:54.956850+0000","last_became_peered":"2024-09-12T17:29:54.956850+0000","last_unstale":"2024-09-12T18:05:56.253509+0000","last_undegraded":"2024-09-12T18:05:56.253509+0000","last_fullsized":"2024-09-12T18:05:56.253509+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:59.322551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":712,"num_read_kb":607,"num_write":242,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'174","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.297648+0000","last_change":"2024-09-12T17:29:52.959240+0000","last_active":"2024-09-12T18:06:19.297648+0000","last_peered":"2024-09-12T18:06:19.297648+0000","last_clean":"2024-09-12T18:06:19.297648+0000","last_became_active":"2024-09-12T17:29:52.958919+0000","last_became_peered":"2024-09-12T17:29:52.958919+0000","last_unstale":"2024-09-12T18:06:19.297648+0000","last_undegraded":"2024-09-12T18:06:19.297648+0000","last_fullsized":"2024-09-12T18:06:19.297648+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:33.354065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12930272,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":324,"num_read_kb":13812,"num_write":936,"num_write_kb":31717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.630825+0000","last_change":"2024-09-12T17:29:56.955564+0000","last_active":"2024-09-12T18:03:44.630825+0000","last_peered":"2024-09-12T18:03:44.630825+0000","last_clean":"2024-09-12T18:03:44.630825+0000","last_became_active":"2024-09-12T17:29:56.955288+0000","last_became_peered":"2024-09-12T17:29:56.955288+0000","last_unstale":"2024-09-12T18:03:44.630825+0000","last_undegraded":"2024-09-12T18:03:44.630825+0000","last_fullsized":"2024-09-12T18:03:44.630825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:03.688076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'136","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.523117+0000","last_change":"2024-09-12T17:29:58.953188+0000","last_active":"2024-09-12T18:05:59.523117+0000","last_peered":"2024-09-12T18:05:59.523117+0000","last_clean":"2024-09-12T18:05:59.523117+0000","last_became_active":"2024-09-12T17:29:58.952878+0000","last_became_peered":"2024-09-12T17:29:58.952878+0000","last_unstale":"2024-09-12T18:05:59.523117+0000","last_undegraded":"2024-09-12T18:05:59.523117+0000","last_fullsized":"2024-09-12T18:05:59.523117+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:06.356317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7441,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":233,"num_write":152,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633179+0000","last_change":"2024-09-12T17:30:00.970962+0000","last_active":"2024-09-12T18:03:54.633179+0000","last_peered":"2024-09-12T18:03:54.633179+0000","last_clean":"2024-09-12T18:03:54.633179+0000","last_became_active":"2024-09-12T17:30:00.970668+0000","last_became_peered":"2024-09-12T17:30:00.970668+0000","last_unstale":"2024-09-12T18:03:54.633179+0000","last_undegraded":"2024-09-12T18:03:54.633179+0000","last_fullsized":"2024-09-12T18:03:54.633179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:09.749573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'138","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.302849+0000","last_change":"2024-09-12T17:30:02.964408+0000","last_active":"2024-09-12T18:06:21.302849+0000","last_peered":"2024-09-12T18:06:21.302849+0000","last_clean":"2024-09-12T18:06:21.302849+0000","last_became_active":"2024-09-12T17:30:02.964125+0000","last_became_peered":"2024-09-12T17:30:02.964125+0000","last_unstale":"2024-09-12T18:06:21.302849+0000","last_undegraded":"2024-09-12T18:06:21.302849+0000","last_fullsized":"2024-09-12T18:06:21.302849+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:51.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":200,"num_read_kb":186,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'123","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.807408+0000","last_change":"2024-09-12T17:29:54.958681+0000","last_active":"2024-09-12T18:05:55.807408+0000","last_peered":"2024-09-12T18:05:55.807408+0000","last_clean":"2024-09-12T18:05:55.807408+0000","last_became_active":"2024-09-12T17:29:54.956019+0000","last_became_peered":"2024-09-12T17:29:54.956019+0000","last_unstale":"2024-09-12T18:05:55.807408+0000","last_undegraded":"2024-09-12T18:05:55.807408+0000","last_fullsized":"2024-09-12T18:05:55.807408+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:52.410372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":560,"num_read_kb":466,"num_write":179,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'194","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:15.446945+0000","last_change":"2024-09-12T17:29:52.951444+0000","last_active":"2024-09-12T18:05:15.446945+0000","last_peered":"2024-09-12T18:05:15.446945+0000","last_clean":"2024-09-12T18:05:15.446945+0000","last_became_active":"2024-09-12T17:29:52.951013+0000","last_became_peered":"2024-09-12T17:29:52.951013+0000","last_unstale":"2024-09-12T18:05:15.446945+0000","last_undegraded":"2024-09-12T18:05:15.446945+0000","last_fullsized":"2024-09-12T18:05:15.446945+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:26.659611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24709,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":472,"num_read_kb":90183,"num_write":905,"num_write_kb":29071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.632112+0000","last_change":"2024-09-12T17:29:56.959688+0000","last_active":"2024-09-12T18:03:44.632112+0000","last_peered":"2024-09-12T18:03:44.632112+0000","last_clean":"2024-09-12T18:03:44.632112+0000","last_became_active":"2024-09-12T17:29:56.959436+0000","last_became_peered":"2024-09-12T17:29:56.959436+0000","last_unstale":"2024-09-12T18:03:44.632112+0000","last_undegraded":"2024-09-12T18:03:44.632112+0000","last_fullsized":"2024-09-12T18:03:44.632112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:17.810253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'138","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.649246+0000","last_change":"2024-09-12T17:29:58.954865+0000","last_active":"2024-09-12T18:06:04.649246+0000","last_peered":"2024-09-12T18:06:04.649246+0000","last_clean":"2024-09-12T18:06:04.649246+0000","last_became_active":"2024-09-12T17:29:58.954548+0000","last_became_peered":"2024-09-12T17:29:58.954548+0000","last_unstale":"2024-09-12T18:06:04.649246+0000","last_undegraded":"2024-09-12T18:06:04.649246+0000","last_fullsized":"2024-09-12T18:06:04.649246+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:57.732564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15394,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":183,"num_read_kb":244,"num_write":102,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'730","reported_seq":2374,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.688693+0000","last_change":"2024-09-12T17:30:00.960694+0000","last_active":"2024-09-12T18:07:38.688693+0000","last_peered":"2024-09-12T18:07:38.688693+0000","last_clean":"2024-09-12T18:07:38.688693+0000","last_became_active":"2024-09-12T17:30:00.960402+0000","last_became_peered":"2024-09-12T17:30:00.960402+0000","last_unstale":"2024-09-12T18:07:38.688693+0000","last_undegraded":"2024-09-12T18:07:38.688693+0000","last_fullsized":"2024-09-12T18:07:38.688693+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:14.850575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'95","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.486123+0000","last_change":"2024-09-12T17:30:02.969918+0000","last_active":"2024-09-12T18:06:20.486123+0000","last_peered":"2024-09-12T18:06:20.486123+0000","last_clean":"2024-09-12T18:06:20.486123+0000","last_became_active":"2024-09-12T17:30:02.969617+0000","last_became_peered":"2024-09-12T17:30:02.969617+0000","last_unstale":"2024-09-12T18:06:20.486123+0000","last_undegraded":"2024-09-12T18:06:20.486123+0000","last_fullsized":"2024-09-12T18:06:20.486123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:08.908464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":242,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'118","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.647063+0000","last_change":"2024-09-12T17:29:54.959321+0000","last_active":"2024-09-12T18:06:06.647063+0000","last_peered":"2024-09-12T18:06:06.647063+0000","last_clean":"2024-09-12T18:06:06.647063+0000","last_became_active":"2024-09-12T17:29:54.958362+0000","last_became_peered":"2024-09-12T17:29:54.958362+0000","last_unstale":"2024-09-12T18:06:06.647063+0000","last_undegraded":"2024-09-12T18:06:06.647063+0000","last_fullsized":"2024-09-12T18:06:06.647063+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:49.275936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":415,"num_write":164,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'161","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.481795+0000","last_change":"2024-09-12T17:30:28.005494+0000","last_active":"2024-09-12T18:05:57.481795+0000","last_peered":"2024-09-12T18:05:57.481795+0000","last_clean":"2024-09-12T18:05:57.481795+0000","last_became_active":"2024-09-12T17:30:28.005099+0000","last_became_peered":"2024-09-12T17:30:28.005099+0000","last_unstale":"2024-09-12T18:05:57.481795+0000","last_undegraded":"2024-09-12T18:05:57.481795+0000","last_fullsized":"2024-09-12T18:05:57.481795+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:40.351778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27238,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":402,"num_read_kb":6854,"num_write":852,"num_write_kb":33010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.610781+0000","last_change":"2024-09-12T17:29:56.955646+0000","last_active":"2024-09-12T18:07:38.610781+0000","last_peered":"2024-09-12T18:07:38.610781+0000","last_clean":"2024-09-12T18:07:38.610781+0000","last_became_active":"2024-09-12T17:29:56.955321+0000","last_became_peered":"2024-09-12T17:29:56.955321+0000","last_unstale":"2024-09-12T18:07:38.610781+0000","last_undegraded":"2024-09-12T18:07:38.610781+0000","last_fullsized":"2024-09-12T18:07:38.610781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:06.863842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'79","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.538704+0000","last_change":"2024-09-12T17:29:58.978790+0000","last_active":"2024-09-12T18:05:59.538704+0000","last_peered":"2024-09-12T18:05:59.538704+0000","last_clean":"2024-09-12T18:05:59.538704+0000","last_became_active":"2024-09-12T17:29:58.978480+0000","last_became_peered":"2024-09-12T17:29:58.978480+0000","last_unstale":"2024-09-12T18:05:59.538704+0000","last_undegraded":"2024-09-12T18:05:59.538704+0000","last_fullsized":"2024-09-12T18:05:59.538704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:05.359700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'756","reported_seq":4524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.689646+0000","last_change":"2024-09-12T17:30:00.959471+0000","last_active":"2024-09-12T18:07:38.689646+0000","last_peered":"2024-09-12T18:07:38.689646+0000","last_clean":"2024-09-12T18:07:38.689646+0000","last_became_active":"2024-09-12T17:30:00.959015+0000","last_became_peered":"2024-09-12T17:30:00.959015+0000","last_unstale":"2024-09-12T18:07:38.689646+0000","last_undegraded":"2024-09-12T18:07:38.689646+0000","last_fullsized":"2024-09-12T18:07:38.689646+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:29.861180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'126","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.966308+0000","last_change":"2024-09-12T17:30:02.972327+0000","last_active":"2024-09-12T18:06:01.966308+0000","last_peered":"2024-09-12T18:06:01.966308+0000","last_clean":"2024-09-12T18:06:01.966308+0000","last_became_active":"2024-09-12T17:30:02.972020+0000","last_became_peered":"2024-09-12T17:30:02.972020+0000","last_unstale":"2024-09-12T18:06:01.966308+0000","last_undegraded":"2024-09-12T18:06:01.966308+0000","last_fullsized":"2024-09-12T18:06:01.966308+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.485323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":156,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.376221+0000","last_change":"2024-09-12T17:29:54.951231+0000","last_active":"2024-09-12T18:05:29.376221+0000","last_peered":"2024-09-12T18:05:29.376221+0000","last_clean":"2024-09-12T18:05:29.376221+0000","last_became_active":"2024-09-12T17:29:54.950966+0000","last_became_peered":"2024-09-12T17:29:54.950966+0000","last_unstale":"2024-09-12T18:05:29.376221+0000","last_undegraded":"2024-09-12T18:05:29.376221+0000","last_fullsized":"2024-09-12T18:05:29.376221+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:59.344136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":955,"num_read_kb":788,"num_write":339,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'175","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.456384+0000","last_change":"2024-09-12T17:29:52.948919+0000","last_active":"2024-09-12T18:06:08.456384+0000","last_peered":"2024-09-12T18:06:08.456384+0000","last_clean":"2024-09-12T18:06:08.456384+0000","last_became_active":"2024-09-12T17:29:52.948591+0000","last_became_peered":"2024-09-12T17:29:52.948591+0000","last_unstale":"2024-09-12T18:06:08.456384+0000","last_undegraded":"2024-09-12T18:06:08.456384+0000","last_fullsized":"2024-09-12T18:06:08.456384+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:40.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7552392,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":2966,"num_write":840,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.504222+0000","last_change":"2024-09-12T17:29:56.953681+0000","last_active":"2024-09-12T18:03:44.504222+0000","last_peered":"2024-09-12T18:03:44.504222+0000","last_clean":"2024-09-12T18:03:44.504222+0000","last_became_active":"2024-09-12T17:29:56.953198+0000","last_became_peered":"2024-09-12T17:29:56.953198+0000","last_unstale":"2024-09-12T18:03:44.504222+0000","last_undegraded":"2024-09-12T18:03:44.504222+0000","last_fullsized":"2024-09-12T18:03:44.504222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:26.233204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'186","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:35.847732+0000","last_change":"2024-09-12T17:29:58.957118+0000","last_active":"2024-09-12T18:06:35.847732+0000","last_peered":"2024-09-12T18:06:35.847732+0000","last_clean":"2024-09-12T18:06:35.847732+0000","last_became_active":"2024-09-12T17:29:58.956828+0000","last_became_peered":"2024-09-12T17:29:58.956828+0000","last_unstale":"2024-09-12T18:06:35.847732+0000","last_undegraded":"2024-09-12T18:06:35.847732+0000","last_fullsized":"2024-09-12T18:06:35.847732+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:05.359700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12042,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":832,"num_read_kb":892,"num_write":1324,"num_write_kb":1208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.504747+0000","last_change":"2024-09-12T17:30:00.963569+0000","last_active":"2024-09-12T18:03:49.504747+0000","last_peered":"2024-09-12T18:03:49.504747+0000","last_clean":"2024-09-12T18:03:49.504747+0000","last_became_active":"2024-09-12T17:30:00.963117+0000","last_became_peered":"2024-09-12T17:30:00.963117+0000","last_unstale":"2024-09-12T18:03:49.504747+0000","last_undegraded":"2024-09-12T18:03:49.504747+0000","last_fullsized":"2024-09-12T18:03:49.504747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:47.856522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'115","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.931424+0000","last_change":"2024-09-12T17:30:02.963673+0000","last_active":"2024-09-12T18:06:00.931424+0000","last_peered":"2024-09-12T18:06:00.931424+0000","last_clean":"2024-09-12T18:06:00.931424+0000","last_became_active":"2024-09-12T17:30:02.963368+0000","last_became_peered":"2024-09-12T17:30:02.963368+0000","last_unstale":"2024-09-12T18:06:00.931424+0000","last_undegraded":"2024-09-12T18:06:00.931424+0000","last_fullsized":"2024-09-12T18:06:00.931424+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:30.008139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":267,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'271","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:51.069613+0000","last_change":"2024-09-12T17:29:54.960752+0000","last_active":"2024-09-12T18:05:51.069613+0000","last_peered":"2024-09-12T18:05:51.069613+0000","last_clean":"2024-09-12T18:05:51.069613+0000","last_became_active":"2024-09-12T17:29:54.960486+0000","last_became_peered":"2024-09-12T17:29:54.960486+0000","last_unstale":"2024-09-12T18:05:51.069613+0000","last_undegraded":"2024-09-12T18:05:51.069613+0000","last_fullsized":"2024-09-12T18:05:51.069613+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:09.952438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1268,"num_write":469,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:44.688092+0000","last_change":"2024-09-12T17:29:36.164552+0000","last_active":"2024-09-12T18:05:44.688092+0000","last_peered":"2024-09-12T18:05:44.688092+0000","last_clean":"2024-09-12T18:05:44.688092+0000","last_became_active":"2024-09-12T17:29:36.163604+0000","last_became_peered":"2024-09-12T17:29:36.163604+0000","last_unstale":"2024-09-12T18:05:44.688092+0000","last_undegraded":"2024-09-12T18:05:44.688092+0000","last_fullsized":"2024-09-12T18:05:44.688092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.896766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.896766+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.896766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:35.293197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.640572+0000","last_change":"2024-09-12T17:29:43.975243+0000","last_active":"2024-09-12T18:05:09.640572+0000","last_peered":"2024-09-12T18:05:09.640572+0000","last_clean":"2024-09-12T18:05:09.640572+0000","last_became_active":"2024-09-12T17:29:41.963643+0000","last_became_peered":"2024-09-12T17:29:41.963643+0000","last_unstale":"2024-09-12T18:05:09.640572+0000","last_undegraded":"2024-09-12T18:05:09.640572+0000","last_fullsized":"2024-09-12T18:05:09.640572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:57.226626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056994999999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'200","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.275860+0000","last_change":"2024-09-12T17:29:52.955756+0000","last_active":"2024-09-12T18:05:29.275860+0000","last_peered":"2024-09-12T18:05:29.275860+0000","last_clean":"2024-09-12T18:05:29.275860+0000","last_became_active":"2024-09-12T17:29:52.954839+0000","last_became_peered":"2024-09-12T17:29:52.954839+0000","last_unstale":"2024-09-12T18:05:29.275860+0000","last_undegraded":"2024-09-12T18:05:29.275860+0000","last_fullsized":"2024-09-12T18:05:29.275860+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:54.464363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7720365,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":442,"num_read_kb":3372,"num_write":1034,"num_write_kb":36567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.685110+0000","last_change":"2024-09-12T17:29:56.955566+0000","last_active":"2024-09-12T18:05:24.685110+0000","last_peered":"2024-09-12T18:05:24.685110+0000","last_clean":"2024-09-12T18:05:24.685110+0000","last_became_active":"2024-09-12T17:29:56.955260+0000","last_became_peered":"2024-09-12T17:29:56.955260+0000","last_unstale":"2024-09-12T18:05:24.685110+0000","last_undegraded":"2024-09-12T18:05:24.685110+0000","last_fullsized":"2024-09-12T18:05:24.685110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:09.539939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'287","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.658767+0000","last_change":"2024-09-12T17:29:58.954504+0000","last_active":"2024-09-12T18:07:38.658767+0000","last_peered":"2024-09-12T18:07:38.658767+0000","last_clean":"2024-09-12T18:07:38.658767+0000","last_became_active":"2024-09-12T17:29:58.954205+0000","last_became_peered":"2024-09-12T17:29:58.954205+0000","last_unstale":"2024-09-12T18:07:38.658767+0000","last_undegraded":"2024-09-12T18:07:38.658767+0000","last_fullsized":"2024-09-12T18:07:38.658767+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:15.729749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":698,"num_write":486,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640713+0000","last_change":"2024-09-12T17:30:00.964518+0000","last_active":"2024-09-12T18:04:44.640713+0000","last_peered":"2024-09-12T18:04:44.640713+0000","last_clean":"2024-09-12T18:04:44.640713+0000","last_became_active":"2024-09-12T17:30:00.964241+0000","last_became_peered":"2024-09-12T17:30:00.964241+0000","last_unstale":"2024-09-12T18:04:44.640713+0000","last_undegraded":"2024-09-12T18:04:44.640713+0000","last_fullsized":"2024-09-12T18:04:44.640713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:14.242835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'221","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.251802+0000","last_change":"2024-09-12T17:30:02.964194+0000","last_active":"2024-09-12T18:06:21.251802+0000","last_peered":"2024-09-12T18:06:21.251802+0000","last_clean":"2024-09-12T18:06:21.251802+0000","last_became_active":"2024-09-12T17:30:02.963890+0000","last_became_peered":"2024-09-12T17:30:02.963890+0000","last_unstale":"2024-09-12T18:06:21.251802+0000","last_undegraded":"2024-09-12T18:06:21.251802+0000","last_fullsized":"2024-09-12T18:06:21.251802+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.997124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":552,"num_write":485,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'384","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.127003+0000","last_change":"2024-09-12T17:29:54.946209+0000","last_active":"2024-09-12T18:06:19.127003+0000","last_peered":"2024-09-12T18:06:19.127003+0000","last_clean":"2024-09-12T18:06:19.127003+0000","last_became_active":"2024-09-12T17:29:54.944624+0000","last_became_peered":"2024-09-12T17:29:54.944624+0000","last_unstale":"2024-09-12T18:06:19.127003+0000","last_undegraded":"2024-09-12T18:06:19.127003+0000","last_fullsized":"2024-09-12T18:06:19.127003+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:39.689437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1668,"num_read_kb":1443,"num_write":651,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:49.688854+0000","last_change":"2024-09-12T17:29:43.985359+0000","last_active":"2024-09-12T18:05:49.688854+0000","last_peered":"2024-09-12T18:05:49.688854+0000","last_clean":"2024-09-12T18:05:49.688854+0000","last_became_active":"2024-09-12T17:29:41.963499+0000","last_became_peered":"2024-09-12T17:29:41.963499+0000","last_unstale":"2024-09-12T18:05:49.688854+0000","last_undegraded":"2024-09-12T18:05:49.688854+0000","last_fullsized":"2024-09-12T18:05:49.688854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:34.267982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470655,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'146","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.500222+0000","last_change":"2024-09-12T17:29:52.949670+0000","last_active":"2024-09-12T18:05:54.500222+0000","last_peered":"2024-09-12T18:05:54.500222+0000","last_clean":"2024-09-12T18:05:54.500222+0000","last_became_active":"2024-09-12T17:29:52.949339+0000","last_became_peered":"2024-09-12T17:29:52.949339+0000","last_unstale":"2024-09-12T18:05:54.500222+0000","last_undegraded":"2024-09-12T18:05:54.500222+0000","last_fullsized":"2024-09-12T18:05:54.500222+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:19.928095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244268,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":390,"num_read_kb":3075,"num_write":748,"num_write_kb":23555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.635977+0000","last_change":"2024-09-12T17:29:56.954436+0000","last_active":"2024-09-12T18:04:39.635977+0000","last_peered":"2024-09-12T18:04:39.635977+0000","last_clean":"2024-09-12T18:04:39.635977+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:04:39.635977+0000","last_undegraded":"2024-09-12T18:04:39.635977+0000","last_fullsized":"2024-09-12T18:04:39.635977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:38.720237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'773","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.683830+0000","last_change":"2024-09-12T17:29:58.958558+0000","last_active":"2024-09-12T18:07:38.683830+0000","last_peered":"2024-09-12T18:07:38.683830+0000","last_clean":"2024-09-12T18:07:38.683830+0000","last_became_active":"2024-09-12T17:29:58.958269+0000","last_became_peered":"2024-09-12T17:29:58.958269+0000","last_unstale":"2024-09-12T18:07:38.683830+0000","last_undegraded":"2024-09-12T18:07:38.683830+0000","last_fullsized":"2024-09-12T18:07:38.683830+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:14.582465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44041,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1107,"num_read_kb":1266,"num_write":230,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:34.686581+0000","last_change":"2024-09-12T17:30:00.958433+0000","last_active":"2024-09-12T18:05:34.686581+0000","last_peered":"2024-09-12T18:05:34.686581+0000","last_clean":"2024-09-12T18:05:34.686581+0000","last_became_active":"2024-09-12T17:30:00.957628+0000","last_became_peered":"2024-09-12T17:30:00.957628+0000","last_unstale":"2024-09-12T18:05:34.686581+0000","last_undegraded":"2024-09-12T18:05:34.686581+0000","last_fullsized":"2024-09-12T18:05:34.686581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.962381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'136","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.227859+0000","last_change":"2024-09-12T17:30:02.960607+0000","last_active":"2024-09-12T18:05:52.227859+0000","last_peered":"2024-09-12T18:05:52.227859+0000","last_clean":"2024-09-12T18:05:52.227859+0000","last_became_active":"2024-09-12T17:30:02.960109+0000","last_became_peered":"2024-09-12T17:30:02.960109+0000","last_unstale":"2024-09-12T18:05:52.227859+0000","last_undegraded":"2024-09-12T18:05:52.227859+0000","last_fullsized":"2024-09-12T18:05:52.227859+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:27.244929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":318,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'88","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.991113+0000","last_change":"2024-09-12T17:29:54.958561+0000","last_active":"2024-09-12T18:06:07.991113+0000","last_peered":"2024-09-12T18:06:07.991113+0000","last_clean":"2024-09-12T18:06:07.991113+0000","last_became_active":"2024-09-12T17:29:54.958310+0000","last_became_peered":"2024-09-12T17:29:54.958310+0000","last_unstale":"2024-09-12T18:06:07.991113+0000","last_undegraded":"2024-09-12T18:06:07.991113+0000","last_fullsized":"2024-09-12T18:06:07.991113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:54.864495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":367,"num_read_kb":311,"num_write":135,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.642763+0000","last_change":"2024-09-12T17:29:44.204001+0000","last_active":"2024-09-12T18:05:09.642763+0000","last_peered":"2024-09-12T18:05:09.642763+0000","last_clean":"2024-09-12T18:05:09.642763+0000","last_became_active":"2024-09-12T17:29:42.064972+0000","last_became_peered":"2024-09-12T17:29:42.064972+0000","last_unstale":"2024-09-12T18:05:09.642763+0000","last_undegraded":"2024-09-12T18:05:09.642763+0000","last_fullsized":"2024-09-12T18:05:09.642763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.574136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047741400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'206","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.652642+0000","last_change":"2024-09-12T17:29:52.949699+0000","last_active":"2024-09-12T18:05:59.652642+0000","last_peered":"2024-09-12T18:05:59.652642+0000","last_clean":"2024-09-12T18:05:59.652642+0000","last_became_active":"2024-09-12T17:29:52.949301+0000","last_became_peered":"2024-09-12T17:29:52.949301+0000","last_unstale":"2024-09-12T18:05:59.652642+0000","last_undegraded":"2024-09-12T18:05:59.652642+0000","last_fullsized":"2024-09-12T18:05:59.652642+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:56.930560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6416875,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":479,"num_read_kb":2667,"num_write":1029,"num_write_kb":7887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.638711+0000","last_change":"2024-09-12T17:29:56.956881+0000","last_active":"2024-09-12T18:04:39.638711+0000","last_peered":"2024-09-12T18:04:39.638711+0000","last_clean":"2024-09-12T18:04:39.638711+0000","last_became_active":"2024-09-12T17:29:56.956623+0000","last_became_peered":"2024-09-12T17:29:56.956623+0000","last_unstale":"2024-09-12T18:04:39.638711+0000","last_undegraded":"2024-09-12T18:04:39.638711+0000","last_fullsized":"2024-09-12T18:04:39.638711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:54.110865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'210","reported_seq":1203,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:35.761738+0000","last_change":"2024-09-12T17:29:58.980974+0000","last_active":"2024-09-12T18:07:35.761738+0000","last_peered":"2024-09-12T18:07:35.761738+0000","last_clean":"2024-09-12T18:07:35.761738+0000","last_became_active":"2024-09-12T17:29:58.980697+0000","last_became_peered":"2024-09-12T17:29:58.980697+0000","last_unstale":"2024-09-12T18:07:35.761738+0000","last_undegraded":"2024-09-12T18:07:35.761738+0000","last_fullsized":"2024-09-12T18:07:35.761738+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:02.768234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":123,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648081+0000","last_change":"2024-09-12T17:30:00.968730+0000","last_active":"2024-09-12T18:05:29.648081+0000","last_peered":"2024-09-12T18:05:29.648081+0000","last_clean":"2024-09-12T18:05:29.648081+0000","last_became_active":"2024-09-12T17:30:00.968468+0000","last_became_peered":"2024-09-12T17:30:00.968468+0000","last_unstale":"2024-09-12T18:05:29.648081+0000","last_undegraded":"2024-09-12T18:05:29.648081+0000","last_fullsized":"2024-09-12T18:05:29.648081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:49.912468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'248","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.956406+0000","last_change":"2024-09-12T17:30:02.967215+0000","last_active":"2024-09-12T18:06:20.956406+0000","last_peered":"2024-09-12T18:06:20.956406+0000","last_clean":"2024-09-12T18:06:20.956406+0000","last_became_active":"2024-09-12T17:30:02.966910+0000","last_became_peered":"2024-09-12T17:30:02.966910+0000","last_unstale":"2024-09-12T18:06:20.956406+0000","last_undegraded":"2024-09-12T18:06:20.956406+0000","last_fullsized":"2024-09-12T18:06:20.956406+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":529,"num_write":537,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'112","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.763591+0000","last_change":"2024-09-12T17:29:54.948794+0000","last_active":"2024-09-12T18:07:37.763591+0000","last_peered":"2024-09-12T18:07:37.763591+0000","last_clean":"2024-09-12T18:07:37.763591+0000","last_became_active":"2024-09-12T17:29:54.948402+0000","last_became_peered":"2024-09-12T17:29:54.948402+0000","last_unstale":"2024-09-12T18:07:37.763591+0000","last_undegraded":"2024-09-12T18:07:37.763591+0000","last_fullsized":"2024-09-12T18:07:37.763591+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:23.995374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":452,"num_write":172,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.640533+0000","last_change":"2024-09-12T17:29:43.975620+0000","last_active":"2024-09-12T18:05:09.640533+0000","last_peered":"2024-09-12T18:05:09.640533+0000","last_clean":"2024-09-12T18:05:09.640533+0000","last_became_active":"2024-09-12T17:29:41.961122+0000","last_became_peered":"2024-09-12T17:29:41.961122+0000","last_unstale":"2024-09-12T18:05:09.640533+0000","last_undegraded":"2024-09-12T18:05:09.640533+0000","last_fullsized":"2024-09-12T18:05:09.640533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.143106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095277999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'240","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.721978+0000","last_change":"2024-09-12T17:29:52.958960+0000","last_active":"2024-09-12T18:05:54.721978+0000","last_peered":"2024-09-12T18:05:54.721978+0000","last_clean":"2024-09-12T18:05:54.721978+0000","last_became_active":"2024-09-12T17:29:52.958406+0000","last_became_peered":"2024-09-12T17:29:52.958406+0000","last_unstale":"2024-09-12T18:05:54.721978+0000","last_undegraded":"2024-09-12T18:05:54.721978+0000","last_fullsized":"2024-09-12T18:05:54.721978+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:53.477079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728679,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":48737,"num_write":1096,"num_write_kb":63490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648110+0000","last_change":"2024-09-12T17:29:56.954279+0000","last_active":"2024-09-12T18:05:29.648110+0000","last_peered":"2024-09-12T18:05:29.648110+0000","last_clean":"2024-09-12T18:05:29.648110+0000","last_became_active":"2024-09-12T17:29:56.954018+0000","last_became_peered":"2024-09-12T17:29:56.954018+0000","last_unstale":"2024-09-12T18:05:29.648110+0000","last_undegraded":"2024-09-12T18:05:29.648110+0000","last_fullsized":"2024-09-12T18:05:29.648110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.921260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'111","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:35.852981+0000","last_change":"2024-09-12T17:29:58.954279+0000","last_active":"2024-09-12T18:07:35.852981+0000","last_peered":"2024-09-12T18:07:35.852981+0000","last_clean":"2024-09-12T18:07:35.852981+0000","last_became_active":"2024-09-12T17:29:58.953909+0000","last_became_peered":"2024-09-12T17:29:58.953909+0000","last_unstale":"2024-09-12T18:07:35.852981+0000","last_undegraded":"2024-09-12T18:07:35.852981+0000","last_fullsized":"2024-09-12T18:07:35.852981+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:29.055630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":90,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.512851+0000","last_change":"2024-09-12T17:30:00.967582+0000","last_active":"2024-09-12T18:04:44.512851+0000","last_peered":"2024-09-12T18:04:44.512851+0000","last_clean":"2024-09-12T18:04:44.512851+0000","last_became_active":"2024-09-12T17:30:00.967279+0000","last_became_peered":"2024-09-12T17:30:00.967279+0000","last_unstale":"2024-09-12T18:04:44.512851+0000","last_undegraded":"2024-09-12T18:04:44.512851+0000","last_fullsized":"2024-09-12T18:04:44.512851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:05.249822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'207","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.809120+0000","last_change":"2024-09-12T17:30:02.969741+0000","last_active":"2024-09-12T18:05:55.809120+0000","last_peered":"2024-09-12T18:05:55.809120+0000","last_clean":"2024-09-12T18:05:55.809120+0000","last_became_active":"2024-09-12T17:30:02.969486+0000","last_became_peered":"2024-09-12T17:30:02.969486+0000","last_unstale":"2024-09-12T18:05:55.809120+0000","last_undegraded":"2024-09-12T18:05:55.809120+0000","last_fullsized":"2024-09-12T18:05:55.809120+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:39.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":397,"num_write":473,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'156","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.910434+0000","last_change":"2024-09-12T17:29:54.963961+0000","last_active":"2024-09-12T18:06:06.910434+0000","last_peered":"2024-09-12T18:06:06.910434+0000","last_clean":"2024-09-12T18:06:06.910434+0000","last_became_active":"2024-09-12T17:29:54.963669+0000","last_became_peered":"2024-09-12T17:29:54.963669+0000","last_unstale":"2024-09-12T18:06:06.910434+0000","last_undegraded":"2024-09-12T18:06:06.910434+0000","last_fullsized":"2024-09-12T18:06:06.910434+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:24.840068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":549,"num_write":259,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'200","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:31.236102+0000","last_change":"2024-09-12T17:29:52.954700+0000","last_active":"2024-09-12T18:05:31.236102+0000","last_peered":"2024-09-12T18:05:31.236102+0000","last_clean":"2024-09-12T18:05:31.236102+0000","last_became_active":"2024-09-12T17:29:52.954220+0000","last_became_peered":"2024-09-12T17:29:52.954220+0000","last_unstale":"2024-09-12T18:05:31.236102+0000","last_undegraded":"2024-09-12T18:05:31.236102+0000","last_fullsized":"2024-09-12T18:05:31.236102+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:30.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16799934,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":520,"num_read_kb":74998,"num_write":1061,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.645181+0000","last_change":"2024-09-12T17:29:43.966855+0000","last_active":"2024-09-12T18:05:09.645181+0000","last_peered":"2024-09-12T18:05:09.645181+0000","last_clean":"2024-09-12T18:05:09.645181+0000","last_became_active":"2024-09-12T17:29:42.064741+0000","last_became_peered":"2024-09-12T17:29:42.064741+0000","last_unstale":"2024-09-12T18:05:09.645181+0000","last_undegraded":"2024-09-12T18:05:09.645181+0000","last_fullsized":"2024-09-12T18:05:09.645181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:56.698152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043924099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647471+0000","last_change":"2024-09-12T17:29:56.955865+0000","last_active":"2024-09-12T18:05:24.647471+0000","last_peered":"2024-09-12T18:05:24.647471+0000","last_clean":"2024-09-12T18:05:24.647471+0000","last_became_active":"2024-09-12T17:29:56.955562+0000","last_became_peered":"2024-09-12T17:29:56.955562+0000","last_unstale":"2024-09-12T18:05:24.647471+0000","last_undegraded":"2024-09-12T18:05:24.647471+0000","last_fullsized":"2024-09-12T18:05:24.647471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:02.094255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'256","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.651372+0000","last_change":"2024-09-12T17:29:58.960788+0000","last_active":"2024-09-12T18:07:38.651372+0000","last_peered":"2024-09-12T18:07:38.651372+0000","last_clean":"2024-09-12T18:07:38.651372+0000","last_became_active":"2024-09-12T17:29:58.960410+0000","last_became_peered":"2024-09-12T17:29:58.960410+0000","last_unstale":"2024-09-12T18:07:38.651372+0000","last_undegraded":"2024-09-12T18:07:38.651372+0000","last_fullsized":"2024-09-12T18:07:38.651372+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:42.521026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21141,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":360,"num_read_kb":468,"num_write":234,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519052+0000","last_change":"2024-09-12T17:30:00.963954+0000","last_active":"2024-09-12T18:05:29.519052+0000","last_peered":"2024-09-12T18:05:29.519052+0000","last_clean":"2024-09-12T18:05:29.519052+0000","last_became_active":"2024-09-12T17:30:00.963660+0000","last_became_peered":"2024-09-12T17:30:00.963660+0000","last_unstale":"2024-09-12T18:05:29.519052+0000","last_undegraded":"2024-09-12T18:05:29.519052+0000","last_fullsized":"2024-09-12T18:05:29.519052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:07.402246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'169","reported_seq":678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.937429+0000","last_change":"2024-09-12T17:30:02.972165+0000","last_active":"2024-09-12T18:06:00.937429+0000","last_peered":"2024-09-12T18:06:00.937429+0000","last_clean":"2024-09-12T18:06:00.937429+0000","last_became_active":"2024-09-12T17:30:02.971807+0000","last_became_peered":"2024-09-12T17:30:02.971807+0000","last_unstale":"2024-09-12T18:06:00.937429+0000","last_undegraded":"2024-09-12T18:06:00.937429+0000","last_fullsized":"2024-09-12T18:06:00.937429+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:12.197480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":246,"num_write":442,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'190","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.624295+0000","last_change":"2024-09-12T17:29:54.959312+0000","last_active":"2024-09-12T18:05:26.624295+0000","last_peered":"2024-09-12T18:05:26.624295+0000","last_clean":"2024-09-12T18:05:26.624295+0000","last_became_active":"2024-09-12T17:29:54.958998+0000","last_became_peered":"2024-09-12T17:29:54.958998+0000","last_unstale":"2024-09-12T18:05:26.624295+0000","last_undegraded":"2024-09-12T18:05:26.624295+0000","last_fullsized":"2024-09-12T18:05:26.624295+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:32.259773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":764,"num_write":273,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'221","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:33.577392+0000","last_change":"2024-09-12T17:29:52.955784+0000","last_active":"2024-09-12T18:07:33.577392+0000","last_peered":"2024-09-12T18:07:33.577392+0000","last_clean":"2024-09-12T18:07:33.577392+0000","last_became_active":"2024-09-12T17:29:52.955429+0000","last_became_peered":"2024-09-12T17:29:52.955429+0000","last_unstale":"2024-09-12T18:07:33.577392+0000","last_undegraded":"2024-09-12T18:07:33.577392+0000","last_fullsized":"2024-09-12T18:07:33.577392+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:09.456649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3642728,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":39247,"num_write":987,"num_write_kb":44156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:14.683770+0000","last_change":"2024-09-12T17:29:43.985392+0000","last_active":"2024-09-12T18:05:14.683770+0000","last_peered":"2024-09-12T18:05:14.683770+0000","last_clean":"2024-09-12T18:05:14.683770+0000","last_became_active":"2024-09-12T17:29:42.064736+0000","last_became_peered":"2024-09-12T17:29:42.064736+0000","last_unstale":"2024-09-12T18:05:14.683770+0000","last_undegraded":"2024-09-12T18:05:14.683770+0000","last_fullsized":"2024-09-12T18:05:14.683770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:58.936927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045118300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518499+0000","last_change":"2024-09-12T17:29:56.957783+0000","last_active":"2024-09-12T18:05:24.518499+0000","last_peered":"2024-09-12T18:05:24.518499+0000","last_clean":"2024-09-12T18:05:24.518499+0000","last_became_active":"2024-09-12T17:29:56.957503+0000","last_became_peered":"2024-09-12T17:29:56.957503+0000","last_unstale":"2024-09-12T18:05:24.518499+0000","last_undegraded":"2024-09-12T18:05:24.518499+0000","last_fullsized":"2024-09-12T18:05:24.518499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:58.375801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'150","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.753445+0000","last_change":"2024-09-12T17:29:58.978826+0000","last_active":"2024-09-12T18:05:53.753445+0000","last_peered":"2024-09-12T18:05:53.753445+0000","last_clean":"2024-09-12T18:05:53.753445+0000","last_became_active":"2024-09-12T17:29:58.978487+0000","last_became_peered":"2024-09-12T17:29:58.978487+0000","last_unstale":"2024-09-12T18:05:53.753445+0000","last_undegraded":"2024-09-12T18:05:53.753445+0000","last_fullsized":"2024-09-12T18:05:53.753445+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:07.080227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":172,"num_read_kb":165,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'768","reported_seq":2440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.685983+0000","last_change":"2024-09-12T17:30:00.957003+0000","last_active":"2024-09-12T18:07:38.685983+0000","last_peered":"2024-09-12T18:07:38.685983+0000","last_clean":"2024-09-12T18:07:38.685983+0000","last_became_active":"2024-09-12T17:30:00.956655+0000","last_became_peered":"2024-09-12T17:30:00.956655+0000","last_unstale":"2024-09-12T18:07:38.685983+0000","last_undegraded":"2024-09-12T18:07:38.685983+0000","last_fullsized":"2024-09-12T18:07:38.685983+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:00.807981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'117","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:18.421406+0000","last_change":"2024-09-12T17:30:02.969523+0000","last_active":"2024-09-12T18:06:18.421406+0000","last_peered":"2024-09-12T18:06:18.421406+0000","last_clean":"2024-09-12T18:06:18.421406+0000","last_became_active":"2024-09-12T17:30:02.968978+0000","last_became_peered":"2024-09-12T17:30:02.968978+0000","last_unstale":"2024-09-12T18:06:18.421406+0000","last_undegraded":"2024-09-12T18:06:18.421406+0000","last_fullsized":"2024-09-12T18:06:18.421406+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:20.219209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1365,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":174,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'406","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.911679+0000","last_change":"2024-09-12T17:29:54.955693+0000","last_active":"2024-09-12T18:05:53.911679+0000","last_peered":"2024-09-12T18:05:53.911679+0000","last_clean":"2024-09-12T18:05:53.911679+0000","last_became_active":"2024-09-12T17:29:54.955170+0000","last_became_peered":"2024-09-12T17:29:54.955170+0000","last_unstale":"2024-09-12T18:05:53.911679+0000","last_undegraded":"2024-09-12T18:05:53.911679+0000","last_fullsized":"2024-09-12T18:05:53.911679+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:25.653731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1829,"num_read_kb":1585,"num_write":674,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'157","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.642860+0000","last_change":"2024-09-12T17:30:28.005223+0000","last_active":"2024-09-12T18:05:09.642860+0000","last_peered":"2024-09-12T18:05:09.642860+0000","last_clean":"2024-09-12T18:05:09.642860+0000","last_became_active":"2024-09-12T17:30:28.004804+0000","last_became_peered":"2024-09-12T17:30:28.004804+0000","last_unstale":"2024-09-12T18:05:09.642860+0000","last_undegraded":"2024-09-12T18:05:09.642860+0000","last_fullsized":"2024-09-12T18:05:09.642860+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:07.880016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10850256,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":331,"num_read_kb":56975,"num_write":791,"num_write_kb":25989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637817+0000","last_change":"2024-09-12T17:29:43.966900+0000","last_active":"2024-09-12T18:04:24.637817+0000","last_peered":"2024-09-12T18:04:24.637817+0000","last_clean":"2024-09-12T18:04:24.637817+0000","last_became_active":"2024-09-12T17:29:41.961194+0000","last_became_peered":"2024-09-12T17:29:41.961194+0000","last_unstale":"2024-09-12T18:04:24.637817+0000","last_undegraded":"2024-09-12T18:04:24.637817+0000","last_fullsized":"2024-09-12T18:04:24.637817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:52.853132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049442699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518488+0000","last_change":"2024-09-12T17:29:56.956156+0000","last_active":"2024-09-12T18:05:24.518488+0000","last_peered":"2024-09-12T18:05:24.518488+0000","last_clean":"2024-09-12T18:05:24.518488+0000","last_became_active":"2024-09-12T17:29:56.955865+0000","last_became_peered":"2024-09-12T17:29:56.955865+0000","last_unstale":"2024-09-12T18:05:24.518488+0000","last_undegraded":"2024-09-12T18:05:24.518488+0000","last_fullsized":"2024-09-12T18:05:24.518488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:29.721519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'96","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.072656+0000","last_change":"2024-09-12T17:29:58.954437+0000","last_active":"2024-09-12T18:05:52.072656+0000","last_peered":"2024-09-12T18:05:52.072656+0000","last_clean":"2024-09-12T18:05:52.072656+0000","last_became_active":"2024-09-12T17:29:58.953924+0000","last_became_peered":"2024-09-12T17:29:58.953924+0000","last_unstale":"2024-09-12T18:05:52.072656+0000","last_undegraded":"2024-09-12T18:05:52.072656+0000","last_fullsized":"2024-09-12T18:05:52.072656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:40.076452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":108,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'776","reported_seq":2089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.690589+0000","last_change":"2024-09-12T17:30:00.967465+0000","last_active":"2024-09-12T18:07:38.690589+0000","last_peered":"2024-09-12T18:07:38.690589+0000","last_clean":"2024-09-12T18:07:38.690589+0000","last_became_active":"2024-09-12T17:30:00.967168+0000","last_became_peered":"2024-09-12T17:30:00.967168+0000","last_unstale":"2024-09-12T18:07:38.690589+0000","last_undegraded":"2024-09-12T18:07:38.690589+0000","last_fullsized":"2024-09-12T18:07:38.690589+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:34.280045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'300","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.843665+0000","last_change":"2024-09-12T17:30:02.969830+0000","last_active":"2024-09-12T18:06:01.843665+0000","last_peered":"2024-09-12T18:06:01.843665+0000","last_clean":"2024-09-12T18:06:01.843665+0000","last_became_active":"2024-09-12T17:30:02.969526+0000","last_became_peered":"2024-09-12T17:30:02.969526+0000","last_unstale":"2024-09-12T18:06:01.843665+0000","last_undegraded":"2024-09-12T18:06:01.843665+0000","last_fullsized":"2024-09-12T18:06:01.843665+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:15.996494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":439,"num_write":657,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'44","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:23.880167+0000","last_change":"2024-09-12T17:29:54.958269+0000","last_active":"2024-09-12T18:05:23.880167+0000","last_peered":"2024-09-12T18:05:23.880167+0000","last_clean":"2024-09-12T18:05:23.880167+0000","last_became_active":"2024-09-12T17:29:54.957906+0000","last_became_peered":"2024-09-12T17:29:54.957906+0000","last_unstale":"2024-09-12T18:05:23.880167+0000","last_undegraded":"2024-09-12T18:05:23.880167+0000","last_fullsized":"2024-09-12T18:05:23.880167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:40.016834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":180,"num_write":59,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'208","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:22.236915+0000","last_change":"2024-09-12T17:30:28.007323+0000","last_active":"2024-09-12T18:05:22.236915+0000","last_peered":"2024-09-12T18:05:22.236915+0000","last_clean":"2024-09-12T18:05:22.236915+0000","last_became_active":"2024-09-12T17:30:28.006884+0000","last_became_peered":"2024-09-12T17:30:28.006884+0000","last_unstale":"2024-09-12T18:05:22.236915+0000","last_undegraded":"2024-09-12T18:05:22.236915+0000","last_fullsized":"2024-09-12T18:05:22.236915+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:19.123396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6643300,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":14673,"num_write":987,"num_write_kb":46674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.509953+0000","last_change":"2024-09-12T17:29:43.986874+0000","last_active":"2024-09-12T18:04:24.509953+0000","last_peered":"2024-09-12T18:04:24.509953+0000","last_clean":"2024-09-12T18:04:24.509953+0000","last_became_active":"2024-09-12T17:29:41.961477+0000","last_became_peered":"2024-09-12T17:29:41.961477+0000","last_unstale":"2024-09-12T18:04:24.509953+0000","last_undegraded":"2024-09-12T18:04:24.509953+0000","last_fullsized":"2024-09-12T18:04:24.509953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:09.932105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041855800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.518421+0000","last_change":"2024-09-12T17:29:56.954444+0000","last_active":"2024-09-12T18:04:09.518421+0000","last_peered":"2024-09-12T18:04:09.518421+0000","last_clean":"2024-09-12T18:04:09.518421+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:04:09.518421+0000","last_undegraded":"2024-09-12T18:04:09.518421+0000","last_fullsized":"2024-09-12T18:04:09.518421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:02.231915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'303","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.648148+0000","last_change":"2024-09-12T17:29:58.978547+0000","last_active":"2024-09-12T18:07:38.648148+0000","last_peered":"2024-09-12T18:07:38.648148+0000","last_clean":"2024-09-12T18:07:38.648148+0000","last_became_active":"2024-09-12T17:29:58.978222+0000","last_became_peered":"2024-09-12T17:29:58.978222+0000","last_unstale":"2024-09-12T18:07:38.648148+0000","last_undegraded":"2024-09-12T18:07:38.648148+0000","last_fullsized":"2024-09-12T18:07:38.648148+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.293800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43074,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":453,"num_read_kb":643,"num_write":242,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.534853+0000","last_change":"2024-09-12T17:30:00.968813+0000","last_active":"2024-09-12T18:05:29.534853+0000","last_peered":"2024-09-12T18:05:29.534853+0000","last_clean":"2024-09-12T18:05:29.534853+0000","last_became_active":"2024-09-12T17:30:00.968527+0000","last_became_peered":"2024-09-12T17:30:00.968527+0000","last_unstale":"2024-09-12T18:05:29.534853+0000","last_undegraded":"2024-09-12T18:05:29.534853+0000","last_fullsized":"2024-09-12T18:05:29.534853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:25.372195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'123","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.301030+0000","last_change":"2024-09-12T17:30:02.966314+0000","last_active":"2024-09-12T18:06:21.301030+0000","last_peered":"2024-09-12T18:06:21.301030+0000","last_clean":"2024-09-12T18:06:21.301030+0000","last_became_active":"2024-09-12T17:30:02.966018+0000","last_became_peered":"2024-09-12T17:30:02.966018+0000","last_unstale":"2024-09-12T18:06:21.301030+0000","last_undegraded":"2024-09-12T18:06:21.301030+0000","last_fullsized":"2024-09-12T18:06:21.301030+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:36.046680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":226,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'154","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.350541+0000","last_change":"2024-09-12T17:30:02.964433+0000","last_active":"2024-09-12T18:06:21.350541+0000","last_peered":"2024-09-12T18:06:21.350541+0000","last_clean":"2024-09-12T18:06:21.350541+0000","last_became_active":"2024-09-12T17:30:02.964133+0000","last_became_peered":"2024-09-12T17:30:02.964133+0000","last_unstale":"2024-09-12T18:06:21.350541+0000","last_undegraded":"2024-09-12T18:06:21.350541+0000","last_fullsized":"2024-09-12T18:06:21.350541+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:49.035962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":286,"num_write":383,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'104","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:05.138023+0000","last_change":"2024-09-12T17:29:54.955997+0000","last_active":"2024-09-12T18:06:05.138023+0000","last_peered":"2024-09-12T18:06:05.138023+0000","last_clean":"2024-09-12T18:06:05.138023+0000","last_became_active":"2024-09-12T17:29:54.955716+0000","last_became_peered":"2024-09-12T17:29:54.955716+0000","last_unstale":"2024-09-12T18:06:05.138023+0000","last_undegraded":"2024-09-12T18:06:05.138023+0000","last_fullsized":"2024-09-12T18:06:05.138023+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:34.910648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":383,"num_write":153,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'178","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:34.645556+0000","last_change":"2024-09-12T17:30:28.200904+0000","last_active":"2024-09-12T18:05:34.645556+0000","last_peered":"2024-09-12T18:05:34.645556+0000","last_clean":"2024-09-12T18:05:34.645556+0000","last_became_active":"2024-09-12T17:30:28.200487+0000","last_became_peered":"2024-09-12T17:30:28.200487+0000","last_unstale":"2024-09-12T18:05:34.645556+0000","last_undegraded":"2024-09-12T18:05:34.645556+0000","last_fullsized":"2024-09-12T18:05:34.645556+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:12.443062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485827,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":386,"num_read_kb":70105,"num_write":887,"num_write_kb":56875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643518+0000","last_change":"2024-09-12T17:29:56.952926+0000","last_active":"2024-09-12T18:04:59.643518+0000","last_peered":"2024-09-12T18:04:59.643518+0000","last_clean":"2024-09-12T18:04:59.643518+0000","last_became_active":"2024-09-12T17:29:56.952578+0000","last_became_peered":"2024-09-12T17:29:56.952578+0000","last_unstale":"2024-09-12T18:04:59.643518+0000","last_undegraded":"2024-09-12T18:04:59.643518+0000","last_fullsized":"2024-09-12T18:04:59.643518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:45.935353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'121","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.550099+0000","last_change":"2024-09-12T17:29:58.955397+0000","last_active":"2024-09-12T18:07:19.550099+0000","last_peered":"2024-09-12T18:07:19.550099+0000","last_clean":"2024-09-12T18:07:19.550099+0000","last_became_active":"2024-09-12T17:29:58.955111+0000","last_became_peered":"2024-09-12T17:29:58.955111+0000","last_unstale":"2024-09-12T18:07:19.550099+0000","last_undegraded":"2024-09-12T18:07:19.550099+0000","last_fullsized":"2024-09-12T18:07:19.550099+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.069692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31460,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":154,"num_read_kb":247,"num_write":80,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527389+0000","last_change":"2024-09-12T17:30:00.966432+0000","last_active":"2024-09-12T18:05:04.527389+0000","last_peered":"2024-09-12T18:05:04.527389+0000","last_clean":"2024-09-12T18:05:04.527389+0000","last_became_active":"2024-09-12T17:30:00.965975+0000","last_became_peered":"2024-09-12T17:30:00.965975+0000","last_unstale":"2024-09-12T18:05:04.527389+0000","last_undegraded":"2024-09-12T18:05:04.527389+0000","last_fullsized":"2024-09-12T18:05:04.527389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:47.435596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.885555+0000","last_change":"2024-09-12T17:30:02.966210+0000","last_active":"2024-09-12T18:06:08.885555+0000","last_peered":"2024-09-12T18:06:08.885555+0000","last_clean":"2024-09-12T18:06:08.885555+0000","last_became_active":"2024-09-12T17:30:02.965919+0000","last_became_peered":"2024-09-12T17:30:02.965919+0000","last_unstale":"2024-09-12T18:06:08.885555+0000","last_undegraded":"2024-09-12T18:06:08.885555+0000","last_fullsized":"2024-09-12T18:06:08.885555+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:02.212105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":165,"num_read_kb":151,"num_write":248,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'420","reported_seq":1167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.973572+0000","last_change":"2024-09-12T17:29:54.956088+0000","last_active":"2024-09-12T18:05:20.973572+0000","last_peered":"2024-09-12T18:05:20.973572+0000","last_clean":"2024-09-12T18:05:20.973572+0000","last_became_active":"2024-09-12T17:29:54.954477+0000","last_became_peered":"2024-09-12T17:29:54.954477+0000","last_unstale":"2024-09-12T18:05:20.973572+0000","last_undegraded":"2024-09-12T18:05:20.973572+0000","last_fullsized":"2024-09-12T18:05:20.973572+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:23.380497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1777,"num_write":781,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'209","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:27.766770+0000","last_change":"2024-09-12T17:29:52.956760+0000","last_active":"2024-09-12T18:05:27.766770+0000","last_peered":"2024-09-12T18:05:27.766770+0000","last_clean":"2024-09-12T18:05:27.766770+0000","last_became_active":"2024-09-12T17:29:52.956376+0000","last_became_peered":"2024-09-12T17:29:52.956376+0000","last_unstale":"2024-09-12T18:05:27.766770+0000","last_undegraded":"2024-09-12T18:05:27.766770+0000","last_fullsized":"2024-09-12T18:05:27.766770+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:50.307316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242984,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":420,"num_read_kb":36390,"num_write":985,"num_write_kb":36751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.526513+0000","last_change":"2024-09-12T17:29:56.955510+0000","last_active":"2024-09-12T18:04:59.526513+0000","last_peered":"2024-09-12T18:04:59.526513+0000","last_clean":"2024-09-12T18:04:59.526513+0000","last_became_active":"2024-09-12T17:29:56.955256+0000","last_became_peered":"2024-09-12T17:29:56.955256+0000","last_unstale":"2024-09-12T18:04:59.526513+0000","last_undegraded":"2024-09-12T18:04:59.526513+0000","last_fullsized":"2024-09-12T18:04:59.526513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:56.582465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'51","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.247475+0000","last_change":"2024-09-12T17:29:58.961027+0000","last_active":"2024-09-12T18:06:21.247475+0000","last_peered":"2024-09-12T18:06:21.247475+0000","last_clean":"2024-09-12T18:06:21.247475+0000","last_became_active":"2024-09-12T17:29:58.960476+0000","last_became_peered":"2024-09-12T17:29:58.960476+0000","last_unstale":"2024-09-12T18:06:21.247475+0000","last_undegraded":"2024-09-12T18:06:21.247475+0000","last_fullsized":"2024-09-12T18:06:21.247475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:15.254313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.682338+0000","last_change":"2024-09-12T17:30:00.958998+0000","last_active":"2024-09-12T18:05:04.682338+0000","last_peered":"2024-09-12T18:05:04.682338+0000","last_clean":"2024-09-12T18:05:04.682338+0000","last_became_active":"2024-09-12T17:30:00.958739+0000","last_became_peered":"2024-09-12T17:30:00.958739+0000","last_unstale":"2024-09-12T18:05:04.682338+0000","last_undegraded":"2024-09-12T18:05:04.682338+0000","last_fullsized":"2024-09-12T18:05:04.682338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:23.108221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'186","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.857340+0000","last_change":"2024-09-12T17:30:02.973036+0000","last_active":"2024-09-12T18:06:20.857340+0000","last_peered":"2024-09-12T18:06:20.857340+0000","last_clean":"2024-09-12T18:06:20.857340+0000","last_became_active":"2024-09-12T17:30:02.972717+0000","last_became_peered":"2024-09-12T17:30:02.972717+0000","last_unstale":"2024-09-12T18:06:20.857340+0000","last_undegraded":"2024-09-12T18:06:20.857340+0000","last_fullsized":"2024-09-12T18:06:20.857340+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:17.417135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":309,"num_read_kb":305,"num_write":411,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'235","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.884486+0000","last_change":"2024-09-12T17:29:54.956165+0000","last_active":"2024-09-12T18:06:08.884486+0000","last_peered":"2024-09-12T18:06:08.884486+0000","last_clean":"2024-09-12T18:06:08.884486+0000","last_became_active":"2024-09-12T17:29:54.955897+0000","last_became_peered":"2024-09-12T17:29:54.955897+0000","last_unstale":"2024-09-12T18:06:08.884486+0000","last_undegraded":"2024-09-12T18:06:08.884486+0000","last_fullsized":"2024-09-12T18:06:08.884486+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:12.755846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":344,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'242","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:02.614774+0000","last_change":"2024-09-12T17:29:52.955479+0000","last_active":"2024-09-12T18:06:02.614774+0000","last_peered":"2024-09-12T18:06:02.614774+0000","last_clean":"2024-09-12T18:06:02.614774+0000","last_became_active":"2024-09-12T17:29:52.954956+0000","last_became_peered":"2024-09-12T17:29:52.954956+0000","last_unstale":"2024-09-12T18:06:02.614774+0000","last_undegraded":"2024-09-12T18:06:02.614774+0000","last_fullsized":"2024-09-12T18:06:02.614774+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:37.430521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5794956,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":5380,"num_write":1206,"num_write_kb":40346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.681595+0000","last_change":"2024-09-12T17:29:56.959871+0000","last_active":"2024-09-12T18:04:59.681595+0000","last_peered":"2024-09-12T18:04:59.681595+0000","last_clean":"2024-09-12T18:04:59.681595+0000","last_became_active":"2024-09-12T17:29:56.959460+0000","last_became_peered":"2024-09-12T17:29:56.959460+0000","last_unstale":"2024-09-12T18:04:59.681595+0000","last_undegraded":"2024-09-12T18:04:59.681595+0000","last_fullsized":"2024-09-12T18:04:59.681595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:11.274542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'145","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.550161+0000","last_change":"2024-09-12T17:29:58.961137+0000","last_active":"2024-09-12T18:07:19.550161+0000","last_peered":"2024-09-12T18:07:19.550161+0000","last_clean":"2024-09-12T18:07:19.550161+0000","last_became_active":"2024-09-12T17:29:58.960824+0000","last_became_peered":"2024-09-12T17:29:58.960824+0000","last_unstale":"2024-09-12T18:07:19.550161+0000","last_undegraded":"2024-09-12T18:07:19.550161+0000","last_fullsized":"2024-09-12T18:07:19.550161+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:15.729749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6167,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":223,"num_write":102,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.515733+0000","last_change":"2024-09-12T17:30:00.967592+0000","last_active":"2024-09-12T18:05:04.515733+0000","last_peered":"2024-09-12T18:05:04.515733+0000","last_clean":"2024-09-12T18:05:04.515733+0000","last_became_active":"2024-09-12T17:30:00.967299+0000","last_became_peered":"2024-09-12T17:30:00.967299+0000","last_unstale":"2024-09-12T18:05:04.515733+0000","last_undegraded":"2024-09-12T18:05:04.515733+0000","last_fullsized":"2024-09-12T18:05:04.515733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:31.645270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'93","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.484386+0000","last_change":"2024-09-12T17:30:02.966660+0000","last_active":"2024-09-12T18:06:20.484386+0000","last_peered":"2024-09-12T18:06:20.484386+0000","last_clean":"2024-09-12T18:06:20.484386+0000","last_became_active":"2024-09-12T17:30:02.965644+0000","last_became_peered":"2024-09-12T17:30:02.965644+0000","last_unstale":"2024-09-12T18:06:20.484386+0000","last_undegraded":"2024-09-12T18:06:20.484386+0000","last_fullsized":"2024-09-12T18:06:20.484386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:15.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":207,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'4299","reported_seq":4944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.467541+0000","last_change":"2024-09-12T17:29:54.951955+0000","last_active":"2024-09-12T18:06:07.467541+0000","last_peered":"2024-09-12T18:06:07.467541+0000","last_clean":"2024-09-12T18:06:07.467541+0000","last_became_active":"2024-09-12T17:29:54.950407+0000","last_became_peered":"2024-09-12T17:29:54.950407+0000","last_unstale":"2024-09-12T18:06:07.467541+0000","last_undegraded":"2024-09-12T18:06:07.467541+0000","last_fullsized":"2024-09-12T18:06:07.467541+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:23.507143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17237,"num_read_kb":14347,"num_write":6471,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'174","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.126319+0000","last_change":"2024-09-12T17:29:52.963110+0000","last_active":"2024-09-12T18:06:01.126319+0000","last_peered":"2024-09-12T18:06:01.126319+0000","last_clean":"2024-09-12T18:06:01.126319+0000","last_became_active":"2024-09-12T17:29:52.962836+0000","last_became_peered":"2024-09-12T17:29:52.962836+0000","last_unstale":"2024-09-12T18:06:01.126319+0000","last_undegraded":"2024-09-12T18:06:01.126319+0000","last_fullsized":"2024-09-12T18:06:01.126319+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:33.047304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27545556,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":390,"num_read_kb":45090,"num_write":883,"num_write_kb":58788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.514939+0000","last_change":"2024-09-12T17:29:56.957363+0000","last_active":"2024-09-12T18:04:59.514939+0000","last_peered":"2024-09-12T18:04:59.514939+0000","last_clean":"2024-09-12T18:04:59.514939+0000","last_became_active":"2024-09-12T17:29:56.957066+0000","last_became_peered":"2024-09-12T17:29:56.957066+0000","last_unstale":"2024-09-12T18:04:59.514939+0000","last_undegraded":"2024-09-12T18:04:59.514939+0000","last_fullsized":"2024-09-12T18:04:59.514939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:23.450708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'148","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.701524+0000","last_change":"2024-09-12T17:29:58.955841+0000","last_active":"2024-09-12T18:07:19.701524+0000","last_peered":"2024-09-12T18:07:19.701524+0000","last_clean":"2024-09-12T18:07:19.701524+0000","last_became_active":"2024-09-12T17:29:58.955585+0000","last_became_peered":"2024-09-12T17:29:58.955585+0000","last_unstale":"2024-09-12T18:07:19.701524+0000","last_undegraded":"2024-09-12T18:07:19.701524+0000","last_fullsized":"2024-09-12T18:07:19.701524+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:03.552605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12664,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":164,"num_read_kb":221,"num_write":98,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644380+0000","last_change":"2024-09-12T17:30:00.965228+0000","last_active":"2024-09-12T18:05:04.644380+0000","last_peered":"2024-09-12T18:05:04.644380+0000","last_clean":"2024-09-12T18:05:04.644380+0000","last_became_active":"2024-09-12T17:30:00.964621+0000","last_became_peered":"2024-09-12T17:30:00.964621+0000","last_unstale":"2024-09-12T18:05:04.644380+0000","last_undegraded":"2024-09-12T18:05:04.644380+0000","last_fullsized":"2024-09-12T18:05:04.644380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:28.006617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'546","reported_seq":1344,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517857+0000","last_change":"2024-09-12T17:29:54.959133+0000","last_active":"2024-09-12T18:05:19.517857+0000","last_peered":"2024-09-12T18:05:19.517857+0000","last_clean":"2024-09-12T18:05:19.517857+0000","last_became_active":"2024-09-12T17:29:54.958758+0000","last_became_peered":"2024-09-12T17:29:54.958758+0000","last_unstale":"2024-09-12T18:05:19.517857+0000","last_undegraded":"2024-09-12T18:05:19.517857+0000","last_fullsized":"2024-09-12T18:05:19.517857+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:49.827603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2571,"num_read_kb":2181,"num_write":951,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'207","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.106442+0000","last_change":"2024-09-12T17:30:28.007406+0000","last_active":"2024-09-12T18:05:57.106442+0000","last_peered":"2024-09-12T18:05:57.106442+0000","last_clean":"2024-09-12T18:05:57.106442+0000","last_became_active":"2024-09-12T17:30:28.007001+0000","last_became_peered":"2024-09-12T17:30:28.007001+0000","last_unstale":"2024-09-12T18:05:57.106442+0000","last_undegraded":"2024-09-12T18:05:57.106442+0000","last_fullsized":"2024-09-12T18:05:57.106442+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:46.585635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15991744,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":573,"num_read_kb":31262,"num_write":913,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634516+0000","last_change":"2024-09-12T17:29:56.954814+0000","last_active":"2024-09-12T18:04:04.634516+0000","last_peered":"2024-09-12T18:04:04.634516+0000","last_clean":"2024-09-12T18:04:04.634516+0000","last_became_active":"2024-09-12T17:29:56.954498+0000","last_became_peered":"2024-09-12T17:29:56.954498+0000","last_unstale":"2024-09-12T18:04:04.634516+0000","last_undegraded":"2024-09-12T18:04:04.634516+0000","last_fullsized":"2024-09-12T18:04:04.634516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:39.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'182","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.644829+0000","last_change":"2024-09-12T17:29:58.958482+0000","last_active":"2024-09-12T18:07:38.644829+0000","last_peered":"2024-09-12T18:07:38.644829+0000","last_clean":"2024-09-12T18:07:38.644829+0000","last_became_active":"2024-09-12T17:29:58.958198+0000","last_became_peered":"2024-09-12T17:29:58.958198+0000","last_unstale":"2024-09-12T18:07:38.644829+0000","last_undegraded":"2024-09-12T18:07:38.644829+0000","last_fullsized":"2024-09-12T18:07:38.644829+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:03.636909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23630,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":276,"num_read_kb":397,"num_write":176,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.639853+0000","last_change":"2024-09-12T17:30:00.964218+0000","last_active":"2024-09-12T18:05:04.639853+0000","last_peered":"2024-09-12T18:05:04.639853+0000","last_clean":"2024-09-12T18:05:04.639853+0000","last_became_active":"2024-09-12T17:30:00.963706+0000","last_became_peered":"2024-09-12T17:30:00.963706+0000","last_unstale":"2024-09-12T18:05:04.639853+0000","last_undegraded":"2024-09-12T18:05:04.639853+0000","last_fullsized":"2024-09-12T18:05:04.639853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:42.210305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'175","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.667499+0000","last_change":"2024-09-12T17:30:02.964954+0000","last_active":"2024-09-12T18:06:08.667499+0000","last_peered":"2024-09-12T18:06:08.667499+0000","last_clean":"2024-09-12T18:06:08.667499+0000","last_became_active":"2024-09-12T17:30:02.964682+0000","last_became_peered":"2024-09-12T17:30:02.964682+0000","last_unstale":"2024-09-12T18:06:08.667499+0000","last_undegraded":"2024-09-12T18:06:08.667499+0000","last_fullsized":"2024-09-12T18:06:08.667499+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:18.544576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":239,"num_read_kb":250,"num_write":415,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'100","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.652523+0000","last_change":"2024-09-12T17:29:54.955631+0000","last_active":"2024-09-12T18:05:59.652523+0000","last_peered":"2024-09-12T18:05:59.652523+0000","last_clean":"2024-09-12T18:05:59.652523+0000","last_became_active":"2024-09-12T17:29:54.955326+0000","last_became_peered":"2024-09-12T17:29:54.955326+0000","last_unstale":"2024-09-12T18:05:59.652523+0000","last_undegraded":"2024-09-12T18:05:59.652523+0000","last_fullsized":"2024-09-12T18:05:59.652523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:49.289784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":334,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'216","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.390956+0000","last_change":"2024-09-12T17:29:52.946176+0000","last_active":"2024-09-12T18:06:06.390956+0000","last_peered":"2024-09-12T18:06:06.390956+0000","last_clean":"2024-09-12T18:06:06.390956+0000","last_became_active":"2024-09-12T17:29:52.945616+0000","last_became_peered":"2024-09-12T17:29:52.945616+0000","last_unstale":"2024-09-12T18:06:06.390956+0000","last_undegraded":"2024-09-12T18:06:06.390956+0000","last_fullsized":"2024-09-12T18:06:06.390956+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.047653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16164918,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":15300,"num_write":1079,"num_write_kb":27395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518557+0000","last_change":"2024-09-12T17:29:56.959423+0000","last_active":"2024-09-12T18:05:24.518557+0000","last_peered":"2024-09-12T18:05:24.518557+0000","last_clean":"2024-09-12T18:05:24.518557+0000","last_became_active":"2024-09-12T17:29:56.959047+0000","last_became_peered":"2024-09-12T17:29:56.959047+0000","last_unstale":"2024-09-12T18:05:24.518557+0000","last_undegraded":"2024-09-12T18:05:24.518557+0000","last_fullsized":"2024-09-12T18:05:24.518557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:03.525338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'141","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:29.703006+0000","last_change":"2024-09-12T17:29:58.955055+0000","last_active":"2024-09-12T18:07:29.703006+0000","last_peered":"2024-09-12T18:07:29.703006+0000","last_clean":"2024-09-12T18:07:29.703006+0000","last_became_active":"2024-09-12T17:29:58.954747+0000","last_became_peered":"2024-09-12T17:29:58.954747+0000","last_unstale":"2024-09-12T18:07:29.703006+0000","last_undegraded":"2024-09-12T18:07:29.703006+0000","last_fullsized":"2024-09-12T18:07:29.703006+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:01.106668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10981,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":186,"num_read_kb":237,"num_write":116,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644390+0000","last_change":"2024-09-12T17:30:00.960182+0000","last_active":"2024-09-12T18:05:04.644390+0000","last_peered":"2024-09-12T18:05:04.644390+0000","last_clean":"2024-09-12T18:05:04.644390+0000","last_became_active":"2024-09-12T17:30:00.959708+0000","last_became_peered":"2024-09-12T17:30:00.959708+0000","last_unstale":"2024-09-12T18:05:04.644390+0000","last_undegraded":"2024-09-12T18:05:04.644390+0000","last_fullsized":"2024-09-12T18:05:04.644390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:04.130612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'214","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.731228+0000","last_change":"2024-09-12T17:30:02.961235+0000","last_active":"2024-09-12T18:07:37.731228+0000","last_peered":"2024-09-12T18:07:37.731228+0000","last_clean":"2024-09-12T18:07:37.731228+0000","last_became_active":"2024-09-12T17:30:02.960928+0000","last_became_peered":"2024-09-12T17:30:02.960928+0000","last_unstale":"2024-09-12T18:07:37.731228+0000","last_undegraded":"2024-09-12T18:07:37.731228+0000","last_fullsized":"2024-09-12T18:07:37.731228+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:02.653466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":219,"num_write":570,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'158","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:03.287640+0000","last_change":"2024-09-12T17:29:54.951640+0000","last_active":"2024-09-12T18:06:03.287640+0000","last_peered":"2024-09-12T18:06:03.287640+0000","last_clean":"2024-09-12T18:06:03.287640+0000","last_became_active":"2024-09-12T17:29:54.950294+0000","last_became_peered":"2024-09-12T17:29:54.950294+0000","last_unstale":"2024-09-12T18:06:03.287640+0000","last_undegraded":"2024-09-12T18:06:03.287640+0000","last_fullsized":"2024-09-12T18:06:03.287640+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:35.954198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":567,"num_write":224,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'194","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.301434+0000","last_change":"2024-09-12T17:29:52.947774+0000","last_active":"2024-09-12T18:05:57.301434+0000","last_peered":"2024-09-12T18:05:57.301434+0000","last_clean":"2024-09-12T18:05:57.301434+0000","last_became_active":"2024-09-12T17:29:52.947363+0000","last_became_peered":"2024-09-12T17:29:52.947363+0000","last_unstale":"2024-09-12T18:05:57.301434+0000","last_undegraded":"2024-09-12T18:05:57.301434+0000","last_fullsized":"2024-09-12T18:05:57.301434+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:04.661665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6376533,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":718,"num_read_kb":129945,"num_write":976,"num_write_kb":26137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.515065+0000","last_change":"2024-09-12T17:29:56.952220+0000","last_active":"2024-09-12T18:04:59.515065+0000","last_peered":"2024-09-12T18:04:59.515065+0000","last_clean":"2024-09-12T18:04:59.515065+0000","last_became_active":"2024-09-12T17:29:56.951825+0000","last_became_peered":"2024-09-12T17:29:56.951825+0000","last_unstale":"2024-09-12T18:04:59.515065+0000","last_undegraded":"2024-09-12T18:04:59.515065+0000","last_fullsized":"2024-09-12T18:04:59.515065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.728224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'127","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:29.551350+0000","last_change":"2024-09-12T17:29:58.978881+0000","last_active":"2024-09-12T18:07:29.551350+0000","last_peered":"2024-09-12T18:07:29.551350+0000","last_clean":"2024-09-12T18:07:29.551350+0000","last_became_active":"2024-09-12T17:29:58.978506+0000","last_became_peered":"2024-09-12T17:29:58.978506+0000","last_unstale":"2024-09-12T18:07:29.551350+0000","last_undegraded":"2024-09-12T18:07:29.551350+0000","last_fullsized":"2024-09-12T18:07:29.551350+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:23.505523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8546,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":154,"num_read_kb":204,"num_write":82,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.635596+0000","last_change":"2024-09-12T17:30:00.965903+0000","last_active":"2024-09-12T18:04:09.635596+0000","last_peered":"2024-09-12T18:04:09.635596+0000","last_clean":"2024-09-12T18:04:09.635596+0000","last_became_active":"2024-09-12T17:30:00.965628+0000","last_became_peered":"2024-09-12T17:30:00.965628+0000","last_unstale":"2024-09-12T18:04:09.635596+0000","last_undegraded":"2024-09-12T18:04:09.635596+0000","last_fullsized":"2024-09-12T18:04:09.635596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:59.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'111","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.672413+0000","last_change":"2024-09-12T17:30:02.963569+0000","last_active":"2024-09-12T18:07:38.672413+0000","last_peered":"2024-09-12T18:07:38.672413+0000","last_clean":"2024-09-12T18:07:38.672413+0000","last_became_active":"2024-09-12T17:30:02.963242+0000","last_became_peered":"2024-09-12T17:30:02.963242+0000","last_unstale":"2024-09-12T18:07:38.672413+0000","last_undegraded":"2024-09-12T18:07:38.672413+0000","last_fullsized":"2024-09-12T18:07:38.672413+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:33.404263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'168","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.875016+0000","last_change":"2024-09-12T17:29:54.950700+0000","last_active":"2024-09-12T18:05:26.875016+0000","last_peered":"2024-09-12T18:05:26.875016+0000","last_clean":"2024-09-12T18:05:26.875016+0000","last_became_active":"2024-09-12T17:29:54.950429+0000","last_became_peered":"2024-09-12T17:29:54.950429+0000","last_unstale":"2024-09-12T18:05:26.875016+0000","last_undegraded":"2024-09-12T18:05:26.875016+0000","last_fullsized":"2024-09-12T18:05:26.875016+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:03.561091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":726,"num_read_kb":598,"num_write":255,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'194","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.730592+0000","last_change":"2024-09-12T17:29:52.967135+0000","last_active":"2024-09-12T18:05:20.730592+0000","last_peered":"2024-09-12T18:05:20.730592+0000","last_clean":"2024-09-12T18:05:20.730592+0000","last_became_active":"2024-09-12T17:29:52.966561+0000","last_became_peered":"2024-09-12T17:29:52.966561+0000","last_unstale":"2024-09-12T18:05:20.730592+0000","last_undegraded":"2024-09-12T18:05:20.730592+0000","last_fullsized":"2024-09-12T18:05:20.730592+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:12.665280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":383,"num_read_kb":24994,"num_write":950,"num_write_kb":31573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643585+0000","last_change":"2024-09-12T17:29:56.959683+0000","last_active":"2024-09-12T18:04:59.643585+0000","last_peered":"2024-09-12T18:04:59.643585+0000","last_clean":"2024-09-12T18:04:59.643585+0000","last_became_active":"2024-09-12T17:29:56.959185+0000","last_became_peered":"2024-09-12T17:29:56.959185+0000","last_unstale":"2024-09-12T18:04:59.643585+0000","last_undegraded":"2024-09-12T18:04:59.643585+0000","last_fullsized":"2024-09-12T18:04:59.643585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:49.577878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'60","reported_seq":573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.221013+0000","last_change":"2024-09-12T17:29:58.978897+0000","last_active":"2024-09-12T18:05:53.221013+0000","last_peered":"2024-09-12T18:05:53.221013+0000","last_clean":"2024-09-12T18:05:53.221013+0000","last_became_active":"2024-09-12T17:29:58.978247+0000","last_became_peered":"2024-09-12T17:29:58.978247+0000","last_unstale":"2024-09-12T18:05:53.221013+0000","last_undegraded":"2024-09-12T18:05:53.221013+0000","last_fullsized":"2024-09-12T18:05:53.221013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:21.292974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":59,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'756","reported_seq":2182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.684833+0000","last_change":"2024-09-12T17:30:00.962301+0000","last_active":"2024-09-12T18:07:38.684833+0000","last_peered":"2024-09-12T18:07:38.684833+0000","last_clean":"2024-09-12T18:07:38.684833+0000","last_became_active":"2024-09-12T17:30:00.961928+0000","last_became_peered":"2024-09-12T17:30:00.961928+0000","last_unstale":"2024-09-12T18:07:38.684833+0000","last_undegraded":"2024-09-12T18:07:38.684833+0000","last_fullsized":"2024-09-12T18:07:38.684833+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:21.176614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'103","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.850274+0000","last_change":"2024-09-12T17:30:02.963767+0000","last_active":"2024-09-12T18:06:20.850274+0000","last_peered":"2024-09-12T18:06:20.850274+0000","last_clean":"2024-09-12T18:06:20.850274+0000","last_became_active":"2024-09-12T17:30:02.963474+0000","last_became_peered":"2024-09-12T17:30:02.963474+0000","last_unstale":"2024-09-12T18:06:20.850274+0000","last_undegraded":"2024-09-12T18:06:20.850274+0000","last_fullsized":"2024-09-12T18:06:20.850274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:06.653540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'461","reported_seq":1185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.916766+0000","last_change":"2024-09-12T17:29:54.956245+0000","last_active":"2024-09-12T18:05:56.916766+0000","last_peered":"2024-09-12T18:05:56.916766+0000","last_clean":"2024-09-12T18:05:56.916766+0000","last_became_active":"2024-09-12T17:29:54.954344+0000","last_became_peered":"2024-09-12T17:29:54.954344+0000","last_unstale":"2024-09-12T18:05:56.916766+0000","last_undegraded":"2024-09-12T18:05:56.916766+0000","last_fullsized":"2024-09-12T18:05:56.916766+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:54.059931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":1813,"num_write":696,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'213","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:28.839278+0000","last_change":"2024-09-12T17:30:28.008322+0000","last_active":"2024-09-12T18:05:28.839278+0000","last_peered":"2024-09-12T18:05:28.839278+0000","last_clean":"2024-09-12T18:05:28.839278+0000","last_became_active":"2024-09-12T17:30:28.008012+0000","last_became_peered":"2024-09-12T17:30:28.008012+0000","last_unstale":"2024-09-12T18:05:28.839278+0000","last_undegraded":"2024-09-12T18:05:28.839278+0000","last_fullsized":"2024-09-12T18:05:28.839278+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:35.056975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11908801,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":11221,"num_write":1054,"num_write_kb":38249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.681643+0000","last_change":"2024-09-12T17:29:56.959803+0000","last_active":"2024-09-12T18:04:59.681643+0000","last_peered":"2024-09-12T18:04:59.681643+0000","last_clean":"2024-09-12T18:04:59.681643+0000","last_became_active":"2024-09-12T17:29:56.959496+0000","last_became_peered":"2024-09-12T17:29:56.959496+0000","last_unstale":"2024-09-12T18:04:59.681643+0000","last_undegraded":"2024-09-12T18:04:59.681643+0000","last_fullsized":"2024-09-12T18:04:59.681643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:24.096051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'140","reported_seq":703,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.650628+0000","last_change":"2024-09-12T17:29:58.956511+0000","last_active":"2024-09-12T18:06:19.650628+0000","last_peered":"2024-09-12T18:06:19.650628+0000","last_clean":"2024-09-12T18:06:19.650628+0000","last_became_active":"2024-09-12T17:29:58.956214+0000","last_became_peered":"2024-09-12T17:29:58.956214+0000","last_unstale":"2024-09-12T18:06:19.650628+0000","last_undegraded":"2024-09-12T18:06:19.650628+0000","last_fullsized":"2024-09-12T18:06:19.650628+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.069692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9446,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":184,"num_read_kb":237,"num_write":104,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633054+0000","last_change":"2024-09-12T17:30:00.964427+0000","last_active":"2024-09-12T18:03:54.633054+0000","last_peered":"2024-09-12T18:03:54.633054+0000","last_clean":"2024-09-12T18:03:54.633054+0000","last_became_active":"2024-09-12T17:30:00.964150+0000","last_became_peered":"2024-09-12T17:30:00.964150+0000","last_unstale":"2024-09-12T18:03:54.633054+0000","last_undegraded":"2024-09-12T18:03:54.633054+0000","last_fullsized":"2024-09-12T18:03:54.633054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:38.024178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'176","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.255174+0000","last_change":"2024-09-12T17:30:02.972717+0000","last_active":"2024-09-12T18:05:56.255174+0000","last_peered":"2024-09-12T18:05:56.255174+0000","last_clean":"2024-09-12T18:05:56.255174+0000","last_became_active":"2024-09-12T17:30:02.972420+0000","last_became_peered":"2024-09-12T17:30:02.972420+0000","last_unstale":"2024-09-12T18:05:56.255174+0000","last_undegraded":"2024-09-12T18:05:56.255174+0000","last_fullsized":"2024-09-12T18:05:56.255174+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:00.149423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":302,"num_write":451,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'323","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.064215+0000","last_change":"2024-09-12T17:29:54.954336+0000","last_active":"2024-09-12T18:05:53.064215+0000","last_peered":"2024-09-12T18:05:53.064215+0000","last_clean":"2024-09-12T18:05:53.064215+0000","last_became_active":"2024-09-12T17:29:54.953626+0000","last_became_peered":"2024-09-12T17:29:54.953626+0000","last_unstale":"2024-09-12T18:05:53.064215+0000","last_undegraded":"2024-09-12T18:05:53.064215+0000","last_fullsized":"2024-09-12T18:05:53.064215+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:50.673324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1393,"num_read_kb":1115,"num_write":522,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'166","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.015143+0000","last_change":"2024-09-12T17:30:28.201293+0000","last_active":"2024-09-12T18:06:00.015143+0000","last_peered":"2024-09-12T18:06:00.015143+0000","last_clean":"2024-09-12T18:06:00.015143+0000","last_became_active":"2024-09-12T17:30:28.200981+0000","last_became_peered":"2024-09-12T17:30:28.200981+0000","last_unstale":"2024-09-12T18:06:00.015143+0000","last_undegraded":"2024-09-12T18:06:00.015143+0000","last_fullsized":"2024-09-12T18:06:00.015143+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:11.575396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6329538,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":372,"num_read_kb":41427,"num_write":830,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.639179+0000","last_change":"2024-09-12T17:29:56.955843+0000","last_active":"2024-09-12T18:04:59.639179+0000","last_peered":"2024-09-12T18:04:59.639179+0000","last_clean":"2024-09-12T18:04:59.639179+0000","last_became_active":"2024-09-12T17:29:56.955532+0000","last_became_peered":"2024-09-12T17:29:56.955532+0000","last_unstale":"2024-09-12T18:04:59.639179+0000","last_undegraded":"2024-09-12T18:04:59.639179+0000","last_fullsized":"2024-09-12T18:04:59.639179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:32.340336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'119","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.654225+0000","last_change":"2024-09-12T17:29:58.961115+0000","last_active":"2024-09-12T18:06:14.654225+0000","last_peered":"2024-09-12T18:06:14.654225+0000","last_clean":"2024-09-12T18:06:14.654225+0000","last_became_active":"2024-09-12T17:29:58.960733+0000","last_became_peered":"2024-09-12T17:29:58.960733+0000","last_unstale":"2024-09-12T18:06:14.654225+0000","last_undegraded":"2024-09-12T18:06:14.654225+0000","last_fullsized":"2024-09-12T18:06:14.654225+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:12.596344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11189,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":226,"num_write":80,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.507102+0000","last_change":"2024-09-12T17:30:00.960684+0000","last_active":"2024-09-12T18:04:04.507102+0000","last_peered":"2024-09-12T18:04:04.507102+0000","last_clean":"2024-09-12T18:04:04.507102+0000","last_became_active":"2024-09-12T17:30:00.960358+0000","last_became_peered":"2024-09-12T17:30:00.960358+0000","last_unstale":"2024-09-12T18:04:04.507102+0000","last_undegraded":"2024-09-12T18:04:04.507102+0000","last_fullsized":"2024-09-12T18:04:04.507102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:41.585720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'157","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.309864+0000","last_change":"2024-09-12T17:30:02.964368+0000","last_active":"2024-09-12T18:06:08.309864+0000","last_peered":"2024-09-12T18:06:08.309864+0000","last_clean":"2024-09-12T18:06:08.309864+0000","last_became_active":"2024-09-12T17:30:02.964082+0000","last_became_peered":"2024-09-12T17:30:02.964082+0000","last_unstale":"2024-09-12T18:06:08.309864+0000","last_undegraded":"2024-09-12T18:06:08.309864+0000","last_fullsized":"2024-09-12T18:06:08.309864+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:51.607971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":313,"num_read_kb":292,"num_write":397,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'219","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.313861+0000","last_change":"2024-09-12T17:29:54.945900+0000","last_active":"2024-09-12T18:06:01.313861+0000","last_peered":"2024-09-12T18:06:01.313861+0000","last_clean":"2024-09-12T18:06:01.313861+0000","last_became_active":"2024-09-12T17:29:54.945602+0000","last_became_peered":"2024-09-12T17:29:54.945602+0000","last_unstale":"2024-09-12T18:06:01.313861+0000","last_undegraded":"2024-09-12T18:06:01.313861+0000","last_fullsized":"2024-09-12T18:06:01.313861+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:32.630682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":778,"num_write":336,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'195","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.792203+0000","last_change":"2024-09-12T17:29:52.954797+0000","last_active":"2024-09-12T18:05:30.792203+0000","last_peered":"2024-09-12T18:05:30.792203+0000","last_clean":"2024-09-12T18:05:30.792203+0000","last_became_active":"2024-09-12T17:29:52.954457+0000","last_became_peered":"2024-09-12T17:29:52.954457+0000","last_unstale":"2024-09-12T18:05:30.792203+0000","last_undegraded":"2024-09-12T18:05:30.792203+0000","last_fullsized":"2024-09-12T18:05:30.792203+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:04.967724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10811276,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":410,"num_read_kb":114782,"num_write":974,"num_write_kb":45150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.504802+0000","last_change":"2024-09-12T17:29:56.953213+0000","last_active":"2024-09-12T18:03:49.504802+0000","last_peered":"2024-09-12T18:03:49.504802+0000","last_clean":"2024-09-12T18:03:49.504802+0000","last_became_active":"2024-09-12T17:29:56.952946+0000","last_became_peered":"2024-09-12T17:29:56.952946+0000","last_unstale":"2024-09-12T18:03:49.504802+0000","last_undegraded":"2024-09-12T18:03:49.504802+0000","last_fullsized":"2024-09-12T18:03:49.504802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:44.459531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'101","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:29.551281+0000","last_change":"2024-09-12T17:29:58.956494+0000","last_active":"2024-09-12T18:07:29.551281+0000","last_peered":"2024-09-12T18:07:29.551281+0000","last_clean":"2024-09-12T18:07:29.551281+0000","last_became_active":"2024-09-12T17:29:58.953283+0000","last_became_peered":"2024-09-12T17:29:58.953283+0000","last_unstale":"2024-09-12T18:07:29.551281+0000","last_undegraded":"2024-09-12T18:07:29.551281+0000","last_fullsized":"2024-09-12T18:07:29.551281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:18.253475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12298,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":145,"num_write":56,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.515722+0000","last_change":"2024-09-12T17:30:00.963002+0000","last_active":"2024-09-12T18:05:04.515722+0000","last_peered":"2024-09-12T18:05:04.515722+0000","last_clean":"2024-09-12T18:05:04.515722+0000","last_became_active":"2024-09-12T17:30:00.962703+0000","last_became_peered":"2024-09-12T17:30:00.962703+0000","last_unstale":"2024-09-12T18:05:04.515722+0000","last_undegraded":"2024-09-12T18:05:04.515722+0000","last_fullsized":"2024-09-12T18:05:04.515722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:05.219468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'181","reported_seq":1637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.718070+0000","last_change":"2024-09-12T17:30:02.970877+0000","last_active":"2024-09-12T18:06:19.718070+0000","last_peered":"2024-09-12T18:06:19.718070+0000","last_clean":"2024-09-12T18:06:19.718070+0000","last_became_active":"2024-09-12T17:30:02.970633+0000","last_became_peered":"2024-09-12T17:30:02.970633+0000","last_unstale":"2024-09-12T18:06:19.718070+0000","last_undegraded":"2024-09-12T18:06:19.718070+0000","last_fullsized":"2024-09-12T18:06:19.718070+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:13.976443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1219,"num_read_kb":1215,"num_write":406,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'173","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.446097+0000","last_change":"2024-09-12T17:29:54.955106+0000","last_active":"2024-09-12T18:06:06.446097+0000","last_peered":"2024-09-12T18:06:06.446097+0000","last_clean":"2024-09-12T18:06:06.446097+0000","last_became_active":"2024-09-12T17:29:54.954585+0000","last_became_peered":"2024-09-12T17:29:54.954585+0000","last_unstale":"2024-09-12T18:06:06.446097+0000","last_undegraded":"2024-09-12T18:06:06.446097+0000","last_fullsized":"2024-09-12T18:06:06.446097+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:16.804269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":606,"num_write":278,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'196","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.947535+0000","last_change":"2024-09-12T17:29:52.957088+0000","last_active":"2024-09-12T18:06:08.947535+0000","last_peered":"2024-09-12T18:06:08.947535+0000","last_clean":"2024-09-12T18:06:08.947535+0000","last_became_active":"2024-09-12T17:29:52.956621+0000","last_became_peered":"2024-09-12T17:29:52.956621+0000","last_unstale":"2024-09-12T18:06:08.947535+0000","last_undegraded":"2024-09-12T18:06:08.947535+0000","last_fullsized":"2024-09-12T18:06:08.947535+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:04.500292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13590676,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":906,"num_read_kb":17688,"num_write":1017,"num_write_kb":27781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633423+0000","last_change":"2024-09-12T17:29:56.955247+0000","last_active":"2024-09-12T18:03:54.633423+0000","last_peered":"2024-09-12T18:03:54.633423+0000","last_clean":"2024-09-12T18:03:54.633423+0000","last_became_active":"2024-09-12T17:29:56.954952+0000","last_became_peered":"2024-09-12T17:29:56.954952+0000","last_unstale":"2024-09-12T18:03:54.633423+0000","last_undegraded":"2024-09-12T18:03:54.633423+0000","last_fullsized":"2024-09-12T18:03:54.633423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:49.854222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'134","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:29.536122+0000","last_change":"2024-09-12T17:29:58.953367+0000","last_active":"2024-09-12T18:07:29.536122+0000","last_peered":"2024-09-12T18:07:29.536122+0000","last_clean":"2024-09-12T18:07:29.536122+0000","last_became_active":"2024-09-12T17:29:58.953076+0000","last_became_peered":"2024-09-12T17:29:58.953076+0000","last_unstale":"2024-09-12T18:07:29.536122+0000","last_undegraded":"2024-09-12T18:07:29.536122+0000","last_fullsized":"2024-09-12T18:07:29.536122+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:10.729622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11140,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":195,"num_read_kb":267,"num_write":108,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644366+0000","last_change":"2024-09-12T17:30:00.967059+0000","last_active":"2024-09-12T18:05:04.644366+0000","last_peered":"2024-09-12T18:05:04.644366+0000","last_clean":"2024-09-12T18:05:04.644366+0000","last_became_active":"2024-09-12T17:30:00.964942+0000","last_became_peered":"2024-09-12T17:30:00.964942+0000","last_unstale":"2024-09-12T18:05:04.644366+0000","last_undegraded":"2024-09-12T18:05:04.644366+0000","last_fullsized":"2024-09-12T18:05:04.644366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:59.160654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'116","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.763230+0000","last_change":"2024-09-12T17:30:02.969660+0000","last_active":"2024-09-12T18:07:37.763230+0000","last_peered":"2024-09-12T18:07:37.763230+0000","last_clean":"2024-09-12T18:07:37.763230+0000","last_became_active":"2024-09-12T17:30:02.969327+0000","last_became_peered":"2024-09-12T17:30:02.969327+0000","last_unstale":"2024-09-12T18:07:37.763230+0000","last_undegraded":"2024-09-12T18:07:37.763230+0000","last_fullsized":"2024-09-12T18:07:37.763230+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:11.229944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":150,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'198","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:02.136940+0000","last_change":"2024-09-12T17:29:54.956426+0000","last_active":"2024-09-12T18:06:02.136940+0000","last_peered":"2024-09-12T18:06:02.136940+0000","last_clean":"2024-09-12T18:06:02.136940+0000","last_became_active":"2024-09-12T17:29:54.956020+0000","last_became_peered":"2024-09-12T17:29:54.956020+0000","last_unstale":"2024-09-12T18:06:02.136940+0000","last_undegraded":"2024-09-12T18:06:02.136940+0000","last_fullsized":"2024-09-12T18:06:02.136940+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:46.756727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":702,"num_write":286,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'207","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.184629+0000","last_change":"2024-09-12T17:29:52.963730+0000","last_active":"2024-09-12T18:05:30.184629+0000","last_peered":"2024-09-12T18:05:30.184629+0000","last_clean":"2024-09-12T18:05:30.184629+0000","last_became_active":"2024-09-12T17:29:52.963118+0000","last_became_peered":"2024-09-12T17:29:52.963118+0000","last_unstale":"2024-09-12T18:05:30.184629+0000","last_undegraded":"2024-09-12T18:05:30.184629+0000","last_fullsized":"2024-09-12T18:05:30.184629+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:48.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5675346,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":2786,"num_write":993,"num_write_kb":44194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'222","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:27.059176+0000","last_change":"2024-09-12T17:29:54.947947+0000","last_active":"2024-09-12T18:05:27.059176+0000","last_peered":"2024-09-12T18:05:27.059176+0000","last_clean":"2024-09-12T18:05:27.059176+0000","last_became_active":"2024-09-12T17:29:54.947659+0000","last_became_peered":"2024-09-12T17:29:54.947659+0000","last_unstale":"2024-09-12T18:05:27.059176+0000","last_undegraded":"2024-09-12T18:05:27.059176+0000","last_fullsized":"2024-09-12T18:05:27.059176+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:03.080124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":954,"num_read_kb":780,"num_write":336,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'185","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:28.835935+0000","last_change":"2024-09-12T17:29:52.955863+0000","last_active":"2024-09-12T18:07:28.835935+0000","last_peered":"2024-09-12T18:07:28.835935+0000","last_clean":"2024-09-12T18:07:28.835935+0000","last_became_active":"2024-09-12T17:29:52.955546+0000","last_became_peered":"2024-09-12T17:29:52.955546+0000","last_unstale":"2024-09-12T18:07:28.835935+0000","last_undegraded":"2024-09-12T18:07:28.835935+0000","last_fullsized":"2024-09-12T18:07:28.835935+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:42.412076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10957292,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":626,"num_read_kb":171668,"num_write":900,"num_write_kb":49213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'156","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.113845+0000","last_change":"2024-09-12T17:29:54.958380+0000","last_active":"2024-09-12T18:06:09.113845+0000","last_peered":"2024-09-12T18:06:09.113845+0000","last_clean":"2024-09-12T18:06:09.113845+0000","last_became_active":"2024-09-12T17:29:54.958047+0000","last_became_peered":"2024-09-12T17:29:54.958047+0000","last_unstale":"2024-09-12T18:06:09.113845+0000","last_undegraded":"2024-09-12T18:06:09.113845+0000","last_fullsized":"2024-09-12T18:06:09.113845+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:44.328756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":718,"num_read_kb":592,"num_write":271,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'176","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.113932+0000","last_change":"2024-09-12T17:29:52.960525+0000","last_active":"2024-09-12T18:06:01.113932+0000","last_peered":"2024-09-12T18:06:01.113932+0000","last_clean":"2024-09-12T18:06:01.113932+0000","last_became_active":"2024-09-12T17:29:52.955924+0000","last_became_peered":"2024-09-12T17:29:52.955924+0000","last_unstale":"2024-09-12T18:06:01.113932+0000","last_undegraded":"2024-09-12T18:06:01.113932+0000","last_fullsized":"2024-09-12T18:06:01.113932+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:05.866424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4133406,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":445,"num_read_kb":86465,"num_write":875,"num_write_kb":34463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'67","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.807467+0000","last_change":"2024-09-12T17:29:54.956853+0000","last_active":"2024-09-12T18:05:09.807467+0000","last_peered":"2024-09-12T18:05:09.807467+0000","last_clean":"2024-09-12T18:05:09.807467+0000","last_became_active":"2024-09-12T17:29:54.956587+0000","last_became_peered":"2024-09-12T17:29:54.956587+0000","last_unstale":"2024-09-12T18:05:09.807467+0000","last_undegraded":"2024-09-12T18:05:09.807467+0000","last_fullsized":"2024-09-12T18:05:09.807467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:30.162589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":238,"num_write":111,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'188","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.507312+0000","last_change":"2024-09-12T17:29:52.961431+0000","last_active":"2024-09-12T18:05:29.507312+0000","last_peered":"2024-09-12T18:05:29.507312+0000","last_clean":"2024-09-12T18:05:29.507312+0000","last_became_active":"2024-09-12T17:29:52.961103+0000","last_became_peered":"2024-09-12T17:29:52.961103+0000","last_unstale":"2024-09-12T18:05:29.507312+0000","last_undegraded":"2024-09-12T18:05:29.507312+0000","last_fullsized":"2024-09-12T18:05:29.507312+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:36.469288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11159765,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":887,"num_read_kb":61034,"num_write":898,"num_write_kb":21974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'80","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.348999+0000","last_change":"2024-09-12T17:29:54.956259+0000","last_active":"2024-09-12T18:05:57.348999+0000","last_peered":"2024-09-12T18:05:57.348999+0000","last_clean":"2024-09-12T18:05:57.348999+0000","last_became_active":"2024-09-12T17:29:54.955986+0000","last_became_peered":"2024-09-12T17:29:54.955986+0000","last_unstale":"2024-09-12T18:05:57.348999+0000","last_undegraded":"2024-09-12T18:05:57.348999+0000","last_fullsized":"2024-09-12T18:05:57.348999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:45.758007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":303,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'230","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.138167+0000","last_change":"2024-09-12T17:31:28.509450+0000","last_active":"2024-09-12T18:06:08.138167+0000","last_peered":"2024-09-12T18:06:08.138167+0000","last_clean":"2024-09-12T18:06:08.138167+0000","last_became_active":"2024-09-12T17:31:28.509017+0000","last_became_peered":"2024-09-12T17:31:28.509017+0000","last_unstale":"2024-09-12T18:06:08.138167+0000","last_undegraded":"2024-09-12T18:06:08.138167+0000","last_fullsized":"2024-09-12T18:06:08.138167+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:24.346593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41098116,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":497,"num_read_kb":51267,"num_write":1099,"num_write_kb":73287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"264'52","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.531280+0000","last_change":"2024-09-12T17:29:54.957796+0000","last_active":"2024-09-12T18:05:57.531280+0000","last_peered":"2024-09-12T18:05:57.531280+0000","last_clean":"2024-09-12T18:05:57.531280+0000","last_became_active":"2024-09-12T17:29:54.957480+0000","last_became_peered":"2024-09-12T17:29:54.957480+0000","last_unstale":"2024-09-12T18:05:57.531280+0000","last_undegraded":"2024-09-12T18:05:57.531280+0000","last_fullsized":"2024-09-12T18:05:57.531280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:21.784834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":218,"num_write":68,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'170","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:27.136141+0000","last_change":"2024-09-12T17:29:52.946263+0000","last_active":"2024-09-12T18:05:27.136141+0000","last_peered":"2024-09-12T18:05:27.136141+0000","last_clean":"2024-09-12T18:05:27.136141+0000","last_became_active":"2024-09-12T17:29:52.945750+0000","last_became_peered":"2024-09-12T17:29:52.945750+0000","last_unstale":"2024-09-12T18:05:27.136141+0000","last_undegraded":"2024-09-12T18:05:27.136141+0000","last_fullsized":"2024-09-12T18:05:27.136141+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:34.049238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505957,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":12063,"num_write":841,"num_write_kb":23165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'78","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.533490+0000","last_change":"2024-09-12T17:29:54.950489+0000","last_active":"2024-09-12T18:05:19.533490+0000","last_peered":"2024-09-12T18:05:19.533490+0000","last_clean":"2024-09-12T18:05:19.533490+0000","last_became_active":"2024-09-12T17:29:54.949704+0000","last_became_peered":"2024-09-12T17:29:54.949704+0000","last_unstale":"2024-09-12T18:05:19.533490+0000","last_undegraded":"2024-09-12T18:05:19.533490+0000","last_fullsized":"2024-09-12T18:05:19.533490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:17.371079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":312,"num_write":123,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'199","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.031221+0000","last_change":"2024-09-12T17:29:52.961104+0000","last_active":"2024-09-12T18:07:37.031221+0000","last_peered":"2024-09-12T18:07:37.031221+0000","last_clean":"2024-09-12T18:07:37.031221+0000","last_became_active":"2024-09-12T17:29:52.960336+0000","last_became_peered":"2024-09-12T17:29:52.960336+0000","last_unstale":"2024-09-12T18:07:37.031221+0000","last_undegraded":"2024-09-12T18:07:37.031221+0000","last_fullsized":"2024-09-12T18:07:37.031221+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:31.941705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16275719,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":506,"num_read_kb":45667,"num_write":958,"num_write_kb":42266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'76","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517786+0000","last_change":"2024-09-12T17:29:54.956588+0000","last_active":"2024-09-12T18:05:19.517786+0000","last_peered":"2024-09-12T18:05:19.517786+0000","last_clean":"2024-09-12T18:05:19.517786+0000","last_became_active":"2024-09-12T17:29:54.956296+0000","last_became_peered":"2024-09-12T17:29:54.956296+0000","last_unstale":"2024-09-12T18:05:19.517786+0000","last_undegraded":"2024-09-12T18:05:19.517786+0000","last_fullsized":"2024-09-12T18:05:19.517786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:05.987373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":291,"num_write":101,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'195","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:18.481264+0000","last_change":"2024-09-12T17:29:52.953430+0000","last_active":"2024-09-12T18:05:18.481264+0000","last_peered":"2024-09-12T18:05:18.481264+0000","last_clean":"2024-09-12T18:05:18.481264+0000","last_became_active":"2024-09-12T17:29:52.953110+0000","last_became_peered":"2024-09-12T17:29:52.953110+0000","last_unstale":"2024-09-12T18:05:18.481264+0000","last_undegraded":"2024-09-12T18:05:18.481264+0000","last_fullsized":"2024-09-12T18:05:18.481264+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:17.347005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12859753,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":433,"num_read_kb":64376,"num_write":924,"num_write_kb":39967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'142","reported_seq":727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.024368+0000","last_change":"2024-09-12T17:29:54.945058+0000","last_active":"2024-09-12T18:06:06.024368+0000","last_peered":"2024-09-12T18:06:06.024368+0000","last_clean":"2024-09-12T18:06:06.024368+0000","last_became_active":"2024-09-12T17:29:54.944775+0000","last_became_peered":"2024-09-12T17:29:54.944775+0000","last_unstale":"2024-09-12T18:06:06.024368+0000","last_undegraded":"2024-09-12T18:06:06.024368+0000","last_fullsized":"2024-09-12T18:06:06.024368+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:36.057705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":576,"num_read_kb":470,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'232","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.738541+0000","last_change":"2024-09-12T17:29:52.953267+0000","last_active":"2024-09-12T18:06:08.738541+0000","last_peered":"2024-09-12T18:06:08.738541+0000","last_clean":"2024-09-12T18:06:08.738541+0000","last_became_active":"2024-09-12T17:29:52.952892+0000","last_became_peered":"2024-09-12T17:29:52.952892+0000","last_unstale":"2024-09-12T18:06:08.738541+0000","last_undegraded":"2024-09-12T18:06:08.738541+0000","last_fullsized":"2024-09-12T18:06:08.738541+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:09.264458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13312570,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":794,"num_read_kb":90532,"num_write":1288,"num_write_kb":28113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'4190","reported_seq":4816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.965248+0000","last_change":"2024-09-12T17:29:54.956378+0000","last_active":"2024-09-12T18:06:01.965248+0000","last_peered":"2024-09-12T18:06:01.965248+0000","last_clean":"2024-09-12T18:06:01.965248+0000","last_became_active":"2024-09-12T17:29:54.956030+0000","last_became_peered":"2024-09-12T17:29:54.956030+0000","last_unstale":"2024-09-12T18:06:01.965248+0000","last_undegraded":"2024-09-12T18:06:01.965248+0000","last_fullsized":"2024-09-12T18:06:01.965248+0000","mapping_epoch":26,"log_start":"264'4100","ondisk_log_start":"264'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":3000,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:59.132944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16971,"num_read_kb":14174,"num_write":6344,"num_write_kb":3204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'193","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.709664+0000","last_change":"2024-09-12T17:29:52.955756+0000","last_active":"2024-09-12T18:06:06.709664+0000","last_peered":"2024-09-12T18:06:06.709664+0000","last_clean":"2024-09-12T18:06:06.709664+0000","last_became_active":"2024-09-12T17:29:52.953694+0000","last_became_peered":"2024-09-12T17:29:52.953694+0000","last_unstale":"2024-09-12T18:06:06.709664+0000","last_undegraded":"2024-09-12T18:06:06.709664+0000","last_fullsized":"2024-09-12T18:06:06.709664+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:25.200873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13436243,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":421,"num_read_kb":9241,"num_write":943,"num_write_kb":54194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'298","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.645212+0000","last_change":"2024-09-12T17:29:54.954876+0000","last_active":"2024-09-12T18:05:55.645212+0000","last_peered":"2024-09-12T18:05:55.645212+0000","last_clean":"2024-09-12T18:05:55.645212+0000","last_became_active":"2024-09-12T17:29:54.954593+0000","last_became_peered":"2024-09-12T17:29:54.954593+0000","last_unstale":"2024-09-12T18:05:55.645212+0000","last_undegraded":"2024-09-12T18:05:55.645212+0000","last_fullsized":"2024-09-12T18:05:55.645212+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:15.447562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1407,"num_read_kb":1154,"num_write":474,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'208","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.674515+0000","last_change":"2024-09-12T17:29:52.959010+0000","last_active":"2024-09-12T18:06:01.674515+0000","last_peered":"2024-09-12T18:06:01.674515+0000","last_clean":"2024-09-12T18:06:01.674515+0000","last_became_active":"2024-09-12T17:29:52.958021+0000","last_became_peered":"2024-09-12T17:29:52.958021+0000","last_unstale":"2024-09-12T18:06:01.674515+0000","last_undegraded":"2024-09-12T18:06:01.674515+0000","last_fullsized":"2024-09-12T18:06:01.674515+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:23.137050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15903366,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":26305,"num_write":959,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'301","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:12.095784+0000","last_change":"2024-09-12T17:29:54.957925+0000","last_active":"2024-09-12T18:05:12.095784+0000","last_peered":"2024-09-12T18:05:12.095784+0000","last_clean":"2024-09-12T18:05:12.095784+0000","last_became_active":"2024-09-12T17:29:54.957636+0000","last_became_peered":"2024-09-12T17:29:54.957636+0000","last_unstale":"2024-09-12T18:05:12.095784+0000","last_undegraded":"2024-09-12T18:05:12.095784+0000","last_fullsized":"2024-09-12T18:05:12.095784+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:31.541263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1037,"num_write":475,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'225","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.677629+0000","last_change":"2024-09-12T17:29:52.966860+0000","last_active":"2024-09-12T18:05:59.677629+0000","last_peered":"2024-09-12T18:05:59.677629+0000","last_clean":"2024-09-12T18:05:59.677629+0000","last_became_active":"2024-09-12T17:29:52.966500+0000","last_became_peered":"2024-09-12T17:29:52.966500+0000","last_unstale":"2024-09-12T18:05:59.677629+0000","last_undegraded":"2024-09-12T18:05:59.677629+0000","last_fullsized":"2024-09-12T18:05:59.677629+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:52.632541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5504834,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":34941,"num_write":1116,"num_write_kb":28764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'173","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.713791+0000","last_change":"2024-09-12T17:30:28.010302+0000","last_active":"2024-09-12T18:06:07.713791+0000","last_peered":"2024-09-12T18:06:07.713791+0000","last_clean":"2024-09-12T18:06:07.713791+0000","last_became_active":"2024-09-12T17:30:28.010055+0000","last_became_peered":"2024-09-12T17:30:28.010055+0000","last_unstale":"2024-09-12T18:06:07.713791+0000","last_undegraded":"2024-09-12T18:06:07.713791+0000","last_fullsized":"2024-09-12T18:06:07.713791+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:49.191682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":614,"num_write":281,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'196","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.536940+0000","last_change":"2024-09-12T17:29:52.954562+0000","last_active":"2024-09-12T18:05:24.536940+0000","last_peered":"2024-09-12T18:05:24.536940+0000","last_clean":"2024-09-12T18:05:24.536940+0000","last_became_active":"2024-09-12T17:29:52.954238+0000","last_became_peered":"2024-09-12T17:29:52.954238+0000","last_unstale":"2024-09-12T18:05:24.536940+0000","last_undegraded":"2024-09-12T18:05:24.536940+0000","last_fullsized":"2024-09-12T18:05:24.536940+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:31.094284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874420,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":33290,"num_write":853,"num_write_kb":39696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'173","reported_seq":736,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.661699+0000","last_change":"2024-09-12T17:29:54.944911+0000","last_active":"2024-09-12T18:06:08.661699+0000","last_peered":"2024-09-12T18:06:08.661699+0000","last_clean":"2024-09-12T18:06:08.661699+0000","last_became_active":"2024-09-12T17:29:54.944623+0000","last_became_peered":"2024-09-12T17:29:54.944623+0000","last_unstale":"2024-09-12T18:06:08.661699+0000","last_undegraded":"2024-09-12T18:06:08.661699+0000","last_fullsized":"2024-09-12T18:06:08.661699+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:42.419447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":587,"num_write":256,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'215","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.019643+0000","last_change":"2024-09-12T17:29:52.952178+0000","last_active":"2024-09-12T18:06:07.019643+0000","last_peered":"2024-09-12T18:06:07.019643+0000","last_clean":"2024-09-12T18:06:07.019643+0000","last_became_active":"2024-09-12T17:29:52.951819+0000","last_became_peered":"2024-09-12T17:29:52.951819+0000","last_unstale":"2024-09-12T18:06:07.019643+0000","last_undegraded":"2024-09-12T18:06:07.019643+0000","last_fullsized":"2024-09-12T18:06:07.019643+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:53.052744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2432528,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":4445,"num_write":1037,"num_write_kb":38455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'247","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:02.429830+0000","last_change":"2024-09-12T17:29:54.952227+0000","last_active":"2024-09-12T18:06:02.429830+0000","last_peered":"2024-09-12T18:06:02.429830+0000","last_clean":"2024-09-12T18:06:02.429830+0000","last_became_active":"2024-09-12T17:29:54.950941+0000","last_became_peered":"2024-09-12T17:29:54.950941+0000","last_unstale":"2024-09-12T18:06:02.429830+0000","last_undegraded":"2024-09-12T18:06:02.429830+0000","last_fullsized":"2024-09-12T18:06:02.429830+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:47.854196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":842,"num_write":398,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'203","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.640910+0000","last_change":"2024-09-12T17:29:52.953913+0000","last_active":"2024-09-12T18:04:54.640910+0000","last_peered":"2024-09-12T18:04:54.640910+0000","last_clean":"2024-09-12T18:04:54.640910+0000","last_became_active":"2024-09-12T17:29:52.953569+0000","last_became_peered":"2024-09-12T17:29:52.953569+0000","last_unstale":"2024-09-12T18:04:54.640910+0000","last_undegraded":"2024-09-12T18:04:54.640910+0000","last_fullsized":"2024-09-12T18:04:54.640910+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:45.959383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2568203,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":11537,"num_write":1035,"num_write_kb":39628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'119","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.659784+0000","last_change":"2024-09-12T17:29:54.961906+0000","last_active":"2024-09-12T18:05:52.659784+0000","last_peered":"2024-09-12T18:05:52.659784+0000","last_clean":"2024-09-12T18:05:52.659784+0000","last_became_active":"2024-09-12T17:29:54.961615+0000","last_became_peered":"2024-09-12T17:29:54.961615+0000","last_unstale":"2024-09-12T18:05:52.659784+0000","last_undegraded":"2024-09-12T18:05:52.659784+0000","last_fullsized":"2024-09-12T18:05:52.659784+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:47.744907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":544,"num_read_kb":456,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'259","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.188541+0000","last_change":"2024-09-12T17:29:52.956926+0000","last_active":"2024-09-12T18:06:06.188541+0000","last_peered":"2024-09-12T18:06:06.188541+0000","last_clean":"2024-09-12T18:06:06.188541+0000","last_became_active":"2024-09-12T17:29:52.954363+0000","last_became_peered":"2024-09-12T17:29:52.954363+0000","last_unstale":"2024-09-12T18:06:06.188541+0000","last_undegraded":"2024-09-12T18:06:06.188541+0000","last_fullsized":"2024-09-12T18:06:06.188541+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:03.699758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12188635,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":605,"num_read_kb":60789,"num_write":1178,"num_write_kb":24093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'148","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.787667+0000","last_change":"2024-09-12T17:29:52.953182+0000","last_active":"2024-09-12T18:06:07.787667+0000","last_peered":"2024-09-12T18:06:07.787667+0000","last_clean":"2024-09-12T18:06:07.787667+0000","last_became_active":"2024-09-12T17:29:52.952766+0000","last_became_peered":"2024-09-12T17:29:52.952766+0000","last_unstale":"2024-09-12T18:06:07.787667+0000","last_undegraded":"2024-09-12T18:06:07.787667+0000","last_fullsized":"2024-09-12T18:06:07.787667+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:33.543180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20385387,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":390,"num_read_kb":30421,"num_write":774,"num_write_kb":28733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'81","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.545153+0000","last_change":"2024-09-12T17:29:54.944959+0000","last_active":"2024-09-12T18:05:52.545153+0000","last_peered":"2024-09-12T18:05:52.545153+0000","last_clean":"2024-09-12T18:05:52.545153+0000","last_became_active":"2024-09-12T17:29:54.944681+0000","last_became_peered":"2024-09-12T17:29:54.944681+0000","last_unstale":"2024-09-12T18:05:52.545153+0000","last_undegraded":"2024-09-12T18:05:52.545153+0000","last_fullsized":"2024-09-12T18:05:52.545153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:39.628805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":330,"num_write":124,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'185","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.255368+0000","last_change":"2024-09-12T17:29:52.942936+0000","last_active":"2024-09-12T18:06:19.255368+0000","last_peered":"2024-09-12T18:06:19.255368+0000","last_clean":"2024-09-12T18:06:19.255368+0000","last_became_active":"2024-09-12T17:29:52.942331+0000","last_became_peered":"2024-09-12T17:29:52.942331+0000","last_unstale":"2024-09-12T18:06:19.255368+0000","last_undegraded":"2024-09-12T18:06:19.255368+0000","last_fullsized":"2024-09-12T18:06:19.255368+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:29.868639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4365672,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":15046,"num_write":965,"num_write_kb":38540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'194","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.022497+0000","last_change":"2024-09-12T17:29:54.963259+0000","last_active":"2024-09-12T18:05:56.022497+0000","last_peered":"2024-09-12T18:05:56.022497+0000","last_clean":"2024-09-12T18:05:56.022497+0000","last_became_active":"2024-09-12T17:29:54.962921+0000","last_became_peered":"2024-09-12T17:29:54.962921+0000","last_unstale":"2024-09-12T18:05:56.022497+0000","last_undegraded":"2024-09-12T18:05:56.022497+0000","last_fullsized":"2024-09-12T18:05:56.022497+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:02.447215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":851,"num_read_kb":702,"num_write":304,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":4389,"num_write":1992,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1063,"ondisk_log_size":1063,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":16199,"num_read_kb":15887,"num_write":16770,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1852,"ondisk_log_size":1852,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":469,"ondisk_log_size":469,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":371539,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7530,"num_read_kb":9197,"num_write":5063,"num_write_kb":2472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":696320,"data_stored":191346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1997,"ondisk_log_size":1997,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2394,"num_read_kb":2858,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102452,"num_read_kb":85292,"num_write":37168,"num_write_kb":18720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4224,"ondisk_log_size":4224,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":623432097,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":474,"num_whiteouts":0,"num_read":32696,"num_read_kb":2424166,"num_write":62705,"num_write_kb":2261412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":938360832,"data_stored":938360832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4590,"ondisk_log_size":4590,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":85054806,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":124,"num_read_kb":207617,"num_write":141,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170115072,"data_stored":170109612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":85054806,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":121,"num_read_kb":201926,"num_write":141,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170115072,"data_stored":170109612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542610,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316056,"kb_used_data":96072,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94055784,"statfs":{"total":96636764160,"available":96313122816,"internally_reserved":0,"allocated":98377728,"data_stored":96341523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542609,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409564,"kb_used_data":189580,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":93962276,"statfs":{"total":96636764160,"available":96217370624,"internally_reserved":0,"allocated":194129920,"data_stored":192165815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542611,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252852,"kb_used_data":159268,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94118988,"statfs":{"total":96636764160,"available":96377843712,"internally_reserved":0,"allocated":163090432,"data_stored":161046070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542610,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238164,"kb_used_data":170884,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94133676,"statfs":{"total":96636764160,"available":96392884224,"internally_reserved":0,"allocated":174985216,"data_stored":173066278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542608,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429780,"kb_used_data":200068,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93942060,"statfs":{"total":96636764160,"available":96196669440,"internally_reserved":0,"allocated":204869632,"data_stored":202846428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542609,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217292,"kb_used_data":132028,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94154548,"statfs":{"total":96636764160,"available":96414257152,"internally_reserved":0,"allocated":135196672,"data_stored":133257194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542610,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255836,"kb_used_data":148364,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94116004,"statfs":{"total":96636764160,"available":96374788096,"internally_reserved":0,"allocated":151924736,"data_stored":149927987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542609,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":420896,"kb_used_data":187024,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93950944,"statfs":{"total":96636764160,"available":96205766656,"internally_reserved":0,"allocated":191512576,"data_stored":189506297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":138264576,"data_stored":138264576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":88326144,"data_stored":88326144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":92172288,"data_stored":92172288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":133304320,"data_stored":133304320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":133967872,"data_stored":133967872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":140910592,"data_stored":140910592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":134758400,"data_stored":134758400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":76656640,"data_stored":76656640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":19594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":21787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":10890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":36226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":34789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":22099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":42141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30994432,"data_stored":30993067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28897280,"data_stored":28895915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13168640,"data_stored":13167275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24117248,"data_stored":24117248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24702976,"data_stored":24701611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28311552,"data_stored":28311552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38334464,"data_stored":38333099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":30994432,"data_stored":30993067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:08:05.085 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:08:05.407 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:08:05.408 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":264,"fsid":"2daf3ce0-18c7-480c-9839-5cd2a9722806","created":"2024-09-12T17:29:22.150626+0000","modified":"2024-09-12T17:57:01.452313+0000","last_up_change":"2024-09-12T17:29:33.895471+0000","last_in_change":"2024-09-12T17:29:24.719113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:29:34.460317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:29:40.565279+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:29:51.011365+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:29:53.307956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:29:55.091666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:29:57.011582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:29:58.962178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:30:01.031159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T17:45:02.144491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"253","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T17:46:40.234225+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T17:46:43.243864+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T17:56:58.789670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"264","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b2dec4b-cd90-4710-a263-5068d2e36152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6801","nonce":3240254390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6803","nonce":3240254390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6807","nonce":3240254390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3240254390},{"type":"v1","addr":"172.21.15.107:6805","nonce":3240254390}]},"public_addr":"172.21.15.107:6801/3240254390","cluster_addr":"172.21.15.107:6803/3240254390","heartbeat_back_addr":"172.21.15.107:6807/3240254390","heartbeat_front_addr":"172.21.15.107:6805/3240254390","state":["exists","up"]},{"osd":1,"uuid":"ba046ff3-6ade-435c-8f5d-9408f064cdc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6817","nonce":1403347761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6819","nonce":1403347761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6823","nonce":1403347761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1403347761},{"type":"v1","addr":"172.21.15.107:6821","nonce":1403347761}]},"public_addr":"172.21.15.107:6817/1403347761","cluster_addr":"172.21.15.107:6819/1403347761","heartbeat_back_addr":"172.21.15.107:6823/1403347761","heartbeat_front_addr":"172.21.15.107:6821/1403347761","state":["exists","up"]},{"osd":2,"uuid":"5584d09f-df0b-4dcc-974f-feed64c92e5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6825","nonce":1525535229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6827","nonce":1525535229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6831","nonce":1525535229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1525535229},{"type":"v1","addr":"172.21.15.107:6829","nonce":1525535229}]},"public_addr":"172.21.15.107:6825/1525535229","cluster_addr":"172.21.15.107:6827/1525535229","heartbeat_back_addr":"172.21.15.107:6831/1525535229","heartbeat_front_addr":"172.21.15.107:6829/1525535229","state":["exists","up"]},{"osd":3,"uuid":"62030820-39f3-41fb-9eee-32a712bd5583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6809","nonce":3471033075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6811","nonce":3471033075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6815","nonce":3471033075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3471033075},{"type":"v1","addr":"172.21.15.107:6813","nonce":3471033075}]},"public_addr":"172.21.15.107:6809/3471033075","cluster_addr":"172.21.15.107:6811/3471033075","heartbeat_back_addr":"172.21.15.107:6815/3471033075","heartbeat_front_addr":"172.21.15.107:6813/3471033075","state":["exists","up"]},{"osd":4,"uuid":"f4e12c76-7b48-417f-9008-e761665ea4e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6827","nonce":3050464724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6829","nonce":3050464724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6833","nonce":3050464724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3050464724},{"type":"v1","addr":"172.21.15.148:6831","nonce":3050464724}]},"public_addr":"172.21.15.148:6827/3050464724","cluster_addr":"172.21.15.148:6829/3050464724","heartbeat_back_addr":"172.21.15.148:6833/3050464724","heartbeat_front_addr":"172.21.15.148:6831/3050464724","state":["exists","up"]},{"osd":5,"uuid":"ff4b02f8-504d-49a0-a7d6-15d2ea28c0e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6801","nonce":18671776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6803","nonce":18671776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6807","nonce":18671776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":18671776},{"type":"v1","addr":"172.21.15.148:6805","nonce":18671776}]},"public_addr":"172.21.15.148:6801/18671776","cluster_addr":"172.21.15.148:6803/18671776","heartbeat_back_addr":"172.21.15.148:6807/18671776","heartbeat_front_addr":"172.21.15.148:6805/18671776","state":["exists","up"]},{"osd":6,"uuid":"3a6b4985-a112-4e19-b2f4-52b8c022b17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6811","nonce":1396481160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6813","nonce":1396481160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6817","nonce":1396481160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1396481160},{"type":"v1","addr":"172.21.15.148:6815","nonce":1396481160}]},"public_addr":"172.21.15.148:6811/1396481160","cluster_addr":"172.21.15.148:6813/1396481160","heartbeat_back_addr":"172.21.15.148:6817/1396481160","heartbeat_front_addr":"172.21.15.148:6815/1396481160","state":["exists","up"]},{"osd":7,"uuid":"ccbe261e-8c61-4663-a1da-5f946f573e94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6819","nonce":357097900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6821","nonce":357097900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6825","nonce":357097900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":357097900},{"type":"v1","addr":"172.21.15.148:6823","nonce":357097900}]},"public_addr":"172.21.15.148:6819/357097900","cluster_addr":"172.21.15.148:6821/357097900","heartbeat_back_addr":"172.21.15.148:6825/357097900","heartbeat_front_addr":"172.21.15.148:6823/357097900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:30.807179+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.834326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.471666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.296209+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.311282+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:30.638501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.052514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:31.582204+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.9","mappings":[{"from":4,"to":1}]},{"pgid":"3.13","mappings":[{"from":6,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":4,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"67.18","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:08:06.421 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T18:08:06.422 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:08:06.571 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T18:08:06.571 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:08:06.571 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T18:08:06.582 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T18:08:06.881 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T18:08:06.894 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T18:08:06.895 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:08:07.031 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T18:08:07.031 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:08:07.031 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T18:08:07.041 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T18:08:07.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T18:08:07.344 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T18:08:07.357 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T18:08:07.357 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:08:07.494 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T18:08:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:08:07.494 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T18:08:07.505 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T18:08:07.801 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T18:08:07.815 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T18:08:07.815 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:08:07.951 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T18:08:07.951 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:08:07.952 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T18:08:07.962 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T18:08:08.263 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T18:08:08.277 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T18:08:08.277 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:08:08.415 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T18:08:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:08:08.416 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T18:08:08.426 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T18:08:08.723 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T18:08:08.737 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T18:08:08.737 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:08:08.873 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T18:08:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:08:08.874 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T18:08:08.884 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T18:08:09.188 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T18:08:09.201 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T18:08:09.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:08:09.340 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T18:08:09.341 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:08:09.341 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T18:08:09.351 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T18:08:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T18:08:09.664 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T18:08:09.665 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:08:09.802 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-09-12T18:08:09.802 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:08:09.802 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-09-12T18:08:09.812 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T18:08:10.112 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T18:08:10.125 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:08:10.452 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:08:10.464 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-09-12T18:08:10.466 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":1414,"stamp":"2024-09-12T18:08:09.284237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84787076,"num_objects":562,"num_object_clones":0,"num_object_copies":1357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":562,"num_whiteouts":0,"num_read":168345,"num_read_kb":2952080,"num_write":124562,"num_write_kb":2564884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14218,"ondisk_log_size":14218,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1667592,"kb_used_data":406052,"kb_used_omap":12,"kb_used_meta":1261171,"kb_avail":753307128,"statfs":{"total":773094113280,"available":771386499072,"internally_reserved":0,"allocated":415797248,"data_stored":400032909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1291439666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-709734471,"num_objects":-281,"num_object_clones":0,"num_object_copies":-803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-281,"num_whiteouts":0,"num_read":614,"num_read_kb":681,"num_write":441,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004781"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.634310+0000","last_change":"2024-09-12T17:57:00.464809+0000","last_active":"2024-09-12T18:04:29.634310+0000","last_peered":"2024-09-12T18:04:29.634310+0000","last_clean":"2024-09-12T18:04:29.634310+0000","last_became_active":"2024-09-12T17:57:00.464331+0000","last_became_peered":"2024-09-12T17:57:00.464331+0000","last_unstale":"2024-09-12T18:04:29.634310+0000","last_undegraded":"2024-09-12T18:04:29.634310+0000","last_fullsized":"2024-09-12T18:04:29.634310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:20.663580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.631990+0000","last_change":"2024-09-12T17:46:45.211816+0000","last_active":"2024-09-12T18:04:14.631990+0000","last_peered":"2024-09-12T18:04:14.631990+0000","last_clean":"2024-09-12T18:04:14.631990+0000","last_became_active":"2024-09-12T17:46:45.211533+0000","last_became_peered":"2024-09-12T17:46:45.211533+0000","last_unstale":"2024-09-12T18:04:14.631990+0000","last_undegraded":"2024-09-12T18:04:14.631990+0000","last_fullsized":"2024-09-12T18:04:14.631990+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:29.748663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.792520+0000","last_change":"2024-09-12T17:46:42.179842+0000","last_active":"2024-09-12T18:08:03.792520+0000","last_peered":"2024-09-12T18:08:03.792520+0000","last_clean":"2024-09-12T18:08:03.792520+0000","last_became_active":"2024-09-12T17:46:42.179372+0000","last_became_peered":"2024-09-12T17:46:42.179372+0000","last_unstale":"2024-09-12T18:08:03.792520+0000","last_undegraded":"2024-09-12T18:08:03.792520+0000","last_fullsized":"2024-09-12T18:08:03.792520+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:29.561145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6715,"num_write":5,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'32","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.172145+0000","last_change":"2024-09-12T17:45:03.890371+0000","last_active":"2024-09-12T18:05:55.172145+0000","last_peered":"2024-09-12T18:05:55.172145+0000","last_clean":"2024-09-12T18:05:55.172145+0000","last_became_active":"2024-09-12T17:45:03.890104+0000","last_became_peered":"2024-09-12T17:45:03.890104+0000","last_unstale":"2024-09-12T18:05:55.172145+0000","last_undegraded":"2024-09-12T18:05:55.172145+0000","last_fullsized":"2024-09-12T18:05:55.172145+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:20.406460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":111,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.637454+0000","last_change":"2024-09-12T17:57:00.466568+0000","last_active":"2024-09-12T18:04:29.637454+0000","last_peered":"2024-09-12T18:04:29.637454+0000","last_clean":"2024-09-12T18:04:29.637454+0000","last_became_active":"2024-09-12T17:57:00.466304+0000","last_became_peered":"2024-09-12T17:57:00.466304+0000","last_unstale":"2024-09-12T18:04:29.637454+0000","last_undegraded":"2024-09-12T18:04:29.637454+0000","last_fullsized":"2024-09-12T18:04:29.637454+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:52.603747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:44.529464+0000","last_change":"2024-09-12T17:46:45.202607+0000","last_active":"2024-09-12T18:06:44.529464+0000","last_peered":"2024-09-12T18:06:44.529464+0000","last_clean":"2024-09-12T18:06:44.529464+0000","last_became_active":"2024-09-12T17:46:45.202290+0000","last_became_peered":"2024-09-12T17:46:45.202290+0000","last_unstale":"2024-09-12T18:06:44.529464+0000","last_undegraded":"2024-09-12T18:06:44.529464+0000","last_fullsized":"2024-09-12T18:06:44.529464+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:30.467678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'8","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.682176+0000","last_change":"2024-09-12T17:46:42.177978+0000","last_active":"2024-09-12T18:08:03.682176+0000","last_peered":"2024-09-12T18:08:03.682176+0000","last_clean":"2024-09-12T18:08:03.682176+0000","last_became_active":"2024-09-12T17:46:42.177112+0000","last_became_peered":"2024-09-12T17:46:42.177112+0000","last_unstale":"2024-09-12T18:08:03.682176+0000","last_undegraded":"2024-09-12T18:08:03.682176+0000","last_fullsized":"2024-09-12T18:08:03.682176+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:37.077362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10811,"num_write":18,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'16","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.642269+0000","last_change":"2024-09-12T17:45:03.893271+0000","last_active":"2024-09-12T18:05:04.642269+0000","last_peered":"2024-09-12T18:05:04.642269+0000","last_clean":"2024-09-12T18:05:04.642269+0000","last_became_active":"2024-09-12T17:45:03.893002+0000","last_became_peered":"2024-09-12T17:45:03.893002+0000","last_unstale":"2024-09-12T18:05:04.642269+0000","last_undegraded":"2024-09-12T18:05:04.642269+0000","last_fullsized":"2024-09-12T18:05:04.642269+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:22.163418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508520+0000","last_change":"2024-09-12T17:57:00.457762+0000","last_active":"2024-09-12T18:04:14.508520+0000","last_peered":"2024-09-12T18:04:14.508520+0000","last_clean":"2024-09-12T18:04:14.508520+0000","last_became_active":"2024-09-12T17:57:00.456939+0000","last_became_peered":"2024-09-12T17:57:00.456939+0000","last_unstale":"2024-09-12T18:04:14.508520+0000","last_undegraded":"2024-09-12T18:04:14.508520+0000","last_fullsized":"2024-09-12T18:04:14.508520+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:16.042163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'10","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.760358+0000","last_change":"2024-09-12T17:46:45.537660+0000","last_active":"2024-09-12T18:08:03.760358+0000","last_peered":"2024-09-12T18:08:03.760358+0000","last_clean":"2024-09-12T18:08:03.760358+0000","last_became_active":"2024-09-12T17:46:45.536920+0000","last_became_peered":"2024-09-12T17:46:45.536920+0000","last_unstale":"2024-09-12T18:08:03.760358+0000","last_undegraded":"2024-09-12T18:08:03.760358+0000","last_fullsized":"2024-09-12T18:08:03.760358+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.487169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":15,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639526+0000","last_change":"2024-09-12T17:46:42.186263+0000","last_active":"2024-09-12T18:04:44.639526+0000","last_peered":"2024-09-12T18:04:44.639526+0000","last_clean":"2024-09-12T18:04:44.639526+0000","last_became_active":"2024-09-12T17:46:42.185870+0000","last_became_peered":"2024-09-12T17:46:42.185870+0000","last_unstale":"2024-09-12T18:04:44.639526+0000","last_undegraded":"2024-09-12T18:04:44.639526+0000","last_fullsized":"2024-09-12T18:04:44.639526+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:49.932340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'49","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644429+0000","last_change":"2024-09-12T17:45:03.895036+0000","last_active":"2024-09-12T18:05:04.644429+0000","last_peered":"2024-09-12T18:05:04.644429+0000","last_clean":"2024-09-12T18:05:04.644429+0000","last_became_active":"2024-09-12T17:45:03.894537+0000","last_became_peered":"2024-09-12T17:45:03.894537+0000","last_unstale":"2024-09-12T18:05:04.644429+0000","last_undegraded":"2024-09-12T18:05:04.644429+0000","last_fullsized":"2024-09-12T18:05:04.644429+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:15.446699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":186,"num_write":90,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:19.519960+0000","last_change":"2024-09-12T17:57:00.465664+0000","last_active":"2024-09-12T18:04:19.519960+0000","last_peered":"2024-09-12T18:04:19.519960+0000","last_clean":"2024-09-12T18:04:19.519960+0000","last_became_active":"2024-09-12T17:57:00.464157+0000","last_became_peered":"2024-09-12T17:57:00.464157+0000","last_unstale":"2024-09-12T18:04:19.519960+0000","last_undegraded":"2024-09-12T18:04:19.519960+0000","last_fullsized":"2024-09-12T18:04:19.519960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:27.777117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.524896+0000","last_change":"2024-09-12T17:46:45.538613+0000","last_active":"2024-09-12T18:04:49.524896+0000","last_peered":"2024-09-12T18:04:49.524896+0000","last_clean":"2024-09-12T18:04:49.524896+0000","last_became_active":"2024-09-12T17:46:45.538295+0000","last_became_peered":"2024-09-12T17:46:45.538295+0000","last_unstale":"2024-09-12T18:04:49.524896+0000","last_undegraded":"2024-09-12T18:04:49.524896+0000","last_fullsized":"2024-09-12T18:04:49.524896+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:12.638632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519162+0000","last_change":"2024-09-12T17:46:42.184099+0000","last_active":"2024-09-12T18:05:29.519162+0000","last_peered":"2024-09-12T18:05:29.519162+0000","last_clean":"2024-09-12T18:05:29.519162+0000","last_became_active":"2024-09-12T17:46:42.183792+0000","last_became_peered":"2024-09-12T17:46:42.183792+0000","last_unstale":"2024-09-12T18:05:29.519162+0000","last_undegraded":"2024-09-12T18:05:29.519162+0000","last_fullsized":"2024-09-12T18:05:29.519162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:38.522171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'18","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527497+0000","last_change":"2024-09-12T17:45:03.893407+0000","last_active":"2024-09-12T18:05:04.527497+0000","last_peered":"2024-09-12T18:05:04.527497+0000","last_clean":"2024-09-12T18:05:04.527497+0000","last_became_active":"2024-09-12T17:45:03.893108+0000","last_became_peered":"2024-09-12T17:45:03.893108+0000","last_unstale":"2024-09-12T18:05:04.527497+0000","last_undegraded":"2024-09-12T18:05:04.527497+0000","last_fullsized":"2024-09-12T18:05:04.527497+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:43.333855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":71,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527532+0000","last_change":"2024-09-12T17:57:00.463065+0000","last_active":"2024-09-12T18:05:04.527532+0000","last_peered":"2024-09-12T18:05:04.527532+0000","last_clean":"2024-09-12T18:05:04.527532+0000","last_became_active":"2024-09-12T17:57:00.462657+0000","last_became_peered":"2024-09-12T17:57:00.462657+0000","last_unstale":"2024-09-12T18:05:04.527532+0000","last_undegraded":"2024-09-12T18:05:04.527532+0000","last_fullsized":"2024-09-12T18:05:04.527532+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:24.423220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.649088+0000","last_change":"2024-09-12T17:46:45.210708+0000","last_active":"2024-09-12T18:06:09.649088+0000","last_peered":"2024-09-12T18:06:09.649088+0000","last_clean":"2024-09-12T18:06:09.649088+0000","last_became_active":"2024-09-12T17:46:45.210259+0000","last_became_peered":"2024-09-12T17:46:45.210259+0000","last_unstale":"2024-09-12T18:06:09.649088+0000","last_undegraded":"2024-09-12T18:06:09.649088+0000","last_fullsized":"2024-09-12T18:06:09.649088+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:01.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6189,"num_write":4,"num_write_kb":3117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.630954+0000","last_change":"2024-09-12T17:46:42.179361+0000","last_active":"2024-09-12T18:03:39.630954+0000","last_peered":"2024-09-12T18:03:39.630954+0000","last_clean":"2024-09-12T18:03:39.630954+0000","last_became_active":"2024-09-12T17:46:42.178782+0000","last_became_peered":"2024-09-12T17:46:42.178782+0000","last_unstale":"2024-09-12T18:03:39.630954+0000","last_undegraded":"2024-09-12T18:03:39.630954+0000","last_fullsized":"2024-09-12T18:03:39.630954+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:21.705278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'101","reported_seq":355,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.903517+0000","last_change":"2024-09-12T17:45:03.899922+0000","last_active":"2024-09-12T18:05:56.903517+0000","last_peered":"2024-09-12T18:05:56.903517+0000","last_clean":"2024-09-12T18:05:56.903517+0000","last_became_active":"2024-09-12T17:45:03.899635+0000","last_became_peered":"2024-09-12T17:45:03.899635+0000","last_unstale":"2024-09-12T18:05:56.903517+0000","last_undegraded":"2024-09-12T18:05:56.903517+0000","last_fullsized":"2024-09-12T18:05:56.903517+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:27.634887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":455,"num_write":132,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646813+0000","last_change":"2024-09-12T17:57:00.462866+0000","last_active":"2024-09-12T18:05:19.646813+0000","last_peered":"2024-09-12T18:05:19.646813+0000","last_clean":"2024-09-12T18:05:19.646813+0000","last_became_active":"2024-09-12T17:57:00.462532+0000","last_became_peered":"2024-09-12T17:57:00.462532+0000","last_unstale":"2024-09-12T18:05:19.646813+0000","last_undegraded":"2024-09-12T18:05:19.646813+0000","last_fullsized":"2024-09-12T18:05:19.646813+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:39.678951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.503221+0000","last_change":"2024-09-12T17:47:29.324227+0000","last_active":"2024-09-12T18:03:39.503221+0000","last_peered":"2024-09-12T18:03:39.503221+0000","last_clean":"2024-09-12T18:03:39.503221+0000","last_became_active":"2024-09-12T17:47:29.305275+0000","last_became_peered":"2024-09-12T17:47:29.305275+0000","last_unstale":"2024-09-12T18:03:39.503221+0000","last_undegraded":"2024-09-12T18:03:39.503221+0000","last_fullsized":"2024-09-12T18:03:39.503221+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:21.892809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.524329+0000","last_change":"2024-09-12T17:46:42.183120+0000","last_active":"2024-09-12T18:06:09.524329+0000","last_peered":"2024-09-12T18:06:09.524329+0000","last_clean":"2024-09-12T18:06:09.524329+0000","last_became_active":"2024-09-12T17:46:42.182797+0000","last_became_peered":"2024-09-12T17:46:42.182797+0000","last_unstale":"2024-09-12T18:06:09.524329+0000","last_undegraded":"2024-09-12T18:06:09.524329+0000","last_fullsized":"2024-09-12T18:06:09.524329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:02.336324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.192756+0000","last_change":"2024-09-12T17:45:03.900065+0000","last_active":"2024-09-12T18:05:57.192756+0000","last_peered":"2024-09-12T18:05:57.192756+0000","last_clean":"2024-09-12T18:05:57.192756+0000","last_became_active":"2024-09-12T17:45:03.899684+0000","last_became_peered":"2024-09-12T17:45:03.899684+0000","last_unstale":"2024-09-12T18:05:57.192756+0000","last_undegraded":"2024-09-12T18:05:57.192756+0000","last_fullsized":"2024-09-12T18:05:57.192756+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:45.656746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.676639+0000","last_change":"2024-09-12T17:57:00.464844+0000","last_active":"2024-09-12T18:04:29.676639+0000","last_peered":"2024-09-12T18:04:29.676639+0000","last_clean":"2024-09-12T18:04:29.676639+0000","last_became_active":"2024-09-12T17:57:00.464581+0000","last_became_peered":"2024-09-12T17:57:00.464581+0000","last_unstale":"2024-09-12T18:04:29.676639+0000","last_undegraded":"2024-09-12T18:04:29.676639+0000","last_fullsized":"2024-09-12T18:04:29.676639+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:41.808967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508601+0000","last_change":"2024-09-12T17:46:45.208867+0000","last_active":"2024-09-12T18:04:14.508601+0000","last_peered":"2024-09-12T18:04:14.508601+0000","last_clean":"2024-09-12T18:04:14.508601+0000","last_became_active":"2024-09-12T17:46:45.208580+0000","last_became_peered":"2024-09-12T17:46:45.208580+0000","last_unstale":"2024-09-12T18:04:14.508601+0000","last_undegraded":"2024-09-12T18:04:14.508601+0000","last_fullsized":"2024-09-12T18:04:14.508601+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:28.654102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508572+0000","last_change":"2024-09-12T17:46:42.182258+0000","last_active":"2024-09-12T18:04:14.508572+0000","last_peered":"2024-09-12T18:04:14.508572+0000","last_clean":"2024-09-12T18:04:14.508572+0000","last_became_active":"2024-09-12T17:46:42.181972+0000","last_became_peered":"2024-09-12T17:46:42.181972+0000","last_unstale":"2024-09-12T18:04:14.508572+0000","last_undegraded":"2024-09-12T18:04:14.508572+0000","last_fullsized":"2024-09-12T18:04:14.508572+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:16.906107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637435+0000","last_change":"2024-09-12T17:45:03.900188+0000","last_active":"2024-09-12T18:04:24.637435+0000","last_peered":"2024-09-12T18:04:24.637435+0000","last_clean":"2024-09-12T18:04:24.637435+0000","last_became_active":"2024-09-12T17:45:03.899876+0000","last_became_peered":"2024-09-12T17:45:03.899876+0000","last_unstale":"2024-09-12T18:04:24.637435+0000","last_undegraded":"2024-09-12T18:04:24.637435+0000","last_fullsized":"2024-09-12T18:04:24.637435+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:14.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.676688+0000","last_change":"2024-09-12T17:57:00.467655+0000","last_active":"2024-09-12T18:04:29.676688+0000","last_peered":"2024-09-12T18:04:29.676688+0000","last_clean":"2024-09-12T18:04:29.676688+0000","last_became_active":"2024-09-12T17:57:00.467385+0000","last_became_peered":"2024-09-12T17:57:00.467385+0000","last_unstale":"2024-09-12T18:04:29.676688+0000","last_undegraded":"2024-09-12T18:04:29.676688+0000","last_fullsized":"2024-09-12T18:04:29.676688+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:10.181468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519179+0000","last_change":"2024-09-12T17:46:45.206159+0000","last_active":"2024-09-12T18:04:14.519179+0000","last_peered":"2024-09-12T18:04:14.519179+0000","last_clean":"2024-09-12T18:04:14.519179+0000","last_became_active":"2024-09-12T17:46:45.205742+0000","last_became_peered":"2024-09-12T17:46:45.205742+0000","last_unstale":"2024-09-12T18:04:14.519179+0000","last_undegraded":"2024-09-12T18:04:14.519179+0000","last_fullsized":"2024-09-12T18:04:14.519179+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:07.179448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:44.658205+0000","last_change":"2024-09-12T17:46:42.175938+0000","last_active":"2024-09-12T18:06:44.658205+0000","last_peered":"2024-09-12T18:06:44.658205+0000","last_clean":"2024-09-12T18:06:44.658205+0000","last_became_active":"2024-09-12T17:46:42.175501+0000","last_became_peered":"2024-09-12T17:46:42.175501+0000","last_unstale":"2024-09-12T18:06:44.658205+0000","last_undegraded":"2024-09-12T18:06:44.658205+0000","last_fullsized":"2024-09-12T18:06:44.658205+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:32.128694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637725+0000","last_change":"2024-09-12T17:45:03.895224+0000","last_active":"2024-09-12T18:04:24.637725+0000","last_peered":"2024-09-12T18:04:24.637725+0000","last_clean":"2024-09-12T18:04:24.637725+0000","last_became_active":"2024-09-12T17:45:03.894942+0000","last_became_peered":"2024-09-12T17:45:03.894942+0000","last_unstale":"2024-09-12T18:04:24.637725+0000","last_undegraded":"2024-09-12T18:04:24.637725+0000","last_fullsized":"2024-09-12T18:04:24.637725+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:52.737392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.634058+0000","last_change":"2024-09-12T17:57:00.463459+0000","last_active":"2024-09-12T18:03:59.634058+0000","last_peered":"2024-09-12T18:03:59.634058+0000","last_clean":"2024-09-12T18:03:59.634058+0000","last_became_active":"2024-09-12T17:57:00.463134+0000","last_became_peered":"2024-09-12T17:57:00.463134+0000","last_unstale":"2024-09-12T18:03:59.634058+0000","last_undegraded":"2024-09-12T18:03:59.634058+0000","last_fullsized":"2024-09-12T18:03:59.634058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:21.197817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.514362+0000","last_change":"2024-09-12T17:46:45.536892+0000","last_active":"2024-09-12T18:03:39.514362+0000","last_peered":"2024-09-12T18:03:39.514362+0000","last_clean":"2024-09-12T18:03:39.514362+0000","last_became_active":"2024-09-12T17:46:45.536581+0000","last_became_peered":"2024-09-12T17:46:45.536581+0000","last_unstale":"2024-09-12T18:03:39.514362+0000","last_undegraded":"2024-09-12T18:03:39.514362+0000","last_fullsized":"2024-09-12T18:03:39.514362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:18.649337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.643082+0000","last_change":"2024-09-12T17:46:42.180809+0000","last_active":"2024-09-12T18:05:29.643082+0000","last_peered":"2024-09-12T18:05:29.643082+0000","last_clean":"2024-09-12T18:05:29.643082+0000","last_became_active":"2024-09-12T17:46:42.179981+0000","last_became_peered":"2024-09-12T17:46:42.179981+0000","last_unstale":"2024-09-12T18:05:29.643082+0000","last_undegraded":"2024-09-12T18:05:29.643082+0000","last_fullsized":"2024-09-12T18:05:29.643082+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:19.357865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.810540+0000","last_change":"2024-09-12T17:45:03.892892+0000","last_active":"2024-09-12T18:05:30.810540+0000","last_peered":"2024-09-12T18:05:30.810540+0000","last_clean":"2024-09-12T18:05:30.810540+0000","last_became_active":"2024-09-12T17:45:03.892625+0000","last_became_peered":"2024-09-12T17:45:03.892625+0000","last_unstale":"2024-09-12T18:05:30.810540+0000","last_undegraded":"2024-09-12T18:05:30.810540+0000","last_fullsized":"2024-09-12T18:05:30.810540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:58.968922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.633098+0000","last_change":"2024-09-12T17:57:00.461660+0000","last_active":"2024-09-12T18:03:59.633098+0000","last_peered":"2024-09-12T18:03:59.633098+0000","last_clean":"2024-09-12T18:03:59.633098+0000","last_became_active":"2024-09-12T17:57:00.461347+0000","last_became_peered":"2024-09-12T17:57:00.461347+0000","last_unstale":"2024-09-12T18:03:59.633098+0000","last_undegraded":"2024-09-12T18:03:59.633098+0000","last_fullsized":"2024-09-12T18:03:59.633098+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:19.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.553715+0000","last_change":"2024-09-12T17:46:45.537765+0000","last_active":"2024-09-12T18:07:49.553715+0000","last_peered":"2024-09-12T18:07:49.553715+0000","last_clean":"2024-09-12T18:07:49.553715+0000","last_became_active":"2024-09-12T17:46:45.537463+0000","last_became_peered":"2024-09-12T17:46:45.537463+0000","last_unstale":"2024-09-12T18:07:49.553715+0000","last_undegraded":"2024-09-12T18:07:49.553715+0000","last_fullsized":"2024-09-12T18:07:49.553715+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:28.915955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.668771+0000","last_change":"2024-09-12T17:46:42.181302+0000","last_active":"2024-09-12T18:03:39.668771+0000","last_peered":"2024-09-12T18:03:39.668771+0000","last_clean":"2024-09-12T18:03:39.668771+0000","last_became_active":"2024-09-12T17:46:42.178809+0000","last_became_peered":"2024-09-12T17:46:42.178809+0000","last_unstale":"2024-09-12T18:03:39.668771+0000","last_undegraded":"2024-09-12T18:03:39.668771+0000","last_fullsized":"2024-09-12T18:03:39.668771+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:58.601763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'40","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.520902+0000","last_change":"2024-09-12T17:45:03.892705+0000","last_active":"2024-09-12T18:04:24.520902+0000","last_peered":"2024-09-12T18:04:24.520902+0000","last_clean":"2024-09-12T18:04:24.520902+0000","last_became_active":"2024-09-12T17:45:03.892417+0000","last_became_peered":"2024-09-12T17:45:03.892417+0000","last_unstale":"2024-09-12T18:04:24.520902+0000","last_undegraded":"2024-09-12T18:04:24.520902+0000","last_fullsized":"2024-09-12T18:04:24.520902+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:19.505017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":139,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.671898+0000","last_change":"2024-09-12T17:57:00.463497+0000","last_active":"2024-09-12T18:03:59.671898+0000","last_peered":"2024-09-12T18:03:59.671898+0000","last_clean":"2024-09-12T18:03:59.671898+0000","last_became_active":"2024-09-12T17:57:00.463245+0000","last_became_peered":"2024-09-12T17:57:00.463245+0000","last_unstale":"2024-09-12T18:03:59.671898+0000","last_undegraded":"2024-09-12T18:03:59.671898+0000","last_fullsized":"2024-09-12T18:03:59.671898+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:38.750487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.514393+0000","last_change":"2024-09-12T17:46:45.538651+0000","last_active":"2024-09-12T18:03:39.514393+0000","last_peered":"2024-09-12T18:03:39.514393+0000","last_clean":"2024-09-12T18:03:39.514393+0000","last_became_active":"2024-09-12T17:46:45.538337+0000","last_became_peered":"2024-09-12T17:46:45.538337+0000","last_unstale":"2024-09-12T18:03:39.514393+0000","last_undegraded":"2024-09-12T18:03:39.514393+0000","last_fullsized":"2024-09-12T18:03:39.514393+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:48.298979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'6","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.793117+0000","last_change":"2024-09-12T17:46:42.183384+0000","last_active":"2024-09-12T18:08:03.793117+0000","last_peered":"2024-09-12T18:08:03.793117+0000","last_clean":"2024-09-12T18:08:03.793117+0000","last_became_active":"2024-09-12T17:46:42.183098+0000","last_became_peered":"2024-09-12T17:46:42.183098+0000","last_unstale":"2024-09-12T18:08:03.793117+0000","last_undegraded":"2024-09-12T18:08:03.793117+0000","last_fullsized":"2024-09-12T18:08:03.793117+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:06.980322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'35","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.149147+0000","last_change":"2024-09-12T17:45:03.896813+0000","last_active":"2024-09-12T18:05:20.149147+0000","last_peered":"2024-09-12T18:05:20.149147+0000","last_clean":"2024-09-12T18:05:20.149147+0000","last_became_active":"2024-09-12T17:45:03.896299+0000","last_became_peered":"2024-09-12T17:45:03.896299+0000","last_unstale":"2024-09-12T18:05:20.149147+0000","last_undegraded":"2024-09-12T18:05:20.149147+0000","last_fullsized":"2024-09-12T18:05:20.149147+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:31.025568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":68,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.629360+0000","last_change":"2024-09-12T17:57:00.462016+0000","last_active":"2024-09-12T18:03:59.629360+0000","last_peered":"2024-09-12T18:03:59.629360+0000","last_clean":"2024-09-12T18:03:59.629360+0000","last_became_active":"2024-09-12T17:57:00.461706+0000","last_became_peered":"2024-09-12T17:57:00.461706+0000","last_unstale":"2024-09-12T18:03:59.629360+0000","last_undegraded":"2024-09-12T18:03:59.629360+0000","last_fullsized":"2024-09-12T18:03:59.629360+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:47.107872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.503300+0000","last_change":"2024-09-12T17:46:45.207863+0000","last_active":"2024-09-12T18:03:39.503300+0000","last_peered":"2024-09-12T18:03:39.503300+0000","last_clean":"2024-09-12T18:03:39.503300+0000","last_became_active":"2024-09-12T17:46:45.207610+0000","last_became_peered":"2024-09-12T17:46:45.207610+0000","last_unstale":"2024-09-12T18:03:39.503300+0000","last_undegraded":"2024-09-12T18:03:39.503300+0000","last_fullsized":"2024-09-12T18:03:39.503300+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:02.945511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.631136+0000","last_change":"2024-09-12T17:46:42.182800+0000","last_active":"2024-09-12T18:03:39.631136+0000","last_peered":"2024-09-12T18:03:39.631136+0000","last_clean":"2024-09-12T18:03:39.631136+0000","last_became_active":"2024-09-12T17:46:42.182412+0000","last_became_peered":"2024-09-12T17:46:42.182412+0000","last_unstale":"2024-09-12T18:03:39.631136+0000","last_undegraded":"2024-09-12T18:03:39.631136+0000","last_fullsized":"2024-09-12T18:03:39.631136+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:58.438274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'49","reported_seq":173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:28.740711+0000","last_change":"2024-09-12T17:45:03.900251+0000","last_active":"2024-09-12T18:05:28.740711+0000","last_peered":"2024-09-12T18:05:28.740711+0000","last_clean":"2024-09-12T18:05:28.740711+0000","last_became_active":"2024-09-12T17:45:03.899885+0000","last_became_peered":"2024-09-12T17:45:03.899885+0000","last_unstale":"2024-09-12T18:05:28.740711+0000","last_undegraded":"2024-09-12T18:05:28.740711+0000","last_fullsized":"2024-09-12T18:05:28.740711+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:29.712954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":167,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519268+0000","last_change":"2024-09-12T17:57:00.468941+0000","last_active":"2024-09-12T18:04:14.519268+0000","last_peered":"2024-09-12T18:04:14.519268+0000","last_clean":"2024-09-12T18:04:14.519268+0000","last_became_active":"2024-09-12T17:57:00.468592+0000","last_became_peered":"2024-09-12T17:57:00.468592+0000","last_unstale":"2024-09-12T18:04:14.519268+0000","last_undegraded":"2024-09-12T18:04:14.519268+0000","last_fullsized":"2024-09-12T18:04:14.519268+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:05.976634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647467+0000","last_change":"2024-09-12T17:46:45.210723+0000","last_active":"2024-09-12T18:05:24.647467+0000","last_peered":"2024-09-12T18:05:24.647467+0000","last_clean":"2024-09-12T18:05:24.647467+0000","last_became_active":"2024-09-12T17:46:45.210413+0000","last_became_peered":"2024-09-12T17:46:45.210413+0000","last_unstale":"2024-09-12T18:05:24.647467+0000","last_undegraded":"2024-09-12T18:05:24.647467+0000","last_fullsized":"2024-09-12T18:05:24.647467+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:35.068995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518445+0000","last_change":"2024-09-12T17:46:42.177074+0000","last_active":"2024-09-12T18:05:24.518445+0000","last_peered":"2024-09-12T18:05:24.518445+0000","last_clean":"2024-09-12T18:05:24.518445+0000","last_became_active":"2024-09-12T17:46:42.176505+0000","last_became_peered":"2024-09-12T17:46:42.176505+0000","last_unstale":"2024-09-12T18:05:24.518445+0000","last_undegraded":"2024-09-12T18:05:24.518445+0000","last_fullsized":"2024-09-12T18:05:24.518445+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:43.326678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.669496+0000","last_change":"2024-09-12T17:45:03.900017+0000","last_active":"2024-09-12T18:03:44.669496+0000","last_peered":"2024-09-12T18:03:44.669496+0000","last_clean":"2024-09-12T18:03:44.669496+0000","last_became_active":"2024-09-12T17:45:03.899726+0000","last_became_peered":"2024-09-12T17:45:03.899726+0000","last_unstale":"2024-09-12T18:03:44.669496+0000","last_undegraded":"2024-09-12T18:03:44.669496+0000","last_fullsized":"2024-09-12T18:03:44.669496+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:05.783642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.636058+0000","last_change":"2024-09-12T17:57:00.464086+0000","last_active":"2024-09-12T18:04:14.636058+0000","last_peered":"2024-09-12T18:04:14.636058+0000","last_clean":"2024-09-12T18:04:14.636058+0000","last_became_active":"2024-09-12T17:57:00.463766+0000","last_became_peered":"2024-09-12T17:57:00.463766+0000","last_unstale":"2024-09-12T18:04:14.636058+0000","last_undegraded":"2024-09-12T18:04:14.636058+0000","last_fullsized":"2024-09-12T18:04:14.636058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:28.897896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'8","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.659185+0000","last_change":"2024-09-12T17:46:45.201582+0000","last_active":"2024-09-12T18:08:03.659185+0000","last_peered":"2024-09-12T18:08:03.659185+0000","last_clean":"2024-09-12T18:08:03.659185+0000","last_became_active":"2024-09-12T17:46:45.201278+0000","last_became_peered":"2024-09-12T17:46:45.201278+0000","last_unstale":"2024-09-12T18:08:03.659185+0000","last_undegraded":"2024-09-12T18:08:03.659185+0000","last_fullsized":"2024-09-12T18:08:03.659185+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:48.055531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'8","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.682624+0000","last_change":"2024-09-12T17:46:42.182936+0000","last_active":"2024-09-12T18:08:03.682624+0000","last_peered":"2024-09-12T18:08:03.682624+0000","last_clean":"2024-09-12T18:08:03.682624+0000","last_became_active":"2024-09-12T17:46:42.182658+0000","last_became_peered":"2024-09-12T17:46:42.182658+0000","last_unstale":"2024-09-12T18:08:03.682624+0000","last_undegraded":"2024-09-12T18:08:03.682624+0000","last_fullsized":"2024-09-12T18:08:03.682624+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:02.557846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":45,"num_write":18,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.277595+0000","last_change":"2024-09-12T17:45:03.891474+0000","last_active":"2024-09-12T18:05:09.277595+0000","last_peered":"2024-09-12T18:05:09.277595+0000","last_clean":"2024-09-12T18:05:09.277595+0000","last_became_active":"2024-09-12T17:45:03.891186+0000","last_became_peered":"2024-09-12T17:45:03.891186+0000","last_unstale":"2024-09-12T18:05:09.277595+0000","last_undegraded":"2024-09-12T18:05:09.277595+0000","last_fullsized":"2024-09-12T18:05:09.277595+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:08.125248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":128,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.633745+0000","last_change":"2024-09-12T17:57:00.465754+0000","last_active":"2024-09-12T18:03:59.633745+0000","last_peered":"2024-09-12T18:03:59.633745+0000","last_clean":"2024-09-12T18:03:59.633745+0000","last_became_active":"2024-09-12T17:57:00.464910+0000","last_became_peered":"2024-09-12T17:57:00.464910+0000","last_unstale":"2024-09-12T18:03:59.633745+0000","last_undegraded":"2024-09-12T18:03:59.633745+0000","last_fullsized":"2024-09-12T18:03:59.633745+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:15.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534265+0000","last_change":"2024-09-12T17:46:45.206745+0000","last_active":"2024-09-12T18:05:24.534265+0000","last_peered":"2024-09-12T18:05:24.534265+0000","last_clean":"2024-09-12T18:05:24.534265+0000","last_became_active":"2024-09-12T17:46:45.206402+0000","last_became_peered":"2024-09-12T17:46:45.206402+0000","last_unstale":"2024-09-12T18:05:24.534265+0000","last_undegraded":"2024-09-12T18:05:24.534265+0000","last_fullsized":"2024-09-12T18:05:24.534265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:55.547505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.538364+0000","last_change":"2024-09-12T17:46:42.185043+0000","last_active":"2024-09-12T18:07:44.538364+0000","last_peered":"2024-09-12T18:07:44.538364+0000","last_clean":"2024-09-12T18:07:44.538364+0000","last_became_active":"2024-09-12T17:46:42.184760+0000","last_became_peered":"2024-09-12T17:46:42.184760+0000","last_unstale":"2024-09-12T18:07:44.538364+0000","last_undegraded":"2024-09-12T18:07:44.538364+0000","last_fullsized":"2024-09-12T18:07:44.538364+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:44.853687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'36","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.504092+0000","last_change":"2024-09-12T17:45:03.897900+0000","last_active":"2024-09-12T18:03:44.504092+0000","last_peered":"2024-09-12T18:03:44.504092+0000","last_clean":"2024-09-12T18:03:44.504092+0000","last_became_active":"2024-09-12T17:45:03.897616+0000","last_became_peered":"2024-09-12T17:45:03.897616+0000","last_unstale":"2024-09-12T18:03:44.504092+0000","last_undegraded":"2024-09-12T18:03:44.504092+0000","last_fullsized":"2024-09-12T18:03:44.504092+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:50.190493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":138,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519243+0000","last_change":"2024-09-12T17:57:00.464276+0000","last_active":"2024-09-12T18:04:14.519243+0000","last_peered":"2024-09-12T18:04:14.519243+0000","last_clean":"2024-09-12T18:04:14.519243+0000","last_became_active":"2024-09-12T17:57:00.463881+0000","last_became_peered":"2024-09-12T17:57:00.463881+0000","last_unstale":"2024-09-12T18:04:14.519243+0000","last_undegraded":"2024-09-12T18:04:14.519243+0000","last_fullsized":"2024-09-12T18:04:14.519243+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:03.028160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518466+0000","last_change":"2024-09-12T17:46:45.206370+0000","last_active":"2024-09-12T18:05:24.518466+0000","last_peered":"2024-09-12T18:05:24.518466+0000","last_clean":"2024-09-12T18:05:24.518466+0000","last_became_active":"2024-09-12T17:46:45.205987+0000","last_became_peered":"2024-09-12T17:46:45.205987+0000","last_unstale":"2024-09-12T18:05:24.518466+0000","last_undegraded":"2024-09-12T18:05:24.518466+0000","last_fullsized":"2024-09-12T18:05:24.518466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:04.606065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.642468+0000","last_change":"2024-09-12T17:46:42.180412+0000","last_active":"2024-09-12T18:05:24.642468+0000","last_peered":"2024-09-12T18:05:24.642468+0000","last_clean":"2024-09-12T18:05:24.642468+0000","last_became_active":"2024-09-12T17:46:42.178941+0000","last_became_peered":"2024-09-12T17:46:42.178941+0000","last_unstale":"2024-09-12T18:05:24.642468+0000","last_undegraded":"2024-09-12T18:05:24.642468+0000","last_fullsized":"2024-09-12T18:05:24.642468+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:53.889661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'33","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.633278+0000","last_change":"2024-09-12T17:45:03.893625+0000","last_active":"2024-09-12T18:05:19.633278+0000","last_peered":"2024-09-12T18:05:19.633278+0000","last_clean":"2024-09-12T18:05:19.633278+0000","last_became_active":"2024-09-12T17:45:03.893332+0000","last_became_peered":"2024-09-12T17:45:03.893332+0000","last_unstale":"2024-09-12T18:05:19.633278+0000","last_undegraded":"2024-09-12T18:05:19.633278+0000","last_fullsized":"2024-09-12T18:05:19.633278+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:59.606201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.646279+0000","last_change":"2024-09-12T17:57:00.461421+0000","last_active":"2024-09-12T18:05:39.646279+0000","last_peered":"2024-09-12T18:05:39.646279+0000","last_clean":"2024-09-12T18:05:39.646279+0000","last_became_active":"2024-09-12T17:57:00.461130+0000","last_became_peered":"2024-09-12T17:57:00.461130+0000","last_unstale":"2024-09-12T18:05:39.646279+0000","last_undegraded":"2024-09-12T18:05:39.646279+0000","last_fullsized":"2024-09-12T18:05:39.646279+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:49.944764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.673146+0000","last_change":"2024-09-12T17:46:45.208179+0000","last_active":"2024-09-12T18:08:03.673146+0000","last_peered":"2024-09-12T18:08:03.673146+0000","last_clean":"2024-09-12T18:08:03.673146+0000","last_became_active":"2024-09-12T17:46:45.207899+0000","last_became_peered":"2024-09-12T17:46:45.207899+0000","last_unstale":"2024-09-12T18:08:03.673146+0000","last_undegraded":"2024-09-12T18:08:03.673146+0000","last_fullsized":"2024-09-12T18:08:03.673146+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:40.530867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":571,"num_write":10,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.679250+0000","last_change":"2024-09-12T17:46:42.178168+0000","last_active":"2024-09-12T18:04:44.679250+0000","last_peered":"2024-09-12T18:04:44.679250+0000","last_clean":"2024-09-12T18:04:44.679250+0000","last_became_active":"2024-09-12T17:46:42.177867+0000","last_became_peered":"2024-09-12T17:46:42.177867+0000","last_unstale":"2024-09-12T18:04:44.679250+0000","last_undegraded":"2024-09-12T18:04:44.679250+0000","last_fullsized":"2024-09-12T18:04:44.679250+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:40.404324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'22","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534323+0000","last_change":"2024-09-12T17:45:03.895504+0000","last_active":"2024-09-12T18:05:24.534323+0000","last_peered":"2024-09-12T18:05:24.534323+0000","last_clean":"2024-09-12T18:05:24.534323+0000","last_became_active":"2024-09-12T17:45:03.895229+0000","last_became_peered":"2024-09-12T17:45:03.895229+0000","last_unstale":"2024-09-12T18:05:24.534323+0000","last_undegraded":"2024-09-12T18:05:24.534323+0000","last_fullsized":"2024-09-12T18:05:24.534323+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:49.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.669484+0000","last_change":"2024-09-12T17:57:00.466936+0000","last_active":"2024-09-12T18:03:44.669484+0000","last_peered":"2024-09-12T18:03:44.669484+0000","last_clean":"2024-09-12T18:03:44.669484+0000","last_became_active":"2024-09-12T17:57:00.466328+0000","last_became_peered":"2024-09-12T17:57:00.466328+0000","last_unstale":"2024-09-12T18:03:44.669484+0000","last_undegraded":"2024-09-12T18:03:44.669484+0000","last_fullsized":"2024-09-12T18:03:44.669484+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:21.500416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.547239+0000","last_change":"2024-09-12T17:46:45.204918+0000","last_active":"2024-09-12T18:06:59.547239+0000","last_peered":"2024-09-12T18:06:59.547239+0000","last_clean":"2024-09-12T18:06:59.547239+0000","last_became_active":"2024-09-12T17:46:45.204628+0000","last_became_peered":"2024-09-12T17:46:45.204628+0000","last_unstale":"2024-09-12T18:06:59.547239+0000","last_undegraded":"2024-09-12T18:06:59.547239+0000","last_fullsized":"2024-09-12T18:06:59.547239+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:44.729741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.655391+0000","last_change":"2024-09-12T17:46:42.183988+0000","last_active":"2024-09-12T18:06:59.655391+0000","last_peered":"2024-09-12T18:06:59.655391+0000","last_clean":"2024-09-12T18:06:59.655391+0000","last_became_active":"2024-09-12T17:46:42.183710+0000","last_became_peered":"2024-09-12T17:46:42.183710+0000","last_unstale":"2024-09-12T18:06:59.655391+0000","last_undegraded":"2024-09-12T18:06:59.655391+0000","last_fullsized":"2024-09-12T18:06:59.655391+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:52.515375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'20","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.641966+0000","last_change":"2024-09-12T17:45:03.897931+0000","last_active":"2024-09-12T18:05:19.641966+0000","last_peered":"2024-09-12T18:05:19.641966+0000","last_clean":"2024-09-12T18:05:19.641966+0000","last_became_active":"2024-09-12T17:45:03.897609+0000","last_became_peered":"2024-09-12T17:45:03.897609+0000","last_unstale":"2024-09-12T18:05:19.641966+0000","last_undegraded":"2024-09-12T18:05:19.641966+0000","last_fullsized":"2024-09-12T18:05:19.641966+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:57.004403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.520491+0000","last_change":"2024-09-12T17:57:00.459052+0000","last_active":"2024-09-12T18:05:39.520491+0000","last_peered":"2024-09-12T18:05:39.520491+0000","last_clean":"2024-09-12T18:05:39.520491+0000","last_became_active":"2024-09-12T17:57:00.458777+0000","last_became_peered":"2024-09-12T17:57:00.458777+0000","last_unstale":"2024-09-12T18:05:39.520491+0000","last_undegraded":"2024-09-12T18:05:39.520491+0000","last_fullsized":"2024-09-12T18:05:39.520491+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:12.952038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.660334+0000","last_change":"2024-09-12T17:46:45.537482+0000","last_active":"2024-09-12T18:06:59.660334+0000","last_peered":"2024-09-12T18:06:59.660334+0000","last_clean":"2024-09-12T18:06:59.660334+0000","last_became_active":"2024-09-12T17:46:45.536980+0000","last_became_peered":"2024-09-12T17:46:45.536980+0000","last_unstale":"2024-09-12T18:06:59.660334+0000","last_undegraded":"2024-09-12T18:06:59.660334+0000","last_fullsized":"2024-09-12T18:06:59.660334+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:14.427774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640687+0000","last_change":"2024-09-12T17:46:42.180818+0000","last_active":"2024-09-12T18:04:44.640687+0000","last_peered":"2024-09-12T18:04:44.640687+0000","last_clean":"2024-09-12T18:04:44.640687+0000","last_became_active":"2024-09-12T17:46:42.180565+0000","last_became_peered":"2024-09-12T17:46:42.180565+0000","last_unstale":"2024-09-12T18:04:44.640687+0000","last_undegraded":"2024-09-12T18:04:44.640687+0000","last_fullsized":"2024-09-12T18:04:44.640687+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:16.219991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'33","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517834+0000","last_change":"2024-09-12T17:45:03.892503+0000","last_active":"2024-09-12T18:05:19.517834+0000","last_peered":"2024-09-12T18:05:19.517834+0000","last_clean":"2024-09-12T18:05:19.517834+0000","last_became_active":"2024-09-12T17:45:03.892226+0000","last_became_peered":"2024-09-12T17:45:03.892226+0000","last_unstale":"2024-09-12T18:05:19.517834+0000","last_undegraded":"2024-09-12T18:05:19.517834+0000","last_fullsized":"2024-09-12T18:05:19.517834+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:41.497858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":124,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.687364+0000","last_change":"2024-09-12T17:57:00.464984+0000","last_active":"2024-09-12T18:05:39.687364+0000","last_peered":"2024-09-12T18:05:39.687364+0000","last_clean":"2024-09-12T18:05:39.687364+0000","last_became_active":"2024-09-12T17:57:00.464707+0000","last_became_peered":"2024-09-12T17:57:00.464707+0000","last_unstale":"2024-09-12T18:05:39.687364+0000","last_undegraded":"2024-09-12T18:05:39.687364+0000","last_fullsized":"2024-09-12T18:05:39.687364+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:25.768696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.547308+0000","last_change":"2024-09-12T17:46:45.205067+0000","last_active":"2024-09-12T18:06:59.547308+0000","last_peered":"2024-09-12T18:06:59.547308+0000","last_clean":"2024-09-12T18:06:59.547308+0000","last_became_active":"2024-09-12T17:46:45.204759+0000","last_became_peered":"2024-09-12T17:46:45.204759+0000","last_unstale":"2024-09-12T18:06:59.547308+0000","last_undegraded":"2024-09-12T18:06:59.547308+0000","last_fullsized":"2024-09-12T18:06:59.547308+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:47.314625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.660314+0000","last_change":"2024-09-12T17:46:42.183190+0000","last_active":"2024-09-12T18:06:59.660314+0000","last_peered":"2024-09-12T18:06:59.660314+0000","last_clean":"2024-09-12T18:06:59.660314+0000","last_became_active":"2024-09-12T17:46:42.182805+0000","last_became_peered":"2024-09-12T17:46:42.182805+0000","last_unstale":"2024-09-12T18:06:59.660314+0000","last_undegraded":"2024-09-12T18:06:59.660314+0000","last_fullsized":"2024-09-12T18:06:59.660314+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:54.005006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'42","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.643914+0000","last_change":"2024-09-12T17:45:03.898048+0000","last_active":"2024-09-12T18:05:19.643914+0000","last_peered":"2024-09-12T18:05:19.643914+0000","last_clean":"2024-09-12T18:05:19.643914+0000","last_became_active":"2024-09-12T17:45:03.897752+0000","last_became_peered":"2024-09-12T17:45:03.897752+0000","last_unstale":"2024-09-12T18:05:19.643914+0000","last_undegraded":"2024-09-12T18:05:19.643914+0000","last_fullsized":"2024-09-12T18:05:19.643914+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:59.048003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":75,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.515086+0000","last_change":"2024-09-12T17:57:00.469400+0000","last_active":"2024-09-12T18:03:44.515086+0000","last_peered":"2024-09-12T18:03:44.515086+0000","last_clean":"2024-09-12T18:03:44.515086+0000","last_became_active":"2024-09-12T17:57:00.469072+0000","last_became_peered":"2024-09-12T17:57:00.469072+0000","last_unstale":"2024-09-12T18:03:44.515086+0000","last_undegraded":"2024-09-12T18:03:44.515086+0000","last_fullsized":"2024-09-12T18:03:44.515086+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:37.442197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.507138+0000","last_change":"2024-09-12T17:46:45.203169+0000","last_active":"2024-09-12T18:04:04.507138+0000","last_peered":"2024-09-12T18:04:04.507138+0000","last_clean":"2024-09-12T18:04:04.507138+0000","last_became_active":"2024-09-12T17:46:45.202892+0000","last_became_peered":"2024-09-12T17:46:45.202892+0000","last_unstale":"2024-09-12T18:04:04.507138+0000","last_undegraded":"2024-09-12T18:04:04.507138+0000","last_fullsized":"2024-09-12T18:04:04.507138+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:50.179992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634333+0000","last_change":"2024-09-12T17:46:42.179076+0000","last_active":"2024-09-12T18:04:04.634333+0000","last_peered":"2024-09-12T18:04:04.634333+0000","last_clean":"2024-09-12T18:04:04.634333+0000","last_became_active":"2024-09-12T17:46:42.178411+0000","last_became_peered":"2024-09-12T17:46:42.178411+0000","last_unstale":"2024-09-12T18:04:04.634333+0000","last_undegraded":"2024-09-12T18:04:04.634333+0000","last_fullsized":"2024-09-12T18:04:04.634333+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:26.191877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'24","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646723+0000","last_change":"2024-09-12T17:45:03.891655+0000","last_active":"2024-09-12T18:05:19.646723+0000","last_peered":"2024-09-12T18:05:19.646723+0000","last_clean":"2024-09-12T18:05:19.646723+0000","last_became_active":"2024-09-12T17:45:03.891369+0000","last_became_peered":"2024-09-12T17:45:03.891369+0000","last_unstale":"2024-09-12T18:05:19.646723+0000","last_undegraded":"2024-09-12T18:05:19.646723+0000","last_fullsized":"2024-09-12T18:05:19.646723+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:45.970204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.670237+0000","last_change":"2024-09-12T17:57:00.465652+0000","last_active":"2024-09-12T18:03:49.670237+0000","last_peered":"2024-09-12T18:03:49.670237+0000","last_clean":"2024-09-12T18:03:49.670237+0000","last_became_active":"2024-09-12T17:57:00.465360+0000","last_became_peered":"2024-09-12T17:57:00.465360+0000","last_unstale":"2024-09-12T18:03:49.670237+0000","last_undegraded":"2024-09-12T18:03:49.670237+0000","last_fullsized":"2024-09-12T18:03:49.670237+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:56.997962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.672845+0000","last_change":"2024-09-12T17:46:45.536369+0000","last_active":"2024-09-12T18:04:04.672845+0000","last_peered":"2024-09-12T18:04:04.672845+0000","last_clean":"2024-09-12T18:04:04.672845+0000","last_became_active":"2024-09-12T17:46:45.536056+0000","last_became_peered":"2024-09-12T17:46:45.536056+0000","last_unstale":"2024-09-12T18:04:04.672845+0000","last_undegraded":"2024-09-12T18:04:04.672845+0000","last_fullsized":"2024-09-12T18:04:04.672845+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:32.199489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634773+0000","last_change":"2024-09-12T17:46:42.183083+0000","last_active":"2024-09-12T18:04:04.634773+0000","last_peered":"2024-09-12T18:04:04.634773+0000","last_clean":"2024-09-12T18:04:04.634773+0000","last_became_active":"2024-09-12T17:46:42.182831+0000","last_became_peered":"2024-09-12T17:46:42.182831+0000","last_unstale":"2024-09-12T18:04:04.634773+0000","last_undegraded":"2024-09-12T18:04:04.634773+0000","last_fullsized":"2024-09-12T18:04:04.634773+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:04.590775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'86","reported_seq":281,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.623576+0000","last_change":"2024-09-12T17:45:03.893737+0000","last_active":"2024-09-12T18:05:20.623576+0000","last_peered":"2024-09-12T18:05:20.623576+0000","last_clean":"2024-09-12T18:05:20.623576+0000","last_became_active":"2024-09-12T17:45:03.893452+0000","last_became_peered":"2024-09-12T17:45:03.893452+0000","last_unstale":"2024-09-12T18:05:20.623576+0000","last_undegraded":"2024-09-12T18:05:20.623576+0000","last_fullsized":"2024-09-12T18:05:20.623576+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:29.372853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":321,"num_write":137,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.669517+0000","last_change":"2024-09-12T17:57:00.464389+0000","last_active":"2024-09-12T18:03:44.669517+0000","last_peered":"2024-09-12T18:03:44.669517+0000","last_clean":"2024-09-12T18:03:44.669517+0000","last_became_active":"2024-09-12T17:57:00.464068+0000","last_became_peered":"2024-09-12T17:57:00.464068+0000","last_unstale":"2024-09-12T18:03:44.669517+0000","last_undegraded":"2024-09-12T18:03:44.669517+0000","last_fullsized":"2024-09-12T18:03:44.669517+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:52.387690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'6","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.659774+0000","last_change":"2024-09-12T17:46:45.206955+0000","last_active":"2024-09-12T18:08:03.659774+0000","last_peered":"2024-09-12T18:08:03.659774+0000","last_clean":"2024-09-12T18:08:03.659774+0000","last_became_active":"2024-09-12T17:46:45.206644+0000","last_became_peered":"2024-09-12T17:46:45.206644+0000","last_unstale":"2024-09-12T18:08:03.659774+0000","last_undegraded":"2024-09-12T18:08:03.659774+0000","last_fullsized":"2024-09-12T18:08:03.659774+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:01.211515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.634414+0000","last_change":"2024-09-12T17:46:42.184536+0000","last_active":"2024-09-12T18:04:04.634414+0000","last_peered":"2024-09-12T18:04:04.634414+0000","last_clean":"2024-09-12T18:04:04.634414+0000","last_became_active":"2024-09-12T17:46:42.184232+0000","last_became_peered":"2024-09-12T17:46:42.184232+0000","last_unstale":"2024-09-12T18:04:04.634414+0000","last_undegraded":"2024-09-12T18:04:04.634414+0000","last_fullsized":"2024-09-12T18:04:04.634414+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:05.091740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.522427+0000","last_change":"2024-09-12T17:45:03.897167+0000","last_active":"2024-09-12T18:04:34.522427+0000","last_peered":"2024-09-12T18:04:34.522427+0000","last_clean":"2024-09-12T18:04:34.522427+0000","last_became_active":"2024-09-12T17:45:03.896663+0000","last_became_peered":"2024-09-12T17:45:03.896663+0000","last_unstale":"2024-09-12T18:04:34.522427+0000","last_undegraded":"2024-09-12T18:04:34.522427+0000","last_fullsized":"2024-09-12T18:04:34.522427+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:00.166379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.631728+0000","last_change":"2024-09-12T17:57:00.465893+0000","last_active":"2024-09-12T18:03:44.631728+0000","last_peered":"2024-09-12T18:03:44.631728+0000","last_clean":"2024-09-12T18:03:44.631728+0000","last_became_active":"2024-09-12T17:57:00.465596+0000","last_became_peered":"2024-09-12T17:57:00.465596+0000","last_unstale":"2024-09-12T18:03:44.631728+0000","last_undegraded":"2024-09-12T18:03:44.631728+0000","last_fullsized":"2024-09-12T18:03:44.631728+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:13.446382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.673723+0000","last_change":"2024-09-12T17:46:45.208374+0000","last_active":"2024-09-12T18:04:09.673723+0000","last_peered":"2024-09-12T18:04:09.673723+0000","last_clean":"2024-09-12T18:04:09.673723+0000","last_became_active":"2024-09-12T17:46:45.208019+0000","last_became_peered":"2024-09-12T17:46:45.208019+0000","last_unstale":"2024-09-12T18:04:09.673723+0000","last_undegraded":"2024-09-12T18:04:09.673723+0000","last_fullsized":"2024-09-12T18:04:09.673723+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:03.347779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.512748+0000","last_change":"2024-09-12T17:46:42.184553+0000","last_active":"2024-09-12T18:04:44.512748+0000","last_peered":"2024-09-12T18:04:44.512748+0000","last_clean":"2024-09-12T18:04:44.512748+0000","last_became_active":"2024-09-12T17:46:42.184250+0000","last_became_peered":"2024-09-12T17:46:42.184250+0000","last_unstale":"2024-09-12T18:04:44.512748+0000","last_undegraded":"2024-09-12T18:04:44.512748+0000","last_fullsized":"2024-09-12T18:04:44.512748+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:49.433698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'40","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.511355+0000","last_change":"2024-09-12T17:45:03.897601+0000","last_active":"2024-09-12T18:04:34.511355+0000","last_peered":"2024-09-12T18:04:34.511355+0000","last_clean":"2024-09-12T18:04:34.511355+0000","last_became_active":"2024-09-12T17:45:03.897291+0000","last_became_peered":"2024-09-12T17:45:03.897291+0000","last_unstale":"2024-09-12T18:04:34.511355+0000","last_undegraded":"2024-09-12T18:04:34.511355+0000","last_fullsized":"2024-09-12T18:04:34.511355+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:56.938763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.684325+0000","last_change":"2024-09-12T17:57:00.465725+0000","last_active":"2024-09-12T18:05:19.684325+0000","last_peered":"2024-09-12T18:05:19.684325+0000","last_clean":"2024-09-12T18:05:19.684325+0000","last_became_active":"2024-09-12T17:57:00.465454+0000","last_became_peered":"2024-09-12T17:57:00.465454+0000","last_unstale":"2024-09-12T18:05:19.684325+0000","last_undegraded":"2024-09-12T18:05:19.684325+0000","last_fullsized":"2024-09-12T18:05:19.684325+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.552904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648118+0000","last_change":"2024-09-12T17:46:45.207902+0000","last_active":"2024-09-12T18:05:29.648118+0000","last_peered":"2024-09-12T18:05:29.648118+0000","last_clean":"2024-09-12T18:05:29.648118+0000","last_became_active":"2024-09-12T17:46:45.207607+0000","last_became_peered":"2024-09-12T17:46:45.207607+0000","last_unstale":"2024-09-12T18:05:29.648118+0000","last_undegraded":"2024-09-12T18:05:29.648118+0000","last_fullsized":"2024-09-12T18:05:29.648118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:31.661695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.685860+0000","last_change":"2024-09-12T17:46:42.182625+0000","last_active":"2024-09-12T18:05:29.685860+0000","last_peered":"2024-09-12T18:05:29.685860+0000","last_clean":"2024-09-12T18:05:29.685860+0000","last_became_active":"2024-09-12T17:46:42.182267+0000","last_became_peered":"2024-09-12T17:46:42.182267+0000","last_unstale":"2024-09-12T18:05:29.685860+0000","last_undegraded":"2024-09-12T18:05:29.685860+0000","last_fullsized":"2024-09-12T18:05:29.685860+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:39.753698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'54","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.639121+0000","last_change":"2024-09-12T17:45:03.892593+0000","last_active":"2024-09-12T18:04:34.639121+0000","last_peered":"2024-09-12T18:04:34.639121+0000","last_clean":"2024-09-12T18:04:34.639121+0000","last_became_active":"2024-09-12T17:45:03.891861+0000","last_became_peered":"2024-09-12T17:45:03.891861+0000","last_unstale":"2024-09-12T18:04:34.639121+0000","last_undegraded":"2024-09-12T18:04:34.639121+0000","last_fullsized":"2024-09-12T18:04:34.639121+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:11.906724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":286,"num_read_kb":219,"num_write":84,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.641923+0000","last_change":"2024-09-12T17:57:00.467076+0000","last_active":"2024-09-12T18:05:19.641923+0000","last_peered":"2024-09-12T18:05:19.641923+0000","last_clean":"2024-09-12T18:05:19.641923+0000","last_became_active":"2024-09-12T17:57:00.466761+0000","last_became_peered":"2024-09-12T17:57:00.466761+0000","last_unstale":"2024-09-12T18:05:19.641923+0000","last_undegraded":"2024-09-12T18:05:19.641923+0000","last_fullsized":"2024-09-12T18:05:19.641923+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:37.302553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648100+0000","last_change":"2024-09-12T17:46:45.537244+0000","last_active":"2024-09-12T18:05:29.648100+0000","last_peered":"2024-09-12T18:05:29.648100+0000","last_clean":"2024-09-12T18:05:29.648100+0000","last_became_active":"2024-09-12T17:46:45.536927+0000","last_became_peered":"2024-09-12T17:46:45.536927+0000","last_unstale":"2024-09-12T18:05:29.648100+0000","last_undegraded":"2024-09-12T18:05:29.648100+0000","last_fullsized":"2024-09-12T18:05:29.648100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:06.976539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.644905+0000","last_change":"2024-09-12T17:46:42.182617+0000","last_active":"2024-09-12T18:05:29.644905+0000","last_peered":"2024-09-12T18:05:29.644905+0000","last_clean":"2024-09-12T18:05:29.644905+0000","last_became_active":"2024-09-12T17:46:42.182346+0000","last_became_peered":"2024-09-12T17:46:42.182346+0000","last_unstale":"2024-09-12T18:05:29.644905+0000","last_undegraded":"2024-09-12T18:05:29.644905+0000","last_fullsized":"2024-09-12T18:05:29.644905+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:54.314647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'22","reported_seq":105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.511454+0000","last_change":"2024-09-12T17:45:03.895804+0000","last_active":"2024-09-12T18:04:34.511454+0000","last_peered":"2024-09-12T18:04:34.511454+0000","last_clean":"2024-09-12T18:04:34.511454+0000","last_became_active":"2024-09-12T17:45:03.895580+0000","last_became_peered":"2024-09-12T17:45:03.895580+0000","last_unstale":"2024-09-12T18:04:34.511454+0000","last_undegraded":"2024-09-12T18:04:34.511454+0000","last_fullsized":"2024-09-12T18:04:34.511454+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.580183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643446+0000","last_change":"2024-09-12T17:57:00.463170+0000","last_active":"2024-09-12T18:04:59.643446+0000","last_peered":"2024-09-12T18:04:59.643446+0000","last_clean":"2024-09-12T18:04:59.643446+0000","last_became_active":"2024-09-12T17:57:00.462863+0000","last_became_peered":"2024-09-12T17:57:00.462863+0000","last_unstale":"2024-09-12T18:04:59.643446+0000","last_undegraded":"2024-09-12T18:04:59.643446+0000","last_fullsized":"2024-09-12T18:04:59.643446+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:40.563317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.672968+0000","last_change":"2024-09-12T17:46:45.537210+0000","last_active":"2024-09-12T18:04:04.672968+0000","last_peered":"2024-09-12T18:04:04.672968+0000","last_clean":"2024-09-12T18:04:04.672968+0000","last_became_active":"2024-09-12T17:46:45.536831+0000","last_became_peered":"2024-09-12T17:46:45.536831+0000","last_unstale":"2024-09-12T18:04:04.672968+0000","last_undegraded":"2024-09-12T18:04:04.672968+0000","last_fullsized":"2024-09-12T18:04:04.672968+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:29.700931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'7","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.649746+0000","last_change":"2024-09-12T17:46:42.185520+0000","last_active":"2024-09-12T18:06:14.649746+0000","last_peered":"2024-09-12T18:06:14.649746+0000","last_clean":"2024-09-12T18:06:14.649746+0000","last_became_active":"2024-09-12T17:46:42.185216+0000","last_became_peered":"2024-09-12T17:46:42.185216+0000","last_unstale":"2024-09-12T18:06:14.649746+0000","last_undegraded":"2024-09-12T18:06:14.649746+0000","last_fullsized":"2024-09-12T18:06:14.649746+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:37.439176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.690176+0000","last_change":"2024-09-12T17:45:03.894942+0000","last_active":"2024-09-12T18:05:59.690176+0000","last_peered":"2024-09-12T18:05:59.690176+0000","last_clean":"2024-09-12T18:05:59.690176+0000","last_became_active":"2024-09-12T17:45:03.894642+0000","last_became_peered":"2024-09-12T17:45:03.894642+0000","last_unstale":"2024-09-12T18:05:59.690176+0000","last_undegraded":"2024-09-12T18:05:59.690176+0000","last_fullsized":"2024-09-12T18:05:59.690176+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:17.879728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517749+0000","last_change":"2024-09-12T17:57:00.465804+0000","last_active":"2024-09-12T18:05:19.517749+0000","last_peered":"2024-09-12T18:05:19.517749+0000","last_clean":"2024-09-12T18:05:19.517749+0000","last_became_active":"2024-09-12T17:57:00.465546+0000","last_became_peered":"2024-09-12T17:57:00.465546+0000","last_unstale":"2024-09-12T18:05:19.517749+0000","last_undegraded":"2024-09-12T18:05:19.517749+0000","last_fullsized":"2024-09-12T18:05:19.517749+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.264688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'13","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.793629+0000","last_change":"2024-09-12T17:46:45.206808+0000","last_active":"2024-09-12T18:08:03.793629+0000","last_peered":"2024-09-12T18:08:03.793629+0000","last_clean":"2024-09-12T18:08:03.793629+0000","last_became_active":"2024-09-12T17:46:45.206537+0000","last_became_peered":"2024-09-12T17:46:45.206537+0000","last_unstale":"2024-09-12T18:08:03.793629+0000","last_undegraded":"2024-09-12T18:08:03.793629+0000","last_fullsized":"2024-09-12T18:08:03.793629+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:43.731520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29814,"num_write":18,"num_write_kb":19003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.692448+0000","last_change":"2024-09-12T17:46:42.177736+0000","last_active":"2024-09-12T18:06:14.692448+0000","last_peered":"2024-09-12T18:06:14.692448+0000","last_clean":"2024-09-12T18:06:14.692448+0000","last_became_active":"2024-09-12T17:46:42.177427+0000","last_became_peered":"2024-09-12T17:46:42.177427+0000","last_unstale":"2024-09-12T18:06:14.692448+0000","last_undegraded":"2024-09-12T18:06:14.692448+0000","last_fullsized":"2024-09-12T18:06:14.692448+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:07.172378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'156","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.651994+0000","last_change":"2024-09-12T17:45:03.898576+0000","last_active":"2024-09-12T18:05:54.651994+0000","last_peered":"2024-09-12T18:05:54.651994+0000","last_clean":"2024-09-12T18:05:54.651994+0000","last_became_active":"2024-09-12T17:45:03.898292+0000","last_became_peered":"2024-09-12T17:45:03.898292+0000","last_unstale":"2024-09-12T18:05:54.651994+0000","last_undegraded":"2024-09-12T18:05:54.651994+0000","last_fullsized":"2024-09-12T18:05:54.651994+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:55.707973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":951,"num_read_kb":701,"num_write":196,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.646344+0000","last_change":"2024-09-12T17:57:00.464364+0000","last_active":"2024-09-12T18:05:39.646344+0000","last_peered":"2024-09-12T18:05:39.646344+0000","last_clean":"2024-09-12T18:05:39.646344+0000","last_became_active":"2024-09-12T17:57:00.464090+0000","last_became_peered":"2024-09-12T17:57:00.464090+0000","last_unstale":"2024-09-12T18:05:39.646344+0000","last_undegraded":"2024-09-12T18:05:39.646344+0000","last_fullsized":"2024-09-12T18:05:39.646344+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.615989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648116+0000","last_change":"2024-09-12T17:46:45.205661+0000","last_active":"2024-09-12T18:05:29.648116+0000","last_peered":"2024-09-12T18:05:29.648116+0000","last_clean":"2024-09-12T18:05:29.648116+0000","last_became_active":"2024-09-12T17:46:45.205357+0000","last_became_peered":"2024-09-12T17:46:45.205357+0000","last_unstale":"2024-09-12T18:05:29.648116+0000","last_undegraded":"2024-09-12T18:05:29.648116+0000","last_fullsized":"2024-09-12T18:05:29.648116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:35.096441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:49.697236+0000","last_change":"2024-09-12T17:46:42.176715+0000","last_active":"2024-09-12T18:06:49.697236+0000","last_peered":"2024-09-12T18:06:49.697236+0000","last_clean":"2024-09-12T18:06:49.697236+0000","last_became_active":"2024-09-12T17:46:42.176415+0000","last_became_peered":"2024-09-12T17:46:42.176415+0000","last_unstale":"2024-09-12T18:06:49.697236+0000","last_undegraded":"2024-09-12T18:06:49.697236+0000","last_fullsized":"2024-09-12T18:06:49.697236+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:04.586483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'25","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.647144+0000","last_change":"2024-09-12T17:45:03.889617+0000","last_active":"2024-09-12T18:05:54.647144+0000","last_peered":"2024-09-12T18:05:54.647144+0000","last_clean":"2024-09-12T18:05:54.647144+0000","last_became_active":"2024-09-12T17:45:03.889334+0000","last_became_peered":"2024-09-12T17:45:03.889334+0000","last_unstale":"2024-09-12T18:05:54.647144+0000","last_undegraded":"2024-09-12T18:05:54.647144+0000","last_fullsized":"2024-09-12T18:05:54.647144+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:08.253653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.649616+0000","last_change":"2024-09-12T17:57:00.453730+0000","last_active":"2024-09-12T18:05:39.649616+0000","last_peered":"2024-09-12T18:05:39.649616+0000","last_clean":"2024-09-12T18:05:39.649616+0000","last_became_active":"2024-09-12T17:57:00.453435+0000","last_became_peered":"2024-09-12T17:57:00.453435+0000","last_unstale":"2024-09-12T18:05:39.649616+0000","last_undegraded":"2024-09-12T18:05:39.649616+0000","last_fullsized":"2024-09-12T18:05:39.649616+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:47.161486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"261'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.637517+0000","last_change":"2024-09-12T17:46:45.211314+0000","last_active":"2024-09-12T18:04:49.637517+0000","last_peered":"2024-09-12T18:04:49.637517+0000","last_clean":"2024-09-12T18:04:49.637517+0000","last_became_active":"2024-09-12T17:46:45.210669+0000","last_became_peered":"2024-09-12T17:46:45.210669+0000","last_unstale":"2024-09-12T18:04:49.637517+0000","last_undegraded":"2024-09-12T18:04:49.637517+0000","last_fullsized":"2024-09-12T18:04:49.637517+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:28.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.685819+0000","last_change":"2024-09-12T17:46:42.179654+0000","last_active":"2024-09-12T18:05:29.685819+0000","last_peered":"2024-09-12T18:05:29.685819+0000","last_clean":"2024-09-12T18:05:29.685819+0000","last_became_active":"2024-09-12T17:46:42.179369+0000","last_became_peered":"2024-09-12T17:46:42.179369+0000","last_unstale":"2024-09-12T18:05:29.685819+0000","last_undegraded":"2024-09-12T18:05:29.685819+0000","last_fullsized":"2024-09-12T18:05:29.685819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:46.896690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'11","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.522442+0000","last_change":"2024-09-12T17:45:03.892044+0000","last_active":"2024-09-12T18:05:54.522442+0000","last_peered":"2024-09-12T18:05:54.522442+0000","last_clean":"2024-09-12T18:05:54.522442+0000","last_became_active":"2024-09-12T17:45:03.891751+0000","last_became_peered":"2024-09-12T17:45:03.891751+0000","last_unstale":"2024-09-12T18:05:54.522442+0000","last_undegraded":"2024-09-12T18:05:54.522442+0000","last_fullsized":"2024-09-12T18:05:54.522442+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:57.974426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646774+0000","last_change":"2024-09-12T17:57:00.466635+0000","last_active":"2024-09-12T18:05:19.646774+0000","last_peered":"2024-09-12T18:05:19.646774+0000","last_clean":"2024-09-12T18:05:19.646774+0000","last_became_active":"2024-09-12T17:57:00.465706+0000","last_became_peered":"2024-09-12T17:57:00.465706+0000","last_unstale":"2024-09-12T18:05:19.646774+0000","last_undegraded":"2024-09-12T18:05:19.646774+0000","last_fullsized":"2024-09-12T18:05:19.646774+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:50.291887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'8","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.761747+0000","last_change":"2024-09-12T17:46:45.207296+0000","last_active":"2024-09-12T18:08:03.761747+0000","last_peered":"2024-09-12T18:08:03.761747+0000","last_clean":"2024-09-12T18:08:03.761747+0000","last_became_active":"2024-09-12T17:46:45.206384+0000","last_became_peered":"2024-09-12T17:46:45.206384+0000","last_unstale":"2024-09-12T18:08:03.761747+0000","last_undegraded":"2024-09-12T18:08:03.761747+0000","last_fullsized":"2024-09-12T18:08:03.761747+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:12.346318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":22528,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.760790+0000","last_change":"2024-09-12T17:46:42.177668+0000","last_active":"2024-09-12T18:08:03.760790+0000","last_peered":"2024-09-12T18:08:03.760790+0000","last_clean":"2024-09-12T18:08:03.760790+0000","last_became_active":"2024-09-12T17:46:42.177381+0000","last_became_peered":"2024-09-12T17:46:42.177381+0000","last_unstale":"2024-09-12T18:08:03.760790+0000","last_undegraded":"2024-09-12T18:08:03.760790+0000","last_fullsized":"2024-09-12T18:08:03.760790+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:48.797003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.908163+0000","last_change":"2024-09-12T17:45:03.893535+0000","last_active":"2024-09-12T18:05:56.908163+0000","last_peered":"2024-09-12T18:05:56.908163+0000","last_clean":"2024-09-12T18:05:56.908163+0000","last_became_active":"2024-09-12T17:45:03.893234+0000","last_became_peered":"2024-09-12T17:45:03.893234+0000","last_unstale":"2024-09-12T18:05:56.908163+0000","last_undegraded":"2024-09-12T18:05:56.908163+0000","last_fullsized":"2024-09-12T18:05:56.908163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:56.134844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":127,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.685120+0000","last_change":"2024-09-12T17:57:00.467265+0000","last_active":"2024-09-12T18:05:24.685120+0000","last_peered":"2024-09-12T18:05:24.685120+0000","last_clean":"2024-09-12T18:05:24.685120+0000","last_became_active":"2024-09-12T17:57:00.466994+0000","last_became_peered":"2024-09-12T17:57:00.466994+0000","last_unstale":"2024-09-12T18:05:24.685120+0000","last_undegraded":"2024-09-12T18:05:24.685120+0000","last_fullsized":"2024-09-12T18:05:24.685120+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:10.618141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519076+0000","last_change":"2024-09-12T17:46:45.207817+0000","last_active":"2024-09-12T18:05:29.519076+0000","last_peered":"2024-09-12T18:05:29.519076+0000","last_clean":"2024-09-12T18:05:29.519076+0000","last_became_active":"2024-09-12T17:46:45.207552+0000","last_became_peered":"2024-09-12T17:46:45.207552+0000","last_unstale":"2024-09-12T18:05:29.519076+0000","last_undegraded":"2024-09-12T18:05:29.519076+0000","last_fullsized":"2024-09-12T18:05:29.519076+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.256254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.536825+0000","last_change":"2024-09-12T17:46:42.182084+0000","last_active":"2024-09-12T18:07:34.536825+0000","last_peered":"2024-09-12T18:07:34.536825+0000","last_clean":"2024-09-12T18:07:34.536825+0000","last_became_active":"2024-09-12T17:46:42.181805+0000","last_became_peered":"2024-09-12T17:46:42.181805+0000","last_unstale":"2024-09-12T18:07:34.536825+0000","last_undegraded":"2024-09-12T18:07:34.536825+0000","last_fullsized":"2024-09-12T18:07:34.536825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:10.912482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'23","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.747227+0000","last_change":"2024-09-12T17:45:03.893633+0000","last_active":"2024-09-12T18:05:56.747227+0000","last_peered":"2024-09-12T18:05:56.747227+0000","last_clean":"2024-09-12T18:05:56.747227+0000","last_became_active":"2024-09-12T17:45:03.893361+0000","last_became_peered":"2024-09-12T17:45:03.893361+0000","last_unstale":"2024-09-12T18:05:56.747227+0000","last_undegraded":"2024-09-12T18:05:56.747227+0000","last_fullsized":"2024-09-12T18:05:56.747227+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:44.155033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":77,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'207","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.242849+0000","last_change":"2024-09-12T17:29:52.955507+0000","last_active":"2024-09-12T18:05:59.242849+0000","last_peered":"2024-09-12T18:05:59.242849+0000","last_clean":"2024-09-12T18:05:59.242849+0000","last_became_active":"2024-09-12T17:29:52.955124+0000","last_became_peered":"2024-09-12T17:29:52.955124+0000","last_unstale":"2024-09-12T18:05:59.242849+0000","last_undegraded":"2024-09-12T18:05:59.242849+0000","last_fullsized":"2024-09-12T18:05:59.242849+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:32.089966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":3241,"num_write":1056,"num_write_kb":28474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'166","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.325382+0000","last_change":"2024-09-12T17:29:54.957835+0000","last_active":"2024-09-12T18:05:55.325382+0000","last_peered":"2024-09-12T18:05:55.325382+0000","last_clean":"2024-09-12T18:05:55.325382+0000","last_became_active":"2024-09-12T17:29:54.957047+0000","last_became_peered":"2024-09-12T17:29:54.957047+0000","last_unstale":"2024-09-12T18:05:55.325382+0000","last_undegraded":"2024-09-12T18:05:55.325382+0000","last_fullsized":"2024-09-12T18:05:55.325382+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:17.894082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":598,"num_write":253,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'214","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.718193+0000","last_change":"2024-09-12T17:29:52.954589+0000","last_active":"2024-09-12T18:08:03.718193+0000","last_peered":"2024-09-12T18:08:03.718193+0000","last_clean":"2024-09-12T18:08:03.718193+0000","last_became_active":"2024-09-12T17:29:52.954249+0000","last_became_peered":"2024-09-12T17:29:52.954249+0000","last_unstale":"2024-09-12T18:08:03.718193+0000","last_undegraded":"2024-09-12T18:08:03.718193+0000","last_fullsized":"2024-09-12T18:08:03.718193+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:36.461295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":62367,"num_write":1041,"num_write_kb":21747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'277","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:58.408944+0000","last_change":"2024-09-12T17:29:54.959793+0000","last_active":"2024-09-12T18:05:58.408944+0000","last_peered":"2024-09-12T18:05:58.408944+0000","last_clean":"2024-09-12T18:05:58.408944+0000","last_became_active":"2024-09-12T17:29:54.959503+0000","last_became_peered":"2024-09-12T17:29:54.959503+0000","last_unstale":"2024-09-12T18:05:58.408944+0000","last_undegraded":"2024-09-12T18:05:58.408944+0000","last_fullsized":"2024-09-12T18:05:58.408944+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:15.895941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1203,"num_read_kb":968,"num_write":436,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'251","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.740225+0000","last_change":"2024-09-12T17:29:52.957963+0000","last_active":"2024-09-12T18:08:03.740225+0000","last_peered":"2024-09-12T18:08:03.740225+0000","last_clean":"2024-09-12T18:08:03.740225+0000","last_became_active":"2024-09-12T17:29:52.957594+0000","last_became_peered":"2024-09-12T17:29:52.957594+0000","last_unstale":"2024-09-12T18:08:03.740225+0000","last_undegraded":"2024-09-12T18:08:03.740225+0000","last_fullsized":"2024-09-12T18:08:03.740225+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:50.942076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595238,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":699,"num_read_kb":82538,"num_write":1032,"num_write_kb":35611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'90","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.508667+0000","last_change":"2024-09-12T17:29:54.955262+0000","last_active":"2024-09-12T18:05:53.508667+0000","last_peered":"2024-09-12T18:05:53.508667+0000","last_clean":"2024-09-12T18:05:53.508667+0000","last_became_active":"2024-09-12T17:29:54.954764+0000","last_became_peered":"2024-09-12T17:29:54.954764+0000","last_unstale":"2024-09-12T18:05:53.508667+0000","last_undegraded":"2024-09-12T18:05:53.508667+0000","last_fullsized":"2024-09-12T18:05:53.508667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:12.643057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":371,"num_write":125,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'210","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.889133+0000","last_change":"2024-09-12T17:29:52.957193+0000","last_active":"2024-09-12T18:08:03.889133+0000","last_peered":"2024-09-12T18:08:03.889133+0000","last_clean":"2024-09-12T18:08:03.889133+0000","last_became_active":"2024-09-12T17:29:52.956816+0000","last_became_peered":"2024-09-12T17:29:52.956816+0000","last_unstale":"2024-09-12T18:08:03.889133+0000","last_undegraded":"2024-09-12T18:08:03.889133+0000","last_fullsized":"2024-09-12T18:08:03.889133+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:23.693578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":70330,"num_write":999,"num_write_kb":42186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4089","reported_seq":4667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.194774+0000","last_change":"2024-09-12T17:29:54.945238+0000","last_active":"2024-09-12T18:05:26.194774+0000","last_peered":"2024-09-12T18:05:26.194774+0000","last_clean":"2024-09-12T18:05:26.194774+0000","last_became_active":"2024-09-12T17:29:54.944959+0000","last_became_peered":"2024-09-12T17:29:54.944959+0000","last_unstale":"2024-09-12T18:05:26.194774+0000","last_undegraded":"2024-09-12T18:05:26.194774+0000","last_fullsized":"2024-09-12T18:05:26.194774+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":3000,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:46.528319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16426,"num_read_kb":13705,"num_write":6135,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'163","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.635254+0000","last_change":"2024-09-12T17:29:52.961055+0000","last_active":"2024-09-12T18:08:03.635254+0000","last_peered":"2024-09-12T18:08:03.635254+0000","last_clean":"2024-09-12T18:08:03.635254+0000","last_became_active":"2024-09-12T17:29:52.960666+0000","last_became_peered":"2024-09-12T17:29:52.960666+0000","last_unstale":"2024-09-12T18:08:03.635254+0000","last_undegraded":"2024-09-12T18:08:03.635254+0000","last_fullsized":"2024-09-12T18:08:03.635254+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:19.974025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":500,"num_read_kb":127585,"num_write":826,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'125","reported_seq":684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.523623+0000","last_change":"2024-09-12T17:29:54.955474+0000","last_active":"2024-09-12T18:06:04.523623+0000","last_peered":"2024-09-12T18:06:04.523623+0000","last_clean":"2024-09-12T18:06:04.523623+0000","last_became_active":"2024-09-12T17:29:54.955205+0000","last_became_peered":"2024-09-12T17:29:54.955205+0000","last_unstale":"2024-09-12T18:06:04.523623+0000","last_undegraded":"2024-09-12T18:06:04.523623+0000","last_fullsized":"2024-09-12T18:06:04.523623+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:25.759255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":437,"num_write":181,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'215","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.782795+0000","last_change":"2024-09-12T17:29:52.960833+0000","last_active":"2024-09-12T18:08:03.782795+0000","last_peered":"2024-09-12T18:08:03.782795+0000","last_clean":"2024-09-12T18:08:03.782795+0000","last_became_active":"2024-09-12T17:29:52.955926+0000","last_became_peered":"2024-09-12T17:29:52.955926+0000","last_unstale":"2024-09-12T18:08:03.782795+0000","last_undegraded":"2024-09-12T18:08:03.782795+0000","last_fullsized":"2024-09-12T18:08:03.782795+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:53.948085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":501,"num_read_kb":5634,"num_write":1057,"num_write_kb":27185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'203","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.854752+0000","last_change":"2024-09-12T17:29:54.955413+0000","last_active":"2024-09-12T18:06:20.854752+0000","last_peered":"2024-09-12T18:06:20.854752+0000","last_clean":"2024-09-12T18:06:20.854752+0000","last_became_active":"2024-09-12T17:29:54.955119+0000","last_became_peered":"2024-09-12T17:29:54.955119+0000","last_unstale":"2024-09-12T18:06:20.854752+0000","last_undegraded":"2024-09-12T18:06:20.854752+0000","last_fullsized":"2024-09-12T18:06:20.854752+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:34.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":872,"num_read_kb":697,"num_write":351,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'196","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.713495+0000","last_change":"2024-09-12T17:29:52.962572+0000","last_active":"2024-09-12T18:08:03.713495+0000","last_peered":"2024-09-12T18:08:03.713495+0000","last_clean":"2024-09-12T18:08:03.713495+0000","last_became_active":"2024-09-12T17:29:52.962236+0000","last_became_peered":"2024-09-12T17:29:52.962236+0000","last_unstale":"2024-09-12T18:08:03.713495+0000","last_undegraded":"2024-09-12T18:08:03.713495+0000","last_fullsized":"2024-09-12T18:08:03.713495+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:19.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2835815,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":524,"num_read_kb":5167,"num_write":1014,"num_write_kb":25714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'272","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:18.420389+0000","last_change":"2024-09-12T17:29:54.963988+0000","last_active":"2024-09-12T18:06:18.420389+0000","last_peered":"2024-09-12T18:06:18.420389+0000","last_clean":"2024-09-12T18:06:18.420389+0000","last_became_active":"2024-09-12T17:29:54.963665+0000","last_became_peered":"2024-09-12T17:29:54.963665+0000","last_unstale":"2024-09-12T18:06:18.420389+0000","last_undegraded":"2024-09-12T18:06:18.420389+0000","last_fullsized":"2024-09-12T18:06:18.420389+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:56.293772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1246,"num_read_kb":1040,"num_write":431,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'231","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.731929+0000","last_change":"2024-09-12T17:29:52.956163+0000","last_active":"2024-09-12T18:08:03.731929+0000","last_peered":"2024-09-12T18:08:03.731929+0000","last_clean":"2024-09-12T18:08:03.731929+0000","last_became_active":"2024-09-12T17:29:52.955333+0000","last_became_peered":"2024-09-12T17:29:52.955333+0000","last_unstale":"2024-09-12T18:08:03.731929+0000","last_undegraded":"2024-09-12T18:08:03.731929+0000","last_fullsized":"2024-09-12T18:08:03.731929+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:31.003485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569139,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":94260,"num_write":1118,"num_write_kb":40355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'158","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.172360+0000","last_change":"2024-09-12T17:29:54.952797+0000","last_active":"2024-09-12T18:06:07.172360+0000","last_peered":"2024-09-12T18:06:07.172360+0000","last_clean":"2024-09-12T18:06:07.172360+0000","last_became_active":"2024-09-12T17:29:54.952536+0000","last_became_peered":"2024-09-12T17:29:54.952536+0000","last_unstale":"2024-09-12T18:06:07.172360+0000","last_undegraded":"2024-09-12T18:06:07.172360+0000","last_fullsized":"2024-09-12T18:06:07.172360+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:50.999631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":604,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'401","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.229784+0000","last_change":"2024-09-12T17:29:54.955472+0000","last_active":"2024-09-12T18:05:52.229784+0000","last_peered":"2024-09-12T18:05:52.229784+0000","last_clean":"2024-09-12T18:05:52.229784+0000","last_became_active":"2024-09-12T17:29:54.954401+0000","last_became_peered":"2024-09-12T17:29:54.954401+0000","last_unstale":"2024-09-12T18:05:52.229784+0000","last_undegraded":"2024-09-12T18:05:52.229784+0000","last_fullsized":"2024-09-12T18:05:52.229784+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:16.926597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1720,"num_read_kb":1358,"num_write":655,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'182","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.692462+0000","last_change":"2024-09-12T17:29:52.958556+0000","last_active":"2024-09-12T18:06:14.692462+0000","last_peered":"2024-09-12T18:06:14.692462+0000","last_clean":"2024-09-12T18:06:14.692462+0000","last_became_active":"2024-09-12T17:29:52.957715+0000","last_became_peered":"2024-09-12T17:29:52.957715+0000","last_unstale":"2024-09-12T18:06:14.692462+0000","last_undegraded":"2024-09-12T18:06:14.692462+0000","last_fullsized":"2024-09-12T18:06:14.692462+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:48.046592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":380,"num_write":908,"num_write_kb":20925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'91","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.680830+0000","last_change":"2024-09-12T17:29:54.960764+0000","last_active":"2024-09-12T18:04:54.680830+0000","last_peered":"2024-09-12T18:04:54.680830+0000","last_clean":"2024-09-12T18:04:54.680830+0000","last_became_active":"2024-09-12T17:29:54.960430+0000","last_became_peered":"2024-09-12T17:29:54.960430+0000","last_unstale":"2024-09-12T18:04:54.680830+0000","last_undegraded":"2024-09-12T18:04:54.680830+0000","last_fullsized":"2024-09-12T18:04:54.680830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:51.078408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":446,"num_read_kb":372,"num_write":151,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'245","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.793314+0000","last_change":"2024-09-12T17:29:52.961437+0000","last_active":"2024-09-12T18:08:03.793314+0000","last_peered":"2024-09-12T18:08:03.793314+0000","last_clean":"2024-09-12T18:08:03.793314+0000","last_became_active":"2024-09-12T17:29:52.960770+0000","last_became_peered":"2024-09-12T17:29:52.960770+0000","last_unstale":"2024-09-12T18:08:03.793314+0000","last_undegraded":"2024-09-12T18:08:03.793314+0000","last_fullsized":"2024-09-12T18:08:03.793314+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:52.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291498,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":825,"num_read_kb":13405,"num_write":1115,"num_write_kb":28936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'257","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.245805+0000","last_change":"2024-09-12T17:29:54.963348+0000","last_active":"2024-09-12T18:06:21.245805+0000","last_peered":"2024-09-12T18:06:21.245805+0000","last_clean":"2024-09-12T18:06:21.245805+0000","last_became_active":"2024-09-12T17:29:54.962822+0000","last_became_peered":"2024-09-12T17:29:54.962822+0000","last_unstale":"2024-09-12T18:06:21.245805+0000","last_undegraded":"2024-09-12T18:06:21.245805+0000","last_fullsized":"2024-09-12T18:06:21.245805+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:14.125505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1220,"num_read_kb":1023,"num_write":434,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'208","reported_seq":845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.737204+0000","last_change":"2024-09-12T17:29:52.956896+0000","last_active":"2024-09-12T18:08:03.737204+0000","last_peered":"2024-09-12T18:08:03.737204+0000","last_clean":"2024-09-12T18:08:03.737204+0000","last_became_active":"2024-09-12T17:29:52.956432+0000","last_became_peered":"2024-09-12T17:29:52.956432+0000","last_unstale":"2024-09-12T18:08:03.737204+0000","last_undegraded":"2024-09-12T18:08:03.737204+0000","last_fullsized":"2024-09-12T18:08:03.737204+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:34.225457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306456,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":42949,"num_write":1043,"num_write_kb":37671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'84","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.247939+0000","last_change":"2024-09-12T17:29:54.944847+0000","last_active":"2024-09-12T18:05:24.247939+0000","last_peered":"2024-09-12T18:05:24.247939+0000","last_clean":"2024-09-12T18:05:24.247939+0000","last_became_active":"2024-09-12T17:29:54.944588+0000","last_became_peered":"2024-09-12T17:29:54.944588+0000","last_unstale":"2024-09-12T18:05:24.247939+0000","last_undegraded":"2024-09-12T18:05:24.247939+0000","last_fullsized":"2024-09-12T18:05:24.247939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:15.044680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":342,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'232","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.849222+0000","last_change":"2024-09-12T17:29:52.963156+0000","last_active":"2024-09-12T18:08:03.849222+0000","last_peered":"2024-09-12T18:08:03.849222+0000","last_clean":"2024-09-12T18:08:03.849222+0000","last_became_active":"2024-09-12T17:29:52.962814+0000","last_became_peered":"2024-09-12T17:29:52.962814+0000","last_unstale":"2024-09-12T18:08:03.849222+0000","last_undegraded":"2024-09-12T18:08:03.849222+0000","last_fullsized":"2024-09-12T18:08:03.849222+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:05.435586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":494,"num_read_kb":48249,"num_write":1130,"num_write_kb":37209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'125","reported_seq":719,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:18.231406+0000","last_change":"2024-09-12T17:29:54.957275+0000","last_active":"2024-09-12T18:05:18.231406+0000","last_peered":"2024-09-12T18:05:18.231406+0000","last_clean":"2024-09-12T18:05:18.231406+0000","last_became_active":"2024-09-12T17:29:54.956975+0000","last_became_peered":"2024-09-12T17:29:54.956975+0000","last_unstale":"2024-09-12T18:05:18.231406+0000","last_undegraded":"2024-09-12T18:05:18.231406+0000","last_fullsized":"2024-09-12T18:05:18.231406+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:35.436729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":592,"num_read_kb":498,"num_write":187,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'266","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.831847+0000","last_change":"2024-09-12T17:29:52.954983+0000","last_active":"2024-09-12T18:08:03.831847+0000","last_peered":"2024-09-12T18:08:03.831847+0000","last_clean":"2024-09-12T18:08:03.831847+0000","last_became_active":"2024-09-12T17:29:52.954630+0000","last_became_peered":"2024-09-12T17:29:52.954630+0000","last_unstale":"2024-09-12T18:08:03.831847+0000","last_undegraded":"2024-09-12T18:08:03.831847+0000","last_fullsized":"2024-09-12T18:08:03.831847+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:32.291580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456483,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":845,"num_read_kb":67267,"num_write":1133,"num_write_kb":48740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'283","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.230047+0000","last_change":"2024-09-12T17:29:54.959334+0000","last_active":"2024-09-12T18:05:30.230047+0000","last_peered":"2024-09-12T18:05:30.230047+0000","last_clean":"2024-09-12T18:05:30.230047+0000","last_became_active":"2024-09-12T17:29:54.958852+0000","last_became_peered":"2024-09-12T17:29:54.958852+0000","last_unstale":"2024-09-12T18:05:30.230047+0000","last_undegraded":"2024-09-12T18:05:30.230047+0000","last_fullsized":"2024-09-12T18:05:30.230047+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:21.982711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1254,"num_read_kb":1035,"num_write":436,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'170","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.662861+0000","last_change":"2024-09-12T17:29:52.959483+0000","last_active":"2024-09-12T18:07:19.662861+0000","last_peered":"2024-09-12T18:07:19.662861+0000","last_clean":"2024-09-12T18:07:19.662861+0000","last_became_active":"2024-09-12T17:29:52.959175+0000","last_became_peered":"2024-09-12T17:29:52.959175+0000","last_unstale":"2024-09-12T18:07:19.662861+0000","last_undegraded":"2024-09-12T18:07:19.662861+0000","last_fullsized":"2024-09-12T18:07:19.662861+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:39.671271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":1243,"num_write":851,"num_write_kb":36341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'154","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.297485+0000","last_change":"2024-09-12T17:30:02.964799+0000","last_active":"2024-09-12T18:06:21.297485+0000","last_peered":"2024-09-12T18:06:21.297485+0000","last_clean":"2024-09-12T18:06:21.297485+0000","last_became_active":"2024-09-12T17:30:02.964492+0000","last_became_peered":"2024-09-12T17:30:02.964492+0000","last_unstale":"2024-09-12T18:06:21.297485+0000","last_undegraded":"2024-09-12T18:06:21.297485+0000","last_fullsized":"2024-09-12T18:06:21.297485+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:49.837441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":218,"num_read_kb":205,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'110","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.335050+0000","last_change":"2024-09-12T17:29:54.951914+0000","last_active":"2024-09-12T18:05:59.335050+0000","last_peered":"2024-09-12T18:05:59.335050+0000","last_clean":"2024-09-12T18:05:59.335050+0000","last_became_active":"2024-09-12T17:29:54.950633+0000","last_became_peered":"2024-09-12T17:29:54.950633+0000","last_unstale":"2024-09-12T18:05:59.335050+0000","last_undegraded":"2024-09-12T18:05:59.335050+0000","last_fullsized":"2024-09-12T18:05:59.335050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:07.589708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":400,"num_write":147,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'201","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.747705+0000","last_change":"2024-09-12T17:30:28.007547+0000","last_active":"2024-09-12T18:08:03.747705+0000","last_peered":"2024-09-12T18:08:03.747705+0000","last_clean":"2024-09-12T18:08:03.747705+0000","last_became_active":"2024-09-12T17:30:28.007183+0000","last_became_peered":"2024-09-12T17:30:28.007183+0000","last_unstale":"2024-09-12T18:08:03.747705+0000","last_undegraded":"2024-09-12T18:08:03.747705+0000","last_fullsized":"2024-09-12T18:08:03.747705+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:49.159102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":918,"num_read_kb":19617,"num_write":951,"num_write_kb":33635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.527115+0000","last_change":"2024-09-12T17:29:56.954842+0000","last_active":"2024-09-12T18:08:03.527115+0000","last_peered":"2024-09-12T18:08:03.527115+0000","last_clean":"2024-09-12T18:08:03.527115+0000","last_became_active":"2024-09-12T17:29:56.954488+0000","last_became_peered":"2024-09-12T17:29:56.954488+0000","last_unstale":"2024-09-12T18:08:03.527115+0000","last_undegraded":"2024-09-12T18:08:03.527115+0000","last_fullsized":"2024-09-12T18:08:03.527115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:16.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":724,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'178","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.803280+0000","last_change":"2024-09-12T17:29:58.957203+0000","last_active":"2024-09-12T18:08:03.803280+0000","last_peered":"2024-09-12T18:08:03.803280+0000","last_clean":"2024-09-12T18:08:03.803280+0000","last_became_active":"2024-09-12T17:29:58.956916+0000","last_became_peered":"2024-09-12T17:29:58.956916+0000","last_unstale":"2024-09-12T18:08:03.803280+0000","last_undegraded":"2024-09-12T18:08:03.803280+0000","last_fullsized":"2024-09-12T18:08:03.803280+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:23.529305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4406,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":236,"num_read_kb":279,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.671162+0000","last_change":"2024-09-12T17:30:00.960720+0000","last_active":"2024-09-12T18:03:54.671162+0000","last_peered":"2024-09-12T18:03:54.671162+0000","last_clean":"2024-09-12T18:03:54.671162+0000","last_became_active":"2024-09-12T17:30:00.960409+0000","last_became_peered":"2024-09-12T17:30:00.960409+0000","last_unstale":"2024-09-12T18:03:54.671162+0000","last_undegraded":"2024-09-12T18:03:54.671162+0000","last_fullsized":"2024-09-12T18:03:54.671162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:36.986925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2442","reported_seq":4366,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.852848+0000","last_change":"2024-09-12T17:30:02.968528+0000","last_active":"2024-09-12T18:06:20.852848+0000","last_peered":"2024-09-12T18:06:20.852848+0000","last_clean":"2024-09-12T18:06:20.852848+0000","last_became_active":"2024-09-12T17:30:02.967718+0000","last_became_peered":"2024-09-12T17:30:02.967718+0000","last_unstale":"2024-09-12T18:06:20.852848+0000","last_undegraded":"2024-09-12T18:06:20.852848+0000","last_fullsized":"2024-09-12T18:06:20.852848+0000","mapping_epoch":34,"log_start":"264'2400","ondisk_log_start":"264'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":2400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:40.278625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1044,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6319,"num_read_kb":6274,"num_write":4873,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'136","reported_seq":718,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.219639+0000","last_change":"2024-09-12T17:29:54.958156+0000","last_active":"2024-09-12T18:05:53.219639+0000","last_peered":"2024-09-12T18:05:53.219639+0000","last_clean":"2024-09-12T18:05:53.219639+0000","last_became_active":"2024-09-12T17:29:54.957747+0000","last_became_peered":"2024-09-12T17:29:54.957747+0000","last_unstale":"2024-09-12T18:05:53.219639+0000","last_undegraded":"2024-09-12T18:05:53.219639+0000","last_fullsized":"2024-09-12T18:05:53.219639+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:45.769420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":552,"num_write":215,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'213","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.781534+0000","last_change":"2024-09-12T17:29:52.950951+0000","last_active":"2024-09-12T18:08:03.781534+0000","last_peered":"2024-09-12T18:08:03.781534+0000","last_clean":"2024-09-12T18:08:03.781534+0000","last_became_active":"2024-09-12T17:29:52.950612+0000","last_became_peered":"2024-09-12T17:29:52.950612+0000","last_unstale":"2024-09-12T18:08:03.781534+0000","last_undegraded":"2024-09-12T18:08:03.781534+0000","last_fullsized":"2024-09-12T18:08:03.781534+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:09.873785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":421,"num_read_kb":10994,"num_write":1027,"num_write_kb":32732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.528200+0000","last_change":"2024-09-12T17:29:56.953819+0000","last_active":"2024-09-12T18:05:09.528200+0000","last_peered":"2024-09-12T18:05:09.528200+0000","last_clean":"2024-09-12T18:05:09.528200+0000","last_became_active":"2024-09-12T17:29:56.953546+0000","last_became_peered":"2024-09-12T17:29:56.953546+0000","last_unstale":"2024-09-12T18:05:09.528200+0000","last_undegraded":"2024-09-12T18:05:09.528200+0000","last_fullsized":"2024-09-12T18:05:09.528200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:02.063377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'85","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.814472+0000","last_change":"2024-09-12T17:29:58.951397+0000","last_active":"2024-09-12T18:05:55.814472+0000","last_peered":"2024-09-12T18:05:55.814472+0000","last_clean":"2024-09-12T18:05:55.814472+0000","last_became_active":"2024-09-12T17:29:58.951077+0000","last_became_peered":"2024-09-12T17:29:58.951077+0000","last_unstale":"2024-09-12T18:05:55.814472+0000","last_undegraded":"2024-09-12T18:05:55.814472+0000","last_fullsized":"2024-09-12T18:05:55.814472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:32.229853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.505635+0000","last_change":"2024-09-12T17:30:00.969561+0000","last_active":"2024-09-12T18:03:54.505635+0000","last_peered":"2024-09-12T18:03:54.505635+0000","last_clean":"2024-09-12T18:03:54.505635+0000","last_became_active":"2024-09-12T17:30:00.969291+0000","last_became_peered":"2024-09-12T17:30:00.969291+0000","last_unstale":"2024-09-12T18:03:54.505635+0000","last_undegraded":"2024-09-12T18:03:54.505635+0000","last_fullsized":"2024-09-12T18:03:54.505635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:59.191519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'123","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:03.288660+0000","last_change":"2024-09-12T17:30:02.972169+0000","last_active":"2024-09-12T18:06:03.288660+0000","last_peered":"2024-09-12T18:06:03.288660+0000","last_clean":"2024-09-12T18:06:03.288660+0000","last_became_active":"2024-09-12T17:30:02.971843+0000","last_became_peered":"2024-09-12T17:30:02.971843+0000","last_unstale":"2024-09-12T18:06:03.288660+0000","last_undegraded":"2024-09-12T18:06:03.288660+0000","last_fullsized":"2024-09-12T18:06:03.288660+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:27.791607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'129","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.234318+0000","last_change":"2024-09-12T17:29:54.945375+0000","last_active":"2024-09-12T18:06:00.234318+0000","last_peered":"2024-09-12T18:06:00.234318+0000","last_clean":"2024-09-12T18:06:00.234318+0000","last_became_active":"2024-09-12T17:29:54.944698+0000","last_became_peered":"2024-09-12T17:29:54.944698+0000","last_unstale":"2024-09-12T18:06:00.234318+0000","last_undegraded":"2024-09-12T18:06:00.234318+0000","last_fullsized":"2024-09-12T18:06:00.234318+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:02.736469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":422,"num_write":199,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'178","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.644910+0000","last_change":"2024-09-12T17:29:52.963403+0000","last_active":"2024-09-12T18:08:03.644910+0000","last_peered":"2024-09-12T18:08:03.644910+0000","last_clean":"2024-09-12T18:08:03.644910+0000","last_became_active":"2024-09-12T17:29:52.963087+0000","last_became_peered":"2024-09-12T17:29:52.963087+0000","last_unstale":"2024-09-12T18:08:03.644910+0000","last_undegraded":"2024-09-12T18:08:03.644910+0000","last_fullsized":"2024-09-12T18:08:03.644910+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:31.829205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128531,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":3190,"num_write":917,"num_write_kb":30863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.515779+0000","last_change":"2024-09-12T17:29:56.953137+0000","last_active":"2024-09-12T18:03:49.515779+0000","last_peered":"2024-09-12T18:03:49.515779+0000","last_clean":"2024-09-12T18:03:49.515779+0000","last_became_active":"2024-09-12T17:29:56.952827+0000","last_became_peered":"2024-09-12T17:29:56.952827+0000","last_unstale":"2024-09-12T18:03:49.515779+0000","last_undegraded":"2024-09-12T18:03:49.515779+0000","last_fullsized":"2024-09-12T18:03:49.515779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:28.816718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'97","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.555493+0000","last_change":"2024-09-12T17:29:58.952475+0000","last_active":"2024-09-12T18:05:29.555493+0000","last_peered":"2024-09-12T18:05:29.555493+0000","last_clean":"2024-09-12T18:05:29.555493+0000","last_became_active":"2024-09-12T17:29:58.952169+0000","last_became_peered":"2024-09-12T17:29:58.952169+0000","last_unstale":"2024-09-12T18:05:29.555493+0000","last_undegraded":"2024-09-12T18:05:29.555493+0000","last_fullsized":"2024-09-12T18:05:29.555493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:14.255681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":103,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'754","reported_seq":2404,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.555776+0000","last_change":"2024-09-12T17:30:00.954478+0000","last_active":"2024-09-12T18:08:03.555776+0000","last_peered":"2024-09-12T18:08:03.555776+0000","last_clean":"2024-09-12T18:08:03.555776+0000","last_became_active":"2024-09-12T17:30:00.954180+0000","last_became_peered":"2024-09-12T17:30:00.954180+0000","last_unstale":"2024-09-12T18:08:03.555776+0000","last_undegraded":"2024-09-12T18:08:03.555776+0000","last_fullsized":"2024-09-12T18:08:03.555776+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:51.847365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'180","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.347847+0000","last_change":"2024-09-12T17:30:02.962486+0000","last_active":"2024-09-12T18:06:21.347847+0000","last_peered":"2024-09-12T18:06:21.347847+0000","last_clean":"2024-09-12T18:06:21.347847+0000","last_became_active":"2024-09-12T17:30:02.961198+0000","last_became_peered":"2024-09-12T17:30:02.961198+0000","last_unstale":"2024-09-12T18:06:21.347847+0000","last_undegraded":"2024-09-12T18:06:21.347847+0000","last_fullsized":"2024-09-12T18:06:21.347847+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:59.034236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":624,"num_write":393,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'95","reported_seq":671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.293469+0000","last_change":"2024-09-12T17:29:54.956913+0000","last_active":"2024-09-12T18:06:06.293469+0000","last_peered":"2024-09-12T18:06:06.293469+0000","last_clean":"2024-09-12T18:06:06.293469+0000","last_became_active":"2024-09-12T17:29:54.956663+0000","last_became_peered":"2024-09-12T17:29:54.956663+0000","last_unstale":"2024-09-12T18:06:06.293469+0000","last_undegraded":"2024-09-12T18:06:06.293469+0000","last_fullsized":"2024-09-12T18:06:06.293469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:29.330762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":356,"num_write":140,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'167","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.840248+0000","last_change":"2024-09-12T17:29:52.963393+0000","last_active":"2024-09-12T18:08:03.840248+0000","last_peered":"2024-09-12T18:08:03.840248+0000","last_clean":"2024-09-12T18:08:03.840248+0000","last_became_active":"2024-09-12T17:29:52.962665+0000","last_became_peered":"2024-09-12T17:29:52.962665+0000","last_unstale":"2024-09-12T18:08:03.840248+0000","last_undegraded":"2024-09-12T18:08:03.840248+0000","last_fullsized":"2024-09-12T18:08:03.840248+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:43.499509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":354,"num_read_kb":5731,"num_write":816,"num_write_kb":29128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.627887+0000","last_change":"2024-09-12T17:29:56.953011+0000","last_active":"2024-09-12T18:03:49.627887+0000","last_peered":"2024-09-12T18:03:49.627887+0000","last_clean":"2024-09-12T18:03:49.627887+0000","last_became_active":"2024-09-12T17:29:56.952625+0000","last_became_peered":"2024-09-12T17:29:56.952625+0000","last_unstale":"2024-09-12T18:03:49.627887+0000","last_undegraded":"2024-09-12T18:03:49.627887+0000","last_fullsized":"2024-09-12T18:03:49.627887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:37.754261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'105","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.754301+0000","last_change":"2024-09-12T17:29:58.978681+0000","last_active":"2024-09-12T18:08:03.754301+0000","last_peered":"2024-09-12T18:08:03.754301+0000","last_clean":"2024-09-12T18:08:03.754301+0000","last_became_active":"2024-09-12T17:29:58.978299+0000","last_became_peered":"2024-09-12T17:29:58.978299+0000","last_unstale":"2024-09-12T18:08:03.754301+0000","last_undegraded":"2024-09-12T18:08:03.754301+0000","last_fullsized":"2024-09-12T18:08:03.754301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:51.821063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'776","reported_seq":3919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.784663+0000","last_change":"2024-09-12T17:30:00.963021+0000","last_active":"2024-09-12T18:08:03.784663+0000","last_peered":"2024-09-12T18:08:03.784663+0000","last_clean":"2024-09-12T18:08:03.784663+0000","last_became_active":"2024-09-12T17:30:00.962754+0000","last_became_peered":"2024-09-12T17:30:00.962754+0000","last_unstale":"2024-09-12T18:08:03.784663+0000","last_undegraded":"2024-09-12T18:08:03.784663+0000","last_fullsized":"2024-09-12T18:08:03.784663+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:34.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'251","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.889819+0000","last_change":"2024-09-12T17:29:54.957456+0000","last_active":"2024-09-12T18:06:00.889819+0000","last_peered":"2024-09-12T18:06:00.889819+0000","last_clean":"2024-09-12T18:06:00.889819+0000","last_became_active":"2024-09-12T17:29:54.957148+0000","last_became_peered":"2024-09-12T17:29:54.957148+0000","last_unstale":"2024-09-12T18:06:00.889819+0000","last_undegraded":"2024-09-12T18:06:00.889819+0000","last_fullsized":"2024-09-12T18:06:00.889819+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:19.628837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":968,"num_write":398,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'237","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.691709+0000","last_change":"2024-09-12T17:29:52.964771+0000","last_active":"2024-09-12T18:08:03.691709+0000","last_peered":"2024-09-12T18:08:03.691709+0000","last_clean":"2024-09-12T18:08:03.691709+0000","last_became_active":"2024-09-12T17:29:52.964421+0000","last_became_peered":"2024-09-12T17:29:52.964421+0000","last_unstale":"2024-09-12T18:08:03.691709+0000","last_undegraded":"2024-09-12T18:08:03.691709+0000","last_fullsized":"2024-09-12T18:08:03.691709+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:13.642050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":5176,"num_write":1044,"num_write_kb":56179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.678374+0000","last_change":"2024-09-12T17:29:56.953482+0000","last_active":"2024-09-12T18:04:39.678374+0000","last_peered":"2024-09-12T18:04:39.678374+0000","last_clean":"2024-09-12T18:04:39.678374+0000","last_became_active":"2024-09-12T17:29:56.953204+0000","last_became_peered":"2024-09-12T17:29:56.953204+0000","last_unstale":"2024-09-12T18:04:39.678374+0000","last_undegraded":"2024-09-12T18:04:39.678374+0000","last_fullsized":"2024-09-12T18:04:39.678374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:49.409852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'181","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.833794+0000","last_change":"2024-09-12T17:29:58.979003+0000","last_active":"2024-09-12T18:08:03.833794+0000","last_peered":"2024-09-12T18:08:03.833794+0000","last_clean":"2024-09-12T18:08:03.833794+0000","last_became_active":"2024-09-12T17:29:58.978213+0000","last_became_peered":"2024-09-12T17:29:58.978213+0000","last_unstale":"2024-09-12T18:08:03.833794+0000","last_undegraded":"2024-09-12T18:08:03.833794+0000","last_fullsized":"2024-09-12T18:08:03.833794+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:29.055630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9297,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":251,"num_read_kb":306,"num_write":140,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.632793+0000","last_change":"2024-09-12T17:30:00.959136+0000","last_active":"2024-09-12T18:03:49.632793+0000","last_peered":"2024-09-12T18:03:49.632793+0000","last_clean":"2024-09-12T18:03:49.632793+0000","last_became_active":"2024-09-12T17:30:00.958723+0000","last_became_peered":"2024-09-12T17:30:00.958723+0000","last_unstale":"2024-09-12T18:03:49.632793+0000","last_undegraded":"2024-09-12T18:03:49.632793+0000","last_fullsized":"2024-09-12T18:03:49.632793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:07.523774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'549","reported_seq":1353,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.673110+0000","last_change":"2024-09-12T17:30:02.968872+0000","last_active":"2024-09-12T18:07:38.673110+0000","last_peered":"2024-09-12T18:07:38.673110+0000","last_clean":"2024-09-12T18:07:38.673110+0000","last_became_active":"2024-09-12T17:30:02.968515+0000","last_became_peered":"2024-09-12T17:30:02.968515+0000","last_unstale":"2024-09-12T18:07:38.673110+0000","last_undegraded":"2024-09-12T18:07:38.673110+0000","last_fullsized":"2024-09-12T18:07:38.673110+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:33.814672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1325,"num_read_kb":1316,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'153","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.308857+0000","last_change":"2024-09-12T17:29:54.959404+0000","last_active":"2024-09-12T18:06:08.308857+0000","last_peered":"2024-09-12T18:06:08.308857+0000","last_clean":"2024-09-12T18:06:08.308857+0000","last_became_active":"2024-09-12T17:29:54.959140+0000","last_became_peered":"2024-09-12T17:29:54.959140+0000","last_unstale":"2024-09-12T18:06:08.308857+0000","last_undegraded":"2024-09-12T18:06:08.308857+0000","last_fullsized":"2024-09-12T18:06:08.308857+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:46.796125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":582,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'177","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.856857+0000","last_change":"2024-09-12T17:29:52.964678+0000","last_active":"2024-09-12T18:08:03.856857+0000","last_peered":"2024-09-12T18:08:03.856857+0000","last_clean":"2024-09-12T18:08:03.856857+0000","last_became_active":"2024-09-12T17:29:52.964339+0000","last_became_peered":"2024-09-12T17:29:52.964339+0000","last_unstale":"2024-09-12T18:08:03.856857+0000","last_undegraded":"2024-09-12T18:08:03.856857+0000","last_fullsized":"2024-09-12T18:08:03.856857+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:23.502950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395849,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":381,"num_read_kb":1621,"num_write":866,"num_write_kb":10562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.638636+0000","last_change":"2024-09-12T17:29:56.954142+0000","last_active":"2024-09-12T18:04:39.638636+0000","last_peered":"2024-09-12T18:04:39.638636+0000","last_clean":"2024-09-12T18:04:39.638636+0000","last_became_active":"2024-09-12T17:29:56.953551+0000","last_became_peered":"2024-09-12T17:29:56.953551+0000","last_unstale":"2024-09-12T18:04:39.638636+0000","last_undegraded":"2024-09-12T18:04:39.638636+0000","last_fullsized":"2024-09-12T18:04:39.638636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:50.189739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'125","reported_seq":684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.668675+0000","last_change":"2024-09-12T17:29:58.953621+0000","last_active":"2024-09-12T18:08:03.668675+0000","last_peered":"2024-09-12T18:08:03.668675+0000","last_clean":"2024-09-12T18:08:03.668675+0000","last_became_active":"2024-09-12T17:29:58.953107+0000","last_became_peered":"2024-09-12T17:29:58.953107+0000","last_unstale":"2024-09-12T18:08:03.668675+0000","last_undegraded":"2024-09-12T18:08:03.668675+0000","last_fullsized":"2024-09-12T18:08:03.668675+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:20.703344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9938,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":239,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.525616+0000","last_change":"2024-09-12T17:30:00.961851+0000","last_active":"2024-09-12T18:04:54.525616+0000","last_peered":"2024-09-12T18:04:54.525616+0000","last_clean":"2024-09-12T18:04:54.525616+0000","last_became_active":"2024-09-12T17:30:00.961545+0000","last_became_peered":"2024-09-12T17:30:00.961545+0000","last_unstale":"2024-09-12T18:04:54.525616+0000","last_undegraded":"2024-09-12T18:04:54.525616+0000","last_fullsized":"2024-09-12T18:04:54.525616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:46.146649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'85","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:28.622892+0000","last_change":"2024-09-12T17:30:02.967776+0000","last_active":"2024-09-12T18:07:28.622892+0000","last_peered":"2024-09-12T18:07:28.622892+0000","last_clean":"2024-09-12T18:07:28.622892+0000","last_became_active":"2024-09-12T17:30:02.967500+0000","last_became_peered":"2024-09-12T17:30:02.967500+0000","last_unstale":"2024-09-12T18:07:28.622892+0000","last_undegraded":"2024-09-12T18:07:28.622892+0000","last_fullsized":"2024-09-12T18:07:28.622892+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:21.856163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":199,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'67","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:28.210721+0000","last_change":"2024-09-12T17:29:54.960258+0000","last_active":"2024-09-12T18:05:28.210721+0000","last_peered":"2024-09-12T18:05:28.210721+0000","last_clean":"2024-09-12T18:05:28.210721+0000","last_became_active":"2024-09-12T17:29:54.959979+0000","last_became_peered":"2024-09-12T17:29:54.959979+0000","last_unstale":"2024-09-12T18:05:28.210721+0000","last_undegraded":"2024-09-12T18:05:28.210721+0000","last_fullsized":"2024-09-12T18:05:28.210721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:30.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":252,"num_write":105,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'337","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.698709+0000","last_change":"2024-09-12T17:29:52.957702+0000","last_active":"2024-09-12T18:08:03.698709+0000","last_peered":"2024-09-12T18:08:03.698709+0000","last_clean":"2024-09-12T18:08:03.698709+0000","last_became_active":"2024-09-12T17:29:52.957308+0000","last_became_peered":"2024-09-12T17:29:52.957308+0000","last_unstale":"2024-09-12T18:08:03.698709+0000","last_undegraded":"2024-09-12T18:08:03.698709+0000","last_fullsized":"2024-09-12T18:08:03.698709+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:52.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":832,"num_read_kb":24052,"num_write":1268,"num_write_kb":42343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'4","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.526363+0000","last_change":"2024-09-12T17:29:56.959495+0000","last_active":"2024-09-12T18:08:03.526363+0000","last_peered":"2024-09-12T18:08:03.526363+0000","last_clean":"2024-09-12T18:08:03.526363+0000","last_became_active":"2024-09-12T17:29:56.959206+0000","last_became_peered":"2024-09-12T17:29:56.959206+0000","last_unstale":"2024-09-12T18:08:03.526363+0000","last_undegraded":"2024-09-12T18:08:03.526363+0000","last_fullsized":"2024-09-12T18:08:03.526363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:54.257647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":1192,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'158","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.851374+0000","last_change":"2024-09-12T17:29:58.956025+0000","last_active":"2024-09-12T18:08:03.851374+0000","last_peered":"2024-09-12T18:08:03.851374+0000","last_clean":"2024-09-12T18:08:03.851374+0000","last_became_active":"2024-09-12T17:29:58.955698+0000","last_became_peered":"2024-09-12T17:29:58.955698+0000","last_unstale":"2024-09-12T18:08:03.851374+0000","last_undegraded":"2024-09-12T18:08:03.851374+0000","last_fullsized":"2024-09-12T18:08:03.851374+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:21.001386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7452,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":263,"num_write":112,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'763","reported_seq":2326,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.561083+0000","last_change":"2024-09-12T17:30:00.967003+0000","last_active":"2024-09-12T18:08:03.561083+0000","last_peered":"2024-09-12T18:08:03.561083+0000","last_clean":"2024-09-12T18:08:03.561083+0000","last_became_active":"2024-09-12T17:30:00.966661+0000","last_became_peered":"2024-09-12T17:30:00.966661+0000","last_unstale":"2024-09-12T18:08:03.561083+0000","last_undegraded":"2024-09-12T18:08:03.561083+0000","last_fullsized":"2024-09-12T18:08:03.561083+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:57.546741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'107","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.730576+0000","last_change":"2024-09-12T17:30:02.970504+0000","last_active":"2024-09-12T18:07:37.730576+0000","last_peered":"2024-09-12T18:07:37.730576+0000","last_clean":"2024-09-12T18:07:37.730576+0000","last_became_active":"2024-09-12T17:30:02.969837+0000","last_became_peered":"2024-09-12T17:30:02.969837+0000","last_unstale":"2024-09-12T18:07:37.730576+0000","last_undegraded":"2024-09-12T18:07:37.730576+0000","last_fullsized":"2024-09-12T18:07:37.730576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:09.306140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":259,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'232","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.631061+0000","last_change":"2024-09-12T17:30:28.004554+0000","last_active":"2024-09-12T18:03:39.631061+0000","last_peered":"2024-09-12T18:03:39.631061+0000","last_clean":"2024-09-12T18:03:39.631061+0000","last_became_active":"2024-09-12T17:30:28.004234+0000","last_became_peered":"2024-09-12T17:30:28.004234+0000","last_unstale":"2024-09-12T18:03:39.631061+0000","last_undegraded":"2024-09-12T18:03:39.631061+0000","last_fullsized":"2024-09-12T18:03:39.631061+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:30.577975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":779,"num_write":354,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'204","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.715254+0000","last_change":"2024-09-12T17:29:52.952108+0000","last_active":"2024-09-12T18:08:03.715254+0000","last_peered":"2024-09-12T18:08:03.715254+0000","last_clean":"2024-09-12T18:08:03.715254+0000","last_became_active":"2024-09-12T17:29:52.951442+0000","last_became_peered":"2024-09-12T17:29:52.951442+0000","last_unstale":"2024-09-12T18:08:03.715254+0000","last_undegraded":"2024-09-12T18:08:03.715254+0000","last_fullsized":"2024-09-12T18:08:03.715254+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:21.862788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6462010,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":476,"num_read_kb":16166,"num_write":931,"num_write_kb":36148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639431+0000","last_change":"2024-09-12T17:29:56.956309+0000","last_active":"2024-09-12T18:04:44.639431+0000","last_peered":"2024-09-12T18:04:44.639431+0000","last_clean":"2024-09-12T18:04:44.639431+0000","last_became_active":"2024-09-12T17:29:56.955948+0000","last_became_peered":"2024-09-12T17:29:56.955948+0000","last_unstale":"2024-09-12T18:04:44.639431+0000","last_undegraded":"2024-09-12T18:04:44.639431+0000","last_fullsized":"2024-09-12T18:04:44.639431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:39.319625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'202","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.877272+0000","last_change":"2024-09-12T17:29:58.958169+0000","last_active":"2024-09-12T18:08:03.877272+0000","last_peered":"2024-09-12T18:08:03.877272+0000","last_clean":"2024-09-12T18:08:03.877272+0000","last_became_active":"2024-09-12T17:29:58.957183+0000","last_became_peered":"2024-09-12T17:29:58.957183+0000","last_unstale":"2024-09-12T18:08:03.877272+0000","last_undegraded":"2024-09-12T18:08:03.877272+0000","last_fullsized":"2024-09-12T18:08:03.877272+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:19.712371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13747,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":267,"num_read_kb":394,"num_write":132,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639403+0000","last_change":"2024-09-12T17:30:00.958337+0000","last_active":"2024-09-12T18:04:44.639403+0000","last_peered":"2024-09-12T18:04:44.639403+0000","last_clean":"2024-09-12T18:04:44.639403+0000","last_became_active":"2024-09-12T17:30:00.958049+0000","last_became_peered":"2024-09-12T17:30:00.958049+0000","last_unstale":"2024-09-12T18:04:44.639403+0000","last_undegraded":"2024-09-12T18:04:44.639403+0000","last_fullsized":"2024-09-12T18:04:44.639403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:24.880580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'146","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.020504+0000","last_change":"2024-09-12T17:30:02.970369+0000","last_active":"2024-09-12T18:05:56.020504+0000","last_peered":"2024-09-12T18:05:56.020504+0000","last_clean":"2024-09-12T18:05:56.020504+0000","last_became_active":"2024-09-12T17:30:02.970095+0000","last_became_peered":"2024-09-12T17:30:02.970095+0000","last_unstale":"2024-09-12T18:05:56.020504+0000","last_undegraded":"2024-09-12T18:05:56.020504+0000","last_fullsized":"2024-09-12T18:05:56.020504+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:20.676163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":173,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'179","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.253509+0000","last_change":"2024-09-12T17:29:54.957178+0000","last_active":"2024-09-12T18:05:56.253509+0000","last_peered":"2024-09-12T18:05:56.253509+0000","last_clean":"2024-09-12T18:05:56.253509+0000","last_became_active":"2024-09-12T17:29:54.956850+0000","last_became_peered":"2024-09-12T17:29:54.956850+0000","last_unstale":"2024-09-12T18:05:56.253509+0000","last_undegraded":"2024-09-12T18:05:56.253509+0000","last_fullsized":"2024-09-12T18:05:56.253509+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:59.322551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":712,"num_read_kb":607,"num_write":242,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'175","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.298256+0000","last_change":"2024-09-12T17:29:52.959240+0000","last_active":"2024-09-12T18:06:19.298256+0000","last_peered":"2024-09-12T18:06:19.298256+0000","last_clean":"2024-09-12T18:06:19.298256+0000","last_became_active":"2024-09-12T17:29:52.958919+0000","last_became_peered":"2024-09-12T17:29:52.958919+0000","last_unstale":"2024-09-12T18:06:19.298256+0000","last_undegraded":"2024-09-12T18:06:19.298256+0000","last_fullsized":"2024-09-12T18:06:19.298256+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:33.354065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7687392,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":325,"num_read_kb":13812,"num_write":937,"num_write_kb":31717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.630825+0000","last_change":"2024-09-12T17:29:56.955564+0000","last_active":"2024-09-12T18:03:44.630825+0000","last_peered":"2024-09-12T18:03:44.630825+0000","last_clean":"2024-09-12T18:03:44.630825+0000","last_became_active":"2024-09-12T17:29:56.955288+0000","last_became_peered":"2024-09-12T17:29:56.955288+0000","last_unstale":"2024-09-12T18:03:44.630825+0000","last_undegraded":"2024-09-12T18:03:44.630825+0000","last_fullsized":"2024-09-12T18:03:44.630825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:03.688076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'140","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.700989+0000","last_change":"2024-09-12T17:29:58.953188+0000","last_active":"2024-09-12T18:08:03.700989+0000","last_peered":"2024-09-12T18:08:03.700989+0000","last_clean":"2024-09-12T18:08:03.700989+0000","last_became_active":"2024-09-12T17:29:58.952878+0000","last_became_peered":"2024-09-12T17:29:58.952878+0000","last_unstale":"2024-09-12T18:08:03.700989+0000","last_undegraded":"2024-09-12T18:08:03.700989+0000","last_fullsized":"2024-09-12T18:08:03.700989+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:06.356317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":250,"num_write":156,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633179+0000","last_change":"2024-09-12T17:30:00.970962+0000","last_active":"2024-09-12T18:03:54.633179+0000","last_peered":"2024-09-12T18:03:54.633179+0000","last_clean":"2024-09-12T18:03:54.633179+0000","last_became_active":"2024-09-12T17:30:00.970668+0000","last_became_peered":"2024-09-12T17:30:00.970668+0000","last_unstale":"2024-09-12T18:03:54.633179+0000","last_undegraded":"2024-09-12T18:03:54.633179+0000","last_fullsized":"2024-09-12T18:03:54.633179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:09.749573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'138","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.302849+0000","last_change":"2024-09-12T17:30:02.964408+0000","last_active":"2024-09-12T18:06:21.302849+0000","last_peered":"2024-09-12T18:06:21.302849+0000","last_clean":"2024-09-12T18:06:21.302849+0000","last_became_active":"2024-09-12T17:30:02.964125+0000","last_became_peered":"2024-09-12T17:30:02.964125+0000","last_unstale":"2024-09-12T18:06:21.302849+0000","last_undegraded":"2024-09-12T18:06:21.302849+0000","last_fullsized":"2024-09-12T18:06:21.302849+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:51.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":200,"num_read_kb":186,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'123","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.807408+0000","last_change":"2024-09-12T17:29:54.958681+0000","last_active":"2024-09-12T18:05:55.807408+0000","last_peered":"2024-09-12T18:05:55.807408+0000","last_clean":"2024-09-12T18:05:55.807408+0000","last_became_active":"2024-09-12T17:29:54.956019+0000","last_became_peered":"2024-09-12T17:29:54.956019+0000","last_unstale":"2024-09-12T18:05:55.807408+0000","last_undegraded":"2024-09-12T18:05:55.807408+0000","last_fullsized":"2024-09-12T18:05:55.807408+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:52.410372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":560,"num_read_kb":466,"num_write":179,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'197","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.736711+0000","last_change":"2024-09-12T17:29:52.951444+0000","last_active":"2024-09-12T18:08:03.736711+0000","last_peered":"2024-09-12T18:08:03.736711+0000","last_clean":"2024-09-12T18:08:03.736711+0000","last_became_active":"2024-09-12T17:29:52.951013+0000","last_became_peered":"2024-09-12T17:29:52.951013+0000","last_unstale":"2024-09-12T18:08:03.736711+0000","last_undegraded":"2024-09-12T18:08:03.736711+0000","last_fullsized":"2024-09-12T18:08:03.736711+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:26.659611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":90183,"num_write":908,"num_write_kb":29071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.632112+0000","last_change":"2024-09-12T17:29:56.959688+0000","last_active":"2024-09-12T18:03:44.632112+0000","last_peered":"2024-09-12T18:03:44.632112+0000","last_clean":"2024-09-12T18:03:44.632112+0000","last_became_active":"2024-09-12T17:29:56.959436+0000","last_became_peered":"2024-09-12T17:29:56.959436+0000","last_unstale":"2024-09-12T18:03:44.632112+0000","last_undegraded":"2024-09-12T18:03:44.632112+0000","last_fullsized":"2024-09-12T18:03:44.632112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:17.810253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'142","reported_seq":715,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.646813+0000","last_change":"2024-09-12T17:29:58.954865+0000","last_active":"2024-09-12T18:08:03.646813+0000","last_peered":"2024-09-12T18:08:03.646813+0000","last_clean":"2024-09-12T18:08:03.646813+0000","last_became_active":"2024-09-12T17:29:58.954548+0000","last_became_peered":"2024-09-12T17:29:58.954548+0000","last_unstale":"2024-09-12T18:08:03.646813+0000","last_undegraded":"2024-09-12T18:08:03.646813+0000","last_fullsized":"2024-09-12T18:08:03.646813+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:57.732564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12489,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'733","reported_seq":2377,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.556826+0000","last_change":"2024-09-12T17:30:00.960694+0000","last_active":"2024-09-12T18:08:03.556826+0000","last_peered":"2024-09-12T18:08:03.556826+0000","last_clean":"2024-09-12T18:08:03.556826+0000","last_became_active":"2024-09-12T17:30:00.960402+0000","last_became_peered":"2024-09-12T17:30:00.960402+0000","last_unstale":"2024-09-12T18:08:03.556826+0000","last_undegraded":"2024-09-12T18:08:03.556826+0000","last_fullsized":"2024-09-12T18:08:03.556826+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:14.850575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'95","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.486123+0000","last_change":"2024-09-12T17:30:02.969918+0000","last_active":"2024-09-12T18:06:20.486123+0000","last_peered":"2024-09-12T18:06:20.486123+0000","last_clean":"2024-09-12T18:06:20.486123+0000","last_became_active":"2024-09-12T17:30:02.969617+0000","last_became_peered":"2024-09-12T17:30:02.969617+0000","last_unstale":"2024-09-12T18:06:20.486123+0000","last_undegraded":"2024-09-12T18:06:20.486123+0000","last_fullsized":"2024-09-12T18:06:20.486123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:08.908464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":242,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'118","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.647063+0000","last_change":"2024-09-12T17:29:54.959321+0000","last_active":"2024-09-12T18:06:06.647063+0000","last_peered":"2024-09-12T18:06:06.647063+0000","last_clean":"2024-09-12T18:06:06.647063+0000","last_became_active":"2024-09-12T17:29:54.958362+0000","last_became_peered":"2024-09-12T17:29:54.958362+0000","last_unstale":"2024-09-12T18:06:06.647063+0000","last_undegraded":"2024-09-12T18:06:06.647063+0000","last_fullsized":"2024-09-12T18:06:06.647063+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:49.275936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":415,"num_write":164,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'162","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.662699+0000","last_change":"2024-09-12T17:30:28.005494+0000","last_active":"2024-09-12T18:07:19.662699+0000","last_peered":"2024-09-12T18:07:19.662699+0000","last_clean":"2024-09-12T18:07:19.662699+0000","last_became_active":"2024-09-12T17:30:28.005099+0000","last_became_peered":"2024-09-12T17:30:28.005099+0000","last_unstale":"2024-09-12T18:07:19.662699+0000","last_undegraded":"2024-09-12T18:07:19.662699+0000","last_fullsized":"2024-09-12T18:07:19.662699+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:40.351778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":6854,"num_write":853,"num_write_kb":33010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1444,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.537366+0000","last_change":"2024-09-12T17:29:56.955646+0000","last_active":"2024-09-12T18:08:03.537366+0000","last_peered":"2024-09-12T18:08:03.537366+0000","last_clean":"2024-09-12T18:08:03.537366+0000","last_became_active":"2024-09-12T17:29:56.955321+0000","last_became_peered":"2024-09-12T17:29:56.955321+0000","last_unstale":"2024-09-12T18:08:03.537366+0000","last_undegraded":"2024-09-12T18:08:03.537366+0000","last_fullsized":"2024-09-12T18:08:03.537366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:06.863842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":954,"num_read_kb":954,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'79","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.538704+0000","last_change":"2024-09-12T17:29:58.978790+0000","last_active":"2024-09-12T18:05:59.538704+0000","last_peered":"2024-09-12T18:05:59.538704+0000","last_clean":"2024-09-12T18:05:59.538704+0000","last_became_active":"2024-09-12T17:29:58.978480+0000","last_became_peered":"2024-09-12T17:29:58.978480+0000","last_unstale":"2024-09-12T18:05:59.538704+0000","last_undegraded":"2024-09-12T18:05:59.538704+0000","last_fullsized":"2024-09-12T18:05:59.538704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:05.359700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'759","reported_seq":4527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.557938+0000","last_change":"2024-09-12T17:30:00.959471+0000","last_active":"2024-09-12T18:08:03.557938+0000","last_peered":"2024-09-12T18:08:03.557938+0000","last_clean":"2024-09-12T18:08:03.557938+0000","last_became_active":"2024-09-12T17:30:00.959015+0000","last_became_peered":"2024-09-12T17:30:00.959015+0000","last_unstale":"2024-09-12T18:08:03.557938+0000","last_undegraded":"2024-09-12T18:08:03.557938+0000","last_fullsized":"2024-09-12T18:08:03.557938+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:29.861180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'126","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.966308+0000","last_change":"2024-09-12T17:30:02.972327+0000","last_active":"2024-09-12T18:06:01.966308+0000","last_peered":"2024-09-12T18:06:01.966308+0000","last_clean":"2024-09-12T18:06:01.966308+0000","last_became_active":"2024-09-12T17:30:02.972020+0000","last_became_peered":"2024-09-12T17:30:02.972020+0000","last_unstale":"2024-09-12T18:06:01.966308+0000","last_undegraded":"2024-09-12T18:06:01.966308+0000","last_fullsized":"2024-09-12T18:06:01.966308+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.485323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":156,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.376221+0000","last_change":"2024-09-12T17:29:54.951231+0000","last_active":"2024-09-12T18:05:29.376221+0000","last_peered":"2024-09-12T18:05:29.376221+0000","last_clean":"2024-09-12T18:05:29.376221+0000","last_became_active":"2024-09-12T17:29:54.950966+0000","last_became_peered":"2024-09-12T17:29:54.950966+0000","last_unstale":"2024-09-12T18:05:29.376221+0000","last_undegraded":"2024-09-12T18:05:29.376221+0000","last_fullsized":"2024-09-12T18:05:29.376221+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:59.344136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":955,"num_read_kb":788,"num_write":339,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'177","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.831333+0000","last_change":"2024-09-12T17:29:52.948919+0000","last_active":"2024-09-12T18:08:03.831333+0000","last_peered":"2024-09-12T18:08:03.831333+0000","last_clean":"2024-09-12T18:08:03.831333+0000","last_became_active":"2024-09-12T17:29:52.948591+0000","last_became_peered":"2024-09-12T17:29:52.948591+0000","last_unstale":"2024-09-12T18:08:03.831333+0000","last_undegraded":"2024-09-12T18:08:03.831333+0000","last_fullsized":"2024-09-12T18:08:03.831333+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:40.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1260936,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":2968,"num_write":842,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:44.504222+0000","last_change":"2024-09-12T17:29:56.953681+0000","last_active":"2024-09-12T18:03:44.504222+0000","last_peered":"2024-09-12T18:03:44.504222+0000","last_clean":"2024-09-12T18:03:44.504222+0000","last_became_active":"2024-09-12T17:29:56.953198+0000","last_became_peered":"2024-09-12T17:29:56.953198+0000","last_unstale":"2024-09-12T18:03:44.504222+0000","last_undegraded":"2024-09-12T18:03:44.504222+0000","last_fullsized":"2024-09-12T18:03:44.504222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:26.233204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'190","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.810763+0000","last_change":"2024-09-12T17:29:58.957118+0000","last_active":"2024-09-12T18:08:03.810763+0000","last_peered":"2024-09-12T18:08:03.810763+0000","last_clean":"2024-09-12T18:08:03.810763+0000","last_became_active":"2024-09-12T17:29:58.956828+0000","last_became_peered":"2024-09-12T17:29:58.956828+0000","last_unstale":"2024-09-12T18:08:03.810763+0000","last_undegraded":"2024-09-12T18:08:03.810763+0000","last_fullsized":"2024-09-12T18:08:03.810763+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:05.359700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10697,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":841,"num_read_kb":909,"num_write":1328,"num_write_kb":1209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.504747+0000","last_change":"2024-09-12T17:30:00.963569+0000","last_active":"2024-09-12T18:03:49.504747+0000","last_peered":"2024-09-12T18:03:49.504747+0000","last_clean":"2024-09-12T18:03:49.504747+0000","last_became_active":"2024-09-12T17:30:00.963117+0000","last_became_peered":"2024-09-12T17:30:00.963117+0000","last_unstale":"2024-09-12T18:03:49.504747+0000","last_undegraded":"2024-09-12T18:03:49.504747+0000","last_fullsized":"2024-09-12T18:03:49.504747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:47.856522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'115","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.931424+0000","last_change":"2024-09-12T17:30:02.963673+0000","last_active":"2024-09-12T18:06:00.931424+0000","last_peered":"2024-09-12T18:06:00.931424+0000","last_clean":"2024-09-12T18:06:00.931424+0000","last_became_active":"2024-09-12T17:30:02.963368+0000","last_became_peered":"2024-09-12T17:30:02.963368+0000","last_unstale":"2024-09-12T18:06:00.931424+0000","last_undegraded":"2024-09-12T18:06:00.931424+0000","last_fullsized":"2024-09-12T18:06:00.931424+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:30.008139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":267,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'271","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:51.069613+0000","last_change":"2024-09-12T17:29:54.960752+0000","last_active":"2024-09-12T18:05:51.069613+0000","last_peered":"2024-09-12T18:05:51.069613+0000","last_clean":"2024-09-12T18:05:51.069613+0000","last_became_active":"2024-09-12T17:29:54.960486+0000","last_became_peered":"2024-09-12T17:29:54.960486+0000","last_unstale":"2024-09-12T18:05:51.069613+0000","last_undegraded":"2024-09-12T18:05:51.069613+0000","last_fullsized":"2024-09-12T18:05:51.069613+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:09.952438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1268,"num_write":469,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:44.688092+0000","last_change":"2024-09-12T17:29:36.164552+0000","last_active":"2024-09-12T18:05:44.688092+0000","last_peered":"2024-09-12T18:05:44.688092+0000","last_clean":"2024-09-12T18:05:44.688092+0000","last_became_active":"2024-09-12T17:29:36.163604+0000","last_became_peered":"2024-09-12T17:29:36.163604+0000","last_unstale":"2024-09-12T18:05:44.688092+0000","last_undegraded":"2024-09-12T18:05:44.688092+0000","last_fullsized":"2024-09-12T18:05:44.688092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.896766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.896766+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.896766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:35.293197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.640572+0000","last_change":"2024-09-12T17:29:43.975243+0000","last_active":"2024-09-12T18:05:09.640572+0000","last_peered":"2024-09-12T18:05:09.640572+0000","last_clean":"2024-09-12T18:05:09.640572+0000","last_became_active":"2024-09-12T17:29:41.963643+0000","last_became_peered":"2024-09-12T17:29:41.963643+0000","last_unstale":"2024-09-12T18:05:09.640572+0000","last_undegraded":"2024-09-12T18:05:09.640572+0000","last_fullsized":"2024-09-12T18:05:09.640572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:57.226626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056994999999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'207","reported_seq":834,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.865091+0000","last_change":"2024-09-12T17:29:52.955756+0000","last_active":"2024-09-12T18:08:03.865091+0000","last_peered":"2024-09-12T18:08:03.865091+0000","last_clean":"2024-09-12T18:08:03.865091+0000","last_became_active":"2024-09-12T17:29:52.954839+0000","last_became_peered":"2024-09-12T17:29:52.954839+0000","last_unstale":"2024-09-12T18:08:03.865091+0000","last_undegraded":"2024-09-12T18:08:03.865091+0000","last_fullsized":"2024-09-12T18:08:03.865091+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:54.464363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395904,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":449,"num_read_kb":3374,"num_write":1041,"num_write_kb":36567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.685110+0000","last_change":"2024-09-12T17:29:56.955566+0000","last_active":"2024-09-12T18:05:24.685110+0000","last_peered":"2024-09-12T18:05:24.685110+0000","last_clean":"2024-09-12T18:05:24.685110+0000","last_became_active":"2024-09-12T17:29:56.955260+0000","last_became_peered":"2024-09-12T17:29:56.955260+0000","last_unstale":"2024-09-12T18:05:24.685110+0000","last_undegraded":"2024-09-12T18:05:24.685110+0000","last_fullsized":"2024-09-12T18:05:24.685110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:09.539939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'299","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.826304+0000","last_change":"2024-09-12T17:29:58.954504+0000","last_active":"2024-09-12T18:08:03.826304+0000","last_peered":"2024-09-12T18:08:03.826304+0000","last_clean":"2024-09-12T18:08:03.826304+0000","last_became_active":"2024-09-12T17:29:58.954205+0000","last_became_peered":"2024-09-12T17:29:58.954205+0000","last_unstale":"2024-09-12T18:08:03.826304+0000","last_undegraded":"2024-09-12T18:08:03.826304+0000","last_fullsized":"2024-09-12T18:08:03.826304+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:15.729749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17428,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":763,"num_write":498,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640713+0000","last_change":"2024-09-12T17:30:00.964518+0000","last_active":"2024-09-12T18:04:44.640713+0000","last_peered":"2024-09-12T18:04:44.640713+0000","last_clean":"2024-09-12T18:04:44.640713+0000","last_became_active":"2024-09-12T17:30:00.964241+0000","last_became_peered":"2024-09-12T17:30:00.964241+0000","last_unstale":"2024-09-12T18:04:44.640713+0000","last_undegraded":"2024-09-12T18:04:44.640713+0000","last_fullsized":"2024-09-12T18:04:44.640713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:14.242835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'221","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.251802+0000","last_change":"2024-09-12T17:30:02.964194+0000","last_active":"2024-09-12T18:06:21.251802+0000","last_peered":"2024-09-12T18:06:21.251802+0000","last_clean":"2024-09-12T18:06:21.251802+0000","last_became_active":"2024-09-12T17:30:02.963890+0000","last_became_peered":"2024-09-12T17:30:02.963890+0000","last_unstale":"2024-09-12T18:06:21.251802+0000","last_undegraded":"2024-09-12T18:06:21.251802+0000","last_fullsized":"2024-09-12T18:06:21.251802+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.997124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":552,"num_write":485,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'384","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.127003+0000","last_change":"2024-09-12T17:29:54.946209+0000","last_active":"2024-09-12T18:06:19.127003+0000","last_peered":"2024-09-12T18:06:19.127003+0000","last_clean":"2024-09-12T18:06:19.127003+0000","last_became_active":"2024-09-12T17:29:54.944624+0000","last_became_peered":"2024-09-12T17:29:54.944624+0000","last_unstale":"2024-09-12T18:06:19.127003+0000","last_undegraded":"2024-09-12T18:06:19.127003+0000","last_fullsized":"2024-09-12T18:06:19.127003+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:39.689437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1668,"num_read_kb":1443,"num_write":651,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:49.688854+0000","last_change":"2024-09-12T17:29:43.985359+0000","last_active":"2024-09-12T18:05:49.688854+0000","last_peered":"2024-09-12T18:05:49.688854+0000","last_clean":"2024-09-12T18:05:49.688854+0000","last_became_active":"2024-09-12T17:29:41.963499+0000","last_became_peered":"2024-09-12T17:29:41.963499+0000","last_unstale":"2024-09-12T18:05:49.688854+0000","last_undegraded":"2024-09-12T18:05:49.688854+0000","last_fullsized":"2024-09-12T18:05:49.688854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:34.267982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470655,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'149","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.634186+0000","last_change":"2024-09-12T17:29:52.949670+0000","last_active":"2024-09-12T18:08:03.634186+0000","last_peered":"2024-09-12T18:08:03.634186+0000","last_clean":"2024-09-12T18:08:03.634186+0000","last_became_active":"2024-09-12T17:29:52.949339+0000","last_became_peered":"2024-09-12T17:29:52.949339+0000","last_unstale":"2024-09-12T18:08:03.634186+0000","last_undegraded":"2024-09-12T18:08:03.634186+0000","last_fullsized":"2024-09-12T18:08:03.634186+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:19.928095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":3075,"num_write":751,"num_write_kb":23555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.635977+0000","last_change":"2024-09-12T17:29:56.954436+0000","last_active":"2024-09-12T18:04:39.635977+0000","last_peered":"2024-09-12T18:04:39.635977+0000","last_clean":"2024-09-12T18:04:39.635977+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:04:39.635977+0000","last_undegraded":"2024-09-12T18:04:39.635977+0000","last_fullsized":"2024-09-12T18:04:39.635977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:38.720237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'787","reported_seq":2174,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.822093+0000","last_change":"2024-09-12T17:29:58.958558+0000","last_active":"2024-09-12T18:08:03.822093+0000","last_peered":"2024-09-12T18:08:03.822093+0000","last_clean":"2024-09-12T18:08:03.822093+0000","last_became_active":"2024-09-12T17:29:58.958269+0000","last_became_peered":"2024-09-12T17:29:58.958269+0000","last_unstale":"2024-09-12T18:08:03.822093+0000","last_undegraded":"2024-09-12T18:08:03.822093+0000","last_fullsized":"2024-09-12T18:08:03.822093+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:14.582465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37829,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1137,"num_read_kb":1322,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:34.686581+0000","last_change":"2024-09-12T17:30:00.958433+0000","last_active":"2024-09-12T18:05:34.686581+0000","last_peered":"2024-09-12T18:05:34.686581+0000","last_clean":"2024-09-12T18:05:34.686581+0000","last_became_active":"2024-09-12T17:30:00.957628+0000","last_became_peered":"2024-09-12T17:30:00.957628+0000","last_unstale":"2024-09-12T18:05:34.686581+0000","last_undegraded":"2024-09-12T18:05:34.686581+0000","last_fullsized":"2024-09-12T18:05:34.686581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.962381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'136","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.227859+0000","last_change":"2024-09-12T17:30:02.960607+0000","last_active":"2024-09-12T18:05:52.227859+0000","last_peered":"2024-09-12T18:05:52.227859+0000","last_clean":"2024-09-12T18:05:52.227859+0000","last_became_active":"2024-09-12T17:30:02.960109+0000","last_became_peered":"2024-09-12T17:30:02.960109+0000","last_unstale":"2024-09-12T18:05:52.227859+0000","last_undegraded":"2024-09-12T18:05:52.227859+0000","last_fullsized":"2024-09-12T18:05:52.227859+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:27.244929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":318,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'88","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.991113+0000","last_change":"2024-09-12T17:29:54.958561+0000","last_active":"2024-09-12T18:06:07.991113+0000","last_peered":"2024-09-12T18:06:07.991113+0000","last_clean":"2024-09-12T18:06:07.991113+0000","last_became_active":"2024-09-12T17:29:54.958310+0000","last_became_peered":"2024-09-12T17:29:54.958310+0000","last_unstale":"2024-09-12T18:06:07.991113+0000","last_undegraded":"2024-09-12T18:06:07.991113+0000","last_fullsized":"2024-09-12T18:06:07.991113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:54.864495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":367,"num_read_kb":311,"num_write":135,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.642763+0000","last_change":"2024-09-12T17:29:44.204001+0000","last_active":"2024-09-12T18:05:09.642763+0000","last_peered":"2024-09-12T18:05:09.642763+0000","last_clean":"2024-09-12T18:05:09.642763+0000","last_became_active":"2024-09-12T17:29:42.064972+0000","last_became_peered":"2024-09-12T17:29:42.064972+0000","last_unstale":"2024-09-12T18:05:09.642763+0000","last_undegraded":"2024-09-12T18:05:09.642763+0000","last_fullsized":"2024-09-12T18:05:09.642763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:39.574136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047741400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'211","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.857350+0000","last_change":"2024-09-12T17:29:52.949699+0000","last_active":"2024-09-12T18:08:03.857350+0000","last_peered":"2024-09-12T18:08:03.857350+0000","last_clean":"2024-09-12T18:08:03.857350+0000","last_became_active":"2024-09-12T17:29:52.949301+0000","last_became_peered":"2024-09-12T17:29:52.949301+0000","last_unstale":"2024-09-12T18:08:03.857350+0000","last_undegraded":"2024-09-12T18:08:03.857350+0000","last_fullsized":"2024-09-12T18:08:03.857350+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:56.930560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":2667,"num_write":1034,"num_write_kb":7887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.638711+0000","last_change":"2024-09-12T17:29:56.956881+0000","last_active":"2024-09-12T18:04:39.638711+0000","last_peered":"2024-09-12T18:04:39.638711+0000","last_clean":"2024-09-12T18:04:39.638711+0000","last_became_active":"2024-09-12T17:29:56.956623+0000","last_became_peered":"2024-09-12T17:29:56.956623+0000","last_unstale":"2024-09-12T18:04:39.638711+0000","last_undegraded":"2024-09-12T18:04:39.638711+0000","last_fullsized":"2024-09-12T18:04:39.638711+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:54.110865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'210","reported_seq":1203,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:35.761738+0000","last_change":"2024-09-12T17:29:58.980974+0000","last_active":"2024-09-12T18:07:35.761738+0000","last_peered":"2024-09-12T18:07:35.761738+0000","last_clean":"2024-09-12T18:07:35.761738+0000","last_became_active":"2024-09-12T17:29:58.980697+0000","last_became_peered":"2024-09-12T17:29:58.980697+0000","last_unstale":"2024-09-12T18:07:35.761738+0000","last_undegraded":"2024-09-12T18:07:35.761738+0000","last_fullsized":"2024-09-12T18:07:35.761738+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:02.768234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":123,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648081+0000","last_change":"2024-09-12T17:30:00.968730+0000","last_active":"2024-09-12T18:05:29.648081+0000","last_peered":"2024-09-12T18:05:29.648081+0000","last_clean":"2024-09-12T18:05:29.648081+0000","last_became_active":"2024-09-12T17:30:00.968468+0000","last_became_peered":"2024-09-12T17:30:00.968468+0000","last_unstale":"2024-09-12T18:05:29.648081+0000","last_undegraded":"2024-09-12T18:05:29.648081+0000","last_fullsized":"2024-09-12T18:05:29.648081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:49.912468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'248","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.956406+0000","last_change":"2024-09-12T17:30:02.967215+0000","last_active":"2024-09-12T18:06:20.956406+0000","last_peered":"2024-09-12T18:06:20.956406+0000","last_clean":"2024-09-12T18:06:20.956406+0000","last_became_active":"2024-09-12T17:30:02.966910+0000","last_became_peered":"2024-09-12T17:30:02.966910+0000","last_unstale":"2024-09-12T18:06:20.956406+0000","last_undegraded":"2024-09-12T18:06:20.956406+0000","last_fullsized":"2024-09-12T18:06:20.956406+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:30.148974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":529,"num_write":537,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'112","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.763591+0000","last_change":"2024-09-12T17:29:54.948794+0000","last_active":"2024-09-12T18:07:37.763591+0000","last_peered":"2024-09-12T18:07:37.763591+0000","last_clean":"2024-09-12T18:07:37.763591+0000","last_became_active":"2024-09-12T17:29:54.948402+0000","last_became_peered":"2024-09-12T17:29:54.948402+0000","last_unstale":"2024-09-12T18:07:37.763591+0000","last_undegraded":"2024-09-12T18:07:37.763591+0000","last_fullsized":"2024-09-12T18:07:37.763591+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:23.995374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":452,"num_write":172,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.640533+0000","last_change":"2024-09-12T17:29:43.975620+0000","last_active":"2024-09-12T18:05:09.640533+0000","last_peered":"2024-09-12T18:05:09.640533+0000","last_clean":"2024-09-12T18:05:09.640533+0000","last_became_active":"2024-09-12T17:29:41.961122+0000","last_became_peered":"2024-09-12T17:29:41.961122+0000","last_unstale":"2024-09-12T18:05:09.640533+0000","last_undegraded":"2024-09-12T18:05:09.640533+0000","last_fullsized":"2024-09-12T18:05:09.640533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.143106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095277999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'244","reported_seq":906,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.760723+0000","last_change":"2024-09-12T17:29:52.958960+0000","last_active":"2024-09-12T18:08:03.760723+0000","last_peered":"2024-09-12T18:08:03.760723+0000","last_clean":"2024-09-12T18:08:03.760723+0000","last_became_active":"2024-09-12T17:29:52.958406+0000","last_became_peered":"2024-09-12T17:29:52.958406+0000","last_unstale":"2024-09-12T18:08:03.760723+0000","last_undegraded":"2024-09-12T18:08:03.760723+0000","last_fullsized":"2024-09-12T18:08:03.760723+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:53.477079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":569,"num_read_kb":48737,"num_write":1100,"num_write_kb":63490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648110+0000","last_change":"2024-09-12T17:29:56.954279+0000","last_active":"2024-09-12T18:05:29.648110+0000","last_peered":"2024-09-12T18:05:29.648110+0000","last_clean":"2024-09-12T18:05:29.648110+0000","last_became_active":"2024-09-12T17:29:56.954018+0000","last_became_peered":"2024-09-12T17:29:56.954018+0000","last_unstale":"2024-09-12T18:05:29.648110+0000","last_undegraded":"2024-09-12T18:05:29.648110+0000","last_fullsized":"2024-09-12T18:05:29.648110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.921260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'111","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:35.852981+0000","last_change":"2024-09-12T17:29:58.954279+0000","last_active":"2024-09-12T18:07:35.852981+0000","last_peered":"2024-09-12T18:07:35.852981+0000","last_clean":"2024-09-12T18:07:35.852981+0000","last_became_active":"2024-09-12T17:29:58.953909+0000","last_became_peered":"2024-09-12T17:29:58.953909+0000","last_unstale":"2024-09-12T18:07:35.852981+0000","last_undegraded":"2024-09-12T18:07:35.852981+0000","last_fullsized":"2024-09-12T18:07:35.852981+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:29.055630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":90,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.512851+0000","last_change":"2024-09-12T17:30:00.967582+0000","last_active":"2024-09-12T18:04:44.512851+0000","last_peered":"2024-09-12T18:04:44.512851+0000","last_clean":"2024-09-12T18:04:44.512851+0000","last_became_active":"2024-09-12T17:30:00.967279+0000","last_became_peered":"2024-09-12T17:30:00.967279+0000","last_unstale":"2024-09-12T18:04:44.512851+0000","last_undegraded":"2024-09-12T18:04:44.512851+0000","last_fullsized":"2024-09-12T18:04:44.512851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:05.249822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'207","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.809120+0000","last_change":"2024-09-12T17:30:02.969741+0000","last_active":"2024-09-12T18:05:55.809120+0000","last_peered":"2024-09-12T18:05:55.809120+0000","last_clean":"2024-09-12T18:05:55.809120+0000","last_became_active":"2024-09-12T17:30:02.969486+0000","last_became_peered":"2024-09-12T17:30:02.969486+0000","last_unstale":"2024-09-12T18:05:55.809120+0000","last_undegraded":"2024-09-12T18:05:55.809120+0000","last_fullsized":"2024-09-12T18:05:55.809120+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:39.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":397,"num_write":473,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'156","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.910434+0000","last_change":"2024-09-12T17:29:54.963961+0000","last_active":"2024-09-12T18:06:06.910434+0000","last_peered":"2024-09-12T18:06:06.910434+0000","last_clean":"2024-09-12T18:06:06.910434+0000","last_became_active":"2024-09-12T17:29:54.963669+0000","last_became_peered":"2024-09-12T17:29:54.963669+0000","last_unstale":"2024-09-12T18:06:06.910434+0000","last_undegraded":"2024-09-12T18:06:06.910434+0000","last_fullsized":"2024-09-12T18:06:06.910434+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:24.840068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":549,"num_write":259,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'205","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.776508+0000","last_change":"2024-09-12T17:29:52.954700+0000","last_active":"2024-09-12T18:08:03.776508+0000","last_peered":"2024-09-12T18:08:03.776508+0000","last_clean":"2024-09-12T18:08:03.776508+0000","last_became_active":"2024-09-12T17:29:52.954220+0000","last_became_peered":"2024-09-12T17:29:52.954220+0000","last_unstale":"2024-09-12T18:08:03.776508+0000","last_undegraded":"2024-09-12T18:08:03.776508+0000","last_fullsized":"2024-09-12T18:08:03.776508+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:30.880138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":525,"num_read_kb":74998,"num_write":1066,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.645181+0000","last_change":"2024-09-12T17:29:43.966855+0000","last_active":"2024-09-12T18:05:09.645181+0000","last_peered":"2024-09-12T18:05:09.645181+0000","last_clean":"2024-09-12T18:05:09.645181+0000","last_became_active":"2024-09-12T17:29:42.064741+0000","last_became_peered":"2024-09-12T17:29:42.064741+0000","last_unstale":"2024-09-12T18:05:09.645181+0000","last_undegraded":"2024-09-12T18:05:09.645181+0000","last_fullsized":"2024-09-12T18:05:09.645181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:56.698152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043924099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647471+0000","last_change":"2024-09-12T17:29:56.955865+0000","last_active":"2024-09-12T18:05:24.647471+0000","last_peered":"2024-09-12T18:05:24.647471+0000","last_clean":"2024-09-12T18:05:24.647471+0000","last_became_active":"2024-09-12T17:29:56.955562+0000","last_became_peered":"2024-09-12T17:29:56.955562+0000","last_unstale":"2024-09-12T18:05:24.647471+0000","last_undegraded":"2024-09-12T18:05:24.647471+0000","last_fullsized":"2024-09-12T18:05:24.647471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:02.094255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'264","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.765803+0000","last_change":"2024-09-12T17:29:58.960788+0000","last_active":"2024-09-12T18:08:03.765803+0000","last_peered":"2024-09-12T18:08:03.765803+0000","last_clean":"2024-09-12T18:08:03.765803+0000","last_became_active":"2024-09-12T17:29:58.960410+0000","last_became_peered":"2024-09-12T17:29:58.960410+0000","last_unstale":"2024-09-12T18:08:03.765803+0000","last_undegraded":"2024-09-12T18:08:03.765803+0000","last_fullsized":"2024-09-12T18:08:03.765803+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:42.521026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14017,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":378,"num_read_kb":510,"num_write":242,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519052+0000","last_change":"2024-09-12T17:30:00.963954+0000","last_active":"2024-09-12T18:05:29.519052+0000","last_peered":"2024-09-12T18:05:29.519052+0000","last_clean":"2024-09-12T18:05:29.519052+0000","last_became_active":"2024-09-12T17:30:00.963660+0000","last_became_peered":"2024-09-12T17:30:00.963660+0000","last_unstale":"2024-09-12T18:05:29.519052+0000","last_undegraded":"2024-09-12T18:05:29.519052+0000","last_fullsized":"2024-09-12T18:05:29.519052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:07.402246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'169","reported_seq":678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.937429+0000","last_change":"2024-09-12T17:30:02.972165+0000","last_active":"2024-09-12T18:06:00.937429+0000","last_peered":"2024-09-12T18:06:00.937429+0000","last_clean":"2024-09-12T18:06:00.937429+0000","last_became_active":"2024-09-12T17:30:02.971807+0000","last_became_peered":"2024-09-12T17:30:02.971807+0000","last_unstale":"2024-09-12T18:06:00.937429+0000","last_undegraded":"2024-09-12T18:06:00.937429+0000","last_fullsized":"2024-09-12T18:06:00.937429+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:12.197480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":246,"num_write":442,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'190","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.624295+0000","last_change":"2024-09-12T17:29:54.959312+0000","last_active":"2024-09-12T18:05:26.624295+0000","last_peered":"2024-09-12T18:05:26.624295+0000","last_clean":"2024-09-12T18:05:26.624295+0000","last_became_active":"2024-09-12T17:29:54.958998+0000","last_became_peered":"2024-09-12T17:29:54.958998+0000","last_unstale":"2024-09-12T18:05:26.624295+0000","last_undegraded":"2024-09-12T18:05:26.624295+0000","last_fullsized":"2024-09-12T18:05:26.624295+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:32.259773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":764,"num_write":273,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'224","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.862794+0000","last_change":"2024-09-12T17:29:52.955784+0000","last_active":"2024-09-12T18:08:03.862794+0000","last_peered":"2024-09-12T18:08:03.862794+0000","last_clean":"2024-09-12T18:08:03.862794+0000","last_became_active":"2024-09-12T17:29:52.955429+0000","last_became_peered":"2024-09-12T17:29:52.955429+0000","last_unstale":"2024-09-12T18:08:03.862794+0000","last_undegraded":"2024-09-12T18:08:03.862794+0000","last_fullsized":"2024-09-12T18:08:03.862794+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:09.456649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170313,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":39247,"num_write":990,"num_write_kb":44156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:14.683770+0000","last_change":"2024-09-12T17:29:43.985392+0000","last_active":"2024-09-12T18:05:14.683770+0000","last_peered":"2024-09-12T18:05:14.683770+0000","last_clean":"2024-09-12T18:05:14.683770+0000","last_became_active":"2024-09-12T17:29:42.064736+0000","last_became_peered":"2024-09-12T17:29:42.064736+0000","last_unstale":"2024-09-12T18:05:14.683770+0000","last_undegraded":"2024-09-12T18:05:14.683770+0000","last_fullsized":"2024-09-12T18:05:14.683770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:58.936927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045118300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518499+0000","last_change":"2024-09-12T17:29:56.957783+0000","last_active":"2024-09-12T18:05:24.518499+0000","last_peered":"2024-09-12T18:05:24.518499+0000","last_clean":"2024-09-12T18:05:24.518499+0000","last_became_active":"2024-09-12T17:29:56.957503+0000","last_became_peered":"2024-09-12T17:29:56.957503+0000","last_unstale":"2024-09-12T18:05:24.518499+0000","last_undegraded":"2024-09-12T18:05:24.518499+0000","last_fullsized":"2024-09-12T18:05:24.518499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:58.375801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'150","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.753445+0000","last_change":"2024-09-12T17:29:58.978826+0000","last_active":"2024-09-12T18:05:53.753445+0000","last_peered":"2024-09-12T18:05:53.753445+0000","last_clean":"2024-09-12T18:05:53.753445+0000","last_became_active":"2024-09-12T17:29:58.978487+0000","last_became_peered":"2024-09-12T17:29:58.978487+0000","last_unstale":"2024-09-12T18:05:53.753445+0000","last_undegraded":"2024-09-12T18:05:53.753445+0000","last_fullsized":"2024-09-12T18:05:53.753445+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:07.080227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":172,"num_read_kb":165,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'771","reported_seq":2443,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.554567+0000","last_change":"2024-09-12T17:30:00.957003+0000","last_active":"2024-09-12T18:08:03.554567+0000","last_peered":"2024-09-12T18:08:03.554567+0000","last_clean":"2024-09-12T18:08:03.554567+0000","last_became_active":"2024-09-12T17:30:00.956655+0000","last_became_peered":"2024-09-12T17:30:00.956655+0000","last_unstale":"2024-09-12T18:08:03.554567+0000","last_undegraded":"2024-09-12T18:08:03.554567+0000","last_fullsized":"2024-09-12T18:08:03.554567+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:00.807981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'117","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:18.421406+0000","last_change":"2024-09-12T17:30:02.969523+0000","last_active":"2024-09-12T18:06:18.421406+0000","last_peered":"2024-09-12T18:06:18.421406+0000","last_clean":"2024-09-12T18:06:18.421406+0000","last_became_active":"2024-09-12T17:30:02.968978+0000","last_became_peered":"2024-09-12T17:30:02.968978+0000","last_unstale":"2024-09-12T18:06:18.421406+0000","last_undegraded":"2024-09-12T18:06:18.421406+0000","last_fullsized":"2024-09-12T18:06:18.421406+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:20.219209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1365,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":174,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'406","reported_seq":1077,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.539355+0000","last_change":"2024-09-12T17:29:54.955693+0000","last_active":"2024-09-12T18:06:04.539355+0000","last_peered":"2024-09-12T18:06:04.539355+0000","last_clean":"2024-09-12T18:06:04.539355+0000","last_became_active":"2024-09-12T17:29:54.955170+0000","last_became_peered":"2024-09-12T17:29:54.955170+0000","last_unstale":"2024-09-12T18:06:04.539355+0000","last_undegraded":"2024-09-12T18:06:04.539355+0000","last_fullsized":"2024-09-12T18:06:04.539355+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:25.653731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1829,"num_read_kb":1585,"num_write":674,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'168","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.831248+0000","last_change":"2024-09-12T17:30:28.005223+0000","last_active":"2024-09-12T18:08:03.831248+0000","last_peered":"2024-09-12T18:08:03.831248+0000","last_clean":"2024-09-12T18:08:03.831248+0000","last_became_active":"2024-09-12T17:30:28.004804+0000","last_became_peered":"2024-09-12T17:30:28.004804+0000","last_unstale":"2024-09-12T18:08:03.831248+0000","last_undegraded":"2024-09-12T18:08:03.831248+0000","last_fullsized":"2024-09-12T18:08:03.831248+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:07.880016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262290,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":342,"num_read_kb":56981,"num_write":802,"num_write_kb":25989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637817+0000","last_change":"2024-09-12T17:29:43.966900+0000","last_active":"2024-09-12T18:04:24.637817+0000","last_peered":"2024-09-12T18:04:24.637817+0000","last_clean":"2024-09-12T18:04:24.637817+0000","last_became_active":"2024-09-12T17:29:41.961194+0000","last_became_peered":"2024-09-12T17:29:41.961194+0000","last_unstale":"2024-09-12T18:04:24.637817+0000","last_undegraded":"2024-09-12T18:04:24.637817+0000","last_fullsized":"2024-09-12T18:04:24.637817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:52.853132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049442699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518488+0000","last_change":"2024-09-12T17:29:56.956156+0000","last_active":"2024-09-12T18:05:24.518488+0000","last_peered":"2024-09-12T18:05:24.518488+0000","last_clean":"2024-09-12T18:05:24.518488+0000","last_became_active":"2024-09-12T17:29:56.955865+0000","last_became_peered":"2024-09-12T17:29:56.955865+0000","last_unstale":"2024-09-12T18:05:24.518488+0000","last_undegraded":"2024-09-12T18:05:24.518488+0000","last_fullsized":"2024-09-12T18:05:24.518488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:29.721519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'96","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.072656+0000","last_change":"2024-09-12T17:29:58.954437+0000","last_active":"2024-09-12T18:05:52.072656+0000","last_peered":"2024-09-12T18:05:52.072656+0000","last_clean":"2024-09-12T18:05:52.072656+0000","last_became_active":"2024-09-12T17:29:58.953924+0000","last_became_peered":"2024-09-12T17:29:58.953924+0000","last_unstale":"2024-09-12T18:05:52.072656+0000","last_undegraded":"2024-09-12T18:05:52.072656+0000","last_fullsized":"2024-09-12T18:05:52.072656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:40.076452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":108,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'780","reported_seq":2093,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.783294+0000","last_change":"2024-09-12T17:30:00.967465+0000","last_active":"2024-09-12T18:08:03.783294+0000","last_peered":"2024-09-12T18:08:03.783294+0000","last_clean":"2024-09-12T18:08:03.783294+0000","last_became_active":"2024-09-12T17:30:00.967168+0000","last_became_peered":"2024-09-12T17:30:00.967168+0000","last_unstale":"2024-09-12T18:08:03.783294+0000","last_undegraded":"2024-09-12T18:08:03.783294+0000","last_fullsized":"2024-09-12T18:08:03.783294+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:34.280045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'300","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.843665+0000","last_change":"2024-09-12T17:30:02.969830+0000","last_active":"2024-09-12T18:06:01.843665+0000","last_peered":"2024-09-12T18:06:01.843665+0000","last_clean":"2024-09-12T18:06:01.843665+0000","last_became_active":"2024-09-12T17:30:02.969526+0000","last_became_peered":"2024-09-12T17:30:02.969526+0000","last_unstale":"2024-09-12T18:06:01.843665+0000","last_undegraded":"2024-09-12T18:06:01.843665+0000","last_fullsized":"2024-09-12T18:06:01.843665+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:15.996494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":439,"num_write":657,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'44","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:23.880167+0000","last_change":"2024-09-12T17:29:54.958269+0000","last_active":"2024-09-12T18:05:23.880167+0000","last_peered":"2024-09-12T18:05:23.880167+0000","last_clean":"2024-09-12T18:05:23.880167+0000","last_became_active":"2024-09-12T17:29:54.957906+0000","last_became_peered":"2024-09-12T17:29:54.957906+0000","last_unstale":"2024-09-12T18:05:23.880167+0000","last_undegraded":"2024-09-12T18:05:23.880167+0000","last_fullsized":"2024-09-12T18:05:23.880167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:40.016834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":180,"num_write":59,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'212","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.732992+0000","last_change":"2024-09-12T17:30:28.007323+0000","last_active":"2024-09-12T18:08:03.732992+0000","last_peered":"2024-09-12T18:08:03.732992+0000","last_clean":"2024-09-12T18:08:03.732992+0000","last_became_active":"2024-09-12T17:30:28.006884+0000","last_became_peered":"2024-09-12T17:30:28.006884+0000","last_unstale":"2024-09-12T18:08:03.732992+0000","last_undegraded":"2024-09-12T18:08:03.732992+0000","last_fullsized":"2024-09-12T18:08:03.732992+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:19.123396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":14673,"num_write":991,"num_write_kb":46674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.509953+0000","last_change":"2024-09-12T17:29:43.986874+0000","last_active":"2024-09-12T18:04:24.509953+0000","last_peered":"2024-09-12T18:04:24.509953+0000","last_clean":"2024-09-12T18:04:24.509953+0000","last_became_active":"2024-09-12T17:29:41.961477+0000","last_became_peered":"2024-09-12T17:29:41.961477+0000","last_unstale":"2024-09-12T18:04:24.509953+0000","last_undegraded":"2024-09-12T18:04:24.509953+0000","last_fullsized":"2024-09-12T18:04:24.509953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:40.946896+0000","last_clean_scrub_stamp":"2024-09-12T17:29:40.946896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:09.932105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041855800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.518421+0000","last_change":"2024-09-12T17:29:56.954444+0000","last_active":"2024-09-12T18:04:09.518421+0000","last_peered":"2024-09-12T18:04:09.518421+0000","last_clean":"2024-09-12T18:04:09.518421+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:04:09.518421+0000","last_undegraded":"2024-09-12T18:04:09.518421+0000","last_fullsized":"2024-09-12T18:04:09.518421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:02.231915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'315","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.797884+0000","last_change":"2024-09-12T17:29:58.978547+0000","last_active":"2024-09-12T18:08:03.797884+0000","last_peered":"2024-09-12T18:08:03.797884+0000","last_clean":"2024-09-12T18:08:03.797884+0000","last_became_active":"2024-09-12T17:29:58.978222+0000","last_became_peered":"2024-09-12T17:29:58.978222+0000","last_unstale":"2024-09-12T18:08:03.797884+0000","last_undegraded":"2024-09-12T18:08:03.797884+0000","last_fullsized":"2024-09-12T18:08:03.797884+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.293800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25498,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":718,"num_write":254,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.534853+0000","last_change":"2024-09-12T17:30:00.968813+0000","last_active":"2024-09-12T18:05:29.534853+0000","last_peered":"2024-09-12T18:05:29.534853+0000","last_clean":"2024-09-12T18:05:29.534853+0000","last_became_active":"2024-09-12T17:30:00.968527+0000","last_became_peered":"2024-09-12T17:30:00.968527+0000","last_unstale":"2024-09-12T18:05:29.534853+0000","last_undegraded":"2024-09-12T18:05:29.534853+0000","last_fullsized":"2024-09-12T18:05:29.534853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:25.372195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'123","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.301030+0000","last_change":"2024-09-12T17:30:02.966314+0000","last_active":"2024-09-12T18:06:21.301030+0000","last_peered":"2024-09-12T18:06:21.301030+0000","last_clean":"2024-09-12T18:06:21.301030+0000","last_became_active":"2024-09-12T17:30:02.966018+0000","last_became_peered":"2024-09-12T17:30:02.966018+0000","last_unstale":"2024-09-12T18:06:21.301030+0000","last_undegraded":"2024-09-12T18:06:21.301030+0000","last_fullsized":"2024-09-12T18:06:21.301030+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:36.046680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":226,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'154","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.350541+0000","last_change":"2024-09-12T17:30:02.964433+0000","last_active":"2024-09-12T18:06:21.350541+0000","last_peered":"2024-09-12T18:06:21.350541+0000","last_clean":"2024-09-12T18:06:21.350541+0000","last_became_active":"2024-09-12T17:30:02.964133+0000","last_became_peered":"2024-09-12T17:30:02.964133+0000","last_unstale":"2024-09-12T18:06:21.350541+0000","last_undegraded":"2024-09-12T18:06:21.350541+0000","last_fullsized":"2024-09-12T18:06:21.350541+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:49.035962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":286,"num_write":383,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'104","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:05.138023+0000","last_change":"2024-09-12T17:29:54.955997+0000","last_active":"2024-09-12T18:06:05.138023+0000","last_peered":"2024-09-12T18:06:05.138023+0000","last_clean":"2024-09-12T18:06:05.138023+0000","last_became_active":"2024-09-12T17:29:54.955716+0000","last_became_peered":"2024-09-12T17:29:54.955716+0000","last_unstale":"2024-09-12T18:06:05.138023+0000","last_undegraded":"2024-09-12T18:06:05.138023+0000","last_fullsized":"2024-09-12T18:06:05.138023+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:34.910648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":383,"num_write":153,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'185","reported_seq":777,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.847542+0000","last_change":"2024-09-12T17:30:28.200904+0000","last_active":"2024-09-12T18:08:03.847542+0000","last_peered":"2024-09-12T18:08:03.847542+0000","last_clean":"2024-09-12T18:08:03.847542+0000","last_became_active":"2024-09-12T17:30:28.200487+0000","last_became_peered":"2024-09-12T17:30:28.200487+0000","last_unstale":"2024-09-12T18:08:03.847542+0000","last_undegraded":"2024-09-12T18:08:03.847542+0000","last_fullsized":"2024-09-12T18:08:03.847542+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:12.443062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":393,"num_read_kb":70111,"num_write":894,"num_write_kb":56875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643518+0000","last_change":"2024-09-12T17:29:56.952926+0000","last_active":"2024-09-12T18:04:59.643518+0000","last_peered":"2024-09-12T18:04:59.643518+0000","last_clean":"2024-09-12T18:04:59.643518+0000","last_became_active":"2024-09-12T17:29:56.952578+0000","last_became_peered":"2024-09-12T17:29:56.952578+0000","last_unstale":"2024-09-12T18:04:59.643518+0000","last_undegraded":"2024-09-12T18:04:59.643518+0000","last_fullsized":"2024-09-12T18:04:59.643518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:45.935353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'125","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.842303+0000","last_change":"2024-09-12T17:29:58.955397+0000","last_active":"2024-09-12T18:08:03.842303+0000","last_peered":"2024-09-12T18:08:03.842303+0000","last_clean":"2024-09-12T18:08:03.842303+0000","last_became_active":"2024-09-12T17:29:58.955111+0000","last_became_peered":"2024-09-12T17:29:58.955111+0000","last_unstale":"2024-09-12T18:08:03.842303+0000","last_undegraded":"2024-09-12T18:08:03.842303+0000","last_fullsized":"2024-09-12T18:08:03.842303+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.069692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":163,"num_read_kb":266,"num_write":84,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527389+0000","last_change":"2024-09-12T17:30:00.966432+0000","last_active":"2024-09-12T18:05:04.527389+0000","last_peered":"2024-09-12T18:05:04.527389+0000","last_clean":"2024-09-12T18:05:04.527389+0000","last_became_active":"2024-09-12T17:30:00.965975+0000","last_became_peered":"2024-09-12T17:30:00.965975+0000","last_unstale":"2024-09-12T18:05:04.527389+0000","last_undegraded":"2024-09-12T18:05:04.527389+0000","last_fullsized":"2024-09-12T18:05:04.527389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:47.435596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.885555+0000","last_change":"2024-09-12T17:30:02.966210+0000","last_active":"2024-09-12T18:06:08.885555+0000","last_peered":"2024-09-12T18:06:08.885555+0000","last_clean":"2024-09-12T18:06:08.885555+0000","last_became_active":"2024-09-12T17:30:02.965919+0000","last_became_peered":"2024-09-12T17:30:02.965919+0000","last_unstale":"2024-09-12T18:06:08.885555+0000","last_undegraded":"2024-09-12T18:06:08.885555+0000","last_fullsized":"2024-09-12T18:06:08.885555+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:02.212105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":165,"num_read_kb":151,"num_write":248,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'420","reported_seq":1167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.973572+0000","last_change":"2024-09-12T17:29:54.956088+0000","last_active":"2024-09-12T18:05:20.973572+0000","last_peered":"2024-09-12T18:05:20.973572+0000","last_clean":"2024-09-12T18:05:20.973572+0000","last_became_active":"2024-09-12T17:29:54.954477+0000","last_became_peered":"2024-09-12T17:29:54.954477+0000","last_unstale":"2024-09-12T18:05:20.973572+0000","last_undegraded":"2024-09-12T18:05:20.973572+0000","last_fullsized":"2024-09-12T18:05:20.973572+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:23.380497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1777,"num_write":781,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'210","reported_seq":834,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.691648+0000","last_change":"2024-09-12T17:29:52.956760+0000","last_active":"2024-09-12T18:06:09.691648+0000","last_peered":"2024-09-12T18:06:09.691648+0000","last_clean":"2024-09-12T18:06:09.691648+0000","last_became_active":"2024-09-12T17:29:52.956376+0000","last_became_peered":"2024-09-12T17:29:52.956376+0000","last_unstale":"2024-09-12T18:06:09.691648+0000","last_undegraded":"2024-09-12T18:06:09.691648+0000","last_fullsized":"2024-09-12T18:06:09.691648+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:50.307316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":36390,"num_write":986,"num_write_kb":36751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.526513+0000","last_change":"2024-09-12T17:29:56.955510+0000","last_active":"2024-09-12T18:04:59.526513+0000","last_peered":"2024-09-12T18:04:59.526513+0000","last_clean":"2024-09-12T18:04:59.526513+0000","last_became_active":"2024-09-12T17:29:56.955256+0000","last_became_peered":"2024-09-12T17:29:56.955256+0000","last_unstale":"2024-09-12T18:04:59.526513+0000","last_undegraded":"2024-09-12T18:04:59.526513+0000","last_fullsized":"2024-09-12T18:04:59.526513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:56.582465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'51","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.247475+0000","last_change":"2024-09-12T17:29:58.961027+0000","last_active":"2024-09-12T18:06:21.247475+0000","last_peered":"2024-09-12T18:06:21.247475+0000","last_clean":"2024-09-12T18:06:21.247475+0000","last_became_active":"2024-09-12T17:29:58.960476+0000","last_became_peered":"2024-09-12T17:29:58.960476+0000","last_unstale":"2024-09-12T18:06:21.247475+0000","last_undegraded":"2024-09-12T18:06:21.247475+0000","last_fullsized":"2024-09-12T18:06:21.247475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:15.254313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.682338+0000","last_change":"2024-09-12T17:30:00.958998+0000","last_active":"2024-09-12T18:05:04.682338+0000","last_peered":"2024-09-12T18:05:04.682338+0000","last_clean":"2024-09-12T18:05:04.682338+0000","last_became_active":"2024-09-12T17:30:00.958739+0000","last_became_peered":"2024-09-12T17:30:00.958739+0000","last_unstale":"2024-09-12T18:05:04.682338+0000","last_undegraded":"2024-09-12T18:05:04.682338+0000","last_fullsized":"2024-09-12T18:05:04.682338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:23.108221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'186","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.857340+0000","last_change":"2024-09-12T17:30:02.973036+0000","last_active":"2024-09-12T18:06:20.857340+0000","last_peered":"2024-09-12T18:06:20.857340+0000","last_clean":"2024-09-12T18:06:20.857340+0000","last_became_active":"2024-09-12T17:30:02.972717+0000","last_became_peered":"2024-09-12T17:30:02.972717+0000","last_unstale":"2024-09-12T18:06:20.857340+0000","last_undegraded":"2024-09-12T18:06:20.857340+0000","last_fullsized":"2024-09-12T18:06:20.857340+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:17.417135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":309,"num_read_kb":305,"num_write":411,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'235","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.884486+0000","last_change":"2024-09-12T17:29:54.956165+0000","last_active":"2024-09-12T18:06:08.884486+0000","last_peered":"2024-09-12T18:06:08.884486+0000","last_clean":"2024-09-12T18:06:08.884486+0000","last_became_active":"2024-09-12T17:29:54.955897+0000","last_became_peered":"2024-09-12T17:29:54.955897+0000","last_unstale":"2024-09-12T18:06:08.884486+0000","last_undegraded":"2024-09-12T18:06:08.884486+0000","last_fullsized":"2024-09-12T18:06:08.884486+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:12.755846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":344,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'244","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.636889+0000","last_change":"2024-09-12T17:29:52.955479+0000","last_active":"2024-09-12T18:08:03.636889+0000","last_peered":"2024-09-12T18:08:03.636889+0000","last_clean":"2024-09-12T18:08:03.636889+0000","last_became_active":"2024-09-12T17:29:52.954956+0000","last_became_peered":"2024-09-12T17:29:52.954956+0000","last_unstale":"2024-09-12T18:08:03.636889+0000","last_undegraded":"2024-09-12T18:08:03.636889+0000","last_fullsized":"2024-09-12T18:08:03.636889+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:37.430521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550036,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":646,"num_read_kb":5380,"num_write":1208,"num_write_kb":40346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.681595+0000","last_change":"2024-09-12T17:29:56.959871+0000","last_active":"2024-09-12T18:04:59.681595+0000","last_peered":"2024-09-12T18:04:59.681595+0000","last_clean":"2024-09-12T18:04:59.681595+0000","last_became_active":"2024-09-12T17:29:56.959460+0000","last_became_peered":"2024-09-12T17:29:56.959460+0000","last_unstale":"2024-09-12T18:04:59.681595+0000","last_undegraded":"2024-09-12T18:04:59.681595+0000","last_fullsized":"2024-09-12T18:04:59.681595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:11.274542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'149","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.749133+0000","last_change":"2024-09-12T17:29:58.961137+0000","last_active":"2024-09-12T18:08:03.749133+0000","last_peered":"2024-09-12T18:08:03.749133+0000","last_clean":"2024-09-12T18:08:03.749133+0000","last_became_active":"2024-09-12T17:29:58.960824+0000","last_became_peered":"2024-09-12T17:29:58.960824+0000","last_unstale":"2024-09-12T18:08:03.749133+0000","last_undegraded":"2024-09-12T18:08:03.749133+0000","last_fullsized":"2024-09-12T18:08:03.749133+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:15.729749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":238,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.515733+0000","last_change":"2024-09-12T17:30:00.967592+0000","last_active":"2024-09-12T18:05:04.515733+0000","last_peered":"2024-09-12T18:05:04.515733+0000","last_clean":"2024-09-12T18:05:04.515733+0000","last_became_active":"2024-09-12T17:30:00.967299+0000","last_became_peered":"2024-09-12T17:30:00.967299+0000","last_unstale":"2024-09-12T18:05:04.515733+0000","last_undegraded":"2024-09-12T18:05:04.515733+0000","last_fullsized":"2024-09-12T18:05:04.515733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:31.645270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'93","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.484386+0000","last_change":"2024-09-12T17:30:02.966660+0000","last_active":"2024-09-12T18:06:20.484386+0000","last_peered":"2024-09-12T18:06:20.484386+0000","last_clean":"2024-09-12T18:06:20.484386+0000","last_became_active":"2024-09-12T17:30:02.965644+0000","last_became_peered":"2024-09-12T17:30:02.965644+0000","last_unstale":"2024-09-12T18:06:20.484386+0000","last_undegraded":"2024-09-12T18:06:20.484386+0000","last_fullsized":"2024-09-12T18:06:20.484386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:15.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":207,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'4299","reported_seq":4944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.467541+0000","last_change":"2024-09-12T17:29:54.951955+0000","last_active":"2024-09-12T18:06:07.467541+0000","last_peered":"2024-09-12T18:06:07.467541+0000","last_clean":"2024-09-12T18:06:07.467541+0000","last_became_active":"2024-09-12T17:29:54.950407+0000","last_became_peered":"2024-09-12T17:29:54.950407+0000","last_unstale":"2024-09-12T18:06:07.467541+0000","last_undegraded":"2024-09-12T18:06:07.467541+0000","last_fullsized":"2024-09-12T18:06:07.467541+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:23.507143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17237,"num_read_kb":14347,"num_write":6471,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'180","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.760584+0000","last_change":"2024-09-12T17:29:52.963110+0000","last_active":"2024-09-12T18:08:03.760584+0000","last_peered":"2024-09-12T18:08:03.760584+0000","last_clean":"2024-09-12T18:08:03.760584+0000","last_became_active":"2024-09-12T17:29:52.962836+0000","last_became_peered":"2024-09-12T17:29:52.962836+0000","last_unstale":"2024-09-12T18:08:03.760584+0000","last_undegraded":"2024-09-12T18:08:03.760584+0000","last_fullsized":"2024-09-12T18:08:03.760584+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:33.047304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303959,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":45090,"num_write":889,"num_write_kb":58788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.514939+0000","last_change":"2024-09-12T17:29:56.957363+0000","last_active":"2024-09-12T18:04:59.514939+0000","last_peered":"2024-09-12T18:04:59.514939+0000","last_clean":"2024-09-12T18:04:59.514939+0000","last_became_active":"2024-09-12T17:29:56.957066+0000","last_became_peered":"2024-09-12T17:29:56.957066+0000","last_unstale":"2024-09-12T18:04:59.514939+0000","last_undegraded":"2024-09-12T18:04:59.514939+0000","last_fullsized":"2024-09-12T18:04:59.514939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:23.450708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'152","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.719866+0000","last_change":"2024-09-12T17:29:58.955841+0000","last_active":"2024-09-12T18:08:03.719866+0000","last_peered":"2024-09-12T18:08:03.719866+0000","last_clean":"2024-09-12T18:08:03.719866+0000","last_became_active":"2024-09-12T17:29:58.955585+0000","last_became_peered":"2024-09-12T17:29:58.955585+0000","last_unstale":"2024-09-12T18:08:03.719866+0000","last_undegraded":"2024-09-12T18:08:03.719866+0000","last_fullsized":"2024-09-12T18:08:03.719866+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:03.552605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7377,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":246,"num_write":102,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644380+0000","last_change":"2024-09-12T17:30:00.965228+0000","last_active":"2024-09-12T18:05:04.644380+0000","last_peered":"2024-09-12T18:05:04.644380+0000","last_clean":"2024-09-12T18:05:04.644380+0000","last_became_active":"2024-09-12T17:30:00.964621+0000","last_became_peered":"2024-09-12T17:30:00.964621+0000","last_unstale":"2024-09-12T18:05:04.644380+0000","last_undegraded":"2024-09-12T18:05:04.644380+0000","last_fullsized":"2024-09-12T18:05:04.644380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:28.006617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'546","reported_seq":1344,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517857+0000","last_change":"2024-09-12T17:29:54.959133+0000","last_active":"2024-09-12T18:05:19.517857+0000","last_peered":"2024-09-12T18:05:19.517857+0000","last_clean":"2024-09-12T18:05:19.517857+0000","last_became_active":"2024-09-12T17:29:54.958758+0000","last_became_peered":"2024-09-12T17:29:54.958758+0000","last_unstale":"2024-09-12T18:05:19.517857+0000","last_undegraded":"2024-09-12T18:05:19.517857+0000","last_fullsized":"2024-09-12T18:05:19.517857+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:49.827603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2571,"num_read_kb":2181,"num_write":951,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'212","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.840739+0000","last_change":"2024-09-12T17:30:28.007406+0000","last_active":"2024-09-12T18:08:03.840739+0000","last_peered":"2024-09-12T18:08:03.840739+0000","last_clean":"2024-09-12T18:08:03.840739+0000","last_became_active":"2024-09-12T17:30:28.007001+0000","last_became_peered":"2024-09-12T17:30:28.007001+0000","last_unstale":"2024-09-12T18:08:03.840739+0000","last_undegraded":"2024-09-12T18:08:03.840739+0000","last_fullsized":"2024-09-12T18:08:03.840739+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:46.585635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":31262,"num_write":918,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.653171+0000","last_change":"2024-09-12T17:29:56.954814+0000","last_active":"2024-09-12T18:06:04.653171+0000","last_peered":"2024-09-12T18:06:04.653171+0000","last_clean":"2024-09-12T18:06:04.653171+0000","last_became_active":"2024-09-12T17:29:56.954498+0000","last_became_peered":"2024-09-12T17:29:56.954498+0000","last_unstale":"2024-09-12T18:06:04.653171+0000","last_undegraded":"2024-09-12T18:06:04.653171+0000","last_fullsized":"2024-09-12T18:06:04.653171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:39.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'190","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.707014+0000","last_change":"2024-09-12T17:29:58.958482+0000","last_active":"2024-09-12T18:08:03.707014+0000","last_peered":"2024-09-12T18:08:03.707014+0000","last_clean":"2024-09-12T18:08:03.707014+0000","last_became_active":"2024-09-12T17:29:58.958198+0000","last_became_peered":"2024-09-12T17:29:58.958198+0000","last_unstale":"2024-09-12T18:08:03.707014+0000","last_undegraded":"2024-09-12T18:08:03.707014+0000","last_fullsized":"2024-09-12T18:08:03.707014+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:03.636909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15825,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":439,"num_write":184,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.639853+0000","last_change":"2024-09-12T17:30:00.964218+0000","last_active":"2024-09-12T18:05:04.639853+0000","last_peered":"2024-09-12T18:05:04.639853+0000","last_clean":"2024-09-12T18:05:04.639853+0000","last_became_active":"2024-09-12T17:30:00.963706+0000","last_became_peered":"2024-09-12T17:30:00.963706+0000","last_unstale":"2024-09-12T18:05:04.639853+0000","last_undegraded":"2024-09-12T18:05:04.639853+0000","last_fullsized":"2024-09-12T18:05:04.639853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:42.210305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'175","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.667499+0000","last_change":"2024-09-12T17:30:02.964954+0000","last_active":"2024-09-12T18:06:08.667499+0000","last_peered":"2024-09-12T18:06:08.667499+0000","last_clean":"2024-09-12T18:06:08.667499+0000","last_became_active":"2024-09-12T17:30:02.964682+0000","last_became_peered":"2024-09-12T17:30:02.964682+0000","last_unstale":"2024-09-12T18:06:08.667499+0000","last_undegraded":"2024-09-12T18:06:08.667499+0000","last_fullsized":"2024-09-12T18:06:08.667499+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:18.544576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":239,"num_read_kb":250,"num_write":415,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'100","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.652523+0000","last_change":"2024-09-12T17:29:54.955631+0000","last_active":"2024-09-12T18:05:59.652523+0000","last_peered":"2024-09-12T18:05:59.652523+0000","last_clean":"2024-09-12T18:05:59.652523+0000","last_became_active":"2024-09-12T17:29:54.955326+0000","last_became_peered":"2024-09-12T17:29:54.955326+0000","last_unstale":"2024-09-12T18:05:59.652523+0000","last_undegraded":"2024-09-12T18:05:59.652523+0000","last_fullsized":"2024-09-12T18:05:59.652523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:49.289784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":334,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'221","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.872223+0000","last_change":"2024-09-12T17:29:52.946176+0000","last_active":"2024-09-12T18:08:03.872223+0000","last_peered":"2024-09-12T18:08:03.872223+0000","last_clean":"2024-09-12T18:08:03.872223+0000","last_became_active":"2024-09-12T17:29:52.945616+0000","last_became_peered":"2024-09-12T17:29:52.945616+0000","last_unstale":"2024-09-12T18:08:03.872223+0000","last_undegraded":"2024-09-12T18:08:03.872223+0000","last_fullsized":"2024-09-12T18:08:03.872223+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.047653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109585,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":523,"num_read_kb":15300,"num_write":1084,"num_write_kb":27395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518557+0000","last_change":"2024-09-12T17:29:56.959423+0000","last_active":"2024-09-12T18:05:24.518557+0000","last_peered":"2024-09-12T18:05:24.518557+0000","last_clean":"2024-09-12T18:05:24.518557+0000","last_became_active":"2024-09-12T17:29:56.959047+0000","last_became_peered":"2024-09-12T17:29:56.959047+0000","last_unstale":"2024-09-12T18:05:24.518557+0000","last_undegraded":"2024-09-12T18:05:24.518557+0000","last_fullsized":"2024-09-12T18:05:24.518557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:03.525338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'145","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.725366+0000","last_change":"2024-09-12T17:29:58.955055+0000","last_active":"2024-09-12T18:08:03.725366+0000","last_peered":"2024-09-12T18:08:03.725366+0000","last_clean":"2024-09-12T18:08:03.725366+0000","last_became_active":"2024-09-12T17:29:58.954747+0000","last_became_peered":"2024-09-12T17:29:58.954747+0000","last_unstale":"2024-09-12T18:08:03.725366+0000","last_undegraded":"2024-09-12T18:08:03.725366+0000","last_fullsized":"2024-09-12T18:08:03.725366+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:01.106668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10649,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":195,"num_read_kb":252,"num_write":120,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644390+0000","last_change":"2024-09-12T17:30:00.960182+0000","last_active":"2024-09-12T18:05:04.644390+0000","last_peered":"2024-09-12T18:05:04.644390+0000","last_clean":"2024-09-12T18:05:04.644390+0000","last_became_active":"2024-09-12T17:30:00.959708+0000","last_became_peered":"2024-09-12T17:30:00.959708+0000","last_unstale":"2024-09-12T18:05:04.644390+0000","last_undegraded":"2024-09-12T18:05:04.644390+0000","last_fullsized":"2024-09-12T18:05:04.644390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:04.130612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'214","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.731228+0000","last_change":"2024-09-12T17:30:02.961235+0000","last_active":"2024-09-12T18:07:37.731228+0000","last_peered":"2024-09-12T18:07:37.731228+0000","last_clean":"2024-09-12T18:07:37.731228+0000","last_became_active":"2024-09-12T17:30:02.960928+0000","last_became_peered":"2024-09-12T17:30:02.960928+0000","last_unstale":"2024-09-12T18:07:37.731228+0000","last_undegraded":"2024-09-12T18:07:37.731228+0000","last_fullsized":"2024-09-12T18:07:37.731228+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:02.653466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":219,"num_write":570,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'158","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:03.287640+0000","last_change":"2024-09-12T17:29:54.951640+0000","last_active":"2024-09-12T18:06:03.287640+0000","last_peered":"2024-09-12T18:06:03.287640+0000","last_clean":"2024-09-12T18:06:03.287640+0000","last_became_active":"2024-09-12T17:29:54.950294+0000","last_became_peered":"2024-09-12T17:29:54.950294+0000","last_unstale":"2024-09-12T18:06:03.287640+0000","last_undegraded":"2024-09-12T18:06:03.287640+0000","last_fullsized":"2024-09-12T18:06:03.287640+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:35.954198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":567,"num_write":224,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'195","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:24.535388+0000","last_change":"2024-09-12T17:29:52.947774+0000","last_active":"2024-09-12T18:07:24.535388+0000","last_peered":"2024-09-12T18:07:24.535388+0000","last_clean":"2024-09-12T18:07:24.535388+0000","last_became_active":"2024-09-12T17:29:52.947363+0000","last_became_peered":"2024-09-12T17:29:52.947363+0000","last_unstale":"2024-09-12T18:07:24.535388+0000","last_undegraded":"2024-09-12T18:07:24.535388+0000","last_fullsized":"2024-09-12T18:07:24.535388+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:04.661665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":129945,"num_write":977,"num_write_kb":26137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.515065+0000","last_change":"2024-09-12T17:29:56.952220+0000","last_active":"2024-09-12T18:04:59.515065+0000","last_peered":"2024-09-12T18:04:59.515065+0000","last_clean":"2024-09-12T18:04:59.515065+0000","last_became_active":"2024-09-12T17:29:56.951825+0000","last_became_peered":"2024-09-12T17:29:56.951825+0000","last_unstale":"2024-09-12T18:04:59.515065+0000","last_undegraded":"2024-09-12T18:04:59.515065+0000","last_fullsized":"2024-09-12T18:04:59.515065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.728224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'131","reported_seq":696,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.883858+0000","last_change":"2024-09-12T17:29:58.978881+0000","last_active":"2024-09-12T18:08:03.883858+0000","last_peered":"2024-09-12T18:08:03.883858+0000","last_clean":"2024-09-12T18:08:03.883858+0000","last_became_active":"2024-09-12T17:29:58.978506+0000","last_became_peered":"2024-09-12T17:29:58.978506+0000","last_unstale":"2024-09-12T18:08:03.883858+0000","last_undegraded":"2024-09-12T18:08:03.883858+0000","last_fullsized":"2024-09-12T18:08:03.883858+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:23.505523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7433,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":163,"num_read_kb":221,"num_write":86,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.635596+0000","last_change":"2024-09-12T17:30:00.965903+0000","last_active":"2024-09-12T18:04:09.635596+0000","last_peered":"2024-09-12T18:04:09.635596+0000","last_clean":"2024-09-12T18:04:09.635596+0000","last_became_active":"2024-09-12T17:30:00.965628+0000","last_became_peered":"2024-09-12T17:30:00.965628+0000","last_unstale":"2024-09-12T18:04:09.635596+0000","last_undegraded":"2024-09-12T18:04:09.635596+0000","last_fullsized":"2024-09-12T18:04:09.635596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:59.886033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'111","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.672413+0000","last_change":"2024-09-12T17:30:02.963569+0000","last_active":"2024-09-12T18:07:38.672413+0000","last_peered":"2024-09-12T18:07:38.672413+0000","last_clean":"2024-09-12T18:07:38.672413+0000","last_became_active":"2024-09-12T17:30:02.963242+0000","last_became_peered":"2024-09-12T17:30:02.963242+0000","last_unstale":"2024-09-12T18:07:38.672413+0000","last_undegraded":"2024-09-12T18:07:38.672413+0000","last_fullsized":"2024-09-12T18:07:38.672413+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:33.404263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'168","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:26.875016+0000","last_change":"2024-09-12T17:29:54.950700+0000","last_active":"2024-09-12T18:05:26.875016+0000","last_peered":"2024-09-12T18:05:26.875016+0000","last_clean":"2024-09-12T18:05:26.875016+0000","last_became_active":"2024-09-12T17:29:54.950429+0000","last_became_peered":"2024-09-12T17:29:54.950429+0000","last_unstale":"2024-09-12T18:05:26.875016+0000","last_undegraded":"2024-09-12T18:05:26.875016+0000","last_fullsized":"2024-09-12T18:05:26.875016+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:03.561091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":726,"num_read_kb":598,"num_write":255,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'195","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:24.663441+0000","last_change":"2024-09-12T17:29:52.967135+0000","last_active":"2024-09-12T18:07:24.663441+0000","last_peered":"2024-09-12T18:07:24.663441+0000","last_clean":"2024-09-12T18:07:24.663441+0000","last_became_active":"2024-09-12T17:29:52.966561+0000","last_became_peered":"2024-09-12T17:29:52.966561+0000","last_unstale":"2024-09-12T18:07:24.663441+0000","last_undegraded":"2024-09-12T18:07:24.663441+0000","last_fullsized":"2024-09-12T18:07:24.663441+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:12.665280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":24994,"num_write":951,"num_write_kb":31573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643585+0000","last_change":"2024-09-12T17:29:56.959683+0000","last_active":"2024-09-12T18:04:59.643585+0000","last_peered":"2024-09-12T18:04:59.643585+0000","last_clean":"2024-09-12T18:04:59.643585+0000","last_became_active":"2024-09-12T17:29:56.959185+0000","last_became_peered":"2024-09-12T17:29:56.959185+0000","last_unstale":"2024-09-12T18:04:59.643585+0000","last_undegraded":"2024-09-12T18:04:59.643585+0000","last_fullsized":"2024-09-12T18:04:59.643585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:49.577878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'60","reported_seq":574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.523846+0000","last_change":"2024-09-12T17:29:58.978897+0000","last_active":"2024-09-12T18:06:04.523846+0000","last_peered":"2024-09-12T18:06:04.523846+0000","last_clean":"2024-09-12T18:06:04.523846+0000","last_became_active":"2024-09-12T17:29:58.978247+0000","last_became_peered":"2024-09-12T17:29:58.978247+0000","last_unstale":"2024-09-12T18:06:04.523846+0000","last_undegraded":"2024-09-12T18:06:04.523846+0000","last_fullsized":"2024-09-12T18:06:04.523846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:21.292974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":59,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'759","reported_seq":2185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.553237+0000","last_change":"2024-09-12T17:30:00.962301+0000","last_active":"2024-09-12T18:08:03.553237+0000","last_peered":"2024-09-12T18:08:03.553237+0000","last_clean":"2024-09-12T18:08:03.553237+0000","last_became_active":"2024-09-12T17:30:00.961928+0000","last_became_peered":"2024-09-12T17:30:00.961928+0000","last_unstale":"2024-09-12T18:08:03.553237+0000","last_undegraded":"2024-09-12T18:08:03.553237+0000","last_fullsized":"2024-09-12T18:08:03.553237+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:21.176614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'103","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.850274+0000","last_change":"2024-09-12T17:30:02.963767+0000","last_active":"2024-09-12T18:06:20.850274+0000","last_peered":"2024-09-12T18:06:20.850274+0000","last_clean":"2024-09-12T18:06:20.850274+0000","last_became_active":"2024-09-12T17:30:02.963474+0000","last_became_peered":"2024-09-12T17:30:02.963474+0000","last_unstale":"2024-09-12T18:06:20.850274+0000","last_undegraded":"2024-09-12T18:06:20.850274+0000","last_fullsized":"2024-09-12T18:06:20.850274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:06.653540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'461","reported_seq":1185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.916766+0000","last_change":"2024-09-12T17:29:54.956245+0000","last_active":"2024-09-12T18:05:56.916766+0000","last_peered":"2024-09-12T18:05:56.916766+0000","last_clean":"2024-09-12T18:05:56.916766+0000","last_became_active":"2024-09-12T17:29:54.954344+0000","last_became_peered":"2024-09-12T17:29:54.954344+0000","last_unstale":"2024-09-12T18:05:56.916766+0000","last_undegraded":"2024-09-12T18:05:56.916766+0000","last_fullsized":"2024-09-12T18:05:56.916766+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:54.059931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":1813,"num_write":696,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'216","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.777130+0000","last_change":"2024-09-12T17:30:28.008322+0000","last_active":"2024-09-12T18:08:03.777130+0000","last_peered":"2024-09-12T18:08:03.777130+0000","last_clean":"2024-09-12T18:08:03.777130+0000","last_became_active":"2024-09-12T17:30:28.008012+0000","last_became_peered":"2024-09-12T17:30:28.008012+0000","last_unstale":"2024-09-12T18:08:03.777130+0000","last_undegraded":"2024-09-12T18:08:03.777130+0000","last_fullsized":"2024-09-12T18:08:03.777130+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:35.056975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395846,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":11221,"num_write":1057,"num_write_kb":38249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.681643+0000","last_change":"2024-09-12T17:29:56.959803+0000","last_active":"2024-09-12T18:04:59.681643+0000","last_peered":"2024-09-12T18:04:59.681643+0000","last_clean":"2024-09-12T18:04:59.681643+0000","last_became_active":"2024-09-12T17:29:56.959496+0000","last_became_peered":"2024-09-12T17:29:56.959496+0000","last_unstale":"2024-09-12T18:04:59.681643+0000","last_undegraded":"2024-09-12T18:04:59.681643+0000","last_fullsized":"2024-09-12T18:04:59.681643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:24.096051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'144","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.654187+0000","last_change":"2024-09-12T17:29:58.956511+0000","last_active":"2024-09-12T18:08:03.654187+0000","last_peered":"2024-09-12T18:08:03.654187+0000","last_clean":"2024-09-12T18:08:03.654187+0000","last_became_active":"2024-09-12T17:29:58.956214+0000","last_became_peered":"2024-09-12T17:29:58.956214+0000","last_unstale":"2024-09-12T18:08:03.654187+0000","last_undegraded":"2024-09-12T18:08:03.654187+0000","last_fullsized":"2024-09-12T18:08:03.654187+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.069692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7681,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":254,"num_write":108,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633054+0000","last_change":"2024-09-12T17:30:00.964427+0000","last_active":"2024-09-12T18:03:54.633054+0000","last_peered":"2024-09-12T18:03:54.633054+0000","last_clean":"2024-09-12T18:03:54.633054+0000","last_became_active":"2024-09-12T17:30:00.964150+0000","last_became_peered":"2024-09-12T17:30:00.964150+0000","last_unstale":"2024-09-12T18:03:54.633054+0000","last_undegraded":"2024-09-12T18:03:54.633054+0000","last_fullsized":"2024-09-12T18:03:54.633054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:38.024178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'176","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.255174+0000","last_change":"2024-09-12T17:30:02.972717+0000","last_active":"2024-09-12T18:05:56.255174+0000","last_peered":"2024-09-12T18:05:56.255174+0000","last_clean":"2024-09-12T18:05:56.255174+0000","last_became_active":"2024-09-12T17:30:02.972420+0000","last_became_peered":"2024-09-12T17:30:02.972420+0000","last_unstale":"2024-09-12T18:05:56.255174+0000","last_undegraded":"2024-09-12T18:05:56.255174+0000","last_fullsized":"2024-09-12T18:05:56.255174+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:00.149423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":302,"num_write":451,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'323","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.064215+0000","last_change":"2024-09-12T17:29:54.954336+0000","last_active":"2024-09-12T18:05:53.064215+0000","last_peered":"2024-09-12T18:05:53.064215+0000","last_clean":"2024-09-12T18:05:53.064215+0000","last_became_active":"2024-09-12T17:29:54.953626+0000","last_became_peered":"2024-09-12T17:29:54.953626+0000","last_unstale":"2024-09-12T18:05:53.064215+0000","last_undegraded":"2024-09-12T18:05:53.064215+0000","last_fullsized":"2024-09-12T18:05:53.064215+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:50.673324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1393,"num_read_kb":1115,"num_write":522,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'171","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.807774+0000","last_change":"2024-09-12T17:30:28.201293+0000","last_active":"2024-09-12T18:08:03.807774+0000","last_peered":"2024-09-12T18:08:03.807774+0000","last_clean":"2024-09-12T18:08:03.807774+0000","last_became_active":"2024-09-12T17:30:28.200981+0000","last_became_peered":"2024-09-12T17:30:28.200981+0000","last_unstale":"2024-09-12T18:08:03.807774+0000","last_undegraded":"2024-09-12T18:08:03.807774+0000","last_fullsized":"2024-09-12T18:08:03.807774+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:11.575396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755684,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":377,"num_read_kb":41427,"num_write":835,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.639179+0000","last_change":"2024-09-12T17:29:56.955843+0000","last_active":"2024-09-12T18:04:59.639179+0000","last_peered":"2024-09-12T18:04:59.639179+0000","last_clean":"2024-09-12T18:04:59.639179+0000","last_became_active":"2024-09-12T17:29:56.955532+0000","last_became_peered":"2024-09-12T17:29:56.955532+0000","last_unstale":"2024-09-12T18:04:59.639179+0000","last_undegraded":"2024-09-12T18:04:59.639179+0000","last_fullsized":"2024-09-12T18:04:59.639179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:32.340336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'123","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.661177+0000","last_change":"2024-09-12T17:29:58.961115+0000","last_active":"2024-09-12T18:08:03.661177+0000","last_peered":"2024-09-12T18:08:03.661177+0000","last_clean":"2024-09-12T18:08:03.661177+0000","last_became_active":"2024-09-12T17:29:58.960733+0000","last_became_peered":"2024-09-12T17:29:58.960733+0000","last_unstale":"2024-09-12T18:08:03.661177+0000","last_undegraded":"2024-09-12T18:08:03.661177+0000","last_fullsized":"2024-09-12T18:08:03.661177+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:12.596344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9021,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":245,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.507102+0000","last_change":"2024-09-12T17:30:00.960684+0000","last_active":"2024-09-12T18:04:04.507102+0000","last_peered":"2024-09-12T18:04:04.507102+0000","last_clean":"2024-09-12T18:04:04.507102+0000","last_became_active":"2024-09-12T17:30:00.960358+0000","last_became_peered":"2024-09-12T17:30:00.960358+0000","last_unstale":"2024-09-12T18:04:04.507102+0000","last_undegraded":"2024-09-12T18:04:04.507102+0000","last_fullsized":"2024-09-12T18:04:04.507102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:41.585720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'157","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.309864+0000","last_change":"2024-09-12T17:30:02.964368+0000","last_active":"2024-09-12T18:06:08.309864+0000","last_peered":"2024-09-12T18:06:08.309864+0000","last_clean":"2024-09-12T18:06:08.309864+0000","last_became_active":"2024-09-12T17:30:02.964082+0000","last_became_peered":"2024-09-12T17:30:02.964082+0000","last_unstale":"2024-09-12T18:06:08.309864+0000","last_undegraded":"2024-09-12T18:06:08.309864+0000","last_fullsized":"2024-09-12T18:06:08.309864+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:51.607971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":313,"num_read_kb":292,"num_write":397,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'219","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.313861+0000","last_change":"2024-09-12T17:29:54.945900+0000","last_active":"2024-09-12T18:06:01.313861+0000","last_peered":"2024-09-12T18:06:01.313861+0000","last_clean":"2024-09-12T18:06:01.313861+0000","last_became_active":"2024-09-12T17:29:54.945602+0000","last_became_peered":"2024-09-12T17:29:54.945602+0000","last_unstale":"2024-09-12T18:06:01.313861+0000","last_undegraded":"2024-09-12T18:06:01.313861+0000","last_fullsized":"2024-09-12T18:06:01.313861+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:32.630682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":778,"num_write":336,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'201","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.856854+0000","last_change":"2024-09-12T17:29:52.954797+0000","last_active":"2024-09-12T18:08:03.856854+0000","last_peered":"2024-09-12T18:08:03.856854+0000","last_clean":"2024-09-12T18:08:03.856854+0000","last_became_active":"2024-09-12T17:29:52.954457+0000","last_became_peered":"2024-09-12T17:29:52.954457+0000","last_unstale":"2024-09-12T18:08:03.856854+0000","last_undegraded":"2024-09-12T18:08:03.856854+0000","last_fullsized":"2024-09-12T18:08:03.856854+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:04.967724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":114782,"num_write":980,"num_write_kb":45150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.504802+0000","last_change":"2024-09-12T17:29:56.953213+0000","last_active":"2024-09-12T18:03:49.504802+0000","last_peered":"2024-09-12T18:03:49.504802+0000","last_clean":"2024-09-12T18:03:49.504802+0000","last_became_active":"2024-09-12T17:29:56.952946+0000","last_became_peered":"2024-09-12T17:29:56.952946+0000","last_unstale":"2024-09-12T18:03:49.504802+0000","last_undegraded":"2024-09-12T18:03:49.504802+0000","last_fullsized":"2024-09-12T18:03:49.504802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:44.459531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'105","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.866517+0000","last_change":"2024-09-12T17:29:58.956494+0000","last_active":"2024-09-12T18:08:03.866517+0000","last_peered":"2024-09-12T18:08:03.866517+0000","last_clean":"2024-09-12T18:08:03.866517+0000","last_became_active":"2024-09-12T17:29:58.953283+0000","last_became_peered":"2024-09-12T17:29:58.953283+0000","last_unstale":"2024-09-12T18:08:03.866517+0000","last_undegraded":"2024-09-12T18:08:03.866517+0000","last_fullsized":"2024-09-12T18:08:03.866517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:18.253475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":172,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.515722+0000","last_change":"2024-09-12T17:30:00.963002+0000","last_active":"2024-09-12T18:05:04.515722+0000","last_peered":"2024-09-12T18:05:04.515722+0000","last_clean":"2024-09-12T18:05:04.515722+0000","last_became_active":"2024-09-12T17:30:00.962703+0000","last_became_peered":"2024-09-12T17:30:00.962703+0000","last_unstale":"2024-09-12T18:05:04.515722+0000","last_undegraded":"2024-09-12T18:05:04.515722+0000","last_fullsized":"2024-09-12T18:05:04.515722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:05.219468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'181","reported_seq":1637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.718070+0000","last_change":"2024-09-12T17:30:02.970877+0000","last_active":"2024-09-12T18:06:19.718070+0000","last_peered":"2024-09-12T18:06:19.718070+0000","last_clean":"2024-09-12T18:06:19.718070+0000","last_became_active":"2024-09-12T17:30:02.970633+0000","last_became_peered":"2024-09-12T17:30:02.970633+0000","last_unstale":"2024-09-12T18:06:19.718070+0000","last_undegraded":"2024-09-12T18:06:19.718070+0000","last_fullsized":"2024-09-12T18:06:19.718070+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:13.976443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1219,"num_read_kb":1215,"num_write":406,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'173","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.446097+0000","last_change":"2024-09-12T17:29:54.955106+0000","last_active":"2024-09-12T18:06:06.446097+0000","last_peered":"2024-09-12T18:06:06.446097+0000","last_clean":"2024-09-12T18:06:06.446097+0000","last_became_active":"2024-09-12T17:29:54.954585+0000","last_became_peered":"2024-09-12T17:29:54.954585+0000","last_unstale":"2024-09-12T18:06:06.446097+0000","last_undegraded":"2024-09-12T18:06:06.446097+0000","last_fullsized":"2024-09-12T18:06:06.446097+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:16.804269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":606,"num_write":278,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'199","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.644273+0000","last_change":"2024-09-12T17:29:52.957088+0000","last_active":"2024-09-12T18:08:03.644273+0000","last_peered":"2024-09-12T18:08:03.644273+0000","last_clean":"2024-09-12T18:08:03.644273+0000","last_became_active":"2024-09-12T17:29:52.956621+0000","last_became_peered":"2024-09-12T17:29:52.956621+0000","last_unstale":"2024-09-12T18:08:03.644273+0000","last_undegraded":"2024-09-12T18:08:03.644273+0000","last_fullsized":"2024-09-12T18:08:03.644273+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:04.500292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3104916,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":909,"num_read_kb":17688,"num_write":1020,"num_write_kb":27781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633423+0000","last_change":"2024-09-12T17:29:56.955247+0000","last_active":"2024-09-12T18:03:54.633423+0000","last_peered":"2024-09-12T18:03:54.633423+0000","last_clean":"2024-09-12T18:03:54.633423+0000","last_became_active":"2024-09-12T17:29:56.954952+0000","last_became_peered":"2024-09-12T17:29:56.954952+0000","last_unstale":"2024-09-12T18:03:54.633423+0000","last_undegraded":"2024-09-12T18:03:54.633423+0000","last_fullsized":"2024-09-12T18:03:54.633423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:49.854222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'138","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.891840+0000","last_change":"2024-09-12T17:29:58.953367+0000","last_active":"2024-09-12T18:08:03.891840+0000","last_peered":"2024-09-12T18:08:03.891840+0000","last_clean":"2024-09-12T18:08:03.891840+0000","last_became_active":"2024-09-12T17:29:58.953076+0000","last_became_peered":"2024-09-12T17:29:58.953076+0000","last_unstale":"2024-09-12T18:08:03.891840+0000","last_undegraded":"2024-09-12T18:08:03.891840+0000","last_fullsized":"2024-09-12T18:08:03.891840+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:10.729622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9014,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":204,"num_read_kb":286,"num_write":112,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644366+0000","last_change":"2024-09-12T17:30:00.967059+0000","last_active":"2024-09-12T18:05:04.644366+0000","last_peered":"2024-09-12T18:05:04.644366+0000","last_clean":"2024-09-12T18:05:04.644366+0000","last_became_active":"2024-09-12T17:30:00.964942+0000","last_became_peered":"2024-09-12T17:30:00.964942+0000","last_unstale":"2024-09-12T18:05:04.644366+0000","last_undegraded":"2024-09-12T18:05:04.644366+0000","last_fullsized":"2024-09-12T18:05:04.644366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:59.160654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'116","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.763230+0000","last_change":"2024-09-12T17:30:02.969660+0000","last_active":"2024-09-12T18:07:37.763230+0000","last_peered":"2024-09-12T18:07:37.763230+0000","last_clean":"2024-09-12T18:07:37.763230+0000","last_became_active":"2024-09-12T17:30:02.969327+0000","last_became_peered":"2024-09-12T17:30:02.969327+0000","last_unstale":"2024-09-12T18:07:37.763230+0000","last_undegraded":"2024-09-12T18:07:37.763230+0000","last_fullsized":"2024-09-12T18:07:37.763230+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:11.229944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":150,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'198","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:02.136940+0000","last_change":"2024-09-12T17:29:54.956426+0000","last_active":"2024-09-12T18:06:02.136940+0000","last_peered":"2024-09-12T18:06:02.136940+0000","last_clean":"2024-09-12T18:06:02.136940+0000","last_became_active":"2024-09-12T17:29:54.956020+0000","last_became_peered":"2024-09-12T17:29:54.956020+0000","last_unstale":"2024-09-12T18:06:02.136940+0000","last_undegraded":"2024-09-12T18:06:02.136940+0000","last_fullsized":"2024-09-12T18:06:02.136940+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:46.756727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":702,"num_write":286,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'210","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.713025+0000","last_change":"2024-09-12T17:29:52.963730+0000","last_active":"2024-09-12T18:08:03.713025+0000","last_peered":"2024-09-12T18:08:03.713025+0000","last_clean":"2024-09-12T18:08:03.713025+0000","last_became_active":"2024-09-12T17:29:52.963118+0000","last_became_peered":"2024-09-12T17:29:52.963118+0000","last_unstale":"2024-09-12T18:08:03.713025+0000","last_undegraded":"2024-09-12T18:08:03.713025+0000","last_fullsized":"2024-09-12T18:08:03.713025+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:48.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":444,"num_read_kb":2786,"num_write":996,"num_write_kb":44194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'222","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:27.059176+0000","last_change":"2024-09-12T17:29:54.947947+0000","last_active":"2024-09-12T18:05:27.059176+0000","last_peered":"2024-09-12T18:05:27.059176+0000","last_clean":"2024-09-12T18:05:27.059176+0000","last_became_active":"2024-09-12T17:29:54.947659+0000","last_became_peered":"2024-09-12T17:29:54.947659+0000","last_unstale":"2024-09-12T18:05:27.059176+0000","last_undegraded":"2024-09-12T18:05:27.059176+0000","last_fullsized":"2024-09-12T18:05:27.059176+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:03.080124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":954,"num_read_kb":780,"num_write":336,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'187","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.666629+0000","last_change":"2024-09-12T17:29:52.955863+0000","last_active":"2024-09-12T18:08:03.666629+0000","last_peered":"2024-09-12T18:08:03.666629+0000","last_clean":"2024-09-12T18:08:03.666629+0000","last_became_active":"2024-09-12T17:29:52.955546+0000","last_became_peered":"2024-09-12T17:29:52.955546+0000","last_unstale":"2024-09-12T18:08:03.666629+0000","last_undegraded":"2024-09-12T18:08:03.666629+0000","last_fullsized":"2024-09-12T18:08:03.666629+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:42.412076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5712374,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":628,"num_read_kb":171668,"num_write":902,"num_write_kb":49213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'156","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.113845+0000","last_change":"2024-09-12T17:29:54.958380+0000","last_active":"2024-09-12T18:06:09.113845+0000","last_peered":"2024-09-12T18:06:09.113845+0000","last_clean":"2024-09-12T18:06:09.113845+0000","last_became_active":"2024-09-12T17:29:54.958047+0000","last_became_peered":"2024-09-12T17:29:54.958047+0000","last_unstale":"2024-09-12T18:06:09.113845+0000","last_undegraded":"2024-09-12T18:06:09.113845+0000","last_fullsized":"2024-09-12T18:06:09.113845+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:44.328756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":718,"num_read_kb":592,"num_write":271,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'177","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:24.534797+0000","last_change":"2024-09-12T17:29:52.960525+0000","last_active":"2024-09-12T18:07:24.534797+0000","last_peered":"2024-09-12T18:07:24.534797+0000","last_clean":"2024-09-12T18:07:24.534797+0000","last_became_active":"2024-09-12T17:29:52.955924+0000","last_became_peered":"2024-09-12T17:29:52.955924+0000","last_unstale":"2024-09-12T18:07:24.534797+0000","last_undegraded":"2024-09-12T18:07:24.534797+0000","last_fullsized":"2024-09-12T18:07:24.534797+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:05.866424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4131368,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":446,"num_read_kb":86465,"num_write":876,"num_write_kb":34463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'67","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.807467+0000","last_change":"2024-09-12T17:29:54.956853+0000","last_active":"2024-09-12T18:05:09.807467+0000","last_peered":"2024-09-12T18:05:09.807467+0000","last_clean":"2024-09-12T18:05:09.807467+0000","last_became_active":"2024-09-12T17:29:54.956587+0000","last_became_peered":"2024-09-12T17:29:54.956587+0000","last_unstale":"2024-09-12T18:05:09.807467+0000","last_undegraded":"2024-09-12T18:05:09.807467+0000","last_fullsized":"2024-09-12T18:05:09.807467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:30.162589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":238,"num_write":111,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'195","reported_seq":1074,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.783612+0000","last_change":"2024-09-12T17:29:52.961431+0000","last_active":"2024-09-12T18:08:03.783612+0000","last_peered":"2024-09-12T18:08:03.783612+0000","last_clean":"2024-09-12T18:08:03.783612+0000","last_became_active":"2024-09-12T17:29:52.961103+0000","last_became_peered":"2024-09-12T17:29:52.961103+0000","last_unstale":"2024-09-12T18:08:03.783612+0000","last_undegraded":"2024-09-12T18:08:03.783612+0000","last_fullsized":"2024-09-12T18:08:03.783612+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:36.469288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":61034,"num_write":905,"num_write_kb":21974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'80","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.348999+0000","last_change":"2024-09-12T17:29:54.956259+0000","last_active":"2024-09-12T18:05:57.348999+0000","last_peered":"2024-09-12T18:05:57.348999+0000","last_clean":"2024-09-12T18:05:57.348999+0000","last_became_active":"2024-09-12T17:29:54.955986+0000","last_became_peered":"2024-09-12T17:29:54.955986+0000","last_unstale":"2024-09-12T18:05:57.348999+0000","last_undegraded":"2024-09-12T18:05:57.348999+0000","last_fullsized":"2024-09-12T18:05:57.348999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:45.758007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":303,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'242","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.831288+0000","last_change":"2024-09-12T17:31:28.509450+0000","last_active":"2024-09-12T18:08:03.831288+0000","last_peered":"2024-09-12T18:08:03.831288+0000","last_clean":"2024-09-12T18:08:03.831288+0000","last_became_active":"2024-09-12T17:31:28.509017+0000","last_became_peered":"2024-09-12T17:31:28.509017+0000","last_unstale":"2024-09-12T18:08:03.831288+0000","last_undegraded":"2024-09-12T18:08:03.831288+0000","last_fullsized":"2024-09-12T18:08:03.831288+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:24.346593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9316189,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":509,"num_read_kb":51273,"num_write":1111,"num_write_kb":73287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"264'52","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.531280+0000","last_change":"2024-09-12T17:29:54.957796+0000","last_active":"2024-09-12T18:05:57.531280+0000","last_peered":"2024-09-12T18:05:57.531280+0000","last_clean":"2024-09-12T18:05:57.531280+0000","last_became_active":"2024-09-12T17:29:54.957480+0000","last_became_peered":"2024-09-12T17:29:54.957480+0000","last_unstale":"2024-09-12T18:05:57.531280+0000","last_undegraded":"2024-09-12T18:05:57.531280+0000","last_fullsized":"2024-09-12T18:05:57.531280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:21.784834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":218,"num_write":68,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'172","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.622348+0000","last_change":"2024-09-12T17:29:52.946263+0000","last_active":"2024-09-12T18:08:03.622348+0000","last_peered":"2024-09-12T18:08:03.622348+0000","last_clean":"2024-09-12T18:08:03.622348+0000","last_became_active":"2024-09-12T17:29:52.945750+0000","last_became_peered":"2024-09-12T17:29:52.945750+0000","last_unstale":"2024-09-12T18:08:03.622348+0000","last_undegraded":"2024-09-12T18:08:03.622348+0000","last_fullsized":"2024-09-12T18:08:03.622348+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:34.049238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":408,"num_read_kb":12063,"num_write":843,"num_write_kb":23165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'78","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.533490+0000","last_change":"2024-09-12T17:29:54.950489+0000","last_active":"2024-09-12T18:05:19.533490+0000","last_peered":"2024-09-12T18:05:19.533490+0000","last_clean":"2024-09-12T18:05:19.533490+0000","last_became_active":"2024-09-12T17:29:54.949704+0000","last_became_peered":"2024-09-12T17:29:54.949704+0000","last_unstale":"2024-09-12T18:05:19.533490+0000","last_undegraded":"2024-09-12T18:05:19.533490+0000","last_fullsized":"2024-09-12T18:05:19.533490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:17.371079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":312,"num_write":123,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'203","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.716814+0000","last_change":"2024-09-12T17:29:52.961104+0000","last_active":"2024-09-12T18:08:03.716814+0000","last_peered":"2024-09-12T18:08:03.716814+0000","last_clean":"2024-09-12T18:08:03.716814+0000","last_became_active":"2024-09-12T17:29:52.960336+0000","last_became_peered":"2024-09-12T17:29:52.960336+0000","last_unstale":"2024-09-12T18:08:03.716814+0000","last_undegraded":"2024-09-12T18:08:03.716814+0000","last_fullsized":"2024-09-12T18:08:03.716814+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:31.941705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524427,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":45667,"num_write":962,"num_write_kb":42266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'76","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517786+0000","last_change":"2024-09-12T17:29:54.956588+0000","last_active":"2024-09-12T18:05:19.517786+0000","last_peered":"2024-09-12T18:05:19.517786+0000","last_clean":"2024-09-12T18:05:19.517786+0000","last_became_active":"2024-09-12T17:29:54.956296+0000","last_became_peered":"2024-09-12T17:29:54.956296+0000","last_unstale":"2024-09-12T18:05:19.517786+0000","last_undegraded":"2024-09-12T18:05:19.517786+0000","last_fullsized":"2024-09-12T18:05:19.517786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:05.987373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":291,"num_write":101,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'208","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.849487+0000","last_change":"2024-09-12T17:29:52.953430+0000","last_active":"2024-09-12T18:08:03.849487+0000","last_peered":"2024-09-12T18:08:03.849487+0000","last_clean":"2024-09-12T18:08:03.849487+0000","last_became_active":"2024-09-12T17:29:52.953110+0000","last_became_peered":"2024-09-12T17:29:52.953110+0000","last_unstale":"2024-09-12T18:08:03.849487+0000","last_undegraded":"2024-09-12T18:08:03.849487+0000","last_fullsized":"2024-09-12T18:08:03.849487+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:17.347005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":64382,"num_write":937,"num_write_kb":39967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'142","reported_seq":727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:06.024368+0000","last_change":"2024-09-12T17:29:54.945058+0000","last_active":"2024-09-12T18:06:06.024368+0000","last_peered":"2024-09-12T18:06:06.024368+0000","last_clean":"2024-09-12T18:06:06.024368+0000","last_became_active":"2024-09-12T17:29:54.944775+0000","last_became_peered":"2024-09-12T17:29:54.944775+0000","last_unstale":"2024-09-12T18:06:06.024368+0000","last_undegraded":"2024-09-12T18:06:06.024368+0000","last_fullsized":"2024-09-12T18:06:06.024368+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:36.057705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":576,"num_read_kb":470,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'239","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.847752+0000","last_change":"2024-09-12T17:29:52.953267+0000","last_active":"2024-09-12T18:08:03.847752+0000","last_peered":"2024-09-12T18:08:03.847752+0000","last_clean":"2024-09-12T18:08:03.847752+0000","last_became_active":"2024-09-12T17:29:52.952892+0000","last_became_peered":"2024-09-12T17:29:52.952892+0000","last_unstale":"2024-09-12T18:08:03.847752+0000","last_undegraded":"2024-09-12T18:08:03.847752+0000","last_fullsized":"2024-09-12T18:08:03.847752+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:09.264458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1423505,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":801,"num_read_kb":90532,"num_write":1295,"num_write_kb":28113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'4190","reported_seq":4816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.965248+0000","last_change":"2024-09-12T17:29:54.956378+0000","last_active":"2024-09-12T18:06:01.965248+0000","last_peered":"2024-09-12T18:06:01.965248+0000","last_clean":"2024-09-12T18:06:01.965248+0000","last_became_active":"2024-09-12T17:29:54.956030+0000","last_became_peered":"2024-09-12T17:29:54.956030+0000","last_unstale":"2024-09-12T18:06:01.965248+0000","last_undegraded":"2024-09-12T18:06:01.965248+0000","last_fullsized":"2024-09-12T18:06:01.965248+0000","mapping_epoch":26,"log_start":"264'4100","ondisk_log_start":"264'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":3000,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:59.132944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16971,"num_read_kb":14174,"num_write":6344,"num_write_kb":3204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'200","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.840293+0000","last_change":"2024-09-12T17:29:52.955756+0000","last_active":"2024-09-12T18:08:03.840293+0000","last_peered":"2024-09-12T18:08:03.840293+0000","last_clean":"2024-09-12T18:08:03.840293+0000","last_became_active":"2024-09-12T17:29:52.953694+0000","last_became_peered":"2024-09-12T17:29:52.953694+0000","last_unstale":"2024-09-12T18:08:03.840293+0000","last_undegraded":"2024-09-12T18:08:03.840293+0000","last_fullsized":"2024-09-12T18:08:03.840293+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:25.200873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174802,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":9241,"num_write":950,"num_write_kb":54194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'298","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.645212+0000","last_change":"2024-09-12T17:29:54.954876+0000","last_active":"2024-09-12T18:05:55.645212+0000","last_peered":"2024-09-12T18:05:55.645212+0000","last_clean":"2024-09-12T18:05:55.645212+0000","last_became_active":"2024-09-12T17:29:54.954593+0000","last_became_peered":"2024-09-12T17:29:54.954593+0000","last_unstale":"2024-09-12T18:05:55.645212+0000","last_undegraded":"2024-09-12T18:05:55.645212+0000","last_fullsized":"2024-09-12T18:05:55.645212+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:15.447562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1407,"num_read_kb":1154,"num_write":474,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'211","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.626017+0000","last_change":"2024-09-12T17:29:52.959010+0000","last_active":"2024-09-12T18:08:03.626017+0000","last_peered":"2024-09-12T18:08:03.626017+0000","last_clean":"2024-09-12T18:08:03.626017+0000","last_became_active":"2024-09-12T17:29:52.958021+0000","last_became_peered":"2024-09-12T17:29:52.958021+0000","last_unstale":"2024-09-12T18:08:03.626017+0000","last_undegraded":"2024-09-12T18:08:03.626017+0000","last_fullsized":"2024-09-12T18:08:03.626017+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:23.137050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174726,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":543,"num_read_kb":26305,"num_write":962,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'301","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:12.095784+0000","last_change":"2024-09-12T17:29:54.957925+0000","last_active":"2024-09-12T18:05:12.095784+0000","last_peered":"2024-09-12T18:05:12.095784+0000","last_clean":"2024-09-12T18:05:12.095784+0000","last_became_active":"2024-09-12T17:29:54.957636+0000","last_became_peered":"2024-09-12T17:29:54.957636+0000","last_unstale":"2024-09-12T18:05:12.095784+0000","last_undegraded":"2024-09-12T18:05:12.095784+0000","last_fullsized":"2024-09-12T18:05:12.095784+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:31.541263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1037,"num_write":475,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'227","reported_seq":870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.622639+0000","last_change":"2024-09-12T17:29:52.966860+0000","last_active":"2024-09-12T18:08:03.622639+0000","last_peered":"2024-09-12T18:08:03.622639+0000","last_clean":"2024-09-12T18:08:03.622639+0000","last_became_active":"2024-09-12T17:29:52.966500+0000","last_became_peered":"2024-09-12T17:29:52.966500+0000","last_unstale":"2024-09-12T18:08:03.622639+0000","last_undegraded":"2024-09-12T18:08:03.622639+0000","last_fullsized":"2024-09-12T18:08:03.622639+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:52.632541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254282,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":515,"num_read_kb":34941,"num_write":1118,"num_write_kb":28764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'173","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.713791+0000","last_change":"2024-09-12T17:30:28.010302+0000","last_active":"2024-09-12T18:06:07.713791+0000","last_peered":"2024-09-12T18:06:07.713791+0000","last_clean":"2024-09-12T18:06:07.713791+0000","last_became_active":"2024-09-12T17:30:28.010055+0000","last_became_peered":"2024-09-12T17:30:28.010055+0000","last_unstale":"2024-09-12T18:06:07.713791+0000","last_undegraded":"2024-09-12T18:06:07.713791+0000","last_fullsized":"2024-09-12T18:06:07.713791+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:49.191682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":614,"num_write":281,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'200","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.862568+0000","last_change":"2024-09-12T17:29:52.954562+0000","last_active":"2024-09-12T18:08:03.862568+0000","last_peered":"2024-09-12T18:08:03.862568+0000","last_clean":"2024-09-12T18:08:03.862568+0000","last_became_active":"2024-09-12T17:29:52.954238+0000","last_became_peered":"2024-09-12T17:29:52.954238+0000","last_unstale":"2024-09-12T18:08:03.862568+0000","last_undegraded":"2024-09-12T18:08:03.862568+0000","last_fullsized":"2024-09-12T18:08:03.862568+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:31.094284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":33290,"num_write":857,"num_write_kb":39696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'173","reported_seq":736,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.661699+0000","last_change":"2024-09-12T17:29:54.944911+0000","last_active":"2024-09-12T18:06:08.661699+0000","last_peered":"2024-09-12T18:06:08.661699+0000","last_clean":"2024-09-12T18:06:08.661699+0000","last_became_active":"2024-09-12T17:29:54.944623+0000","last_became_peered":"2024-09-12T17:29:54.944623+0000","last_unstale":"2024-09-12T18:06:08.661699+0000","last_undegraded":"2024-09-12T18:06:08.661699+0000","last_fullsized":"2024-09-12T18:06:08.661699+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:42.419447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":587,"num_write":256,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'218","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.781454+0000","last_change":"2024-09-12T17:29:52.952178+0000","last_active":"2024-09-12T18:08:03.781454+0000","last_peered":"2024-09-12T18:08:03.781454+0000","last_clean":"2024-09-12T18:08:03.781454+0000","last_became_active":"2024-09-12T17:29:52.951819+0000","last_became_peered":"2024-09-12T17:29:52.951819+0000","last_unstale":"2024-09-12T18:08:03.781454+0000","last_undegraded":"2024-09-12T18:08:03.781454+0000","last_fullsized":"2024-09-12T18:08:03.781454+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:53.052744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287564,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":4445,"num_write":1040,"num_write_kb":38455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'247","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:02.429830+0000","last_change":"2024-09-12T17:29:54.952227+0000","last_active":"2024-09-12T18:06:02.429830+0000","last_peered":"2024-09-12T18:06:02.429830+0000","last_clean":"2024-09-12T18:06:02.429830+0000","last_became_active":"2024-09-12T17:29:54.950941+0000","last_became_peered":"2024-09-12T17:29:54.950941+0000","last_unstale":"2024-09-12T18:06:02.429830+0000","last_undegraded":"2024-09-12T18:06:02.429830+0000","last_fullsized":"2024-09-12T18:06:02.429830+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:47.854196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":842,"num_write":398,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'207","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.713015+0000","last_change":"2024-09-12T17:29:52.953913+0000","last_active":"2024-09-12T18:08:03.713015+0000","last_peered":"2024-09-12T18:08:03.713015+0000","last_clean":"2024-09-12T18:08:03.713015+0000","last_became_active":"2024-09-12T17:29:52.953569+0000","last_became_peered":"2024-09-12T17:29:52.953569+0000","last_unstale":"2024-09-12T18:08:03.713015+0000","last_undegraded":"2024-09-12T18:08:03.713015+0000","last_fullsized":"2024-09-12T18:08:03.713015+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:45.959383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":380,"num_read_kb":11537,"num_write":1039,"num_write_kb":39628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'119","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.659784+0000","last_change":"2024-09-12T17:29:54.961906+0000","last_active":"2024-09-12T18:05:52.659784+0000","last_peered":"2024-09-12T18:05:52.659784+0000","last_clean":"2024-09-12T18:05:52.659784+0000","last_became_active":"2024-09-12T17:29:54.961615+0000","last_became_peered":"2024-09-12T17:29:54.961615+0000","last_unstale":"2024-09-12T18:05:52.659784+0000","last_undegraded":"2024-09-12T18:05:52.659784+0000","last_fullsized":"2024-09-12T18:05:52.659784+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:47.744907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":544,"num_read_kb":456,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'264","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.777269+0000","last_change":"2024-09-12T17:29:52.956926+0000","last_active":"2024-09-12T18:08:03.777269+0000","last_peered":"2024-09-12T18:08:03.777269+0000","last_clean":"2024-09-12T18:08:03.777269+0000","last_became_active":"2024-09-12T17:29:52.954363+0000","last_became_peered":"2024-09-12T17:29:52.954363+0000","last_unstale":"2024-09-12T18:08:03.777269+0000","last_undegraded":"2024-09-12T18:08:03.777269+0000","last_fullsized":"2024-09-12T18:08:03.777269+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:03.699758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505373,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":610,"num_read_kb":60789,"num_write":1183,"num_write_kb":24093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'153","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.861266+0000","last_change":"2024-09-12T17:29:52.953182+0000","last_active":"2024-09-12T18:08:03.861266+0000","last_peered":"2024-09-12T18:08:03.861266+0000","last_clean":"2024-09-12T18:08:03.861266+0000","last_became_active":"2024-09-12T17:29:52.952766+0000","last_became_peered":"2024-09-12T17:29:52.952766+0000","last_unstale":"2024-09-12T18:08:03.861266+0000","last_undegraded":"2024-09-12T18:08:03.861266+0000","last_fullsized":"2024-09-12T18:08:03.861266+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:33.543180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847564,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":395,"num_read_kb":30421,"num_write":779,"num_write_kb":28733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'81","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.545153+0000","last_change":"2024-09-12T17:29:54.944959+0000","last_active":"2024-09-12T18:05:52.545153+0000","last_peered":"2024-09-12T18:05:52.545153+0000","last_clean":"2024-09-12T18:05:52.545153+0000","last_became_active":"2024-09-12T17:29:54.944681+0000","last_became_peered":"2024-09-12T17:29:54.944681+0000","last_unstale":"2024-09-12T18:05:52.545153+0000","last_undegraded":"2024-09-12T18:05:52.545153+0000","last_fullsized":"2024-09-12T18:05:52.545153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:39.628805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":330,"num_write":124,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'186","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.662048+0000","last_change":"2024-09-12T17:29:52.942936+0000","last_active":"2024-09-12T18:07:14.662048+0000","last_peered":"2024-09-12T18:07:14.662048+0000","last_clean":"2024-09-12T18:07:14.662048+0000","last_became_active":"2024-09-12T17:29:52.942331+0000","last_became_peered":"2024-09-12T17:29:52.942331+0000","last_unstale":"2024-09-12T18:07:14.662048+0000","last_undegraded":"2024-09-12T18:07:14.662048+0000","last_fullsized":"2024-09-12T18:07:14.662048+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.925466+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.925466+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:29.868639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364835,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":15046,"num_write":966,"num_write_kb":38540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'194","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.022497+0000","last_change":"2024-09-12T17:29:54.963259+0000","last_active":"2024-09-12T18:05:56.022497+0000","last_peered":"2024-09-12T18:05:56.022497+0000","last_clean":"2024-09-12T18:05:56.022497+0000","last_became_active":"2024-09-12T17:29:54.962921+0000","last_became_peered":"2024-09-12T17:29:54.962921+0000","last_unstale":"2024-09-12T18:05:56.022497+0000","last_undegraded":"2024-09-12T18:05:56.022497+0000","last_fullsized":"2024-09-12T18:05:56.022497+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:02.447215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":851,"num_read_kb":702,"num_write":304,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":4389,"num_write":1992,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1063,"ondisk_log_size":1063,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":16199,"num_read_kb":15887,"num_write":16770,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1852,"ondisk_log_size":1852,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":495,"ondisk_log_size":495,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":279568,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7821,"num_read_kb":9826,"num_write":5191,"num_write_kb":2504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2027,"ondisk_log_size":2027,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2870,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102452,"num_read_kb":85292,"num_write":37168,"num_write_kb":18720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4224,"ondisk_log_size":4224,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":83899209,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":32969,"num_read_kb":2424206,"num_write":62978,"num_write_kb":2261412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127942656,"data_stored":127942656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4263,"ondisk_log_size":4263,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":207617,"num_write":161,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":201926,"num_write":161,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542611,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276232,"kb_used_data":56216,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94095608,"statfs":{"total":96636764160,"available":96353902592,"internally_reserved":0,"allocated":57565184,"data_stored":55547828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542610,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":240060,"kb_used_data":20032,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94131780,"statfs":{"total":96636764160,"available":96390942720,"internally_reserved":0,"allocated":20512768,"data_stored":18573799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542612,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252852,"kb_used_data":159268,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94118988,"statfs":{"total":96636764160,"available":96377843712,"internally_reserved":0,"allocated":163090432,"data_stored":161046070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542611,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164624,"kb_used_data":97340,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94207216,"statfs":{"total":96636764160,"available":96468189184,"internally_reserved":0,"allocated":99676160,"data_stored":97759844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542609,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249540,"kb_used_data":19756,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122300,"statfs":{"total":96636764160,"available":96381235200,"internally_reserved":0,"allocated":20230144,"data_stored":18248382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542610,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100688,"kb_used_data":15400,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94271152,"statfs":{"total":96636764160,"available":96533659648,"internally_reserved":0,"allocated":15769600,"data_stored":13844138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542611,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121068,"kb_used_data":13588,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94250772,"statfs":{"total":96636764160,"available":96512790528,"internally_reserved":0,"allocated":13914112,"data_stored":11951207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542610,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262528,"kb_used_data":24452,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94109312,"statfs":{"total":96636764160,"available":96367935488,"internally_reserved":0,"allocated":25038848,"data_stored":23061641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20193280,"data_stored":20193280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9674752,"data_stored":9674752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11567104,"data_stored":11567104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15970304,"data_stored":15970304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22704128,"data_stored":22704128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25698304,"data_stored":25698304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16297984,"data_stored":16297984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5836800,"data_stored":5836800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:08:10.485 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.486 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.486 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.486 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.486 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.486 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.486 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.486 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.486 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.487 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.487 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.487 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.487 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.487 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.488 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.488 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.488 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.488 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.488 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.488 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.488 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.488 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.488 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.489 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.489 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.489 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.489 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.489 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.489 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.489 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.489 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.489 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.490 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.490 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.490 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.490 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.490 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.490 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.490 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.491 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.491 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.491 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.491 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.491 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.491 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.491 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.491 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.491 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.492 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.492 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.492 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.492 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.492 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.492 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.492 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.492 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.492 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.493 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.493 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.493 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.493 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.493 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.493 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.493 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.493 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.493 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.494 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.494 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.494 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.494 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.494 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.494 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.494 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.494 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.494 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.495 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.495 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.495 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.495 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.495 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.495 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.495 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.495 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.495 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.496 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.496 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.496 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.496 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.496 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.496 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.496 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.496 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.496 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.497 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.497 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.497 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.497 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.497 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.497 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.497 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.497 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.497 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.498 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.498 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.498 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.498 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.498 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.498 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.498 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.498 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.498 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.499 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.499 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.499 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.499 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.499 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.499 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.499 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.499 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.499 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.500 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.500 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.500 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.500 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.500 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.500 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.500 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.500 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.500 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.501 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.501 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.501 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.501 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.501 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.501 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.501 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.501 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.501 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.502 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.502 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.502 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.502 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.502 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.502 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.502 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.502 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.503 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.503 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.503 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.503 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.503 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.503 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.503 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.503 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.503 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.504 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.504 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.504 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.504 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.504 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.504 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.504 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.504 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.504 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.504 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.505 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.505 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.505 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.505 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.505 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.505 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.505 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.505 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.506 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.506 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.506 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.506 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.506 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.506 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.506 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.506 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.506 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.507 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.507 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.507 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.507 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.507 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.507 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.507 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.507 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.507 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.508 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.508 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.508 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.508 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.508 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.508 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.508 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.508 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.508 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.509 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.509 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.509 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.509 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.509 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.509 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.509 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.509 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.509 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.509 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.510 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.510 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.510 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.510 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.510 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.510 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.510 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.510 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.510 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.511 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.511 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.511 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.511 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.511 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.511 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.511 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.511 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.511 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.512 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.512 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T17:29:34.896766+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.512 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T17:29:40.946896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.512 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.512 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.512 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.512 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.512 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.512 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.513 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T17:29:40.946896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.513 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.513 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.513 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.513 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.513 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.513 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.513 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T17:29:40.946896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.513 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.514 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.514 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.514 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.514 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.514 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.514 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T17:29:40.946896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.514 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.514 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.514 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.515 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.515 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.515 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.515 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.515 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T17:29:40.946896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.515 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.515 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.515 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.515 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.516 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.516 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.516 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T17:29:40.946896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.516 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.516 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.516 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.516 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.516 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.516 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.517 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T17:29:40.946896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.517 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.517 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.517 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.517 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.517 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.517 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.517 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T17:29:40.946896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.517 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.518 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.518 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.518 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.518 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.518 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.518 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.518 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.518 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.518 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.519 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.519 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.519 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.519 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.519 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.519 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.519 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.519 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.519 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.520 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.520 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.520 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.520 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.520 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.520 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.520 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.522 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.522 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.522 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.523 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.523 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.523 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.523 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.523 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.523 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.523 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.523 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.523 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.524 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.524 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.524 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.524 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.524 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.524 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.524 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.524 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.525 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.525 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.525 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.525 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.525 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.525 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.525 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.525 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.525 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.526 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.526 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.526 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.526 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.526 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.526 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.526 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.526 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.527 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.527 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.527 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.527 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.527 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.527 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.527 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.527 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.528 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.528 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.528 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.528 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.528 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.528 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.528 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.528 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.528 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.529 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.529 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.529 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.529 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.529 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.529 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.529 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.529 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.529 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.530 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.530 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.530 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.530 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.530 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.530 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.530 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.530 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.531 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.531 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.531 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.531 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.531 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.531 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.531 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.531 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.531 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.531 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.532 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.532 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.532 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.532 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:29:51.925466+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.532 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:10.532 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:08:30.534 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:08:30.867 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:08:30.878 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-09-12T18:08:30.880 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":1424,"stamp":"2024-09-12T18:08:29.293254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84787076,"num_objects":562,"num_object_clones":0,"num_object_copies":1357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":562,"num_whiteouts":0,"num_read":168345,"num_read_kb":2952080,"num_write":124562,"num_write_kb":2564884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":40407,"num_omap_keys":164,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14237,"ondisk_log_size":14237,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1428832,"kb_used_data":159200,"kb_used_omap":12,"kb_used_meta":1269491,"kb_avail":753545888,"statfs":{"total":773094113280,"available":771630989312,"internally_reserved":0,"allocated":163020800,"data_stored":147336250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1299959346},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36405,"num_omap_keys":146,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005075"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.634310+0000","last_change":"2024-09-12T17:57:00.464809+0000","last_active":"2024-09-12T18:04:29.634310+0000","last_peered":"2024-09-12T18:04:29.634310+0000","last_clean":"2024-09-12T18:04:29.634310+0000","last_became_active":"2024-09-12T17:57:00.464331+0000","last_became_peered":"2024-09-12T17:57:00.464331+0000","last_unstale":"2024-09-12T18:04:29.634310+0000","last_undegraded":"2024-09-12T18:04:29.634310+0000","last_fullsized":"2024-09-12T18:04:29.634310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:20.663580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.631990+0000","last_change":"2024-09-12T17:46:45.211816+0000","last_active":"2024-09-12T18:04:14.631990+0000","last_peered":"2024-09-12T18:04:14.631990+0000","last_clean":"2024-09-12T18:04:14.631990+0000","last_became_active":"2024-09-12T17:46:45.211533+0000","last_became_peered":"2024-09-12T17:46:45.211533+0000","last_unstale":"2024-09-12T18:04:14.631990+0000","last_undegraded":"2024-09-12T18:04:14.631990+0000","last_fullsized":"2024-09-12T18:04:14.631990+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:29.748663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.792520+0000","last_change":"2024-09-12T17:46:42.179842+0000","last_active":"2024-09-12T18:08:03.792520+0000","last_peered":"2024-09-12T18:08:03.792520+0000","last_clean":"2024-09-12T18:08:03.792520+0000","last_became_active":"2024-09-12T17:46:42.179372+0000","last_became_peered":"2024-09-12T17:46:42.179372+0000","last_unstale":"2024-09-12T18:08:03.792520+0000","last_undegraded":"2024-09-12T18:08:03.792520+0000","last_fullsized":"2024-09-12T18:08:03.792520+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:29.561145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6715,"num_write":5,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'32","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.172145+0000","last_change":"2024-09-12T17:45:03.890371+0000","last_active":"2024-09-12T18:05:55.172145+0000","last_peered":"2024-09-12T18:05:55.172145+0000","last_clean":"2024-09-12T18:05:55.172145+0000","last_became_active":"2024-09-12T17:45:03.890104+0000","last_became_peered":"2024-09-12T17:45:03.890104+0000","last_unstale":"2024-09-12T18:05:55.172145+0000","last_undegraded":"2024-09-12T18:05:55.172145+0000","last_fullsized":"2024-09-12T18:05:55.172145+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:20.406460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":111,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.637454+0000","last_change":"2024-09-12T17:57:00.466568+0000","last_active":"2024-09-12T18:04:29.637454+0000","last_peered":"2024-09-12T18:04:29.637454+0000","last_clean":"2024-09-12T18:04:29.637454+0000","last_became_active":"2024-09-12T17:57:00.466304+0000","last_became_peered":"2024-09-12T17:57:00.466304+0000","last_unstale":"2024-09-12T18:04:29.637454+0000","last_undegraded":"2024-09-12T18:04:29.637454+0000","last_fullsized":"2024-09-12T18:04:29.637454+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:52.603747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:44.529464+0000","last_change":"2024-09-12T17:46:45.202607+0000","last_active":"2024-09-12T18:06:44.529464+0000","last_peered":"2024-09-12T18:06:44.529464+0000","last_clean":"2024-09-12T18:06:44.529464+0000","last_became_active":"2024-09-12T17:46:45.202290+0000","last_became_peered":"2024-09-12T17:46:45.202290+0000","last_unstale":"2024-09-12T18:06:44.529464+0000","last_undegraded":"2024-09-12T18:06:44.529464+0000","last_fullsized":"2024-09-12T18:06:44.529464+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:30.467678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'8","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.682176+0000","last_change":"2024-09-12T17:46:42.177978+0000","last_active":"2024-09-12T18:08:03.682176+0000","last_peered":"2024-09-12T18:08:03.682176+0000","last_clean":"2024-09-12T18:08:03.682176+0000","last_became_active":"2024-09-12T17:46:42.177112+0000","last_became_peered":"2024-09-12T17:46:42.177112+0000","last_unstale":"2024-09-12T18:08:03.682176+0000","last_undegraded":"2024-09-12T18:08:03.682176+0000","last_fullsized":"2024-09-12T18:08:03.682176+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:37.077362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10811,"num_write":18,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'16","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.642269+0000","last_change":"2024-09-12T17:45:03.893271+0000","last_active":"2024-09-12T18:05:04.642269+0000","last_peered":"2024-09-12T18:05:04.642269+0000","last_clean":"2024-09-12T18:05:04.642269+0000","last_became_active":"2024-09-12T17:45:03.893002+0000","last_became_peered":"2024-09-12T17:45:03.893002+0000","last_unstale":"2024-09-12T18:05:04.642269+0000","last_undegraded":"2024-09-12T18:05:04.642269+0000","last_fullsized":"2024-09-12T18:05:04.642269+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:22.163418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508520+0000","last_change":"2024-09-12T17:57:00.457762+0000","last_active":"2024-09-12T18:04:14.508520+0000","last_peered":"2024-09-12T18:04:14.508520+0000","last_clean":"2024-09-12T18:04:14.508520+0000","last_became_active":"2024-09-12T17:57:00.456939+0000","last_became_peered":"2024-09-12T17:57:00.456939+0000","last_unstale":"2024-09-12T18:04:14.508520+0000","last_undegraded":"2024-09-12T18:04:14.508520+0000","last_fullsized":"2024-09-12T18:04:14.508520+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:16.042163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'10","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.760358+0000","last_change":"2024-09-12T17:46:45.537660+0000","last_active":"2024-09-12T18:08:03.760358+0000","last_peered":"2024-09-12T18:08:03.760358+0000","last_clean":"2024-09-12T18:08:03.760358+0000","last_became_active":"2024-09-12T17:46:45.536920+0000","last_became_peered":"2024-09-12T17:46:45.536920+0000","last_unstale":"2024-09-12T18:08:03.760358+0000","last_undegraded":"2024-09-12T18:08:03.760358+0000","last_fullsized":"2024-09-12T18:08:03.760358+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.487169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":15,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639526+0000","last_change":"2024-09-12T17:46:42.186263+0000","last_active":"2024-09-12T18:04:44.639526+0000","last_peered":"2024-09-12T18:04:44.639526+0000","last_clean":"2024-09-12T18:04:44.639526+0000","last_became_active":"2024-09-12T17:46:42.185870+0000","last_became_peered":"2024-09-12T17:46:42.185870+0000","last_unstale":"2024-09-12T18:04:44.639526+0000","last_undegraded":"2024-09-12T18:04:44.639526+0000","last_fullsized":"2024-09-12T18:04:44.639526+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:49.932340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'49","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644429+0000","last_change":"2024-09-12T17:45:03.895036+0000","last_active":"2024-09-12T18:05:04.644429+0000","last_peered":"2024-09-12T18:05:04.644429+0000","last_clean":"2024-09-12T18:05:04.644429+0000","last_became_active":"2024-09-12T17:45:03.894537+0000","last_became_peered":"2024-09-12T17:45:03.894537+0000","last_unstale":"2024-09-12T18:05:04.644429+0000","last_undegraded":"2024-09-12T18:05:04.644429+0000","last_fullsized":"2024-09-12T18:05:04.644429+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:15.446699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":186,"num_write":90,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:19.519960+0000","last_change":"2024-09-12T17:57:00.465664+0000","last_active":"2024-09-12T18:04:19.519960+0000","last_peered":"2024-09-12T18:04:19.519960+0000","last_clean":"2024-09-12T18:04:19.519960+0000","last_became_active":"2024-09-12T17:57:00.464157+0000","last_became_peered":"2024-09-12T17:57:00.464157+0000","last_unstale":"2024-09-12T18:04:19.519960+0000","last_undegraded":"2024-09-12T18:04:19.519960+0000","last_fullsized":"2024-09-12T18:04:19.519960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:27.777117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.524896+0000","last_change":"2024-09-12T17:46:45.538613+0000","last_active":"2024-09-12T18:04:49.524896+0000","last_peered":"2024-09-12T18:04:49.524896+0000","last_clean":"2024-09-12T18:04:49.524896+0000","last_became_active":"2024-09-12T17:46:45.538295+0000","last_became_peered":"2024-09-12T17:46:45.538295+0000","last_unstale":"2024-09-12T18:04:49.524896+0000","last_undegraded":"2024-09-12T18:04:49.524896+0000","last_fullsized":"2024-09-12T18:04:49.524896+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:12.638632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519162+0000","last_change":"2024-09-12T17:46:42.184099+0000","last_active":"2024-09-12T18:05:29.519162+0000","last_peered":"2024-09-12T18:05:29.519162+0000","last_clean":"2024-09-12T18:05:29.519162+0000","last_became_active":"2024-09-12T17:46:42.183792+0000","last_became_peered":"2024-09-12T17:46:42.183792+0000","last_unstale":"2024-09-12T18:05:29.519162+0000","last_undegraded":"2024-09-12T18:05:29.519162+0000","last_fullsized":"2024-09-12T18:05:29.519162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:38.522171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'18","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527497+0000","last_change":"2024-09-12T17:45:03.893407+0000","last_active":"2024-09-12T18:05:04.527497+0000","last_peered":"2024-09-12T18:05:04.527497+0000","last_clean":"2024-09-12T18:05:04.527497+0000","last_became_active":"2024-09-12T17:45:03.893108+0000","last_became_peered":"2024-09-12T17:45:03.893108+0000","last_unstale":"2024-09-12T18:05:04.527497+0000","last_undegraded":"2024-09-12T18:05:04.527497+0000","last_fullsized":"2024-09-12T18:05:04.527497+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:43.333855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":71,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527532+0000","last_change":"2024-09-12T17:57:00.463065+0000","last_active":"2024-09-12T18:05:04.527532+0000","last_peered":"2024-09-12T18:05:04.527532+0000","last_clean":"2024-09-12T18:05:04.527532+0000","last_became_active":"2024-09-12T17:57:00.462657+0000","last_became_peered":"2024-09-12T17:57:00.462657+0000","last_unstale":"2024-09-12T18:05:04.527532+0000","last_undegraded":"2024-09-12T18:05:04.527532+0000","last_fullsized":"2024-09-12T18:05:04.527532+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:24.423220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.649088+0000","last_change":"2024-09-12T17:46:45.210708+0000","last_active":"2024-09-12T18:06:09.649088+0000","last_peered":"2024-09-12T18:06:09.649088+0000","last_clean":"2024-09-12T18:06:09.649088+0000","last_became_active":"2024-09-12T17:46:45.210259+0000","last_became_peered":"2024-09-12T17:46:45.210259+0000","last_unstale":"2024-09-12T18:06:09.649088+0000","last_undegraded":"2024-09-12T18:06:09.649088+0000","last_fullsized":"2024-09-12T18:06:09.649088+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:01.331182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6189,"num_write":4,"num_write_kb":3117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.630954+0000","last_change":"2024-09-12T17:46:42.179361+0000","last_active":"2024-09-12T18:03:39.630954+0000","last_peered":"2024-09-12T18:03:39.630954+0000","last_clean":"2024-09-12T18:03:39.630954+0000","last_became_active":"2024-09-12T17:46:42.178782+0000","last_became_peered":"2024-09-12T17:46:42.178782+0000","last_unstale":"2024-09-12T18:03:39.630954+0000","last_undegraded":"2024-09-12T18:03:39.630954+0000","last_fullsized":"2024-09-12T18:03:39.630954+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:21.705278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'101","reported_seq":355,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.903517+0000","last_change":"2024-09-12T17:45:03.899922+0000","last_active":"2024-09-12T18:05:56.903517+0000","last_peered":"2024-09-12T18:05:56.903517+0000","last_clean":"2024-09-12T18:05:56.903517+0000","last_became_active":"2024-09-12T17:45:03.899635+0000","last_became_peered":"2024-09-12T17:45:03.899635+0000","last_unstale":"2024-09-12T18:05:56.903517+0000","last_undegraded":"2024-09-12T18:05:56.903517+0000","last_fullsized":"2024-09-12T18:05:56.903517+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:27.634887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":455,"num_write":132,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646813+0000","last_change":"2024-09-12T17:57:00.462866+0000","last_active":"2024-09-12T18:05:19.646813+0000","last_peered":"2024-09-12T18:05:19.646813+0000","last_clean":"2024-09-12T18:05:19.646813+0000","last_became_active":"2024-09-12T17:57:00.462532+0000","last_became_peered":"2024-09-12T17:57:00.462532+0000","last_unstale":"2024-09-12T18:05:19.646813+0000","last_undegraded":"2024-09-12T18:05:19.646813+0000","last_fullsized":"2024-09-12T18:05:19.646813+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:39.678951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.503221+0000","last_change":"2024-09-12T17:47:29.324227+0000","last_active":"2024-09-12T18:03:39.503221+0000","last_peered":"2024-09-12T18:03:39.503221+0000","last_clean":"2024-09-12T18:03:39.503221+0000","last_became_active":"2024-09-12T17:47:29.305275+0000","last_became_peered":"2024-09-12T17:47:29.305275+0000","last_unstale":"2024-09-12T18:03:39.503221+0000","last_undegraded":"2024-09-12T18:03:39.503221+0000","last_fullsized":"2024-09-12T18:03:39.503221+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:21.892809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.524329+0000","last_change":"2024-09-12T17:46:42.183120+0000","last_active":"2024-09-12T18:06:09.524329+0000","last_peered":"2024-09-12T18:06:09.524329+0000","last_clean":"2024-09-12T18:06:09.524329+0000","last_became_active":"2024-09-12T17:46:42.182797+0000","last_became_peered":"2024-09-12T17:46:42.182797+0000","last_unstale":"2024-09-12T18:06:09.524329+0000","last_undegraded":"2024-09-12T18:06:09.524329+0000","last_fullsized":"2024-09-12T18:06:09.524329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:02.336324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.192756+0000","last_change":"2024-09-12T17:45:03.900065+0000","last_active":"2024-09-12T18:05:57.192756+0000","last_peered":"2024-09-12T18:05:57.192756+0000","last_clean":"2024-09-12T18:05:57.192756+0000","last_became_active":"2024-09-12T17:45:03.899684+0000","last_became_peered":"2024-09-12T17:45:03.899684+0000","last_unstale":"2024-09-12T18:05:57.192756+0000","last_undegraded":"2024-09-12T18:05:57.192756+0000","last_fullsized":"2024-09-12T18:05:57.192756+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:45.656746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.676639+0000","last_change":"2024-09-12T17:57:00.464844+0000","last_active":"2024-09-12T18:04:29.676639+0000","last_peered":"2024-09-12T18:04:29.676639+0000","last_clean":"2024-09-12T18:04:29.676639+0000","last_became_active":"2024-09-12T17:57:00.464581+0000","last_became_peered":"2024-09-12T17:57:00.464581+0000","last_unstale":"2024-09-12T18:04:29.676639+0000","last_undegraded":"2024-09-12T18:04:29.676639+0000","last_fullsized":"2024-09-12T18:04:29.676639+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:41.808967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508601+0000","last_change":"2024-09-12T17:46:45.208867+0000","last_active":"2024-09-12T18:04:14.508601+0000","last_peered":"2024-09-12T18:04:14.508601+0000","last_clean":"2024-09-12T18:04:14.508601+0000","last_became_active":"2024-09-12T17:46:45.208580+0000","last_became_peered":"2024-09-12T17:46:45.208580+0000","last_unstale":"2024-09-12T18:04:14.508601+0000","last_undegraded":"2024-09-12T18:04:14.508601+0000","last_fullsized":"2024-09-12T18:04:14.508601+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:28.654102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508572+0000","last_change":"2024-09-12T17:46:42.182258+0000","last_active":"2024-09-12T18:04:14.508572+0000","last_peered":"2024-09-12T18:04:14.508572+0000","last_clean":"2024-09-12T18:04:14.508572+0000","last_became_active":"2024-09-12T17:46:42.181972+0000","last_became_peered":"2024-09-12T17:46:42.181972+0000","last_unstale":"2024-09-12T18:04:14.508572+0000","last_undegraded":"2024-09-12T18:04:14.508572+0000","last_fullsized":"2024-09-12T18:04:14.508572+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:16.906107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637435+0000","last_change":"2024-09-12T17:45:03.900188+0000","last_active":"2024-09-12T18:04:24.637435+0000","last_peered":"2024-09-12T18:04:24.637435+0000","last_clean":"2024-09-12T18:04:24.637435+0000","last_became_active":"2024-09-12T17:45:03.899876+0000","last_became_peered":"2024-09-12T17:45:03.899876+0000","last_unstale":"2024-09-12T18:04:24.637435+0000","last_undegraded":"2024-09-12T18:04:24.637435+0000","last_fullsized":"2024-09-12T18:04:24.637435+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:14.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.676688+0000","last_change":"2024-09-12T17:57:00.467655+0000","last_active":"2024-09-12T18:04:29.676688+0000","last_peered":"2024-09-12T18:04:29.676688+0000","last_clean":"2024-09-12T18:04:29.676688+0000","last_became_active":"2024-09-12T17:57:00.467385+0000","last_became_peered":"2024-09-12T17:57:00.467385+0000","last_unstale":"2024-09-12T18:04:29.676688+0000","last_undegraded":"2024-09-12T18:04:29.676688+0000","last_fullsized":"2024-09-12T18:04:29.676688+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:10.181468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519179+0000","last_change":"2024-09-12T17:46:45.206159+0000","last_active":"2024-09-12T18:04:14.519179+0000","last_peered":"2024-09-12T18:04:14.519179+0000","last_clean":"2024-09-12T18:04:14.519179+0000","last_became_active":"2024-09-12T17:46:45.205742+0000","last_became_peered":"2024-09-12T17:46:45.205742+0000","last_unstale":"2024-09-12T18:04:14.519179+0000","last_undegraded":"2024-09-12T18:04:14.519179+0000","last_fullsized":"2024-09-12T18:04:14.519179+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:07.179448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:44.658205+0000","last_change":"2024-09-12T17:46:42.175938+0000","last_active":"2024-09-12T18:06:44.658205+0000","last_peered":"2024-09-12T18:06:44.658205+0000","last_clean":"2024-09-12T18:06:44.658205+0000","last_became_active":"2024-09-12T17:46:42.175501+0000","last_became_peered":"2024-09-12T17:46:42.175501+0000","last_unstale":"2024-09-12T18:06:44.658205+0000","last_undegraded":"2024-09-12T18:06:44.658205+0000","last_fullsized":"2024-09-12T18:06:44.658205+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:32.128694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637725+0000","last_change":"2024-09-12T17:45:03.895224+0000","last_active":"2024-09-12T18:04:24.637725+0000","last_peered":"2024-09-12T18:04:24.637725+0000","last_clean":"2024-09-12T18:04:24.637725+0000","last_became_active":"2024-09-12T17:45:03.894942+0000","last_became_peered":"2024-09-12T17:45:03.894942+0000","last_unstale":"2024-09-12T18:04:24.637725+0000","last_undegraded":"2024-09-12T18:04:24.637725+0000","last_fullsized":"2024-09-12T18:04:24.637725+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:52.737392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.634058+0000","last_change":"2024-09-12T17:57:00.463459+0000","last_active":"2024-09-12T18:03:59.634058+0000","last_peered":"2024-09-12T18:03:59.634058+0000","last_clean":"2024-09-12T18:03:59.634058+0000","last_became_active":"2024-09-12T17:57:00.463134+0000","last_became_peered":"2024-09-12T17:57:00.463134+0000","last_unstale":"2024-09-12T18:03:59.634058+0000","last_undegraded":"2024-09-12T18:03:59.634058+0000","last_fullsized":"2024-09-12T18:03:59.634058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:21.197817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.514362+0000","last_change":"2024-09-12T17:46:45.536892+0000","last_active":"2024-09-12T18:03:39.514362+0000","last_peered":"2024-09-12T18:03:39.514362+0000","last_clean":"2024-09-12T18:03:39.514362+0000","last_became_active":"2024-09-12T17:46:45.536581+0000","last_became_peered":"2024-09-12T17:46:45.536581+0000","last_unstale":"2024-09-12T18:03:39.514362+0000","last_undegraded":"2024-09-12T18:03:39.514362+0000","last_fullsized":"2024-09-12T18:03:39.514362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:18.649337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.643082+0000","last_change":"2024-09-12T17:46:42.180809+0000","last_active":"2024-09-12T18:05:29.643082+0000","last_peered":"2024-09-12T18:05:29.643082+0000","last_clean":"2024-09-12T18:05:29.643082+0000","last_became_active":"2024-09-12T17:46:42.179981+0000","last_became_peered":"2024-09-12T17:46:42.179981+0000","last_unstale":"2024-09-12T18:05:29.643082+0000","last_undegraded":"2024-09-12T18:05:29.643082+0000","last_fullsized":"2024-09-12T18:05:29.643082+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:19.357865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.810540+0000","last_change":"2024-09-12T17:45:03.892892+0000","last_active":"2024-09-12T18:05:30.810540+0000","last_peered":"2024-09-12T18:05:30.810540+0000","last_clean":"2024-09-12T18:05:30.810540+0000","last_became_active":"2024-09-12T17:45:03.892625+0000","last_became_peered":"2024-09-12T17:45:03.892625+0000","last_unstale":"2024-09-12T18:05:30.810540+0000","last_undegraded":"2024-09-12T18:05:30.810540+0000","last_fullsized":"2024-09-12T18:05:30.810540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:58.968922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.633098+0000","last_change":"2024-09-12T17:57:00.461660+0000","last_active":"2024-09-12T18:03:59.633098+0000","last_peered":"2024-09-12T18:03:59.633098+0000","last_clean":"2024-09-12T18:03:59.633098+0000","last_became_active":"2024-09-12T17:57:00.461347+0000","last_became_peered":"2024-09-12T17:57:00.461347+0000","last_unstale":"2024-09-12T18:03:59.633098+0000","last_undegraded":"2024-09-12T18:03:59.633098+0000","last_fullsized":"2024-09-12T18:03:59.633098+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:19.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.553715+0000","last_change":"2024-09-12T17:46:45.537765+0000","last_active":"2024-09-12T18:07:49.553715+0000","last_peered":"2024-09-12T18:07:49.553715+0000","last_clean":"2024-09-12T18:07:49.553715+0000","last_became_active":"2024-09-12T17:46:45.537463+0000","last_became_peered":"2024-09-12T17:46:45.537463+0000","last_unstale":"2024-09-12T18:07:49.553715+0000","last_undegraded":"2024-09-12T18:07:49.553715+0000","last_fullsized":"2024-09-12T18:07:49.553715+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:28.915955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.668771+0000","last_change":"2024-09-12T17:46:42.181302+0000","last_active":"2024-09-12T18:03:39.668771+0000","last_peered":"2024-09-12T18:03:39.668771+0000","last_clean":"2024-09-12T18:03:39.668771+0000","last_became_active":"2024-09-12T17:46:42.178809+0000","last_became_peered":"2024-09-12T17:46:42.178809+0000","last_unstale":"2024-09-12T18:03:39.668771+0000","last_undegraded":"2024-09-12T18:03:39.668771+0000","last_fullsized":"2024-09-12T18:03:39.668771+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:58.601763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'40","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.520902+0000","last_change":"2024-09-12T17:45:03.892705+0000","last_active":"2024-09-12T18:04:24.520902+0000","last_peered":"2024-09-12T18:04:24.520902+0000","last_clean":"2024-09-12T18:04:24.520902+0000","last_became_active":"2024-09-12T17:45:03.892417+0000","last_became_peered":"2024-09-12T17:45:03.892417+0000","last_unstale":"2024-09-12T18:04:24.520902+0000","last_undegraded":"2024-09-12T18:04:24.520902+0000","last_fullsized":"2024-09-12T18:04:24.520902+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:19.505017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":139,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.671898+0000","last_change":"2024-09-12T17:57:00.463497+0000","last_active":"2024-09-12T18:03:59.671898+0000","last_peered":"2024-09-12T18:03:59.671898+0000","last_clean":"2024-09-12T18:03:59.671898+0000","last_became_active":"2024-09-12T17:57:00.463245+0000","last_became_peered":"2024-09-12T17:57:00.463245+0000","last_unstale":"2024-09-12T18:03:59.671898+0000","last_undegraded":"2024-09-12T18:03:59.671898+0000","last_fullsized":"2024-09-12T18:03:59.671898+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:38.750487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.514393+0000","last_change":"2024-09-12T17:46:45.538651+0000","last_active":"2024-09-12T18:03:39.514393+0000","last_peered":"2024-09-12T18:03:39.514393+0000","last_clean":"2024-09-12T18:03:39.514393+0000","last_became_active":"2024-09-12T17:46:45.538337+0000","last_became_peered":"2024-09-12T17:46:45.538337+0000","last_unstale":"2024-09-12T18:03:39.514393+0000","last_undegraded":"2024-09-12T18:03:39.514393+0000","last_fullsized":"2024-09-12T18:03:39.514393+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:48.298979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'6","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.793117+0000","last_change":"2024-09-12T17:46:42.183384+0000","last_active":"2024-09-12T18:08:03.793117+0000","last_peered":"2024-09-12T18:08:03.793117+0000","last_clean":"2024-09-12T18:08:03.793117+0000","last_became_active":"2024-09-12T17:46:42.183098+0000","last_became_peered":"2024-09-12T17:46:42.183098+0000","last_unstale":"2024-09-12T18:08:03.793117+0000","last_undegraded":"2024-09-12T18:08:03.793117+0000","last_fullsized":"2024-09-12T18:08:03.793117+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:06.980322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'35","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.149147+0000","last_change":"2024-09-12T17:45:03.896813+0000","last_active":"2024-09-12T18:05:20.149147+0000","last_peered":"2024-09-12T18:05:20.149147+0000","last_clean":"2024-09-12T18:05:20.149147+0000","last_became_active":"2024-09-12T17:45:03.896299+0000","last_became_peered":"2024-09-12T17:45:03.896299+0000","last_unstale":"2024-09-12T18:05:20.149147+0000","last_undegraded":"2024-09-12T18:05:20.149147+0000","last_fullsized":"2024-09-12T18:05:20.149147+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:31.025568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":68,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.629360+0000","last_change":"2024-09-12T17:57:00.462016+0000","last_active":"2024-09-12T18:03:59.629360+0000","last_peered":"2024-09-12T18:03:59.629360+0000","last_clean":"2024-09-12T18:03:59.629360+0000","last_became_active":"2024-09-12T17:57:00.461706+0000","last_became_peered":"2024-09-12T17:57:00.461706+0000","last_unstale":"2024-09-12T18:03:59.629360+0000","last_undegraded":"2024-09-12T18:03:59.629360+0000","last_fullsized":"2024-09-12T18:03:59.629360+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:47.107872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.503300+0000","last_change":"2024-09-12T17:46:45.207863+0000","last_active":"2024-09-12T18:03:39.503300+0000","last_peered":"2024-09-12T18:03:39.503300+0000","last_clean":"2024-09-12T18:03:39.503300+0000","last_became_active":"2024-09-12T17:46:45.207610+0000","last_became_peered":"2024-09-12T17:46:45.207610+0000","last_unstale":"2024-09-12T18:03:39.503300+0000","last_undegraded":"2024-09-12T18:03:39.503300+0000","last_fullsized":"2024-09-12T18:03:39.503300+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:02.945511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:39.631136+0000","last_change":"2024-09-12T17:46:42.182800+0000","last_active":"2024-09-12T18:03:39.631136+0000","last_peered":"2024-09-12T18:03:39.631136+0000","last_clean":"2024-09-12T18:03:39.631136+0000","last_became_active":"2024-09-12T17:46:42.182412+0000","last_became_peered":"2024-09-12T17:46:42.182412+0000","last_unstale":"2024-09-12T18:03:39.631136+0000","last_undegraded":"2024-09-12T18:03:39.631136+0000","last_fullsized":"2024-09-12T18:03:39.631136+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:58.438274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'49","reported_seq":173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:28.740711+0000","last_change":"2024-09-12T17:45:03.900251+0000","last_active":"2024-09-12T18:05:28.740711+0000","last_peered":"2024-09-12T18:05:28.740711+0000","last_clean":"2024-09-12T18:05:28.740711+0000","last_became_active":"2024-09-12T17:45:03.899885+0000","last_became_peered":"2024-09-12T17:45:03.899885+0000","last_unstale":"2024-09-12T18:05:28.740711+0000","last_undegraded":"2024-09-12T18:05:28.740711+0000","last_fullsized":"2024-09-12T18:05:28.740711+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:29.712954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":167,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519268+0000","last_change":"2024-09-12T17:57:00.468941+0000","last_active":"2024-09-12T18:04:14.519268+0000","last_peered":"2024-09-12T18:04:14.519268+0000","last_clean":"2024-09-12T18:04:14.519268+0000","last_became_active":"2024-09-12T17:57:00.468592+0000","last_became_peered":"2024-09-12T17:57:00.468592+0000","last_unstale":"2024-09-12T18:04:14.519268+0000","last_undegraded":"2024-09-12T18:04:14.519268+0000","last_fullsized":"2024-09-12T18:04:14.519268+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:05.976634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647467+0000","last_change":"2024-09-12T17:46:45.210723+0000","last_active":"2024-09-12T18:05:24.647467+0000","last_peered":"2024-09-12T18:05:24.647467+0000","last_clean":"2024-09-12T18:05:24.647467+0000","last_became_active":"2024-09-12T17:46:45.210413+0000","last_became_peered":"2024-09-12T17:46:45.210413+0000","last_unstale":"2024-09-12T18:05:24.647467+0000","last_undegraded":"2024-09-12T18:05:24.647467+0000","last_fullsized":"2024-09-12T18:05:24.647467+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:35.068995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518445+0000","last_change":"2024-09-12T17:46:42.177074+0000","last_active":"2024-09-12T18:05:24.518445+0000","last_peered":"2024-09-12T18:05:24.518445+0000","last_clean":"2024-09-12T18:05:24.518445+0000","last_became_active":"2024-09-12T17:46:42.176505+0000","last_became_peered":"2024-09-12T17:46:42.176505+0000","last_unstale":"2024-09-12T18:05:24.518445+0000","last_undegraded":"2024-09-12T18:05:24.518445+0000","last_fullsized":"2024-09-12T18:05:24.518445+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:43.326678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'4","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.690928+0000","last_change":"2024-09-12T17:45:03.900017+0000","last_active":"2024-09-12T18:06:04.690928+0000","last_peered":"2024-09-12T18:06:04.690928+0000","last_clean":"2024-09-12T18:06:04.690928+0000","last_became_active":"2024-09-12T17:45:03.899726+0000","last_became_peered":"2024-09-12T17:45:03.899726+0000","last_unstale":"2024-09-12T18:06:04.690928+0000","last_undegraded":"2024-09-12T18:06:04.690928+0000","last_fullsized":"2024-09-12T18:06:04.690928+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.636058+0000","last_change":"2024-09-12T17:57:00.464086+0000","last_active":"2024-09-12T18:04:14.636058+0000","last_peered":"2024-09-12T18:04:14.636058+0000","last_clean":"2024-09-12T18:04:14.636058+0000","last_became_active":"2024-09-12T17:57:00.463766+0000","last_became_peered":"2024-09-12T17:57:00.463766+0000","last_unstale":"2024-09-12T18:04:14.636058+0000","last_undegraded":"2024-09-12T18:04:14.636058+0000","last_fullsized":"2024-09-12T18:04:14.636058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:28.897896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'8","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.659185+0000","last_change":"2024-09-12T17:46:45.201582+0000","last_active":"2024-09-12T18:08:03.659185+0000","last_peered":"2024-09-12T18:08:03.659185+0000","last_clean":"2024-09-12T18:08:03.659185+0000","last_became_active":"2024-09-12T17:46:45.201278+0000","last_became_peered":"2024-09-12T17:46:45.201278+0000","last_unstale":"2024-09-12T18:08:03.659185+0000","last_undegraded":"2024-09-12T18:08:03.659185+0000","last_fullsized":"2024-09-12T18:08:03.659185+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:48.055531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'8","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.682624+0000","last_change":"2024-09-12T17:46:42.182936+0000","last_active":"2024-09-12T18:08:03.682624+0000","last_peered":"2024-09-12T18:08:03.682624+0000","last_clean":"2024-09-12T18:08:03.682624+0000","last_became_active":"2024-09-12T17:46:42.182658+0000","last_became_peered":"2024-09-12T17:46:42.182658+0000","last_unstale":"2024-09-12T18:08:03.682624+0000","last_undegraded":"2024-09-12T18:08:03.682624+0000","last_fullsized":"2024-09-12T18:08:03.682624+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:02.557846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":45,"num_write":18,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.653089+0000","last_change":"2024-09-12T17:45:03.891474+0000","last_active":"2024-09-12T18:06:04.653089+0000","last_peered":"2024-09-12T18:06:04.653089+0000","last_clean":"2024-09-12T18:06:04.653089+0000","last_became_active":"2024-09-12T17:45:03.891186+0000","last_became_peered":"2024-09-12T17:45:03.891186+0000","last_unstale":"2024-09-12T18:06:04.653089+0000","last_undegraded":"2024-09-12T18:06:04.653089+0000","last_fullsized":"2024-09-12T18:06:04.653089+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":128,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:59.633745+0000","last_change":"2024-09-12T17:57:00.465754+0000","last_active":"2024-09-12T18:03:59.633745+0000","last_peered":"2024-09-12T18:03:59.633745+0000","last_clean":"2024-09-12T18:03:59.633745+0000","last_became_active":"2024-09-12T17:57:00.464910+0000","last_became_peered":"2024-09-12T17:57:00.464910+0000","last_unstale":"2024-09-12T18:03:59.633745+0000","last_undegraded":"2024-09-12T18:03:59.633745+0000","last_fullsized":"2024-09-12T18:03:59.633745+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:15.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534265+0000","last_change":"2024-09-12T17:46:45.206745+0000","last_active":"2024-09-12T18:05:24.534265+0000","last_peered":"2024-09-12T18:05:24.534265+0000","last_clean":"2024-09-12T18:05:24.534265+0000","last_became_active":"2024-09-12T17:46:45.206402+0000","last_became_peered":"2024-09-12T17:46:45.206402+0000","last_unstale":"2024-09-12T18:05:24.534265+0000","last_undegraded":"2024-09-12T18:05:24.534265+0000","last_fullsized":"2024-09-12T18:05:24.534265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:55.547505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.538364+0000","last_change":"2024-09-12T17:46:42.185043+0000","last_active":"2024-09-12T18:07:44.538364+0000","last_peered":"2024-09-12T18:07:44.538364+0000","last_clean":"2024-09-12T18:07:44.538364+0000","last_became_active":"2024-09-12T17:46:42.184760+0000","last_became_peered":"2024-09-12T17:46:42.184760+0000","last_unstale":"2024-09-12T18:07:44.538364+0000","last_undegraded":"2024-09-12T18:07:44.538364+0000","last_fullsized":"2024-09-12T18:07:44.538364+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:44.853687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'36","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.523725+0000","last_change":"2024-09-12T17:45:03.897900+0000","last_active":"2024-09-12T18:06:04.523725+0000","last_peered":"2024-09-12T18:06:04.523725+0000","last_clean":"2024-09-12T18:06:04.523725+0000","last_became_active":"2024-09-12T17:45:03.897616+0000","last_became_peered":"2024-09-12T17:45:03.897616+0000","last_unstale":"2024-09-12T18:06:04.523725+0000","last_undegraded":"2024-09-12T18:06:04.523725+0000","last_fullsized":"2024-09-12T18:06:04.523725+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":138,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519243+0000","last_change":"2024-09-12T17:57:00.464276+0000","last_active":"2024-09-12T18:04:14.519243+0000","last_peered":"2024-09-12T18:04:14.519243+0000","last_clean":"2024-09-12T18:04:14.519243+0000","last_became_active":"2024-09-12T17:57:00.463881+0000","last_became_peered":"2024-09-12T17:57:00.463881+0000","last_unstale":"2024-09-12T18:04:14.519243+0000","last_undegraded":"2024-09-12T18:04:14.519243+0000","last_fullsized":"2024-09-12T18:04:14.519243+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:03.028160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518466+0000","last_change":"2024-09-12T17:46:45.206370+0000","last_active":"2024-09-12T18:05:24.518466+0000","last_peered":"2024-09-12T18:05:24.518466+0000","last_clean":"2024-09-12T18:05:24.518466+0000","last_became_active":"2024-09-12T17:46:45.205987+0000","last_became_peered":"2024-09-12T17:46:45.205987+0000","last_unstale":"2024-09-12T18:05:24.518466+0000","last_undegraded":"2024-09-12T18:05:24.518466+0000","last_fullsized":"2024-09-12T18:05:24.518466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:04.606065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.642468+0000","last_change":"2024-09-12T17:46:42.180412+0000","last_active":"2024-09-12T18:05:24.642468+0000","last_peered":"2024-09-12T18:05:24.642468+0000","last_clean":"2024-09-12T18:05:24.642468+0000","last_became_active":"2024-09-12T17:46:42.178941+0000","last_became_peered":"2024-09-12T17:46:42.178941+0000","last_unstale":"2024-09-12T18:05:24.642468+0000","last_undegraded":"2024-09-12T18:05:24.642468+0000","last_fullsized":"2024-09-12T18:05:24.642468+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:53.889661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'33","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.539297+0000","last_change":"2024-09-12T17:45:03.893625+0000","last_active":"2024-09-12T18:06:04.539297+0000","last_peered":"2024-09-12T18:06:04.539297+0000","last_clean":"2024-09-12T18:06:04.539297+0000","last_became_active":"2024-09-12T17:45:03.893332+0000","last_became_peered":"2024-09-12T17:45:03.893332+0000","last_unstale":"2024-09-12T18:06:04.539297+0000","last_undegraded":"2024-09-12T18:06:04.539297+0000","last_fullsized":"2024-09-12T18:06:04.539297+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.646279+0000","last_change":"2024-09-12T17:57:00.461421+0000","last_active":"2024-09-12T18:05:39.646279+0000","last_peered":"2024-09-12T18:05:39.646279+0000","last_clean":"2024-09-12T18:05:39.646279+0000","last_became_active":"2024-09-12T17:57:00.461130+0000","last_became_peered":"2024-09-12T17:57:00.461130+0000","last_unstale":"2024-09-12T18:05:39.646279+0000","last_undegraded":"2024-09-12T18:05:39.646279+0000","last_fullsized":"2024-09-12T18:05:39.646279+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:49.944764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.673146+0000","last_change":"2024-09-12T17:46:45.208179+0000","last_active":"2024-09-12T18:08:03.673146+0000","last_peered":"2024-09-12T18:08:03.673146+0000","last_clean":"2024-09-12T18:08:03.673146+0000","last_became_active":"2024-09-12T17:46:45.207899+0000","last_became_peered":"2024-09-12T17:46:45.207899+0000","last_unstale":"2024-09-12T18:08:03.673146+0000","last_undegraded":"2024-09-12T18:08:03.673146+0000","last_fullsized":"2024-09-12T18:08:03.673146+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:40.530867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":571,"num_write":10,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.679250+0000","last_change":"2024-09-12T17:46:42.178168+0000","last_active":"2024-09-12T18:04:44.679250+0000","last_peered":"2024-09-12T18:04:44.679250+0000","last_clean":"2024-09-12T18:04:44.679250+0000","last_became_active":"2024-09-12T17:46:42.177867+0000","last_became_peered":"2024-09-12T17:46:42.177867+0000","last_unstale":"2024-09-12T18:04:44.679250+0000","last_undegraded":"2024-09-12T18:04:44.679250+0000","last_fullsized":"2024-09-12T18:04:44.679250+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:40.404324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'22","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534323+0000","last_change":"2024-09-12T17:45:03.895504+0000","last_active":"2024-09-12T18:05:24.534323+0000","last_peered":"2024-09-12T18:05:24.534323+0000","last_clean":"2024-09-12T18:05:24.534323+0000","last_became_active":"2024-09-12T17:45:03.895229+0000","last_became_peered":"2024-09-12T17:45:03.895229+0000","last_unstale":"2024-09-12T18:05:24.534323+0000","last_undegraded":"2024-09-12T18:05:24.534323+0000","last_fullsized":"2024-09-12T18:05:24.534323+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:49.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.690124+0000","last_change":"2024-09-12T17:57:00.466936+0000","last_active":"2024-09-12T18:05:59.690124+0000","last_peered":"2024-09-12T18:05:59.690124+0000","last_clean":"2024-09-12T18:05:59.690124+0000","last_became_active":"2024-09-12T17:57:00.466328+0000","last_became_peered":"2024-09-12T17:57:00.466328+0000","last_unstale":"2024-09-12T18:05:59.690124+0000","last_undegraded":"2024-09-12T18:05:59.690124+0000","last_fullsized":"2024-09-12T18:05:59.690124+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.547239+0000","last_change":"2024-09-12T17:46:45.204918+0000","last_active":"2024-09-12T18:06:59.547239+0000","last_peered":"2024-09-12T18:06:59.547239+0000","last_clean":"2024-09-12T18:06:59.547239+0000","last_became_active":"2024-09-12T17:46:45.204628+0000","last_became_peered":"2024-09-12T17:46:45.204628+0000","last_unstale":"2024-09-12T18:06:59.547239+0000","last_undegraded":"2024-09-12T18:06:59.547239+0000","last_fullsized":"2024-09-12T18:06:59.547239+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:44.729741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.655391+0000","last_change":"2024-09-12T17:46:42.183988+0000","last_active":"2024-09-12T18:06:59.655391+0000","last_peered":"2024-09-12T18:06:59.655391+0000","last_clean":"2024-09-12T18:06:59.655391+0000","last_became_active":"2024-09-12T17:46:42.183710+0000","last_became_peered":"2024-09-12T17:46:42.183710+0000","last_unstale":"2024-09-12T18:06:59.655391+0000","last_undegraded":"2024-09-12T18:06:59.655391+0000","last_fullsized":"2024-09-12T18:06:59.655391+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:52.515375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'20","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.641966+0000","last_change":"2024-09-12T17:45:03.897931+0000","last_active":"2024-09-12T18:05:19.641966+0000","last_peered":"2024-09-12T18:05:19.641966+0000","last_clean":"2024-09-12T18:05:19.641966+0000","last_became_active":"2024-09-12T17:45:03.897609+0000","last_became_peered":"2024-09-12T17:45:03.897609+0000","last_unstale":"2024-09-12T18:05:19.641966+0000","last_undegraded":"2024-09-12T18:05:19.641966+0000","last_fullsized":"2024-09-12T18:05:19.641966+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:57.004403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.520491+0000","last_change":"2024-09-12T17:57:00.459052+0000","last_active":"2024-09-12T18:05:39.520491+0000","last_peered":"2024-09-12T18:05:39.520491+0000","last_clean":"2024-09-12T18:05:39.520491+0000","last_became_active":"2024-09-12T17:57:00.458777+0000","last_became_peered":"2024-09-12T17:57:00.458777+0000","last_unstale":"2024-09-12T18:05:39.520491+0000","last_undegraded":"2024-09-12T18:05:39.520491+0000","last_fullsized":"2024-09-12T18:05:39.520491+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:12.952038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.660334+0000","last_change":"2024-09-12T17:46:45.537482+0000","last_active":"2024-09-12T18:06:59.660334+0000","last_peered":"2024-09-12T18:06:59.660334+0000","last_clean":"2024-09-12T18:06:59.660334+0000","last_became_active":"2024-09-12T17:46:45.536980+0000","last_became_peered":"2024-09-12T17:46:45.536980+0000","last_unstale":"2024-09-12T18:06:59.660334+0000","last_undegraded":"2024-09-12T18:06:59.660334+0000","last_fullsized":"2024-09-12T18:06:59.660334+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:14.427774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640687+0000","last_change":"2024-09-12T17:46:42.180818+0000","last_active":"2024-09-12T18:04:44.640687+0000","last_peered":"2024-09-12T18:04:44.640687+0000","last_clean":"2024-09-12T18:04:44.640687+0000","last_became_active":"2024-09-12T17:46:42.180565+0000","last_became_peered":"2024-09-12T17:46:42.180565+0000","last_unstale":"2024-09-12T18:04:44.640687+0000","last_undegraded":"2024-09-12T18:04:44.640687+0000","last_fullsized":"2024-09-12T18:04:44.640687+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:16.219991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'33","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517834+0000","last_change":"2024-09-12T17:45:03.892503+0000","last_active":"2024-09-12T18:05:19.517834+0000","last_peered":"2024-09-12T18:05:19.517834+0000","last_clean":"2024-09-12T18:05:19.517834+0000","last_became_active":"2024-09-12T17:45:03.892226+0000","last_became_peered":"2024-09-12T17:45:03.892226+0000","last_unstale":"2024-09-12T18:05:19.517834+0000","last_undegraded":"2024-09-12T18:05:19.517834+0000","last_fullsized":"2024-09-12T18:05:19.517834+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:41.497858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":124,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.687364+0000","last_change":"2024-09-12T17:57:00.464984+0000","last_active":"2024-09-12T18:05:39.687364+0000","last_peered":"2024-09-12T18:05:39.687364+0000","last_clean":"2024-09-12T18:05:39.687364+0000","last_became_active":"2024-09-12T17:57:00.464707+0000","last_became_peered":"2024-09-12T17:57:00.464707+0000","last_unstale":"2024-09-12T18:05:39.687364+0000","last_undegraded":"2024-09-12T18:05:39.687364+0000","last_fullsized":"2024-09-12T18:05:39.687364+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:25.768696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.547308+0000","last_change":"2024-09-12T17:46:45.205067+0000","last_active":"2024-09-12T18:06:59.547308+0000","last_peered":"2024-09-12T18:06:59.547308+0000","last_clean":"2024-09-12T18:06:59.547308+0000","last_became_active":"2024-09-12T17:46:45.204759+0000","last_became_peered":"2024-09-12T17:46:45.204759+0000","last_unstale":"2024-09-12T18:06:59.547308+0000","last_undegraded":"2024-09-12T18:06:59.547308+0000","last_fullsized":"2024-09-12T18:06:59.547308+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:47.314625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.660314+0000","last_change":"2024-09-12T17:46:42.183190+0000","last_active":"2024-09-12T18:06:59.660314+0000","last_peered":"2024-09-12T18:06:59.660314+0000","last_clean":"2024-09-12T18:06:59.660314+0000","last_became_active":"2024-09-12T17:46:42.182805+0000","last_became_peered":"2024-09-12T17:46:42.182805+0000","last_unstale":"2024-09-12T18:06:59.660314+0000","last_undegraded":"2024-09-12T18:06:59.660314+0000","last_fullsized":"2024-09-12T18:06:59.660314+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:54.005006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'42","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.643914+0000","last_change":"2024-09-12T17:45:03.898048+0000","last_active":"2024-09-12T18:05:19.643914+0000","last_peered":"2024-09-12T18:05:19.643914+0000","last_clean":"2024-09-12T18:05:19.643914+0000","last_became_active":"2024-09-12T17:45:03.897752+0000","last_became_peered":"2024-09-12T17:45:03.897752+0000","last_unstale":"2024-09-12T18:05:19.643914+0000","last_undegraded":"2024-09-12T18:05:19.643914+0000","last_fullsized":"2024-09-12T18:05:19.643914+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:59.048003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":75,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.538731+0000","last_change":"2024-09-12T17:57:00.469400+0000","last_active":"2024-09-12T18:05:59.538731+0000","last_peered":"2024-09-12T18:05:59.538731+0000","last_clean":"2024-09-12T18:05:59.538731+0000","last_became_active":"2024-09-12T17:57:00.469072+0000","last_became_peered":"2024-09-12T17:57:00.469072+0000","last_unstale":"2024-09-12T18:05:59.538731+0000","last_undegraded":"2024-09-12T18:05:59.538731+0000","last_fullsized":"2024-09-12T18:05:59.538731+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.525003+0000","last_change":"2024-09-12T17:46:45.203169+0000","last_active":"2024-09-12T18:06:14.525003+0000","last_peered":"2024-09-12T18:06:14.525003+0000","last_clean":"2024-09-12T18:06:14.525003+0000","last_became_active":"2024-09-12T17:46:45.202892+0000","last_became_peered":"2024-09-12T17:46:45.202892+0000","last_unstale":"2024-09-12T18:06:14.525003+0000","last_undegraded":"2024-09-12T18:06:14.525003+0000","last_fullsized":"2024-09-12T18:06:14.525003+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.654205+0000","last_change":"2024-09-12T17:46:42.179076+0000","last_active":"2024-09-12T18:06:14.654205+0000","last_peered":"2024-09-12T18:06:14.654205+0000","last_clean":"2024-09-12T18:06:14.654205+0000","last_became_active":"2024-09-12T17:46:42.178411+0000","last_became_peered":"2024-09-12T17:46:42.178411+0000","last_unstale":"2024-09-12T18:06:14.654205+0000","last_undegraded":"2024-09-12T18:06:14.654205+0000","last_fullsized":"2024-09-12T18:06:14.654205+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'24","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646723+0000","last_change":"2024-09-12T17:45:03.891655+0000","last_active":"2024-09-12T18:05:19.646723+0000","last_peered":"2024-09-12T18:05:19.646723+0000","last_clean":"2024-09-12T18:05:19.646723+0000","last_became_active":"2024-09-12T17:45:03.891369+0000","last_became_peered":"2024-09-12T17:45:03.891369+0000","last_unstale":"2024-09-12T18:05:19.646723+0000","last_undegraded":"2024-09-12T18:05:19.646723+0000","last_fullsized":"2024-09-12T18:05:19.646723+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:45.970204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.691011+0000","last_change":"2024-09-12T17:57:00.465652+0000","last_active":"2024-09-12T18:06:04.691011+0000","last_peered":"2024-09-12T18:06:04.691011+0000","last_clean":"2024-09-12T18:06:04.691011+0000","last_became_active":"2024-09-12T17:57:00.465360+0000","last_became_peered":"2024-09-12T17:57:00.465360+0000","last_unstale":"2024-09-12T18:06:04.691011+0000","last_undegraded":"2024-09-12T18:06:04.691011+0000","last_fullsized":"2024-09-12T18:06:04.691011+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.692313+0000","last_change":"2024-09-12T17:46:45.536369+0000","last_active":"2024-09-12T18:06:14.692313+0000","last_peered":"2024-09-12T18:06:14.692313+0000","last_clean":"2024-09-12T18:06:14.692313+0000","last_became_active":"2024-09-12T17:46:45.536056+0000","last_became_peered":"2024-09-12T17:46:45.536056+0000","last_unstale":"2024-09-12T18:06:14.692313+0000","last_undegraded":"2024-09-12T18:06:14.692313+0000","last_fullsized":"2024-09-12T18:06:14.692313+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.654391+0000","last_change":"2024-09-12T17:46:42.183083+0000","last_active":"2024-09-12T18:06:14.654391+0000","last_peered":"2024-09-12T18:06:14.654391+0000","last_clean":"2024-09-12T18:06:14.654391+0000","last_became_active":"2024-09-12T17:46:42.182831+0000","last_became_peered":"2024-09-12T17:46:42.182831+0000","last_unstale":"2024-09-12T18:06:14.654391+0000","last_undegraded":"2024-09-12T18:06:14.654391+0000","last_fullsized":"2024-09-12T18:06:14.654391+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'86","reported_seq":281,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.623576+0000","last_change":"2024-09-12T17:45:03.893737+0000","last_active":"2024-09-12T18:05:20.623576+0000","last_peered":"2024-09-12T18:05:20.623576+0000","last_clean":"2024-09-12T18:05:20.623576+0000","last_became_active":"2024-09-12T17:45:03.893452+0000","last_became_peered":"2024-09-12T17:45:03.893452+0000","last_unstale":"2024-09-12T18:05:20.623576+0000","last_undegraded":"2024-09-12T18:05:20.623576+0000","last_fullsized":"2024-09-12T18:05:20.623576+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:29.372853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":321,"num_write":137,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.690159+0000","last_change":"2024-09-12T17:57:00.464389+0000","last_active":"2024-09-12T18:05:59.690159+0000","last_peered":"2024-09-12T18:05:59.690159+0000","last_clean":"2024-09-12T18:05:59.690159+0000","last_became_active":"2024-09-12T17:57:00.464068+0000","last_became_peered":"2024-09-12T17:57:00.464068+0000","last_unstale":"2024-09-12T18:05:59.690159+0000","last_undegraded":"2024-09-12T18:05:59.690159+0000","last_fullsized":"2024-09-12T18:05:59.690159+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'6","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.659774+0000","last_change":"2024-09-12T17:46:45.206955+0000","last_active":"2024-09-12T18:08:03.659774+0000","last_peered":"2024-09-12T18:08:03.659774+0000","last_clean":"2024-09-12T18:08:03.659774+0000","last_became_active":"2024-09-12T17:46:45.206644+0000","last_became_peered":"2024-09-12T17:46:45.206644+0000","last_unstale":"2024-09-12T18:08:03.659774+0000","last_undegraded":"2024-09-12T18:08:03.659774+0000","last_fullsized":"2024-09-12T18:08:03.659774+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:01.211515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.654243+0000","last_change":"2024-09-12T17:46:42.184536+0000","last_active":"2024-09-12T18:06:14.654243+0000","last_peered":"2024-09-12T18:06:14.654243+0000","last_clean":"2024-09-12T18:06:14.654243+0000","last_became_active":"2024-09-12T17:46:42.184232+0000","last_became_peered":"2024-09-12T17:46:42.184232+0000","last_unstale":"2024-09-12T18:06:14.654243+0000","last_undegraded":"2024-09-12T18:06:14.654243+0000","last_fullsized":"2024-09-12T18:06:14.654243+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.522427+0000","last_change":"2024-09-12T17:45:03.897167+0000","last_active":"2024-09-12T18:04:34.522427+0000","last_peered":"2024-09-12T18:04:34.522427+0000","last_clean":"2024-09-12T18:04:34.522427+0000","last_became_active":"2024-09-12T17:45:03.896663+0000","last_became_peered":"2024-09-12T17:45:03.896663+0000","last_unstale":"2024-09-12T18:04:34.522427+0000","last_undegraded":"2024-09-12T18:04:34.522427+0000","last_fullsized":"2024-09-12T18:04:34.522427+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:00.166379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.652498+0000","last_change":"2024-09-12T17:57:00.465893+0000","last_active":"2024-09-12T18:05:59.652498+0000","last_peered":"2024-09-12T18:05:59.652498+0000","last_clean":"2024-09-12T18:05:59.652498+0000","last_became_active":"2024-09-12T17:57:00.465596+0000","last_became_peered":"2024-09-12T17:57:00.465596+0000","last_unstale":"2024-09-12T18:05:59.652498+0000","last_undegraded":"2024-09-12T18:05:59.652498+0000","last_fullsized":"2024-09-12T18:05:59.652498+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:09.673723+0000","last_change":"2024-09-12T17:46:45.208374+0000","last_active":"2024-09-12T18:04:09.673723+0000","last_peered":"2024-09-12T18:04:09.673723+0000","last_clean":"2024-09-12T18:04:09.673723+0000","last_became_active":"2024-09-12T17:46:45.208019+0000","last_became_peered":"2024-09-12T17:46:45.208019+0000","last_unstale":"2024-09-12T18:04:09.673723+0000","last_undegraded":"2024-09-12T18:04:09.673723+0000","last_fullsized":"2024-09-12T18:04:09.673723+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:03.347779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.512748+0000","last_change":"2024-09-12T17:46:42.184553+0000","last_active":"2024-09-12T18:04:44.512748+0000","last_peered":"2024-09-12T18:04:44.512748+0000","last_clean":"2024-09-12T18:04:44.512748+0000","last_became_active":"2024-09-12T17:46:42.184250+0000","last_became_peered":"2024-09-12T17:46:42.184250+0000","last_unstale":"2024-09-12T18:04:44.512748+0000","last_undegraded":"2024-09-12T18:04:44.512748+0000","last_fullsized":"2024-09-12T18:04:44.512748+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:49.433698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'40","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.511355+0000","last_change":"2024-09-12T17:45:03.897601+0000","last_active":"2024-09-12T18:04:34.511355+0000","last_peered":"2024-09-12T18:04:34.511355+0000","last_clean":"2024-09-12T18:04:34.511355+0000","last_became_active":"2024-09-12T17:45:03.897291+0000","last_became_peered":"2024-09-12T17:45:03.897291+0000","last_unstale":"2024-09-12T18:04:34.511355+0000","last_undegraded":"2024-09-12T18:04:34.511355+0000","last_fullsized":"2024-09-12T18:04:34.511355+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:56.938763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.684325+0000","last_change":"2024-09-12T17:57:00.465725+0000","last_active":"2024-09-12T18:05:19.684325+0000","last_peered":"2024-09-12T18:05:19.684325+0000","last_clean":"2024-09-12T18:05:19.684325+0000","last_became_active":"2024-09-12T17:57:00.465454+0000","last_became_peered":"2024-09-12T17:57:00.465454+0000","last_unstale":"2024-09-12T18:05:19.684325+0000","last_undegraded":"2024-09-12T18:05:19.684325+0000","last_fullsized":"2024-09-12T18:05:19.684325+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.552904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648118+0000","last_change":"2024-09-12T17:46:45.207902+0000","last_active":"2024-09-12T18:05:29.648118+0000","last_peered":"2024-09-12T18:05:29.648118+0000","last_clean":"2024-09-12T18:05:29.648118+0000","last_became_active":"2024-09-12T17:46:45.207607+0000","last_became_peered":"2024-09-12T17:46:45.207607+0000","last_unstale":"2024-09-12T18:05:29.648118+0000","last_undegraded":"2024-09-12T18:05:29.648118+0000","last_fullsized":"2024-09-12T18:05:29.648118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:31.661695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.685860+0000","last_change":"2024-09-12T17:46:42.182625+0000","last_active":"2024-09-12T18:05:29.685860+0000","last_peered":"2024-09-12T18:05:29.685860+0000","last_clean":"2024-09-12T18:05:29.685860+0000","last_became_active":"2024-09-12T17:46:42.182267+0000","last_became_peered":"2024-09-12T17:46:42.182267+0000","last_unstale":"2024-09-12T18:05:29.685860+0000","last_undegraded":"2024-09-12T18:05:29.685860+0000","last_fullsized":"2024-09-12T18:05:29.685860+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:39.753698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'54","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.639121+0000","last_change":"2024-09-12T17:45:03.892593+0000","last_active":"2024-09-12T18:04:34.639121+0000","last_peered":"2024-09-12T18:04:34.639121+0000","last_clean":"2024-09-12T18:04:34.639121+0000","last_became_active":"2024-09-12T17:45:03.891861+0000","last_became_peered":"2024-09-12T17:45:03.891861+0000","last_unstale":"2024-09-12T18:04:34.639121+0000","last_undegraded":"2024-09-12T18:04:34.639121+0000","last_fullsized":"2024-09-12T18:04:34.639121+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:11.906724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":286,"num_read_kb":219,"num_write":84,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.641923+0000","last_change":"2024-09-12T17:57:00.467076+0000","last_active":"2024-09-12T18:05:19.641923+0000","last_peered":"2024-09-12T18:05:19.641923+0000","last_clean":"2024-09-12T18:05:19.641923+0000","last_became_active":"2024-09-12T17:57:00.466761+0000","last_became_peered":"2024-09-12T17:57:00.466761+0000","last_unstale":"2024-09-12T18:05:19.641923+0000","last_undegraded":"2024-09-12T18:05:19.641923+0000","last_fullsized":"2024-09-12T18:05:19.641923+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:37.302553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648100+0000","last_change":"2024-09-12T17:46:45.537244+0000","last_active":"2024-09-12T18:05:29.648100+0000","last_peered":"2024-09-12T18:05:29.648100+0000","last_clean":"2024-09-12T18:05:29.648100+0000","last_became_active":"2024-09-12T17:46:45.536927+0000","last_became_peered":"2024-09-12T17:46:45.536927+0000","last_unstale":"2024-09-12T18:05:29.648100+0000","last_undegraded":"2024-09-12T18:05:29.648100+0000","last_fullsized":"2024-09-12T18:05:29.648100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:06.976539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.644905+0000","last_change":"2024-09-12T17:46:42.182617+0000","last_active":"2024-09-12T18:05:29.644905+0000","last_peered":"2024-09-12T18:05:29.644905+0000","last_clean":"2024-09-12T18:05:29.644905+0000","last_became_active":"2024-09-12T17:46:42.182346+0000","last_became_peered":"2024-09-12T17:46:42.182346+0000","last_unstale":"2024-09-12T18:05:29.644905+0000","last_undegraded":"2024-09-12T18:05:29.644905+0000","last_fullsized":"2024-09-12T18:05:29.644905+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:54.314647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'22","reported_seq":105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.511454+0000","last_change":"2024-09-12T17:45:03.895804+0000","last_active":"2024-09-12T18:04:34.511454+0000","last_peered":"2024-09-12T18:04:34.511454+0000","last_clean":"2024-09-12T18:04:34.511454+0000","last_became_active":"2024-09-12T17:45:03.895580+0000","last_became_peered":"2024-09-12T17:45:03.895580+0000","last_unstale":"2024-09-12T18:04:34.511454+0000","last_undegraded":"2024-09-12T18:04:34.511454+0000","last_fullsized":"2024-09-12T18:04:34.511454+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:27.580183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643446+0000","last_change":"2024-09-12T17:57:00.463170+0000","last_active":"2024-09-12T18:04:59.643446+0000","last_peered":"2024-09-12T18:04:59.643446+0000","last_clean":"2024-09-12T18:04:59.643446+0000","last_became_active":"2024-09-12T17:57:00.462863+0000","last_became_peered":"2024-09-12T17:57:00.462863+0000","last_unstale":"2024-09-12T18:04:59.643446+0000","last_undegraded":"2024-09-12T18:04:59.643446+0000","last_fullsized":"2024-09-12T18:04:59.643446+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:40.563317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.692438+0000","last_change":"2024-09-12T17:46:45.537210+0000","last_active":"2024-09-12T18:06:14.692438+0000","last_peered":"2024-09-12T18:06:14.692438+0000","last_clean":"2024-09-12T18:06:14.692438+0000","last_became_active":"2024-09-12T17:46:45.536831+0000","last_became_peered":"2024-09-12T17:46:45.536831+0000","last_unstale":"2024-09-12T18:06:14.692438+0000","last_undegraded":"2024-09-12T18:06:14.692438+0000","last_fullsized":"2024-09-12T18:06:14.692438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'7","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.652728+0000","last_change":"2024-09-12T17:46:42.185520+0000","last_active":"2024-09-12T18:08:03.652728+0000","last_peered":"2024-09-12T18:08:03.652728+0000","last_clean":"2024-09-12T18:08:03.652728+0000","last_became_active":"2024-09-12T17:46:42.185216+0000","last_became_peered":"2024-09-12T17:46:42.185216+0000","last_unstale":"2024-09-12T18:08:03.652728+0000","last_undegraded":"2024-09-12T18:08:03.652728+0000","last_fullsized":"2024-09-12T18:08:03.652728+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.690176+0000","last_change":"2024-09-12T17:45:03.894942+0000","last_active":"2024-09-12T18:05:59.690176+0000","last_peered":"2024-09-12T18:05:59.690176+0000","last_clean":"2024-09-12T18:05:59.690176+0000","last_became_active":"2024-09-12T17:45:03.894642+0000","last_became_peered":"2024-09-12T17:45:03.894642+0000","last_unstale":"2024-09-12T18:05:59.690176+0000","last_undegraded":"2024-09-12T18:05:59.690176+0000","last_fullsized":"2024-09-12T18:05:59.690176+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:17.879728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517749+0000","last_change":"2024-09-12T17:57:00.465804+0000","last_active":"2024-09-12T18:05:19.517749+0000","last_peered":"2024-09-12T18:05:19.517749+0000","last_clean":"2024-09-12T18:05:19.517749+0000","last_became_active":"2024-09-12T17:57:00.465546+0000","last_became_peered":"2024-09-12T17:57:00.465546+0000","last_unstale":"2024-09-12T18:05:19.517749+0000","last_undegraded":"2024-09-12T18:05:19.517749+0000","last_fullsized":"2024-09-12T18:05:19.517749+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.264688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'13","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.839888+0000","last_change":"2024-09-12T17:46:45.206808+0000","last_active":"2024-09-12T18:08:03.839888+0000","last_peered":"2024-09-12T18:08:03.839888+0000","last_clean":"2024-09-12T18:08:03.839888+0000","last_became_active":"2024-09-12T17:46:45.206537+0000","last_became_peered":"2024-09-12T17:46:45.206537+0000","last_unstale":"2024-09-12T18:08:03.839888+0000","last_undegraded":"2024-09-12T18:08:03.839888+0000","last_fullsized":"2024-09-12T18:08:03.839888+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29814,"num_write":18,"num_write_kb":19003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.840346+0000","last_change":"2024-09-12T17:46:42.177736+0000","last_active":"2024-09-12T18:08:03.840346+0000","last_peered":"2024-09-12T18:08:03.840346+0000","last_clean":"2024-09-12T18:08:03.840346+0000","last_became_active":"2024-09-12T17:46:42.177427+0000","last_became_peered":"2024-09-12T17:46:42.177427+0000","last_unstale":"2024-09-12T18:08:03.840346+0000","last_undegraded":"2024-09-12T18:08:03.840346+0000","last_fullsized":"2024-09-12T18:08:03.840346+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'156","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.651994+0000","last_change":"2024-09-12T17:45:03.898576+0000","last_active":"2024-09-12T18:05:54.651994+0000","last_peered":"2024-09-12T18:05:54.651994+0000","last_clean":"2024-09-12T18:05:54.651994+0000","last_became_active":"2024-09-12T17:45:03.898292+0000","last_became_peered":"2024-09-12T17:45:03.898292+0000","last_unstale":"2024-09-12T18:05:54.651994+0000","last_undegraded":"2024-09-12T18:05:54.651994+0000","last_fullsized":"2024-09-12T18:05:54.651994+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:55.707973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":951,"num_read_kb":701,"num_write":196,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.646344+0000","last_change":"2024-09-12T17:57:00.464364+0000","last_active":"2024-09-12T18:05:39.646344+0000","last_peered":"2024-09-12T18:05:39.646344+0000","last_clean":"2024-09-12T18:05:39.646344+0000","last_became_active":"2024-09-12T17:57:00.464090+0000","last_became_peered":"2024-09-12T17:57:00.464090+0000","last_unstale":"2024-09-12T18:05:39.646344+0000","last_undegraded":"2024-09-12T18:05:39.646344+0000","last_fullsized":"2024-09-12T18:05:39.646344+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.615989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648116+0000","last_change":"2024-09-12T17:46:45.205661+0000","last_active":"2024-09-12T18:05:29.648116+0000","last_peered":"2024-09-12T18:05:29.648116+0000","last_clean":"2024-09-12T18:05:29.648116+0000","last_became_active":"2024-09-12T17:46:45.205357+0000","last_became_peered":"2024-09-12T17:46:45.205357+0000","last_unstale":"2024-09-12T18:05:29.648116+0000","last_undegraded":"2024-09-12T18:05:29.648116+0000","last_fullsized":"2024-09-12T18:05:29.648116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:35.096441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:49.697236+0000","last_change":"2024-09-12T17:46:42.176715+0000","last_active":"2024-09-12T18:06:49.697236+0000","last_peered":"2024-09-12T18:06:49.697236+0000","last_clean":"2024-09-12T18:06:49.697236+0000","last_became_active":"2024-09-12T17:46:42.176415+0000","last_became_peered":"2024-09-12T17:46:42.176415+0000","last_unstale":"2024-09-12T18:06:49.697236+0000","last_undegraded":"2024-09-12T18:06:49.697236+0000","last_fullsized":"2024-09-12T18:06:49.697236+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:04.586483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'25","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.647144+0000","last_change":"2024-09-12T17:45:03.889617+0000","last_active":"2024-09-12T18:05:54.647144+0000","last_peered":"2024-09-12T18:05:54.647144+0000","last_clean":"2024-09-12T18:05:54.647144+0000","last_became_active":"2024-09-12T17:45:03.889334+0000","last_became_peered":"2024-09-12T17:45:03.889334+0000","last_unstale":"2024-09-12T18:05:54.647144+0000","last_undegraded":"2024-09-12T18:05:54.647144+0000","last_fullsized":"2024-09-12T18:05:54.647144+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:08.253653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.649616+0000","last_change":"2024-09-12T17:57:00.453730+0000","last_active":"2024-09-12T18:05:39.649616+0000","last_peered":"2024-09-12T18:05:39.649616+0000","last_clean":"2024-09-12T18:05:39.649616+0000","last_became_active":"2024-09-12T17:57:00.453435+0000","last_became_peered":"2024-09-12T17:57:00.453435+0000","last_unstale":"2024-09-12T18:05:39.649616+0000","last_undegraded":"2024-09-12T18:05:39.649616+0000","last_fullsized":"2024-09-12T18:05:39.649616+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:47.161486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"261'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.637517+0000","last_change":"2024-09-12T17:46:45.211314+0000","last_active":"2024-09-12T18:04:49.637517+0000","last_peered":"2024-09-12T18:04:49.637517+0000","last_clean":"2024-09-12T18:04:49.637517+0000","last_became_active":"2024-09-12T17:46:45.210669+0000","last_became_peered":"2024-09-12T17:46:45.210669+0000","last_unstale":"2024-09-12T18:04:49.637517+0000","last_undegraded":"2024-09-12T18:04:49.637517+0000","last_fullsized":"2024-09-12T18:04:49.637517+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:28.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.685819+0000","last_change":"2024-09-12T17:46:42.179654+0000","last_active":"2024-09-12T18:05:29.685819+0000","last_peered":"2024-09-12T18:05:29.685819+0000","last_clean":"2024-09-12T18:05:29.685819+0000","last_became_active":"2024-09-12T17:46:42.179369+0000","last_became_peered":"2024-09-12T17:46:42.179369+0000","last_unstale":"2024-09-12T18:05:29.685819+0000","last_undegraded":"2024-09-12T18:05:29.685819+0000","last_fullsized":"2024-09-12T18:05:29.685819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:46.896690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'11","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.522442+0000","last_change":"2024-09-12T17:45:03.892044+0000","last_active":"2024-09-12T18:05:54.522442+0000","last_peered":"2024-09-12T18:05:54.522442+0000","last_clean":"2024-09-12T18:05:54.522442+0000","last_became_active":"2024-09-12T17:45:03.891751+0000","last_became_peered":"2024-09-12T17:45:03.891751+0000","last_unstale":"2024-09-12T18:05:54.522442+0000","last_undegraded":"2024-09-12T18:05:54.522442+0000","last_fullsized":"2024-09-12T18:05:54.522442+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:57.974426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646774+0000","last_change":"2024-09-12T17:57:00.466635+0000","last_active":"2024-09-12T18:05:19.646774+0000","last_peered":"2024-09-12T18:05:19.646774+0000","last_clean":"2024-09-12T18:05:19.646774+0000","last_became_active":"2024-09-12T17:57:00.465706+0000","last_became_peered":"2024-09-12T17:57:00.465706+0000","last_unstale":"2024-09-12T18:05:19.646774+0000","last_undegraded":"2024-09-12T18:05:19.646774+0000","last_fullsized":"2024-09-12T18:05:19.646774+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:50.291887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'8","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.761747+0000","last_change":"2024-09-12T17:46:45.207296+0000","last_active":"2024-09-12T18:08:03.761747+0000","last_peered":"2024-09-12T18:08:03.761747+0000","last_clean":"2024-09-12T18:08:03.761747+0000","last_became_active":"2024-09-12T17:46:45.206384+0000","last_became_peered":"2024-09-12T17:46:45.206384+0000","last_unstale":"2024-09-12T18:08:03.761747+0000","last_undegraded":"2024-09-12T18:08:03.761747+0000","last_fullsized":"2024-09-12T18:08:03.761747+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:12.346318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":22528,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.760790+0000","last_change":"2024-09-12T17:46:42.177668+0000","last_active":"2024-09-12T18:08:03.760790+0000","last_peered":"2024-09-12T18:08:03.760790+0000","last_clean":"2024-09-12T18:08:03.760790+0000","last_became_active":"2024-09-12T17:46:42.177381+0000","last_became_peered":"2024-09-12T17:46:42.177381+0000","last_unstale":"2024-09-12T18:08:03.760790+0000","last_undegraded":"2024-09-12T18:08:03.760790+0000","last_fullsized":"2024-09-12T18:08:03.760790+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:48.797003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.908163+0000","last_change":"2024-09-12T17:45:03.893535+0000","last_active":"2024-09-12T18:05:56.908163+0000","last_peered":"2024-09-12T18:05:56.908163+0000","last_clean":"2024-09-12T18:05:56.908163+0000","last_became_active":"2024-09-12T17:45:03.893234+0000","last_became_peered":"2024-09-12T17:45:03.893234+0000","last_unstale":"2024-09-12T18:05:56.908163+0000","last_undegraded":"2024-09-12T18:05:56.908163+0000","last_fullsized":"2024-09-12T18:05:56.908163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:56.134844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":127,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.685120+0000","last_change":"2024-09-12T17:57:00.467265+0000","last_active":"2024-09-12T18:05:24.685120+0000","last_peered":"2024-09-12T18:05:24.685120+0000","last_clean":"2024-09-12T18:05:24.685120+0000","last_became_active":"2024-09-12T17:57:00.466994+0000","last_became_peered":"2024-09-12T17:57:00.466994+0000","last_unstale":"2024-09-12T18:05:24.685120+0000","last_undegraded":"2024-09-12T18:05:24.685120+0000","last_fullsized":"2024-09-12T18:05:24.685120+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:10.618141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519076+0000","last_change":"2024-09-12T17:46:45.207817+0000","last_active":"2024-09-12T18:05:29.519076+0000","last_peered":"2024-09-12T18:05:29.519076+0000","last_clean":"2024-09-12T18:05:29.519076+0000","last_became_active":"2024-09-12T17:46:45.207552+0000","last_became_peered":"2024-09-12T17:46:45.207552+0000","last_unstale":"2024-09-12T18:05:29.519076+0000","last_undegraded":"2024-09-12T18:05:29.519076+0000","last_fullsized":"2024-09-12T18:05:29.519076+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.256254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.536825+0000","last_change":"2024-09-12T17:46:42.182084+0000","last_active":"2024-09-12T18:07:34.536825+0000","last_peered":"2024-09-12T18:07:34.536825+0000","last_clean":"2024-09-12T18:07:34.536825+0000","last_became_active":"2024-09-12T17:46:42.181805+0000","last_became_peered":"2024-09-12T17:46:42.181805+0000","last_unstale":"2024-09-12T18:07:34.536825+0000","last_undegraded":"2024-09-12T18:07:34.536825+0000","last_fullsized":"2024-09-12T18:07:34.536825+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:10.912482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'23","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.747227+0000","last_change":"2024-09-12T17:45:03.893633+0000","last_active":"2024-09-12T18:05:56.747227+0000","last_peered":"2024-09-12T18:05:56.747227+0000","last_clean":"2024-09-12T18:05:56.747227+0000","last_became_active":"2024-09-12T17:45:03.893361+0000","last_became_peered":"2024-09-12T17:45:03.893361+0000","last_unstale":"2024-09-12T18:05:56.747227+0000","last_undegraded":"2024-09-12T18:05:56.747227+0000","last_fullsized":"2024-09-12T18:05:56.747227+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:44.155033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":77,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'207","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.759272+0000","last_change":"2024-09-12T18:08:23.759272+0000","last_active":"2024-09-12T18:08:23.759272+0000","last_peered":"2024-09-12T18:08:23.759272+0000","last_clean":"2024-09-12T18:08:23.759272+0000","last_became_active":"2024-09-12T17:29:52.955124+0000","last_became_peered":"2024-09-12T17:29:52.955124+0000","last_unstale":"2024-09-12T18:08:23.759272+0000","last_undegraded":"2024-09-12T18:08:23.759272+0000","last_fullsized":"2024-09-12T18:08:23.759272+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:23.759131+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:23.759131+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.759131+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:37.285891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":3241,"num_write":1056,"num_write_kb":28474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'166","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.325382+0000","last_change":"2024-09-12T17:29:54.957835+0000","last_active":"2024-09-12T18:05:55.325382+0000","last_peered":"2024-09-12T18:05:55.325382+0000","last_clean":"2024-09-12T18:05:55.325382+0000","last_became_active":"2024-09-12T17:29:54.957047+0000","last_became_peered":"2024-09-12T17:29:54.957047+0000","last_unstale":"2024-09-12T18:05:55.325382+0000","last_undegraded":"2024-09-12T18:05:55.325382+0000","last_fullsized":"2024-09-12T18:05:55.325382+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:17.894082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":598,"num_write":253,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'214","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.249725+0000","last_change":"2024-09-12T18:08:14.249725+0000","last_active":"2024-09-12T18:08:14.249725+0000","last_peered":"2024-09-12T18:08:14.249725+0000","last_clean":"2024-09-12T18:08:14.249725+0000","last_became_active":"2024-09-12T17:29:52.954249+0000","last_became_peered":"2024-09-12T17:29:52.954249+0000","last_unstale":"2024-09-12T18:08:14.249725+0000","last_undegraded":"2024-09-12T18:08:14.249725+0000","last_fullsized":"2024-09-12T18:08:14.249725+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-12T18:08:14.249628+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-12T18:08:14.249628+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.249628+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:16.628392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":62367,"num_write":1041,"num_write_kb":21747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'277","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:58.408944+0000","last_change":"2024-09-12T17:29:54.959793+0000","last_active":"2024-09-12T18:05:58.408944+0000","last_peered":"2024-09-12T18:05:58.408944+0000","last_clean":"2024-09-12T18:05:58.408944+0000","last_became_active":"2024-09-12T17:29:54.959503+0000","last_became_peered":"2024-09-12T17:29:54.959503+0000","last_unstale":"2024-09-12T18:05:58.408944+0000","last_undegraded":"2024-09-12T18:05:58.408944+0000","last_fullsized":"2024-09-12T18:05:58.408944+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:15.895941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1203,"num_read_kb":968,"num_write":436,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'251","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.162765+0000","last_change":"2024-09-12T18:08:16.162765+0000","last_active":"2024-09-12T18:08:16.162765+0000","last_peered":"2024-09-12T18:08:16.162765+0000","last_clean":"2024-09-12T18:08:16.162765+0000","last_became_active":"2024-09-12T17:29:52.957594+0000","last_became_peered":"2024-09-12T17:29:52.957594+0000","last_unstale":"2024-09-12T18:08:16.162765+0000","last_undegraded":"2024-09-12T18:08:16.162765+0000","last_fullsized":"2024-09-12T18:08:16.162765+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T18:08:16.162633+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T18:08:16.162633+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.162633+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:03.752251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595238,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":699,"num_read_kb":82538,"num_write":1032,"num_write_kb":35611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'90","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.508667+0000","last_change":"2024-09-12T17:29:54.955262+0000","last_active":"2024-09-12T18:05:53.508667+0000","last_peered":"2024-09-12T18:05:53.508667+0000","last_clean":"2024-09-12T18:05:53.508667+0000","last_became_active":"2024-09-12T17:29:54.954764+0000","last_became_peered":"2024-09-12T17:29:54.954764+0000","last_unstale":"2024-09-12T18:05:53.508667+0000","last_undegraded":"2024-09-12T18:05:53.508667+0000","last_fullsized":"2024-09-12T18:05:53.508667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:12.643057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":371,"num_write":125,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'210","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.448812+0000","last_change":"2024-09-12T18:08:22.448812+0000","last_active":"2024-09-12T18:08:22.448812+0000","last_peered":"2024-09-12T18:08:22.448812+0000","last_clean":"2024-09-12T18:08:22.448812+0000","last_became_active":"2024-09-12T17:29:52.956816+0000","last_became_peered":"2024-09-12T17:29:52.956816+0000","last_unstale":"2024-09-12T18:08:22.448812+0000","last_undegraded":"2024-09-12T18:08:22.448812+0000","last_fullsized":"2024-09-12T18:08:22.448812+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-12T18:08:22.448672+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-12T18:08:22.448672+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.448672+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:57.146612+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":70330,"num_write":999,"num_write_kb":42186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4089","reported_seq":4675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.210788+0000","last_change":"2024-09-12T18:08:24.210788+0000","last_active":"2024-09-12T18:08:24.210788+0000","last_peered":"2024-09-12T18:08:24.210788+0000","last_clean":"2024-09-12T18:08:24.210788+0000","last_became_active":"2024-09-12T17:29:54.944959+0000","last_became_peered":"2024-09-12T17:29:54.944959+0000","last_unstale":"2024-09-12T18:08:24.210788+0000","last_undegraded":"2024-09-12T18:08:24.210788+0000","last_fullsized":"2024-09-12T18:08:24.210788+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4089","last_scrub_stamp":"2024-09-12T18:08:24.210700+0000","last_deep_scrub":"264'4089","last_deep_scrub_stamp":"2024-09-12T18:08:24.210700+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.210700+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":3000,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:36.120715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16426,"num_read_kb":13705,"num_write":6135,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'163","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.724946+0000","last_change":"2024-09-12T18:08:22.724946+0000","last_active":"2024-09-12T18:08:22.724946+0000","last_peered":"2024-09-12T18:08:22.724946+0000","last_clean":"2024-09-12T18:08:22.724946+0000","last_became_active":"2024-09-12T17:29:52.960666+0000","last_became_peered":"2024-09-12T17:29:52.960666+0000","last_unstale":"2024-09-12T18:08:22.724946+0000","last_undegraded":"2024-09-12T18:08:22.724946+0000","last_fullsized":"2024-09-12T18:08:22.724946+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T18:08:22.724802+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T18:08:22.724802+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.724802+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:44.691765+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":500,"num_read_kb":127585,"num_write":826,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'125","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.067481+0000","last_change":"2024-09-12T18:08:22.067481+0000","last_active":"2024-09-12T18:08:22.067481+0000","last_peered":"2024-09-12T18:08:22.067481+0000","last_clean":"2024-09-12T18:08:22.067481+0000","last_became_active":"2024-09-12T17:29:54.955205+0000","last_became_peered":"2024-09-12T17:29:54.955205+0000","last_unstale":"2024-09-12T18:08:22.067481+0000","last_undegraded":"2024-09-12T18:08:22.067481+0000","last_fullsized":"2024-09-12T18:08:22.067481+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T18:08:22.067382+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T18:08:22.067382+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.067382+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:17.462304+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":437,"num_write":181,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'215","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.474026+0000","last_change":"2024-09-12T18:08:20.474026+0000","last_active":"2024-09-12T18:08:20.474026+0000","last_peered":"2024-09-12T18:08:20.474026+0000","last_clean":"2024-09-12T18:08:20.474026+0000","last_became_active":"2024-09-12T17:29:52.955926+0000","last_became_peered":"2024-09-12T17:29:52.955926+0000","last_unstale":"2024-09-12T18:08:20.474026+0000","last_undegraded":"2024-09-12T18:08:20.474026+0000","last_fullsized":"2024-09-12T18:08:20.474026+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'215","last_scrub_stamp":"2024-09-12T18:08:20.473907+0000","last_deep_scrub":"264'215","last_deep_scrub_stamp":"2024-09-12T18:08:20.473907+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.473907+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:59.079099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":501,"num_read_kb":5634,"num_write":1057,"num_write_kb":27185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'203","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.854752+0000","last_change":"2024-09-12T17:29:54.955413+0000","last_active":"2024-09-12T18:06:20.854752+0000","last_peered":"2024-09-12T18:06:20.854752+0000","last_clean":"2024-09-12T18:06:20.854752+0000","last_became_active":"2024-09-12T17:29:54.955119+0000","last_became_peered":"2024-09-12T17:29:54.955119+0000","last_unstale":"2024-09-12T18:06:20.854752+0000","last_undegraded":"2024-09-12T18:06:20.854752+0000","last_fullsized":"2024-09-12T18:06:20.854752+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:34.797196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":872,"num_read_kb":697,"num_write":351,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'196","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.745850+0000","last_change":"2024-09-12T18:08:21.745850+0000","last_active":"2024-09-12T18:08:21.745850+0000","last_peered":"2024-09-12T18:08:21.745850+0000","last_clean":"2024-09-12T18:08:21.745850+0000","last_became_active":"2024-09-12T17:29:52.962236+0000","last_became_peered":"2024-09-12T17:29:52.962236+0000","last_unstale":"2024-09-12T18:08:21.745850+0000","last_undegraded":"2024-09-12T18:08:21.745850+0000","last_fullsized":"2024-09-12T18:08:21.745850+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-12T18:08:21.745689+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-12T18:08:21.745689+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.745689+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:04.341885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2835815,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":524,"num_read_kb":5167,"num_write":1014,"num_write_kb":25714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'272","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:18.420389+0000","last_change":"2024-09-12T17:29:54.963988+0000","last_active":"2024-09-12T18:06:18.420389+0000","last_peered":"2024-09-12T18:06:18.420389+0000","last_clean":"2024-09-12T18:06:18.420389+0000","last_became_active":"2024-09-12T17:29:54.963665+0000","last_became_peered":"2024-09-12T17:29:54.963665+0000","last_unstale":"2024-09-12T18:06:18.420389+0000","last_undegraded":"2024-09-12T18:06:18.420389+0000","last_fullsized":"2024-09-12T18:06:18.420389+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:56.293772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1246,"num_read_kb":1040,"num_write":431,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'231","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.106919+0000","last_change":"2024-09-12T18:08:16.106919+0000","last_active":"2024-09-12T18:08:16.106919+0000","last_peered":"2024-09-12T18:08:16.106919+0000","last_clean":"2024-09-12T18:08:16.106919+0000","last_became_active":"2024-09-12T17:29:52.955333+0000","last_became_peered":"2024-09-12T17:29:52.955333+0000","last_unstale":"2024-09-12T18:08:16.106919+0000","last_undegraded":"2024-09-12T18:08:16.106919+0000","last_fullsized":"2024-09-12T18:08:16.106919+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-12T18:08:16.106773+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-12T18:08:16.106773+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.106773+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:19.227426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569139,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":94260,"num_write":1118,"num_write_kb":40355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'158","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.404145+0000","last_change":"2024-09-12T18:08:23.404145+0000","last_active":"2024-09-12T18:08:23.404145+0000","last_peered":"2024-09-12T18:08:23.404145+0000","last_clean":"2024-09-12T18:08:23.404145+0000","last_became_active":"2024-09-12T17:29:54.952536+0000","last_became_peered":"2024-09-12T17:29:54.952536+0000","last_unstale":"2024-09-12T18:08:23.404145+0000","last_undegraded":"2024-09-12T18:08:23.404145+0000","last_fullsized":"2024-09-12T18:08:23.404145+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'158","last_scrub_stamp":"2024-09-12T18:08:23.404033+0000","last_deep_scrub":"264'158","last_deep_scrub_stamp":"2024-09-12T18:08:23.404033+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.404033+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:50.664895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":604,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'402","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.806677+0000","last_change":"2024-09-12T18:08:23.806677+0000","last_active":"2024-09-12T18:08:23.806677+0000","last_peered":"2024-09-12T18:08:23.806677+0000","last_clean":"2024-09-12T18:08:23.806677+0000","last_became_active":"2024-09-12T17:29:54.954401+0000","last_became_peered":"2024-09-12T17:29:54.954401+0000","last_unstale":"2024-09-12T18:08:23.806677+0000","last_undegraded":"2024-09-12T18:08:23.806677+0000","last_fullsized":"2024-09-12T18:08:23.806677+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'402","last_scrub_stamp":"2024-09-12T18:08:23.806573+0000","last_deep_scrub":"264'402","last_deep_scrub_stamp":"2024-09-12T18:08:23.806573+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.806573+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:47.510776+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1720,"num_read_kb":1358,"num_write":655,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'182","reported_seq":768,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.710509+0000","last_change":"2024-09-12T18:08:20.710509+0000","last_active":"2024-09-12T18:08:20.710509+0000","last_peered":"2024-09-12T18:08:20.710509+0000","last_clean":"2024-09-12T18:08:20.710509+0000","last_became_active":"2024-09-12T17:29:52.957715+0000","last_became_peered":"2024-09-12T17:29:52.957715+0000","last_unstale":"2024-09-12T18:08:20.710509+0000","last_undegraded":"2024-09-12T18:08:20.710509+0000","last_fullsized":"2024-09-12T18:08:20.710509+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-12T18:08:20.710410+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-12T18:08:20.710410+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.710410+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:15.953280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":380,"num_write":908,"num_write_kb":20925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'91","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.680830+0000","last_change":"2024-09-12T17:29:54.960764+0000","last_active":"2024-09-12T18:04:54.680830+0000","last_peered":"2024-09-12T18:04:54.680830+0000","last_clean":"2024-09-12T18:04:54.680830+0000","last_became_active":"2024-09-12T17:29:54.960430+0000","last_became_peered":"2024-09-12T17:29:54.960430+0000","last_unstale":"2024-09-12T18:04:54.680830+0000","last_undegraded":"2024-09-12T18:04:54.680830+0000","last_fullsized":"2024-09-12T18:04:54.680830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:51.078408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":446,"num_read_kb":372,"num_write":151,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'245","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.079473+0000","last_change":"2024-09-12T18:08:16.079473+0000","last_active":"2024-09-12T18:08:16.079473+0000","last_peered":"2024-09-12T18:08:16.079473+0000","last_clean":"2024-09-12T18:08:16.079473+0000","last_became_active":"2024-09-12T17:29:52.960770+0000","last_became_peered":"2024-09-12T17:29:52.960770+0000","last_unstale":"2024-09-12T18:08:16.079473+0000","last_undegraded":"2024-09-12T18:08:16.079473+0000","last_fullsized":"2024-09-12T18:08:16.079473+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T18:08:16.079351+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T18:08:16.079351+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.079351+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:46.777517+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291498,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":825,"num_read_kb":13405,"num_write":1115,"num_write_kb":28936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'257","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.420438+0000","last_change":"2024-09-12T18:08:24.420438+0000","last_active":"2024-09-12T18:08:24.420438+0000","last_peered":"2024-09-12T18:08:24.420438+0000","last_clean":"2024-09-12T18:08:24.420438+0000","last_became_active":"2024-09-12T17:29:54.962822+0000","last_became_peered":"2024-09-12T17:29:54.962822+0000","last_unstale":"2024-09-12T18:08:24.420438+0000","last_undegraded":"2024-09-12T18:08:24.420438+0000","last_fullsized":"2024-09-12T18:08:24.420438+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-09-12T18:08:24.420342+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-09-12T18:08:24.420342+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.420342+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:43.478734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1220,"num_read_kb":1023,"num_write":434,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'208","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.047282+0000","last_change":"2024-09-12T18:08:17.047282+0000","last_active":"2024-09-12T18:08:17.047282+0000","last_peered":"2024-09-12T18:08:17.047282+0000","last_clean":"2024-09-12T18:08:17.047282+0000","last_became_active":"2024-09-12T17:29:52.956432+0000","last_became_peered":"2024-09-12T17:29:52.956432+0000","last_unstale":"2024-09-12T18:08:17.047282+0000","last_undegraded":"2024-09-12T18:08:17.047282+0000","last_fullsized":"2024-09-12T18:08:17.047282+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T18:08:17.047159+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T18:08:17.047159+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.047159+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:56.216084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306456,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":42949,"num_write":1043,"num_write_kb":37671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'84","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.431383+0000","last_change":"2024-09-12T18:08:18.431383+0000","last_active":"2024-09-12T18:08:18.431383+0000","last_peered":"2024-09-12T18:08:18.431383+0000","last_clean":"2024-09-12T18:08:18.431383+0000","last_became_active":"2024-09-12T17:29:54.944588+0000","last_became_peered":"2024-09-12T17:29:54.944588+0000","last_unstale":"2024-09-12T18:08:18.431383+0000","last_undegraded":"2024-09-12T18:08:18.431383+0000","last_fullsized":"2024-09-12T18:08:18.431383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T18:08:18.431281+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T18:08:18.431281+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.431281+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:42.771743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":342,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'232","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.778762+0000","last_change":"2024-09-12T18:08:09.778762+0000","last_active":"2024-09-12T18:08:09.778762+0000","last_peered":"2024-09-12T18:08:09.778762+0000","last_clean":"2024-09-12T18:08:09.778762+0000","last_became_active":"2024-09-12T17:29:52.962814+0000","last_became_peered":"2024-09-12T17:29:52.962814+0000","last_unstale":"2024-09-12T18:08:09.778762+0000","last_undegraded":"2024-09-12T18:08:09.778762+0000","last_fullsized":"2024-09-12T18:08:09.778762+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-09-12T18:08:09.778651+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-09-12T18:08:09.778651+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.778651+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:58.056507+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":494,"num_read_kb":48249,"num_write":1130,"num_write_kb":37209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'126","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.419319+0000","last_change":"2024-09-12T18:08:19.419319+0000","last_active":"2024-09-12T18:08:19.419319+0000","last_peered":"2024-09-12T18:08:19.419319+0000","last_clean":"2024-09-12T18:08:19.419319+0000","last_became_active":"2024-09-12T17:29:54.956975+0000","last_became_peered":"2024-09-12T17:29:54.956975+0000","last_unstale":"2024-09-12T18:08:19.419319+0000","last_undegraded":"2024-09-12T18:08:19.419319+0000","last_fullsized":"2024-09-12T18:08:19.419319+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-12T18:08:19.419239+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-12T18:08:19.419239+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.419239+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:11.813359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":592,"num_read_kb":498,"num_write":187,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'266","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.067674+0000","last_change":"2024-09-12T18:08:14.067674+0000","last_active":"2024-09-12T18:08:14.067674+0000","last_peered":"2024-09-12T18:08:14.067674+0000","last_clean":"2024-09-12T18:08:14.067674+0000","last_became_active":"2024-09-12T17:29:52.954630+0000","last_became_peered":"2024-09-12T17:29:52.954630+0000","last_unstale":"2024-09-12T18:08:14.067674+0000","last_undegraded":"2024-09-12T18:08:14.067674+0000","last_fullsized":"2024-09-12T18:08:14.067674+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T18:08:14.067562+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T18:08:14.067562+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.067562+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:04.519905+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456483,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":845,"num_read_kb":67267,"num_write":1133,"num_write_kb":48740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'283","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.230047+0000","last_change":"2024-09-12T17:29:54.959334+0000","last_active":"2024-09-12T18:05:30.230047+0000","last_peered":"2024-09-12T18:05:30.230047+0000","last_clean":"2024-09-12T18:05:30.230047+0000","last_became_active":"2024-09-12T17:29:54.958852+0000","last_became_peered":"2024-09-12T17:29:54.958852+0000","last_unstale":"2024-09-12T18:05:30.230047+0000","last_undegraded":"2024-09-12T18:05:30.230047+0000","last_fullsized":"2024-09-12T18:05:30.230047+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:21.982711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1254,"num_read_kb":1035,"num_write":436,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'170","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.123138+0000","last_change":"2024-09-12T18:08:14.123138+0000","last_active":"2024-09-12T18:08:14.123138+0000","last_peered":"2024-09-12T18:08:14.123138+0000","last_clean":"2024-09-12T18:08:14.123138+0000","last_became_active":"2024-09-12T17:29:52.959175+0000","last_became_peered":"2024-09-12T17:29:52.959175+0000","last_unstale":"2024-09-12T18:08:14.123138+0000","last_undegraded":"2024-09-12T18:08:14.123138+0000","last_fullsized":"2024-09-12T18:08:14.123138+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-09-12T18:08:14.123015+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-09-12T18:08:14.123015+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.123015+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:26.240900+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":1243,"num_write":851,"num_write_kb":36341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'154","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.297485+0000","last_change":"2024-09-12T17:30:02.964799+0000","last_active":"2024-09-12T18:06:21.297485+0000","last_peered":"2024-09-12T18:06:21.297485+0000","last_clean":"2024-09-12T18:06:21.297485+0000","last_became_active":"2024-09-12T17:30:02.964492+0000","last_became_peered":"2024-09-12T17:30:02.964492+0000","last_unstale":"2024-09-12T18:06:21.297485+0000","last_undegraded":"2024-09-12T18:06:21.297485+0000","last_fullsized":"2024-09-12T18:06:21.297485+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:49.837441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":218,"num_read_kb":205,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'110","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.069383+0000","last_change":"2024-09-12T18:08:20.069383+0000","last_active":"2024-09-12T18:08:20.069383+0000","last_peered":"2024-09-12T18:08:20.069383+0000","last_clean":"2024-09-12T18:08:20.069383+0000","last_became_active":"2024-09-12T17:29:54.950633+0000","last_became_peered":"2024-09-12T17:29:54.950633+0000","last_unstale":"2024-09-12T18:08:20.069383+0000","last_undegraded":"2024-09-12T18:08:20.069383+0000","last_fullsized":"2024-09-12T18:08:20.069383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-12T18:08:20.069263+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-12T18:08:20.069263+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.069263+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:55.109697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":400,"num_write":147,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'201","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.722577+0000","last_change":"2024-09-12T18:08:16.722577+0000","last_active":"2024-09-12T18:08:16.722577+0000","last_peered":"2024-09-12T18:08:16.722577+0000","last_clean":"2024-09-12T18:08:16.722577+0000","last_became_active":"2024-09-12T17:30:28.007183+0000","last_became_peered":"2024-09-12T17:30:28.007183+0000","last_unstale":"2024-09-12T18:08:16.722577+0000","last_undegraded":"2024-09-12T18:08:16.722577+0000","last_fullsized":"2024-09-12T18:08:16.722577+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-12T18:08:16.722467+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-12T18:08:16.722467+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.722467+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:25.320294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":918,"num_read_kb":19617,"num_write":951,"num_write_kb":33635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.527115+0000","last_change":"2024-09-12T17:29:56.954842+0000","last_active":"2024-09-12T18:08:03.527115+0000","last_peered":"2024-09-12T18:08:03.527115+0000","last_clean":"2024-09-12T18:08:03.527115+0000","last_became_active":"2024-09-12T17:29:56.954488+0000","last_became_peered":"2024-09-12T17:29:56.954488+0000","last_unstale":"2024-09-12T18:08:03.527115+0000","last_undegraded":"2024-09-12T18:08:03.527115+0000","last_fullsized":"2024-09-12T18:08:03.527115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:16.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":724,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'178","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.803280+0000","last_change":"2024-09-12T17:29:58.957203+0000","last_active":"2024-09-12T18:08:03.803280+0000","last_peered":"2024-09-12T18:08:03.803280+0000","last_clean":"2024-09-12T18:08:03.803280+0000","last_became_active":"2024-09-12T17:29:58.956916+0000","last_became_peered":"2024-09-12T17:29:58.956916+0000","last_unstale":"2024-09-12T18:08:03.803280+0000","last_undegraded":"2024-09-12T18:08:03.803280+0000","last_fullsized":"2024-09-12T18:08:03.803280+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:23.529305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4406,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":236,"num_read_kb":279,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.671162+0000","last_change":"2024-09-12T17:30:00.960720+0000","last_active":"2024-09-12T18:03:54.671162+0000","last_peered":"2024-09-12T18:03:54.671162+0000","last_clean":"2024-09-12T18:03:54.671162+0000","last_became_active":"2024-09-12T17:30:00.960409+0000","last_became_peered":"2024-09-12T17:30:00.960409+0000","last_unstale":"2024-09-12T18:03:54.671162+0000","last_undegraded":"2024-09-12T18:03:54.671162+0000","last_fullsized":"2024-09-12T18:03:54.671162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:36.986925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2442","reported_seq":4366,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.852848+0000","last_change":"2024-09-12T17:30:02.968528+0000","last_active":"2024-09-12T18:06:20.852848+0000","last_peered":"2024-09-12T18:06:20.852848+0000","last_clean":"2024-09-12T18:06:20.852848+0000","last_became_active":"2024-09-12T17:30:02.967718+0000","last_became_peered":"2024-09-12T17:30:02.967718+0000","last_unstale":"2024-09-12T18:06:20.852848+0000","last_undegraded":"2024-09-12T18:06:20.852848+0000","last_fullsized":"2024-09-12T18:06:20.852848+0000","mapping_epoch":34,"log_start":"264'2400","ondisk_log_start":"264'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":2400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:40.278625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1044,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6319,"num_read_kb":6274,"num_write":4873,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'136","reported_seq":718,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.219639+0000","last_change":"2024-09-12T17:29:54.958156+0000","last_active":"2024-09-12T18:05:53.219639+0000","last_peered":"2024-09-12T18:05:53.219639+0000","last_clean":"2024-09-12T18:05:53.219639+0000","last_became_active":"2024-09-12T17:29:54.957747+0000","last_became_peered":"2024-09-12T17:29:54.957747+0000","last_unstale":"2024-09-12T18:05:53.219639+0000","last_undegraded":"2024-09-12T18:05:53.219639+0000","last_fullsized":"2024-09-12T18:05:53.219639+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:45.769420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":552,"num_write":215,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'213","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.155495+0000","last_change":"2024-09-12T18:08:09.155495+0000","last_active":"2024-09-12T18:08:09.155495+0000","last_peered":"2024-09-12T18:08:09.155495+0000","last_clean":"2024-09-12T18:08:09.155495+0000","last_became_active":"2024-09-12T17:29:52.950612+0000","last_became_peered":"2024-09-12T17:29:52.950612+0000","last_unstale":"2024-09-12T18:08:09.155495+0000","last_undegraded":"2024-09-12T18:08:09.155495+0000","last_fullsized":"2024-09-12T18:08:09.155495+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-09-12T18:08:09.155405+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-09-12T18:08:09.155405+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.155405+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:06.394522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":421,"num_read_kb":10994,"num_write":1027,"num_write_kb":32732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:09.528200+0000","last_change":"2024-09-12T17:29:56.953819+0000","last_active":"2024-09-12T18:05:09.528200+0000","last_peered":"2024-09-12T18:05:09.528200+0000","last_clean":"2024-09-12T18:05:09.528200+0000","last_became_active":"2024-09-12T17:29:56.953546+0000","last_became_peered":"2024-09-12T17:29:56.953546+0000","last_unstale":"2024-09-12T18:05:09.528200+0000","last_undegraded":"2024-09-12T18:05:09.528200+0000","last_fullsized":"2024-09-12T18:05:09.528200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:02.063377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'85","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.814472+0000","last_change":"2024-09-12T17:29:58.951397+0000","last_active":"2024-09-12T18:05:55.814472+0000","last_peered":"2024-09-12T18:05:55.814472+0000","last_clean":"2024-09-12T18:05:55.814472+0000","last_became_active":"2024-09-12T17:29:58.951077+0000","last_became_peered":"2024-09-12T17:29:58.951077+0000","last_unstale":"2024-09-12T18:05:55.814472+0000","last_undegraded":"2024-09-12T18:05:55.814472+0000","last_fullsized":"2024-09-12T18:05:55.814472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:32.229853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.505635+0000","last_change":"2024-09-12T17:30:00.969561+0000","last_active":"2024-09-12T18:03:54.505635+0000","last_peered":"2024-09-12T18:03:54.505635+0000","last_clean":"2024-09-12T18:03:54.505635+0000","last_became_active":"2024-09-12T17:30:00.969291+0000","last_became_peered":"2024-09-12T17:30:00.969291+0000","last_unstale":"2024-09-12T18:03:54.505635+0000","last_undegraded":"2024-09-12T18:03:54.505635+0000","last_fullsized":"2024-09-12T18:03:54.505635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:59.191519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'123","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:03.288660+0000","last_change":"2024-09-12T17:30:02.972169+0000","last_active":"2024-09-12T18:06:03.288660+0000","last_peered":"2024-09-12T18:06:03.288660+0000","last_clean":"2024-09-12T18:06:03.288660+0000","last_became_active":"2024-09-12T17:30:02.971843+0000","last_became_peered":"2024-09-12T17:30:02.971843+0000","last_unstale":"2024-09-12T18:06:03.288660+0000","last_undegraded":"2024-09-12T18:06:03.288660+0000","last_fullsized":"2024-09-12T18:06:03.288660+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:27.791607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'129","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.116925+0000","last_change":"2024-09-12T18:08:19.116925+0000","last_active":"2024-09-12T18:08:19.116925+0000","last_peered":"2024-09-12T18:08:19.116925+0000","last_clean":"2024-09-12T18:08:19.116925+0000","last_became_active":"2024-09-12T17:29:54.944698+0000","last_became_peered":"2024-09-12T17:29:54.944698+0000","last_unstale":"2024-09-12T18:08:19.116925+0000","last_undegraded":"2024-09-12T18:08:19.116925+0000","last_fullsized":"2024-09-12T18:08:19.116925+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T18:08:19.116839+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T18:08:19.116839+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.116839+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:21.922508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":422,"num_write":199,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'178","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.665158+0000","last_change":"2024-09-12T18:08:18.665158+0000","last_active":"2024-09-12T18:08:18.665158+0000","last_peered":"2024-09-12T18:08:18.665158+0000","last_clean":"2024-09-12T18:08:18.665158+0000","last_became_active":"2024-09-12T17:29:52.963087+0000","last_became_peered":"2024-09-12T17:29:52.963087+0000","last_unstale":"2024-09-12T18:08:18.665158+0000","last_undegraded":"2024-09-12T18:08:18.665158+0000","last_fullsized":"2024-09-12T18:08:18.665158+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-12T18:08:18.665031+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-12T18:08:18.665031+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.665031+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:53.506644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128531,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":3190,"num_write":917,"num_write_kb":30863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.515779+0000","last_change":"2024-09-12T17:29:56.953137+0000","last_active":"2024-09-12T18:03:49.515779+0000","last_peered":"2024-09-12T18:03:49.515779+0000","last_clean":"2024-09-12T18:03:49.515779+0000","last_became_active":"2024-09-12T17:29:56.952827+0000","last_became_peered":"2024-09-12T17:29:56.952827+0000","last_unstale":"2024-09-12T18:03:49.515779+0000","last_undegraded":"2024-09-12T18:03:49.515779+0000","last_fullsized":"2024-09-12T18:03:49.515779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:28.816718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'97","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.555493+0000","last_change":"2024-09-12T17:29:58.952475+0000","last_active":"2024-09-12T18:05:29.555493+0000","last_peered":"2024-09-12T18:05:29.555493+0000","last_clean":"2024-09-12T18:05:29.555493+0000","last_became_active":"2024-09-12T17:29:58.952169+0000","last_became_peered":"2024-09-12T17:29:58.952169+0000","last_unstale":"2024-09-12T18:05:29.555493+0000","last_undegraded":"2024-09-12T18:05:29.555493+0000","last_fullsized":"2024-09-12T18:05:29.555493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:14.255681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":103,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'754","reported_seq":2404,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.555776+0000","last_change":"2024-09-12T17:30:00.954478+0000","last_active":"2024-09-12T18:08:03.555776+0000","last_peered":"2024-09-12T18:08:03.555776+0000","last_clean":"2024-09-12T18:08:03.555776+0000","last_became_active":"2024-09-12T17:30:00.954180+0000","last_became_peered":"2024-09-12T17:30:00.954180+0000","last_unstale":"2024-09-12T18:08:03.555776+0000","last_undegraded":"2024-09-12T18:08:03.555776+0000","last_fullsized":"2024-09-12T18:08:03.555776+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:51.847365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'180","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.347847+0000","last_change":"2024-09-12T17:30:02.962486+0000","last_active":"2024-09-12T18:06:21.347847+0000","last_peered":"2024-09-12T18:06:21.347847+0000","last_clean":"2024-09-12T18:06:21.347847+0000","last_became_active":"2024-09-12T17:30:02.961198+0000","last_became_peered":"2024-09-12T17:30:02.961198+0000","last_unstale":"2024-09-12T18:06:21.347847+0000","last_undegraded":"2024-09-12T18:06:21.347847+0000","last_fullsized":"2024-09-12T18:06:21.347847+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:59.034236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":624,"num_write":393,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'95","reported_seq":679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.075530+0000","last_change":"2024-09-12T18:08:21.075530+0000","last_active":"2024-09-12T18:08:21.075530+0000","last_peered":"2024-09-12T18:08:21.075530+0000","last_clean":"2024-09-12T18:08:21.075530+0000","last_became_active":"2024-09-12T17:29:54.956663+0000","last_became_peered":"2024-09-12T17:29:54.956663+0000","last_unstale":"2024-09-12T18:08:21.075530+0000","last_undegraded":"2024-09-12T18:08:21.075530+0000","last_fullsized":"2024-09-12T18:08:21.075530+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'95","last_scrub_stamp":"2024-09-12T18:08:21.075428+0000","last_deep_scrub":"264'95","last_deep_scrub_stamp":"2024-09-12T18:08:21.075428+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.075428+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:39.799375+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":356,"num_write":140,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'167","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.026722+0000","last_change":"2024-09-12T18:08:12.026722+0000","last_active":"2024-09-12T18:08:12.026722+0000","last_peered":"2024-09-12T18:08:12.026722+0000","last_clean":"2024-09-12T18:08:12.026722+0000","last_became_active":"2024-09-12T17:29:52.962665+0000","last_became_peered":"2024-09-12T17:29:52.962665+0000","last_unstale":"2024-09-12T18:08:12.026722+0000","last_undegraded":"2024-09-12T18:08:12.026722+0000","last_fullsized":"2024-09-12T18:08:12.026722+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-09-12T18:08:12.026621+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-09-12T18:08:12.026621+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.026621+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:49.096759+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":354,"num_read_kb":5731,"num_write":816,"num_write_kb":29128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.627887+0000","last_change":"2024-09-12T17:29:56.953011+0000","last_active":"2024-09-12T18:03:49.627887+0000","last_peered":"2024-09-12T18:03:49.627887+0000","last_clean":"2024-09-12T18:03:49.627887+0000","last_became_active":"2024-09-12T17:29:56.952625+0000","last_became_peered":"2024-09-12T17:29:56.952625+0000","last_unstale":"2024-09-12T18:03:49.627887+0000","last_undegraded":"2024-09-12T18:03:49.627887+0000","last_fullsized":"2024-09-12T18:03:49.627887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:37.754261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'105","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.754301+0000","last_change":"2024-09-12T17:29:58.978681+0000","last_active":"2024-09-12T18:08:03.754301+0000","last_peered":"2024-09-12T18:08:03.754301+0000","last_clean":"2024-09-12T18:08:03.754301+0000","last_became_active":"2024-09-12T17:29:58.978299+0000","last_became_peered":"2024-09-12T17:29:58.978299+0000","last_unstale":"2024-09-12T18:08:03.754301+0000","last_undegraded":"2024-09-12T18:08:03.754301+0000","last_fullsized":"2024-09-12T18:08:03.754301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:51.821063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'776","reported_seq":3919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.784663+0000","last_change":"2024-09-12T17:30:00.963021+0000","last_active":"2024-09-12T18:08:03.784663+0000","last_peered":"2024-09-12T18:08:03.784663+0000","last_clean":"2024-09-12T18:08:03.784663+0000","last_became_active":"2024-09-12T17:30:00.962754+0000","last_became_peered":"2024-09-12T17:30:00.962754+0000","last_unstale":"2024-09-12T18:08:03.784663+0000","last_undegraded":"2024-09-12T18:08:03.784663+0000","last_fullsized":"2024-09-12T18:08:03.784663+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:34.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'251","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.399080+0000","last_change":"2024-09-12T18:08:23.399080+0000","last_active":"2024-09-12T18:08:23.399080+0000","last_peered":"2024-09-12T18:08:23.399080+0000","last_clean":"2024-09-12T18:08:23.399080+0000","last_became_active":"2024-09-12T17:29:54.957148+0000","last_became_peered":"2024-09-12T17:29:54.957148+0000","last_unstale":"2024-09-12T18:08:23.399080+0000","last_undegraded":"2024-09-12T18:08:23.399080+0000","last_fullsized":"2024-09-12T18:08:23.399080+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T18:08:23.398990+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T18:08:23.398990+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.398990+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:10.788896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":968,"num_write":398,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'237","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.672401+0000","last_change":"2024-09-12T18:08:15.672401+0000","last_active":"2024-09-12T18:08:15.672401+0000","last_peered":"2024-09-12T18:08:15.672401+0000","last_clean":"2024-09-12T18:08:15.672401+0000","last_became_active":"2024-09-12T17:29:52.964421+0000","last_became_peered":"2024-09-12T17:29:52.964421+0000","last_unstale":"2024-09-12T18:08:15.672401+0000","last_undegraded":"2024-09-12T18:08:15.672401+0000","last_fullsized":"2024-09-12T18:08:15.672401+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'237","last_scrub_stamp":"2024-09-12T18:08:15.672302+0000","last_deep_scrub":"264'237","last_deep_scrub_stamp":"2024-09-12T18:08:15.672302+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.672302+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:57.673677+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":5176,"num_write":1044,"num_write_kb":56179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.678374+0000","last_change":"2024-09-12T17:29:56.953482+0000","last_active":"2024-09-12T18:04:39.678374+0000","last_peered":"2024-09-12T18:04:39.678374+0000","last_clean":"2024-09-12T18:04:39.678374+0000","last_became_active":"2024-09-12T17:29:56.953204+0000","last_became_peered":"2024-09-12T17:29:56.953204+0000","last_unstale":"2024-09-12T18:04:39.678374+0000","last_undegraded":"2024-09-12T18:04:39.678374+0000","last_fullsized":"2024-09-12T18:04:39.678374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:49.409852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'181","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.833794+0000","last_change":"2024-09-12T17:29:58.979003+0000","last_active":"2024-09-12T18:08:03.833794+0000","last_peered":"2024-09-12T18:08:03.833794+0000","last_clean":"2024-09-12T18:08:03.833794+0000","last_became_active":"2024-09-12T17:29:58.978213+0000","last_became_peered":"2024-09-12T17:29:58.978213+0000","last_unstale":"2024-09-12T18:08:03.833794+0000","last_undegraded":"2024-09-12T18:08:03.833794+0000","last_fullsized":"2024-09-12T18:08:03.833794+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:29.055630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9297,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":251,"num_read_kb":306,"num_write":140,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.653384+0000","last_change":"2024-09-12T17:30:00.959136+0000","last_active":"2024-09-12T18:06:04.653384+0000","last_peered":"2024-09-12T18:06:04.653384+0000","last_clean":"2024-09-12T18:06:04.653384+0000","last_became_active":"2024-09-12T17:30:00.958723+0000","last_became_peered":"2024-09-12T17:30:00.958723+0000","last_unstale":"2024-09-12T18:06:04.653384+0000","last_undegraded":"2024-09-12T18:06:04.653384+0000","last_fullsized":"2024-09-12T18:06:04.653384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'549","reported_seq":1353,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.673110+0000","last_change":"2024-09-12T17:30:02.968872+0000","last_active":"2024-09-12T18:07:38.673110+0000","last_peered":"2024-09-12T18:07:38.673110+0000","last_clean":"2024-09-12T18:07:38.673110+0000","last_became_active":"2024-09-12T17:30:02.968515+0000","last_became_peered":"2024-09-12T17:30:02.968515+0000","last_unstale":"2024-09-12T18:07:38.673110+0000","last_undegraded":"2024-09-12T18:07:38.673110+0000","last_fullsized":"2024-09-12T18:07:38.673110+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:33.814672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1325,"num_read_kb":1316,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'153","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.736621+0000","last_change":"2024-09-12T18:08:11.736621+0000","last_active":"2024-09-12T18:08:11.736621+0000","last_peered":"2024-09-12T18:08:11.736621+0000","last_clean":"2024-09-12T18:08:11.736621+0000","last_became_active":"2024-09-12T17:29:54.959140+0000","last_became_peered":"2024-09-12T17:29:54.959140+0000","last_unstale":"2024-09-12T18:08:11.736621+0000","last_undegraded":"2024-09-12T18:08:11.736621+0000","last_fullsized":"2024-09-12T18:08:11.736621+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-12T18:08:11.736532+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-12T18:08:11.736532+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.736532+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:28.497052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":582,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'177","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.657316+0000","last_change":"2024-09-12T18:08:14.657316+0000","last_active":"2024-09-12T18:08:14.657316+0000","last_peered":"2024-09-12T18:08:14.657316+0000","last_clean":"2024-09-12T18:08:14.657316+0000","last_became_active":"2024-09-12T17:29:52.964339+0000","last_became_peered":"2024-09-12T17:29:52.964339+0000","last_unstale":"2024-09-12T18:08:14.657316+0000","last_undegraded":"2024-09-12T18:08:14.657316+0000","last_fullsized":"2024-09-12T18:08:14.657316+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:08:14.657212+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:08:14.657212+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.657212+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:58.043317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395849,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":381,"num_read_kb":1621,"num_write":866,"num_write_kb":10562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.466833+0000","last_change":"2024-09-12T18:08:20.466833+0000","last_active":"2024-09-12T18:08:20.466833+0000","last_peered":"2024-09-12T18:08:20.466833+0000","last_clean":"2024-09-12T18:08:20.466833+0000","last_became_active":"2024-09-12T17:29:56.953551+0000","last_became_peered":"2024-09-12T17:29:56.953551+0000","last_unstale":"2024-09-12T18:08:20.466833+0000","last_undegraded":"2024-09-12T18:08:20.466833+0000","last_fullsized":"2024-09-12T18:08:20.466833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:20.466738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:20.466738+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.466738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:40.063398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'125","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.669683+0000","last_change":"2024-09-12T17:29:58.953621+0000","last_active":"2024-09-12T18:08:03.669683+0000","last_peered":"2024-09-12T18:08:03.669683+0000","last_clean":"2024-09-12T18:08:03.669683+0000","last_became_active":"2024-09-12T17:29:58.953107+0000","last_became_peered":"2024-09-12T17:29:58.953107+0000","last_unstale":"2024-09-12T18:08:03.669683+0000","last_undegraded":"2024-09-12T18:08:03.669683+0000","last_fullsized":"2024-09-12T18:08:03.669683+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9938,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":239,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.525616+0000","last_change":"2024-09-12T17:30:00.961851+0000","last_active":"2024-09-12T18:04:54.525616+0000","last_peered":"2024-09-12T18:04:54.525616+0000","last_clean":"2024-09-12T18:04:54.525616+0000","last_became_active":"2024-09-12T17:30:00.961545+0000","last_became_peered":"2024-09-12T17:30:00.961545+0000","last_unstale":"2024-09-12T18:04:54.525616+0000","last_undegraded":"2024-09-12T18:04:54.525616+0000","last_fullsized":"2024-09-12T18:04:54.525616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:46.146649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'85","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:28.622892+0000","last_change":"2024-09-12T17:30:02.967776+0000","last_active":"2024-09-12T18:07:28.622892+0000","last_peered":"2024-09-12T18:07:28.622892+0000","last_clean":"2024-09-12T18:07:28.622892+0000","last_became_active":"2024-09-12T17:30:02.967500+0000","last_became_peered":"2024-09-12T17:30:02.967500+0000","last_unstale":"2024-09-12T18:07:28.622892+0000","last_undegraded":"2024-09-12T18:07:28.622892+0000","last_fullsized":"2024-09-12T18:07:28.622892+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:21.856163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":199,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'67","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.126105+0000","last_change":"2024-09-12T18:08:19.126105+0000","last_active":"2024-09-12T18:08:19.126105+0000","last_peered":"2024-09-12T18:08:19.126105+0000","last_clean":"2024-09-12T18:08:19.126105+0000","last_became_active":"2024-09-12T17:29:54.959979+0000","last_became_peered":"2024-09-12T17:29:54.959979+0000","last_unstale":"2024-09-12T18:08:19.126105+0000","last_undegraded":"2024-09-12T18:08:19.126105+0000","last_fullsized":"2024-09-12T18:08:19.126105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-09-12T18:08:19.125996+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-09-12T18:08:19.125996+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.125996+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:57.331669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":252,"num_write":105,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'337","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.692746+0000","last_change":"2024-09-12T18:08:13.692746+0000","last_active":"2024-09-12T18:08:13.692746+0000","last_peered":"2024-09-12T18:08:13.692746+0000","last_clean":"2024-09-12T18:08:13.692746+0000","last_became_active":"2024-09-12T17:29:52.957308+0000","last_became_peered":"2024-09-12T17:29:52.957308+0000","last_unstale":"2024-09-12T18:08:13.692746+0000","last_undegraded":"2024-09-12T18:08:13.692746+0000","last_fullsized":"2024-09-12T18:08:13.692746+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-09-12T18:08:13.692640+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-09-12T18:08:13.692640+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.692640+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:12.037962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":832,"num_read_kb":24052,"num_write":1268,"num_write_kb":42343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"264'5","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.414556+0000","last_change":"2024-09-12T18:08:24.414556+0000","last_active":"2024-09-12T18:08:24.414556+0000","last_peered":"2024-09-12T18:08:24.414556+0000","last_clean":"2024-09-12T18:08:24.414556+0000","last_became_active":"2024-09-12T17:29:56.959206+0000","last_became_peered":"2024-09-12T17:29:56.959206+0000","last_unstale":"2024-09-12T18:08:24.414556+0000","last_undegraded":"2024-09-12T18:08:24.414556+0000","last_fullsized":"2024-09-12T18:08:24.414556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:24.414472+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:24.414472+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.414472+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:13.993154+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":1192,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'158","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.851374+0000","last_change":"2024-09-12T17:29:58.956025+0000","last_active":"2024-09-12T18:08:03.851374+0000","last_peered":"2024-09-12T18:08:03.851374+0000","last_clean":"2024-09-12T18:08:03.851374+0000","last_became_active":"2024-09-12T17:29:58.955698+0000","last_became_peered":"2024-09-12T17:29:58.955698+0000","last_unstale":"2024-09-12T18:08:03.851374+0000","last_undegraded":"2024-09-12T18:08:03.851374+0000","last_fullsized":"2024-09-12T18:08:03.851374+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:21.001386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7452,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":263,"num_write":112,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'763","reported_seq":2326,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.561083+0000","last_change":"2024-09-12T17:30:00.967003+0000","last_active":"2024-09-12T18:08:03.561083+0000","last_peered":"2024-09-12T18:08:03.561083+0000","last_clean":"2024-09-12T18:08:03.561083+0000","last_became_active":"2024-09-12T17:30:00.966661+0000","last_became_peered":"2024-09-12T17:30:00.966661+0000","last_unstale":"2024-09-12T18:08:03.561083+0000","last_undegraded":"2024-09-12T18:08:03.561083+0000","last_fullsized":"2024-09-12T18:08:03.561083+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:57.546741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'107","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.730576+0000","last_change":"2024-09-12T17:30:02.970504+0000","last_active":"2024-09-12T18:07:37.730576+0000","last_peered":"2024-09-12T18:07:37.730576+0000","last_clean":"2024-09-12T18:07:37.730576+0000","last_became_active":"2024-09-12T17:30:02.969837+0000","last_became_peered":"2024-09-12T17:30:02.969837+0000","last_unstale":"2024-09-12T18:07:37.730576+0000","last_undegraded":"2024-09-12T18:07:37.730576+0000","last_fullsized":"2024-09-12T18:07:37.730576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:09.306140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":259,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'232","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.182943+0000","last_change":"2024-09-12T18:08:17.182943+0000","last_active":"2024-09-12T18:08:17.182943+0000","last_peered":"2024-09-12T18:08:17.182943+0000","last_clean":"2024-09-12T18:08:17.182943+0000","last_became_active":"2024-09-12T17:30:28.004234+0000","last_became_peered":"2024-09-12T17:30:28.004234+0000","last_unstale":"2024-09-12T18:08:17.182943+0000","last_undegraded":"2024-09-12T18:08:17.182943+0000","last_fullsized":"2024-09-12T18:08:17.182943+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-09-12T18:08:17.182861+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-09-12T18:08:17.182861+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.182861+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:07.554492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":779,"num_write":354,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'204","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.486827+0000","last_change":"2024-09-12T18:08:15.486827+0000","last_active":"2024-09-12T18:08:15.486827+0000","last_peered":"2024-09-12T18:08:15.486827+0000","last_clean":"2024-09-12T18:08:15.486827+0000","last_became_active":"2024-09-12T17:29:52.951442+0000","last_became_peered":"2024-09-12T17:29:52.951442+0000","last_unstale":"2024-09-12T18:08:15.486827+0000","last_undegraded":"2024-09-12T18:08:15.486827+0000","last_fullsized":"2024-09-12T18:08:15.486827+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'204","last_scrub_stamp":"2024-09-12T18:08:15.486681+0000","last_deep_scrub":"264'204","last_deep_scrub_stamp":"2024-09-12T18:08:15.486681+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.486681+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:50.751228+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6462010,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":476,"num_read_kb":16166,"num_write":931,"num_write_kb":36148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.427263+0000","last_change":"2024-09-12T18:08:22.427263+0000","last_active":"2024-09-12T18:08:22.427263+0000","last_peered":"2024-09-12T18:08:22.427263+0000","last_clean":"2024-09-12T18:08:22.427263+0000","last_became_active":"2024-09-12T17:29:56.955948+0000","last_became_peered":"2024-09-12T17:29:56.955948+0000","last_unstale":"2024-09-12T18:08:22.427263+0000","last_undegraded":"2024-09-12T18:08:22.427263+0000","last_fullsized":"2024-09-12T18:08:22.427263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:22.427174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:22.427174+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.427174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:36.201160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'202","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.877272+0000","last_change":"2024-09-12T17:29:58.958169+0000","last_active":"2024-09-12T18:08:03.877272+0000","last_peered":"2024-09-12T18:08:03.877272+0000","last_clean":"2024-09-12T18:08:03.877272+0000","last_became_active":"2024-09-12T17:29:58.957183+0000","last_became_peered":"2024-09-12T17:29:58.957183+0000","last_unstale":"2024-09-12T18:08:03.877272+0000","last_undegraded":"2024-09-12T18:08:03.877272+0000","last_fullsized":"2024-09-12T18:08:03.877272+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:19.712371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13747,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":267,"num_read_kb":394,"num_write":132,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.639403+0000","last_change":"2024-09-12T17:30:00.958337+0000","last_active":"2024-09-12T18:04:44.639403+0000","last_peered":"2024-09-12T18:04:44.639403+0000","last_clean":"2024-09-12T18:04:44.639403+0000","last_became_active":"2024-09-12T17:30:00.958049+0000","last_became_peered":"2024-09-12T17:30:00.958049+0000","last_unstale":"2024-09-12T18:04:44.639403+0000","last_undegraded":"2024-09-12T18:04:44.639403+0000","last_fullsized":"2024-09-12T18:04:44.639403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:24.880580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'146","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.020504+0000","last_change":"2024-09-12T17:30:02.970369+0000","last_active":"2024-09-12T18:05:56.020504+0000","last_peered":"2024-09-12T18:05:56.020504+0000","last_clean":"2024-09-12T18:05:56.020504+0000","last_became_active":"2024-09-12T17:30:02.970095+0000","last_became_peered":"2024-09-12T17:30:02.970095+0000","last_unstale":"2024-09-12T18:05:56.020504+0000","last_undegraded":"2024-09-12T18:05:56.020504+0000","last_fullsized":"2024-09-12T18:05:56.020504+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:20.676163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":173,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'179","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.670165+0000","last_change":"2024-09-12T18:08:14.670165+0000","last_active":"2024-09-12T18:08:14.670165+0000","last_peered":"2024-09-12T18:08:14.670165+0000","last_clean":"2024-09-12T18:08:14.670165+0000","last_became_active":"2024-09-12T17:29:54.956850+0000","last_became_peered":"2024-09-12T17:29:54.956850+0000","last_unstale":"2024-09-12T18:08:14.670165+0000","last_undegraded":"2024-09-12T18:08:14.670165+0000","last_fullsized":"2024-09-12T18:08:14.670165+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:08:14.670074+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:08:14.670074+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.670074+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:21.265957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":712,"num_read_kb":607,"num_write":242,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'175","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.059924+0000","last_change":"2024-09-12T18:08:12.059924+0000","last_active":"2024-09-12T18:08:12.059924+0000","last_peered":"2024-09-12T18:08:12.059924+0000","last_clean":"2024-09-12T18:08:12.059924+0000","last_became_active":"2024-09-12T17:29:52.958919+0000","last_became_peered":"2024-09-12T17:29:52.958919+0000","last_unstale":"2024-09-12T18:08:12.059924+0000","last_undegraded":"2024-09-12T18:08:12.059924+0000","last_fullsized":"2024-09-12T18:08:12.059924+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'175","last_scrub_stamp":"2024-09-12T18:08:12.059737+0000","last_deep_scrub":"264'175","last_deep_scrub_stamp":"2024-09-12T18:08:12.059737+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.059737+0000","objects_scrubbed":11,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:59.307212+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7687392,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":325,"num_read_kb":13812,"num_write":937,"num_write_kb":31717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.648691+0000","last_change":"2024-09-12T17:29:56.955564+0000","last_active":"2024-09-12T18:05:59.648691+0000","last_peered":"2024-09-12T18:05:59.648691+0000","last_clean":"2024-09-12T18:05:59.648691+0000","last_became_active":"2024-09-12T17:29:56.955288+0000","last_became_peered":"2024-09-12T17:29:56.955288+0000","last_unstale":"2024-09-12T18:05:59.648691+0000","last_undegraded":"2024-09-12T18:05:59.648691+0000","last_fullsized":"2024-09-12T18:05:59.648691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'140","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.701859+0000","last_change":"2024-09-12T17:29:58.953188+0000","last_active":"2024-09-12T18:08:03.701859+0000","last_peered":"2024-09-12T18:08:03.701859+0000","last_clean":"2024-09-12T18:08:03.701859+0000","last_became_active":"2024-09-12T17:29:58.952878+0000","last_became_peered":"2024-09-12T17:29:58.952878+0000","last_unstale":"2024-09-12T18:08:03.701859+0000","last_undegraded":"2024-09-12T18:08:03.701859+0000","last_fullsized":"2024-09-12T18:08:03.701859+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":250,"num_write":156,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.653758+0000","last_change":"2024-09-12T17:30:00.970962+0000","last_active":"2024-09-12T18:06:09.653758+0000","last_peered":"2024-09-12T18:06:09.653758+0000","last_clean":"2024-09-12T18:06:09.653758+0000","last_became_active":"2024-09-12T17:30:00.970668+0000","last_became_peered":"2024-09-12T17:30:00.970668+0000","last_unstale":"2024-09-12T18:06:09.653758+0000","last_undegraded":"2024-09-12T18:06:09.653758+0000","last_fullsized":"2024-09-12T18:06:09.653758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'138","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:28.624792+0000","last_change":"2024-09-12T17:30:02.964408+0000","last_active":"2024-09-12T18:07:28.624792+0000","last_peered":"2024-09-12T18:07:28.624792+0000","last_clean":"2024-09-12T18:07:28.624792+0000","last_became_active":"2024-09-12T17:30:02.964125+0000","last_became_peered":"2024-09-12T17:30:02.964125+0000","last_unstale":"2024-09-12T18:07:28.624792+0000","last_undegraded":"2024-09-12T18:07:28.624792+0000","last_fullsized":"2024-09-12T18:07:28.624792+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":200,"num_read_kb":186,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'124","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.708252+0000","last_change":"2024-09-12T18:08:13.708252+0000","last_active":"2024-09-12T18:08:13.708252+0000","last_peered":"2024-09-12T18:08:13.708252+0000","last_clean":"2024-09-12T18:08:13.708252+0000","last_became_active":"2024-09-12T17:29:54.956019+0000","last_became_peered":"2024-09-12T17:29:54.956019+0000","last_unstale":"2024-09-12T18:08:13.708252+0000","last_undegraded":"2024-09-12T18:08:13.708252+0000","last_fullsized":"2024-09-12T18:08:13.708252+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-12T18:08:13.708174+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-12T18:08:13.708174+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.708174+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:20.307396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":560,"num_read_kb":466,"num_write":179,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'197","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.052727+0000","last_change":"2024-09-12T18:08:11.052727+0000","last_active":"2024-09-12T18:08:11.052727+0000","last_peered":"2024-09-12T18:08:11.052727+0000","last_clean":"2024-09-12T18:08:11.052727+0000","last_became_active":"2024-09-12T17:29:52.951013+0000","last_became_peered":"2024-09-12T17:29:52.951013+0000","last_unstale":"2024-09-12T18:08:11.052727+0000","last_undegraded":"2024-09-12T18:08:11.052727+0000","last_fullsized":"2024-09-12T18:08:11.052727+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'197","last_scrub_stamp":"2024-09-12T18:08:11.052631+0000","last_deep_scrub":"264'197","last_deep_scrub_stamp":"2024-09-12T18:08:11.052631+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.052631+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:32.972110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":90183,"num_write":908,"num_write_kb":29071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.652726+0000","last_change":"2024-09-12T17:29:56.959688+0000","last_active":"2024-09-12T18:05:59.652726+0000","last_peered":"2024-09-12T18:05:59.652726+0000","last_clean":"2024-09-12T18:05:59.652726+0000","last_became_active":"2024-09-12T17:29:56.959436+0000","last_became_peered":"2024-09-12T17:29:56.959436+0000","last_unstale":"2024-09-12T18:05:59.652726+0000","last_undegraded":"2024-09-12T18:05:59.652726+0000","last_fullsized":"2024-09-12T18:05:59.652726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'142","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.647809+0000","last_change":"2024-09-12T17:29:58.954865+0000","last_active":"2024-09-12T18:08:03.647809+0000","last_peered":"2024-09-12T18:08:03.647809+0000","last_clean":"2024-09-12T18:08:03.647809+0000","last_became_active":"2024-09-12T17:29:58.954548+0000","last_became_peered":"2024-09-12T17:29:58.954548+0000","last_unstale":"2024-09-12T18:08:03.647809+0000","last_undegraded":"2024-09-12T18:08:03.647809+0000","last_fullsized":"2024-09-12T18:08:03.647809+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12489,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'733","reported_seq":2378,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.898485+0000","last_change":"2024-09-12T17:30:00.960694+0000","last_active":"2024-09-12T18:08:03.898485+0000","last_peered":"2024-09-12T18:08:03.898485+0000","last_clean":"2024-09-12T18:08:03.898485+0000","last_became_active":"2024-09-12T17:30:00.960402+0000","last_became_peered":"2024-09-12T17:30:00.960402+0000","last_unstale":"2024-09-12T18:08:03.898485+0000","last_undegraded":"2024-09-12T18:08:03.898485+0000","last_fullsized":"2024-09-12T18:08:03.898485+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'95","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.486123+0000","last_change":"2024-09-12T17:30:02.969918+0000","last_active":"2024-09-12T18:06:20.486123+0000","last_peered":"2024-09-12T18:06:20.486123+0000","last_clean":"2024-09-12T18:06:20.486123+0000","last_became_active":"2024-09-12T17:30:02.969617+0000","last_became_peered":"2024-09-12T17:30:02.969617+0000","last_unstale":"2024-09-12T18:06:20.486123+0000","last_undegraded":"2024-09-12T18:06:20.486123+0000","last_fullsized":"2024-09-12T18:06:20.486123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:08.908464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":242,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'118","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.709781+0000","last_change":"2024-09-12T18:08:16.709781+0000","last_active":"2024-09-12T18:08:16.709781+0000","last_peered":"2024-09-12T18:08:16.709781+0000","last_clean":"2024-09-12T18:08:16.709781+0000","last_became_active":"2024-09-12T17:29:54.958362+0000","last_became_peered":"2024-09-12T17:29:54.958362+0000","last_unstale":"2024-09-12T18:08:16.709781+0000","last_undegraded":"2024-09-12T18:08:16.709781+0000","last_fullsized":"2024-09-12T18:08:16.709781+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-12T18:08:16.709692+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-12T18:08:16.709692+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.709692+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:36.417665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":415,"num_write":164,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'162","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.276109+0000","last_change":"2024-09-12T18:08:11.276109+0000","last_active":"2024-09-12T18:08:11.276109+0000","last_peered":"2024-09-12T18:08:11.276109+0000","last_clean":"2024-09-12T18:08:11.276109+0000","last_became_active":"2024-09-12T17:30:28.005099+0000","last_became_peered":"2024-09-12T17:30:28.005099+0000","last_unstale":"2024-09-12T18:08:11.276109+0000","last_undegraded":"2024-09-12T18:08:11.276109+0000","last_fullsized":"2024-09-12T18:08:11.276109+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T18:08:11.276007+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T18:08:11.276007+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.276007+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:24.791440+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":6854,"num_write":853,"num_write_kb":33010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1445,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.549488+0000","last_change":"2024-09-12T17:29:56.955646+0000","last_active":"2024-09-12T18:08:03.549488+0000","last_peered":"2024-09-12T18:08:03.549488+0000","last_clean":"2024-09-12T18:08:03.549488+0000","last_became_active":"2024-09-12T17:29:56.955321+0000","last_became_peered":"2024-09-12T17:29:56.955321+0000","last_unstale":"2024-09-12T18:08:03.549488+0000","last_undegraded":"2024-09-12T18:08:03.549488+0000","last_fullsized":"2024-09-12T18:08:03.549488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":954,"num_read_kb":954,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'79","reported_seq":587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.856219+0000","last_change":"2024-09-12T17:29:58.978790+0000","last_active":"2024-09-12T18:06:20.856219+0000","last_peered":"2024-09-12T18:06:20.856219+0000","last_clean":"2024-09-12T18:06:20.856219+0000","last_became_active":"2024-09-12T17:29:58.978480+0000","last_became_peered":"2024-09-12T17:29:58.978480+0000","last_unstale":"2024-09-12T18:06:20.856219+0000","last_undegraded":"2024-09-12T18:06:20.856219+0000","last_fullsized":"2024-09-12T18:06:20.856219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'759","reported_seq":4528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.899428+0000","last_change":"2024-09-12T17:30:00.959471+0000","last_active":"2024-09-12T18:08:03.899428+0000","last_peered":"2024-09-12T18:08:03.899428+0000","last_clean":"2024-09-12T18:08:03.899428+0000","last_became_active":"2024-09-12T17:30:00.959015+0000","last_became_peered":"2024-09-12T17:30:00.959015+0000","last_unstale":"2024-09-12T18:08:03.899428+0000","last_undegraded":"2024-09-12T18:08:03.899428+0000","last_fullsized":"2024-09-12T18:08:03.899428+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'126","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.966308+0000","last_change":"2024-09-12T17:30:02.972327+0000","last_active":"2024-09-12T18:06:01.966308+0000","last_peered":"2024-09-12T18:06:01.966308+0000","last_clean":"2024-09-12T18:06:01.966308+0000","last_became_active":"2024-09-12T17:30:02.972020+0000","last_became_peered":"2024-09-12T17:30:02.972020+0000","last_unstale":"2024-09-12T18:06:01.966308+0000","last_undegraded":"2024-09-12T18:06:01.966308+0000","last_fullsized":"2024-09-12T18:06:01.966308+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.485323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":156,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.252876+0000","last_change":"2024-09-12T18:08:21.252876+0000","last_active":"2024-09-12T18:08:21.252876+0000","last_peered":"2024-09-12T18:08:21.252876+0000","last_clean":"2024-09-12T18:08:21.252876+0000","last_became_active":"2024-09-12T17:29:54.950966+0000","last_became_peered":"2024-09-12T17:29:54.950966+0000","last_unstale":"2024-09-12T18:08:21.252876+0000","last_undegraded":"2024-09-12T18:08:21.252876+0000","last_fullsized":"2024-09-12T18:08:21.252876+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T18:08:21.252794+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T18:08:21.252794+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.252794+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:22.803219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":955,"num_read_kb":788,"num_write":339,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'177","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.082011+0000","last_change":"2024-09-12T18:08:09.082011+0000","last_active":"2024-09-12T18:08:09.082011+0000","last_peered":"2024-09-12T18:08:09.082011+0000","last_clean":"2024-09-12T18:08:09.082011+0000","last_became_active":"2024-09-12T17:29:52.948591+0000","last_became_peered":"2024-09-12T17:29:52.948591+0000","last_unstale":"2024-09-12T18:08:09.082011+0000","last_undegraded":"2024-09-12T18:08:09.082011+0000","last_fullsized":"2024-09-12T18:08:09.082011+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:08:09.081909+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:08:09.081909+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.081909+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:16.244554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1260936,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":2968,"num_write":842,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.523147+0000","last_change":"2024-09-12T17:29:56.953681+0000","last_active":"2024-09-12T18:05:59.523147+0000","last_peered":"2024-09-12T18:05:59.523147+0000","last_clean":"2024-09-12T18:05:59.523147+0000","last_became_active":"2024-09-12T17:29:56.953198+0000","last_became_peered":"2024-09-12T17:29:56.953198+0000","last_unstale":"2024-09-12T18:05:59.523147+0000","last_undegraded":"2024-09-12T18:05:59.523147+0000","last_fullsized":"2024-09-12T18:05:59.523147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'190","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.811630+0000","last_change":"2024-09-12T17:29:58.957118+0000","last_active":"2024-09-12T18:08:03.811630+0000","last_peered":"2024-09-12T18:08:03.811630+0000","last_clean":"2024-09-12T18:08:03.811630+0000","last_became_active":"2024-09-12T17:29:58.956828+0000","last_became_peered":"2024-09-12T17:29:58.956828+0000","last_unstale":"2024-09-12T18:08:03.811630+0000","last_undegraded":"2024-09-12T18:08:03.811630+0000","last_fullsized":"2024-09-12T18:08:03.811630+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10697,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":841,"num_read_kb":909,"num_write":1328,"num_write_kb":1209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.523634+0000","last_change":"2024-09-12T17:30:00.963569+0000","last_active":"2024-09-12T18:06:04.523634+0000","last_peered":"2024-09-12T18:06:04.523634+0000","last_clean":"2024-09-12T18:06:04.523634+0000","last_became_active":"2024-09-12T17:30:00.963117+0000","last_became_peered":"2024-09-12T17:30:00.963117+0000","last_unstale":"2024-09-12T18:06:04.523634+0000","last_undegraded":"2024-09-12T18:06:04.523634+0000","last_fullsized":"2024-09-12T18:06:04.523634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'115","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:00.931424+0000","last_change":"2024-09-12T17:30:02.963673+0000","last_active":"2024-09-12T18:06:00.931424+0000","last_peered":"2024-09-12T18:06:00.931424+0000","last_clean":"2024-09-12T18:06:00.931424+0000","last_became_active":"2024-09-12T17:30:02.963368+0000","last_became_peered":"2024-09-12T17:30:02.963368+0000","last_unstale":"2024-09-12T18:06:00.931424+0000","last_undegraded":"2024-09-12T18:06:00.931424+0000","last_fullsized":"2024-09-12T18:06:00.931424+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:30.008139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":267,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'271","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.085593+0000","last_change":"2024-09-12T18:08:18.085593+0000","last_active":"2024-09-12T18:08:18.085593+0000","last_peered":"2024-09-12T18:08:18.085593+0000","last_clean":"2024-09-12T18:08:18.085593+0000","last_became_active":"2024-09-12T17:29:54.960486+0000","last_became_peered":"2024-09-12T17:29:54.960486+0000","last_unstale":"2024-09-12T18:08:18.085593+0000","last_undegraded":"2024-09-12T18:08:18.085593+0000","last_fullsized":"2024-09-12T18:08:18.085593+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-12T18:08:18.085509+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-12T18:08:18.085509+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.085509+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:18.452979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1268,"num_write":469,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.670133+0000","last_change":"2024-09-12T18:08:10.670133+0000","last_active":"2024-09-12T18:08:10.670133+0000","last_peered":"2024-09-12T18:08:10.670133+0000","last_clean":"2024-09-12T18:08:10.670133+0000","last_became_active":"2024-09-12T17:29:36.163604+0000","last_became_peered":"2024-09-12T17:29:36.163604+0000","last_unstale":"2024-09-12T18:08:10.670133+0000","last_undegraded":"2024-09-12T18:08:10.670133+0000","last_fullsized":"2024-09-12T18:08:10.670133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T18:08:10.670050+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T18:08:10.670050+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.670050+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:28.217846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.564490+0000","last_change":"2024-09-12T18:08:09.564490+0000","last_active":"2024-09-12T18:08:09.564490+0000","last_peered":"2024-09-12T18:08:09.564490+0000","last_clean":"2024-09-12T18:08:09.564490+0000","last_became_active":"2024-09-12T17:29:41.963643+0000","last_became_peered":"2024-09-12T17:29:41.963643+0000","last_unstale":"2024-09-12T18:08:09.564490+0000","last_undegraded":"2024-09-12T18:08:09.564490+0000","last_fullsized":"2024-09-12T18:08:09.564490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:09.564408+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:09.564408+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.564408+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:57.121488+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00056994999999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'207","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.049333+0000","last_change":"2024-09-12T18:08:10.049333+0000","last_active":"2024-09-12T18:08:10.049333+0000","last_peered":"2024-09-12T18:08:10.049333+0000","last_clean":"2024-09-12T18:08:10.049333+0000","last_became_active":"2024-09-12T17:29:52.954839+0000","last_became_peered":"2024-09-12T17:29:52.954839+0000","last_unstale":"2024-09-12T18:08:10.049333+0000","last_undegraded":"2024-09-12T18:08:10.049333+0000","last_fullsized":"2024-09-12T18:08:10.049333+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:10.049250+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:10.049250+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.049250+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:44.893531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395904,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":449,"num_read_kb":3374,"num_write":1041,"num_write_kb":36567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.685110+0000","last_change":"2024-09-12T17:29:56.955566+0000","last_active":"2024-09-12T18:05:24.685110+0000","last_peered":"2024-09-12T18:05:24.685110+0000","last_clean":"2024-09-12T18:05:24.685110+0000","last_became_active":"2024-09-12T17:29:56.955260+0000","last_became_peered":"2024-09-12T17:29:56.955260+0000","last_unstale":"2024-09-12T18:05:24.685110+0000","last_undegraded":"2024-09-12T18:05:24.685110+0000","last_fullsized":"2024-09-12T18:05:24.685110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:09.539939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'299","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.826304+0000","last_change":"2024-09-12T17:29:58.954504+0000","last_active":"2024-09-12T18:08:03.826304+0000","last_peered":"2024-09-12T18:08:03.826304+0000","last_clean":"2024-09-12T18:08:03.826304+0000","last_became_active":"2024-09-12T17:29:58.954205+0000","last_became_peered":"2024-09-12T17:29:58.954205+0000","last_unstale":"2024-09-12T18:08:03.826304+0000","last_undegraded":"2024-09-12T18:08:03.826304+0000","last_fullsized":"2024-09-12T18:08:03.826304+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:15.729749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17428,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":763,"num_write":498,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640713+0000","last_change":"2024-09-12T17:30:00.964518+0000","last_active":"2024-09-12T18:04:44.640713+0000","last_peered":"2024-09-12T18:04:44.640713+0000","last_clean":"2024-09-12T18:04:44.640713+0000","last_became_active":"2024-09-12T17:30:00.964241+0000","last_became_peered":"2024-09-12T17:30:00.964241+0000","last_unstale":"2024-09-12T18:04:44.640713+0000","last_undegraded":"2024-09-12T18:04:44.640713+0000","last_fullsized":"2024-09-12T18:04:44.640713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:14.242835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'221","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.251802+0000","last_change":"2024-09-12T17:30:02.964194+0000","last_active":"2024-09-12T18:06:21.251802+0000","last_peered":"2024-09-12T18:06:21.251802+0000","last_clean":"2024-09-12T18:06:21.251802+0000","last_became_active":"2024-09-12T17:30:02.963890+0000","last_became_peered":"2024-09-12T17:30:02.963890+0000","last_unstale":"2024-09-12T18:06:21.251802+0000","last_undegraded":"2024-09-12T18:06:21.251802+0000","last_fullsized":"2024-09-12T18:06:21.251802+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.997124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":552,"num_write":485,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'385","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.134748+0000","last_change":"2024-09-12T18:08:18.134748+0000","last_active":"2024-09-12T18:08:18.134748+0000","last_peered":"2024-09-12T18:08:18.134748+0000","last_clean":"2024-09-12T18:08:18.134748+0000","last_became_active":"2024-09-12T17:29:54.944624+0000","last_became_peered":"2024-09-12T17:29:54.944624+0000","last_unstale":"2024-09-12T18:08:18.134748+0000","last_undegraded":"2024-09-12T18:08:18.134748+0000","last_fullsized":"2024-09-12T18:08:18.134748+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T18:08:18.134658+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T18:08:18.134658+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.134658+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:17.271829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1668,"num_read_kb":1443,"num_write":651,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7559,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.685327+0000","last_change":"2024-09-12T18:08:12.685327+0000","last_active":"2024-09-12T18:08:12.685327+0000","last_peered":"2024-09-12T18:08:12.685327+0000","last_clean":"2024-09-12T18:08:12.685327+0000","last_became_active":"2024-09-12T17:29:41.963499+0000","last_became_peered":"2024-09-12T17:29:41.963499+0000","last_unstale":"2024-09-12T18:08:12.685327+0000","last_undegraded":"2024-09-12T18:08:12.685327+0000","last_fullsized":"2024-09-12T18:08:12.685327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:12.685224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:12.685224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.685224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:53.962768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470655,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'149","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:07.126035+0000","last_change":"2024-09-12T18:08:07.126035+0000","last_active":"2024-09-12T18:08:07.126035+0000","last_peered":"2024-09-12T18:08:07.126035+0000","last_clean":"2024-09-12T18:08:07.126035+0000","last_became_active":"2024-09-12T17:29:52.949339+0000","last_became_peered":"2024-09-12T17:29:52.949339+0000","last_unstale":"2024-09-12T18:08:07.126035+0000","last_undegraded":"2024-09-12T18:08:07.126035+0000","last_fullsized":"2024-09-12T18:08:07.126035+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T18:08:07.125919+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T18:08:07.125919+0000","last_clean_scrub_stamp":"2024-09-12T18:08:07.125919+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:14.630758+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":3075,"num_write":751,"num_write_kb":23555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.635977+0000","last_change":"2024-09-12T17:29:56.954436+0000","last_active":"2024-09-12T18:04:39.635977+0000","last_peered":"2024-09-12T18:04:39.635977+0000","last_clean":"2024-09-12T18:04:39.635977+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:04:39.635977+0000","last_undegraded":"2024-09-12T18:04:39.635977+0000","last_fullsized":"2024-09-12T18:04:39.635977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:38.720237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'787","reported_seq":2174,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.822093+0000","last_change":"2024-09-12T17:29:58.958558+0000","last_active":"2024-09-12T18:08:03.822093+0000","last_peered":"2024-09-12T18:08:03.822093+0000","last_clean":"2024-09-12T18:08:03.822093+0000","last_became_active":"2024-09-12T17:29:58.958269+0000","last_became_peered":"2024-09-12T17:29:58.958269+0000","last_unstale":"2024-09-12T18:08:03.822093+0000","last_undegraded":"2024-09-12T18:08:03.822093+0000","last_fullsized":"2024-09-12T18:08:03.822093+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:14.582465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37829,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1137,"num_read_kb":1322,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:34.686581+0000","last_change":"2024-09-12T17:30:00.958433+0000","last_active":"2024-09-12T18:05:34.686581+0000","last_peered":"2024-09-12T18:05:34.686581+0000","last_clean":"2024-09-12T18:05:34.686581+0000","last_became_active":"2024-09-12T17:30:00.957628+0000","last_became_peered":"2024-09-12T17:30:00.957628+0000","last_unstale":"2024-09-12T18:05:34.686581+0000","last_undegraded":"2024-09-12T18:05:34.686581+0000","last_fullsized":"2024-09-12T18:05:34.686581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:09.962381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'136","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.227859+0000","last_change":"2024-09-12T17:30:02.960607+0000","last_active":"2024-09-12T18:05:52.227859+0000","last_peered":"2024-09-12T18:05:52.227859+0000","last_clean":"2024-09-12T18:05:52.227859+0000","last_became_active":"2024-09-12T17:30:02.960109+0000","last_became_peered":"2024-09-12T17:30:02.960109+0000","last_unstale":"2024-09-12T18:05:52.227859+0000","last_undegraded":"2024-09-12T18:05:52.227859+0000","last_fullsized":"2024-09-12T18:05:52.227859+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:27.244929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":318,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'88","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.241855+0000","last_change":"2024-09-12T18:08:18.241855+0000","last_active":"2024-09-12T18:08:18.241855+0000","last_peered":"2024-09-12T18:08:18.241855+0000","last_clean":"2024-09-12T18:08:18.241855+0000","last_became_active":"2024-09-12T17:29:54.958310+0000","last_became_peered":"2024-09-12T17:29:54.958310+0000","last_unstale":"2024-09-12T18:08:18.241855+0000","last_undegraded":"2024-09-12T18:08:18.241855+0000","last_fullsized":"2024-09-12T18:08:18.241855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'88","last_scrub_stamp":"2024-09-12T18:08:18.241756+0000","last_deep_scrub":"264'88","last_deep_scrub_stamp":"2024-09-12T18:08:18.241756+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.241756+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:31.581719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":367,"num_read_kb":311,"num_write":135,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.255313+0000","last_change":"2024-09-12T18:08:08.255313+0000","last_active":"2024-09-12T18:08:08.255313+0000","last_peered":"2024-09-12T18:08:08.255313+0000","last_clean":"2024-09-12T18:08:08.255313+0000","last_became_active":"2024-09-12T17:29:42.064972+0000","last_became_peered":"2024-09-12T17:29:42.064972+0000","last_unstale":"2024-09-12T18:08:08.255313+0000","last_undegraded":"2024-09-12T18:08:08.255313+0000","last_fullsized":"2024-09-12T18:08:08.255313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:08.255224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:08.255224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.255224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:11.379409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047741400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'211","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.313282+0000","last_change":"2024-09-12T18:08:09.313282+0000","last_active":"2024-09-12T18:08:09.313282+0000","last_peered":"2024-09-12T18:08:09.313282+0000","last_clean":"2024-09-12T18:08:09.313282+0000","last_became_active":"2024-09-12T17:29:52.949301+0000","last_became_peered":"2024-09-12T17:29:52.949301+0000","last_unstale":"2024-09-12T18:08:09.313282+0000","last_undegraded":"2024-09-12T18:08:09.313282+0000","last_fullsized":"2024-09-12T18:08:09.313282+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-09-12T18:08:09.313149+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-09-12T18:08:09.313149+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.313149+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:08.195813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":2667,"num_write":1034,"num_write_kb":7887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.462126+0000","last_change":"2024-09-12T18:08:21.462126+0000","last_active":"2024-09-12T18:08:21.462126+0000","last_peered":"2024-09-12T18:08:21.462126+0000","last_clean":"2024-09-12T18:08:21.462126+0000","last_became_active":"2024-09-12T17:29:56.956623+0000","last_became_peered":"2024-09-12T17:29:56.956623+0000","last_unstale":"2024-09-12T18:08:21.462126+0000","last_undegraded":"2024-09-12T18:08:21.462126+0000","last_fullsized":"2024-09-12T18:08:21.462126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:21.462035+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:21.462035+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.462035+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.681426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'210","reported_seq":1203,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:35.761738+0000","last_change":"2024-09-12T17:29:58.980974+0000","last_active":"2024-09-12T18:07:35.761738+0000","last_peered":"2024-09-12T18:07:35.761738+0000","last_clean":"2024-09-12T18:07:35.761738+0000","last_became_active":"2024-09-12T17:29:58.980697+0000","last_became_peered":"2024-09-12T17:29:58.980697+0000","last_unstale":"2024-09-12T18:07:35.761738+0000","last_undegraded":"2024-09-12T18:07:35.761738+0000","last_fullsized":"2024-09-12T18:07:35.761738+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:02.768234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":123,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648081+0000","last_change":"2024-09-12T17:30:00.968730+0000","last_active":"2024-09-12T18:05:29.648081+0000","last_peered":"2024-09-12T18:05:29.648081+0000","last_clean":"2024-09-12T18:05:29.648081+0000","last_became_active":"2024-09-12T17:30:00.968468+0000","last_became_peered":"2024-09-12T17:30:00.968468+0000","last_unstale":"2024-09-12T18:05:29.648081+0000","last_undegraded":"2024-09-12T18:05:29.648081+0000","last_fullsized":"2024-09-12T18:05:29.648081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:49.912468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'248","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.393235+0000","last_change":"2024-09-12T17:30:02.967215+0000","last_active":"2024-09-12T18:06:21.393235+0000","last_peered":"2024-09-12T18:06:21.393235+0000","last_clean":"2024-09-12T18:06:21.393235+0000","last_became_active":"2024-09-12T17:30:02.966910+0000","last_became_peered":"2024-09-12T17:30:02.966910+0000","last_unstale":"2024-09-12T18:06:21.393235+0000","last_undegraded":"2024-09-12T18:06:21.393235+0000","last_fullsized":"2024-09-12T18:06:21.393235+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":529,"num_write":537,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'112","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.211065+0000","last_change":"2024-09-12T18:08:17.211065+0000","last_active":"2024-09-12T18:08:17.211065+0000","last_peered":"2024-09-12T18:08:17.211065+0000","last_clean":"2024-09-12T18:08:17.211065+0000","last_became_active":"2024-09-12T17:29:54.948402+0000","last_became_peered":"2024-09-12T17:29:54.948402+0000","last_unstale":"2024-09-12T18:08:17.211065+0000","last_undegraded":"2024-09-12T18:08:17.211065+0000","last_fullsized":"2024-09-12T18:08:17.211065+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-12T18:08:17.210956+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-12T18:08:17.210956+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.210956+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:48.357477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":452,"num_write":172,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.547679+0000","last_change":"2024-09-12T18:08:10.547679+0000","last_active":"2024-09-12T18:08:10.547679+0000","last_peered":"2024-09-12T18:08:10.547679+0000","last_clean":"2024-09-12T18:08:10.547679+0000","last_became_active":"2024-09-12T17:29:41.961122+0000","last_became_peered":"2024-09-12T17:29:41.961122+0000","last_unstale":"2024-09-12T18:08:10.547679+0000","last_undegraded":"2024-09-12T18:08:10.547679+0000","last_fullsized":"2024-09-12T18:08:10.547679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:10.547560+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:10.547560+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.547560+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:55.070358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00095277999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'244","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.748940+0000","last_change":"2024-09-12T18:08:08.748940+0000","last_active":"2024-09-12T18:08:08.748940+0000","last_peered":"2024-09-12T18:08:08.748940+0000","last_clean":"2024-09-12T18:08:08.748940+0000","last_became_active":"2024-09-12T17:29:52.958406+0000","last_became_peered":"2024-09-12T17:29:52.958406+0000","last_unstale":"2024-09-12T18:08:08.748940+0000","last_undegraded":"2024-09-12T18:08:08.748940+0000","last_fullsized":"2024-09-12T18:08:08.748940+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'244","last_scrub_stamp":"2024-09-12T18:08:08.748824+0000","last_deep_scrub":"264'244","last_deep_scrub_stamp":"2024-09-12T18:08:08.748824+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.748824+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:58.654869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":569,"num_read_kb":48737,"num_write":1100,"num_write_kb":63490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648110+0000","last_change":"2024-09-12T17:29:56.954279+0000","last_active":"2024-09-12T18:05:29.648110+0000","last_peered":"2024-09-12T18:05:29.648110+0000","last_clean":"2024-09-12T18:05:29.648110+0000","last_became_active":"2024-09-12T17:29:56.954018+0000","last_became_peered":"2024-09-12T17:29:56.954018+0000","last_unstale":"2024-09-12T18:05:29.648110+0000","last_undegraded":"2024-09-12T18:05:29.648110+0000","last_fullsized":"2024-09-12T18:05:29.648110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.921260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'111","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:35.852981+0000","last_change":"2024-09-12T17:29:58.954279+0000","last_active":"2024-09-12T18:07:35.852981+0000","last_peered":"2024-09-12T18:07:35.852981+0000","last_clean":"2024-09-12T18:07:35.852981+0000","last_became_active":"2024-09-12T17:29:58.953909+0000","last_became_peered":"2024-09-12T17:29:58.953909+0000","last_unstale":"2024-09-12T18:07:35.852981+0000","last_undegraded":"2024-09-12T18:07:35.852981+0000","last_fullsized":"2024-09-12T18:07:35.852981+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:29.055630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":90,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.512851+0000","last_change":"2024-09-12T17:30:00.967582+0000","last_active":"2024-09-12T18:04:44.512851+0000","last_peered":"2024-09-12T18:04:44.512851+0000","last_clean":"2024-09-12T18:04:44.512851+0000","last_became_active":"2024-09-12T17:30:00.967279+0000","last_became_peered":"2024-09-12T17:30:00.967279+0000","last_unstale":"2024-09-12T18:04:44.512851+0000","last_undegraded":"2024-09-12T18:04:44.512851+0000","last_fullsized":"2024-09-12T18:04:44.512851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:05.249822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'207","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.809120+0000","last_change":"2024-09-12T17:30:02.969741+0000","last_active":"2024-09-12T18:05:55.809120+0000","last_peered":"2024-09-12T18:05:55.809120+0000","last_clean":"2024-09-12T18:05:55.809120+0000","last_became_active":"2024-09-12T17:30:02.969486+0000","last_became_peered":"2024-09-12T17:30:02.969486+0000","last_unstale":"2024-09-12T18:05:55.809120+0000","last_undegraded":"2024-09-12T18:05:55.809120+0000","last_fullsized":"2024-09-12T18:05:55.809120+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:39.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":397,"num_write":473,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'156","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.251799+0000","last_change":"2024-09-12T18:08:16.251799+0000","last_active":"2024-09-12T18:08:16.251799+0000","last_peered":"2024-09-12T18:08:16.251799+0000","last_clean":"2024-09-12T18:08:16.251799+0000","last_became_active":"2024-09-12T17:29:54.963669+0000","last_became_peered":"2024-09-12T17:29:54.963669+0000","last_unstale":"2024-09-12T18:08:16.251799+0000","last_undegraded":"2024-09-12T18:08:16.251799+0000","last_fullsized":"2024-09-12T18:08:16.251799+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-12T18:08:16.251716+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-12T18:08:16.251716+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.251716+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:44.134038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":549,"num_write":259,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'205","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.503195+0000","last_change":"2024-09-12T18:08:11.503195+0000","last_active":"2024-09-12T18:08:11.503195+0000","last_peered":"2024-09-12T18:08:11.503195+0000","last_clean":"2024-09-12T18:08:11.503195+0000","last_became_active":"2024-09-12T17:29:52.954220+0000","last_became_peered":"2024-09-12T17:29:52.954220+0000","last_unstale":"2024-09-12T18:08:11.503195+0000","last_undegraded":"2024-09-12T18:08:11.503195+0000","last_fullsized":"2024-09-12T18:08:11.503195+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'205","last_scrub_stamp":"2024-09-12T18:08:11.503069+0000","last_deep_scrub":"264'205","last_deep_scrub_stamp":"2024-09-12T18:08:11.503069+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.503069+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:14.820377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":525,"num_read_kb":74998,"num_write":1066,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.352125+0000","last_change":"2024-09-12T18:08:08.352125+0000","last_active":"2024-09-12T18:08:08.352125+0000","last_peered":"2024-09-12T18:08:08.352125+0000","last_clean":"2024-09-12T18:08:08.352125+0000","last_became_active":"2024-09-12T17:29:42.064741+0000","last_became_peered":"2024-09-12T17:29:42.064741+0000","last_unstale":"2024-09-12T18:08:08.352125+0000","last_undegraded":"2024-09-12T18:08:08.352125+0000","last_fullsized":"2024-09-12T18:08:08.352125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:08.352056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:08.352056+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.352056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:03.352768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043924099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647471+0000","last_change":"2024-09-12T17:29:56.955865+0000","last_active":"2024-09-12T18:05:24.647471+0000","last_peered":"2024-09-12T18:05:24.647471+0000","last_clean":"2024-09-12T18:05:24.647471+0000","last_became_active":"2024-09-12T17:29:56.955562+0000","last_became_peered":"2024-09-12T17:29:56.955562+0000","last_unstale":"2024-09-12T18:05:24.647471+0000","last_undegraded":"2024-09-12T18:05:24.647471+0000","last_fullsized":"2024-09-12T18:05:24.647471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:02.094255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'264","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.765803+0000","last_change":"2024-09-12T17:29:58.960788+0000","last_active":"2024-09-12T18:08:03.765803+0000","last_peered":"2024-09-12T18:08:03.765803+0000","last_clean":"2024-09-12T18:08:03.765803+0000","last_became_active":"2024-09-12T17:29:58.960410+0000","last_became_peered":"2024-09-12T17:29:58.960410+0000","last_unstale":"2024-09-12T18:08:03.765803+0000","last_undegraded":"2024-09-12T18:08:03.765803+0000","last_fullsized":"2024-09-12T18:08:03.765803+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:42.521026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14017,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":378,"num_read_kb":510,"num_write":242,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519052+0000","last_change":"2024-09-12T17:30:00.963954+0000","last_active":"2024-09-12T18:05:29.519052+0000","last_peered":"2024-09-12T18:05:29.519052+0000","last_clean":"2024-09-12T18:05:29.519052+0000","last_became_active":"2024-09-12T17:30:00.963660+0000","last_became_peered":"2024-09-12T17:30:00.963660+0000","last_unstale":"2024-09-12T18:05:29.519052+0000","last_undegraded":"2024-09-12T18:05:29.519052+0000","last_fullsized":"2024-09-12T18:05:29.519052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:07.402246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'169","reported_seq":679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.653187+0000","last_change":"2024-09-12T17:30:02.972165+0000","last_active":"2024-09-12T18:06:04.653187+0000","last_peered":"2024-09-12T18:06:04.653187+0000","last_clean":"2024-09-12T18:06:04.653187+0000","last_became_active":"2024-09-12T17:30:02.971807+0000","last_became_peered":"2024-09-12T17:30:02.971807+0000","last_unstale":"2024-09-12T18:06:04.653187+0000","last_undegraded":"2024-09-12T18:06:04.653187+0000","last_fullsized":"2024-09-12T18:06:04.653187+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":246,"num_write":442,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'192","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.154129+0000","last_change":"2024-09-12T18:08:15.154129+0000","last_active":"2024-09-12T18:08:15.154129+0000","last_peered":"2024-09-12T18:08:15.154129+0000","last_clean":"2024-09-12T18:08:15.154129+0000","last_became_active":"2024-09-12T17:29:54.958998+0000","last_became_peered":"2024-09-12T17:29:54.958998+0000","last_unstale":"2024-09-12T18:08:15.154129+0000","last_undegraded":"2024-09-12T18:08:15.154129+0000","last_fullsized":"2024-09-12T18:08:15.154129+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-09-12T18:08:15.154013+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-09-12T18:08:15.154013+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.154013+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:33.665464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":764,"num_write":273,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'224","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.319484+0000","last_change":"2024-09-12T18:08:10.319484+0000","last_active":"2024-09-12T18:08:10.319484+0000","last_peered":"2024-09-12T18:08:10.319484+0000","last_clean":"2024-09-12T18:08:10.319484+0000","last_became_active":"2024-09-12T17:29:52.955429+0000","last_became_peered":"2024-09-12T17:29:52.955429+0000","last_unstale":"2024-09-12T18:08:10.319484+0000","last_undegraded":"2024-09-12T18:08:10.319484+0000","last_fullsized":"2024-09-12T18:08:10.319484+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'224","last_scrub_stamp":"2024-09-12T18:08:10.319399+0000","last_deep_scrub":"264'224","last_deep_scrub_stamp":"2024-09-12T18:08:10.319399+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.319399+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:41.245590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170313,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":39247,"num_write":990,"num_write_kb":44156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.715167+0000","last_change":"2024-09-12T18:08:11.715167+0000","last_active":"2024-09-12T18:08:11.715167+0000","last_peered":"2024-09-12T18:08:11.715167+0000","last_clean":"2024-09-12T18:08:11.715167+0000","last_became_active":"2024-09-12T17:29:42.064736+0000","last_became_peered":"2024-09-12T17:29:42.064736+0000","last_unstale":"2024-09-12T18:08:11.715167+0000","last_undegraded":"2024-09-12T18:08:11.715167+0000","last_fullsized":"2024-09-12T18:08:11.715167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:11.715042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:11.715042+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.715042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:08.443705+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045118300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.082844+0000","last_change":"2024-09-12T18:08:23.082844+0000","last_active":"2024-09-12T18:08:23.082844+0000","last_peered":"2024-09-12T18:08:23.082844+0000","last_clean":"2024-09-12T18:08:23.082844+0000","last_became_active":"2024-09-12T17:29:56.957503+0000","last_became_peered":"2024-09-12T17:29:56.957503+0000","last_unstale":"2024-09-12T18:08:23.082844+0000","last_undegraded":"2024-09-12T18:08:23.082844+0000","last_fullsized":"2024-09-12T18:08:23.082844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:23.082745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:23.082745+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.082745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:14.276157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'150","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:53.753445+0000","last_change":"2024-09-12T17:29:58.978826+0000","last_active":"2024-09-12T18:05:53.753445+0000","last_peered":"2024-09-12T18:05:53.753445+0000","last_clean":"2024-09-12T18:05:53.753445+0000","last_became_active":"2024-09-12T17:29:58.978487+0000","last_became_peered":"2024-09-12T17:29:58.978487+0000","last_unstale":"2024-09-12T18:05:53.753445+0000","last_undegraded":"2024-09-12T18:05:53.753445+0000","last_fullsized":"2024-09-12T18:05:53.753445+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:07.080227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":172,"num_read_kb":165,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'771","reported_seq":2444,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.896602+0000","last_change":"2024-09-12T17:30:00.957003+0000","last_active":"2024-09-12T18:08:03.896602+0000","last_peered":"2024-09-12T18:08:03.896602+0000","last_clean":"2024-09-12T18:08:03.896602+0000","last_became_active":"2024-09-12T17:30:00.956655+0000","last_became_peered":"2024-09-12T17:30:00.956655+0000","last_unstale":"2024-09-12T18:08:03.896602+0000","last_undegraded":"2024-09-12T18:08:03.896602+0000","last_fullsized":"2024-09-12T18:08:03.896602+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'117","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:18.421406+0000","last_change":"2024-09-12T17:30:02.969523+0000","last_active":"2024-09-12T18:06:18.421406+0000","last_peered":"2024-09-12T18:06:18.421406+0000","last_clean":"2024-09-12T18:06:18.421406+0000","last_became_active":"2024-09-12T17:30:02.968978+0000","last_became_peered":"2024-09-12T17:30:02.968978+0000","last_unstale":"2024-09-12T18:06:18.421406+0000","last_undegraded":"2024-09-12T18:06:18.421406+0000","last_fullsized":"2024-09-12T18:06:18.421406+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:20.219209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1365,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":174,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'406","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.094428+0000","last_change":"2024-09-12T18:08:17.094428+0000","last_active":"2024-09-12T18:08:17.094428+0000","last_peered":"2024-09-12T18:08:17.094428+0000","last_clean":"2024-09-12T18:08:17.094428+0000","last_became_active":"2024-09-12T17:29:54.955170+0000","last_became_peered":"2024-09-12T17:29:54.955170+0000","last_unstale":"2024-09-12T18:08:17.094428+0000","last_undegraded":"2024-09-12T18:08:17.094428+0000","last_fullsized":"2024-09-12T18:08:17.094428+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-09-12T18:08:17.094343+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-09-12T18:08:17.094343+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.094343+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:22.112938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1829,"num_read_kb":1585,"num_write":674,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'168","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.262237+0000","last_change":"2024-09-12T18:08:09.262237+0000","last_active":"2024-09-12T18:08:09.262237+0000","last_peered":"2024-09-12T18:08:09.262237+0000","last_clean":"2024-09-12T18:08:09.262237+0000","last_became_active":"2024-09-12T17:30:28.004804+0000","last_became_peered":"2024-09-12T17:30:28.004804+0000","last_unstale":"2024-09-12T18:08:09.262237+0000","last_undegraded":"2024-09-12T18:08:09.262237+0000","last_fullsized":"2024-09-12T18:08:09.262237+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-12T18:08:09.262150+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-12T18:08:09.262150+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.262150+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:43.192647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262290,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":342,"num_read_kb":56981,"num_write":802,"num_write_kb":25989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:07.370292+0000","last_change":"2024-09-12T18:08:07.370292+0000","last_active":"2024-09-12T18:08:07.370292+0000","last_peered":"2024-09-12T18:08:07.370292+0000","last_clean":"2024-09-12T18:08:07.370292+0000","last_became_active":"2024-09-12T17:29:41.961194+0000","last_became_peered":"2024-09-12T17:29:41.961194+0000","last_unstale":"2024-09-12T18:08:07.370292+0000","last_undegraded":"2024-09-12T18:08:07.370292+0000","last_fullsized":"2024-09-12T18:08:07.370292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:07.370196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:07.370196+0000","last_clean_scrub_stamp":"2024-09-12T18:08:07.370196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:17.088343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049442699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.518488+0000","last_change":"2024-09-12T17:29:56.956156+0000","last_active":"2024-09-12T18:05:24.518488+0000","last_peered":"2024-09-12T18:05:24.518488+0000","last_clean":"2024-09-12T18:05:24.518488+0000","last_became_active":"2024-09-12T17:29:56.955865+0000","last_became_peered":"2024-09-12T17:29:56.955865+0000","last_unstale":"2024-09-12T18:05:24.518488+0000","last_undegraded":"2024-09-12T18:05:24.518488+0000","last_fullsized":"2024-09-12T18:05:24.518488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:29.721519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'96","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.072656+0000","last_change":"2024-09-12T17:29:58.954437+0000","last_active":"2024-09-12T18:05:52.072656+0000","last_peered":"2024-09-12T18:05:52.072656+0000","last_clean":"2024-09-12T18:05:52.072656+0000","last_became_active":"2024-09-12T17:29:58.953924+0000","last_became_peered":"2024-09-12T17:29:58.953924+0000","last_unstale":"2024-09-12T18:05:52.072656+0000","last_undegraded":"2024-09-12T18:05:52.072656+0000","last_fullsized":"2024-09-12T18:05:52.072656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:40.076452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":108,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'780","reported_seq":2093,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.783294+0000","last_change":"2024-09-12T17:30:00.967465+0000","last_active":"2024-09-12T18:08:03.783294+0000","last_peered":"2024-09-12T18:08:03.783294+0000","last_clean":"2024-09-12T18:08:03.783294+0000","last_became_active":"2024-09-12T17:30:00.967168+0000","last_became_peered":"2024-09-12T17:30:00.967168+0000","last_unstale":"2024-09-12T18:08:03.783294+0000","last_undegraded":"2024-09-12T18:08:03.783294+0000","last_fullsized":"2024-09-12T18:08:03.783294+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:34.280045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'300","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.653134+0000","last_change":"2024-09-12T17:30:02.969830+0000","last_active":"2024-09-12T18:06:04.653134+0000","last_peered":"2024-09-12T18:06:04.653134+0000","last_clean":"2024-09-12T18:06:04.653134+0000","last_became_active":"2024-09-12T17:30:02.969526+0000","last_became_peered":"2024-09-12T17:30:02.969526+0000","last_unstale":"2024-09-12T18:06:04.653134+0000","last_undegraded":"2024-09-12T18:06:04.653134+0000","last_fullsized":"2024-09-12T18:06:04.653134+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":439,"num_write":657,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'44","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.696695+0000","last_change":"2024-09-12T18:08:12.696695+0000","last_active":"2024-09-12T18:08:12.696695+0000","last_peered":"2024-09-12T18:08:12.696695+0000","last_clean":"2024-09-12T18:08:12.696695+0000","last_became_active":"2024-09-12T17:29:54.957906+0000","last_became_peered":"2024-09-12T17:29:54.957906+0000","last_unstale":"2024-09-12T18:08:12.696695+0000","last_undegraded":"2024-09-12T18:08:12.696695+0000","last_fullsized":"2024-09-12T18:08:12.696695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T18:08:12.696599+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T18:08:12.696599+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.696599+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:18.217996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":180,"num_write":59,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'212","reported_seq":834,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.278838+0000","last_change":"2024-09-12T18:08:10.278838+0000","last_active":"2024-09-12T18:08:10.278838+0000","last_peered":"2024-09-12T18:08:10.278838+0000","last_clean":"2024-09-12T18:08:10.278838+0000","last_became_active":"2024-09-12T17:30:28.006884+0000","last_became_peered":"2024-09-12T17:30:28.006884+0000","last_unstale":"2024-09-12T18:08:10.278838+0000","last_undegraded":"2024-09-12T18:08:10.278838+0000","last_fullsized":"2024-09-12T18:08:10.278838+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-12T18:08:10.278730+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-12T18:08:10.278730+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.278730+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.094728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":14673,"num_write":991,"num_write_kb":46674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.055401+0000","last_change":"2024-09-12T18:08:10.055401+0000","last_active":"2024-09-12T18:08:10.055401+0000","last_peered":"2024-09-12T18:08:10.055401+0000","last_clean":"2024-09-12T18:08:10.055401+0000","last_became_active":"2024-09-12T17:29:41.961477+0000","last_became_peered":"2024-09-12T17:29:41.961477+0000","last_unstale":"2024-09-12T18:08:10.055401+0000","last_undegraded":"2024-09-12T18:08:10.055401+0000","last_fullsized":"2024-09-12T18:08:10.055401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:10.055313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:10.055313+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.055313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:09.016405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041855800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.540056+0000","last_change":"2024-09-12T17:29:56.954444+0000","last_active":"2024-09-12T18:06:09.540056+0000","last_peered":"2024-09-12T18:06:09.540056+0000","last_clean":"2024-09-12T18:06:09.540056+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:06:09.540056+0000","last_undegraded":"2024-09-12T18:06:09.540056+0000","last_fullsized":"2024-09-12T18:06:09.540056+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'315","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.797884+0000","last_change":"2024-09-12T17:29:58.978547+0000","last_active":"2024-09-12T18:08:03.797884+0000","last_peered":"2024-09-12T18:08:03.797884+0000","last_clean":"2024-09-12T18:08:03.797884+0000","last_became_active":"2024-09-12T17:29:58.978222+0000","last_became_peered":"2024-09-12T17:29:58.978222+0000","last_unstale":"2024-09-12T18:08:03.797884+0000","last_undegraded":"2024-09-12T18:08:03.797884+0000","last_fullsized":"2024-09-12T18:08:03.797884+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:44.293800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25498,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":718,"num_write":254,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.534853+0000","last_change":"2024-09-12T17:30:00.968813+0000","last_active":"2024-09-12T18:05:29.534853+0000","last_peered":"2024-09-12T18:05:29.534853+0000","last_clean":"2024-09-12T18:05:29.534853+0000","last_became_active":"2024-09-12T17:30:00.968527+0000","last_became_peered":"2024-09-12T17:30:00.968527+0000","last_unstale":"2024-09-12T18:05:29.534853+0000","last_undegraded":"2024-09-12T18:05:29.534853+0000","last_fullsized":"2024-09-12T18:05:29.534853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:25.372195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'123","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.674193+0000","last_change":"2024-09-12T17:30:02.966314+0000","last_active":"2024-09-12T18:07:38.674193+0000","last_peered":"2024-09-12T18:07:38.674193+0000","last_clean":"2024-09-12T18:07:38.674193+0000","last_became_active":"2024-09-12T17:30:02.966018+0000","last_became_peered":"2024-09-12T17:30:02.966018+0000","last_unstale":"2024-09-12T18:07:38.674193+0000","last_undegraded":"2024-09-12T18:07:38.674193+0000","last_fullsized":"2024-09-12T18:07:38.674193+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":226,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'154","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.350541+0000","last_change":"2024-09-12T17:30:02.964433+0000","last_active":"2024-09-12T18:06:21.350541+0000","last_peered":"2024-09-12T18:06:21.350541+0000","last_clean":"2024-09-12T18:06:21.350541+0000","last_became_active":"2024-09-12T17:30:02.964133+0000","last_became_peered":"2024-09-12T17:30:02.964133+0000","last_unstale":"2024-09-12T18:06:21.350541+0000","last_undegraded":"2024-09-12T18:06:21.350541+0000","last_fullsized":"2024-09-12T18:06:21.350541+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:49.035962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":286,"num_write":383,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'105","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.701136+0000","last_change":"2024-09-12T18:08:15.701136+0000","last_active":"2024-09-12T18:08:15.701136+0000","last_peered":"2024-09-12T18:08:15.701136+0000","last_clean":"2024-09-12T18:08:15.701136+0000","last_became_active":"2024-09-12T17:29:54.955716+0000","last_became_peered":"2024-09-12T17:29:54.955716+0000","last_unstale":"2024-09-12T18:08:15.701136+0000","last_undegraded":"2024-09-12T18:08:15.701136+0000","last_fullsized":"2024-09-12T18:08:15.701136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T18:08:15.701059+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T18:08:15.701059+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.701059+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:28.452054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":383,"num_write":153,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'185","reported_seq":785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.353007+0000","last_change":"2024-09-12T18:08:15.353007+0000","last_active":"2024-09-12T18:08:15.353007+0000","last_peered":"2024-09-12T18:08:15.353007+0000","last_clean":"2024-09-12T18:08:15.353007+0000","last_became_active":"2024-09-12T17:30:28.200487+0000","last_became_peered":"2024-09-12T17:30:28.200487+0000","last_unstale":"2024-09-12T18:08:15.353007+0000","last_undegraded":"2024-09-12T18:08:15.353007+0000","last_fullsized":"2024-09-12T18:08:15.353007+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-12T18:08:15.352875+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-12T18:08:15.352875+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.352875+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:15.449063+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":393,"num_read_kb":70111,"num_write":894,"num_write_kb":56875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.323914+0000","last_change":"2024-09-12T18:08:24.323914+0000","last_active":"2024-09-12T18:08:24.323914+0000","last_peered":"2024-09-12T18:08:24.323914+0000","last_clean":"2024-09-12T18:08:24.323914+0000","last_became_active":"2024-09-12T17:29:56.952578+0000","last_became_peered":"2024-09-12T17:29:56.952578+0000","last_unstale":"2024-09-12T18:08:24.323914+0000","last_undegraded":"2024-09-12T18:08:24.323914+0000","last_fullsized":"2024-09-12T18:08:24.323914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:24.323828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:24.323828+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.323828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:27.495028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'125","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.842303+0000","last_change":"2024-09-12T17:29:58.955397+0000","last_active":"2024-09-12T18:08:03.842303+0000","last_peered":"2024-09-12T18:08:03.842303+0000","last_clean":"2024-09-12T18:08:03.842303+0000","last_became_active":"2024-09-12T17:29:58.955111+0000","last_became_peered":"2024-09-12T17:29:58.955111+0000","last_unstale":"2024-09-12T18:08:03.842303+0000","last_undegraded":"2024-09-12T18:08:03.842303+0000","last_fullsized":"2024-09-12T18:08:03.842303+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.069692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":163,"num_read_kb":266,"num_write":84,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527389+0000","last_change":"2024-09-12T17:30:00.966432+0000","last_active":"2024-09-12T18:05:04.527389+0000","last_peered":"2024-09-12T18:05:04.527389+0000","last_clean":"2024-09-12T18:05:04.527389+0000","last_became_active":"2024-09-12T17:30:00.965975+0000","last_became_peered":"2024-09-12T17:30:00.965975+0000","last_unstale":"2024-09-12T18:05:04.527389+0000","last_undegraded":"2024-09-12T18:05:04.527389+0000","last_fullsized":"2024-09-12T18:05:04.527389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:47.435596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.540717+0000","last_change":"2024-09-12T17:30:02.966210+0000","last_active":"2024-09-12T18:06:14.540717+0000","last_peered":"2024-09-12T18:06:14.540717+0000","last_clean":"2024-09-12T18:06:14.540717+0000","last_became_active":"2024-09-12T17:30:02.965919+0000","last_became_peered":"2024-09-12T17:30:02.965919+0000","last_unstale":"2024-09-12T18:06:14.540717+0000","last_undegraded":"2024-09-12T18:06:14.540717+0000","last_fullsized":"2024-09-12T18:06:14.540717+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":165,"num_read_kb":151,"num_write":248,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'420","reported_seq":1175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.282459+0000","last_change":"2024-09-12T18:08:19.282459+0000","last_active":"2024-09-12T18:08:19.282459+0000","last_peered":"2024-09-12T18:08:19.282459+0000","last_clean":"2024-09-12T18:08:19.282459+0000","last_became_active":"2024-09-12T17:29:54.954477+0000","last_became_peered":"2024-09-12T17:29:54.954477+0000","last_unstale":"2024-09-12T18:08:19.282459+0000","last_undegraded":"2024-09-12T18:08:19.282459+0000","last_fullsized":"2024-09-12T18:08:19.282459+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'420","last_scrub_stamp":"2024-09-12T18:08:19.282376+0000","last_deep_scrub":"264'420","last_deep_scrub_stamp":"2024-09-12T18:08:19.282376+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.282376+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:52.399922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1777,"num_write":781,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'210","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.682955+0000","last_change":"2024-09-12T18:08:17.682955+0000","last_active":"2024-09-12T18:08:17.682955+0000","last_peered":"2024-09-12T18:08:17.682955+0000","last_clean":"2024-09-12T18:08:17.682955+0000","last_became_active":"2024-09-12T17:29:52.956376+0000","last_became_peered":"2024-09-12T17:29:52.956376+0000","last_unstale":"2024-09-12T18:08:17.682955+0000","last_undegraded":"2024-09-12T18:08:17.682955+0000","last_fullsized":"2024-09-12T18:08:17.682955+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-12T18:08:17.682841+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-12T18:08:17.682841+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.682841+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:59.176548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":36390,"num_write":986,"num_write_kb":36751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.526513+0000","last_change":"2024-09-12T17:29:56.955510+0000","last_active":"2024-09-12T18:04:59.526513+0000","last_peered":"2024-09-12T18:04:59.526513+0000","last_clean":"2024-09-12T18:04:59.526513+0000","last_became_active":"2024-09-12T17:29:56.955256+0000","last_became_peered":"2024-09-12T17:29:56.955256+0000","last_unstale":"2024-09-12T18:04:59.526513+0000","last_undegraded":"2024-09-12T18:04:59.526513+0000","last_fullsized":"2024-09-12T18:04:59.526513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:56.582465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'51","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.247475+0000","last_change":"2024-09-12T17:29:58.961027+0000","last_active":"2024-09-12T18:06:21.247475+0000","last_peered":"2024-09-12T18:06:21.247475+0000","last_clean":"2024-09-12T18:06:21.247475+0000","last_became_active":"2024-09-12T17:29:58.960476+0000","last_became_peered":"2024-09-12T17:29:58.960476+0000","last_unstale":"2024-09-12T18:06:21.247475+0000","last_undegraded":"2024-09-12T18:06:21.247475+0000","last_fullsized":"2024-09-12T18:06:21.247475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:15.254313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.682338+0000","last_change":"2024-09-12T17:30:00.958998+0000","last_active":"2024-09-12T18:05:04.682338+0000","last_peered":"2024-09-12T18:05:04.682338+0000","last_clean":"2024-09-12T18:05:04.682338+0000","last_became_active":"2024-09-12T17:30:00.958739+0000","last_became_peered":"2024-09-12T17:30:00.958739+0000","last_unstale":"2024-09-12T18:05:04.682338+0000","last_undegraded":"2024-09-12T18:05:04.682338+0000","last_fullsized":"2024-09-12T18:05:04.682338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:23.108221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'186","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.857340+0000","last_change":"2024-09-12T17:30:02.973036+0000","last_active":"2024-09-12T18:06:20.857340+0000","last_peered":"2024-09-12T18:06:20.857340+0000","last_clean":"2024-09-12T18:06:20.857340+0000","last_became_active":"2024-09-12T17:30:02.972717+0000","last_became_peered":"2024-09-12T17:30:02.972717+0000","last_unstale":"2024-09-12T18:06:20.857340+0000","last_undegraded":"2024-09-12T18:06:20.857340+0000","last_fullsized":"2024-09-12T18:06:20.857340+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:17.417135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":309,"num_read_kb":305,"num_write":411,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'235","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.096877+0000","last_change":"2024-09-12T18:08:19.096877+0000","last_active":"2024-09-12T18:08:19.096877+0000","last_peered":"2024-09-12T18:08:19.096877+0000","last_clean":"2024-09-12T18:08:19.096877+0000","last_became_active":"2024-09-12T17:29:54.955897+0000","last_became_peered":"2024-09-12T17:29:54.955897+0000","last_unstale":"2024-09-12T18:08:19.096877+0000","last_undegraded":"2024-09-12T18:08:19.096877+0000","last_fullsized":"2024-09-12T18:08:19.096877+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'235","last_scrub_stamp":"2024-09-12T18:08:19.096790+0000","last_deep_scrub":"264'235","last_deep_scrub_stamp":"2024-09-12T18:08:19.096790+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.096790+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:13.358909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":344,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'244","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.510954+0000","last_change":"2024-09-12T18:08:12.510954+0000","last_active":"2024-09-12T18:08:12.510954+0000","last_peered":"2024-09-12T18:08:12.510954+0000","last_clean":"2024-09-12T18:08:12.510954+0000","last_became_active":"2024-09-12T17:29:52.954956+0000","last_became_peered":"2024-09-12T17:29:52.954956+0000","last_unstale":"2024-09-12T18:08:12.510954+0000","last_undegraded":"2024-09-12T18:08:12.510954+0000","last_fullsized":"2024-09-12T18:08:12.510954+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'244","last_scrub_stamp":"2024-09-12T18:08:12.510806+0000","last_deep_scrub":"264'244","last_deep_scrub_stamp":"2024-09-12T18:08:12.510806+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.510806+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:53.796805+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550036,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":646,"num_read_kb":5380,"num_write":1208,"num_write_kb":40346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.681595+0000","last_change":"2024-09-12T17:29:56.959871+0000","last_active":"2024-09-12T18:04:59.681595+0000","last_peered":"2024-09-12T18:04:59.681595+0000","last_clean":"2024-09-12T18:04:59.681595+0000","last_became_active":"2024-09-12T17:29:56.959460+0000","last_became_peered":"2024-09-12T17:29:56.959460+0000","last_unstale":"2024-09-12T18:04:59.681595+0000","last_undegraded":"2024-09-12T18:04:59.681595+0000","last_fullsized":"2024-09-12T18:04:59.681595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:11.274542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'149","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.749133+0000","last_change":"2024-09-12T17:29:58.961137+0000","last_active":"2024-09-12T18:08:03.749133+0000","last_peered":"2024-09-12T18:08:03.749133+0000","last_clean":"2024-09-12T18:08:03.749133+0000","last_became_active":"2024-09-12T17:29:58.960824+0000","last_became_peered":"2024-09-12T17:29:58.960824+0000","last_unstale":"2024-09-12T18:08:03.749133+0000","last_undegraded":"2024-09-12T18:08:03.749133+0000","last_fullsized":"2024-09-12T18:08:03.749133+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:15.729749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":238,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.515733+0000","last_change":"2024-09-12T17:30:00.967592+0000","last_active":"2024-09-12T18:05:04.515733+0000","last_peered":"2024-09-12T18:05:04.515733+0000","last_clean":"2024-09-12T18:05:04.515733+0000","last_became_active":"2024-09-12T17:30:00.967299+0000","last_became_peered":"2024-09-12T17:30:00.967299+0000","last_unstale":"2024-09-12T18:05:04.515733+0000","last_undegraded":"2024-09-12T18:05:04.515733+0000","last_fullsized":"2024-09-12T18:05:04.515733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:31.645270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'93","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.484386+0000","last_change":"2024-09-12T17:30:02.966660+0000","last_active":"2024-09-12T18:06:20.484386+0000","last_peered":"2024-09-12T18:06:20.484386+0000","last_clean":"2024-09-12T18:06:20.484386+0000","last_became_active":"2024-09-12T17:30:02.965644+0000","last_became_peered":"2024-09-12T17:30:02.965644+0000","last_unstale":"2024-09-12T18:06:20.484386+0000","last_undegraded":"2024-09-12T18:06:20.484386+0000","last_fullsized":"2024-09-12T18:06:20.484386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:15.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":207,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'4299","reported_seq":4952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.123934+0000","last_change":"2024-09-12T18:08:18.123934+0000","last_active":"2024-09-12T18:08:18.123934+0000","last_peered":"2024-09-12T18:08:18.123934+0000","last_clean":"2024-09-12T18:08:18.123934+0000","last_became_active":"2024-09-12T17:29:54.950407+0000","last_became_peered":"2024-09-12T17:29:54.950407+0000","last_unstale":"2024-09-12T18:08:18.123934+0000","last_undegraded":"2024-09-12T18:08:18.123934+0000","last_fullsized":"2024-09-12T18:08:18.123934+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4299","last_scrub_stamp":"2024-09-12T18:08:18.123846+0000","last_deep_scrub":"264'4299","last_deep_scrub_stamp":"2024-09-12T18:08:18.123846+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.123846+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:58.856015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17237,"num_read_kb":14347,"num_write":6471,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'180","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.146470+0000","last_change":"2024-09-12T18:08:08.146470+0000","last_active":"2024-09-12T18:08:08.146470+0000","last_peered":"2024-09-12T18:08:08.146470+0000","last_clean":"2024-09-12T18:08:08.146470+0000","last_became_active":"2024-09-12T17:29:52.962836+0000","last_became_peered":"2024-09-12T17:29:52.962836+0000","last_unstale":"2024-09-12T18:08:08.146470+0000","last_undegraded":"2024-09-12T18:08:08.146470+0000","last_fullsized":"2024-09-12T18:08:08.146470+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T18:08:08.146374+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T18:08:08.146374+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.146374+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:03.930960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303959,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":45090,"num_write":889,"num_write_kb":58788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.514939+0000","last_change":"2024-09-12T17:29:56.957363+0000","last_active":"2024-09-12T18:04:59.514939+0000","last_peered":"2024-09-12T18:04:59.514939+0000","last_clean":"2024-09-12T18:04:59.514939+0000","last_became_active":"2024-09-12T17:29:56.957066+0000","last_became_peered":"2024-09-12T17:29:56.957066+0000","last_unstale":"2024-09-12T18:04:59.514939+0000","last_undegraded":"2024-09-12T18:04:59.514939+0000","last_fullsized":"2024-09-12T18:04:59.514939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:23.450708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'152","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.719866+0000","last_change":"2024-09-12T17:29:58.955841+0000","last_active":"2024-09-12T18:08:03.719866+0000","last_peered":"2024-09-12T18:08:03.719866+0000","last_clean":"2024-09-12T18:08:03.719866+0000","last_became_active":"2024-09-12T17:29:58.955585+0000","last_became_peered":"2024-09-12T17:29:58.955585+0000","last_unstale":"2024-09-12T18:08:03.719866+0000","last_undegraded":"2024-09-12T18:08:03.719866+0000","last_fullsized":"2024-09-12T18:08:03.719866+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:03.552605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7377,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":246,"num_write":102,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644380+0000","last_change":"2024-09-12T17:30:00.965228+0000","last_active":"2024-09-12T18:05:04.644380+0000","last_peered":"2024-09-12T18:05:04.644380+0000","last_clean":"2024-09-12T18:05:04.644380+0000","last_became_active":"2024-09-12T17:30:00.964621+0000","last_became_peered":"2024-09-12T17:30:00.964621+0000","last_unstale":"2024-09-12T18:05:04.644380+0000","last_undegraded":"2024-09-12T18:05:04.644380+0000","last_fullsized":"2024-09-12T18:05:04.644380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:28.006617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'546","reported_seq":1352,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.122184+0000","last_change":"2024-09-12T18:08:20.122184+0000","last_active":"2024-09-12T18:08:20.122184+0000","last_peered":"2024-09-12T18:08:20.122184+0000","last_clean":"2024-09-12T18:08:20.122184+0000","last_became_active":"2024-09-12T17:29:54.958758+0000","last_became_peered":"2024-09-12T17:29:54.958758+0000","last_unstale":"2024-09-12T18:08:20.122184+0000","last_undegraded":"2024-09-12T18:08:20.122184+0000","last_fullsized":"2024-09-12T18:08:20.122184+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'546","last_scrub_stamp":"2024-09-12T18:08:20.122059+0000","last_deep_scrub":"264'546","last_deep_scrub_stamp":"2024-09-12T18:08:20.122059+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.122059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:18.469393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2571,"num_read_kb":2181,"num_write":951,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'212","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.316799+0000","last_change":"2024-09-12T18:08:13.316799+0000","last_active":"2024-09-12T18:08:13.316799+0000","last_peered":"2024-09-12T18:08:13.316799+0000","last_clean":"2024-09-12T18:08:13.316799+0000","last_became_active":"2024-09-12T17:30:28.007001+0000","last_became_peered":"2024-09-12T17:30:28.007001+0000","last_unstale":"2024-09-12T18:08:13.316799+0000","last_undegraded":"2024-09-12T18:08:13.316799+0000","last_fullsized":"2024-09-12T18:08:13.316799+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-12T18:08:13.316690+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-12T18:08:13.316690+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.316690+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:44.403007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":31262,"num_write":918,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.653171+0000","last_change":"2024-09-12T17:29:56.954814+0000","last_active":"2024-09-12T18:06:04.653171+0000","last_peered":"2024-09-12T18:06:04.653171+0000","last_clean":"2024-09-12T18:06:04.653171+0000","last_became_active":"2024-09-12T17:29:56.954498+0000","last_became_peered":"2024-09-12T17:29:56.954498+0000","last_unstale":"2024-09-12T18:06:04.653171+0000","last_undegraded":"2024-09-12T18:06:04.653171+0000","last_fullsized":"2024-09-12T18:06:04.653171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:39.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'190","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.707014+0000","last_change":"2024-09-12T17:29:58.958482+0000","last_active":"2024-09-12T18:08:03.707014+0000","last_peered":"2024-09-12T18:08:03.707014+0000","last_clean":"2024-09-12T18:08:03.707014+0000","last_became_active":"2024-09-12T17:29:58.958198+0000","last_became_peered":"2024-09-12T17:29:58.958198+0000","last_unstale":"2024-09-12T18:08:03.707014+0000","last_undegraded":"2024-09-12T18:08:03.707014+0000","last_fullsized":"2024-09-12T18:08:03.707014+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:03.636909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15825,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":439,"num_write":184,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.639853+0000","last_change":"2024-09-12T17:30:00.964218+0000","last_active":"2024-09-12T18:05:04.639853+0000","last_peered":"2024-09-12T18:05:04.639853+0000","last_clean":"2024-09-12T18:05:04.639853+0000","last_became_active":"2024-09-12T17:30:00.963706+0000","last_became_peered":"2024-09-12T17:30:00.963706+0000","last_unstale":"2024-09-12T18:05:04.639853+0000","last_undegraded":"2024-09-12T18:05:04.639853+0000","last_fullsized":"2024-09-12T18:05:04.639853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:42.210305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'175","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.667499+0000","last_change":"2024-09-12T17:30:02.964954+0000","last_active":"2024-09-12T18:06:08.667499+0000","last_peered":"2024-09-12T18:06:08.667499+0000","last_clean":"2024-09-12T18:06:08.667499+0000","last_became_active":"2024-09-12T17:30:02.964682+0000","last_became_peered":"2024-09-12T17:30:02.964682+0000","last_unstale":"2024-09-12T18:06:08.667499+0000","last_undegraded":"2024-09-12T18:06:08.667499+0000","last_fullsized":"2024-09-12T18:06:08.667499+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:18.544576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":239,"num_read_kb":250,"num_write":415,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'100","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.116313+0000","last_change":"2024-09-12T18:08:21.116313+0000","last_active":"2024-09-12T18:08:21.116313+0000","last_peered":"2024-09-12T18:08:21.116313+0000","last_clean":"2024-09-12T18:08:21.116313+0000","last_became_active":"2024-09-12T17:29:54.955326+0000","last_became_peered":"2024-09-12T17:29:54.955326+0000","last_unstale":"2024-09-12T18:08:21.116313+0000","last_undegraded":"2024-09-12T18:08:21.116313+0000","last_fullsized":"2024-09-12T18:08:21.116313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T18:08:21.116224+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T18:08:21.116224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.116224+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:01.095342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":334,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'221","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.279609+0000","last_change":"2024-09-12T18:08:12.279609+0000","last_active":"2024-09-12T18:08:12.279609+0000","last_peered":"2024-09-12T18:08:12.279609+0000","last_clean":"2024-09-12T18:08:12.279609+0000","last_became_active":"2024-09-12T17:29:52.945616+0000","last_became_peered":"2024-09-12T17:29:52.945616+0000","last_unstale":"2024-09-12T18:08:12.279609+0000","last_undegraded":"2024-09-12T18:08:12.279609+0000","last_fullsized":"2024-09-12T18:08:12.279609+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-12T18:08:12.279483+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-12T18:08:12.279483+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.279483+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:42.023356+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109585,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":523,"num_read_kb":15300,"num_write":1084,"num_write_kb":27395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.034592+0000","last_change":"2024-09-12T18:08:24.034592+0000","last_active":"2024-09-12T18:08:24.034592+0000","last_peered":"2024-09-12T18:08:24.034592+0000","last_clean":"2024-09-12T18:08:24.034592+0000","last_became_active":"2024-09-12T17:29:56.959047+0000","last_became_peered":"2024-09-12T17:29:56.959047+0000","last_unstale":"2024-09-12T18:08:24.034592+0000","last_undegraded":"2024-09-12T18:08:24.034592+0000","last_fullsized":"2024-09-12T18:08:24.034592+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:24.034504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:24.034504+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.034504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:19.769078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'145","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.725366+0000","last_change":"2024-09-12T17:29:58.955055+0000","last_active":"2024-09-12T18:08:03.725366+0000","last_peered":"2024-09-12T18:08:03.725366+0000","last_clean":"2024-09-12T18:08:03.725366+0000","last_became_active":"2024-09-12T17:29:58.954747+0000","last_became_peered":"2024-09-12T17:29:58.954747+0000","last_unstale":"2024-09-12T18:08:03.725366+0000","last_undegraded":"2024-09-12T18:08:03.725366+0000","last_fullsized":"2024-09-12T18:08:03.725366+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:01.106668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10649,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":195,"num_read_kb":252,"num_write":120,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644390+0000","last_change":"2024-09-12T17:30:00.960182+0000","last_active":"2024-09-12T18:05:04.644390+0000","last_peered":"2024-09-12T18:05:04.644390+0000","last_clean":"2024-09-12T18:05:04.644390+0000","last_became_active":"2024-09-12T17:30:00.959708+0000","last_became_peered":"2024-09-12T17:30:00.959708+0000","last_unstale":"2024-09-12T18:05:04.644390+0000","last_undegraded":"2024-09-12T18:05:04.644390+0000","last_fullsized":"2024-09-12T18:05:04.644390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:04.130612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'214","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.731228+0000","last_change":"2024-09-12T17:30:02.961235+0000","last_active":"2024-09-12T18:07:37.731228+0000","last_peered":"2024-09-12T18:07:37.731228+0000","last_clean":"2024-09-12T18:07:37.731228+0000","last_became_active":"2024-09-12T17:30:02.960928+0000","last_became_peered":"2024-09-12T17:30:02.960928+0000","last_unstale":"2024-09-12T18:07:37.731228+0000","last_undegraded":"2024-09-12T18:07:37.731228+0000","last_fullsized":"2024-09-12T18:07:37.731228+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:02.653466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":219,"num_write":570,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'158","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.027630+0000","last_change":"2024-09-12T18:08:24.027630+0000","last_active":"2024-09-12T18:08:24.027630+0000","last_peered":"2024-09-12T18:08:24.027630+0000","last_clean":"2024-09-12T18:08:24.027630+0000","last_became_active":"2024-09-12T17:29:54.950294+0000","last_became_peered":"2024-09-12T17:29:54.950294+0000","last_unstale":"2024-09-12T18:08:24.027630+0000","last_undegraded":"2024-09-12T18:08:24.027630+0000","last_fullsized":"2024-09-12T18:08:24.027630+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'158","last_scrub_stamp":"2024-09-12T18:08:24.027548+0000","last_deep_scrub":"264'158","last_deep_scrub_stamp":"2024-09-12T18:08:24.027548+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.027548+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:58.664447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":567,"num_write":224,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'195","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.782806+0000","last_change":"2024-09-12T18:08:10.782806+0000","last_active":"2024-09-12T18:08:10.782806+0000","last_peered":"2024-09-12T18:08:10.782806+0000","last_clean":"2024-09-12T18:08:10.782806+0000","last_became_active":"2024-09-12T17:29:52.947363+0000","last_became_peered":"2024-09-12T17:29:52.947363+0000","last_unstale":"2024-09-12T18:08:10.782806+0000","last_undegraded":"2024-09-12T18:08:10.782806+0000","last_fullsized":"2024-09-12T18:08:10.782806+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T18:08:10.782711+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T18:08:10.782711+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.782711+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:11.562634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":129945,"num_write":977,"num_write_kb":26137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.515065+0000","last_change":"2024-09-12T17:29:56.952220+0000","last_active":"2024-09-12T18:04:59.515065+0000","last_peered":"2024-09-12T18:04:59.515065+0000","last_clean":"2024-09-12T18:04:59.515065+0000","last_became_active":"2024-09-12T17:29:56.951825+0000","last_became_peered":"2024-09-12T17:29:56.951825+0000","last_unstale":"2024-09-12T18:04:59.515065+0000","last_undegraded":"2024-09-12T18:04:59.515065+0000","last_fullsized":"2024-09-12T18:04:59.515065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.728224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'131","reported_seq":696,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.883858+0000","last_change":"2024-09-12T17:29:58.978881+0000","last_active":"2024-09-12T18:08:03.883858+0000","last_peered":"2024-09-12T18:08:03.883858+0000","last_clean":"2024-09-12T18:08:03.883858+0000","last_became_active":"2024-09-12T17:29:58.978506+0000","last_became_peered":"2024-09-12T17:29:58.978506+0000","last_unstale":"2024-09-12T18:08:03.883858+0000","last_undegraded":"2024-09-12T18:08:03.883858+0000","last_fullsized":"2024-09-12T18:08:03.883858+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:23.505523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7433,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":163,"num_read_kb":221,"num_write":86,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.653925+0000","last_change":"2024-09-12T17:30:00.965903+0000","last_active":"2024-09-12T18:06:09.653925+0000","last_peered":"2024-09-12T18:06:09.653925+0000","last_clean":"2024-09-12T18:06:09.653925+0000","last_became_active":"2024-09-12T17:30:00.965628+0000","last_became_peered":"2024-09-12T17:30:00.965628+0000","last_unstale":"2024-09-12T18:06:09.653925+0000","last_undegraded":"2024-09-12T18:06:09.653925+0000","last_fullsized":"2024-09-12T18:06:09.653925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'111","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.672413+0000","last_change":"2024-09-12T17:30:02.963569+0000","last_active":"2024-09-12T18:07:38.672413+0000","last_peered":"2024-09-12T18:07:38.672413+0000","last_clean":"2024-09-12T18:07:38.672413+0000","last_became_active":"2024-09-12T17:30:02.963242+0000","last_became_peered":"2024-09-12T17:30:02.963242+0000","last_unstale":"2024-09-12T18:07:38.672413+0000","last_undegraded":"2024-09-12T18:07:38.672413+0000","last_fullsized":"2024-09-12T18:07:38.672413+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:33.404263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'168","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.408456+0000","last_change":"2024-09-12T18:08:17.408456+0000","last_active":"2024-09-12T18:08:17.408456+0000","last_peered":"2024-09-12T18:08:17.408456+0000","last_clean":"2024-09-12T18:08:17.408456+0000","last_became_active":"2024-09-12T17:29:54.950429+0000","last_became_peered":"2024-09-12T17:29:54.950429+0000","last_unstale":"2024-09-12T18:08:17.408456+0000","last_undegraded":"2024-09-12T18:08:17.408456+0000","last_fullsized":"2024-09-12T18:08:17.408456+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-12T18:08:17.408371+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-12T18:08:17.408371+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.408371+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:54.397921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":726,"num_read_kb":598,"num_write":255,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'195","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.186496+0000","last_change":"2024-09-12T18:08:10.186496+0000","last_active":"2024-09-12T18:08:10.186496+0000","last_peered":"2024-09-12T18:08:10.186496+0000","last_clean":"2024-09-12T18:08:10.186496+0000","last_became_active":"2024-09-12T17:29:52.966561+0000","last_became_peered":"2024-09-12T17:29:52.966561+0000","last_unstale":"2024-09-12T18:08:10.186496+0000","last_undegraded":"2024-09-12T18:08:10.186496+0000","last_fullsized":"2024-09-12T18:08:10.186496+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T18:08:10.186388+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T18:08:10.186388+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.186388+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:55.665607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":24994,"num_write":951,"num_write_kb":31573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643585+0000","last_change":"2024-09-12T17:29:56.959683+0000","last_active":"2024-09-12T18:04:59.643585+0000","last_peered":"2024-09-12T18:04:59.643585+0000","last_clean":"2024-09-12T18:04:59.643585+0000","last_became_active":"2024-09-12T17:29:56.959185+0000","last_became_peered":"2024-09-12T17:29:56.959185+0000","last_unstale":"2024-09-12T18:04:59.643585+0000","last_undegraded":"2024-09-12T18:04:59.643585+0000","last_fullsized":"2024-09-12T18:04:59.643585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:49.577878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'60","reported_seq":574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.523846+0000","last_change":"2024-09-12T17:29:58.978897+0000","last_active":"2024-09-12T18:06:04.523846+0000","last_peered":"2024-09-12T18:06:04.523846+0000","last_clean":"2024-09-12T18:06:04.523846+0000","last_became_active":"2024-09-12T17:29:58.978247+0000","last_became_peered":"2024-09-12T17:29:58.978247+0000","last_unstale":"2024-09-12T18:06:04.523846+0000","last_undegraded":"2024-09-12T18:06:04.523846+0000","last_fullsized":"2024-09-12T18:06:04.523846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:21.292974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":59,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'759","reported_seq":2185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.553237+0000","last_change":"2024-09-12T17:30:00.962301+0000","last_active":"2024-09-12T18:08:03.553237+0000","last_peered":"2024-09-12T18:08:03.553237+0000","last_clean":"2024-09-12T18:08:03.553237+0000","last_became_active":"2024-09-12T17:30:00.961928+0000","last_became_peered":"2024-09-12T17:30:00.961928+0000","last_unstale":"2024-09-12T18:08:03.553237+0000","last_undegraded":"2024-09-12T18:08:03.553237+0000","last_fullsized":"2024-09-12T18:08:03.553237+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:21.176614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'103","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.850274+0000","last_change":"2024-09-12T17:30:02.963767+0000","last_active":"2024-09-12T18:06:20.850274+0000","last_peered":"2024-09-12T18:06:20.850274+0000","last_clean":"2024-09-12T18:06:20.850274+0000","last_became_active":"2024-09-12T17:30:02.963474+0000","last_became_peered":"2024-09-12T17:30:02.963474+0000","last_unstale":"2024-09-12T18:06:20.850274+0000","last_undegraded":"2024-09-12T18:06:20.850274+0000","last_fullsized":"2024-09-12T18:06:20.850274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:06.653540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'463","reported_seq":1195,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.709763+0000","last_change":"2024-09-12T18:08:19.709763+0000","last_active":"2024-09-12T18:08:19.709763+0000","last_peered":"2024-09-12T18:08:19.709763+0000","last_clean":"2024-09-12T18:08:19.709763+0000","last_became_active":"2024-09-12T17:29:54.954344+0000","last_became_peered":"2024-09-12T17:29:54.954344+0000","last_unstale":"2024-09-12T18:08:19.709763+0000","last_undegraded":"2024-09-12T18:08:19.709763+0000","last_fullsized":"2024-09-12T18:08:19.709763+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'463","last_scrub_stamp":"2024-09-12T18:08:19.709661+0000","last_deep_scrub":"264'463","last_deep_scrub_stamp":"2024-09-12T18:08:19.709661+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.709661+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:54.883418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":1813,"num_write":696,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25964,"num_omap_keys":102,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'216","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.485347+0000","last_change":"2024-09-12T18:08:13.485347+0000","last_active":"2024-09-12T18:08:13.485347+0000","last_peered":"2024-09-12T18:08:13.485347+0000","last_clean":"2024-09-12T18:08:13.485347+0000","last_became_active":"2024-09-12T17:30:28.008012+0000","last_became_peered":"2024-09-12T17:30:28.008012+0000","last_unstale":"2024-09-12T18:08:13.485347+0000","last_undegraded":"2024-09-12T18:08:13.485347+0000","last_fullsized":"2024-09-12T18:08:13.485347+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'216","last_scrub_stamp":"2024-09-12T18:08:13.485242+0000","last_deep_scrub":"264'216","last_deep_scrub_stamp":"2024-09-12T18:08:13.485242+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.485242+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.011332+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395846,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":11221,"num_write":1057,"num_write_kb":38249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.681643+0000","last_change":"2024-09-12T17:29:56.959803+0000","last_active":"2024-09-12T18:04:59.681643+0000","last_peered":"2024-09-12T18:04:59.681643+0000","last_clean":"2024-09-12T18:04:59.681643+0000","last_became_active":"2024-09-12T17:29:56.959496+0000","last_became_peered":"2024-09-12T17:29:56.959496+0000","last_unstale":"2024-09-12T18:04:59.681643+0000","last_undegraded":"2024-09-12T18:04:59.681643+0000","last_fullsized":"2024-09-12T18:04:59.681643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:24.096051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'144","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.654187+0000","last_change":"2024-09-12T17:29:58.956511+0000","last_active":"2024-09-12T18:08:03.654187+0000","last_peered":"2024-09-12T18:08:03.654187+0000","last_clean":"2024-09-12T18:08:03.654187+0000","last_became_active":"2024-09-12T17:29:58.956214+0000","last_became_peered":"2024-09-12T17:29:58.956214+0000","last_unstale":"2024-09-12T18:08:03.654187+0000","last_undegraded":"2024-09-12T18:08:03.654187+0000","last_fullsized":"2024-09-12T18:08:03.654187+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.069692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7681,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":254,"num_write":108,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633054+0000","last_change":"2024-09-12T17:30:00.964427+0000","last_active":"2024-09-12T18:03:54.633054+0000","last_peered":"2024-09-12T18:03:54.633054+0000","last_clean":"2024-09-12T18:03:54.633054+0000","last_became_active":"2024-09-12T17:30:00.964150+0000","last_became_peered":"2024-09-12T17:30:00.964150+0000","last_unstale":"2024-09-12T18:03:54.633054+0000","last_undegraded":"2024-09-12T18:03:54.633054+0000","last_fullsized":"2024-09-12T18:03:54.633054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:38.024178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'176","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.255174+0000","last_change":"2024-09-12T17:30:02.972717+0000","last_active":"2024-09-12T18:05:56.255174+0000","last_peered":"2024-09-12T18:05:56.255174+0000","last_clean":"2024-09-12T18:05:56.255174+0000","last_became_active":"2024-09-12T17:30:02.972420+0000","last_became_peered":"2024-09-12T17:30:02.972420+0000","last_unstale":"2024-09-12T18:05:56.255174+0000","last_undegraded":"2024-09-12T18:05:56.255174+0000","last_fullsized":"2024-09-12T18:05:56.255174+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:00.149423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":302,"num_write":451,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'323","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.712424+0000","last_change":"2024-09-12T18:08:18.712424+0000","last_active":"2024-09-12T18:08:18.712424+0000","last_peered":"2024-09-12T18:08:18.712424+0000","last_clean":"2024-09-12T18:08:18.712424+0000","last_became_active":"2024-09-12T17:29:54.953626+0000","last_became_peered":"2024-09-12T17:29:54.953626+0000","last_unstale":"2024-09-12T18:08:18.712424+0000","last_undegraded":"2024-09-12T18:08:18.712424+0000","last_fullsized":"2024-09-12T18:08:18.712424+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-12T18:08:18.712342+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-12T18:08:18.712342+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.712342+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:25.450466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1393,"num_read_kb":1115,"num_write":522,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'171","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.435392+0000","last_change":"2024-09-12T18:08:14.435392+0000","last_active":"2024-09-12T18:08:14.435392+0000","last_peered":"2024-09-12T18:08:14.435392+0000","last_clean":"2024-09-12T18:08:14.435392+0000","last_became_active":"2024-09-12T17:30:28.200981+0000","last_became_peered":"2024-09-12T17:30:28.200981+0000","last_unstale":"2024-09-12T18:08:14.435392+0000","last_undegraded":"2024-09-12T18:08:14.435392+0000","last_fullsized":"2024-09-12T18:08:14.435392+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T18:08:14.435270+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T18:08:14.435270+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.435270+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:50.031909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755684,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":377,"num_read_kb":41427,"num_write":835,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.639179+0000","last_change":"2024-09-12T17:29:56.955843+0000","last_active":"2024-09-12T18:04:59.639179+0000","last_peered":"2024-09-12T18:04:59.639179+0000","last_clean":"2024-09-12T18:04:59.639179+0000","last_became_active":"2024-09-12T17:29:56.955532+0000","last_became_peered":"2024-09-12T17:29:56.955532+0000","last_unstale":"2024-09-12T18:04:59.639179+0000","last_undegraded":"2024-09-12T18:04:59.639179+0000","last_fullsized":"2024-09-12T18:04:59.639179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:32.340336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'123","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.661177+0000","last_change":"2024-09-12T17:29:58.961115+0000","last_active":"2024-09-12T18:08:03.661177+0000","last_peered":"2024-09-12T18:08:03.661177+0000","last_clean":"2024-09-12T18:08:03.661177+0000","last_became_active":"2024-09-12T17:29:58.960733+0000","last_became_peered":"2024-09-12T17:29:58.960733+0000","last_unstale":"2024-09-12T18:08:03.661177+0000","last_undegraded":"2024-09-12T18:08:03.661177+0000","last_fullsized":"2024-09-12T18:08:03.661177+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:12.596344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9021,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":245,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:04.507102+0000","last_change":"2024-09-12T17:30:00.960684+0000","last_active":"2024-09-12T18:04:04.507102+0000","last_peered":"2024-09-12T18:04:04.507102+0000","last_clean":"2024-09-12T18:04:04.507102+0000","last_became_active":"2024-09-12T17:30:00.960358+0000","last_became_peered":"2024-09-12T17:30:00.960358+0000","last_unstale":"2024-09-12T18:04:04.507102+0000","last_undegraded":"2024-09-12T18:04:04.507102+0000","last_fullsized":"2024-09-12T18:04:04.507102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:41.585720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'157","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.309864+0000","last_change":"2024-09-12T17:30:02.964368+0000","last_active":"2024-09-12T18:06:08.309864+0000","last_peered":"2024-09-12T18:06:08.309864+0000","last_clean":"2024-09-12T18:06:08.309864+0000","last_became_active":"2024-09-12T17:30:02.964082+0000","last_became_peered":"2024-09-12T17:30:02.964082+0000","last_unstale":"2024-09-12T18:06:08.309864+0000","last_undegraded":"2024-09-12T18:06:08.309864+0000","last_fullsized":"2024-09-12T18:06:08.309864+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:51.607971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":313,"num_read_kb":292,"num_write":397,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'220","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.029640+0000","last_change":"2024-09-12T18:08:22.029640+0000","last_active":"2024-09-12T18:08:22.029640+0000","last_peered":"2024-09-12T18:08:22.029640+0000","last_clean":"2024-09-12T18:08:22.029640+0000","last_became_active":"2024-09-12T17:29:54.945602+0000","last_became_peered":"2024-09-12T17:29:54.945602+0000","last_unstale":"2024-09-12T18:08:22.029640+0000","last_undegraded":"2024-09-12T18:08:22.029640+0000","last_fullsized":"2024-09-12T18:08:22.029640+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-09-12T18:08:22.029561+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-09-12T18:08:22.029561+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.029561+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:33.368230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":778,"num_write":336,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'201","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.016294+0000","last_change":"2024-09-12T18:08:11.016294+0000","last_active":"2024-09-12T18:08:11.016294+0000","last_peered":"2024-09-12T18:08:11.016294+0000","last_clean":"2024-09-12T18:08:11.016294+0000","last_became_active":"2024-09-12T17:29:52.954457+0000","last_became_peered":"2024-09-12T17:29:52.954457+0000","last_unstale":"2024-09-12T18:08:11.016294+0000","last_undegraded":"2024-09-12T18:08:11.016294+0000","last_fullsized":"2024-09-12T18:08:11.016294+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-12T18:08:11.016216+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-12T18:08:11.016216+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.016216+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:39.597855+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":114782,"num_write":980,"num_write_kb":45150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:49.504802+0000","last_change":"2024-09-12T17:29:56.953213+0000","last_active":"2024-09-12T18:03:49.504802+0000","last_peered":"2024-09-12T18:03:49.504802+0000","last_clean":"2024-09-12T18:03:49.504802+0000","last_became_active":"2024-09-12T17:29:56.952946+0000","last_became_peered":"2024-09-12T17:29:56.952946+0000","last_unstale":"2024-09-12T18:03:49.504802+0000","last_undegraded":"2024-09-12T18:03:49.504802+0000","last_fullsized":"2024-09-12T18:03:49.504802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:44.459531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'105","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.866517+0000","last_change":"2024-09-12T17:29:58.956494+0000","last_active":"2024-09-12T18:08:03.866517+0000","last_peered":"2024-09-12T18:08:03.866517+0000","last_clean":"2024-09-12T18:08:03.866517+0000","last_became_active":"2024-09-12T17:29:58.953283+0000","last_became_peered":"2024-09-12T17:29:58.953283+0000","last_unstale":"2024-09-12T18:08:03.866517+0000","last_undegraded":"2024-09-12T18:08:03.866517+0000","last_fullsized":"2024-09-12T18:08:03.866517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:18.253475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":172,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.515722+0000","last_change":"2024-09-12T17:30:00.963002+0000","last_active":"2024-09-12T18:05:04.515722+0000","last_peered":"2024-09-12T18:05:04.515722+0000","last_clean":"2024-09-12T18:05:04.515722+0000","last_became_active":"2024-09-12T17:30:00.962703+0000","last_became_peered":"2024-09-12T17:30:00.962703+0000","last_unstale":"2024-09-12T18:05:04.515722+0000","last_undegraded":"2024-09-12T18:05:04.515722+0000","last_fullsized":"2024-09-12T18:05:04.515722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:05.219468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'181","reported_seq":1637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.718070+0000","last_change":"2024-09-12T17:30:02.970877+0000","last_active":"2024-09-12T18:06:19.718070+0000","last_peered":"2024-09-12T18:06:19.718070+0000","last_clean":"2024-09-12T18:06:19.718070+0000","last_became_active":"2024-09-12T17:30:02.970633+0000","last_became_peered":"2024-09-12T17:30:02.970633+0000","last_unstale":"2024-09-12T18:06:19.718070+0000","last_undegraded":"2024-09-12T18:06:19.718070+0000","last_fullsized":"2024-09-12T18:06:19.718070+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:13.976443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1219,"num_read_kb":1215,"num_write":406,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'174","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.696777+0000","last_change":"2024-09-12T18:08:17.696777+0000","last_active":"2024-09-12T18:08:17.696777+0000","last_peered":"2024-09-12T18:08:17.696777+0000","last_clean":"2024-09-12T18:08:17.696777+0000","last_became_active":"2024-09-12T17:29:54.954585+0000","last_became_peered":"2024-09-12T17:29:54.954585+0000","last_unstale":"2024-09-12T18:08:17.696777+0000","last_undegraded":"2024-09-12T18:08:17.696777+0000","last_fullsized":"2024-09-12T18:08:17.696777+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:08:17.696671+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:08:17.696671+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.696671+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:23.668390+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":606,"num_write":278,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'199","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.144279+0000","last_change":"2024-09-12T18:08:11.144279+0000","last_active":"2024-09-12T18:08:11.144279+0000","last_peered":"2024-09-12T18:08:11.144279+0000","last_clean":"2024-09-12T18:08:11.144279+0000","last_became_active":"2024-09-12T17:29:52.956621+0000","last_became_peered":"2024-09-12T17:29:52.956621+0000","last_unstale":"2024-09-12T18:08:11.144279+0000","last_undegraded":"2024-09-12T18:08:11.144279+0000","last_fullsized":"2024-09-12T18:08:11.144279+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-12T18:08:11.144146+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-12T18:08:11.144146+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.144146+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:24.182892+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3104916,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":909,"num_read_kb":17688,"num_write":1020,"num_write_kb":27781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:03:54.633423+0000","last_change":"2024-09-12T17:29:56.955247+0000","last_active":"2024-09-12T18:03:54.633423+0000","last_peered":"2024-09-12T18:03:54.633423+0000","last_clean":"2024-09-12T18:03:54.633423+0000","last_became_active":"2024-09-12T17:29:56.954952+0000","last_became_peered":"2024-09-12T17:29:56.954952+0000","last_unstale":"2024-09-12T18:03:54.633423+0000","last_undegraded":"2024-09-12T18:03:54.633423+0000","last_fullsized":"2024-09-12T18:03:54.633423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.932927+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.932927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:49.854222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'138","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.891840+0000","last_change":"2024-09-12T17:29:58.953367+0000","last_active":"2024-09-12T18:08:03.891840+0000","last_peered":"2024-09-12T18:08:03.891840+0000","last_clean":"2024-09-12T18:08:03.891840+0000","last_became_active":"2024-09-12T17:29:58.953076+0000","last_became_peered":"2024-09-12T17:29:58.953076+0000","last_unstale":"2024-09-12T18:08:03.891840+0000","last_undegraded":"2024-09-12T18:08:03.891840+0000","last_fullsized":"2024-09-12T18:08:03.891840+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.936603+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.936603+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:10.729622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9014,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":204,"num_read_kb":286,"num_write":112,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644366+0000","last_change":"2024-09-12T17:30:00.967059+0000","last_active":"2024-09-12T18:05:04.644366+0000","last_peered":"2024-09-12T18:05:04.644366+0000","last_clean":"2024-09-12T18:05:04.644366+0000","last_became_active":"2024-09-12T17:30:00.964942+0000","last_became_peered":"2024-09-12T17:30:00.964942+0000","last_unstale":"2024-09-12T18:05:04.644366+0000","last_undegraded":"2024-09-12T18:05:04.644366+0000","last_fullsized":"2024-09-12T18:05:04.644366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.940113+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.940113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:59.160654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'116","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:37.763230+0000","last_change":"2024-09-12T17:30:02.969660+0000","last_active":"2024-09-12T18:07:37.763230+0000","last_peered":"2024-09-12T18:07:37.763230+0000","last_clean":"2024-09-12T18:07:37.763230+0000","last_became_active":"2024-09-12T17:30:02.969327+0000","last_became_peered":"2024-09-12T17:30:02.969327+0000","last_unstale":"2024-09-12T18:07:37.763230+0000","last_undegraded":"2024-09-12T18:07:37.763230+0000","last_fullsized":"2024-09-12T18:07:37.763230+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:11.229944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":150,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'198","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.318566+0000","last_change":"2024-09-12T18:08:23.318566+0000","last_active":"2024-09-12T18:08:23.318566+0000","last_peered":"2024-09-12T18:08:23.318566+0000","last_clean":"2024-09-12T18:08:23.318566+0000","last_became_active":"2024-09-12T17:29:54.956020+0000","last_became_peered":"2024-09-12T17:29:54.956020+0000","last_unstale":"2024-09-12T18:08:23.318566+0000","last_undegraded":"2024-09-12T18:08:23.318566+0000","last_fullsized":"2024-09-12T18:08:23.318566+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'198","last_scrub_stamp":"2024-09-12T18:08:23.318478+0000","last_deep_scrub":"264'198","last_deep_scrub_stamp":"2024-09-12T18:08:23.318478+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.318478+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:06.926356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":702,"num_write":286,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'210","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.023692+0000","last_change":"2024-09-12T18:08:13.023692+0000","last_active":"2024-09-12T18:08:13.023692+0000","last_peered":"2024-09-12T18:08:13.023692+0000","last_clean":"2024-09-12T18:08:13.023692+0000","last_became_active":"2024-09-12T17:29:52.963118+0000","last_became_peered":"2024-09-12T17:29:52.963118+0000","last_unstale":"2024-09-12T18:08:13.023692+0000","last_undegraded":"2024-09-12T18:08:13.023692+0000","last_fullsized":"2024-09-12T18:08:13.023692+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-12T18:08:13.023594+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-12T18:08:13.023594+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.023594+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.908176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":444,"num_read_kb":2786,"num_write":996,"num_write_kb":44194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'222","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.295537+0000","last_change":"2024-09-12T18:08:22.295537+0000","last_active":"2024-09-12T18:08:22.295537+0000","last_peered":"2024-09-12T18:08:22.295537+0000","last_clean":"2024-09-12T18:08:22.295537+0000","last_became_active":"2024-09-12T17:29:54.947659+0000","last_became_peered":"2024-09-12T17:29:54.947659+0000","last_unstale":"2024-09-12T18:08:22.295537+0000","last_undegraded":"2024-09-12T18:08:22.295537+0000","last_fullsized":"2024-09-12T18:08:22.295537+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-09-12T18:08:22.295452+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-09-12T18:08:22.295452+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.295452+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.342588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":954,"num_read_kb":780,"num_write":336,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'187","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.321394+0000","last_change":"2024-09-12T18:08:12.321394+0000","last_active":"2024-09-12T18:08:12.321394+0000","last_peered":"2024-09-12T18:08:12.321394+0000","last_clean":"2024-09-12T18:08:12.321394+0000","last_became_active":"2024-09-12T17:29:52.955546+0000","last_became_peered":"2024-09-12T17:29:52.955546+0000","last_unstale":"2024-09-12T18:08:12.321394+0000","last_undegraded":"2024-09-12T18:08:12.321394+0000","last_fullsized":"2024-09-12T18:08:12.321394+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-12T18:08:12.321242+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-12T18:08:12.321242+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.321242+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:11.147772+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5712374,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":628,"num_read_kb":171668,"num_write":902,"num_write_kb":49213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'156","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.113845+0000","last_change":"2024-09-12T17:29:54.958380+0000","last_active":"2024-09-12T18:06:09.113845+0000","last_peered":"2024-09-12T18:06:09.113845+0000","last_clean":"2024-09-12T18:06:09.113845+0000","last_became_active":"2024-09-12T17:29:54.958047+0000","last_became_peered":"2024-09-12T17:29:54.958047+0000","last_unstale":"2024-09-12T18:06:09.113845+0000","last_undegraded":"2024-09-12T18:06:09.113845+0000","last_fullsized":"2024-09-12T18:06:09.113845+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:44.328756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":718,"num_read_kb":592,"num_write":271,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'177","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.466300+0000","last_change":"2024-09-12T18:08:16.466300+0000","last_active":"2024-09-12T18:08:16.466300+0000","last_peered":"2024-09-12T18:08:16.466300+0000","last_clean":"2024-09-12T18:08:16.466300+0000","last_became_active":"2024-09-12T17:29:52.955924+0000","last_became_peered":"2024-09-12T17:29:52.955924+0000","last_unstale":"2024-09-12T18:08:16.466300+0000","last_undegraded":"2024-09-12T18:08:16.466300+0000","last_fullsized":"2024-09-12T18:08:16.466300+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:08:16.466188+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:08:16.466188+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.466188+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:45.623269+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4131368,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":446,"num_read_kb":86465,"num_write":876,"num_write_kb":34463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'67","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.278214+0000","last_change":"2024-09-12T18:08:20.278214+0000","last_active":"2024-09-12T18:08:20.278214+0000","last_peered":"2024-09-12T18:08:20.278214+0000","last_clean":"2024-09-12T18:08:20.278214+0000","last_became_active":"2024-09-12T17:29:54.956587+0000","last_became_peered":"2024-09-12T17:29:54.956587+0000","last_unstale":"2024-09-12T18:08:20.278214+0000","last_undegraded":"2024-09-12T18:08:20.278214+0000","last_fullsized":"2024-09-12T18:08:20.278214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-09-12T18:08:20.278133+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-09-12T18:08:20.278133+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.278133+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:53.896456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":238,"num_write":111,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'195","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.116624+0000","last_change":"2024-09-12T18:08:12.116624+0000","last_active":"2024-09-12T18:08:12.116624+0000","last_peered":"2024-09-12T18:08:12.116624+0000","last_clean":"2024-09-12T18:08:12.116624+0000","last_became_active":"2024-09-12T17:29:52.961103+0000","last_became_peered":"2024-09-12T17:29:52.961103+0000","last_unstale":"2024-09-12T18:08:12.116624+0000","last_undegraded":"2024-09-12T18:08:12.116624+0000","last_fullsized":"2024-09-12T18:08:12.116624+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T18:08:12.116514+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T18:08:12.116514+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.116514+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:09.737301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":61034,"num_write":905,"num_write_kb":21974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'80","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:57.348999+0000","last_change":"2024-09-12T17:29:54.956259+0000","last_active":"2024-09-12T18:05:57.348999+0000","last_peered":"2024-09-12T18:05:57.348999+0000","last_clean":"2024-09-12T18:05:57.348999+0000","last_became_active":"2024-09-12T17:29:54.955986+0000","last_became_peered":"2024-09-12T17:29:54.955986+0000","last_unstale":"2024-09-12T18:05:57.348999+0000","last_undegraded":"2024-09-12T18:05:57.348999+0000","last_fullsized":"2024-09-12T18:05:57.348999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:45.758007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":303,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'242","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.385914+0000","last_change":"2024-09-12T18:08:16.385838+0000","last_active":"2024-09-12T18:08:16.385914+0000","last_peered":"2024-09-12T18:08:16.385914+0000","last_clean":"2024-09-12T18:08:16.385914+0000","last_became_active":"2024-09-12T17:31:28.509017+0000","last_became_peered":"2024-09-12T17:31:28.509017+0000","last_unstale":"2024-09-12T18:08:16.385914+0000","last_undegraded":"2024-09-12T18:08:16.385914+0000","last_fullsized":"2024-09-12T18:08:16.385914+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'242","last_scrub_stamp":"2024-09-12T18:08:16.385665+0000","last_deep_scrub":"264'242","last_deep_scrub_stamp":"2024-09-12T18:08:16.385665+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.385665+0000","objects_scrubbed":12,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:17.985445+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9316189,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":509,"num_read_kb":51273,"num_write":1111,"num_write_kb":73287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"264'52","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.707353+0000","last_change":"2024-09-12T18:08:20.707353+0000","last_active":"2024-09-12T18:08:20.707353+0000","last_peered":"2024-09-12T18:08:20.707353+0000","last_clean":"2024-09-12T18:08:20.707353+0000","last_became_active":"2024-09-12T17:29:54.957480+0000","last_became_peered":"2024-09-12T17:29:54.957480+0000","last_unstale":"2024-09-12T18:08:20.707353+0000","last_undegraded":"2024-09-12T18:08:20.707353+0000","last_fullsized":"2024-09-12T18:08:20.707353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-12T18:08:20.707268+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-12T18:08:20.707268+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.707268+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:31.235559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":218,"num_write":68,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'172","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.244570+0000","last_change":"2024-09-12T18:08:15.244570+0000","last_active":"2024-09-12T18:08:15.244570+0000","last_peered":"2024-09-12T18:08:15.244570+0000","last_clean":"2024-09-12T18:08:15.244570+0000","last_became_active":"2024-09-12T17:29:52.945750+0000","last_became_peered":"2024-09-12T17:29:52.945750+0000","last_unstale":"2024-09-12T18:08:15.244570+0000","last_undegraded":"2024-09-12T18:08:15.244570+0000","last_fullsized":"2024-09-12T18:08:15.244570+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'172","last_scrub_stamp":"2024-09-12T18:08:15.244411+0000","last_deep_scrub":"264'172","last_deep_scrub_stamp":"2024-09-12T18:08:15.244411+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.244411+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:04.460342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":408,"num_read_kb":12063,"num_write":843,"num_write_kb":23165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'78","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.070644+0000","last_change":"2024-09-12T18:08:23.070644+0000","last_active":"2024-09-12T18:08:23.070644+0000","last_peered":"2024-09-12T18:08:23.070644+0000","last_clean":"2024-09-12T18:08:23.070644+0000","last_became_active":"2024-09-12T17:29:54.949704+0000","last_became_peered":"2024-09-12T17:29:54.949704+0000","last_unstale":"2024-09-12T18:08:23.070644+0000","last_undegraded":"2024-09-12T18:08:23.070644+0000","last_fullsized":"2024-09-12T18:08:23.070644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-09-12T18:08:23.070551+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-09-12T18:08:23.070551+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.070551+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:51.197271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":312,"num_write":123,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'203","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.047419+0000","last_change":"2024-09-12T18:08:14.047419+0000","last_active":"2024-09-12T18:08:14.047419+0000","last_peered":"2024-09-12T18:08:14.047419+0000","last_clean":"2024-09-12T18:08:14.047419+0000","last_became_active":"2024-09-12T17:29:52.960336+0000","last_became_peered":"2024-09-12T17:29:52.960336+0000","last_unstale":"2024-09-12T18:08:14.047419+0000","last_undegraded":"2024-09-12T18:08:14.047419+0000","last_fullsized":"2024-09-12T18:08:14.047419+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-12T18:08:14.047306+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-12T18:08:14.047306+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.047306+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:01.929338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524427,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":45667,"num_write":962,"num_write_kb":42266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'76","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.108330+0000","last_change":"2024-09-12T18:08:21.108330+0000","last_active":"2024-09-12T18:08:21.108330+0000","last_peered":"2024-09-12T18:08:21.108330+0000","last_clean":"2024-09-12T18:08:21.108330+0000","last_became_active":"2024-09-12T17:29:54.956296+0000","last_became_peered":"2024-09-12T17:29:54.956296+0000","last_unstale":"2024-09-12T18:08:21.108330+0000","last_undegraded":"2024-09-12T18:08:21.108330+0000","last_fullsized":"2024-09-12T18:08:21.108330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'76","last_scrub_stamp":"2024-09-12T18:08:21.108246+0000","last_deep_scrub":"264'76","last_deep_scrub_stamp":"2024-09-12T18:08:21.108246+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.108246+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:09.120650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":291,"num_write":101,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'208","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.066221+0000","last_change":"2024-09-12T18:08:13.066221+0000","last_active":"2024-09-12T18:08:13.066221+0000","last_peered":"2024-09-12T18:08:13.066221+0000","last_clean":"2024-09-12T18:08:13.066221+0000","last_became_active":"2024-09-12T17:29:52.953110+0000","last_became_peered":"2024-09-12T17:29:52.953110+0000","last_unstale":"2024-09-12T18:08:13.066221+0000","last_undegraded":"2024-09-12T18:08:13.066221+0000","last_fullsized":"2024-09-12T18:08:13.066221+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T18:08:13.066097+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T18:08:13.066097+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.066097+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:34.052495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":64382,"num_write":937,"num_write_kb":39967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'142","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.133795+0000","last_change":"2024-09-12T18:08:22.133795+0000","last_active":"2024-09-12T18:08:22.133795+0000","last_peered":"2024-09-12T18:08:22.133795+0000","last_clean":"2024-09-12T18:08:22.133795+0000","last_became_active":"2024-09-12T17:29:54.944775+0000","last_became_peered":"2024-09-12T17:29:54.944775+0000","last_unstale":"2024-09-12T18:08:22.133795+0000","last_undegraded":"2024-09-12T18:08:22.133795+0000","last_fullsized":"2024-09-12T18:08:22.133795+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:08:22.133695+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:08:22.133695+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.133695+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:48.310100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":576,"num_read_kb":470,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'239","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.450063+0000","last_change":"2024-09-12T18:08:17.450063+0000","last_active":"2024-09-12T18:08:17.450063+0000","last_peered":"2024-09-12T18:08:17.450063+0000","last_clean":"2024-09-12T18:08:17.450063+0000","last_became_active":"2024-09-12T17:29:52.952892+0000","last_became_peered":"2024-09-12T17:29:52.952892+0000","last_unstale":"2024-09-12T18:08:17.450063+0000","last_undegraded":"2024-09-12T18:08:17.450063+0000","last_fullsized":"2024-09-12T18:08:17.450063+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'239","last_scrub_stamp":"2024-09-12T18:08:17.449925+0000","last_deep_scrub":"264'239","last_deep_scrub_stamp":"2024-09-12T18:08:17.449925+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.449925+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:31.739549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1423505,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":801,"num_read_kb":90532,"num_write":1295,"num_write_kb":28113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'4190","reported_seq":4824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.763924+0000","last_change":"2024-09-12T18:08:22.763924+0000","last_active":"2024-09-12T18:08:22.763924+0000","last_peered":"2024-09-12T18:08:22.763924+0000","last_clean":"2024-09-12T18:08:22.763924+0000","last_became_active":"2024-09-12T17:29:54.956030+0000","last_became_peered":"2024-09-12T17:29:54.956030+0000","last_unstale":"2024-09-12T18:08:22.763924+0000","last_undegraded":"2024-09-12T18:08:22.763924+0000","last_fullsized":"2024-09-12T18:08:22.763924+0000","mapping_epoch":26,"log_start":"264'4100","ondisk_log_start":"264'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4190","last_scrub_stamp":"2024-09-12T18:08:22.763830+0000","last_deep_scrub":"264'4190","last_deep_scrub_stamp":"2024-09-12T18:08:22.763830+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.763830+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":3000,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:13.600432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16971,"num_read_kb":14174,"num_write":6344,"num_write_kb":3204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'200","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.106345+0000","last_change":"2024-09-12T18:08:15.106345+0000","last_active":"2024-09-12T18:08:15.106345+0000","last_peered":"2024-09-12T18:08:15.106345+0000","last_clean":"2024-09-12T18:08:15.106345+0000","last_became_active":"2024-09-12T17:29:52.953694+0000","last_became_peered":"2024-09-12T17:29:52.953694+0000","last_unstale":"2024-09-12T18:08:15.106345+0000","last_undegraded":"2024-09-12T18:08:15.106345+0000","last_fullsized":"2024-09-12T18:08:15.106345+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-12T18:08:15.106190+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-12T18:08:15.106190+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.106190+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:05.110290+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174802,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":9241,"num_write":950,"num_write_kb":54194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'299","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.364780+0000","last_change":"2024-09-12T18:08:14.364687+0000","last_active":"2024-09-12T18:08:14.364780+0000","last_peered":"2024-09-12T18:08:14.364780+0000","last_clean":"2024-09-12T18:08:14.364780+0000","last_became_active":"2024-09-12T17:29:54.954593+0000","last_became_peered":"2024-09-12T17:29:54.954593+0000","last_unstale":"2024-09-12T18:08:14.364780+0000","last_undegraded":"2024-09-12T18:08:14.364780+0000","last_fullsized":"2024-09-12T18:08:14.364780+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T18:08:14.364594+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T18:08:14.364594+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.364594+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:32.644840+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1407,"num_read_kb":1154,"num_write":474,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4002,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'211","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.452953+0000","last_change":"2024-09-12T18:08:19.452953+0000","last_active":"2024-09-12T18:08:19.452953+0000","last_peered":"2024-09-12T18:08:19.452953+0000","last_clean":"2024-09-12T18:08:19.452953+0000","last_became_active":"2024-09-12T17:29:52.958021+0000","last_became_peered":"2024-09-12T17:29:52.958021+0000","last_unstale":"2024-09-12T18:08:19.452953+0000","last_undegraded":"2024-09-12T18:08:19.452953+0000","last_fullsized":"2024-09-12T18:08:19.452953+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-09-12T18:08:19.452849+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-09-12T18:08:19.452849+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.452849+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:37.690114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174726,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":543,"num_read_kb":26305,"num_write":962,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'301","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.724778+0000","last_change":"2024-09-12T18:08:21.724778+0000","last_active":"2024-09-12T18:08:21.724778+0000","last_peered":"2024-09-12T18:08:21.724778+0000","last_clean":"2024-09-12T18:08:21.724778+0000","last_became_active":"2024-09-12T17:29:54.957636+0000","last_became_peered":"2024-09-12T17:29:54.957636+0000","last_unstale":"2024-09-12T18:08:21.724778+0000","last_undegraded":"2024-09-12T18:08:21.724778+0000","last_fullsized":"2024-09-12T18:08:21.724778+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'301","last_scrub_stamp":"2024-09-12T18:08:21.724693+0000","last_deep_scrub":"264'301","last_deep_scrub_stamp":"2024-09-12T18:08:21.724693+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.724693+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:40.322921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1037,"num_write":475,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'227","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.129459+0000","last_change":"2024-09-12T18:08:13.129459+0000","last_active":"2024-09-12T18:08:13.129459+0000","last_peered":"2024-09-12T18:08:13.129459+0000","last_clean":"2024-09-12T18:08:13.129459+0000","last_became_active":"2024-09-12T17:29:52.966500+0000","last_became_peered":"2024-09-12T17:29:52.966500+0000","last_unstale":"2024-09-12T18:08:13.129459+0000","last_undegraded":"2024-09-12T18:08:13.129459+0000","last_fullsized":"2024-09-12T18:08:13.129459+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-09-12T18:08:13.129341+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-09-12T18:08:13.129341+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.129341+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:16.854387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254282,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":515,"num_read_kb":34941,"num_write":1118,"num_write_kb":28764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'173","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:07.718773+0000","last_change":"2024-09-12T17:30:28.010302+0000","last_active":"2024-09-12T18:06:07.718773+0000","last_peered":"2024-09-12T18:06:07.718773+0000","last_clean":"2024-09-12T18:06:07.718773+0000","last_became_active":"2024-09-12T17:30:28.010055+0000","last_became_peered":"2024-09-12T17:30:28.010055+0000","last_unstale":"2024-09-12T18:06:07.718773+0000","last_undegraded":"2024-09-12T18:06:07.718773+0000","last_fullsized":"2024-09-12T18:06:07.718773+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:49.191682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":614,"num_write":281,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'200","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.071442+0000","last_change":"2024-09-12T18:08:15.071442+0000","last_active":"2024-09-12T18:08:15.071442+0000","last_peered":"2024-09-12T18:08:15.071442+0000","last_clean":"2024-09-12T18:08:15.071442+0000","last_became_active":"2024-09-12T17:29:52.954238+0000","last_became_peered":"2024-09-12T17:29:52.954238+0000","last_unstale":"2024-09-12T18:08:15.071442+0000","last_undegraded":"2024-09-12T18:08:15.071442+0000","last_fullsized":"2024-09-12T18:08:15.071442+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-12T18:08:15.071334+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-12T18:08:15.071334+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.071334+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:38.079896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":33290,"num_write":857,"num_write_kb":39696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'174","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.073348+0000","last_change":"2024-09-12T18:08:20.073348+0000","last_active":"2024-09-12T18:08:20.073348+0000","last_peered":"2024-09-12T18:08:20.073348+0000","last_clean":"2024-09-12T18:08:20.073348+0000","last_became_active":"2024-09-12T17:29:54.944623+0000","last_became_peered":"2024-09-12T17:29:54.944623+0000","last_unstale":"2024-09-12T18:08:20.073348+0000","last_undegraded":"2024-09-12T18:08:20.073348+0000","last_fullsized":"2024-09-12T18:08:20.073348+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:08:20.073256+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:08:20.073256+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.073256+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:47.502492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":587,"num_write":256,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'218","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.693029+0000","last_change":"2024-09-12T18:08:19.693029+0000","last_active":"2024-09-12T18:08:19.693029+0000","last_peered":"2024-09-12T18:08:19.693029+0000","last_clean":"2024-09-12T18:08:19.693029+0000","last_became_active":"2024-09-12T17:29:52.951819+0000","last_became_peered":"2024-09-12T17:29:52.951819+0000","last_unstale":"2024-09-12T18:08:19.693029+0000","last_undegraded":"2024-09-12T18:08:19.693029+0000","last_fullsized":"2024-09-12T18:08:19.693029+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-09-12T18:08:19.692857+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-09-12T18:08:19.692857+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.692857+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:00.897060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287564,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":4445,"num_write":1040,"num_write_kb":38455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'247","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:02.434872+0000","last_change":"2024-09-12T17:29:54.952227+0000","last_active":"2024-09-12T18:06:02.434872+0000","last_peered":"2024-09-12T18:06:02.434872+0000","last_clean":"2024-09-12T18:06:02.434872+0000","last_became_active":"2024-09-12T17:29:54.950941+0000","last_became_peered":"2024-09-12T17:29:54.950941+0000","last_unstale":"2024-09-12T18:06:02.434872+0000","last_undegraded":"2024-09-12T18:06:02.434872+0000","last_fullsized":"2024-09-12T18:06:02.434872+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":842,"num_write":398,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'207","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.297209+0000","last_change":"2024-09-12T18:08:11.297209+0000","last_active":"2024-09-12T18:08:11.297209+0000","last_peered":"2024-09-12T18:08:11.297209+0000","last_clean":"2024-09-12T18:08:11.297209+0000","last_became_active":"2024-09-12T17:29:52.953569+0000","last_became_peered":"2024-09-12T17:29:52.953569+0000","last_unstale":"2024-09-12T18:08:11.297209+0000","last_undegraded":"2024-09-12T18:08:11.297209+0000","last_fullsized":"2024-09-12T18:08:11.297209+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:11.297114+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:11.297114+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.297114+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:20.913969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":380,"num_read_kb":11537,"num_write":1039,"num_write_kb":39628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'119","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:52.659784+0000","last_change":"2024-09-12T17:29:54.961906+0000","last_active":"2024-09-12T18:05:52.659784+0000","last_peered":"2024-09-12T18:05:52.659784+0000","last_clean":"2024-09-12T18:05:52.659784+0000","last_became_active":"2024-09-12T17:29:54.961615+0000","last_became_peered":"2024-09-12T17:29:54.961615+0000","last_unstale":"2024-09-12T18:05:52.659784+0000","last_undegraded":"2024-09-12T18:05:52.659784+0000","last_fullsized":"2024-09-12T18:05:52.659784+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:47.744907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":544,"num_read_kb":456,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'264","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.495069+0000","last_change":"2024-09-12T18:08:18.495069+0000","last_active":"2024-09-12T18:08:18.495069+0000","last_peered":"2024-09-12T18:08:18.495069+0000","last_clean":"2024-09-12T18:08:18.495069+0000","last_became_active":"2024-09-12T17:29:52.954363+0000","last_became_peered":"2024-09-12T17:29:52.954363+0000","last_unstale":"2024-09-12T18:08:18.495069+0000","last_undegraded":"2024-09-12T18:08:18.495069+0000","last_fullsized":"2024-09-12T18:08:18.495069+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-09-12T18:08:18.494932+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-09-12T18:08:18.494932+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.494932+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:35.278309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505373,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":610,"num_read_kb":60789,"num_write":1183,"num_write_kb":24093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'153","reported_seq":763,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.506389+0000","last_change":"2024-09-12T18:08:21.506389+0000","last_active":"2024-09-12T18:08:21.506389+0000","last_peered":"2024-09-12T18:08:21.506389+0000","last_clean":"2024-09-12T18:08:21.506389+0000","last_became_active":"2024-09-12T17:29:52.952766+0000","last_became_peered":"2024-09-12T17:29:52.952766+0000","last_unstale":"2024-09-12T18:08:21.506389+0000","last_undegraded":"2024-09-12T18:08:21.506389+0000","last_fullsized":"2024-09-12T18:08:21.506389+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-12T18:08:21.506224+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-12T18:08:21.506224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.506224+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:00.437314+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847564,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":395,"num_read_kb":30421,"num_write":779,"num_write_kb":28733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'81","reported_seq":672,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.164635+0000","last_change":"2024-09-12T18:08:23.164635+0000","last_active":"2024-09-12T18:08:23.164635+0000","last_peered":"2024-09-12T18:08:23.164635+0000","last_clean":"2024-09-12T18:08:23.164635+0000","last_became_active":"2024-09-12T17:29:54.944681+0000","last_became_peered":"2024-09-12T17:29:54.944681+0000","last_unstale":"2024-09-12T18:08:23.164635+0000","last_undegraded":"2024-09-12T18:08:23.164635+0000","last_fullsized":"2024-09-12T18:08:23.164635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'81","last_scrub_stamp":"2024-09-12T18:08:23.164513+0000","last_deep_scrub":"264'81","last_deep_scrub_stamp":"2024-09-12T18:08:23.164513+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.164513+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:48.210606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":330,"num_write":124,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'186","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.243119+0000","last_change":"2024-09-12T18:08:13.243119+0000","last_active":"2024-09-12T18:08:13.243119+0000","last_peered":"2024-09-12T18:08:13.243119+0000","last_clean":"2024-09-12T18:08:13.243119+0000","last_became_active":"2024-09-12T17:29:52.942331+0000","last_became_peered":"2024-09-12T17:29:52.942331+0000","last_unstale":"2024-09-12T18:08:13.243119+0000","last_undegraded":"2024-09-12T18:08:13.243119+0000","last_fullsized":"2024-09-12T18:08:13.243119+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'186","last_scrub_stamp":"2024-09-12T18:08:13.242996+0000","last_deep_scrub":"264'186","last_deep_scrub_stamp":"2024-09-12T18:08:13.242996+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.242996+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:49.416924+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364835,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":15046,"num_write":966,"num_write_kb":38540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'194","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.022497+0000","last_change":"2024-09-12T17:29:54.963259+0000","last_active":"2024-09-12T18:05:56.022497+0000","last_peered":"2024-09-12T18:05:56.022497+0000","last_clean":"2024-09-12T18:05:56.022497+0000","last_became_active":"2024-09-12T17:29:54.962921+0000","last_became_peered":"2024-09-12T17:29:54.962921+0000","last_unstale":"2024-09-12T18:05:56.022497+0000","last_undegraded":"2024-09-12T18:05:56.022497+0000","last_fullsized":"2024-09-12T18:05:56.022497+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.929278+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.929278+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:02.447215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":851,"num_read_kb":702,"num_write":304,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":4389,"num_write":1992,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1063,"ondisk_log_size":1063,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":16199,"num_read_kb":15887,"num_write":16770,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1852,"ondisk_log_size":1852,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":495,"ondisk_log_size":495,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":279568,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7821,"num_read_kb":9826,"num_write":5191,"num_write_kb":2504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2027,"ondisk_log_size":2027,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2870,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102452,"num_read_kb":85292,"num_write":37168,"num_write_kb":18720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":40407,"num_omap_keys":164,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4237,"ondisk_log_size":4237,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":83899209,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":32969,"num_read_kb":2424206,"num_write":62978,"num_write_kb":2261412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127942656,"data_stored":127942656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4263,"ondisk_log_size":4263,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":207617,"num_write":161,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":201926,"num_write":161,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542615,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":234584,"kb_used_data":10440,"kb_used_omap":1,"kb_used_meta":224126,"kb_avail":94137256,"statfs":{"total":96636764160,"available":96396550144,"internally_reserved":0,"allocated":10690560,"data_stored":8703800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":229505482},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542614,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":240016,"kb_used_data":20032,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94131824,"statfs":{"total":96636764160,"available":96390987776,"internally_reserved":0,"allocated":20512768,"data_stored":18573799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542616,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122856,"kb_used_data":29272,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94248984,"statfs":{"total":96636764160,"available":96510959616,"internally_reserved":0,"allocated":29974528,"data_stored":27974659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542615,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93540,"kb_used_data":26260,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94278300,"statfs":{"total":96636764160,"available":96540979200,"internally_reserved":0,"allocated":26890240,"data_stored":24978624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542613,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249468,"kb_used_data":19756,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122372,"statfs":{"total":96636764160,"available":96381308928,"internally_reserved":0,"allocated":20230144,"data_stored":18248382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542614,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100664,"kb_used_data":15400,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94271176,"statfs":{"total":96636764160,"available":96533684224,"internally_reserved":0,"allocated":15769600,"data_stored":13844138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542615,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125220,"kb_used_data":13588,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94246620,"statfs":{"total":96636764160,"available":96508538880,"internally_reserved":0,"allocated":13914112,"data_stored":11951207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542614,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262484,"kb_used_data":24452,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94109356,"statfs":{"total":96636764160,"available":96367980544,"internally_reserved":0,"allocated":25038848,"data_stored":23061641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20193280,"data_stored":20193280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9674752,"data_stored":9674752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11567104,"data_stored":11567104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15970304,"data_stored":15970304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22704128,"data_stored":22704128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25698304,"data_stored":25698304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16297984,"data_stored":16297984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5836800,"data_stored":5836800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:08:30.953 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.953 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.953 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.953 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.953 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.953 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.954 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.954 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.954 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.954 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.954 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.954 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.954 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.954 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.954 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.954 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.955 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.955 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.955 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.955 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.955 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.955 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.955 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.955 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.955 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.955 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.956 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.956 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.956 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.956 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.956 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.956 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.956 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.956 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.957 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.957 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.957 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.957 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.957 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.957 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.957 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.957 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.958 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.958 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.958 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.958 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.958 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.958 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.958 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.958 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.959 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.959 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.959 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.959 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.959 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.959 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.959 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.959 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.959 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.960 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.960 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.960 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.960 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.960 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.960 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.960 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.960 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.960 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.961 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.961 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.961 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.961 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.961 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.961 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.961 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.961 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.961 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.961 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.962 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.962 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.962 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.962 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.962 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.962 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.962 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.962 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.962 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.963 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.963 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.963 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.963 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.963 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.963 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.963 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.964 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.964 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.964 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.964 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.964 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.964 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.964 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.964 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.964 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.965 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.965 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.965 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.965 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.965 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.965 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.965 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.965 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.966 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.966 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.966 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.966 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.966 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.966 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.966 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.966 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.967 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.967 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.967 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.967 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.967 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.967 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.967 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.967 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.968 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.968 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.968 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.968 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.968 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.968 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.969 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.969 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.969 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.969 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.969 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.969 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.969 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.970 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.970 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.970 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.970 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.970 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.970 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.970 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.970 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.971 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.971 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.971 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.971 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.971 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.971 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.971 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.972 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.972 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.972 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.972 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.972 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.972 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.973 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.973 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.973 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.973 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.974 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.974 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.974 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.974 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.974 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.974 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.974 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.974 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.975 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.975 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.975 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.975 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.975 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.975 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.975 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.975 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.975 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.976 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.976 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.976 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.976 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.976 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.976 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.976 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.976 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.977 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.977 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.977 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.977 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.977 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.977 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.977 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.978 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.978 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.978 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.978 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.978 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.978 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.978 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.978 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.978 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.979 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.979 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.979 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.979 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.979 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.979 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.979 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.979 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.980 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.980 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.980 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.980 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.980 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.980 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.980 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.980 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.980 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.981 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.981 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.981 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.981 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.981 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.981 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.981 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.981 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.982 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.982 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.982 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.982 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.982 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.982 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.982 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.982 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.983 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.983 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.983 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.983 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.983 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.983 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.983 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.983 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.983 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.983 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.984 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.984 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.984 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.984 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.984 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:29:55.932927+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.985 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:29:57.936603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.985 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:29:59.940113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.985 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.985 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.985 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.985 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.986 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.986 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.986 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:29:53.929278+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:30.986 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:08:50.987 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:08:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:08:51.338 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-09-12T18:08:51.340 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":1434,"stamp":"2024-09-12T18:08:49.302006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84787076,"num_objects":562,"num_object_clones":0,"num_object_copies":1357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":562,"num_whiteouts":0,"num_read":168345,"num_read_kb":2952080,"num_write":124562,"num_write_kb":2564884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":726779,"num_omap_keys":1777,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14400,"ondisk_log_size":14400,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1416352,"kb_used_data":159200,"kb_used_omap":12,"kb_used_meta":1257011,"kb_avail":753558368,"statfs":{"total":773094113280,"available":771643768832,"internally_reserved":0,"allocated":163020800,"data_stored":147336250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1287179826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":526977,"num_omap_keys":1229,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005040"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.634310+0000","last_change":"2024-09-12T17:57:00.464809+0000","last_active":"2024-09-12T18:04:29.634310+0000","last_peered":"2024-09-12T18:04:29.634310+0000","last_clean":"2024-09-12T18:04:29.634310+0000","last_became_active":"2024-09-12T17:57:00.464331+0000","last_became_peered":"2024-09-12T17:57:00.464331+0000","last_unstale":"2024-09-12T18:04:29.634310+0000","last_undegraded":"2024-09-12T18:04:29.634310+0000","last_fullsized":"2024-09-12T18:04:29.634310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:20.663580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.631990+0000","last_change":"2024-09-12T17:46:45.211816+0000","last_active":"2024-09-12T18:04:14.631990+0000","last_peered":"2024-09-12T18:04:14.631990+0000","last_clean":"2024-09-12T18:04:14.631990+0000","last_became_active":"2024-09-12T17:46:45.211533+0000","last_became_peered":"2024-09-12T17:46:45.211533+0000","last_unstale":"2024-09-12T18:04:14.631990+0000","last_undegraded":"2024-09-12T18:04:14.631990+0000","last_fullsized":"2024-09-12T18:04:14.631990+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:29.748663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.792520+0000","last_change":"2024-09-12T17:46:42.179842+0000","last_active":"2024-09-12T18:08:03.792520+0000","last_peered":"2024-09-12T18:08:03.792520+0000","last_clean":"2024-09-12T18:08:03.792520+0000","last_became_active":"2024-09-12T17:46:42.179372+0000","last_became_peered":"2024-09-12T17:46:42.179372+0000","last_unstale":"2024-09-12T18:08:03.792520+0000","last_undegraded":"2024-09-12T18:08:03.792520+0000","last_fullsized":"2024-09-12T18:08:03.792520+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:29.561145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6715,"num_write":5,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'32","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:55.172145+0000","last_change":"2024-09-12T17:45:03.890371+0000","last_active":"2024-09-12T18:05:55.172145+0000","last_peered":"2024-09-12T18:05:55.172145+0000","last_clean":"2024-09-12T18:05:55.172145+0000","last_became_active":"2024-09-12T17:45:03.890104+0000","last_became_peered":"2024-09-12T17:45:03.890104+0000","last_unstale":"2024-09-12T18:05:55.172145+0000","last_undegraded":"2024-09-12T18:05:55.172145+0000","last_fullsized":"2024-09-12T18:05:55.172145+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:20.406460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":111,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.351466+0000","last_change":"2024-09-12T18:08:40.351466+0000","last_active":"2024-09-12T18:08:40.351466+0000","last_peered":"2024-09-12T18:08:40.351466+0000","last_clean":"2024-09-12T18:08:40.351466+0000","last_became_active":"2024-09-12T17:57:00.466304+0000","last_became_peered":"2024-09-12T17:57:00.466304+0000","last_unstale":"2024-09-12T18:08:40.351466+0000","last_undegraded":"2024-09-12T18:08:40.351466+0000","last_fullsized":"2024-09-12T18:08:40.351466+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:40.351382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:40.351382+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.351382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:41.320349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:44.529464+0000","last_change":"2024-09-12T17:46:45.202607+0000","last_active":"2024-09-12T18:06:44.529464+0000","last_peered":"2024-09-12T18:06:44.529464+0000","last_clean":"2024-09-12T18:06:44.529464+0000","last_became_active":"2024-09-12T17:46:45.202290+0000","last_became_peered":"2024-09-12T17:46:45.202290+0000","last_unstale":"2024-09-12T18:06:44.529464+0000","last_undegraded":"2024-09-12T18:06:44.529464+0000","last_fullsized":"2024-09-12T18:06:44.529464+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:30.467678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.153255+0000","last_change":"2024-09-12T18:08:43.153255+0000","last_active":"2024-09-12T18:08:43.153255+0000","last_peered":"2024-09-12T18:08:43.153255+0000","last_clean":"2024-09-12T18:08:43.153255+0000","last_became_active":"2024-09-12T17:46:42.177112+0000","last_became_peered":"2024-09-12T17:46:42.177112+0000","last_unstale":"2024-09-12T18:08:43.153255+0000","last_undegraded":"2024-09-12T18:08:43.153255+0000","last_fullsized":"2024-09-12T18:08:43.153255+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:08:43.153171+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:08:43.153171+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.153171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:45.201159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10811,"num_write":18,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'16","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.424946+0000","last_change":"2024-09-12T18:08:31.424946+0000","last_active":"2024-09-12T18:08:31.424946+0000","last_peered":"2024-09-12T18:08:31.424946+0000","last_clean":"2024-09-12T18:08:31.424946+0000","last_became_active":"2024-09-12T17:45:03.893002+0000","last_became_peered":"2024-09-12T17:45:03.893002+0000","last_unstale":"2024-09-12T18:08:31.424946+0000","last_undegraded":"2024-09-12T18:08:31.424946+0000","last_fullsized":"2024-09-12T18:08:31.424946+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T18:08:31.424875+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T18:08:31.424875+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.424875+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:19.126454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508520+0000","last_change":"2024-09-12T17:57:00.457762+0000","last_active":"2024-09-12T18:04:14.508520+0000","last_peered":"2024-09-12T18:04:14.508520+0000","last_clean":"2024-09-12T18:04:14.508520+0000","last_became_active":"2024-09-12T17:57:00.456939+0000","last_became_peered":"2024-09-12T17:57:00.456939+0000","last_unstale":"2024-09-12T18:04:14.508520+0000","last_undegraded":"2024-09-12T18:04:14.508520+0000","last_fullsized":"2024-09-12T18:04:14.508520+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:16.042163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'10","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.760358+0000","last_change":"2024-09-12T17:46:45.537660+0000","last_active":"2024-09-12T18:08:03.760358+0000","last_peered":"2024-09-12T18:08:03.760358+0000","last_clean":"2024-09-12T18:08:03.760358+0000","last_became_active":"2024-09-12T17:46:45.536920+0000","last_became_peered":"2024-09-12T17:46:45.536920+0000","last_unstale":"2024-09-12T18:08:03.760358+0000","last_undegraded":"2024-09-12T18:08:03.760358+0000","last_fullsized":"2024-09-12T18:08:03.760358+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.487169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":15,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.367612+0000","last_change":"2024-09-12T18:08:36.367553+0000","last_active":"2024-09-12T18:08:36.367612+0000","last_peered":"2024-09-12T18:08:36.367612+0000","last_clean":"2024-09-12T18:08:36.367612+0000","last_became_active":"2024-09-12T17:46:42.185870+0000","last_became_peered":"2024-09-12T17:46:42.185870+0000","last_unstale":"2024-09-12T18:08:36.367612+0000","last_undegraded":"2024-09-12T18:08:36.367612+0000","last_fullsized":"2024-09-12T18:08:36.367612+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:36.367467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:36.367467+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.367467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:56.284371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'49","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.644429+0000","last_change":"2024-09-12T17:45:03.895036+0000","last_active":"2024-09-12T18:05:04.644429+0000","last_peered":"2024-09-12T18:05:04.644429+0000","last_clean":"2024-09-12T18:05:04.644429+0000","last_became_active":"2024-09-12T17:45:03.894537+0000","last_became_peered":"2024-09-12T17:45:03.894537+0000","last_unstale":"2024-09-12T18:05:04.644429+0000","last_undegraded":"2024-09-12T18:05:04.644429+0000","last_fullsized":"2024-09-12T18:05:04.644429+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:15.446699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":186,"num_write":90,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:19.519960+0000","last_change":"2024-09-12T17:57:00.465664+0000","last_active":"2024-09-12T18:04:19.519960+0000","last_peered":"2024-09-12T18:04:19.519960+0000","last_clean":"2024-09-12T18:04:19.519960+0000","last_became_active":"2024-09-12T17:57:00.464157+0000","last_became_peered":"2024-09-12T17:57:00.464157+0000","last_unstale":"2024-09-12T18:04:19.519960+0000","last_undegraded":"2024-09-12T18:04:19.519960+0000","last_fullsized":"2024-09-12T18:04:19.519960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:27.777117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.524896+0000","last_change":"2024-09-12T17:46:45.538613+0000","last_active":"2024-09-12T18:04:49.524896+0000","last_peered":"2024-09-12T18:04:49.524896+0000","last_clean":"2024-09-12T18:04:49.524896+0000","last_became_active":"2024-09-12T17:46:45.538295+0000","last_became_peered":"2024-09-12T17:46:45.538295+0000","last_unstale":"2024-09-12T18:04:49.524896+0000","last_undegraded":"2024-09-12T18:04:49.524896+0000","last_fullsized":"2024-09-12T18:04:49.524896+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:12.638632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519162+0000","last_change":"2024-09-12T17:46:42.184099+0000","last_active":"2024-09-12T18:05:29.519162+0000","last_peered":"2024-09-12T18:05:29.519162+0000","last_clean":"2024-09-12T18:05:29.519162+0000","last_became_active":"2024-09-12T17:46:42.183792+0000","last_became_peered":"2024-09-12T17:46:42.183792+0000","last_unstale":"2024-09-12T18:05:29.519162+0000","last_undegraded":"2024-09-12T18:05:29.519162+0000","last_fullsized":"2024-09-12T18:05:29.519162+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:38.522171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'18","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527497+0000","last_change":"2024-09-12T17:45:03.893407+0000","last_active":"2024-09-12T18:05:04.527497+0000","last_peered":"2024-09-12T18:05:04.527497+0000","last_clean":"2024-09-12T18:05:04.527497+0000","last_became_active":"2024-09-12T17:45:03.893108+0000","last_became_peered":"2024-09-12T17:45:03.893108+0000","last_unstale":"2024-09-12T18:05:04.527497+0000","last_undegraded":"2024-09-12T18:05:04.527497+0000","last_fullsized":"2024-09-12T18:05:04.527497+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:43.333855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":71,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:04.527532+0000","last_change":"2024-09-12T17:57:00.463065+0000","last_active":"2024-09-12T18:05:04.527532+0000","last_peered":"2024-09-12T18:05:04.527532+0000","last_clean":"2024-09-12T18:05:04.527532+0000","last_became_active":"2024-09-12T17:57:00.462657+0000","last_became_peered":"2024-09-12T17:57:00.462657+0000","last_unstale":"2024-09-12T18:05:04.527532+0000","last_undegraded":"2024-09-12T18:05:04.527532+0000","last_fullsized":"2024-09-12T18:05:04.527532+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:24.423220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.699098+0000","last_change":"2024-09-12T17:46:45.210708+0000","last_active":"2024-09-12T18:08:03.699098+0000","last_peered":"2024-09-12T18:08:03.699098+0000","last_clean":"2024-09-12T18:08:03.699098+0000","last_became_active":"2024-09-12T17:46:45.210259+0000","last_became_peered":"2024-09-12T17:46:45.210259+0000","last_unstale":"2024-09-12T18:08:03.699098+0000","last_undegraded":"2024-09-12T18:08:03.699098+0000","last_fullsized":"2024-09-12T18:08:03.699098+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6189,"num_write":4,"num_write_kb":3117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.653028+0000","last_change":"2024-09-12T17:46:42.179361+0000","last_active":"2024-09-12T18:06:04.653028+0000","last_peered":"2024-09-12T18:06:04.653028+0000","last_clean":"2024-09-12T18:06:04.653028+0000","last_became_active":"2024-09-12T17:46:42.178782+0000","last_became_peered":"2024-09-12T17:46:42.178782+0000","last_unstale":"2024-09-12T18:06:04.653028+0000","last_undegraded":"2024-09-12T18:06:04.653028+0000","last_fullsized":"2024-09-12T18:06:04.653028+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'101","reported_seq":355,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.903517+0000","last_change":"2024-09-12T17:45:03.899922+0000","last_active":"2024-09-12T18:05:56.903517+0000","last_peered":"2024-09-12T18:05:56.903517+0000","last_clean":"2024-09-12T18:05:56.903517+0000","last_became_active":"2024-09-12T17:45:03.899635+0000","last_became_peered":"2024-09-12T17:45:03.899635+0000","last_unstale":"2024-09-12T18:05:56.903517+0000","last_undegraded":"2024-09-12T18:05:56.903517+0000","last_fullsized":"2024-09-12T18:05:56.903517+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:27.634887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":455,"num_write":132,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646813+0000","last_change":"2024-09-12T17:57:00.462866+0000","last_active":"2024-09-12T18:05:19.646813+0000","last_peered":"2024-09-12T18:05:19.646813+0000","last_clean":"2024-09-12T18:05:19.646813+0000","last_became_active":"2024-09-12T17:57:00.462532+0000","last_became_peered":"2024-09-12T17:57:00.462532+0000","last_unstale":"2024-09-12T18:05:19.646813+0000","last_undegraded":"2024-09-12T18:05:19.646813+0000","last_fullsized":"2024-09-12T18:05:19.646813+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:39.678951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.046364+0000","last_change":"2024-09-12T18:08:44.046364+0000","last_active":"2024-09-12T18:08:44.046364+0000","last_peered":"2024-09-12T18:08:44.046364+0000","last_clean":"2024-09-12T18:08:44.046364+0000","last_became_active":"2024-09-12T17:47:29.305275+0000","last_became_peered":"2024-09-12T17:47:29.305275+0000","last_unstale":"2024-09-12T18:08:44.046364+0000","last_undegraded":"2024-09-12T18:08:44.046364+0000","last_fullsized":"2024-09-12T18:08:44.046364+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:44.046274+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:44.046274+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.046274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:24.312296+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.660023+0000","last_change":"2024-09-12T17:46:42.183120+0000","last_active":"2024-09-12T18:08:03.660023+0000","last_peered":"2024-09-12T18:08:03.660023+0000","last_clean":"2024-09-12T18:08:03.660023+0000","last_became_active":"2024-09-12T17:46:42.182797+0000","last_became_peered":"2024-09-12T17:46:42.182797+0000","last_unstale":"2024-09-12T18:08:03.660023+0000","last_undegraded":"2024-09-12T18:08:03.660023+0000","last_fullsized":"2024-09-12T18:08:03.660023+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.035255+0000","last_change":"2024-09-12T18:08:39.035255+0000","last_active":"2024-09-12T18:08:39.035255+0000","last_peered":"2024-09-12T18:08:39.035255+0000","last_clean":"2024-09-12T18:08:39.035255+0000","last_became_active":"2024-09-12T17:45:03.899684+0000","last_became_peered":"2024-09-12T17:45:03.899684+0000","last_unstale":"2024-09-12T18:08:39.035255+0000","last_undegraded":"2024-09-12T18:08:39.035255+0000","last_fullsized":"2024-09-12T18:08:39.035255+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-12T18:08:39.035164+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-12T18:08:39.035164+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.035164+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:45.390604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.676639+0000","last_change":"2024-09-12T17:57:00.464844+0000","last_active":"2024-09-12T18:04:29.676639+0000","last_peered":"2024-09-12T18:04:29.676639+0000","last_clean":"2024-09-12T18:04:29.676639+0000","last_became_active":"2024-09-12T17:57:00.464581+0000","last_became_peered":"2024-09-12T17:57:00.464581+0000","last_unstale":"2024-09-12T18:04:29.676639+0000","last_undegraded":"2024-09-12T18:04:29.676639+0000","last_fullsized":"2024-09-12T18:04:29.676639+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:41.808967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508601+0000","last_change":"2024-09-12T17:46:45.208867+0000","last_active":"2024-09-12T18:04:14.508601+0000","last_peered":"2024-09-12T18:04:14.508601+0000","last_clean":"2024-09-12T18:04:14.508601+0000","last_became_active":"2024-09-12T17:46:45.208580+0000","last_became_peered":"2024-09-12T17:46:45.208580+0000","last_unstale":"2024-09-12T18:04:14.508601+0000","last_undegraded":"2024-09-12T18:04:14.508601+0000","last_fullsized":"2024-09-12T18:04:14.508601+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:28.654102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.508572+0000","last_change":"2024-09-12T17:46:42.182258+0000","last_active":"2024-09-12T18:04:14.508572+0000","last_peered":"2024-09-12T18:04:14.508572+0000","last_clean":"2024-09-12T18:04:14.508572+0000","last_became_active":"2024-09-12T17:46:42.181972+0000","last_became_peered":"2024-09-12T17:46:42.181972+0000","last_unstale":"2024-09-12T18:04:14.508572+0000","last_undegraded":"2024-09-12T18:04:14.508572+0000","last_fullsized":"2024-09-12T18:04:14.508572+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:16.906107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.637435+0000","last_change":"2024-09-12T17:45:03.900188+0000","last_active":"2024-09-12T18:04:24.637435+0000","last_peered":"2024-09-12T18:04:24.637435+0000","last_clean":"2024-09-12T18:04:24.637435+0000","last_became_active":"2024-09-12T17:45:03.899876+0000","last_became_peered":"2024-09-12T17:45:03.899876+0000","last_unstale":"2024-09-12T18:04:24.637435+0000","last_undegraded":"2024-09-12T18:04:24.637435+0000","last_fullsized":"2024-09-12T18:04:24.637435+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:14.650494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.676688+0000","last_change":"2024-09-12T17:57:00.467655+0000","last_active":"2024-09-12T18:04:29.676688+0000","last_peered":"2024-09-12T18:04:29.676688+0000","last_clean":"2024-09-12T18:04:29.676688+0000","last_became_active":"2024-09-12T17:57:00.467385+0000","last_became_peered":"2024-09-12T17:57:00.467385+0000","last_unstale":"2024-09-12T18:04:29.676688+0000","last_undegraded":"2024-09-12T18:04:29.676688+0000","last_fullsized":"2024-09-12T18:04:29.676688+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:10.181468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519179+0000","last_change":"2024-09-12T17:46:45.206159+0000","last_active":"2024-09-12T18:04:14.519179+0000","last_peered":"2024-09-12T18:04:14.519179+0000","last_clean":"2024-09-12T18:04:14.519179+0000","last_became_active":"2024-09-12T17:46:45.205742+0000","last_became_peered":"2024-09-12T17:46:45.205742+0000","last_unstale":"2024-09-12T18:04:14.519179+0000","last_undegraded":"2024-09-12T18:04:14.519179+0000","last_fullsized":"2024-09-12T18:04:14.519179+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:07.179448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:44.658205+0000","last_change":"2024-09-12T17:46:42.175938+0000","last_active":"2024-09-12T18:06:44.658205+0000","last_peered":"2024-09-12T18:06:44.658205+0000","last_clean":"2024-09-12T18:06:44.658205+0000","last_became_active":"2024-09-12T17:46:42.175501+0000","last_became_peered":"2024-09-12T17:46:42.175501+0000","last_unstale":"2024-09-12T18:06:44.658205+0000","last_undegraded":"2024-09-12T18:06:44.658205+0000","last_fullsized":"2024-09-12T18:06:44.658205+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:32.128694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.139970+0000","last_change":"2024-09-12T18:08:39.139970+0000","last_active":"2024-09-12T18:08:39.139970+0000","last_peered":"2024-09-12T18:08:39.139970+0000","last_clean":"2024-09-12T18:08:39.139970+0000","last_became_active":"2024-09-12T17:45:03.894942+0000","last_became_peered":"2024-09-12T17:45:03.894942+0000","last_unstale":"2024-09-12T18:08:39.139970+0000","last_undegraded":"2024-09-12T18:08:39.139970+0000","last_fullsized":"2024-09-12T18:08:39.139970+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-12T18:08:39.139867+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-12T18:08:39.139867+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.139867+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:45.603564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.654992+0000","last_change":"2024-09-12T17:57:00.463459+0000","last_active":"2024-09-12T18:06:19.654992+0000","last_peered":"2024-09-12T18:06:19.654992+0000","last_clean":"2024-09-12T18:06:19.654992+0000","last_became_active":"2024-09-12T17:57:00.463134+0000","last_became_peered":"2024-09-12T17:57:00.463134+0000","last_unstale":"2024-09-12T18:06:19.654992+0000","last_undegraded":"2024-09-12T18:06:19.654992+0000","last_fullsized":"2024-09-12T18:06:19.654992+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.539493+0000","last_change":"2024-09-12T17:46:45.536892+0000","last_active":"2024-09-12T18:06:04.539493+0000","last_peered":"2024-09-12T18:06:04.539493+0000","last_clean":"2024-09-12T18:06:04.539493+0000","last_became_active":"2024-09-12T17:46:45.536581+0000","last_became_peered":"2024-09-12T17:46:45.536581+0000","last_unstale":"2024-09-12T18:06:04.539493+0000","last_undegraded":"2024-09-12T18:06:04.539493+0000","last_fullsized":"2024-09-12T18:06:04.539493+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.643082+0000","last_change":"2024-09-12T17:46:42.180809+0000","last_active":"2024-09-12T18:05:29.643082+0000","last_peered":"2024-09-12T18:05:29.643082+0000","last_clean":"2024-09-12T18:05:29.643082+0000","last_became_active":"2024-09-12T17:46:42.179981+0000","last_became_peered":"2024-09-12T17:46:42.179981+0000","last_unstale":"2024-09-12T18:05:29.643082+0000","last_undegraded":"2024-09-12T18:05:29.643082+0000","last_fullsized":"2024-09-12T18:05:29.643082+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:19.357865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:30.810540+0000","last_change":"2024-09-12T17:45:03.892892+0000","last_active":"2024-09-12T18:05:30.810540+0000","last_peered":"2024-09-12T18:05:30.810540+0000","last_clean":"2024-09-12T18:05:30.810540+0000","last_became_active":"2024-09-12T17:45:03.892625+0000","last_became_peered":"2024-09-12T17:45:03.892625+0000","last_unstale":"2024-09-12T18:05:30.810540+0000","last_undegraded":"2024-09-12T18:05:30.810540+0000","last_fullsized":"2024-09-12T18:05:30.810540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:58.968922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.338542+0000","last_change":"2024-09-12T18:08:39.338475+0000","last_active":"2024-09-12T18:08:39.338542+0000","last_peered":"2024-09-12T18:08:39.338542+0000","last_clean":"2024-09-12T18:08:39.338542+0000","last_became_active":"2024-09-12T17:57:00.461347+0000","last_became_peered":"2024-09-12T17:57:00.461347+0000","last_unstale":"2024-09-12T18:08:39.338542+0000","last_undegraded":"2024-09-12T18:08:39.338542+0000","last_fullsized":"2024-09-12T18:08:39.338542+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:39.338385+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:39.338385+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.338385+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:37.625439+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.553715+0000","last_change":"2024-09-12T17:46:45.537765+0000","last_active":"2024-09-12T18:07:49.553715+0000","last_peered":"2024-09-12T18:07:49.553715+0000","last_clean":"2024-09-12T18:07:49.553715+0000","last_became_active":"2024-09-12T17:46:45.537463+0000","last_became_peered":"2024-09-12T17:46:45.537463+0000","last_unstale":"2024-09-12T18:07:49.553715+0000","last_undegraded":"2024-09-12T18:07:49.553715+0000","last_fullsized":"2024-09-12T18:07:49.553715+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:28.915955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.690982+0000","last_change":"2024-09-12T17:46:42.181302+0000","last_active":"2024-09-12T18:06:04.690982+0000","last_peered":"2024-09-12T18:06:04.690982+0000","last_clean":"2024-09-12T18:06:04.690982+0000","last_became_active":"2024-09-12T17:46:42.178809+0000","last_became_peered":"2024-09-12T17:46:42.178809+0000","last_unstale":"2024-09-12T18:06:04.690982+0000","last_undegraded":"2024-09-12T18:06:04.690982+0000","last_fullsized":"2024-09-12T18:06:04.690982+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'40","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.520902+0000","last_change":"2024-09-12T17:45:03.892705+0000","last_active":"2024-09-12T18:04:24.520902+0000","last_peered":"2024-09-12T18:04:24.520902+0000","last_clean":"2024-09-12T18:04:24.520902+0000","last_became_active":"2024-09-12T17:45:03.892417+0000","last_became_peered":"2024-09-12T17:45:03.892417+0000","last_unstale":"2024-09-12T18:04:24.520902+0000","last_undegraded":"2024-09-12T18:04:24.520902+0000","last_fullsized":"2024-09-12T18:04:24.520902+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:19.505017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":139,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.692899+0000","last_change":"2024-09-12T17:57:00.463497+0000","last_active":"2024-09-12T18:06:19.692899+0000","last_peered":"2024-09-12T18:06:19.692899+0000","last_clean":"2024-09-12T18:06:19.692899+0000","last_became_active":"2024-09-12T17:57:00.463245+0000","last_became_peered":"2024-09-12T17:57:00.463245+0000","last_unstale":"2024-09-12T18:06:19.692899+0000","last_undegraded":"2024-09-12T18:06:19.692899+0000","last_fullsized":"2024-09-12T18:06:19.692899+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.539545+0000","last_change":"2024-09-12T17:46:45.538651+0000","last_active":"2024-09-12T18:06:04.539545+0000","last_peered":"2024-09-12T18:06:04.539545+0000","last_clean":"2024-09-12T18:06:04.539545+0000","last_became_active":"2024-09-12T17:46:45.538337+0000","last_became_peered":"2024-09-12T17:46:45.538337+0000","last_unstale":"2024-09-12T18:06:04.539545+0000","last_undegraded":"2024-09-12T18:06:04.539545+0000","last_fullsized":"2024-09-12T18:06:04.539545+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'6","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.332509+0000","last_change":"2024-09-12T18:08:34.332509+0000","last_active":"2024-09-12T18:08:34.332509+0000","last_peered":"2024-09-12T18:08:34.332509+0000","last_clean":"2024-09-12T18:08:34.332509+0000","last_became_active":"2024-09-12T17:46:42.183098+0000","last_became_peered":"2024-09-12T17:46:42.183098+0000","last_unstale":"2024-09-12T18:08:34.332509+0000","last_undegraded":"2024-09-12T18:08:34.332509+0000","last_fullsized":"2024-09-12T18:08:34.332509+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:34.332403+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:34.332403+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.332403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:28.057652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'35","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.462161+0000","last_change":"2024-09-12T18:08:30.462161+0000","last_active":"2024-09-12T18:08:30.462161+0000","last_peered":"2024-09-12T18:08:30.462161+0000","last_clean":"2024-09-12T18:08:30.462161+0000","last_became_active":"2024-09-12T17:45:03.896299+0000","last_became_peered":"2024-09-12T17:45:03.896299+0000","last_unstale":"2024-09-12T18:08:30.462161+0000","last_undegraded":"2024-09-12T18:08:30.462161+0000","last_fullsized":"2024-09-12T18:08:30.462161+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-12T18:08:30.462075+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-12T18:08:30.462075+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.462075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:31.466676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":68,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.650577+0000","last_change":"2024-09-12T17:57:00.462016+0000","last_active":"2024-09-12T18:06:19.650577+0000","last_peered":"2024-09-12T18:06:19.650577+0000","last_clean":"2024-09-12T18:06:19.650577+0000","last_became_active":"2024-09-12T17:57:00.461706+0000","last_became_peered":"2024-09-12T17:57:00.461706+0000","last_unstale":"2024-09-12T18:06:19.650577+0000","last_undegraded":"2024-09-12T18:06:19.650577+0000","last_fullsized":"2024-09-12T18:06:19.650577+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.523824+0000","last_change":"2024-09-12T17:46:45.207863+0000","last_active":"2024-09-12T18:06:04.523824+0000","last_peered":"2024-09-12T18:06:04.523824+0000","last_clean":"2024-09-12T18:06:04.523824+0000","last_became_active":"2024-09-12T17:46:45.207610+0000","last_became_peered":"2024-09-12T17:46:45.207610+0000","last_unstale":"2024-09-12T18:06:04.523824+0000","last_undegraded":"2024-09-12T18:06:04.523824+0000","last_fullsized":"2024-09-12T18:06:04.523824+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.653207+0000","last_change":"2024-09-12T17:46:42.182800+0000","last_active":"2024-09-12T18:06:04.653207+0000","last_peered":"2024-09-12T18:06:04.653207+0000","last_clean":"2024-09-12T18:06:04.653207+0000","last_became_active":"2024-09-12T17:46:42.182412+0000","last_became_peered":"2024-09-12T17:46:42.182412+0000","last_unstale":"2024-09-12T18:06:04.653207+0000","last_undegraded":"2024-09-12T18:06:04.653207+0000","last_fullsized":"2024-09-12T18:06:04.653207+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'49","reported_seq":174,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:09.691620+0000","last_change":"2024-09-12T17:45:03.900251+0000","last_active":"2024-09-12T18:06:09.691620+0000","last_peered":"2024-09-12T18:06:09.691620+0000","last_clean":"2024-09-12T18:06:09.691620+0000","last_became_active":"2024-09-12T17:45:03.899885+0000","last_became_peered":"2024-09-12T17:45:03.899885+0000","last_unstale":"2024-09-12T18:06:09.691620+0000","last_undegraded":"2024-09-12T18:06:09.691620+0000","last_fullsized":"2024-09-12T18:06:09.691620+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":167,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519268+0000","last_change":"2024-09-12T17:57:00.468941+0000","last_active":"2024-09-12T18:04:14.519268+0000","last_peered":"2024-09-12T18:04:14.519268+0000","last_clean":"2024-09-12T18:04:14.519268+0000","last_became_active":"2024-09-12T17:57:00.468592+0000","last_became_peered":"2024-09-12T17:57:00.468592+0000","last_unstale":"2024-09-12T18:04:14.519268+0000","last_undegraded":"2024-09-12T18:04:14.519268+0000","last_fullsized":"2024-09-12T18:04:14.519268+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:05.976634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.647467+0000","last_change":"2024-09-12T17:46:45.210723+0000","last_active":"2024-09-12T18:05:24.647467+0000","last_peered":"2024-09-12T18:05:24.647467+0000","last_clean":"2024-09-12T18:05:24.647467+0000","last_became_active":"2024-09-12T17:46:45.210413+0000","last_became_peered":"2024-09-12T17:46:45.210413+0000","last_unstale":"2024-09-12T18:05:24.647467+0000","last_undegraded":"2024-09-12T18:05:24.647467+0000","last_fullsized":"2024-09-12T18:05:24.647467+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:35.068995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.720243+0000","last_change":"2024-09-12T18:08:43.720243+0000","last_active":"2024-09-12T18:08:43.720243+0000","last_peered":"2024-09-12T18:08:43.720243+0000","last_clean":"2024-09-12T18:08:43.720243+0000","last_became_active":"2024-09-12T17:46:42.176505+0000","last_became_peered":"2024-09-12T17:46:42.176505+0000","last_unstale":"2024-09-12T18:08:43.720243+0000","last_undegraded":"2024-09-12T18:08:43.720243+0000","last_fullsized":"2024-09-12T18:08:43.720243+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.720145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.720145+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.720145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:25.547287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'4","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.690928+0000","last_change":"2024-09-12T17:45:03.900017+0000","last_active":"2024-09-12T18:06:04.690928+0000","last_peered":"2024-09-12T18:06:04.690928+0000","last_clean":"2024-09-12T18:06:04.690928+0000","last_became_active":"2024-09-12T17:45:03.899726+0000","last_became_peered":"2024-09-12T17:45:03.899726+0000","last_unstale":"2024-09-12T18:06:04.690928+0000","last_undegraded":"2024-09-12T18:06:04.690928+0000","last_fullsized":"2024-09-12T18:06:04.690928+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.636058+0000","last_change":"2024-09-12T17:57:00.464086+0000","last_active":"2024-09-12T18:04:14.636058+0000","last_peered":"2024-09-12T18:04:14.636058+0000","last_clean":"2024-09-12T18:04:14.636058+0000","last_became_active":"2024-09-12T17:57:00.463766+0000","last_became_peered":"2024-09-12T17:57:00.463766+0000","last_unstale":"2024-09-12T18:04:14.636058+0000","last_undegraded":"2024-09-12T18:04:14.636058+0000","last_fullsized":"2024-09-12T18:04:14.636058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:28.897896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'8","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.659185+0000","last_change":"2024-09-12T17:46:45.201582+0000","last_active":"2024-09-12T18:08:03.659185+0000","last_peered":"2024-09-12T18:08:03.659185+0000","last_clean":"2024-09-12T18:08:03.659185+0000","last_became_active":"2024-09-12T17:46:45.201278+0000","last_became_peered":"2024-09-12T17:46:45.201278+0000","last_unstale":"2024-09-12T18:08:03.659185+0000","last_undegraded":"2024-09-12T18:08:03.659185+0000","last_fullsized":"2024-09-12T18:08:03.659185+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:48.055531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'8","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.682624+0000","last_change":"2024-09-12T17:46:42.182936+0000","last_active":"2024-09-12T18:08:03.682624+0000","last_peered":"2024-09-12T18:08:03.682624+0000","last_clean":"2024-09-12T18:08:03.682624+0000","last_became_active":"2024-09-12T17:46:42.182658+0000","last_became_peered":"2024-09-12T17:46:42.182658+0000","last_unstale":"2024-09-12T18:08:03.682624+0000","last_undegraded":"2024-09-12T18:08:03.682624+0000","last_fullsized":"2024-09-12T18:08:03.682624+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:02.557846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":45,"num_write":18,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.653089+0000","last_change":"2024-09-12T17:45:03.891474+0000","last_active":"2024-09-12T18:06:04.653089+0000","last_peered":"2024-09-12T18:06:04.653089+0000","last_clean":"2024-09-12T18:06:04.653089+0000","last_became_active":"2024-09-12T17:45:03.891186+0000","last_became_peered":"2024-09-12T17:45:03.891186+0000","last_unstale":"2024-09-12T18:06:04.653089+0000","last_undegraded":"2024-09-12T18:06:04.653089+0000","last_fullsized":"2024-09-12T18:06:04.653089+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":128,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.654829+0000","last_change":"2024-09-12T17:57:00.465754+0000","last_active":"2024-09-12T18:06:19.654829+0000","last_peered":"2024-09-12T18:06:19.654829+0000","last_clean":"2024-09-12T18:06:19.654829+0000","last_became_active":"2024-09-12T17:57:00.464910+0000","last_became_peered":"2024-09-12T17:57:00.464910+0000","last_unstale":"2024-09-12T18:06:19.654829+0000","last_undegraded":"2024-09-12T18:06:19.654829+0000","last_fullsized":"2024-09-12T18:06:19.654829+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534265+0000","last_change":"2024-09-12T17:46:45.206745+0000","last_active":"2024-09-12T18:05:24.534265+0000","last_peered":"2024-09-12T18:05:24.534265+0000","last_clean":"2024-09-12T18:05:24.534265+0000","last_became_active":"2024-09-12T17:46:45.206402+0000","last_became_peered":"2024-09-12T17:46:45.206402+0000","last_unstale":"2024-09-12T18:05:24.534265+0000","last_undegraded":"2024-09-12T18:05:24.534265+0000","last_fullsized":"2024-09-12T18:05:24.534265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:55.547505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.062277+0000","last_change":"2024-09-12T18:08:41.062277+0000","last_active":"2024-09-12T18:08:41.062277+0000","last_peered":"2024-09-12T18:08:41.062277+0000","last_clean":"2024-09-12T18:08:41.062277+0000","last_became_active":"2024-09-12T17:46:42.184760+0000","last_became_peered":"2024-09-12T17:46:42.184760+0000","last_unstale":"2024-09-12T18:08:41.062277+0000","last_undegraded":"2024-09-12T18:08:41.062277+0000","last_fullsized":"2024-09-12T18:08:41.062277+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:41.062169+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:41.062169+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.062169+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:26.401540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'36","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.744438+0000","last_change":"2024-09-12T18:08:42.744438+0000","last_active":"2024-09-12T18:08:42.744438+0000","last_peered":"2024-09-12T18:08:42.744438+0000","last_clean":"2024-09-12T18:08:42.744438+0000","last_became_active":"2024-09-12T17:45:03.897616+0000","last_became_peered":"2024-09-12T17:45:03.897616+0000","last_unstale":"2024-09-12T18:08:42.744438+0000","last_undegraded":"2024-09-12T18:08:42.744438+0000","last_fullsized":"2024-09-12T18:08:42.744438+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-12T18:08:42.744348+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-12T18:08:42.744348+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.744348+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:13.467186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":138,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:14.519243+0000","last_change":"2024-09-12T17:57:00.464276+0000","last_active":"2024-09-12T18:04:14.519243+0000","last_peered":"2024-09-12T18:04:14.519243+0000","last_clean":"2024-09-12T18:04:14.519243+0000","last_became_active":"2024-09-12T17:57:00.463881+0000","last_became_peered":"2024-09-12T17:57:00.463881+0000","last_unstale":"2024-09-12T18:04:14.519243+0000","last_undegraded":"2024-09-12T18:04:14.519243+0000","last_fullsized":"2024-09-12T18:04:14.519243+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:03.028160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.054811+0000","last_change":"2024-09-12T18:08:43.054811+0000","last_active":"2024-09-12T18:08:43.054811+0000","last_peered":"2024-09-12T18:08:43.054811+0000","last_clean":"2024-09-12T18:08:43.054811+0000","last_became_active":"2024-09-12T17:46:45.205987+0000","last_became_peered":"2024-09-12T17:46:45.205987+0000","last_unstale":"2024-09-12T18:08:43.054811+0000","last_undegraded":"2024-09-12T18:08:43.054811+0000","last_fullsized":"2024-09-12T18:08:43.054811+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.054721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.054721+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.054721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:35.540307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.642468+0000","last_change":"2024-09-12T17:46:42.180412+0000","last_active":"2024-09-12T18:05:24.642468+0000","last_peered":"2024-09-12T18:05:24.642468+0000","last_clean":"2024-09-12T18:05:24.642468+0000","last_became_active":"2024-09-12T17:46:42.178941+0000","last_became_peered":"2024-09-12T17:46:42.178941+0000","last_unstale":"2024-09-12T18:05:24.642468+0000","last_undegraded":"2024-09-12T18:05:24.642468+0000","last_fullsized":"2024-09-12T18:05:24.642468+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:53.889661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'33","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.539297+0000","last_change":"2024-09-12T17:45:03.893625+0000","last_active":"2024-09-12T18:06:04.539297+0000","last_peered":"2024-09-12T18:06:04.539297+0000","last_clean":"2024-09-12T18:06:04.539297+0000","last_became_active":"2024-09-12T17:45:03.893332+0000","last_became_peered":"2024-09-12T17:45:03.893332+0000","last_unstale":"2024-09-12T18:06:04.539297+0000","last_undegraded":"2024-09-12T18:06:04.539297+0000","last_fullsized":"2024-09-12T18:06:04.539297+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.367651+0000","last_change":"2024-09-12T18:08:38.367651+0000","last_active":"2024-09-12T18:08:38.367651+0000","last_peered":"2024-09-12T18:08:38.367651+0000","last_clean":"2024-09-12T18:08:38.367651+0000","last_became_active":"2024-09-12T17:57:00.461130+0000","last_became_peered":"2024-09-12T17:57:00.461130+0000","last_unstale":"2024-09-12T18:08:38.367651+0000","last_undegraded":"2024-09-12T18:08:38.367651+0000","last_fullsized":"2024-09-12T18:08:38.367651+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:38.367554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:38.367554+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.367554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:37.306375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.673146+0000","last_change":"2024-09-12T17:46:45.208179+0000","last_active":"2024-09-12T18:08:03.673146+0000","last_peered":"2024-09-12T18:08:03.673146+0000","last_clean":"2024-09-12T18:08:03.673146+0000","last_became_active":"2024-09-12T17:46:45.207899+0000","last_became_peered":"2024-09-12T17:46:45.207899+0000","last_unstale":"2024-09-12T18:08:03.673146+0000","last_undegraded":"2024-09-12T18:08:03.673146+0000","last_fullsized":"2024-09-12T18:08:03.673146+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:40.530867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":571,"num_write":10,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.679250+0000","last_change":"2024-09-12T17:46:42.178168+0000","last_active":"2024-09-12T18:04:44.679250+0000","last_peered":"2024-09-12T18:04:44.679250+0000","last_clean":"2024-09-12T18:04:44.679250+0000","last_became_active":"2024-09-12T17:46:42.177867+0000","last_became_peered":"2024-09-12T17:46:42.177867+0000","last_unstale":"2024-09-12T18:04:44.679250+0000","last_undegraded":"2024-09-12T18:04:44.679250+0000","last_fullsized":"2024-09-12T18:04:44.679250+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:40.404324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'22","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.534323+0000","last_change":"2024-09-12T17:45:03.895504+0000","last_active":"2024-09-12T18:05:24.534323+0000","last_peered":"2024-09-12T18:05:24.534323+0000","last_clean":"2024-09-12T18:05:24.534323+0000","last_became_active":"2024-09-12T17:45:03.895229+0000","last_became_peered":"2024-09-12T17:45:03.895229+0000","last_unstale":"2024-09-12T18:05:24.534323+0000","last_undegraded":"2024-09-12T18:05:24.534323+0000","last_fullsized":"2024-09-12T18:05:24.534323+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:49.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.690124+0000","last_change":"2024-09-12T17:57:00.466936+0000","last_active":"2024-09-12T18:05:59.690124+0000","last_peered":"2024-09-12T18:05:59.690124+0000","last_clean":"2024-09-12T18:05:59.690124+0000","last_became_active":"2024-09-12T17:57:00.466328+0000","last_became_peered":"2024-09-12T17:57:00.466328+0000","last_unstale":"2024-09-12T18:05:59.690124+0000","last_undegraded":"2024-09-12T18:05:59.690124+0000","last_fullsized":"2024-09-12T18:05:59.690124+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.547239+0000","last_change":"2024-09-12T17:46:45.204918+0000","last_active":"2024-09-12T18:06:59.547239+0000","last_peered":"2024-09-12T18:06:59.547239+0000","last_clean":"2024-09-12T18:06:59.547239+0000","last_became_active":"2024-09-12T17:46:45.204628+0000","last_became_peered":"2024-09-12T17:46:45.204628+0000","last_unstale":"2024-09-12T18:06:59.547239+0000","last_undegraded":"2024-09-12T18:06:59.547239+0000","last_fullsized":"2024-09-12T18:06:59.547239+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:44.729741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'3","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.353971+0000","last_change":"2024-09-12T18:08:33.353971+0000","last_active":"2024-09-12T18:08:33.353971+0000","last_peered":"2024-09-12T18:08:33.353971+0000","last_clean":"2024-09-12T18:08:33.353971+0000","last_became_active":"2024-09-12T17:46:42.183710+0000","last_became_peered":"2024-09-12T17:46:42.183710+0000","last_unstale":"2024-09-12T18:08:33.353971+0000","last_undegraded":"2024-09-12T18:08:33.353971+0000","last_fullsized":"2024-09-12T18:08:33.353971+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:33.353886+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:33.353886+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.353886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:44.594486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'20","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.641966+0000","last_change":"2024-09-12T17:45:03.897931+0000","last_active":"2024-09-12T18:05:19.641966+0000","last_peered":"2024-09-12T18:05:19.641966+0000","last_clean":"2024-09-12T18:05:19.641966+0000","last_became_active":"2024-09-12T17:45:03.897609+0000","last_became_peered":"2024-09-12T17:45:03.897609+0000","last_unstale":"2024-09-12T18:05:19.641966+0000","last_undegraded":"2024-09-12T18:05:19.641966+0000","last_fullsized":"2024-09-12T18:05:19.641966+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:57.004403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.520491+0000","last_change":"2024-09-12T17:57:00.459052+0000","last_active":"2024-09-12T18:05:39.520491+0000","last_peered":"2024-09-12T18:05:39.520491+0000","last_clean":"2024-09-12T18:05:39.520491+0000","last_became_active":"2024-09-12T17:57:00.458777+0000","last_became_peered":"2024-09-12T17:57:00.458777+0000","last_unstale":"2024-09-12T18:05:39.520491+0000","last_undegraded":"2024-09-12T18:05:39.520491+0000","last_fullsized":"2024-09-12T18:05:39.520491+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:12.952038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.660334+0000","last_change":"2024-09-12T17:46:45.537482+0000","last_active":"2024-09-12T18:06:59.660334+0000","last_peered":"2024-09-12T18:06:59.660334+0000","last_clean":"2024-09-12T18:06:59.660334+0000","last_became_active":"2024-09-12T17:46:45.536980+0000","last_became_peered":"2024-09-12T17:46:45.536980+0000","last_unstale":"2024-09-12T18:06:59.660334+0000","last_undegraded":"2024-09-12T18:06:59.660334+0000","last_fullsized":"2024-09-12T18:06:59.660334+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:14.427774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.640687+0000","last_change":"2024-09-12T17:46:42.180818+0000","last_active":"2024-09-12T18:04:44.640687+0000","last_peered":"2024-09-12T18:04:44.640687+0000","last_clean":"2024-09-12T18:04:44.640687+0000","last_became_active":"2024-09-12T17:46:42.180565+0000","last_became_peered":"2024-09-12T17:46:42.180565+0000","last_unstale":"2024-09-12T18:04:44.640687+0000","last_undegraded":"2024-09-12T18:04:44.640687+0000","last_fullsized":"2024-09-12T18:04:44.640687+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:16.219991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'33","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.050500+0000","last_change":"2024-09-12T18:08:37.050500+0000","last_active":"2024-09-12T18:08:37.050500+0000","last_peered":"2024-09-12T18:08:37.050500+0000","last_clean":"2024-09-12T18:08:37.050500+0000","last_became_active":"2024-09-12T17:45:03.892226+0000","last_became_peered":"2024-09-12T17:45:03.892226+0000","last_unstale":"2024-09-12T18:08:37.050500+0000","last_undegraded":"2024-09-12T18:08:37.050500+0000","last_fullsized":"2024-09-12T18:08:37.050500+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T18:08:37.050393+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T18:08:37.050393+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.050393+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:27.394946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":124,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.687364+0000","last_change":"2024-09-12T17:57:00.464984+0000","last_active":"2024-09-12T18:05:39.687364+0000","last_peered":"2024-09-12T18:05:39.687364+0000","last_clean":"2024-09-12T18:05:39.687364+0000","last_became_active":"2024-09-12T17:57:00.464707+0000","last_became_peered":"2024-09-12T17:57:00.464707+0000","last_unstale":"2024-09-12T18:05:39.687364+0000","last_undegraded":"2024-09-12T18:05:39.687364+0000","last_fullsized":"2024-09-12T18:05:39.687364+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:25.768696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.547308+0000","last_change":"2024-09-12T17:46:45.205067+0000","last_active":"2024-09-12T18:06:59.547308+0000","last_peered":"2024-09-12T18:06:59.547308+0000","last_clean":"2024-09-12T18:06:59.547308+0000","last_became_active":"2024-09-12T17:46:45.204759+0000","last_became_peered":"2024-09-12T17:46:45.204759+0000","last_unstale":"2024-09-12T18:06:59.547308+0000","last_undegraded":"2024-09-12T18:06:59.547308+0000","last_fullsized":"2024-09-12T18:06:59.547308+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:47.314625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.177200+0000","last_change":"2024-09-12T18:08:44.177200+0000","last_active":"2024-09-12T18:08:44.177200+0000","last_peered":"2024-09-12T18:08:44.177200+0000","last_clean":"2024-09-12T18:08:44.177200+0000","last_became_active":"2024-09-12T17:46:42.182805+0000","last_became_peered":"2024-09-12T17:46:42.182805+0000","last_unstale":"2024-09-12T18:08:44.177200+0000","last_undegraded":"2024-09-12T18:08:44.177200+0000","last_fullsized":"2024-09-12T18:08:44.177200+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:44.177115+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:44.177115+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.177115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:06.093127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'42","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.428464+0000","last_change":"2024-09-12T18:08:29.428464+0000","last_active":"2024-09-12T18:08:29.428464+0000","last_peered":"2024-09-12T18:08:29.428464+0000","last_clean":"2024-09-12T18:08:29.428464+0000","last_became_active":"2024-09-12T17:45:03.897752+0000","last_became_peered":"2024-09-12T17:45:03.897752+0000","last_unstale":"2024-09-12T18:08:29.428464+0000","last_undegraded":"2024-09-12T18:08:29.428464+0000","last_fullsized":"2024-09-12T18:08:29.428464+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-12T18:08:29.428355+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-12T18:08:29.428355+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.428355+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:12.865787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":75,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.538731+0000","last_change":"2024-09-12T17:57:00.469400+0000","last_active":"2024-09-12T18:05:59.538731+0000","last_peered":"2024-09-12T18:05:59.538731+0000","last_clean":"2024-09-12T18:05:59.538731+0000","last_became_active":"2024-09-12T17:57:00.469072+0000","last_became_peered":"2024-09-12T17:57:00.469072+0000","last_unstale":"2024-09-12T18:05:59.538731+0000","last_undegraded":"2024-09-12T18:05:59.538731+0000","last_fullsized":"2024-09-12T18:05:59.538731+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.525003+0000","last_change":"2024-09-12T17:46:45.203169+0000","last_active":"2024-09-12T18:06:14.525003+0000","last_peered":"2024-09-12T18:06:14.525003+0000","last_clean":"2024-09-12T18:06:14.525003+0000","last_became_active":"2024-09-12T17:46:45.202892+0000","last_became_peered":"2024-09-12T17:46:45.202892+0000","last_unstale":"2024-09-12T18:06:14.525003+0000","last_undegraded":"2024-09-12T18:06:14.525003+0000","last_fullsized":"2024-09-12T18:06:14.525003+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.654205+0000","last_change":"2024-09-12T17:46:42.179076+0000","last_active":"2024-09-12T18:06:14.654205+0000","last_peered":"2024-09-12T18:06:14.654205+0000","last_clean":"2024-09-12T18:06:14.654205+0000","last_became_active":"2024-09-12T17:46:42.178411+0000","last_became_peered":"2024-09-12T17:46:42.178411+0000","last_unstale":"2024-09-12T18:06:14.654205+0000","last_undegraded":"2024-09-12T18:06:14.654205+0000","last_fullsized":"2024-09-12T18:06:14.654205+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'24","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646723+0000","last_change":"2024-09-12T17:45:03.891655+0000","last_active":"2024-09-12T18:05:19.646723+0000","last_peered":"2024-09-12T18:05:19.646723+0000","last_clean":"2024-09-12T18:05:19.646723+0000","last_became_active":"2024-09-12T17:45:03.891369+0000","last_became_peered":"2024-09-12T17:45:03.891369+0000","last_unstale":"2024-09-12T18:05:19.646723+0000","last_undegraded":"2024-09-12T18:05:19.646723+0000","last_fullsized":"2024-09-12T18:05:19.646723+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:45.970204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:04.691011+0000","last_change":"2024-09-12T17:57:00.465652+0000","last_active":"2024-09-12T18:06:04.691011+0000","last_peered":"2024-09-12T18:06:04.691011+0000","last_clean":"2024-09-12T18:06:04.691011+0000","last_became_active":"2024-09-12T17:57:00.465360+0000","last_became_peered":"2024-09-12T17:57:00.465360+0000","last_unstale":"2024-09-12T18:06:04.691011+0000","last_undegraded":"2024-09-12T18:06:04.691011+0000","last_fullsized":"2024-09-12T18:06:04.691011+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.692313+0000","last_change":"2024-09-12T17:46:45.536369+0000","last_active":"2024-09-12T18:06:14.692313+0000","last_peered":"2024-09-12T18:06:14.692313+0000","last_clean":"2024-09-12T18:06:14.692313+0000","last_became_active":"2024-09-12T17:46:45.536056+0000","last_became_peered":"2024-09-12T17:46:45.536056+0000","last_unstale":"2024-09-12T18:06:14.692313+0000","last_undegraded":"2024-09-12T18:06:14.692313+0000","last_fullsized":"2024-09-12T18:06:14.692313+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.080353+0000","last_change":"2024-09-12T18:08:41.080353+0000","last_active":"2024-09-12T18:08:41.080353+0000","last_peered":"2024-09-12T18:08:41.080353+0000","last_clean":"2024-09-12T18:08:41.080353+0000","last_became_active":"2024-09-12T17:46:42.182831+0000","last_became_peered":"2024-09-12T17:46:42.182831+0000","last_unstale":"2024-09-12T18:08:41.080353+0000","last_undegraded":"2024-09-12T18:08:41.080353+0000","last_fullsized":"2024-09-12T18:08:41.080353+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:41.080224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:41.080224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.080224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:51.193117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'86","reported_seq":281,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:20.623576+0000","last_change":"2024-09-12T17:45:03.893737+0000","last_active":"2024-09-12T18:05:20.623576+0000","last_peered":"2024-09-12T18:05:20.623576+0000","last_clean":"2024-09-12T18:05:20.623576+0000","last_became_active":"2024-09-12T17:45:03.893452+0000","last_became_peered":"2024-09-12T17:45:03.893452+0000","last_unstale":"2024-09-12T18:05:20.623576+0000","last_undegraded":"2024-09-12T18:05:20.623576+0000","last_fullsized":"2024-09-12T18:05:20.623576+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:29.372853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":321,"num_write":137,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.690159+0000","last_change":"2024-09-12T17:57:00.464389+0000","last_active":"2024-09-12T18:05:59.690159+0000","last_peered":"2024-09-12T18:05:59.690159+0000","last_clean":"2024-09-12T18:05:59.690159+0000","last_became_active":"2024-09-12T17:57:00.464068+0000","last_became_peered":"2024-09-12T17:57:00.464068+0000","last_unstale":"2024-09-12T18:05:59.690159+0000","last_undegraded":"2024-09-12T18:05:59.690159+0000","last_fullsized":"2024-09-12T18:05:59.690159+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'6","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.659774+0000","last_change":"2024-09-12T17:46:45.206955+0000","last_active":"2024-09-12T18:08:03.659774+0000","last_peered":"2024-09-12T18:08:03.659774+0000","last_clean":"2024-09-12T18:08:03.659774+0000","last_became_active":"2024-09-12T17:46:45.206644+0000","last_became_peered":"2024-09-12T17:46:45.206644+0000","last_unstale":"2024-09-12T18:08:03.659774+0000","last_undegraded":"2024-09-12T18:08:03.659774+0000","last_fullsized":"2024-09-12T18:08:03.659774+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:01.211515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.654243+0000","last_change":"2024-09-12T17:46:42.184536+0000","last_active":"2024-09-12T18:06:14.654243+0000","last_peered":"2024-09-12T18:06:14.654243+0000","last_clean":"2024-09-12T18:06:14.654243+0000","last_became_active":"2024-09-12T17:46:42.184232+0000","last_became_peered":"2024-09-12T17:46:42.184232+0000","last_unstale":"2024-09-12T18:06:14.654243+0000","last_undegraded":"2024-09-12T18:06:14.654243+0000","last_fullsized":"2024-09-12T18:06:14.654243+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.522427+0000","last_change":"2024-09-12T17:45:03.897167+0000","last_active":"2024-09-12T18:04:34.522427+0000","last_peered":"2024-09-12T18:04:34.522427+0000","last_clean":"2024-09-12T18:04:34.522427+0000","last_became_active":"2024-09-12T17:45:03.896663+0000","last_became_peered":"2024-09-12T17:45:03.896663+0000","last_unstale":"2024-09-12T18:04:34.522427+0000","last_undegraded":"2024-09-12T18:04:34.522427+0000","last_fullsized":"2024-09-12T18:04:34.522427+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:00.166379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.652498+0000","last_change":"2024-09-12T17:57:00.465893+0000","last_active":"2024-09-12T18:05:59.652498+0000","last_peered":"2024-09-12T18:05:59.652498+0000","last_clean":"2024-09-12T18:05:59.652498+0000","last_became_active":"2024-09-12T17:57:00.465596+0000","last_became_peered":"2024-09-12T17:57:00.465596+0000","last_unstale":"2024-09-12T18:05:59.652498+0000","last_undegraded":"2024-09-12T18:05:59.652498+0000","last_fullsized":"2024-09-12T18:05:59.652498+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.692956+0000","last_change":"2024-09-12T17:46:45.208374+0000","last_active":"2024-09-12T18:06:19.692956+0000","last_peered":"2024-09-12T18:06:19.692956+0000","last_clean":"2024-09-12T18:06:19.692956+0000","last_became_active":"2024-09-12T17:46:45.208019+0000","last_became_peered":"2024-09-12T17:46:45.208019+0000","last_unstale":"2024-09-12T18:06:19.692956+0000","last_undegraded":"2024-09-12T18:06:19.692956+0000","last_fullsized":"2024-09-12T18:06:19.692956+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.512748+0000","last_change":"2024-09-12T17:46:42.184553+0000","last_active":"2024-09-12T18:04:44.512748+0000","last_peered":"2024-09-12T18:04:44.512748+0000","last_clean":"2024-09-12T18:04:44.512748+0000","last_became_active":"2024-09-12T17:46:42.184250+0000","last_became_peered":"2024-09-12T17:46:42.184250+0000","last_unstale":"2024-09-12T18:04:44.512748+0000","last_undegraded":"2024-09-12T18:04:44.512748+0000","last_fullsized":"2024-09-12T18:04:44.512748+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:49.433698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'40","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.074825+0000","last_change":"2024-09-12T18:08:36.074825+0000","last_active":"2024-09-12T18:08:36.074825+0000","last_peered":"2024-09-12T18:08:36.074825+0000","last_clean":"2024-09-12T18:08:36.074825+0000","last_became_active":"2024-09-12T17:45:03.897291+0000","last_became_peered":"2024-09-12T17:45:03.897291+0000","last_unstale":"2024-09-12T18:08:36.074825+0000","last_undegraded":"2024-09-12T18:08:36.074825+0000","last_fullsized":"2024-09-12T18:08:36.074825+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-12T18:08:36.074737+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-12T18:08:36.074737+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.074737+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:38.882995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.684325+0000","last_change":"2024-09-12T17:57:00.465725+0000","last_active":"2024-09-12T18:05:19.684325+0000","last_peered":"2024-09-12T18:05:19.684325+0000","last_clean":"2024-09-12T18:05:19.684325+0000","last_became_active":"2024-09-12T17:57:00.465454+0000","last_became_peered":"2024-09-12T17:57:00.465454+0000","last_unstale":"2024-09-12T18:05:19.684325+0000","last_undegraded":"2024-09-12T18:05:19.684325+0000","last_fullsized":"2024-09-12T18:05:19.684325+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.552904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648118+0000","last_change":"2024-09-12T17:46:45.207902+0000","last_active":"2024-09-12T18:05:29.648118+0000","last_peered":"2024-09-12T18:05:29.648118+0000","last_clean":"2024-09-12T18:05:29.648118+0000","last_became_active":"2024-09-12T17:46:45.207607+0000","last_became_peered":"2024-09-12T17:46:45.207607+0000","last_unstale":"2024-09-12T18:05:29.648118+0000","last_undegraded":"2024-09-12T18:05:29.648118+0000","last_fullsized":"2024-09-12T18:05:29.648118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:31.661695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.685860+0000","last_change":"2024-09-12T17:46:42.182625+0000","last_active":"2024-09-12T18:05:29.685860+0000","last_peered":"2024-09-12T18:05:29.685860+0000","last_clean":"2024-09-12T18:05:29.685860+0000","last_became_active":"2024-09-12T17:46:42.182267+0000","last_became_peered":"2024-09-12T17:46:42.182267+0000","last_unstale":"2024-09-12T18:05:29.685860+0000","last_undegraded":"2024-09-12T18:05:29.685860+0000","last_fullsized":"2024-09-12T18:05:29.685860+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:39.753698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'54","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.639121+0000","last_change":"2024-09-12T17:45:03.892593+0000","last_active":"2024-09-12T18:04:34.639121+0000","last_peered":"2024-09-12T18:04:34.639121+0000","last_clean":"2024-09-12T18:04:34.639121+0000","last_became_active":"2024-09-12T17:45:03.891861+0000","last_became_peered":"2024-09-12T17:45:03.891861+0000","last_unstale":"2024-09-12T18:04:34.639121+0000","last_undegraded":"2024-09-12T18:04:34.639121+0000","last_fullsized":"2024-09-12T18:04:34.639121+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:11.906724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":286,"num_read_kb":219,"num_write":84,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.641923+0000","last_change":"2024-09-12T17:57:00.467076+0000","last_active":"2024-09-12T18:05:19.641923+0000","last_peered":"2024-09-12T18:05:19.641923+0000","last_clean":"2024-09-12T18:05:19.641923+0000","last_became_active":"2024-09-12T17:57:00.466761+0000","last_became_peered":"2024-09-12T17:57:00.466761+0000","last_unstale":"2024-09-12T18:05:19.641923+0000","last_undegraded":"2024-09-12T18:05:19.641923+0000","last_fullsized":"2024-09-12T18:05:19.641923+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:37.302553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.648100+0000","last_change":"2024-09-12T17:46:45.537244+0000","last_active":"2024-09-12T18:05:29.648100+0000","last_peered":"2024-09-12T18:05:29.648100+0000","last_clean":"2024-09-12T18:05:29.648100+0000","last_became_active":"2024-09-12T17:46:45.536927+0000","last_became_peered":"2024-09-12T17:46:45.536927+0000","last_unstale":"2024-09-12T18:05:29.648100+0000","last_undegraded":"2024-09-12T18:05:29.648100+0000","last_fullsized":"2024-09-12T18:05:29.648100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:06.976539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'5","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.385091+0000","last_change":"2024-09-12T18:08:32.385091+0000","last_active":"2024-09-12T18:08:32.385091+0000","last_peered":"2024-09-12T18:08:32.385091+0000","last_clean":"2024-09-12T18:08:32.385091+0000","last_became_active":"2024-09-12T17:46:42.182346+0000","last_became_peered":"2024-09-12T17:46:42.182346+0000","last_unstale":"2024-09-12T18:08:32.385091+0000","last_undegraded":"2024-09-12T18:08:32.385091+0000","last_fullsized":"2024-09-12T18:08:32.385091+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:08:32.384982+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:08:32.384982+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.384982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:00.783251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'22","reported_seq":113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.027396+0000","last_change":"2024-09-12T18:08:35.027396+0000","last_active":"2024-09-12T18:08:35.027396+0000","last_peered":"2024-09-12T18:08:35.027396+0000","last_clean":"2024-09-12T18:08:35.027396+0000","last_became_active":"2024-09-12T17:45:03.895580+0000","last_became_peered":"2024-09-12T17:45:03.895580+0000","last_unstale":"2024-09-12T18:08:35.027396+0000","last_undegraded":"2024-09-12T18:08:35.027396+0000","last_fullsized":"2024-09-12T18:08:35.027396+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-12T18:08:35.027312+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-12T18:08:35.027312+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.027312+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:45.152556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:59.643446+0000","last_change":"2024-09-12T17:57:00.463170+0000","last_active":"2024-09-12T18:04:59.643446+0000","last_peered":"2024-09-12T18:04:59.643446+0000","last_clean":"2024-09-12T18:04:59.643446+0000","last_became_active":"2024-09-12T17:57:00.462863+0000","last_became_peered":"2024-09-12T17:57:00.462863+0000","last_unstale":"2024-09-12T18:04:59.643446+0000","last_undegraded":"2024-09-12T18:04:59.643446+0000","last_fullsized":"2024-09-12T18:04:59.643446+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:40.563317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.692438+0000","last_change":"2024-09-12T17:46:45.537210+0000","last_active":"2024-09-12T18:06:14.692438+0000","last_peered":"2024-09-12T18:06:14.692438+0000","last_clean":"2024-09-12T18:06:14.692438+0000","last_became_active":"2024-09-12T17:46:45.536831+0000","last_became_peered":"2024-09-12T17:46:45.536831+0000","last_unstale":"2024-09-12T18:06:14.692438+0000","last_undegraded":"2024-09-12T18:06:14.692438+0000","last_fullsized":"2024-09-12T18:06:14.692438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'7","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.652728+0000","last_change":"2024-09-12T17:46:42.185520+0000","last_active":"2024-09-12T18:08:03.652728+0000","last_peered":"2024-09-12T18:08:03.652728+0000","last_clean":"2024-09-12T18:08:03.652728+0000","last_became_active":"2024-09-12T17:46:42.185216+0000","last_became_peered":"2024-09-12T17:46:42.185216+0000","last_unstale":"2024-09-12T18:08:03.652728+0000","last_undegraded":"2024-09-12T18:08:03.652728+0000","last_fullsized":"2024-09-12T18:08:03.652728+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:59.690176+0000","last_change":"2024-09-12T17:45:03.894942+0000","last_active":"2024-09-12T18:05:59.690176+0000","last_peered":"2024-09-12T18:05:59.690176+0000","last_clean":"2024-09-12T18:05:59.690176+0000","last_became_active":"2024-09-12T17:45:03.894642+0000","last_became_peered":"2024-09-12T17:45:03.894642+0000","last_unstale":"2024-09-12T18:05:59.690176+0000","last_undegraded":"2024-09-12T18:05:59.690176+0000","last_fullsized":"2024-09-12T18:05:59.690176+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:17.879728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.517749+0000","last_change":"2024-09-12T17:57:00.465804+0000","last_active":"2024-09-12T18:05:19.517749+0000","last_peered":"2024-09-12T18:05:19.517749+0000","last_clean":"2024-09-12T18:05:19.517749+0000","last_became_active":"2024-09-12T17:57:00.465546+0000","last_became_peered":"2024-09-12T17:57:00.465546+0000","last_unstale":"2024-09-12T18:05:19.517749+0000","last_undegraded":"2024-09-12T18:05:19.517749+0000","last_fullsized":"2024-09-12T18:05:19.517749+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.264688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'13","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.839888+0000","last_change":"2024-09-12T17:46:45.206808+0000","last_active":"2024-09-12T18:08:03.839888+0000","last_peered":"2024-09-12T18:08:03.839888+0000","last_clean":"2024-09-12T18:08:03.839888+0000","last_became_active":"2024-09-12T17:46:45.206537+0000","last_became_peered":"2024-09-12T17:46:45.206537+0000","last_unstale":"2024-09-12T18:08:03.839888+0000","last_undegraded":"2024-09-12T18:08:03.839888+0000","last_fullsized":"2024-09-12T18:08:03.839888+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29814,"num_write":18,"num_write_kb":19003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:03.840346+0000","last_change":"2024-09-12T17:46:42.177736+0000","last_active":"2024-09-12T18:08:03.840346+0000","last_peered":"2024-09-12T18:08:03.840346+0000","last_clean":"2024-09-12T18:08:03.840346+0000","last_became_active":"2024-09-12T17:46:42.177427+0000","last_became_peered":"2024-09-12T17:46:42.177427+0000","last_unstale":"2024-09-12T18:08:03.840346+0000","last_undegraded":"2024-09-12T18:08:03.840346+0000","last_fullsized":"2024-09-12T18:08:03.840346+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'157","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.188055+0000","last_change":"2024-09-12T18:08:38.188055+0000","last_active":"2024-09-12T18:08:38.188055+0000","last_peered":"2024-09-12T18:08:38.188055+0000","last_clean":"2024-09-12T18:08:38.188055+0000","last_became_active":"2024-09-12T17:45:03.898292+0000","last_became_peered":"2024-09-12T17:45:03.898292+0000","last_unstale":"2024-09-12T18:08:38.188055+0000","last_undegraded":"2024-09-12T18:08:38.188055+0000","last_fullsized":"2024-09-12T18:08:38.188055+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'157","last_scrub_stamp":"2024-09-12T18:08:38.187951+0000","last_deep_scrub":"264'157","last_deep_scrub_stamp":"2024-09-12T18:08:38.187951+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.187951+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:31.196604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":951,"num_read_kb":701,"num_write":196,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2490,"num_omap_keys":5,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.397676+0000","last_change":"2024-09-12T18:08:37.397676+0000","last_active":"2024-09-12T18:08:37.397676+0000","last_peered":"2024-09-12T18:08:37.397676+0000","last_clean":"2024-09-12T18:08:37.397676+0000","last_became_active":"2024-09-12T17:57:00.464090+0000","last_became_peered":"2024-09-12T17:57:00.464090+0000","last_unstale":"2024-09-12T18:08:37.397676+0000","last_undegraded":"2024-09-12T18:08:37.397676+0000","last_fullsized":"2024-09-12T18:08:37.397676+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:37.397578+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:37.397578+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.397578+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:24.082679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.126360+0000","last_change":"2024-09-12T18:08:42.126360+0000","last_active":"2024-09-12T18:08:42.126360+0000","last_peered":"2024-09-12T18:08:42.126360+0000","last_clean":"2024-09-12T18:08:42.126360+0000","last_became_active":"2024-09-12T17:46:45.205357+0000","last_became_peered":"2024-09-12T17:46:45.205357+0000","last_unstale":"2024-09-12T18:08:42.126360+0000","last_undegraded":"2024-09-12T18:08:42.126360+0000","last_fullsized":"2024-09-12T18:08:42.126360+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:42.126244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:42.126244+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.126244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:30.798441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:49.697236+0000","last_change":"2024-09-12T17:46:42.176715+0000","last_active":"2024-09-12T18:06:49.697236+0000","last_peered":"2024-09-12T18:06:49.697236+0000","last_clean":"2024-09-12T18:06:49.697236+0000","last_became_active":"2024-09-12T17:46:42.176415+0000","last_became_peered":"2024-09-12T17:46:42.176415+0000","last_unstale":"2024-09-12T18:06:49.697236+0000","last_undegraded":"2024-09-12T18:06:49.697236+0000","last_fullsized":"2024-09-12T18:06:49.697236+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:04.586483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'25","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.647144+0000","last_change":"2024-09-12T17:45:03.889617+0000","last_active":"2024-09-12T18:05:54.647144+0000","last_peered":"2024-09-12T18:05:54.647144+0000","last_clean":"2024-09-12T18:05:54.647144+0000","last_became_active":"2024-09-12T17:45:03.889334+0000","last_became_peered":"2024-09-12T17:45:03.889334+0000","last_unstale":"2024-09-12T18:05:54.647144+0000","last_undegraded":"2024-09-12T18:05:54.647144+0000","last_fullsized":"2024-09-12T18:05:54.647144+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:08.253653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:39.649616+0000","last_change":"2024-09-12T17:57:00.453730+0000","last_active":"2024-09-12T18:05:39.649616+0000","last_peered":"2024-09-12T18:05:39.649616+0000","last_clean":"2024-09-12T18:05:39.649616+0000","last_became_active":"2024-09-12T17:57:00.453435+0000","last_became_peered":"2024-09-12T17:57:00.453435+0000","last_unstale":"2024-09-12T18:05:39.649616+0000","last_undegraded":"2024-09-12T18:05:39.649616+0000","last_fullsized":"2024-09-12T18:05:39.649616+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:47.161486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"261'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.637517+0000","last_change":"2024-09-12T17:46:45.211314+0000","last_active":"2024-09-12T18:04:49.637517+0000","last_peered":"2024-09-12T18:04:49.637517+0000","last_clean":"2024-09-12T18:04:49.637517+0000","last_became_active":"2024-09-12T17:46:45.210669+0000","last_became_peered":"2024-09-12T17:46:45.210669+0000","last_unstale":"2024-09-12T18:04:49.637517+0000","last_undegraded":"2024-09-12T18:04:49.637517+0000","last_fullsized":"2024-09-12T18:04:49.637517+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:28.368371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.685819+0000","last_change":"2024-09-12T17:46:42.179654+0000","last_active":"2024-09-12T18:05:29.685819+0000","last_peered":"2024-09-12T18:05:29.685819+0000","last_clean":"2024-09-12T18:05:29.685819+0000","last_became_active":"2024-09-12T17:46:42.179369+0000","last_became_peered":"2024-09-12T17:46:42.179369+0000","last_unstale":"2024-09-12T18:05:29.685819+0000","last_undegraded":"2024-09-12T18:05:29.685819+0000","last_fullsized":"2024-09-12T18:05:29.685819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:41.157153+0000","last_clean_scrub_stamp":"2024-09-12T17:46:41.157153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:46.896690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'11","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:54.522442+0000","last_change":"2024-09-12T17:45:03.892044+0000","last_active":"2024-09-12T18:05:54.522442+0000","last_peered":"2024-09-12T18:05:54.522442+0000","last_clean":"2024-09-12T18:05:54.522442+0000","last_became_active":"2024-09-12T17:45:03.891751+0000","last_became_peered":"2024-09-12T17:45:03.891751+0000","last_unstale":"2024-09-12T18:05:54.522442+0000","last_undegraded":"2024-09-12T18:05:54.522442+0000","last_fullsized":"2024-09-12T18:05:54.522442+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:57.974426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:19.646774+0000","last_change":"2024-09-12T17:57:00.466635+0000","last_active":"2024-09-12T18:05:19.646774+0000","last_peered":"2024-09-12T18:05:19.646774+0000","last_clean":"2024-09-12T18:05:19.646774+0000","last_became_active":"2024-09-12T17:57:00.465706+0000","last_became_peered":"2024-09-12T17:57:00.465706+0000","last_unstale":"2024-09-12T18:05:19.646774+0000","last_undegraded":"2024-09-12T18:05:19.646774+0000","last_fullsized":"2024-09-12T18:05:19.646774+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:50.291887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'8","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.040678+0000","last_change":"2024-09-12T18:08:42.040678+0000","last_active":"2024-09-12T18:08:42.040678+0000","last_peered":"2024-09-12T18:08:42.040678+0000","last_clean":"2024-09-12T18:08:42.040678+0000","last_became_active":"2024-09-12T17:46:45.206384+0000","last_became_peered":"2024-09-12T17:46:45.206384+0000","last_unstale":"2024-09-12T18:08:42.040678+0000","last_undegraded":"2024-09-12T18:08:42.040678+0000","last_fullsized":"2024-09-12T18:08:42.040678+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:08:42.040581+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:08:42.040581+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.040581+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:03.377618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":22528,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.118969+0000","last_change":"2024-09-12T18:08:40.118969+0000","last_active":"2024-09-12T18:08:40.118969+0000","last_peered":"2024-09-12T18:08:40.118969+0000","last_clean":"2024-09-12T18:08:40.118969+0000","last_became_active":"2024-09-12T17:46:42.177381+0000","last_became_peered":"2024-09-12T17:46:42.177381+0000","last_unstale":"2024-09-12T18:08:40.118969+0000","last_undegraded":"2024-09-12T18:08:40.118969+0000","last_fullsized":"2024-09-12T18:08:40.118969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:40.118881+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:40.118881+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.118881+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:00.785132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.025529+0000","last_change":"2024-09-12T18:08:34.025529+0000","last_active":"2024-09-12T18:08:34.025529+0000","last_peered":"2024-09-12T18:08:34.025529+0000","last_clean":"2024-09-12T18:08:34.025529+0000","last_became_active":"2024-09-12T17:45:03.893234+0000","last_became_peered":"2024-09-12T17:45:03.893234+0000","last_unstale":"2024-09-12T18:08:34.025529+0000","last_undegraded":"2024-09-12T18:08:34.025529+0000","last_fullsized":"2024-09-12T18:08:34.025529+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T18:08:34.025436+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T18:08:34.025436+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.025436+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:27.725926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":127,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:24.685120+0000","last_change":"2024-09-12T17:57:00.467265+0000","last_active":"2024-09-12T18:05:24.685120+0000","last_peered":"2024-09-12T18:05:24.685120+0000","last_clean":"2024-09-12T18:05:24.685120+0000","last_became_active":"2024-09-12T17:57:00.466994+0000","last_became_peered":"2024-09-12T17:57:00.466994+0000","last_unstale":"2024-09-12T18:05:24.685120+0000","last_undegraded":"2024-09-12T18:05:24.685120+0000","last_fullsized":"2024-09-12T18:05:24.685120+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:10.618141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:29.519076+0000","last_change":"2024-09-12T17:46:45.207817+0000","last_active":"2024-09-12T18:05:29.519076+0000","last_peered":"2024-09-12T18:05:29.519076+0000","last_clean":"2024-09-12T18:05:29.519076+0000","last_became_active":"2024-09-12T17:46:45.207552+0000","last_became_peered":"2024-09-12T17:46:45.207552+0000","last_unstale":"2024-09-12T18:05:29.519076+0000","last_undegraded":"2024-09-12T18:05:29.519076+0000","last_fullsized":"2024-09-12T18:05:29.519076+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:44.178769+0000","last_clean_scrub_stamp":"2024-09-12T17:46:44.178769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.256254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.014529+0000","last_change":"2024-09-12T18:08:40.014529+0000","last_active":"2024-09-12T18:08:40.014529+0000","last_peered":"2024-09-12T18:08:40.014529+0000","last_clean":"2024-09-12T18:08:40.014529+0000","last_became_active":"2024-09-12T17:46:42.181805+0000","last_became_peered":"2024-09-12T17:46:42.181805+0000","last_unstale":"2024-09-12T18:08:40.014529+0000","last_undegraded":"2024-09-12T18:08:40.014529+0000","last_fullsized":"2024-09-12T18:08:40.014529+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:40.014431+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:40.014431+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.014431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:47.203544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'23","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:05:56.747227+0000","last_change":"2024-09-12T17:45:03.893633+0000","last_active":"2024-09-12T18:05:56.747227+0000","last_peered":"2024-09-12T18:05:56.747227+0000","last_clean":"2024-09-12T18:05:56.747227+0000","last_became_active":"2024-09-12T17:45:03.893361+0000","last_became_peered":"2024-09-12T17:45:03.893361+0000","last_unstale":"2024-09-12T18:05:56.747227+0000","last_undegraded":"2024-09-12T18:05:56.747227+0000","last_fullsized":"2024-09-12T18:05:56.747227+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:02.866624+0000","last_clean_scrub_stamp":"2024-09-12T17:45:02.866624+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:44.155033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":77,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'207","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.759272+0000","last_change":"2024-09-12T18:08:23.759272+0000","last_active":"2024-09-12T18:08:23.759272+0000","last_peered":"2024-09-12T18:08:23.759272+0000","last_clean":"2024-09-12T18:08:23.759272+0000","last_became_active":"2024-09-12T17:29:52.955124+0000","last_became_peered":"2024-09-12T17:29:52.955124+0000","last_unstale":"2024-09-12T18:08:23.759272+0000","last_undegraded":"2024-09-12T18:08:23.759272+0000","last_fullsized":"2024-09-12T18:08:23.759272+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:23.759131+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:23.759131+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.759131+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:37.285891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":3241,"num_write":1056,"num_write_kb":28474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'166","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.439354+0000","last_change":"2024-09-12T18:08:28.439354+0000","last_active":"2024-09-12T18:08:28.439354+0000","last_peered":"2024-09-12T18:08:28.439354+0000","last_clean":"2024-09-12T18:08:28.439354+0000","last_became_active":"2024-09-12T17:29:54.957047+0000","last_became_peered":"2024-09-12T17:29:54.957047+0000","last_unstale":"2024-09-12T18:08:28.439354+0000","last_undegraded":"2024-09-12T18:08:28.439354+0000","last_fullsized":"2024-09-12T18:08:28.439354+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T18:08:28.439256+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T18:08:28.439256+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.439256+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:06.350790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":598,"num_write":253,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'214","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.249725+0000","last_change":"2024-09-12T18:08:14.249725+0000","last_active":"2024-09-12T18:08:14.249725+0000","last_peered":"2024-09-12T18:08:14.249725+0000","last_clean":"2024-09-12T18:08:14.249725+0000","last_became_active":"2024-09-12T17:29:52.954249+0000","last_became_peered":"2024-09-12T17:29:52.954249+0000","last_unstale":"2024-09-12T18:08:14.249725+0000","last_undegraded":"2024-09-12T18:08:14.249725+0000","last_fullsized":"2024-09-12T18:08:14.249725+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-12T18:08:14.249628+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-12T18:08:14.249628+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.249628+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:16.628392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":62367,"num_write":1041,"num_write_kb":21747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'277","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.778646+0000","last_change":"2024-09-12T18:08:28.778646+0000","last_active":"2024-09-12T18:08:28.778646+0000","last_peered":"2024-09-12T18:08:28.778646+0000","last_clean":"2024-09-12T18:08:28.778646+0000","last_became_active":"2024-09-12T17:29:54.959503+0000","last_became_peered":"2024-09-12T17:29:54.959503+0000","last_unstale":"2024-09-12T18:08:28.778646+0000","last_undegraded":"2024-09-12T18:08:28.778646+0000","last_fullsized":"2024-09-12T18:08:28.778646+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'277","last_scrub_stamp":"2024-09-12T18:08:28.778560+0000","last_deep_scrub":"264'277","last_deep_scrub_stamp":"2024-09-12T18:08:28.778560+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.778560+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:46.698803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1203,"num_read_kb":968,"num_write":436,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'251","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.162765+0000","last_change":"2024-09-12T18:08:16.162765+0000","last_active":"2024-09-12T18:08:16.162765+0000","last_peered":"2024-09-12T18:08:16.162765+0000","last_clean":"2024-09-12T18:08:16.162765+0000","last_became_active":"2024-09-12T17:29:52.957594+0000","last_became_peered":"2024-09-12T17:29:52.957594+0000","last_unstale":"2024-09-12T18:08:16.162765+0000","last_undegraded":"2024-09-12T18:08:16.162765+0000","last_fullsized":"2024-09-12T18:08:16.162765+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T18:08:16.162633+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T18:08:16.162633+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.162633+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:03.752251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595238,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":699,"num_read_kb":82538,"num_write":1032,"num_write_kb":35611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'90","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.797499+0000","last_change":"2024-09-12T18:08:25.797499+0000","last_active":"2024-09-12T18:08:25.797499+0000","last_peered":"2024-09-12T18:08:25.797499+0000","last_clean":"2024-09-12T18:08:25.797499+0000","last_became_active":"2024-09-12T17:29:54.954764+0000","last_became_peered":"2024-09-12T17:29:54.954764+0000","last_unstale":"2024-09-12T18:08:25.797499+0000","last_undegraded":"2024-09-12T18:08:25.797499+0000","last_fullsized":"2024-09-12T18:08:25.797499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-09-12T18:08:25.797393+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-09-12T18:08:25.797393+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.797393+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:00.865693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":371,"num_write":125,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'210","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.448812+0000","last_change":"2024-09-12T18:08:22.448812+0000","last_active":"2024-09-12T18:08:22.448812+0000","last_peered":"2024-09-12T18:08:22.448812+0000","last_clean":"2024-09-12T18:08:22.448812+0000","last_became_active":"2024-09-12T17:29:52.956816+0000","last_became_peered":"2024-09-12T17:29:52.956816+0000","last_unstale":"2024-09-12T18:08:22.448812+0000","last_undegraded":"2024-09-12T18:08:22.448812+0000","last_fullsized":"2024-09-12T18:08:22.448812+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-12T18:08:22.448672+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-12T18:08:22.448672+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.448672+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:57.146612+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":70330,"num_write":999,"num_write_kb":42186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4089","reported_seq":4675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.210788+0000","last_change":"2024-09-12T18:08:24.210788+0000","last_active":"2024-09-12T18:08:24.210788+0000","last_peered":"2024-09-12T18:08:24.210788+0000","last_clean":"2024-09-12T18:08:24.210788+0000","last_became_active":"2024-09-12T17:29:54.944959+0000","last_became_peered":"2024-09-12T17:29:54.944959+0000","last_unstale":"2024-09-12T18:08:24.210788+0000","last_undegraded":"2024-09-12T18:08:24.210788+0000","last_fullsized":"2024-09-12T18:08:24.210788+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4089","last_scrub_stamp":"2024-09-12T18:08:24.210700+0000","last_deep_scrub":"264'4089","last_deep_scrub_stamp":"2024-09-12T18:08:24.210700+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.210700+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":3000,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:36.120715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16426,"num_read_kb":13705,"num_write":6135,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'163","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.724946+0000","last_change":"2024-09-12T18:08:22.724946+0000","last_active":"2024-09-12T18:08:22.724946+0000","last_peered":"2024-09-12T18:08:22.724946+0000","last_clean":"2024-09-12T18:08:22.724946+0000","last_became_active":"2024-09-12T17:29:52.960666+0000","last_became_peered":"2024-09-12T17:29:52.960666+0000","last_unstale":"2024-09-12T18:08:22.724946+0000","last_undegraded":"2024-09-12T18:08:22.724946+0000","last_fullsized":"2024-09-12T18:08:22.724946+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T18:08:22.724802+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T18:08:22.724802+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.724802+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:44.691765+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":500,"num_read_kb":127585,"num_write":826,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'125","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.067481+0000","last_change":"2024-09-12T18:08:22.067481+0000","last_active":"2024-09-12T18:08:22.067481+0000","last_peered":"2024-09-12T18:08:22.067481+0000","last_clean":"2024-09-12T18:08:22.067481+0000","last_became_active":"2024-09-12T17:29:54.955205+0000","last_became_peered":"2024-09-12T17:29:54.955205+0000","last_unstale":"2024-09-12T18:08:22.067481+0000","last_undegraded":"2024-09-12T18:08:22.067481+0000","last_fullsized":"2024-09-12T18:08:22.067481+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T18:08:22.067382+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T18:08:22.067382+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.067382+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:17.462304+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":437,"num_write":181,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'215","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.474026+0000","last_change":"2024-09-12T18:08:20.474026+0000","last_active":"2024-09-12T18:08:20.474026+0000","last_peered":"2024-09-12T18:08:20.474026+0000","last_clean":"2024-09-12T18:08:20.474026+0000","last_became_active":"2024-09-12T17:29:52.955926+0000","last_became_peered":"2024-09-12T17:29:52.955926+0000","last_unstale":"2024-09-12T18:08:20.474026+0000","last_undegraded":"2024-09-12T18:08:20.474026+0000","last_fullsized":"2024-09-12T18:08:20.474026+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'215","last_scrub_stamp":"2024-09-12T18:08:20.473907+0000","last_deep_scrub":"264'215","last_deep_scrub_stamp":"2024-09-12T18:08:20.473907+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.473907+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:59.079099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":501,"num_read_kb":5634,"num_write":1057,"num_write_kb":27185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'203","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.807971+0000","last_change":"2024-09-12T18:08:26.807971+0000","last_active":"2024-09-12T18:08:26.807971+0000","last_peered":"2024-09-12T18:08:26.807971+0000","last_clean":"2024-09-12T18:08:26.807971+0000","last_became_active":"2024-09-12T17:29:54.955119+0000","last_became_peered":"2024-09-12T17:29:54.955119+0000","last_unstale":"2024-09-12T18:08:26.807971+0000","last_undegraded":"2024-09-12T18:08:26.807971+0000","last_fullsized":"2024-09-12T18:08:26.807971+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-12T18:08:26.807847+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-12T18:08:26.807847+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.807847+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:28.820018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":872,"num_read_kb":697,"num_write":351,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'196","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.745850+0000","last_change":"2024-09-12T18:08:21.745850+0000","last_active":"2024-09-12T18:08:21.745850+0000","last_peered":"2024-09-12T18:08:21.745850+0000","last_clean":"2024-09-12T18:08:21.745850+0000","last_became_active":"2024-09-12T17:29:52.962236+0000","last_became_peered":"2024-09-12T17:29:52.962236+0000","last_unstale":"2024-09-12T18:08:21.745850+0000","last_undegraded":"2024-09-12T18:08:21.745850+0000","last_fullsized":"2024-09-12T18:08:21.745850+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-12T18:08:21.745689+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-12T18:08:21.745689+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.745689+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:04.341885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2835815,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":524,"num_read_kb":5167,"num_write":1014,"num_write_kb":25714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'272","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.447790+0000","last_change":"2024-09-12T18:08:29.447790+0000","last_active":"2024-09-12T18:08:29.447790+0000","last_peered":"2024-09-12T18:08:29.447790+0000","last_clean":"2024-09-12T18:08:29.447790+0000","last_became_active":"2024-09-12T17:29:54.963665+0000","last_became_peered":"2024-09-12T17:29:54.963665+0000","last_unstale":"2024-09-12T18:08:29.447790+0000","last_undegraded":"2024-09-12T18:08:29.447790+0000","last_fullsized":"2024-09-12T18:08:29.447790+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-12T18:08:29.447694+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-12T18:08:29.447694+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.447694+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:07.379854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1246,"num_read_kb":1040,"num_write":431,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'231","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.106919+0000","last_change":"2024-09-12T18:08:16.106919+0000","last_active":"2024-09-12T18:08:16.106919+0000","last_peered":"2024-09-12T18:08:16.106919+0000","last_clean":"2024-09-12T18:08:16.106919+0000","last_became_active":"2024-09-12T17:29:52.955333+0000","last_became_peered":"2024-09-12T17:29:52.955333+0000","last_unstale":"2024-09-12T18:08:16.106919+0000","last_undegraded":"2024-09-12T18:08:16.106919+0000","last_fullsized":"2024-09-12T18:08:16.106919+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-12T18:08:16.106773+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-12T18:08:16.106773+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.106773+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:19.227426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569139,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":94260,"num_write":1118,"num_write_kb":40355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'158","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.404145+0000","last_change":"2024-09-12T18:08:23.404145+0000","last_active":"2024-09-12T18:08:23.404145+0000","last_peered":"2024-09-12T18:08:23.404145+0000","last_clean":"2024-09-12T18:08:23.404145+0000","last_became_active":"2024-09-12T17:29:54.952536+0000","last_became_peered":"2024-09-12T17:29:54.952536+0000","last_unstale":"2024-09-12T18:08:23.404145+0000","last_undegraded":"2024-09-12T18:08:23.404145+0000","last_fullsized":"2024-09-12T18:08:23.404145+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'158","last_scrub_stamp":"2024-09-12T18:08:23.404033+0000","last_deep_scrub":"264'158","last_deep_scrub_stamp":"2024-09-12T18:08:23.404033+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.404033+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:50.664895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":604,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'402","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.806677+0000","last_change":"2024-09-12T18:08:23.806677+0000","last_active":"2024-09-12T18:08:23.806677+0000","last_peered":"2024-09-12T18:08:23.806677+0000","last_clean":"2024-09-12T18:08:23.806677+0000","last_became_active":"2024-09-12T17:29:54.954401+0000","last_became_peered":"2024-09-12T17:29:54.954401+0000","last_unstale":"2024-09-12T18:08:23.806677+0000","last_undegraded":"2024-09-12T18:08:23.806677+0000","last_fullsized":"2024-09-12T18:08:23.806677+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'402","last_scrub_stamp":"2024-09-12T18:08:23.806573+0000","last_deep_scrub":"264'402","last_deep_scrub_stamp":"2024-09-12T18:08:23.806573+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.806573+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:47.510776+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1720,"num_read_kb":1358,"num_write":655,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'182","reported_seq":769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.710577+0000","last_change":"2024-09-12T18:08:20.710509+0000","last_active":"2024-09-12T18:08:20.710577+0000","last_peered":"2024-09-12T18:08:20.710577+0000","last_clean":"2024-09-12T18:08:20.710577+0000","last_became_active":"2024-09-12T17:29:52.957715+0000","last_became_peered":"2024-09-12T17:29:52.957715+0000","last_unstale":"2024-09-12T18:08:20.710577+0000","last_undegraded":"2024-09-12T18:08:20.710577+0000","last_fullsized":"2024-09-12T18:08:20.710577+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-12T18:08:20.710410+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-12T18:08:20.710410+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.710410+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:15.953280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":380,"num_write":908,"num_write_kb":20925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'92","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.775080+0000","last_change":"2024-09-12T18:08:26.775080+0000","last_active":"2024-09-12T18:08:26.775080+0000","last_peered":"2024-09-12T18:08:26.775080+0000","last_clean":"2024-09-12T18:08:26.775080+0000","last_became_active":"2024-09-12T17:29:54.960430+0000","last_became_peered":"2024-09-12T17:29:54.960430+0000","last_unstale":"2024-09-12T18:08:26.775080+0000","last_undegraded":"2024-09-12T18:08:26.775080+0000","last_fullsized":"2024-09-12T18:08:26.775080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-12T18:08:26.774978+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-12T18:08:26.774978+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.774978+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:22.519253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":446,"num_read_kb":372,"num_write":151,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'245","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.079535+0000","last_change":"2024-09-12T18:08:16.079473+0000","last_active":"2024-09-12T18:08:16.079535+0000","last_peered":"2024-09-12T18:08:16.079535+0000","last_clean":"2024-09-12T18:08:16.079535+0000","last_became_active":"2024-09-12T17:29:52.960770+0000","last_became_peered":"2024-09-12T17:29:52.960770+0000","last_unstale":"2024-09-12T18:08:16.079535+0000","last_undegraded":"2024-09-12T18:08:16.079535+0000","last_fullsized":"2024-09-12T18:08:16.079535+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T18:08:16.079351+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T18:08:16.079351+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.079351+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:46.777517+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291498,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":825,"num_read_kb":13405,"num_write":1115,"num_write_kb":28936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'257","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.420438+0000","last_change":"2024-09-12T18:08:24.420438+0000","last_active":"2024-09-12T18:08:24.420438+0000","last_peered":"2024-09-12T18:08:24.420438+0000","last_clean":"2024-09-12T18:08:24.420438+0000","last_became_active":"2024-09-12T17:29:54.962822+0000","last_became_peered":"2024-09-12T17:29:54.962822+0000","last_unstale":"2024-09-12T18:08:24.420438+0000","last_undegraded":"2024-09-12T18:08:24.420438+0000","last_fullsized":"2024-09-12T18:08:24.420438+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-09-12T18:08:24.420342+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-09-12T18:08:24.420342+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.420342+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:43.478734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1220,"num_read_kb":1023,"num_write":434,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'208","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.047387+0000","last_change":"2024-09-12T18:08:17.047282+0000","last_active":"2024-09-12T18:08:17.047387+0000","last_peered":"2024-09-12T18:08:17.047387+0000","last_clean":"2024-09-12T18:08:17.047387+0000","last_became_active":"2024-09-12T17:29:52.956432+0000","last_became_peered":"2024-09-12T17:29:52.956432+0000","last_unstale":"2024-09-12T18:08:17.047387+0000","last_undegraded":"2024-09-12T18:08:17.047387+0000","last_fullsized":"2024-09-12T18:08:17.047387+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T18:08:17.047159+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T18:08:17.047159+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.047159+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:56.216084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306456,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":42949,"num_write":1043,"num_write_kb":37671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'84","reported_seq":678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.431445+0000","last_change":"2024-09-12T18:08:18.431383+0000","last_active":"2024-09-12T18:08:18.431445+0000","last_peered":"2024-09-12T18:08:18.431445+0000","last_clean":"2024-09-12T18:08:18.431445+0000","last_became_active":"2024-09-12T17:29:54.944588+0000","last_became_peered":"2024-09-12T17:29:54.944588+0000","last_unstale":"2024-09-12T18:08:18.431445+0000","last_undegraded":"2024-09-12T18:08:18.431445+0000","last_fullsized":"2024-09-12T18:08:18.431445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T18:08:18.431281+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T18:08:18.431281+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.431281+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:42.771743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":342,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'232","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.778834+0000","last_change":"2024-09-12T18:08:09.778762+0000","last_active":"2024-09-12T18:08:09.778834+0000","last_peered":"2024-09-12T18:08:09.778834+0000","last_clean":"2024-09-12T18:08:09.778834+0000","last_became_active":"2024-09-12T17:29:52.962814+0000","last_became_peered":"2024-09-12T17:29:52.962814+0000","last_unstale":"2024-09-12T18:08:09.778834+0000","last_undegraded":"2024-09-12T18:08:09.778834+0000","last_fullsized":"2024-09-12T18:08:09.778834+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-09-12T18:08:09.778651+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-09-12T18:08:09.778651+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.778651+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:58.056507+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":494,"num_read_kb":48249,"num_write":1130,"num_write_kb":37209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'126","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.419392+0000","last_change":"2024-09-12T18:08:19.419319+0000","last_active":"2024-09-12T18:08:19.419392+0000","last_peered":"2024-09-12T18:08:19.419392+0000","last_clean":"2024-09-12T18:08:19.419392+0000","last_became_active":"2024-09-12T17:29:54.956975+0000","last_became_peered":"2024-09-12T17:29:54.956975+0000","last_unstale":"2024-09-12T18:08:19.419392+0000","last_undegraded":"2024-09-12T18:08:19.419392+0000","last_fullsized":"2024-09-12T18:08:19.419392+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-12T18:08:19.419239+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-12T18:08:19.419239+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.419239+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:11.813359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":592,"num_read_kb":498,"num_write":187,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'266","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.067750+0000","last_change":"2024-09-12T18:08:14.067674+0000","last_active":"2024-09-12T18:08:14.067750+0000","last_peered":"2024-09-12T18:08:14.067750+0000","last_clean":"2024-09-12T18:08:14.067750+0000","last_became_active":"2024-09-12T17:29:52.954630+0000","last_became_peered":"2024-09-12T17:29:52.954630+0000","last_unstale":"2024-09-12T18:08:14.067750+0000","last_undegraded":"2024-09-12T18:08:14.067750+0000","last_fullsized":"2024-09-12T18:08:14.067750+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T18:08:14.067562+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T18:08:14.067562+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.067562+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:04.519905+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456483,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":845,"num_read_kb":67267,"num_write":1133,"num_write_kb":48740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'283","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.846460+0000","last_change":"2024-09-12T18:08:24.846394+0000","last_active":"2024-09-12T18:08:24.846460+0000","last_peered":"2024-09-12T18:08:24.846460+0000","last_clean":"2024-09-12T18:08:24.846460+0000","last_became_active":"2024-09-12T17:29:54.958852+0000","last_became_peered":"2024-09-12T17:29:54.958852+0000","last_unstale":"2024-09-12T18:08:24.846460+0000","last_undegraded":"2024-09-12T18:08:24.846460+0000","last_fullsized":"2024-09-12T18:08:24.846460+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'283","last_scrub_stamp":"2024-09-12T18:08:24.846301+0000","last_deep_scrub":"264'283","last_deep_scrub_stamp":"2024-09-12T18:08:24.846301+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.846301+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:55.554420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1254,"num_read_kb":1035,"num_write":436,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'170","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.123138+0000","last_change":"2024-09-12T18:08:14.123138+0000","last_active":"2024-09-12T18:08:14.123138+0000","last_peered":"2024-09-12T18:08:14.123138+0000","last_clean":"2024-09-12T18:08:14.123138+0000","last_became_active":"2024-09-12T17:29:52.959175+0000","last_became_peered":"2024-09-12T17:29:52.959175+0000","last_unstale":"2024-09-12T18:08:14.123138+0000","last_undegraded":"2024-09-12T18:08:14.123138+0000","last_fullsized":"2024-09-12T18:08:14.123138+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-09-12T18:08:14.123015+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-09-12T18:08:14.123015+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.123015+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:26.240900+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":1243,"num_write":851,"num_write_kb":36341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'157","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.836312+0000","last_change":"2024-09-12T18:08:37.836250+0000","last_active":"2024-09-12T18:08:37.836312+0000","last_peered":"2024-09-12T18:08:37.836312+0000","last_clean":"2024-09-12T18:08:37.836312+0000","last_became_active":"2024-09-12T17:30:02.964492+0000","last_became_peered":"2024-09-12T17:30:02.964492+0000","last_unstale":"2024-09-12T18:08:37.836312+0000","last_undegraded":"2024-09-12T18:08:37.836312+0000","last_fullsized":"2024-09-12T18:08:37.836312+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'157","last_scrub_stamp":"2024-09-12T18:08:37.836168+0000","last_deep_scrub":"264'157","last_deep_scrub_stamp":"2024-09-12T18:08:37.836168+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.836168+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:03.859804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":218,"num_read_kb":205,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'110","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.069383+0000","last_change":"2024-09-12T18:08:20.069383+0000","last_active":"2024-09-12T18:08:20.069383+0000","last_peered":"2024-09-12T18:08:20.069383+0000","last_clean":"2024-09-12T18:08:20.069383+0000","last_became_active":"2024-09-12T17:29:54.950633+0000","last_became_peered":"2024-09-12T17:29:54.950633+0000","last_unstale":"2024-09-12T18:08:20.069383+0000","last_undegraded":"2024-09-12T18:08:20.069383+0000","last_fullsized":"2024-09-12T18:08:20.069383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-12T18:08:20.069263+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-12T18:08:20.069263+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.069263+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:55.109697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":400,"num_write":147,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'201","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.722577+0000","last_change":"2024-09-12T18:08:16.722577+0000","last_active":"2024-09-12T18:08:16.722577+0000","last_peered":"2024-09-12T18:08:16.722577+0000","last_clean":"2024-09-12T18:08:16.722577+0000","last_became_active":"2024-09-12T17:30:28.007183+0000","last_became_peered":"2024-09-12T17:30:28.007183+0000","last_unstale":"2024-09-12T18:08:16.722577+0000","last_undegraded":"2024-09-12T18:08:16.722577+0000","last_fullsized":"2024-09-12T18:08:16.722577+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-12T18:08:16.722467+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-12T18:08:16.722467+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.722467+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:25.320294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":918,"num_read_kb":19617,"num_write":951,"num_write_kb":33635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"264'4","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.504138+0000","last_change":"2024-09-12T18:08:32.504066+0000","last_active":"2024-09-12T18:08:32.504138+0000","last_peered":"2024-09-12T18:08:32.504138+0000","last_clean":"2024-09-12T18:08:32.504138+0000","last_became_active":"2024-09-12T17:29:56.954488+0000","last_became_peered":"2024-09-12T17:29:56.954488+0000","last_unstale":"2024-09-12T18:08:32.504138+0000","last_undegraded":"2024-09-12T18:08:32.504138+0000","last_fullsized":"2024-09-12T18:08:32.504138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:08:32.503973+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:08:32.503973+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.503973+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:44.475732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":724,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'181","reported_seq":784,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.270942+0000","last_change":"2024-09-12T18:08:30.270883+0000","last_active":"2024-09-12T18:08:30.270942+0000","last_peered":"2024-09-12T18:08:30.270942+0000","last_clean":"2024-09-12T18:08:30.270942+0000","last_became_active":"2024-09-12T17:29:58.956916+0000","last_became_peered":"2024-09-12T17:29:58.956916+0000","last_unstale":"2024-09-12T18:08:30.270942+0000","last_undegraded":"2024-09-12T18:08:30.270942+0000","last_fullsized":"2024-09-12T18:08:30.270942+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'181","last_scrub_stamp":"2024-09-12T18:08:30.270791+0000","last_deep_scrub":"264'181","last_deep_scrub_stamp":"2024-09-12T18:08:30.270791+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.270791+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:27.185524+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4406,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":236,"num_read_kb":279,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.990492+0000","last_change":"2024-09-12T18:08:40.990391+0000","last_active":"2024-09-12T18:08:40.990492+0000","last_peered":"2024-09-12T18:08:40.990492+0000","last_clean":"2024-09-12T18:08:40.990492+0000","last_became_active":"2024-09-12T17:30:00.960409+0000","last_became_peered":"2024-09-12T17:30:00.960409+0000","last_unstale":"2024-09-12T18:08:40.990492+0000","last_undegraded":"2024-09-12T18:08:40.990492+0000","last_fullsized":"2024-09-12T18:08:40.990492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:40.990277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:40.990277+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.990277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:06.362958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2442","reported_seq":4366,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.852848+0000","last_change":"2024-09-12T17:30:02.968528+0000","last_active":"2024-09-12T18:06:20.852848+0000","last_peered":"2024-09-12T18:06:20.852848+0000","last_clean":"2024-09-12T18:06:20.852848+0000","last_became_active":"2024-09-12T17:30:02.967718+0000","last_became_peered":"2024-09-12T17:30:02.967718+0000","last_unstale":"2024-09-12T18:06:20.852848+0000","last_undegraded":"2024-09-12T18:06:20.852848+0000","last_fullsized":"2024-09-12T18:06:20.852848+0000","mapping_epoch":34,"log_start":"264'2400","ondisk_log_start":"264'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":2400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:40.278625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1044,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6319,"num_read_kb":6274,"num_write":4873,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'137","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.422157+0000","last_change":"2024-09-12T18:08:25.422081+0000","last_active":"2024-09-12T18:08:25.422157+0000","last_peered":"2024-09-12T18:08:25.422157+0000","last_clean":"2024-09-12T18:08:25.422157+0000","last_became_active":"2024-09-12T17:29:54.957747+0000","last_became_peered":"2024-09-12T17:29:54.957747+0000","last_unstale":"2024-09-12T18:08:25.422157+0000","last_undegraded":"2024-09-12T18:08:25.422157+0000","last_fullsized":"2024-09-12T18:08:25.422157+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T18:08:25.421998+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T18:08:25.421998+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.421998+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:49.865865+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":552,"num_write":215,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2873,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'213","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.155495+0000","last_change":"2024-09-12T18:08:09.155495+0000","last_active":"2024-09-12T18:08:09.155495+0000","last_peered":"2024-09-12T18:08:09.155495+0000","last_clean":"2024-09-12T18:08:09.155495+0000","last_became_active":"2024-09-12T17:29:52.950612+0000","last_became_peered":"2024-09-12T17:29:52.950612+0000","last_unstale":"2024-09-12T18:08:09.155495+0000","last_undegraded":"2024-09-12T18:08:09.155495+0000","last_fullsized":"2024-09-12T18:08:09.155495+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-09-12T18:08:09.155405+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-09-12T18:08:09.155405+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.155405+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:06.394522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":421,"num_read_kb":10994,"num_write":1027,"num_write_kb":32732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.988172+0000","last_change":"2024-09-12T18:08:27.988172+0000","last_active":"2024-09-12T18:08:27.988172+0000","last_peered":"2024-09-12T18:08:27.988172+0000","last_clean":"2024-09-12T18:08:27.988172+0000","last_became_active":"2024-09-12T17:29:56.953546+0000","last_became_peered":"2024-09-12T17:29:56.953546+0000","last_unstale":"2024-09-12T18:08:27.988172+0000","last_undegraded":"2024-09-12T18:08:27.988172+0000","last_fullsized":"2024-09-12T18:08:27.988172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.988088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.988088+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.988088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:29.059380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'89","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.836068+0000","last_change":"2024-09-12T18:08:33.835983+0000","last_active":"2024-09-12T18:08:33.836068+0000","last_peered":"2024-09-12T18:08:33.836068+0000","last_clean":"2024-09-12T18:08:33.836068+0000","last_became_active":"2024-09-12T17:29:58.951077+0000","last_became_peered":"2024-09-12T17:29:58.951077+0000","last_unstale":"2024-09-12T18:08:33.836068+0000","last_undegraded":"2024-09-12T18:08:33.836068+0000","last_fullsized":"2024-09-12T18:08:33.836068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-09-12T18:08:33.835852+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-09-12T18:08:33.835852+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.835852+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:16.577451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.813183+0000","last_change":"2024-09-12T18:08:35.813108+0000","last_active":"2024-09-12T18:08:35.813183+0000","last_peered":"2024-09-12T18:08:35.813183+0000","last_clean":"2024-09-12T18:08:35.813183+0000","last_became_active":"2024-09-12T17:30:00.969291+0000","last_became_peered":"2024-09-12T17:30:00.969291+0000","last_unstale":"2024-09-12T18:08:35.813183+0000","last_undegraded":"2024-09-12T18:08:35.813183+0000","last_fullsized":"2024-09-12T18:08:35.813183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:35.813023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:35.813023+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.813023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:58.218750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'127","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.385530+0000","last_change":"2024-09-12T18:08:44.385530+0000","last_active":"2024-09-12T18:08:44.385530+0000","last_peered":"2024-09-12T18:08:44.385530+0000","last_clean":"2024-09-12T18:08:44.385530+0000","last_became_active":"2024-09-12T17:30:02.971843+0000","last_became_peered":"2024-09-12T17:30:02.971843+0000","last_unstale":"2024-09-12T18:08:44.385530+0000","last_undegraded":"2024-09-12T18:08:44.385530+0000","last_fullsized":"2024-09-12T18:08:44.385530+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-12T18:08:44.385450+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-12T18:08:44.385450+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.385450+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:19.255428+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'129","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.116982+0000","last_change":"2024-09-12T18:08:19.116925+0000","last_active":"2024-09-12T18:08:19.116982+0000","last_peered":"2024-09-12T18:08:19.116982+0000","last_clean":"2024-09-12T18:08:19.116982+0000","last_became_active":"2024-09-12T17:29:54.944698+0000","last_became_peered":"2024-09-12T17:29:54.944698+0000","last_unstale":"2024-09-12T18:08:19.116982+0000","last_undegraded":"2024-09-12T18:08:19.116982+0000","last_fullsized":"2024-09-12T18:08:19.116982+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T18:08:19.116839+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T18:08:19.116839+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.116839+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:21.922508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":422,"num_write":199,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'178","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.665158+0000","last_change":"2024-09-12T18:08:18.665158+0000","last_active":"2024-09-12T18:08:18.665158+0000","last_peered":"2024-09-12T18:08:18.665158+0000","last_clean":"2024-09-12T18:08:18.665158+0000","last_became_active":"2024-09-12T17:29:52.963087+0000","last_became_peered":"2024-09-12T17:29:52.963087+0000","last_unstale":"2024-09-12T18:08:18.665158+0000","last_undegraded":"2024-09-12T18:08:18.665158+0000","last_fullsized":"2024-09-12T18:08:18.665158+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-12T18:08:18.665031+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-12T18:08:18.665031+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.665031+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:53.506644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128531,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":3190,"num_write":917,"num_write_kb":30863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.998246+0000","last_change":"2024-09-12T18:08:29.998182+0000","last_active":"2024-09-12T18:08:29.998246+0000","last_peered":"2024-09-12T18:08:29.998246+0000","last_clean":"2024-09-12T18:08:29.998246+0000","last_became_active":"2024-09-12T17:29:56.952827+0000","last_became_peered":"2024-09-12T17:29:56.952827+0000","last_unstale":"2024-09-12T18:08:29.998246+0000","last_undegraded":"2024-09-12T18:08:29.998246+0000","last_fullsized":"2024-09-12T18:08:29.998246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:29.998095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:29.998095+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.998095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:17.333075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'103","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.426608+0000","last_change":"2024-09-12T18:08:26.426608+0000","last_active":"2024-09-12T18:08:26.426608+0000","last_peered":"2024-09-12T18:08:26.426608+0000","last_clean":"2024-09-12T18:08:26.426608+0000","last_became_active":"2024-09-12T17:29:58.952169+0000","last_became_peered":"2024-09-12T17:29:58.952169+0000","last_unstale":"2024-09-12T18:08:26.426608+0000","last_undegraded":"2024-09-12T18:08:26.426608+0000","last_fullsized":"2024-09-12T18:08:26.426608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'103","last_scrub_stamp":"2024-09-12T18:08:26.426525+0000","last_deep_scrub":"264'103","last_deep_scrub_stamp":"2024-09-12T18:08:26.426525+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.426525+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:57.793772+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":103,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'755","reported_seq":2414,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.994037+0000","last_change":"2024-09-12T18:08:41.993968+0000","last_active":"2024-09-12T18:08:41.994037+0000","last_peered":"2024-09-12T18:08:41.994037+0000","last_clean":"2024-09-12T18:08:41.994037+0000","last_became_active":"2024-09-12T17:30:00.954180+0000","last_became_peered":"2024-09-12T17:30:00.954180+0000","last_unstale":"2024-09-12T18:08:41.994037+0000","last_undegraded":"2024-09-12T18:08:41.994037+0000","last_fullsized":"2024-09-12T18:08:41.994037+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'755","last_scrub_stamp":"2024-09-12T18:08:41.993869+0000","last_deep_scrub":"264'755","last_deep_scrub_stamp":"2024-09-12T18:08:41.993869+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.993869+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:21.785678+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'182","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.753087+0000","last_change":"2024-09-12T18:08:40.753087+0000","last_active":"2024-09-12T18:08:40.753087+0000","last_peered":"2024-09-12T18:08:40.753087+0000","last_clean":"2024-09-12T18:08:40.753087+0000","last_became_active":"2024-09-12T17:30:02.961198+0000","last_became_peered":"2024-09-12T17:30:02.961198+0000","last_unstale":"2024-09-12T18:08:40.753087+0000","last_undegraded":"2024-09-12T18:08:40.753087+0000","last_fullsized":"2024-09-12T18:08:40.753087+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-12T18:08:40.752993+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-12T18:08:40.752993+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.752993+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:04.570541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":624,"num_write":393,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'95","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.075608+0000","last_change":"2024-09-12T18:08:21.075530+0000","last_active":"2024-09-12T18:08:21.075608+0000","last_peered":"2024-09-12T18:08:21.075608+0000","last_clean":"2024-09-12T18:08:21.075608+0000","last_became_active":"2024-09-12T17:29:54.956663+0000","last_became_peered":"2024-09-12T17:29:54.956663+0000","last_unstale":"2024-09-12T18:08:21.075608+0000","last_undegraded":"2024-09-12T18:08:21.075608+0000","last_fullsized":"2024-09-12T18:08:21.075608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'95","last_scrub_stamp":"2024-09-12T18:08:21.075428+0000","last_deep_scrub":"264'95","last_deep_scrub_stamp":"2024-09-12T18:08:21.075428+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.075428+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:39.799375+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":356,"num_write":140,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'167","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.026722+0000","last_change":"2024-09-12T18:08:12.026722+0000","last_active":"2024-09-12T18:08:12.026722+0000","last_peered":"2024-09-12T18:08:12.026722+0000","last_clean":"2024-09-12T18:08:12.026722+0000","last_became_active":"2024-09-12T17:29:52.962665+0000","last_became_peered":"2024-09-12T17:29:52.962665+0000","last_unstale":"2024-09-12T18:08:12.026722+0000","last_undegraded":"2024-09-12T18:08:12.026722+0000","last_fullsized":"2024-09-12T18:08:12.026722+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-09-12T18:08:12.026621+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-09-12T18:08:12.026621+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.026621+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:49.096759+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":354,"num_read_kb":5731,"num_write":816,"num_write_kb":29128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.503672+0000","last_change":"2024-09-12T18:08:33.503610+0000","last_active":"2024-09-12T18:08:33.503672+0000","last_peered":"2024-09-12T18:08:33.503672+0000","last_clean":"2024-09-12T18:08:33.503672+0000","last_became_active":"2024-09-12T17:29:56.952625+0000","last_became_peered":"2024-09-12T17:29:56.952625+0000","last_unstale":"2024-09-12T18:08:33.503672+0000","last_undegraded":"2024-09-12T18:08:33.503672+0000","last_fullsized":"2024-09-12T18:08:33.503672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:33.503515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:33.503515+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.503515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:18.890954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'109","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.934134+0000","last_change":"2024-09-12T18:08:36.934077+0000","last_active":"2024-09-12T18:08:36.934134+0000","last_peered":"2024-09-12T18:08:36.934134+0000","last_clean":"2024-09-12T18:08:36.934134+0000","last_became_active":"2024-09-12T17:29:58.978299+0000","last_became_peered":"2024-09-12T17:29:58.978299+0000","last_unstale":"2024-09-12T18:08:36.934134+0000","last_undegraded":"2024-09-12T18:08:36.934134+0000","last_fullsized":"2024-09-12T18:08:36.934134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-12T18:08:36.933983+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-12T18:08:36.933983+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.933983+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:11.454887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'777","reported_seq":3928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.862355+0000","last_change":"2024-09-12T18:08:40.862355+0000","last_active":"2024-09-12T18:08:40.862355+0000","last_peered":"2024-09-12T18:08:40.862355+0000","last_clean":"2024-09-12T18:08:40.862355+0000","last_became_active":"2024-09-12T17:30:00.962754+0000","last_became_peered":"2024-09-12T17:30:00.962754+0000","last_unstale":"2024-09-12T18:08:40.862355+0000","last_undegraded":"2024-09-12T18:08:40.862355+0000","last_fullsized":"2024-09-12T18:08:40.862355+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'777","last_scrub_stamp":"2024-09-12T18:08:40.862268+0000","last_deep_scrub":"264'777","last_deep_scrub_stamp":"2024-09-12T18:08:40.862268+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.862268+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:57.506437+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'251","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.399080+0000","last_change":"2024-09-12T18:08:23.399080+0000","last_active":"2024-09-12T18:08:23.399080+0000","last_peered":"2024-09-12T18:08:23.399080+0000","last_clean":"2024-09-12T18:08:23.399080+0000","last_became_active":"2024-09-12T17:29:54.957148+0000","last_became_peered":"2024-09-12T17:29:54.957148+0000","last_unstale":"2024-09-12T18:08:23.399080+0000","last_undegraded":"2024-09-12T18:08:23.399080+0000","last_fullsized":"2024-09-12T18:08:23.399080+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T18:08:23.398990+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T18:08:23.398990+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.398990+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:10.788896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":968,"num_write":398,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'237","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.672401+0000","last_change":"2024-09-12T18:08:15.672401+0000","last_active":"2024-09-12T18:08:15.672401+0000","last_peered":"2024-09-12T18:08:15.672401+0000","last_clean":"2024-09-12T18:08:15.672401+0000","last_became_active":"2024-09-12T17:29:52.964421+0000","last_became_peered":"2024-09-12T17:29:52.964421+0000","last_unstale":"2024-09-12T18:08:15.672401+0000","last_undegraded":"2024-09-12T18:08:15.672401+0000","last_fullsized":"2024-09-12T18:08:15.672401+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'237","last_scrub_stamp":"2024-09-12T18:08:15.672302+0000","last_deep_scrub":"264'237","last_deep_scrub_stamp":"2024-09-12T18:08:15.672302+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.672302+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:57.673677+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":5176,"num_write":1044,"num_write_kb":56179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.807188+0000","last_change":"2024-09-12T18:08:29.807188+0000","last_active":"2024-09-12T18:08:29.807188+0000","last_peered":"2024-09-12T18:08:29.807188+0000","last_clean":"2024-09-12T18:08:29.807188+0000","last_became_active":"2024-09-12T17:29:56.953204+0000","last_became_peered":"2024-09-12T17:29:56.953204+0000","last_unstale":"2024-09-12T18:08:29.807188+0000","last_undegraded":"2024-09-12T18:08:29.807188+0000","last_fullsized":"2024-09-12T18:08:29.807188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:29.807103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:29.807103+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.807103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:46.116812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'190","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.513371+0000","last_change":"2024-09-12T18:08:36.513371+0000","last_active":"2024-09-12T18:08:36.513371+0000","last_peered":"2024-09-12T18:08:36.513371+0000","last_clean":"2024-09-12T18:08:36.513371+0000","last_became_active":"2024-09-12T17:29:58.978213+0000","last_became_peered":"2024-09-12T17:29:58.978213+0000","last_unstale":"2024-09-12T18:08:36.513371+0000","last_undegraded":"2024-09-12T18:08:36.513371+0000","last_fullsized":"2024-09-12T18:08:36.513371+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:08:36.513264+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:08:36.513264+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.513264+0000","objects_scrubbed":9,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:02.853977+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9297,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":251,"num_read_kb":306,"num_write":140,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.312537+0000","last_change":"2024-09-12T18:08:31.312537+0000","last_active":"2024-09-12T18:08:31.312537+0000","last_peered":"2024-09-12T18:08:31.312537+0000","last_clean":"2024-09-12T18:08:31.312537+0000","last_became_active":"2024-09-12T17:30:00.958723+0000","last_became_peered":"2024-09-12T17:30:00.958723+0000","last_unstale":"2024-09-12T18:08:31.312537+0000","last_undegraded":"2024-09-12T18:08:31.312537+0000","last_fullsized":"2024-09-12T18:08:31.312537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:31.312475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:31.312475+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.312475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:56.120649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'552","reported_seq":1364,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.411227+0000","last_change":"2024-09-12T18:08:41.411227+0000","last_active":"2024-09-12T18:08:41.411227+0000","last_peered":"2024-09-12T18:08:41.411227+0000","last_clean":"2024-09-12T18:08:41.411227+0000","last_became_active":"2024-09-12T17:30:02.968515+0000","last_became_peered":"2024-09-12T17:30:02.968515+0000","last_unstale":"2024-09-12T18:08:41.411227+0000","last_undegraded":"2024-09-12T18:08:41.411227+0000","last_fullsized":"2024-09-12T18:08:41.411227+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'552","last_scrub_stamp":"2024-09-12T18:08:41.411132+0000","last_deep_scrub":"264'552","last_deep_scrub_stamp":"2024-09-12T18:08:41.411132+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.411132+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:32.937558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1325,"num_read_kb":1316,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'153","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.736621+0000","last_change":"2024-09-12T18:08:11.736621+0000","last_active":"2024-09-12T18:08:11.736621+0000","last_peered":"2024-09-12T18:08:11.736621+0000","last_clean":"2024-09-12T18:08:11.736621+0000","last_became_active":"2024-09-12T17:29:54.959140+0000","last_became_peered":"2024-09-12T17:29:54.959140+0000","last_unstale":"2024-09-12T18:08:11.736621+0000","last_undegraded":"2024-09-12T18:08:11.736621+0000","last_fullsized":"2024-09-12T18:08:11.736621+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-12T18:08:11.736532+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-12T18:08:11.736532+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.736532+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:28.497052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":582,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'177","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.657316+0000","last_change":"2024-09-12T18:08:14.657316+0000","last_active":"2024-09-12T18:08:14.657316+0000","last_peered":"2024-09-12T18:08:14.657316+0000","last_clean":"2024-09-12T18:08:14.657316+0000","last_became_active":"2024-09-12T17:29:52.964339+0000","last_became_peered":"2024-09-12T17:29:52.964339+0000","last_unstale":"2024-09-12T18:08:14.657316+0000","last_undegraded":"2024-09-12T18:08:14.657316+0000","last_fullsized":"2024-09-12T18:08:14.657316+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:08:14.657212+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:08:14.657212+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.657212+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:58.043317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395849,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":381,"num_read_kb":1621,"num_write":866,"num_write_kb":10562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.466833+0000","last_change":"2024-09-12T18:08:20.466833+0000","last_active":"2024-09-12T18:08:20.466833+0000","last_peered":"2024-09-12T18:08:20.466833+0000","last_clean":"2024-09-12T18:08:20.466833+0000","last_became_active":"2024-09-12T17:29:56.953551+0000","last_became_peered":"2024-09-12T17:29:56.953551+0000","last_unstale":"2024-09-12T18:08:20.466833+0000","last_undegraded":"2024-09-12T18:08:20.466833+0000","last_fullsized":"2024-09-12T18:08:20.466833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:20.466738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:20.466738+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.466738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:40.063398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'128","reported_seq":696,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.970220+0000","last_change":"2024-09-12T18:08:31.970220+0000","last_active":"2024-09-12T18:08:31.970220+0000","last_peered":"2024-09-12T18:08:31.970220+0000","last_clean":"2024-09-12T18:08:31.970220+0000","last_became_active":"2024-09-12T17:29:58.953107+0000","last_became_peered":"2024-09-12T17:29:58.953107+0000","last_unstale":"2024-09-12T18:08:31.970220+0000","last_undegraded":"2024-09-12T18:08:31.970220+0000","last_fullsized":"2024-09-12T18:08:31.970220+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-12T18:08:31.970110+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-12T18:08:31.970110+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.970110+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:14.593698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9938,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":239,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.872213+0000","last_change":"2024-09-12T18:08:41.872213+0000","last_active":"2024-09-12T18:08:41.872213+0000","last_peered":"2024-09-12T18:08:41.872213+0000","last_clean":"2024-09-12T18:08:41.872213+0000","last_became_active":"2024-09-12T17:30:00.961545+0000","last_became_peered":"2024-09-12T17:30:00.961545+0000","last_unstale":"2024-09-12T18:08:41.872213+0000","last_undegraded":"2024-09-12T18:08:41.872213+0000","last_fullsized":"2024-09-12T18:08:41.872213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:41.872079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:41.872079+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.872079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:14.981525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'87","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.966855+0000","last_change":"2024-09-12T18:08:31.966855+0000","last_active":"2024-09-12T18:08:31.966855+0000","last_peered":"2024-09-12T18:08:31.966855+0000","last_clean":"2024-09-12T18:08:31.966855+0000","last_became_active":"2024-09-12T17:30:02.967500+0000","last_became_peered":"2024-09-12T17:30:02.967500+0000","last_unstale":"2024-09-12T18:08:31.966855+0000","last_undegraded":"2024-09-12T18:08:31.966855+0000","last_fullsized":"2024-09-12T18:08:31.966855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'87","last_scrub_stamp":"2024-09-12T18:08:31.966730+0000","last_deep_scrub":"264'87","last_deep_scrub_stamp":"2024-09-12T18:08:31.966730+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.966730+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:38.709044+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":199,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'67","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.126105+0000","last_change":"2024-09-12T18:08:19.126105+0000","last_active":"2024-09-12T18:08:19.126105+0000","last_peered":"2024-09-12T18:08:19.126105+0000","last_clean":"2024-09-12T18:08:19.126105+0000","last_became_active":"2024-09-12T17:29:54.959979+0000","last_became_peered":"2024-09-12T17:29:54.959979+0000","last_unstale":"2024-09-12T18:08:19.126105+0000","last_undegraded":"2024-09-12T18:08:19.126105+0000","last_fullsized":"2024-09-12T18:08:19.126105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-09-12T18:08:19.125996+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-09-12T18:08:19.125996+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.125996+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:57.331669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":252,"num_write":105,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'337","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.692746+0000","last_change":"2024-09-12T18:08:13.692746+0000","last_active":"2024-09-12T18:08:13.692746+0000","last_peered":"2024-09-12T18:08:13.692746+0000","last_clean":"2024-09-12T18:08:13.692746+0000","last_became_active":"2024-09-12T17:29:52.957308+0000","last_became_peered":"2024-09-12T17:29:52.957308+0000","last_unstale":"2024-09-12T18:08:13.692746+0000","last_undegraded":"2024-09-12T18:08:13.692746+0000","last_fullsized":"2024-09-12T18:08:13.692746+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-09-12T18:08:13.692640+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-09-12T18:08:13.692640+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.692640+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:12.037962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":832,"num_read_kb":24052,"num_write":1268,"num_write_kb":42343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"264'5","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.414556+0000","last_change":"2024-09-12T18:08:24.414556+0000","last_active":"2024-09-12T18:08:24.414556+0000","last_peered":"2024-09-12T18:08:24.414556+0000","last_clean":"2024-09-12T18:08:24.414556+0000","last_became_active":"2024-09-12T17:29:56.959206+0000","last_became_peered":"2024-09-12T17:29:56.959206+0000","last_unstale":"2024-09-12T18:08:24.414556+0000","last_undegraded":"2024-09-12T18:08:24.414556+0000","last_fullsized":"2024-09-12T18:08:24.414556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:24.414472+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:24.414472+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.414472+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:13.993154+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":1192,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'166","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.920406+0000","last_change":"2024-09-12T18:08:33.920406+0000","last_active":"2024-09-12T18:08:33.920406+0000","last_peered":"2024-09-12T18:08:33.920406+0000","last_clean":"2024-09-12T18:08:33.920406+0000","last_became_active":"2024-09-12T17:29:58.955698+0000","last_became_peered":"2024-09-12T17:29:58.955698+0000","last_unstale":"2024-09-12T18:08:33.920406+0000","last_undegraded":"2024-09-12T18:08:33.920406+0000","last_fullsized":"2024-09-12T18:08:33.920406+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T18:08:33.920303+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T18:08:33.920303+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.920303+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:30.408436+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7452,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":263,"num_write":112,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'763","reported_seq":2334,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.272495+0000","last_change":"2024-09-12T18:08:33.272495+0000","last_active":"2024-09-12T18:08:33.272495+0000","last_peered":"2024-09-12T18:08:33.272495+0000","last_clean":"2024-09-12T18:08:33.272495+0000","last_became_active":"2024-09-12T17:30:00.966661+0000","last_became_peered":"2024-09-12T17:30:00.966661+0000","last_unstale":"2024-09-12T18:08:33.272495+0000","last_undegraded":"2024-09-12T18:08:33.272495+0000","last_fullsized":"2024-09-12T18:08:33.272495+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'763","last_scrub_stamp":"2024-09-12T18:08:33.272408+0000","last_deep_scrub":"264'763","last_deep_scrub_stamp":"2024-09-12T18:08:33.272408+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.272408+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:07.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'109","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.300197+0000","last_change":"2024-09-12T18:08:40.300197+0000","last_active":"2024-09-12T18:08:40.300197+0000","last_peered":"2024-09-12T18:08:40.300197+0000","last_clean":"2024-09-12T18:08:40.300197+0000","last_became_active":"2024-09-12T17:30:02.969837+0000","last_became_peered":"2024-09-12T17:30:02.969837+0000","last_unstale":"2024-09-12T18:08:40.300197+0000","last_undegraded":"2024-09-12T18:08:40.300197+0000","last_fullsized":"2024-09-12T18:08:40.300197+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-12T18:08:40.300105+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-12T18:08:40.300105+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.300105+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:02.977090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":259,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'232","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.182943+0000","last_change":"2024-09-12T18:08:17.182943+0000","last_active":"2024-09-12T18:08:17.182943+0000","last_peered":"2024-09-12T18:08:17.182943+0000","last_clean":"2024-09-12T18:08:17.182943+0000","last_became_active":"2024-09-12T17:30:28.004234+0000","last_became_peered":"2024-09-12T17:30:28.004234+0000","last_unstale":"2024-09-12T18:08:17.182943+0000","last_undegraded":"2024-09-12T18:08:17.182943+0000","last_fullsized":"2024-09-12T18:08:17.182943+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-09-12T18:08:17.182861+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-09-12T18:08:17.182861+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.182861+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:07.554492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":779,"num_write":354,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'204","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.486827+0000","last_change":"2024-09-12T18:08:15.486827+0000","last_active":"2024-09-12T18:08:15.486827+0000","last_peered":"2024-09-12T18:08:15.486827+0000","last_clean":"2024-09-12T18:08:15.486827+0000","last_became_active":"2024-09-12T17:29:52.951442+0000","last_became_peered":"2024-09-12T17:29:52.951442+0000","last_unstale":"2024-09-12T18:08:15.486827+0000","last_undegraded":"2024-09-12T18:08:15.486827+0000","last_fullsized":"2024-09-12T18:08:15.486827+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'204","last_scrub_stamp":"2024-09-12T18:08:15.486681+0000","last_deep_scrub":"264'204","last_deep_scrub_stamp":"2024-09-12T18:08:15.486681+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.486681+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:50.751228+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6462010,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":476,"num_read_kb":16166,"num_write":931,"num_write_kb":36148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.427263+0000","last_change":"2024-09-12T18:08:22.427263+0000","last_active":"2024-09-12T18:08:22.427263+0000","last_peered":"2024-09-12T18:08:22.427263+0000","last_clean":"2024-09-12T18:08:22.427263+0000","last_became_active":"2024-09-12T17:29:56.955948+0000","last_became_peered":"2024-09-12T17:29:56.955948+0000","last_unstale":"2024-09-12T18:08:22.427263+0000","last_undegraded":"2024-09-12T18:08:22.427263+0000","last_fullsized":"2024-09-12T18:08:22.427263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:22.427174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:22.427174+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.427174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:36.201160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'206","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.233740+0000","last_change":"2024-09-12T18:08:29.233740+0000","last_active":"2024-09-12T18:08:29.233740+0000","last_peered":"2024-09-12T18:08:29.233740+0000","last_clean":"2024-09-12T18:08:29.233740+0000","last_became_active":"2024-09-12T17:29:58.957183+0000","last_became_peered":"2024-09-12T17:29:58.957183+0000","last_unstale":"2024-09-12T18:08:29.233740+0000","last_undegraded":"2024-09-12T18:08:29.233740+0000","last_fullsized":"2024-09-12T18:08:29.233740+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T18:08:29.233610+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T18:08:29.233610+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.233610+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:55.220846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13747,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":267,"num_read_kb":394,"num_write":132,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.401175+0000","last_change":"2024-09-12T18:08:27.401175+0000","last_active":"2024-09-12T18:08:27.401175+0000","last_peered":"2024-09-12T18:08:27.401175+0000","last_clean":"2024-09-12T18:08:27.401175+0000","last_became_active":"2024-09-12T17:30:00.958049+0000","last_became_peered":"2024-09-12T17:30:00.958049+0000","last_unstale":"2024-09-12T18:08:27.401175+0000","last_undegraded":"2024-09-12T18:08:27.401175+0000","last_fullsized":"2024-09-12T18:08:27.401175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.401089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.401089+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.401089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:58.968537+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'147","reported_seq":659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.242927+0000","last_change":"2024-09-12T18:08:35.242927+0000","last_active":"2024-09-12T18:08:35.242927+0000","last_peered":"2024-09-12T18:08:35.242927+0000","last_clean":"2024-09-12T18:08:35.242927+0000","last_became_active":"2024-09-12T17:30:02.970095+0000","last_became_peered":"2024-09-12T17:30:02.970095+0000","last_unstale":"2024-09-12T18:08:35.242927+0000","last_undegraded":"2024-09-12T18:08:35.242927+0000","last_fullsized":"2024-09-12T18:08:35.242927+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T18:08:35.242847+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T18:08:35.242847+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.242847+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:12.452660+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":173,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'179","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.670165+0000","last_change":"2024-09-12T18:08:14.670165+0000","last_active":"2024-09-12T18:08:14.670165+0000","last_peered":"2024-09-12T18:08:14.670165+0000","last_clean":"2024-09-12T18:08:14.670165+0000","last_became_active":"2024-09-12T17:29:54.956850+0000","last_became_peered":"2024-09-12T17:29:54.956850+0000","last_unstale":"2024-09-12T18:08:14.670165+0000","last_undegraded":"2024-09-12T18:08:14.670165+0000","last_fullsized":"2024-09-12T18:08:14.670165+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:08:14.670074+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:08:14.670074+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.670074+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:21.265957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":712,"num_read_kb":607,"num_write":242,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'175","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.059924+0000","last_change":"2024-09-12T18:08:12.059924+0000","last_active":"2024-09-12T18:08:12.059924+0000","last_peered":"2024-09-12T18:08:12.059924+0000","last_clean":"2024-09-12T18:08:12.059924+0000","last_became_active":"2024-09-12T17:29:52.958919+0000","last_became_peered":"2024-09-12T17:29:52.958919+0000","last_unstale":"2024-09-12T18:08:12.059924+0000","last_undegraded":"2024-09-12T18:08:12.059924+0000","last_fullsized":"2024-09-12T18:08:12.059924+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'175","last_scrub_stamp":"2024-09-12T18:08:12.059737+0000","last_deep_scrub":"264'175","last_deep_scrub_stamp":"2024-09-12T18:08:12.059737+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.059737+0000","objects_scrubbed":11,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:59.307212+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7687392,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":325,"num_read_kb":13812,"num_write":937,"num_write_kb":31717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.435944+0000","last_change":"2024-09-12T18:08:25.435944+0000","last_active":"2024-09-12T18:08:25.435944+0000","last_peered":"2024-09-12T18:08:25.435944+0000","last_clean":"2024-09-12T18:08:25.435944+0000","last_became_active":"2024-09-12T17:29:56.955288+0000","last_became_peered":"2024-09-12T17:29:56.955288+0000","last_unstale":"2024-09-12T18:08:25.435944+0000","last_undegraded":"2024-09-12T18:08:25.435944+0000","last_fullsized":"2024-09-12T18:08:25.435944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.435793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.435793+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.435793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:42.632232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'147","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.851189+0000","last_change":"2024-09-12T18:08:34.851189+0000","last_active":"2024-09-12T18:08:34.851189+0000","last_peered":"2024-09-12T18:08:34.851189+0000","last_clean":"2024-09-12T18:08:34.851189+0000","last_became_active":"2024-09-12T17:29:58.952878+0000","last_became_peered":"2024-09-12T17:29:58.952878+0000","last_unstale":"2024-09-12T18:08:34.851189+0000","last_undegraded":"2024-09-12T18:08:34.851189+0000","last_fullsized":"2024-09-12T18:08:34.851189+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T18:08:34.851076+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T18:08:34.851076+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.851076+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:51.169705+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":250,"num_write":156,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.272509+0000","last_change":"2024-09-12T18:08:36.272509+0000","last_active":"2024-09-12T18:08:36.272509+0000","last_peered":"2024-09-12T18:08:36.272509+0000","last_clean":"2024-09-12T18:08:36.272509+0000","last_became_active":"2024-09-12T17:30:00.970668+0000","last_became_peered":"2024-09-12T17:30:00.970668+0000","last_unstale":"2024-09-12T18:08:36.272509+0000","last_undegraded":"2024-09-12T18:08:36.272509+0000","last_fullsized":"2024-09-12T18:08:36.272509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:36.272414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:36.272414+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.272414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:46.637903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'142","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.925568+0000","last_change":"2024-09-12T18:08:42.925568+0000","last_active":"2024-09-12T18:08:42.925568+0000","last_peered":"2024-09-12T18:08:42.925568+0000","last_clean":"2024-09-12T18:08:42.925568+0000","last_became_active":"2024-09-12T17:30:02.964125+0000","last_became_peered":"2024-09-12T17:30:02.964125+0000","last_unstale":"2024-09-12T18:08:42.925568+0000","last_undegraded":"2024-09-12T18:08:42.925568+0000","last_fullsized":"2024-09-12T18:08:42.925568+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:08:42.925483+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:08:42.925483+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.925483+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:46.935130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":200,"num_read_kb":186,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'124","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.708252+0000","last_change":"2024-09-12T18:08:13.708252+0000","last_active":"2024-09-12T18:08:13.708252+0000","last_peered":"2024-09-12T18:08:13.708252+0000","last_clean":"2024-09-12T18:08:13.708252+0000","last_became_active":"2024-09-12T17:29:54.956019+0000","last_became_peered":"2024-09-12T17:29:54.956019+0000","last_unstale":"2024-09-12T18:08:13.708252+0000","last_undegraded":"2024-09-12T18:08:13.708252+0000","last_fullsized":"2024-09-12T18:08:13.708252+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-12T18:08:13.708174+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-12T18:08:13.708174+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.708174+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:20.307396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":560,"num_read_kb":466,"num_write":179,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'197","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.052727+0000","last_change":"2024-09-12T18:08:11.052727+0000","last_active":"2024-09-12T18:08:11.052727+0000","last_peered":"2024-09-12T18:08:11.052727+0000","last_clean":"2024-09-12T18:08:11.052727+0000","last_became_active":"2024-09-12T17:29:52.951013+0000","last_became_peered":"2024-09-12T17:29:52.951013+0000","last_unstale":"2024-09-12T18:08:11.052727+0000","last_undegraded":"2024-09-12T18:08:11.052727+0000","last_fullsized":"2024-09-12T18:08:11.052727+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'197","last_scrub_stamp":"2024-09-12T18:08:11.052631+0000","last_deep_scrub":"264'197","last_deep_scrub_stamp":"2024-09-12T18:08:11.052631+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.052631+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:32.972110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":90183,"num_write":908,"num_write_kb":29071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.316309+0000","last_change":"2024-09-12T18:08:25.316309+0000","last_active":"2024-09-12T18:08:25.316309+0000","last_peered":"2024-09-12T18:08:25.316309+0000","last_clean":"2024-09-12T18:08:25.316309+0000","last_became_active":"2024-09-12T17:29:56.959436+0000","last_became_peered":"2024-09-12T17:29:56.959436+0000","last_unstale":"2024-09-12T18:08:25.316309+0000","last_undegraded":"2024-09-12T18:08:25.316309+0000","last_fullsized":"2024-09-12T18:08:25.316309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.316225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.316225+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.316225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:40.776025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'149","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.346397+0000","last_change":"2024-09-12T18:08:35.346397+0000","last_active":"2024-09-12T18:08:35.346397+0000","last_peered":"2024-09-12T18:08:35.346397+0000","last_clean":"2024-09-12T18:08:35.346397+0000","last_became_active":"2024-09-12T17:29:58.954548+0000","last_became_peered":"2024-09-12T17:29:58.954548+0000","last_unstale":"2024-09-12T18:08:35.346397+0000","last_undegraded":"2024-09-12T18:08:35.346397+0000","last_fullsized":"2024-09-12T18:08:35.346397+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T18:08:35.346304+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T18:08:35.346304+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.346304+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:50.124242+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12489,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'733","reported_seq":2386,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.392882+0000","last_change":"2024-09-12T18:08:28.392882+0000","last_active":"2024-09-12T18:08:28.392882+0000","last_peered":"2024-09-12T18:08:28.392882+0000","last_clean":"2024-09-12T18:08:28.392882+0000","last_became_active":"2024-09-12T17:30:00.960402+0000","last_became_peered":"2024-09-12T17:30:00.960402+0000","last_unstale":"2024-09-12T18:08:28.392882+0000","last_undegraded":"2024-09-12T18:08:28.392882+0000","last_fullsized":"2024-09-12T18:08:28.392882+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'733","last_scrub_stamp":"2024-09-12T18:08:28.392750+0000","last_deep_scrub":"264'733","last_deep_scrub_stamp":"2024-09-12T18:08:28.392750+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.392750+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:15.282104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'98","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.233381+0000","last_change":"2024-09-12T18:08:34.233381+0000","last_active":"2024-09-12T18:08:34.233381+0000","last_peered":"2024-09-12T18:08:34.233381+0000","last_clean":"2024-09-12T18:08:34.233381+0000","last_became_active":"2024-09-12T17:30:02.969617+0000","last_became_peered":"2024-09-12T17:30:02.969617+0000","last_unstale":"2024-09-12T18:08:34.233381+0000","last_undegraded":"2024-09-12T18:08:34.233381+0000","last_fullsized":"2024-09-12T18:08:34.233381+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'98","last_scrub_stamp":"2024-09-12T18:08:34.233267+0000","last_deep_scrub":"264'98","last_deep_scrub_stamp":"2024-09-12T18:08:34.233267+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.233267+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:39.388855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":242,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'118","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.709781+0000","last_change":"2024-09-12T18:08:16.709781+0000","last_active":"2024-09-12T18:08:16.709781+0000","last_peered":"2024-09-12T18:08:16.709781+0000","last_clean":"2024-09-12T18:08:16.709781+0000","last_became_active":"2024-09-12T17:29:54.958362+0000","last_became_peered":"2024-09-12T17:29:54.958362+0000","last_unstale":"2024-09-12T18:08:16.709781+0000","last_undegraded":"2024-09-12T18:08:16.709781+0000","last_fullsized":"2024-09-12T18:08:16.709781+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-12T18:08:16.709692+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-12T18:08:16.709692+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.709692+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:36.417665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":415,"num_write":164,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'162","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.276109+0000","last_change":"2024-09-12T18:08:11.276109+0000","last_active":"2024-09-12T18:08:11.276109+0000","last_peered":"2024-09-12T18:08:11.276109+0000","last_clean":"2024-09-12T18:08:11.276109+0000","last_became_active":"2024-09-12T17:30:28.005099+0000","last_became_peered":"2024-09-12T17:30:28.005099+0000","last_unstale":"2024-09-12T18:08:11.276109+0000","last_undegraded":"2024-09-12T18:08:11.276109+0000","last_fullsized":"2024-09-12T18:08:11.276109+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T18:08:11.276007+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T18:08:11.276007+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.276007+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:24.791440+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":6854,"num_write":853,"num_write_kb":33010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1455,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.457567+0000","last_change":"2024-09-12T18:08:31.457567+0000","last_active":"2024-09-12T18:08:31.457567+0000","last_peered":"2024-09-12T18:08:31.457567+0000","last_clean":"2024-09-12T18:08:31.457567+0000","last_became_active":"2024-09-12T17:29:56.955321+0000","last_became_peered":"2024-09-12T17:29:56.955321+0000","last_unstale":"2024-09-12T18:08:31.457567+0000","last_undegraded":"2024-09-12T18:08:31.457567+0000","last_fullsized":"2024-09-12T18:08:31.457567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:08:31.457480+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:08:31.457480+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.457480+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:58.605157+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":954,"num_read_kb":954,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'84","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.934809+0000","last_change":"2024-09-12T18:08:32.934809+0000","last_active":"2024-09-12T18:08:32.934809+0000","last_peered":"2024-09-12T18:08:32.934809+0000","last_clean":"2024-09-12T18:08:32.934809+0000","last_became_active":"2024-09-12T17:29:58.978480+0000","last_became_peered":"2024-09-12T17:29:58.978480+0000","last_unstale":"2024-09-12T18:08:32.934809+0000","last_undegraded":"2024-09-12T18:08:32.934809+0000","last_fullsized":"2024-09-12T18:08:32.934809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T18:08:32.934717+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T18:08:32.934717+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.934717+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:34.102936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'759","reported_seq":4536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.999531+0000","last_change":"2024-09-12T18:08:28.999531+0000","last_active":"2024-09-12T18:08:28.999531+0000","last_peered":"2024-09-12T18:08:28.999531+0000","last_clean":"2024-09-12T18:08:28.999531+0000","last_became_active":"2024-09-12T17:30:00.959015+0000","last_became_peered":"2024-09-12T17:30:00.959015+0000","last_unstale":"2024-09-12T18:08:28.999531+0000","last_undegraded":"2024-09-12T18:08:28.999531+0000","last_fullsized":"2024-09-12T18:08:28.999531+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'759","last_scrub_stamp":"2024-09-12T18:08:28.999434+0000","last_deep_scrub":"264'759","last_deep_scrub_stamp":"2024-09-12T18:08:28.999434+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.999434+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:52.947246+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'126","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:01.966308+0000","last_change":"2024-09-12T17:30:02.972327+0000","last_active":"2024-09-12T18:06:01.966308+0000","last_peered":"2024-09-12T18:06:01.966308+0000","last_clean":"2024-09-12T18:06:01.966308+0000","last_became_active":"2024-09-12T17:30:02.972020+0000","last_became_peered":"2024-09-12T17:30:02.972020+0000","last_unstale":"2024-09-12T18:06:01.966308+0000","last_undegraded":"2024-09-12T18:06:01.966308+0000","last_fullsized":"2024-09-12T18:06:01.966308+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.485323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":156,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.252876+0000","last_change":"2024-09-12T18:08:21.252876+0000","last_active":"2024-09-12T18:08:21.252876+0000","last_peered":"2024-09-12T18:08:21.252876+0000","last_clean":"2024-09-12T18:08:21.252876+0000","last_became_active":"2024-09-12T17:29:54.950966+0000","last_became_peered":"2024-09-12T17:29:54.950966+0000","last_unstale":"2024-09-12T18:08:21.252876+0000","last_undegraded":"2024-09-12T18:08:21.252876+0000","last_fullsized":"2024-09-12T18:08:21.252876+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T18:08:21.252794+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T18:08:21.252794+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.252794+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:22.803219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":955,"num_read_kb":788,"num_write":339,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'177","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.082011+0000","last_change":"2024-09-12T18:08:09.082011+0000","last_active":"2024-09-12T18:08:09.082011+0000","last_peered":"2024-09-12T18:08:09.082011+0000","last_clean":"2024-09-12T18:08:09.082011+0000","last_became_active":"2024-09-12T17:29:52.948591+0000","last_became_peered":"2024-09-12T17:29:52.948591+0000","last_unstale":"2024-09-12T18:08:09.082011+0000","last_undegraded":"2024-09-12T18:08:09.082011+0000","last_fullsized":"2024-09-12T18:08:09.082011+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:08:09.081909+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:08:09.081909+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.081909+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:16.244554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1260936,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":2968,"num_write":842,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.857509+0000","last_change":"2024-09-12T18:08:28.857509+0000","last_active":"2024-09-12T18:08:28.857509+0000","last_peered":"2024-09-12T18:08:28.857509+0000","last_clean":"2024-09-12T18:08:28.857509+0000","last_became_active":"2024-09-12T17:29:56.953198+0000","last_became_peered":"2024-09-12T17:29:56.953198+0000","last_unstale":"2024-09-12T18:08:28.857509+0000","last_undegraded":"2024-09-12T18:08:28.857509+0000","last_fullsized":"2024-09-12T18:08:28.857509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:28.857430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:28.857430+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.857430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:00.350416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'199","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.502122+0000","last_change":"2024-09-12T18:08:38.502122+0000","last_active":"2024-09-12T18:08:38.502122+0000","last_peered":"2024-09-12T18:08:38.502122+0000","last_clean":"2024-09-12T18:08:38.502122+0000","last_became_active":"2024-09-12T17:29:58.956828+0000","last_became_peered":"2024-09-12T17:29:58.956828+0000","last_unstale":"2024-09-12T18:08:38.502122+0000","last_undegraded":"2024-09-12T18:08:38.502122+0000","last_fullsized":"2024-09-12T18:08:38.502122+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-12T18:08:38.502014+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-12T18:08:38.502014+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.502014+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:05.976827+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10697,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":841,"num_read_kb":909,"num_write":1328,"num_write_kb":1209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488582,"num_omap_keys":1128,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.026110+0000","last_change":"2024-09-12T18:08:27.026110+0000","last_active":"2024-09-12T18:08:27.026110+0000","last_peered":"2024-09-12T18:08:27.026110+0000","last_clean":"2024-09-12T18:08:27.026110+0000","last_became_active":"2024-09-12T17:30:00.963117+0000","last_became_peered":"2024-09-12T17:30:00.963117+0000","last_unstale":"2024-09-12T18:08:27.026110+0000","last_undegraded":"2024-09-12T18:08:27.026110+0000","last_fullsized":"2024-09-12T18:08:27.026110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.026012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.026012+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.026012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:43.754740+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'119","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.239747+0000","last_change":"2024-09-12T18:08:36.239747+0000","last_active":"2024-09-12T18:08:36.239747+0000","last_peered":"2024-09-12T18:08:36.239747+0000","last_clean":"2024-09-12T18:08:36.239747+0000","last_became_active":"2024-09-12T17:30:02.963368+0000","last_became_peered":"2024-09-12T17:30:02.963368+0000","last_unstale":"2024-09-12T18:08:36.239747+0000","last_undegraded":"2024-09-12T18:08:36.239747+0000","last_fullsized":"2024-09-12T18:08:36.239747+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T18:08:36.239656+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T18:08:36.239656+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.239656+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:33.522946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":267,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'271","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.085593+0000","last_change":"2024-09-12T18:08:18.085593+0000","last_active":"2024-09-12T18:08:18.085593+0000","last_peered":"2024-09-12T18:08:18.085593+0000","last_clean":"2024-09-12T18:08:18.085593+0000","last_became_active":"2024-09-12T17:29:54.960486+0000","last_became_peered":"2024-09-12T17:29:54.960486+0000","last_unstale":"2024-09-12T18:08:18.085593+0000","last_undegraded":"2024-09-12T18:08:18.085593+0000","last_fullsized":"2024-09-12T18:08:18.085593+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-12T18:08:18.085509+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-12T18:08:18.085509+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.085509+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:18.452979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1268,"num_write":469,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.670133+0000","last_change":"2024-09-12T18:08:10.670133+0000","last_active":"2024-09-12T18:08:10.670133+0000","last_peered":"2024-09-12T18:08:10.670133+0000","last_clean":"2024-09-12T18:08:10.670133+0000","last_became_active":"2024-09-12T17:29:36.163604+0000","last_became_peered":"2024-09-12T17:29:36.163604+0000","last_unstale":"2024-09-12T18:08:10.670133+0000","last_undegraded":"2024-09-12T18:08:10.670133+0000","last_fullsized":"2024-09-12T18:08:10.670133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T18:08:10.670050+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T18:08:10.670050+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.670050+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:28.217846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.564490+0000","last_change":"2024-09-12T18:08:09.564490+0000","last_active":"2024-09-12T18:08:09.564490+0000","last_peered":"2024-09-12T18:08:09.564490+0000","last_clean":"2024-09-12T18:08:09.564490+0000","last_became_active":"2024-09-12T17:29:41.963643+0000","last_became_peered":"2024-09-12T17:29:41.963643+0000","last_unstale":"2024-09-12T18:08:09.564490+0000","last_undegraded":"2024-09-12T18:08:09.564490+0000","last_fullsized":"2024-09-12T18:08:09.564490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:09.564408+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:09.564408+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.564408+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:57.121488+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00056994999999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'207","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.049333+0000","last_change":"2024-09-12T18:08:10.049333+0000","last_active":"2024-09-12T18:08:10.049333+0000","last_peered":"2024-09-12T18:08:10.049333+0000","last_clean":"2024-09-12T18:08:10.049333+0000","last_became_active":"2024-09-12T17:29:52.954839+0000","last_became_peered":"2024-09-12T17:29:52.954839+0000","last_unstale":"2024-09-12T18:08:10.049333+0000","last_undegraded":"2024-09-12T18:08:10.049333+0000","last_fullsized":"2024-09-12T18:08:10.049333+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:10.049250+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:10.049250+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.049250+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:44.893531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395904,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":449,"num_read_kb":3374,"num_write":1041,"num_write_kb":36567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.756334+0000","last_change":"2024-09-12T18:08:27.756334+0000","last_active":"2024-09-12T18:08:27.756334+0000","last_peered":"2024-09-12T18:08:27.756334+0000","last_clean":"2024-09-12T18:08:27.756334+0000","last_became_active":"2024-09-12T17:29:56.955260+0000","last_became_peered":"2024-09-12T17:29:56.955260+0000","last_unstale":"2024-09-12T18:08:27.756334+0000","last_undegraded":"2024-09-12T18:08:27.756334+0000","last_fullsized":"2024-09-12T18:08:27.756334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.756236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.756236+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.756236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:23.735166+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'306","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.504138+0000","last_change":"2024-09-12T18:08:34.504138+0000","last_active":"2024-09-12T18:08:34.504138+0000","last_peered":"2024-09-12T18:08:34.504138+0000","last_clean":"2024-09-12T18:08:34.504138+0000","last_became_active":"2024-09-12T17:29:58.954205+0000","last_became_peered":"2024-09-12T17:29:58.954205+0000","last_unstale":"2024-09-12T18:08:34.504138+0000","last_undegraded":"2024-09-12T18:08:34.504138+0000","last_fullsized":"2024-09-12T18:08:34.504138+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-12T18:08:34.504033+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-12T18:08:34.504033+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.504033+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:58.633159+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17428,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":763,"num_write":498,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106664,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.260603+0000","last_change":"2024-09-12T18:08:34.260603+0000","last_active":"2024-09-12T18:08:34.260603+0000","last_peered":"2024-09-12T18:08:34.260603+0000","last_clean":"2024-09-12T18:08:34.260603+0000","last_became_active":"2024-09-12T17:30:00.964241+0000","last_became_peered":"2024-09-12T17:30:00.964241+0000","last_unstale":"2024-09-12T18:08:34.260603+0000","last_undegraded":"2024-09-12T18:08:34.260603+0000","last_fullsized":"2024-09-12T18:08:34.260603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:34.260510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:34.260510+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.260510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:24.121752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'223","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.023190+0000","last_change":"2024-09-12T18:08:38.023190+0000","last_active":"2024-09-12T18:08:38.023190+0000","last_peered":"2024-09-12T18:08:38.023190+0000","last_clean":"2024-09-12T18:08:38.023190+0000","last_became_active":"2024-09-12T17:30:02.963890+0000","last_became_peered":"2024-09-12T17:30:02.963890+0000","last_unstale":"2024-09-12T18:08:38.023190+0000","last_undegraded":"2024-09-12T18:08:38.023190+0000","last_fullsized":"2024-09-12T18:08:38.023190+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:08:38.023090+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:08:38.023090+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.023090+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:44.300861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":552,"num_write":485,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'385","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.134748+0000","last_change":"2024-09-12T18:08:18.134748+0000","last_active":"2024-09-12T18:08:18.134748+0000","last_peered":"2024-09-12T18:08:18.134748+0000","last_clean":"2024-09-12T18:08:18.134748+0000","last_became_active":"2024-09-12T17:29:54.944624+0000","last_became_peered":"2024-09-12T17:29:54.944624+0000","last_unstale":"2024-09-12T18:08:18.134748+0000","last_undegraded":"2024-09-12T18:08:18.134748+0000","last_fullsized":"2024-09-12T18:08:18.134748+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T18:08:18.134658+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T18:08:18.134658+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.134658+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:17.271829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1668,"num_read_kb":1443,"num_write":651,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7559,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.685327+0000","last_change":"2024-09-12T18:08:12.685327+0000","last_active":"2024-09-12T18:08:12.685327+0000","last_peered":"2024-09-12T18:08:12.685327+0000","last_clean":"2024-09-12T18:08:12.685327+0000","last_became_active":"2024-09-12T17:29:41.963499+0000","last_became_peered":"2024-09-12T17:29:41.963499+0000","last_unstale":"2024-09-12T18:08:12.685327+0000","last_undegraded":"2024-09-12T18:08:12.685327+0000","last_fullsized":"2024-09-12T18:08:12.685327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:12.685224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:12.685224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.685224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:53.962768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470655,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'149","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:07.126035+0000","last_change":"2024-09-12T18:08:07.126035+0000","last_active":"2024-09-12T18:08:07.126035+0000","last_peered":"2024-09-12T18:08:07.126035+0000","last_clean":"2024-09-12T18:08:07.126035+0000","last_became_active":"2024-09-12T17:29:52.949339+0000","last_became_peered":"2024-09-12T17:29:52.949339+0000","last_unstale":"2024-09-12T18:08:07.126035+0000","last_undegraded":"2024-09-12T18:08:07.126035+0000","last_fullsized":"2024-09-12T18:08:07.126035+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T18:08:07.125919+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T18:08:07.125919+0000","last_clean_scrub_stamp":"2024-09-12T18:08:07.125919+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:14.630758+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":3075,"num_write":751,"num_write_kb":23555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.488074+0000","last_change":"2024-09-12T18:08:30.488074+0000","last_active":"2024-09-12T18:08:30.488074+0000","last_peered":"2024-09-12T18:08:30.488074+0000","last_clean":"2024-09-12T18:08:30.488074+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:08:30.488074+0000","last_undegraded":"2024-09-12T18:08:30.488074+0000","last_fullsized":"2024-09-12T18:08:30.488074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:30.487983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:30.487983+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.487983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:10.242355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'795","reported_seq":2190,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.321172+0000","last_change":"2024-09-12T18:08:29.321172+0000","last_active":"2024-09-12T18:08:29.321172+0000","last_peered":"2024-09-12T18:08:29.321172+0000","last_clean":"2024-09-12T18:08:29.321172+0000","last_became_active":"2024-09-12T17:29:58.958269+0000","last_became_peered":"2024-09-12T17:29:58.958269+0000","last_unstale":"2024-09-12T18:08:29.321172+0000","last_undegraded":"2024-09-12T18:08:29.321172+0000","last_fullsized":"2024-09-12T18:08:29.321172+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'795","last_scrub_stamp":"2024-09-12T18:08:29.321029+0000","last_deep_scrub":"264'795","last_deep_scrub_stamp":"2024-09-12T18:08:29.321029+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.321029+0000","objects_scrubbed":12,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:42.926498+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37829,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1137,"num_read_kb":1322,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.950826+0000","last_change":"2024-09-12T18:08:37.950826+0000","last_active":"2024-09-12T18:08:37.950826+0000","last_peered":"2024-09-12T18:08:37.950826+0000","last_clean":"2024-09-12T18:08:37.950826+0000","last_became_active":"2024-09-12T17:30:00.957628+0000","last_became_peered":"2024-09-12T17:30:00.957628+0000","last_unstale":"2024-09-12T18:08:37.950826+0000","last_undegraded":"2024-09-12T18:08:37.950826+0000","last_fullsized":"2024-09-12T18:08:37.950826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:37.950712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:37.950712+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.950712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:19.553228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'138","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.236879+0000","last_change":"2024-09-12T18:08:37.236879+0000","last_active":"2024-09-12T18:08:37.236879+0000","last_peered":"2024-09-12T18:08:37.236879+0000","last_clean":"2024-09-12T18:08:37.236879+0000","last_became_active":"2024-09-12T17:30:02.960109+0000","last_became_peered":"2024-09-12T17:30:02.960109+0000","last_unstale":"2024-09-12T18:08:37.236879+0000","last_undegraded":"2024-09-12T18:08:37.236879+0000","last_fullsized":"2024-09-12T18:08:37.236879+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-12T18:08:37.236794+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-12T18:08:37.236794+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.236794+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:16.611769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":318,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'88","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.241855+0000","last_change":"2024-09-12T18:08:18.241855+0000","last_active":"2024-09-12T18:08:18.241855+0000","last_peered":"2024-09-12T18:08:18.241855+0000","last_clean":"2024-09-12T18:08:18.241855+0000","last_became_active":"2024-09-12T17:29:54.958310+0000","last_became_peered":"2024-09-12T17:29:54.958310+0000","last_unstale":"2024-09-12T18:08:18.241855+0000","last_undegraded":"2024-09-12T18:08:18.241855+0000","last_fullsized":"2024-09-12T18:08:18.241855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'88","last_scrub_stamp":"2024-09-12T18:08:18.241756+0000","last_deep_scrub":"264'88","last_deep_scrub_stamp":"2024-09-12T18:08:18.241756+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.241756+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:31.581719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":367,"num_read_kb":311,"num_write":135,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.255313+0000","last_change":"2024-09-12T18:08:08.255313+0000","last_active":"2024-09-12T18:08:08.255313+0000","last_peered":"2024-09-12T18:08:08.255313+0000","last_clean":"2024-09-12T18:08:08.255313+0000","last_became_active":"2024-09-12T17:29:42.064972+0000","last_became_peered":"2024-09-12T17:29:42.064972+0000","last_unstale":"2024-09-12T18:08:08.255313+0000","last_undegraded":"2024-09-12T18:08:08.255313+0000","last_fullsized":"2024-09-12T18:08:08.255313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:08.255224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:08.255224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.255224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:11.379409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047741400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'211","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.313282+0000","last_change":"2024-09-12T18:08:09.313282+0000","last_active":"2024-09-12T18:08:09.313282+0000","last_peered":"2024-09-12T18:08:09.313282+0000","last_clean":"2024-09-12T18:08:09.313282+0000","last_became_active":"2024-09-12T17:29:52.949301+0000","last_became_peered":"2024-09-12T17:29:52.949301+0000","last_unstale":"2024-09-12T18:08:09.313282+0000","last_undegraded":"2024-09-12T18:08:09.313282+0000","last_fullsized":"2024-09-12T18:08:09.313282+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-09-12T18:08:09.313149+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-09-12T18:08:09.313149+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.313149+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:08.195813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":2667,"num_write":1034,"num_write_kb":7887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.462126+0000","last_change":"2024-09-12T18:08:21.462126+0000","last_active":"2024-09-12T18:08:21.462126+0000","last_peered":"2024-09-12T18:08:21.462126+0000","last_clean":"2024-09-12T18:08:21.462126+0000","last_became_active":"2024-09-12T17:29:56.956623+0000","last_became_peered":"2024-09-12T17:29:56.956623+0000","last_unstale":"2024-09-12T18:08:21.462126+0000","last_undegraded":"2024-09-12T18:08:21.462126+0000","last_fullsized":"2024-09-12T18:08:21.462126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:21.462035+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:21.462035+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.462035+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.681426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'219","reported_seq":1220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.888279+0000","last_change":"2024-09-12T18:08:35.888279+0000","last_active":"2024-09-12T18:08:35.888279+0000","last_peered":"2024-09-12T18:08:35.888279+0000","last_clean":"2024-09-12T18:08:35.888279+0000","last_became_active":"2024-09-12T17:29:58.980697+0000","last_became_peered":"2024-09-12T17:29:58.980697+0000","last_unstale":"2024-09-12T18:08:35.888279+0000","last_undegraded":"2024-09-12T18:08:35.888279+0000","last_fullsized":"2024-09-12T18:08:35.888279+0000","mapping_epoch":30,"log_start":"264'201","ondisk_log_start":"264'201","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-12T18:08:35.888176+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-12T18:08:35.888176+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.888176+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":201,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:09.387384+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":123,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.275810+0000","last_change":"2024-09-12T18:08:35.275810+0000","last_active":"2024-09-12T18:08:35.275810+0000","last_peered":"2024-09-12T18:08:35.275810+0000","last_clean":"2024-09-12T18:08:35.275810+0000","last_became_active":"2024-09-12T17:30:00.968468+0000","last_became_peered":"2024-09-12T17:30:00.968468+0000","last_unstale":"2024-09-12T18:08:35.275810+0000","last_undegraded":"2024-09-12T18:08:35.275810+0000","last_fullsized":"2024-09-12T18:08:35.275810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:35.275712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:35.275712+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.275712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:20.338020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'252","reported_seq":852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.953421+0000","last_change":"2024-09-12T18:08:43.953421+0000","last_active":"2024-09-12T18:08:43.953421+0000","last_peered":"2024-09-12T18:08:43.953421+0000","last_clean":"2024-09-12T18:08:43.953421+0000","last_became_active":"2024-09-12T17:30:02.966910+0000","last_became_peered":"2024-09-12T17:30:02.966910+0000","last_unstale":"2024-09-12T18:08:43.953421+0000","last_undegraded":"2024-09-12T18:08:43.953421+0000","last_fullsized":"2024-09-12T18:08:43.953421+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'252","last_scrub_stamp":"2024-09-12T18:08:43.953338+0000","last_deep_scrub":"264'252","last_deep_scrub_stamp":"2024-09-12T18:08:43.953338+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.953338+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:00.374909+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":529,"num_write":537,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'112","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.211065+0000","last_change":"2024-09-12T18:08:17.211065+0000","last_active":"2024-09-12T18:08:17.211065+0000","last_peered":"2024-09-12T18:08:17.211065+0000","last_clean":"2024-09-12T18:08:17.211065+0000","last_became_active":"2024-09-12T17:29:54.948402+0000","last_became_peered":"2024-09-12T17:29:54.948402+0000","last_unstale":"2024-09-12T18:08:17.211065+0000","last_undegraded":"2024-09-12T18:08:17.211065+0000","last_fullsized":"2024-09-12T18:08:17.211065+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-12T18:08:17.210956+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-12T18:08:17.210956+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.210956+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:48.357477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":452,"num_write":172,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.547679+0000","last_change":"2024-09-12T18:08:10.547679+0000","last_active":"2024-09-12T18:08:10.547679+0000","last_peered":"2024-09-12T18:08:10.547679+0000","last_clean":"2024-09-12T18:08:10.547679+0000","last_became_active":"2024-09-12T17:29:41.961122+0000","last_became_peered":"2024-09-12T17:29:41.961122+0000","last_unstale":"2024-09-12T18:08:10.547679+0000","last_undegraded":"2024-09-12T18:08:10.547679+0000","last_fullsized":"2024-09-12T18:08:10.547679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:10.547560+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:10.547560+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.547560+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:55.070358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00095277999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'244","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.748940+0000","last_change":"2024-09-12T18:08:08.748940+0000","last_active":"2024-09-12T18:08:08.748940+0000","last_peered":"2024-09-12T18:08:08.748940+0000","last_clean":"2024-09-12T18:08:08.748940+0000","last_became_active":"2024-09-12T17:29:52.958406+0000","last_became_peered":"2024-09-12T17:29:52.958406+0000","last_unstale":"2024-09-12T18:08:08.748940+0000","last_undegraded":"2024-09-12T18:08:08.748940+0000","last_fullsized":"2024-09-12T18:08:08.748940+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'244","last_scrub_stamp":"2024-09-12T18:08:08.748824+0000","last_deep_scrub":"264'244","last_deep_scrub_stamp":"2024-09-12T18:08:08.748824+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.748824+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:58.654869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":569,"num_read_kb":48737,"num_write":1100,"num_write_kb":63490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.237589+0000","last_change":"2024-09-12T18:08:26.237589+0000","last_active":"2024-09-12T18:08:26.237589+0000","last_peered":"2024-09-12T18:08:26.237589+0000","last_clean":"2024-09-12T18:08:26.237589+0000","last_became_active":"2024-09-12T17:29:56.954018+0000","last_became_peered":"2024-09-12T17:29:56.954018+0000","last_unstale":"2024-09-12T18:08:26.237589+0000","last_undegraded":"2024-09-12T18:08:26.237589+0000","last_fullsized":"2024-09-12T18:08:26.237589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:26.237500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:26.237500+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.237500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:30.090296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'118","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.963654+0000","last_change":"2024-09-12T18:08:30.963654+0000","last_active":"2024-09-12T18:08:30.963654+0000","last_peered":"2024-09-12T18:08:30.963654+0000","last_clean":"2024-09-12T18:08:30.963654+0000","last_became_active":"2024-09-12T17:29:58.953909+0000","last_became_peered":"2024-09-12T17:29:58.953909+0000","last_unstale":"2024-09-12T18:08:30.963654+0000","last_undegraded":"2024-09-12T18:08:30.963654+0000","last_fullsized":"2024-09-12T18:08:30.963654+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-12T18:08:30.963563+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-12T18:08:30.963563+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.963563+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:58.827555+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":90,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.006228+0000","last_change":"2024-09-12T18:08:26.006228+0000","last_active":"2024-09-12T18:08:26.006228+0000","last_peered":"2024-09-12T18:08:26.006228+0000","last_clean":"2024-09-12T18:08:26.006228+0000","last_became_active":"2024-09-12T17:30:00.967279+0000","last_became_peered":"2024-09-12T17:30:00.967279+0000","last_unstale":"2024-09-12T18:08:26.006228+0000","last_undegraded":"2024-09-12T18:08:26.006228+0000","last_fullsized":"2024-09-12T18:08:26.006228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:26.006129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:26.006129+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.006129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:48.986438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'207","reported_seq":773,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.412024+0000","last_change":"2024-09-12T18:08:42.412024+0000","last_active":"2024-09-12T18:08:42.412024+0000","last_peered":"2024-09-12T18:08:42.412024+0000","last_clean":"2024-09-12T18:08:42.412024+0000","last_became_active":"2024-09-12T17:30:02.969486+0000","last_became_peered":"2024-09-12T17:30:02.969486+0000","last_unstale":"2024-09-12T18:08:42.412024+0000","last_undegraded":"2024-09-12T18:08:42.412024+0000","last_fullsized":"2024-09-12T18:08:42.412024+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:42.411931+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:42.411931+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.411931+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:03.146985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":397,"num_write":473,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'156","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.251799+0000","last_change":"2024-09-12T18:08:16.251799+0000","last_active":"2024-09-12T18:08:16.251799+0000","last_peered":"2024-09-12T18:08:16.251799+0000","last_clean":"2024-09-12T18:08:16.251799+0000","last_became_active":"2024-09-12T17:29:54.963669+0000","last_became_peered":"2024-09-12T17:29:54.963669+0000","last_unstale":"2024-09-12T18:08:16.251799+0000","last_undegraded":"2024-09-12T18:08:16.251799+0000","last_fullsized":"2024-09-12T18:08:16.251799+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-12T18:08:16.251716+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-12T18:08:16.251716+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.251716+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:44.134038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":549,"num_write":259,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'205","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.503195+0000","last_change":"2024-09-12T18:08:11.503195+0000","last_active":"2024-09-12T18:08:11.503195+0000","last_peered":"2024-09-12T18:08:11.503195+0000","last_clean":"2024-09-12T18:08:11.503195+0000","last_became_active":"2024-09-12T17:29:52.954220+0000","last_became_peered":"2024-09-12T17:29:52.954220+0000","last_unstale":"2024-09-12T18:08:11.503195+0000","last_undegraded":"2024-09-12T18:08:11.503195+0000","last_fullsized":"2024-09-12T18:08:11.503195+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'205","last_scrub_stamp":"2024-09-12T18:08:11.503069+0000","last_deep_scrub":"264'205","last_deep_scrub_stamp":"2024-09-12T18:08:11.503069+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.503069+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:14.820377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":525,"num_read_kb":74998,"num_write":1066,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.352125+0000","last_change":"2024-09-12T18:08:08.352125+0000","last_active":"2024-09-12T18:08:08.352125+0000","last_peered":"2024-09-12T18:08:08.352125+0000","last_clean":"2024-09-12T18:08:08.352125+0000","last_became_active":"2024-09-12T17:29:42.064741+0000","last_became_peered":"2024-09-12T17:29:42.064741+0000","last_unstale":"2024-09-12T18:08:08.352125+0000","last_undegraded":"2024-09-12T18:08:08.352125+0000","last_fullsized":"2024-09-12T18:08:08.352125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:08.352056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:08.352056+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.352056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:03.352768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043924099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.228596+0000","last_change":"2024-09-12T18:08:25.228596+0000","last_active":"2024-09-12T18:08:25.228596+0000","last_peered":"2024-09-12T18:08:25.228596+0000","last_clean":"2024-09-12T18:08:25.228596+0000","last_became_active":"2024-09-12T17:29:56.955562+0000","last_became_peered":"2024-09-12T17:29:56.955562+0000","last_unstale":"2024-09-12T18:08:25.228596+0000","last_undegraded":"2024-09-12T18:08:25.228596+0000","last_fullsized":"2024-09-12T18:08:25.228596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.228503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.228503+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.228503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:54.858311+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'271","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.272312+0000","last_change":"2024-09-12T18:08:28.272312+0000","last_active":"2024-09-12T18:08:28.272312+0000","last_peered":"2024-09-12T18:08:28.272312+0000","last_clean":"2024-09-12T18:08:28.272312+0000","last_became_active":"2024-09-12T17:29:58.960410+0000","last_became_peered":"2024-09-12T17:29:58.960410+0000","last_unstale":"2024-09-12T18:08:28.272312+0000","last_undegraded":"2024-09-12T18:08:28.272312+0000","last_fullsized":"2024-09-12T18:08:28.272312+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-12T18:08:28.272217+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-12T18:08:28.272217+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.272217+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:32.383273+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14017,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":378,"num_read_kb":510,"num_write":242,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11880,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.834068+0000","last_change":"2024-09-12T18:08:36.834068+0000","last_active":"2024-09-12T18:08:36.834068+0000","last_peered":"2024-09-12T18:08:36.834068+0000","last_clean":"2024-09-12T18:08:36.834068+0000","last_became_active":"2024-09-12T17:30:00.963660+0000","last_became_peered":"2024-09-12T17:30:00.963660+0000","last_unstale":"2024-09-12T18:08:36.834068+0000","last_undegraded":"2024-09-12T18:08:36.834068+0000","last_fullsized":"2024-09-12T18:08:36.834068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:36.833959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:36.833959+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.833959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:36.771638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'174","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.340404+0000","last_change":"2024-09-12T18:08:42.340404+0000","last_active":"2024-09-12T18:08:42.340404+0000","last_peered":"2024-09-12T18:08:42.340404+0000","last_clean":"2024-09-12T18:08:42.340404+0000","last_became_active":"2024-09-12T17:30:02.971807+0000","last_became_peered":"2024-09-12T17:30:02.971807+0000","last_unstale":"2024-09-12T18:08:42.340404+0000","last_undegraded":"2024-09-12T18:08:42.340404+0000","last_fullsized":"2024-09-12T18:08:42.340404+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:08:42.340320+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:08:42.340320+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.340320+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:28.426511+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":246,"num_write":442,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'192","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.154129+0000","last_change":"2024-09-12T18:08:15.154129+0000","last_active":"2024-09-12T18:08:15.154129+0000","last_peered":"2024-09-12T18:08:15.154129+0000","last_clean":"2024-09-12T18:08:15.154129+0000","last_became_active":"2024-09-12T17:29:54.958998+0000","last_became_peered":"2024-09-12T17:29:54.958998+0000","last_unstale":"2024-09-12T18:08:15.154129+0000","last_undegraded":"2024-09-12T18:08:15.154129+0000","last_fullsized":"2024-09-12T18:08:15.154129+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-09-12T18:08:15.154013+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-09-12T18:08:15.154013+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.154013+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:33.665464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":764,"num_write":273,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'224","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.319484+0000","last_change":"2024-09-12T18:08:10.319484+0000","last_active":"2024-09-12T18:08:10.319484+0000","last_peered":"2024-09-12T18:08:10.319484+0000","last_clean":"2024-09-12T18:08:10.319484+0000","last_became_active":"2024-09-12T17:29:52.955429+0000","last_became_peered":"2024-09-12T17:29:52.955429+0000","last_unstale":"2024-09-12T18:08:10.319484+0000","last_undegraded":"2024-09-12T18:08:10.319484+0000","last_fullsized":"2024-09-12T18:08:10.319484+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'224","last_scrub_stamp":"2024-09-12T18:08:10.319399+0000","last_deep_scrub":"264'224","last_deep_scrub_stamp":"2024-09-12T18:08:10.319399+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.319399+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:41.245590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170313,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":39247,"num_write":990,"num_write_kb":44156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.715167+0000","last_change":"2024-09-12T18:08:11.715167+0000","last_active":"2024-09-12T18:08:11.715167+0000","last_peered":"2024-09-12T18:08:11.715167+0000","last_clean":"2024-09-12T18:08:11.715167+0000","last_became_active":"2024-09-12T17:29:42.064736+0000","last_became_peered":"2024-09-12T17:29:42.064736+0000","last_unstale":"2024-09-12T18:08:11.715167+0000","last_undegraded":"2024-09-12T18:08:11.715167+0000","last_fullsized":"2024-09-12T18:08:11.715167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:11.715042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:11.715042+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.715042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:08.443705+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045118300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.082844+0000","last_change":"2024-09-12T18:08:23.082844+0000","last_active":"2024-09-12T18:08:23.082844+0000","last_peered":"2024-09-12T18:08:23.082844+0000","last_clean":"2024-09-12T18:08:23.082844+0000","last_became_active":"2024-09-12T17:29:56.957503+0000","last_became_peered":"2024-09-12T17:29:56.957503+0000","last_unstale":"2024-09-12T18:08:23.082844+0000","last_undegraded":"2024-09-12T18:08:23.082844+0000","last_fullsized":"2024-09-12T18:08:23.082844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:23.082745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:23.082745+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.082745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:14.276157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'157","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.314767+0000","last_change":"2024-09-12T18:08:28.314767+0000","last_active":"2024-09-12T18:08:28.314767+0000","last_peered":"2024-09-12T18:08:28.314767+0000","last_clean":"2024-09-12T18:08:28.314767+0000","last_became_active":"2024-09-12T17:29:58.978487+0000","last_became_peered":"2024-09-12T17:29:58.978487+0000","last_unstale":"2024-09-12T18:08:28.314767+0000","last_undegraded":"2024-09-12T18:08:28.314767+0000","last_fullsized":"2024-09-12T18:08:28.314767+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'157","last_scrub_stamp":"2024-09-12T18:08:28.314678+0000","last_deep_scrub":"264'157","last_deep_scrub_stamp":"2024-09-12T18:08:28.314678+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.314678+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:43.823711+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":172,"num_read_kb":165,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'772","reported_seq":2453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.410854+0000","last_change":"2024-09-12T18:08:40.410854+0000","last_active":"2024-09-12T18:08:40.410854+0000","last_peered":"2024-09-12T18:08:40.410854+0000","last_clean":"2024-09-12T18:08:40.410854+0000","last_became_active":"2024-09-12T17:30:00.956655+0000","last_became_peered":"2024-09-12T17:30:00.956655+0000","last_unstale":"2024-09-12T18:08:40.410854+0000","last_undegraded":"2024-09-12T18:08:40.410854+0000","last_fullsized":"2024-09-12T18:08:40.410854+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'772","last_scrub_stamp":"2024-09-12T18:08:40.410755+0000","last_deep_scrub":"264'772","last_deep_scrub_stamp":"2024-09-12T18:08:40.410755+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.410755+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:40.083368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'117","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:38.675974+0000","last_change":"2024-09-12T17:30:02.969523+0000","last_active":"2024-09-12T18:07:38.675974+0000","last_peered":"2024-09-12T18:07:38.675974+0000","last_clean":"2024-09-12T18:07:38.675974+0000","last_became_active":"2024-09-12T17:30:02.968978+0000","last_became_peered":"2024-09-12T17:30:02.968978+0000","last_unstale":"2024-09-12T18:07:38.675974+0000","last_undegraded":"2024-09-12T18:07:38.675974+0000","last_fullsized":"2024-09-12T18:07:38.675974+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1365,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":174,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'406","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.094428+0000","last_change":"2024-09-12T18:08:17.094428+0000","last_active":"2024-09-12T18:08:17.094428+0000","last_peered":"2024-09-12T18:08:17.094428+0000","last_clean":"2024-09-12T18:08:17.094428+0000","last_became_active":"2024-09-12T17:29:54.955170+0000","last_became_peered":"2024-09-12T17:29:54.955170+0000","last_unstale":"2024-09-12T18:08:17.094428+0000","last_undegraded":"2024-09-12T18:08:17.094428+0000","last_fullsized":"2024-09-12T18:08:17.094428+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-09-12T18:08:17.094343+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-09-12T18:08:17.094343+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.094343+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:22.112938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1829,"num_read_kb":1585,"num_write":674,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'168","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.262237+0000","last_change":"2024-09-12T18:08:09.262237+0000","last_active":"2024-09-12T18:08:09.262237+0000","last_peered":"2024-09-12T18:08:09.262237+0000","last_clean":"2024-09-12T18:08:09.262237+0000","last_became_active":"2024-09-12T17:30:28.004804+0000","last_became_peered":"2024-09-12T17:30:28.004804+0000","last_unstale":"2024-09-12T18:08:09.262237+0000","last_undegraded":"2024-09-12T18:08:09.262237+0000","last_fullsized":"2024-09-12T18:08:09.262237+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-12T18:08:09.262150+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-12T18:08:09.262150+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.262150+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:43.192647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262290,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":342,"num_read_kb":56981,"num_write":802,"num_write_kb":25989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:07.370369+0000","last_change":"2024-09-12T18:08:07.370292+0000","last_active":"2024-09-12T18:08:07.370369+0000","last_peered":"2024-09-12T18:08:07.370369+0000","last_clean":"2024-09-12T18:08:07.370369+0000","last_became_active":"2024-09-12T17:29:41.961194+0000","last_became_peered":"2024-09-12T17:29:41.961194+0000","last_unstale":"2024-09-12T18:08:07.370369+0000","last_undegraded":"2024-09-12T18:08:07.370369+0000","last_fullsized":"2024-09-12T18:08:07.370369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:07.370196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:07.370196+0000","last_clean_scrub_stamp":"2024-09-12T18:08:07.370196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:17.088343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049442699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.840682+0000","last_change":"2024-09-12T18:08:27.840682+0000","last_active":"2024-09-12T18:08:27.840682+0000","last_peered":"2024-09-12T18:08:27.840682+0000","last_clean":"2024-09-12T18:08:27.840682+0000","last_became_active":"2024-09-12T17:29:56.955865+0000","last_became_peered":"2024-09-12T17:29:56.955865+0000","last_unstale":"2024-09-12T18:08:27.840682+0000","last_undegraded":"2024-09-12T18:08:27.840682+0000","last_fullsized":"2024-09-12T18:08:27.840682+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.840597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.840597+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.840597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:30.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'101","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.847564+0000","last_change":"2024-09-12T18:08:31.847564+0000","last_active":"2024-09-12T18:08:31.847564+0000","last_peered":"2024-09-12T18:08:31.847564+0000","last_clean":"2024-09-12T18:08:31.847564+0000","last_became_active":"2024-09-12T17:29:58.953924+0000","last_became_peered":"2024-09-12T17:29:58.953924+0000","last_unstale":"2024-09-12T18:08:31.847564+0000","last_undegraded":"2024-09-12T18:08:31.847564+0000","last_fullsized":"2024-09-12T18:08:31.847564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'101","last_scrub_stamp":"2024-09-12T18:08:31.847468+0000","last_deep_scrub":"264'101","last_deep_scrub_stamp":"2024-09-12T18:08:31.847468+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.847468+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:50.319108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":108,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'781","reported_seq":2102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.859208+0000","last_change":"2024-09-12T18:08:38.859208+0000","last_active":"2024-09-12T18:08:38.859208+0000","last_peered":"2024-09-12T18:08:38.859208+0000","last_clean":"2024-09-12T18:08:38.859208+0000","last_became_active":"2024-09-12T17:30:00.967168+0000","last_became_peered":"2024-09-12T17:30:00.967168+0000","last_unstale":"2024-09-12T18:08:38.859208+0000","last_undegraded":"2024-09-12T18:08:38.859208+0000","last_fullsized":"2024-09-12T18:08:38.859208+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'781","last_scrub_stamp":"2024-09-12T18:08:38.859128+0000","last_deep_scrub":"264'781","last_deep_scrub_stamp":"2024-09-12T18:08:38.859128+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.859128+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:51.244607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'304","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.290565+0000","last_change":"2024-09-12T18:08:41.290565+0000","last_active":"2024-09-12T18:08:41.290565+0000","last_peered":"2024-09-12T18:08:41.290565+0000","last_clean":"2024-09-12T18:08:41.290565+0000","last_became_active":"2024-09-12T17:30:02.969526+0000","last_became_peered":"2024-09-12T17:30:02.969526+0000","last_unstale":"2024-09-12T18:08:41.290565+0000","last_undegraded":"2024-09-12T18:08:41.290565+0000","last_fullsized":"2024-09-12T18:08:41.290565+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'304","last_scrub_stamp":"2024-09-12T18:08:41.290483+0000","last_deep_scrub":"264'304","last_deep_scrub_stamp":"2024-09-12T18:08:41.290483+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.290483+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:17.435474+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":439,"num_write":657,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'44","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.696695+0000","last_change":"2024-09-12T18:08:12.696695+0000","last_active":"2024-09-12T18:08:12.696695+0000","last_peered":"2024-09-12T18:08:12.696695+0000","last_clean":"2024-09-12T18:08:12.696695+0000","last_became_active":"2024-09-12T17:29:54.957906+0000","last_became_peered":"2024-09-12T17:29:54.957906+0000","last_unstale":"2024-09-12T18:08:12.696695+0000","last_undegraded":"2024-09-12T18:08:12.696695+0000","last_fullsized":"2024-09-12T18:08:12.696695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T18:08:12.696599+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T18:08:12.696599+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.696599+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:18.217996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":180,"num_write":59,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'212","reported_seq":834,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.278838+0000","last_change":"2024-09-12T18:08:10.278838+0000","last_active":"2024-09-12T18:08:10.278838+0000","last_peered":"2024-09-12T18:08:10.278838+0000","last_clean":"2024-09-12T18:08:10.278838+0000","last_became_active":"2024-09-12T17:30:28.006884+0000","last_became_peered":"2024-09-12T17:30:28.006884+0000","last_unstale":"2024-09-12T18:08:10.278838+0000","last_undegraded":"2024-09-12T18:08:10.278838+0000","last_fullsized":"2024-09-12T18:08:10.278838+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-12T18:08:10.278730+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-12T18:08:10.278730+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.278730+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.094728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":14673,"num_write":991,"num_write_kb":46674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.055459+0000","last_change":"2024-09-12T18:08:10.055401+0000","last_active":"2024-09-12T18:08:10.055459+0000","last_peered":"2024-09-12T18:08:10.055459+0000","last_clean":"2024-09-12T18:08:10.055459+0000","last_became_active":"2024-09-12T17:29:41.961477+0000","last_became_peered":"2024-09-12T17:29:41.961477+0000","last_unstale":"2024-09-12T18:08:10.055459+0000","last_undegraded":"2024-09-12T18:08:10.055459+0000","last_fullsized":"2024-09-12T18:08:10.055459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:10.055313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:10.055313+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.055313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:09.016405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041855800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.023133+0000","last_change":"2024-09-12T18:08:25.023133+0000","last_active":"2024-09-12T18:08:25.023133+0000","last_peered":"2024-09-12T18:08:25.023133+0000","last_clean":"2024-09-12T18:08:25.023133+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:08:25.023133+0000","last_undegraded":"2024-09-12T18:08:25.023133+0000","last_fullsized":"2024-09-12T18:08:25.023133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.022986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.022986+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.022986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:42.498998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'320","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.888007+0000","last_change":"2024-09-12T18:08:32.888007+0000","last_active":"2024-09-12T18:08:32.888007+0000","last_peered":"2024-09-12T18:08:32.888007+0000","last_clean":"2024-09-12T18:08:32.888007+0000","last_became_active":"2024-09-12T17:29:58.978222+0000","last_became_peered":"2024-09-12T17:29:58.978222+0000","last_unstale":"2024-09-12T18:08:32.888007+0000","last_undegraded":"2024-09-12T18:08:32.888007+0000","last_fullsized":"2024-09-12T18:08:32.888007+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'320","last_scrub_stamp":"2024-09-12T18:08:32.887900+0000","last_deep_scrub":"264'320","last_deep_scrub_stamp":"2024-09-12T18:08:32.887900+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.887900+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:36.484816+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25498,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":718,"num_write":254,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.896645+0000","last_change":"2024-09-12T18:08:37.896645+0000","last_active":"2024-09-12T18:08:37.896645+0000","last_peered":"2024-09-12T18:08:37.896645+0000","last_clean":"2024-09-12T18:08:37.896645+0000","last_became_active":"2024-09-12T17:30:00.968527+0000","last_became_peered":"2024-09-12T17:30:00.968527+0000","last_unstale":"2024-09-12T18:08:37.896645+0000","last_undegraded":"2024-09-12T18:08:37.896645+0000","last_fullsized":"2024-09-12T18:08:37.896645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:37.896560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:37.896560+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.896560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:08.112093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'125","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.454152+0000","last_change":"2024-09-12T18:08:43.454152+0000","last_active":"2024-09-12T18:08:43.454152+0000","last_peered":"2024-09-12T18:08:43.454152+0000","last_clean":"2024-09-12T18:08:43.454152+0000","last_became_active":"2024-09-12T17:30:02.966018+0000","last_became_peered":"2024-09-12T17:30:02.966018+0000","last_unstale":"2024-09-12T18:08:43.454152+0000","last_undegraded":"2024-09-12T18:08:43.454152+0000","last_fullsized":"2024-09-12T18:08:43.454152+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T18:08:43.454064+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T18:08:43.454064+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.454064+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:24.393994+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":226,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'154","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:21.350541+0000","last_change":"2024-09-12T17:30:02.964433+0000","last_active":"2024-09-12T18:06:21.350541+0000","last_peered":"2024-09-12T18:06:21.350541+0000","last_clean":"2024-09-12T18:06:21.350541+0000","last_became_active":"2024-09-12T17:30:02.964133+0000","last_became_peered":"2024-09-12T17:30:02.964133+0000","last_unstale":"2024-09-12T18:06:21.350541+0000","last_undegraded":"2024-09-12T18:06:21.350541+0000","last_fullsized":"2024-09-12T18:06:21.350541+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:49.035962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":286,"num_write":383,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'105","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.701136+0000","last_change":"2024-09-12T18:08:15.701136+0000","last_active":"2024-09-12T18:08:15.701136+0000","last_peered":"2024-09-12T18:08:15.701136+0000","last_clean":"2024-09-12T18:08:15.701136+0000","last_became_active":"2024-09-12T17:29:54.955716+0000","last_became_peered":"2024-09-12T17:29:54.955716+0000","last_unstale":"2024-09-12T18:08:15.701136+0000","last_undegraded":"2024-09-12T18:08:15.701136+0000","last_fullsized":"2024-09-12T18:08:15.701136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T18:08:15.701059+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T18:08:15.701059+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.701059+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:28.452054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":383,"num_write":153,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'185","reported_seq":785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.353007+0000","last_change":"2024-09-12T18:08:15.353007+0000","last_active":"2024-09-12T18:08:15.353007+0000","last_peered":"2024-09-12T18:08:15.353007+0000","last_clean":"2024-09-12T18:08:15.353007+0000","last_became_active":"2024-09-12T17:30:28.200487+0000","last_became_peered":"2024-09-12T17:30:28.200487+0000","last_unstale":"2024-09-12T18:08:15.353007+0000","last_undegraded":"2024-09-12T18:08:15.353007+0000","last_fullsized":"2024-09-12T18:08:15.353007+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-12T18:08:15.352875+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-12T18:08:15.352875+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.352875+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:15.449063+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":393,"num_read_kb":70111,"num_write":894,"num_write_kb":56875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.323914+0000","last_change":"2024-09-12T18:08:24.323914+0000","last_active":"2024-09-12T18:08:24.323914+0000","last_peered":"2024-09-12T18:08:24.323914+0000","last_clean":"2024-09-12T18:08:24.323914+0000","last_became_active":"2024-09-12T17:29:56.952578+0000","last_became_peered":"2024-09-12T17:29:56.952578+0000","last_unstale":"2024-09-12T18:08:24.323914+0000","last_undegraded":"2024-09-12T18:08:24.323914+0000","last_fullsized":"2024-09-12T18:08:24.323914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:24.323828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:24.323828+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.323828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:27.495028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'130","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.906581+0000","last_change":"2024-09-12T18:08:33.906581+0000","last_active":"2024-09-12T18:08:33.906581+0000","last_peered":"2024-09-12T18:08:33.906581+0000","last_clean":"2024-09-12T18:08:33.906581+0000","last_became_active":"2024-09-12T17:29:58.955111+0000","last_became_peered":"2024-09-12T17:29:58.955111+0000","last_unstale":"2024-09-12T18:08:33.906581+0000","last_undegraded":"2024-09-12T18:08:33.906581+0000","last_fullsized":"2024-09-12T18:08:33.906581+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T18:08:33.906456+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T18:08:33.906456+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.906456+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:56.253668+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":163,"num_read_kb":266,"num_write":84,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.811028+0000","last_change":"2024-09-12T18:08:39.811028+0000","last_active":"2024-09-12T18:08:39.811028+0000","last_peered":"2024-09-12T18:08:39.811028+0000","last_clean":"2024-09-12T18:08:39.811028+0000","last_became_active":"2024-09-12T17:30:00.965975+0000","last_became_peered":"2024-09-12T17:30:00.965975+0000","last_unstale":"2024-09-12T18:08:39.811028+0000","last_undegraded":"2024-09-12T18:08:39.811028+0000","last_fullsized":"2024-09-12T18:08:39.811028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:39.810896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:39.810896+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.810896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:04.330311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'105","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:14.540717+0000","last_change":"2024-09-12T17:30:02.966210+0000","last_active":"2024-09-12T18:06:14.540717+0000","last_peered":"2024-09-12T18:06:14.540717+0000","last_clean":"2024-09-12T18:06:14.540717+0000","last_became_active":"2024-09-12T17:30:02.965919+0000","last_became_peered":"2024-09-12T17:30:02.965919+0000","last_unstale":"2024-09-12T18:06:14.540717+0000","last_undegraded":"2024-09-12T18:06:14.540717+0000","last_fullsized":"2024-09-12T18:06:14.540717+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":165,"num_read_kb":151,"num_write":248,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'420","reported_seq":1175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.282459+0000","last_change":"2024-09-12T18:08:19.282459+0000","last_active":"2024-09-12T18:08:19.282459+0000","last_peered":"2024-09-12T18:08:19.282459+0000","last_clean":"2024-09-12T18:08:19.282459+0000","last_became_active":"2024-09-12T17:29:54.954477+0000","last_became_peered":"2024-09-12T17:29:54.954477+0000","last_unstale":"2024-09-12T18:08:19.282459+0000","last_undegraded":"2024-09-12T18:08:19.282459+0000","last_fullsized":"2024-09-12T18:08:19.282459+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'420","last_scrub_stamp":"2024-09-12T18:08:19.282376+0000","last_deep_scrub":"264'420","last_deep_scrub_stamp":"2024-09-12T18:08:19.282376+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.282376+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:52.399922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1777,"num_write":781,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'210","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.683017+0000","last_change":"2024-09-12T18:08:17.682955+0000","last_active":"2024-09-12T18:08:17.683017+0000","last_peered":"2024-09-12T18:08:17.683017+0000","last_clean":"2024-09-12T18:08:17.683017+0000","last_became_active":"2024-09-12T17:29:52.956376+0000","last_became_peered":"2024-09-12T17:29:52.956376+0000","last_unstale":"2024-09-12T18:08:17.683017+0000","last_undegraded":"2024-09-12T18:08:17.683017+0000","last_fullsized":"2024-09-12T18:08:17.683017+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-12T18:08:17.682841+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-12T18:08:17.682841+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.682841+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:59.176548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":36390,"num_write":986,"num_write_kb":36751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.983279+0000","last_change":"2024-09-12T18:08:26.983279+0000","last_active":"2024-09-12T18:08:26.983279+0000","last_peered":"2024-09-12T18:08:26.983279+0000","last_clean":"2024-09-12T18:08:26.983279+0000","last_became_active":"2024-09-12T17:29:56.955256+0000","last_became_peered":"2024-09-12T17:29:56.955256+0000","last_unstale":"2024-09-12T18:08:26.983279+0000","last_undegraded":"2024-09-12T18:08:26.983279+0000","last_fullsized":"2024-09-12T18:08:26.983279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:26.983183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:26.983183+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.983183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:10.917322+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'54","reported_seq":559,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.221679+0000","last_change":"2024-09-12T18:08:31.221679+0000","last_active":"2024-09-12T18:08:31.221679+0000","last_peered":"2024-09-12T18:08:31.221679+0000","last_clean":"2024-09-12T18:08:31.221679+0000","last_became_active":"2024-09-12T17:29:58.960476+0000","last_became_peered":"2024-09-12T17:29:58.960476+0000","last_unstale":"2024-09-12T18:08:31.221679+0000","last_undegraded":"2024-09-12T18:08:31.221679+0000","last_fullsized":"2024-09-12T18:08:31.221679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'54","last_scrub_stamp":"2024-09-12T18:08:31.221616+0000","last_deep_scrub":"264'54","last_deep_scrub_stamp":"2024-09-12T18:08:31.221616+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.221616+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:54.384978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.997404+0000","last_change":"2024-09-12T18:08:39.997404+0000","last_active":"2024-09-12T18:08:39.997404+0000","last_peered":"2024-09-12T18:08:39.997404+0000","last_clean":"2024-09-12T18:08:39.997404+0000","last_became_active":"2024-09-12T17:30:00.958739+0000","last_became_peered":"2024-09-12T17:30:00.958739+0000","last_unstale":"2024-09-12T18:08:39.997404+0000","last_undegraded":"2024-09-12T18:08:39.997404+0000","last_fullsized":"2024-09-12T18:08:39.997404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:39.997305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:39.997305+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.997305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:54.123997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'190","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.374569+0000","last_change":"2024-09-12T18:08:43.374569+0000","last_active":"2024-09-12T18:08:43.374569+0000","last_peered":"2024-09-12T18:08:43.374569+0000","last_clean":"2024-09-12T18:08:43.374569+0000","last_became_active":"2024-09-12T17:30:02.972717+0000","last_became_peered":"2024-09-12T17:30:02.972717+0000","last_unstale":"2024-09-12T18:08:43.374569+0000","last_undegraded":"2024-09-12T18:08:43.374569+0000","last_fullsized":"2024-09-12T18:08:43.374569+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:08:43.374481+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:08:43.374481+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.374481+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:36.269631+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":309,"num_read_kb":305,"num_write":411,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'235","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.096877+0000","last_change":"2024-09-12T18:08:19.096877+0000","last_active":"2024-09-12T18:08:19.096877+0000","last_peered":"2024-09-12T18:08:19.096877+0000","last_clean":"2024-09-12T18:08:19.096877+0000","last_became_active":"2024-09-12T17:29:54.955897+0000","last_became_peered":"2024-09-12T17:29:54.955897+0000","last_unstale":"2024-09-12T18:08:19.096877+0000","last_undegraded":"2024-09-12T18:08:19.096877+0000","last_fullsized":"2024-09-12T18:08:19.096877+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'235","last_scrub_stamp":"2024-09-12T18:08:19.096790+0000","last_deep_scrub":"264'235","last_deep_scrub_stamp":"2024-09-12T18:08:19.096790+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.096790+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:13.358909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":344,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'244","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.511020+0000","last_change":"2024-09-12T18:08:12.510954+0000","last_active":"2024-09-12T18:08:12.511020+0000","last_peered":"2024-09-12T18:08:12.511020+0000","last_clean":"2024-09-12T18:08:12.511020+0000","last_became_active":"2024-09-12T17:29:52.954956+0000","last_became_peered":"2024-09-12T17:29:52.954956+0000","last_unstale":"2024-09-12T18:08:12.511020+0000","last_undegraded":"2024-09-12T18:08:12.511020+0000","last_fullsized":"2024-09-12T18:08:12.511020+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'244","last_scrub_stamp":"2024-09-12T18:08:12.510806+0000","last_deep_scrub":"264'244","last_deep_scrub_stamp":"2024-09-12T18:08:12.510806+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.510806+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:53.796805+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550036,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":646,"num_read_kb":5380,"num_write":1208,"num_write_kb":40346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.876369+0000","last_change":"2024-09-12T18:08:31.876369+0000","last_active":"2024-09-12T18:08:31.876369+0000","last_peered":"2024-09-12T18:08:31.876369+0000","last_clean":"2024-09-12T18:08:31.876369+0000","last_became_active":"2024-09-12T17:29:56.959460+0000","last_became_peered":"2024-09-12T17:29:56.959460+0000","last_unstale":"2024-09-12T18:08:31.876369+0000","last_undegraded":"2024-09-12T18:08:31.876369+0000","last_fullsized":"2024-09-12T18:08:31.876369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:31.876275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:31.876275+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.876275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:33.746738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'154","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.862640+0000","last_change":"2024-09-12T18:08:34.862640+0000","last_active":"2024-09-12T18:08:34.862640+0000","last_peered":"2024-09-12T18:08:34.862640+0000","last_clean":"2024-09-12T18:08:34.862640+0000","last_became_active":"2024-09-12T17:29:58.960824+0000","last_became_peered":"2024-09-12T17:29:58.960824+0000","last_unstale":"2024-09-12T18:08:34.862640+0000","last_undegraded":"2024-09-12T18:08:34.862640+0000","last_fullsized":"2024-09-12T18:08:34.862640+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-12T18:08:34.862546+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-12T18:08:34.862546+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.862546+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:17.967948+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":238,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.025164+0000","last_change":"2024-09-12T18:08:28.025164+0000","last_active":"2024-09-12T18:08:28.025164+0000","last_peered":"2024-09-12T18:08:28.025164+0000","last_clean":"2024-09-12T18:08:28.025164+0000","last_became_active":"2024-09-12T17:30:00.967299+0000","last_became_peered":"2024-09-12T17:30:00.967299+0000","last_unstale":"2024-09-12T18:08:28.025164+0000","last_undegraded":"2024-09-12T18:08:28.025164+0000","last_fullsized":"2024-09-12T18:08:28.025164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:28.025075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:28.025075+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.025075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:03.790015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'93","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:20.484386+0000","last_change":"2024-09-12T17:30:02.966660+0000","last_active":"2024-09-12T18:06:20.484386+0000","last_peered":"2024-09-12T18:06:20.484386+0000","last_clean":"2024-09-12T18:06:20.484386+0000","last_became_active":"2024-09-12T17:30:02.965644+0000","last_became_peered":"2024-09-12T17:30:02.965644+0000","last_unstale":"2024-09-12T18:06:20.484386+0000","last_undegraded":"2024-09-12T18:06:20.484386+0000","last_fullsized":"2024-09-12T18:06:20.484386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:15.702919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":207,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'4299","reported_seq":4952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.123934+0000","last_change":"2024-09-12T18:08:18.123934+0000","last_active":"2024-09-12T18:08:18.123934+0000","last_peered":"2024-09-12T18:08:18.123934+0000","last_clean":"2024-09-12T18:08:18.123934+0000","last_became_active":"2024-09-12T17:29:54.950407+0000","last_became_peered":"2024-09-12T17:29:54.950407+0000","last_unstale":"2024-09-12T18:08:18.123934+0000","last_undegraded":"2024-09-12T18:08:18.123934+0000","last_fullsized":"2024-09-12T18:08:18.123934+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4299","last_scrub_stamp":"2024-09-12T18:08:18.123846+0000","last_deep_scrub":"264'4299","last_deep_scrub_stamp":"2024-09-12T18:08:18.123846+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.123846+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:58.856015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17237,"num_read_kb":14347,"num_write":6471,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'180","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.146524+0000","last_change":"2024-09-12T18:08:08.146470+0000","last_active":"2024-09-12T18:08:08.146524+0000","last_peered":"2024-09-12T18:08:08.146524+0000","last_clean":"2024-09-12T18:08:08.146524+0000","last_became_active":"2024-09-12T17:29:52.962836+0000","last_became_peered":"2024-09-12T17:29:52.962836+0000","last_unstale":"2024-09-12T18:08:08.146524+0000","last_undegraded":"2024-09-12T18:08:08.146524+0000","last_fullsized":"2024-09-12T18:08:08.146524+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T18:08:08.146374+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T18:08:08.146374+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.146374+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:03.930960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303959,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":45090,"num_write":889,"num_write_kb":58788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.009862+0000","last_change":"2024-09-12T18:08:25.009862+0000","last_active":"2024-09-12T18:08:25.009862+0000","last_peered":"2024-09-12T18:08:25.009862+0000","last_clean":"2024-09-12T18:08:25.009862+0000","last_became_active":"2024-09-12T17:29:56.957066+0000","last_became_peered":"2024-09-12T17:29:56.957066+0000","last_unstale":"2024-09-12T18:08:25.009862+0000","last_undegraded":"2024-09-12T18:08:25.009862+0000","last_fullsized":"2024-09-12T18:08:25.009862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.009761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.009761+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.009761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:29.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'156","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.895421+0000","last_change":"2024-09-12T18:08:34.895421+0000","last_active":"2024-09-12T18:08:34.895421+0000","last_peered":"2024-09-12T18:08:34.895421+0000","last_clean":"2024-09-12T18:08:34.895421+0000","last_became_active":"2024-09-12T17:29:58.955585+0000","last_became_peered":"2024-09-12T17:29:58.955585+0000","last_unstale":"2024-09-12T18:08:34.895421+0000","last_undegraded":"2024-09-12T18:08:34.895421+0000","last_fullsized":"2024-09-12T18:08:34.895421+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-12T18:08:34.895323+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-12T18:08:34.895323+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.895323+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:29.675628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7377,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":246,"num_write":102,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.258439+0000","last_change":"2024-09-12T18:08:37.258439+0000","last_active":"2024-09-12T18:08:37.258439+0000","last_peered":"2024-09-12T18:08:37.258439+0000","last_clean":"2024-09-12T18:08:37.258439+0000","last_became_active":"2024-09-12T17:30:00.964621+0000","last_became_peered":"2024-09-12T17:30:00.964621+0000","last_unstale":"2024-09-12T18:08:37.258439+0000","last_undegraded":"2024-09-12T18:08:37.258439+0000","last_fullsized":"2024-09-12T18:08:37.258439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:37.258356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:37.258356+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.258356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:26.246711+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'546","reported_seq":1352,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.122184+0000","last_change":"2024-09-12T18:08:20.122184+0000","last_active":"2024-09-12T18:08:20.122184+0000","last_peered":"2024-09-12T18:08:20.122184+0000","last_clean":"2024-09-12T18:08:20.122184+0000","last_became_active":"2024-09-12T17:29:54.958758+0000","last_became_peered":"2024-09-12T17:29:54.958758+0000","last_unstale":"2024-09-12T18:08:20.122184+0000","last_undegraded":"2024-09-12T18:08:20.122184+0000","last_fullsized":"2024-09-12T18:08:20.122184+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'546","last_scrub_stamp":"2024-09-12T18:08:20.122059+0000","last_deep_scrub":"264'546","last_deep_scrub_stamp":"2024-09-12T18:08:20.122059+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.122059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:18.469393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2571,"num_read_kb":2181,"num_write":951,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'212","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.316799+0000","last_change":"2024-09-12T18:08:13.316799+0000","last_active":"2024-09-12T18:08:13.316799+0000","last_peered":"2024-09-12T18:08:13.316799+0000","last_clean":"2024-09-12T18:08:13.316799+0000","last_became_active":"2024-09-12T17:30:28.007001+0000","last_became_peered":"2024-09-12T17:30:28.007001+0000","last_unstale":"2024-09-12T18:08:13.316799+0000","last_undegraded":"2024-09-12T18:08:13.316799+0000","last_fullsized":"2024-09-12T18:08:13.316799+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-12T18:08:13.316690+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-12T18:08:13.316690+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.316690+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:44.403007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":31262,"num_write":918,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.278158+0000","last_change":"2024-09-12T18:08:27.278158+0000","last_active":"2024-09-12T18:08:27.278158+0000","last_peered":"2024-09-12T18:08:27.278158+0000","last_clean":"2024-09-12T18:08:27.278158+0000","last_became_active":"2024-09-12T17:29:56.954498+0000","last_became_peered":"2024-09-12T17:29:56.954498+0000","last_unstale":"2024-09-12T18:08:27.278158+0000","last_undegraded":"2024-09-12T18:08:27.278158+0000","last_fullsized":"2024-09-12T18:08:27.278158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.278068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.278068+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.278068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:27.868992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'194","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.346927+0000","last_change":"2024-09-12T18:08:30.346927+0000","last_active":"2024-09-12T18:08:30.346927+0000","last_peered":"2024-09-12T18:08:30.346927+0000","last_clean":"2024-09-12T18:08:30.346927+0000","last_became_active":"2024-09-12T17:29:58.958198+0000","last_became_peered":"2024-09-12T17:29:58.958198+0000","last_unstale":"2024-09-12T18:08:30.346927+0000","last_undegraded":"2024-09-12T18:08:30.346927+0000","last_fullsized":"2024-09-12T18:08:30.346927+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'194","last_scrub_stamp":"2024-09-12T18:08:30.346829+0000","last_deep_scrub":"264'194","last_deep_scrub_stamp":"2024-09-12T18:08:30.346829+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.346829+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:10.264119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15825,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":439,"num_write":184,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.447811+0000","last_change":"2024-09-12T18:08:39.447811+0000","last_active":"2024-09-12T18:08:39.447811+0000","last_peered":"2024-09-12T18:08:39.447811+0000","last_clean":"2024-09-12T18:08:39.447811+0000","last_became_active":"2024-09-12T17:30:00.963706+0000","last_became_peered":"2024-09-12T17:30:00.963706+0000","last_unstale":"2024-09-12T18:08:39.447811+0000","last_undegraded":"2024-09-12T18:08:39.447811+0000","last_fullsized":"2024-09-12T18:08:39.447811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:39.447720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:39.447720+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.447720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:56.940712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'175","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:08.667499+0000","last_change":"2024-09-12T17:30:02.964954+0000","last_active":"2024-09-12T18:06:08.667499+0000","last_peered":"2024-09-12T18:06:08.667499+0000","last_clean":"2024-09-12T18:06:08.667499+0000","last_became_active":"2024-09-12T17:30:02.964682+0000","last_became_peered":"2024-09-12T17:30:02.964682+0000","last_unstale":"2024-09-12T18:06:08.667499+0000","last_undegraded":"2024-09-12T18:06:08.667499+0000","last_fullsized":"2024-09-12T18:06:08.667499+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:18.544576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":239,"num_read_kb":250,"num_write":415,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'100","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.116313+0000","last_change":"2024-09-12T18:08:21.116313+0000","last_active":"2024-09-12T18:08:21.116313+0000","last_peered":"2024-09-12T18:08:21.116313+0000","last_clean":"2024-09-12T18:08:21.116313+0000","last_became_active":"2024-09-12T17:29:54.955326+0000","last_became_peered":"2024-09-12T17:29:54.955326+0000","last_unstale":"2024-09-12T18:08:21.116313+0000","last_undegraded":"2024-09-12T18:08:21.116313+0000","last_fullsized":"2024-09-12T18:08:21.116313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T18:08:21.116224+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T18:08:21.116224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.116224+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:01.095342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":334,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'221","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.279702+0000","last_change":"2024-09-12T18:08:12.279609+0000","last_active":"2024-09-12T18:08:12.279702+0000","last_peered":"2024-09-12T18:08:12.279702+0000","last_clean":"2024-09-12T18:08:12.279702+0000","last_became_active":"2024-09-12T17:29:52.945616+0000","last_became_peered":"2024-09-12T17:29:52.945616+0000","last_unstale":"2024-09-12T18:08:12.279702+0000","last_undegraded":"2024-09-12T18:08:12.279702+0000","last_fullsized":"2024-09-12T18:08:12.279702+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-12T18:08:12.279483+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-12T18:08:12.279483+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.279483+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:42.023356+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109585,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":523,"num_read_kb":15300,"num_write":1084,"num_write_kb":27395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.034592+0000","last_change":"2024-09-12T18:08:24.034592+0000","last_active":"2024-09-12T18:08:24.034592+0000","last_peered":"2024-09-12T18:08:24.034592+0000","last_clean":"2024-09-12T18:08:24.034592+0000","last_became_active":"2024-09-12T17:29:56.959047+0000","last_became_peered":"2024-09-12T17:29:56.959047+0000","last_unstale":"2024-09-12T18:08:24.034592+0000","last_undegraded":"2024-09-12T18:08:24.034592+0000","last_fullsized":"2024-09-12T18:08:24.034592+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:24.034504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:24.034504+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.034504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:19.769078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'153","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.955655+0000","last_change":"2024-09-12T18:08:38.955655+0000","last_active":"2024-09-12T18:08:38.955655+0000","last_peered":"2024-09-12T18:08:38.955655+0000","last_clean":"2024-09-12T18:08:38.955655+0000","last_became_active":"2024-09-12T17:29:58.954747+0000","last_became_peered":"2024-09-12T17:29:58.954747+0000","last_unstale":"2024-09-12T18:08:38.955655+0000","last_undegraded":"2024-09-12T18:08:38.955655+0000","last_fullsized":"2024-09-12T18:08:38.955655+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-12T18:08:38.955556+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-12T18:08:38.955556+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.955556+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:06.885028+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10649,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":195,"num_read_kb":252,"num_write":120,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.272855+0000","last_change":"2024-09-12T18:08:32.272855+0000","last_active":"2024-09-12T18:08:32.272855+0000","last_peered":"2024-09-12T18:08:32.272855+0000","last_clean":"2024-09-12T18:08:32.272855+0000","last_became_active":"2024-09-12T17:30:00.959708+0000","last_became_peered":"2024-09-12T17:30:00.959708+0000","last_unstale":"2024-09-12T18:08:32.272855+0000","last_undegraded":"2024-09-12T18:08:32.272855+0000","last_fullsized":"2024-09-12T18:08:32.272855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:32.272771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:32.272771+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.272771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:27.610493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'221","reported_seq":727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.989954+0000","last_change":"2024-09-12T18:08:32.989954+0000","last_active":"2024-09-12T18:08:32.989954+0000","last_peered":"2024-09-12T18:08:32.989954+0000","last_clean":"2024-09-12T18:08:32.989954+0000","last_became_active":"2024-09-12T17:30:02.960928+0000","last_became_peered":"2024-09-12T17:30:02.960928+0000","last_unstale":"2024-09-12T18:08:32.989954+0000","last_undegraded":"2024-09-12T18:08:32.989954+0000","last_fullsized":"2024-09-12T18:08:32.989954+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-12T18:08:32.989843+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-12T18:08:32.989843+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.989843+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:06.325021+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":219,"num_write":570,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'158","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.027630+0000","last_change":"2024-09-12T18:08:24.027630+0000","last_active":"2024-09-12T18:08:24.027630+0000","last_peered":"2024-09-12T18:08:24.027630+0000","last_clean":"2024-09-12T18:08:24.027630+0000","last_became_active":"2024-09-12T17:29:54.950294+0000","last_became_peered":"2024-09-12T17:29:54.950294+0000","last_unstale":"2024-09-12T18:08:24.027630+0000","last_undegraded":"2024-09-12T18:08:24.027630+0000","last_fullsized":"2024-09-12T18:08:24.027630+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'158","last_scrub_stamp":"2024-09-12T18:08:24.027548+0000","last_deep_scrub":"264'158","last_deep_scrub_stamp":"2024-09-12T18:08:24.027548+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.027548+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:58.664447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":567,"num_write":224,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'195","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.782806+0000","last_change":"2024-09-12T18:08:10.782806+0000","last_active":"2024-09-12T18:08:10.782806+0000","last_peered":"2024-09-12T18:08:10.782806+0000","last_clean":"2024-09-12T18:08:10.782806+0000","last_became_active":"2024-09-12T17:29:52.947363+0000","last_became_peered":"2024-09-12T17:29:52.947363+0000","last_unstale":"2024-09-12T18:08:10.782806+0000","last_undegraded":"2024-09-12T18:08:10.782806+0000","last_fullsized":"2024-09-12T18:08:10.782806+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T18:08:10.782711+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T18:08:10.782711+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.782711+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:11.562634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":129945,"num_write":977,"num_write_kb":26137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.800844+0000","last_change":"2024-09-12T18:08:30.800844+0000","last_active":"2024-09-12T18:08:30.800844+0000","last_peered":"2024-09-12T18:08:30.800844+0000","last_clean":"2024-09-12T18:08:30.800844+0000","last_became_active":"2024-09-12T17:29:56.951825+0000","last_became_peered":"2024-09-12T17:29:56.951825+0000","last_unstale":"2024-09-12T18:08:30.800844+0000","last_undegraded":"2024-09-12T18:08:30.800844+0000","last_fullsized":"2024-09-12T18:08:30.800844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:30.800714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:30.800714+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.800714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:41.916626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'137","reported_seq":710,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.880393+0000","last_change":"2024-09-12T18:08:36.880393+0000","last_active":"2024-09-12T18:08:36.880393+0000","last_peered":"2024-09-12T18:08:36.880393+0000","last_clean":"2024-09-12T18:08:36.880393+0000","last_became_active":"2024-09-12T17:29:58.978506+0000","last_became_peered":"2024-09-12T17:29:58.978506+0000","last_unstale":"2024-09-12T18:08:36.880393+0000","last_undegraded":"2024-09-12T18:08:36.880393+0000","last_fullsized":"2024-09-12T18:08:36.880393+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T18:08:36.880305+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T18:08:36.880305+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.880305+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:41.111977+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7433,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":163,"num_read_kb":221,"num_write":86,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.246856+0000","last_change":"2024-09-12T18:08:33.246856+0000","last_active":"2024-09-12T18:08:33.246856+0000","last_peered":"2024-09-12T18:08:33.246856+0000","last_clean":"2024-09-12T18:08:33.246856+0000","last_became_active":"2024-09-12T17:30:00.965628+0000","last_became_peered":"2024-09-12T17:30:00.965628+0000","last_unstale":"2024-09-12T18:08:33.246856+0000","last_undegraded":"2024-09-12T18:08:33.246856+0000","last_fullsized":"2024-09-12T18:08:33.246856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:33.246768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:33.246768+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.246768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:12.109698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'114","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.450871+0000","last_change":"2024-09-12T18:08:44.450871+0000","last_active":"2024-09-12T18:08:44.450871+0000","last_peered":"2024-09-12T18:08:44.450871+0000","last_clean":"2024-09-12T18:08:44.450871+0000","last_became_active":"2024-09-12T17:30:02.963242+0000","last_became_peered":"2024-09-12T17:30:02.963242+0000","last_unstale":"2024-09-12T18:08:44.450871+0000","last_undegraded":"2024-09-12T18:08:44.450871+0000","last_fullsized":"2024-09-12T18:08:44.450871+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-12T18:08:44.450782+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-12T18:08:44.450782+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.450782+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:52.905420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'168","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.408456+0000","last_change":"2024-09-12T18:08:17.408456+0000","last_active":"2024-09-12T18:08:17.408456+0000","last_peered":"2024-09-12T18:08:17.408456+0000","last_clean":"2024-09-12T18:08:17.408456+0000","last_became_active":"2024-09-12T17:29:54.950429+0000","last_became_peered":"2024-09-12T17:29:54.950429+0000","last_unstale":"2024-09-12T18:08:17.408456+0000","last_undegraded":"2024-09-12T18:08:17.408456+0000","last_fullsized":"2024-09-12T18:08:17.408456+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-12T18:08:17.408371+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-12T18:08:17.408371+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.408371+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:54.397921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":726,"num_read_kb":598,"num_write":255,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'195","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.186496+0000","last_change":"2024-09-12T18:08:10.186496+0000","last_active":"2024-09-12T18:08:10.186496+0000","last_peered":"2024-09-12T18:08:10.186496+0000","last_clean":"2024-09-12T18:08:10.186496+0000","last_became_active":"2024-09-12T17:29:52.966561+0000","last_became_peered":"2024-09-12T17:29:52.966561+0000","last_unstale":"2024-09-12T18:08:10.186496+0000","last_undegraded":"2024-09-12T18:08:10.186496+0000","last_fullsized":"2024-09-12T18:08:10.186496+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T18:08:10.186388+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T18:08:10.186388+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.186388+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:55.665607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":24994,"num_write":951,"num_write_kb":31573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.295158+0000","last_change":"2024-09-12T18:08:27.295158+0000","last_active":"2024-09-12T18:08:27.295158+0000","last_peered":"2024-09-12T18:08:27.295158+0000","last_clean":"2024-09-12T18:08:27.295158+0000","last_became_active":"2024-09-12T17:29:56.959185+0000","last_became_peered":"2024-09-12T17:29:56.959185+0000","last_unstale":"2024-09-12T18:08:27.295158+0000","last_undegraded":"2024-09-12T18:08:27.295158+0000","last_fullsized":"2024-09-12T18:08:27.295158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.295061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.295061+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.295061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:11.612594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'66","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.823689+0000","last_change":"2024-09-12T18:08:32.823689+0000","last_active":"2024-09-12T18:08:32.823689+0000","last_peered":"2024-09-12T18:08:32.823689+0000","last_clean":"2024-09-12T18:08:32.823689+0000","last_became_active":"2024-09-12T17:29:58.978247+0000","last_became_peered":"2024-09-12T17:29:58.978247+0000","last_unstale":"2024-09-12T18:08:32.823689+0000","last_undegraded":"2024-09-12T18:08:32.823689+0000","last_fullsized":"2024-09-12T18:08:32.823689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-12T18:08:32.823591+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-12T18:08:32.823591+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.823591+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:19.158862+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":59,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'759","reported_seq":2193,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.983428+0000","last_change":"2024-09-12T18:08:30.983428+0000","last_active":"2024-09-12T18:08:30.983428+0000","last_peered":"2024-09-12T18:08:30.983428+0000","last_clean":"2024-09-12T18:08:30.983428+0000","last_became_active":"2024-09-12T17:30:00.961928+0000","last_became_peered":"2024-09-12T17:30:00.961928+0000","last_unstale":"2024-09-12T18:08:30.983428+0000","last_undegraded":"2024-09-12T18:08:30.983428+0000","last_fullsized":"2024-09-12T18:08:30.983428+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'759","last_scrub_stamp":"2024-09-12T18:08:30.983344+0000","last_deep_scrub":"264'759","last_deep_scrub_stamp":"2024-09-12T18:08:30.983344+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.983344+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:19.296324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'103","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.027212+0000","last_change":"2024-09-12T18:08:43.027212+0000","last_active":"2024-09-12T18:08:43.027212+0000","last_peered":"2024-09-12T18:08:43.027212+0000","last_clean":"2024-09-12T18:08:43.027212+0000","last_became_active":"2024-09-12T17:30:02.963474+0000","last_became_peered":"2024-09-12T17:30:02.963474+0000","last_unstale":"2024-09-12T18:08:43.027212+0000","last_undegraded":"2024-09-12T18:08:43.027212+0000","last_fullsized":"2024-09-12T18:08:43.027212+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'103","last_scrub_stamp":"2024-09-12T18:08:43.027123+0000","last_deep_scrub":"264'103","last_deep_scrub_stamp":"2024-09-12T18:08:43.027123+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.027123+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:42.051090+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'463","reported_seq":1195,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.709763+0000","last_change":"2024-09-12T18:08:19.709763+0000","last_active":"2024-09-12T18:08:19.709763+0000","last_peered":"2024-09-12T18:08:19.709763+0000","last_clean":"2024-09-12T18:08:19.709763+0000","last_became_active":"2024-09-12T17:29:54.954344+0000","last_became_peered":"2024-09-12T17:29:54.954344+0000","last_unstale":"2024-09-12T18:08:19.709763+0000","last_undegraded":"2024-09-12T18:08:19.709763+0000","last_fullsized":"2024-09-12T18:08:19.709763+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'463","last_scrub_stamp":"2024-09-12T18:08:19.709661+0000","last_deep_scrub":"264'463","last_deep_scrub_stamp":"2024-09-12T18:08:19.709661+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.709661+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:54.883418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":1813,"num_write":696,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25964,"num_omap_keys":102,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'216","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.485347+0000","last_change":"2024-09-12T18:08:13.485347+0000","last_active":"2024-09-12T18:08:13.485347+0000","last_peered":"2024-09-12T18:08:13.485347+0000","last_clean":"2024-09-12T18:08:13.485347+0000","last_became_active":"2024-09-12T17:30:28.008012+0000","last_became_peered":"2024-09-12T17:30:28.008012+0000","last_unstale":"2024-09-12T18:08:13.485347+0000","last_undegraded":"2024-09-12T18:08:13.485347+0000","last_fullsized":"2024-09-12T18:08:13.485347+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'216","last_scrub_stamp":"2024-09-12T18:08:13.485242+0000","last_deep_scrub":"264'216","last_deep_scrub_stamp":"2024-09-12T18:08:13.485242+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.485242+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.011332+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395846,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":11221,"num_write":1057,"num_write_kb":38249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.839996+0000","last_change":"2024-09-12T18:08:30.839996+0000","last_active":"2024-09-12T18:08:30.839996+0000","last_peered":"2024-09-12T18:08:30.839996+0000","last_clean":"2024-09-12T18:08:30.839996+0000","last_became_active":"2024-09-12T17:29:56.959496+0000","last_became_peered":"2024-09-12T17:29:56.959496+0000","last_unstale":"2024-09-12T18:08:30.839996+0000","last_undegraded":"2024-09-12T18:08:30.839996+0000","last_fullsized":"2024-09-12T18:08:30.839996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:30.839903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:30.839903+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.839903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:30.580080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'152","reported_seq":727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.526801+0000","last_change":"2024-09-12T18:08:37.526801+0000","last_active":"2024-09-12T18:08:37.526801+0000","last_peered":"2024-09-12T18:08:37.526801+0000","last_clean":"2024-09-12T18:08:37.526801+0000","last_became_active":"2024-09-12T17:29:58.956214+0000","last_became_peered":"2024-09-12T17:29:58.956214+0000","last_unstale":"2024-09-12T18:08:37.526801+0000","last_undegraded":"2024-09-12T18:08:37.526801+0000","last_fullsized":"2024-09-12T18:08:37.526801+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-12T18:08:37.526690+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-12T18:08:37.526690+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.526690+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:57.107449+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7681,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":254,"num_write":108,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.269003+0000","last_change":"2024-09-12T18:08:38.268913+0000","last_active":"2024-09-12T18:08:38.269003+0000","last_peered":"2024-09-12T18:08:38.269003+0000","last_clean":"2024-09-12T18:08:38.269003+0000","last_became_active":"2024-09-12T17:30:00.964150+0000","last_became_peered":"2024-09-12T17:30:00.964150+0000","last_unstale":"2024-09-12T18:08:38.269003+0000","last_undegraded":"2024-09-12T18:08:38.269003+0000","last_fullsized":"2024-09-12T18:08:38.269003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:38.268825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:38.268825+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.268825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:00.721111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'176","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.693081+0000","last_change":"2024-09-12T17:30:02.972717+0000","last_active":"2024-09-12T18:06:19.693081+0000","last_peered":"2024-09-12T18:06:19.693081+0000","last_clean":"2024-09-12T18:06:19.693081+0000","last_became_active":"2024-09-12T17:30:02.972420+0000","last_became_peered":"2024-09-12T17:30:02.972420+0000","last_unstale":"2024-09-12T18:06:19.693081+0000","last_undegraded":"2024-09-12T18:06:19.693081+0000","last_fullsized":"2024-09-12T18:06:19.693081+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":302,"num_write":451,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'323","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.712424+0000","last_change":"2024-09-12T18:08:18.712424+0000","last_active":"2024-09-12T18:08:18.712424+0000","last_peered":"2024-09-12T18:08:18.712424+0000","last_clean":"2024-09-12T18:08:18.712424+0000","last_became_active":"2024-09-12T17:29:54.953626+0000","last_became_peered":"2024-09-12T17:29:54.953626+0000","last_unstale":"2024-09-12T18:08:18.712424+0000","last_undegraded":"2024-09-12T18:08:18.712424+0000","last_fullsized":"2024-09-12T18:08:18.712424+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-12T18:08:18.712342+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-12T18:08:18.712342+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.712342+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:25.450466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1393,"num_read_kb":1115,"num_write":522,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'171","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.435392+0000","last_change":"2024-09-12T18:08:14.435392+0000","last_active":"2024-09-12T18:08:14.435392+0000","last_peered":"2024-09-12T18:08:14.435392+0000","last_clean":"2024-09-12T18:08:14.435392+0000","last_became_active":"2024-09-12T17:30:28.200981+0000","last_became_peered":"2024-09-12T17:30:28.200981+0000","last_unstale":"2024-09-12T18:08:14.435392+0000","last_undegraded":"2024-09-12T18:08:14.435392+0000","last_fullsized":"2024-09-12T18:08:14.435392+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T18:08:14.435270+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T18:08:14.435270+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.435270+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:50.031909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755684,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":377,"num_read_kb":41427,"num_write":835,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.468324+0000","last_change":"2024-09-12T18:08:35.468324+0000","last_active":"2024-09-12T18:08:35.468324+0000","last_peered":"2024-09-12T18:08:35.468324+0000","last_clean":"2024-09-12T18:08:35.468324+0000","last_became_active":"2024-09-12T17:29:56.955532+0000","last_became_peered":"2024-09-12T17:29:56.955532+0000","last_unstale":"2024-09-12T18:08:35.468324+0000","last_undegraded":"2024-09-12T18:08:35.468324+0000","last_fullsized":"2024-09-12T18:08:35.468324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:35.468227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:35.468227+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.468227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:04.731076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'126","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.252600+0000","last_change":"2024-09-12T18:08:32.252524+0000","last_active":"2024-09-12T18:08:32.252600+0000","last_peered":"2024-09-12T18:08:32.252600+0000","last_clean":"2024-09-12T18:08:32.252600+0000","last_became_active":"2024-09-12T17:29:58.960733+0000","last_became_peered":"2024-09-12T17:29:58.960733+0000","last_unstale":"2024-09-12T18:08:32.252600+0000","last_undegraded":"2024-09-12T18:08:32.252600+0000","last_fullsized":"2024-09-12T18:08:32.252600+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-12T18:08:32.252437+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-12T18:08:32.252437+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.252437+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:58.278526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9021,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":245,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.965744+0000","last_change":"2024-09-12T18:08:29.965744+0000","last_active":"2024-09-12T18:08:29.965744+0000","last_peered":"2024-09-12T18:08:29.965744+0000","last_clean":"2024-09-12T18:08:29.965744+0000","last_became_active":"2024-09-12T17:30:00.960358+0000","last_became_peered":"2024-09-12T17:30:00.960358+0000","last_unstale":"2024-09-12T18:08:29.965744+0000","last_undegraded":"2024-09-12T18:08:29.965744+0000","last_fullsized":"2024-09-12T18:08:29.965744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:29.965658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:29.965658+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.965658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:13.910376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'157","reported_seq":684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:06:19.541458+0000","last_change":"2024-09-12T17:30:02.964368+0000","last_active":"2024-09-12T18:06:19.541458+0000","last_peered":"2024-09-12T18:06:19.541458+0000","last_clean":"2024-09-12T18:06:19.541458+0000","last_became_active":"2024-09-12T17:30:02.964082+0000","last_became_peered":"2024-09-12T17:30:02.964082+0000","last_unstale":"2024-09-12T18:06:19.541458+0000","last_undegraded":"2024-09-12T18:06:19.541458+0000","last_fullsized":"2024-09-12T18:06:19.541458+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.943666+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.943666+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":313,"num_read_kb":292,"num_write":397,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'220","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.029703+0000","last_change":"2024-09-12T18:08:22.029640+0000","last_active":"2024-09-12T18:08:22.029703+0000","last_peered":"2024-09-12T18:08:22.029703+0000","last_clean":"2024-09-12T18:08:22.029703+0000","last_became_active":"2024-09-12T17:29:54.945602+0000","last_became_peered":"2024-09-12T17:29:54.945602+0000","last_unstale":"2024-09-12T18:08:22.029703+0000","last_undegraded":"2024-09-12T18:08:22.029703+0000","last_fullsized":"2024-09-12T18:08:22.029703+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-09-12T18:08:22.029561+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-09-12T18:08:22.029561+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.029561+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:33.368230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":778,"num_write":336,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'201","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.016294+0000","last_change":"2024-09-12T18:08:11.016294+0000","last_active":"2024-09-12T18:08:11.016294+0000","last_peered":"2024-09-12T18:08:11.016294+0000","last_clean":"2024-09-12T18:08:11.016294+0000","last_became_active":"2024-09-12T17:29:52.954457+0000","last_became_peered":"2024-09-12T17:29:52.954457+0000","last_unstale":"2024-09-12T18:08:11.016294+0000","last_undegraded":"2024-09-12T18:08:11.016294+0000","last_fullsized":"2024-09-12T18:08:11.016294+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-12T18:08:11.016216+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-12T18:08:11.016216+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.016216+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:39.597855+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":114782,"num_write":980,"num_write_kb":45150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.819088+0000","last_change":"2024-09-12T18:08:29.819020+0000","last_active":"2024-09-12T18:08:29.819088+0000","last_peered":"2024-09-12T18:08:29.819088+0000","last_clean":"2024-09-12T18:08:29.819088+0000","last_became_active":"2024-09-12T17:29:56.952946+0000","last_became_peered":"2024-09-12T17:29:56.952946+0000","last_unstale":"2024-09-12T18:08:29.819088+0000","last_undegraded":"2024-09-12T18:08:29.819088+0000","last_fullsized":"2024-09-12T18:08:29.819088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:29.818910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:29.818910+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.818910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:38.285964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'107","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.857386+0000","last_change":"2024-09-12T18:08:35.857386+0000","last_active":"2024-09-12T18:08:35.857386+0000","last_peered":"2024-09-12T18:08:35.857386+0000","last_clean":"2024-09-12T18:08:35.857386+0000","last_became_active":"2024-09-12T17:29:58.953283+0000","last_became_peered":"2024-09-12T17:29:58.953283+0000","last_unstale":"2024-09-12T18:08:35.857386+0000","last_undegraded":"2024-09-12T18:08:35.857386+0000","last_fullsized":"2024-09-12T18:08:35.857386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-12T18:08:35.857292+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-12T18:08:35.857292+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.857292+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:41.329996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":172,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.730107+0000","last_change":"2024-09-12T18:08:41.730107+0000","last_active":"2024-09-12T18:08:41.730107+0000","last_peered":"2024-09-12T18:08:41.730107+0000","last_clean":"2024-09-12T18:08:41.730107+0000","last_became_active":"2024-09-12T17:30:00.962703+0000","last_became_peered":"2024-09-12T17:30:00.962703+0000","last_unstale":"2024-09-12T18:08:41.730107+0000","last_undegraded":"2024-09-12T18:08:41.730107+0000","last_fullsized":"2024-09-12T18:08:41.730107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:41.730016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:41.730016+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.730016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:48.884526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'187","reported_seq":1652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.024563+0000","last_change":"2024-09-12T18:08:44.024496+0000","last_active":"2024-09-12T18:08:44.024563+0000","last_peered":"2024-09-12T18:08:44.024563+0000","last_clean":"2024-09-12T18:08:44.024563+0000","last_became_active":"2024-09-12T17:30:02.970633+0000","last_became_peered":"2024-09-12T17:30:02.970633+0000","last_unstale":"2024-09-12T18:08:44.024563+0000","last_undegraded":"2024-09-12T18:08:44.024563+0000","last_fullsized":"2024-09-12T18:08:44.024563+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-12T18:08:44.024393+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-12T18:08:44.024393+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.024393+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:31.627824+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1219,"num_read_kb":1215,"num_write":406,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'174","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.696868+0000","last_change":"2024-09-12T18:08:17.696777+0000","last_active":"2024-09-12T18:08:17.696868+0000","last_peered":"2024-09-12T18:08:17.696868+0000","last_clean":"2024-09-12T18:08:17.696868+0000","last_became_active":"2024-09-12T17:29:54.954585+0000","last_became_peered":"2024-09-12T17:29:54.954585+0000","last_unstale":"2024-09-12T18:08:17.696868+0000","last_undegraded":"2024-09-12T18:08:17.696868+0000","last_fullsized":"2024-09-12T18:08:17.696868+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:08:17.696671+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:08:17.696671+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.696671+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:23.668390+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":606,"num_write":278,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'199","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.144279+0000","last_change":"2024-09-12T18:08:11.144279+0000","last_active":"2024-09-12T18:08:11.144279+0000","last_peered":"2024-09-12T18:08:11.144279+0000","last_clean":"2024-09-12T18:08:11.144279+0000","last_became_active":"2024-09-12T17:29:52.956621+0000","last_became_peered":"2024-09-12T17:29:52.956621+0000","last_unstale":"2024-09-12T18:08:11.144279+0000","last_undegraded":"2024-09-12T18:08:11.144279+0000","last_fullsized":"2024-09-12T18:08:11.144279+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-12T18:08:11.144146+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-12T18:08:11.144146+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.144146+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:24.182892+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3104916,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":909,"num_read_kb":17688,"num_write":1020,"num_write_kb":27781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.296375+0000","last_change":"2024-09-12T18:08:26.296277+0000","last_active":"2024-09-12T18:08:26.296375+0000","last_peered":"2024-09-12T18:08:26.296375+0000","last_clean":"2024-09-12T18:08:26.296375+0000","last_became_active":"2024-09-12T17:29:56.954952+0000","last_became_peered":"2024-09-12T17:29:56.954952+0000","last_unstale":"2024-09-12T18:08:26.296375+0000","last_undegraded":"2024-09-12T18:08:26.296375+0000","last_fullsized":"2024-09-12T18:08:26.296375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:26.296172+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:26.296172+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.296172+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:56.807921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'142","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.785541+0000","last_change":"2024-09-12T18:08:39.785541+0000","last_active":"2024-09-12T18:08:39.785541+0000","last_peered":"2024-09-12T18:08:39.785541+0000","last_clean":"2024-09-12T18:08:39.785541+0000","last_became_active":"2024-09-12T17:29:58.953076+0000","last_became_peered":"2024-09-12T17:29:58.953076+0000","last_unstale":"2024-09-12T18:08:39.785541+0000","last_undegraded":"2024-09-12T18:08:39.785541+0000","last_fullsized":"2024-09-12T18:08:39.785541+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:08:39.785415+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:08:39.785415+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.785415+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:34.382114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9014,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":204,"num_read_kb":286,"num_write":112,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.259752+0000","last_change":"2024-09-12T18:08:39.259752+0000","last_active":"2024-09-12T18:08:39.259752+0000","last_peered":"2024-09-12T18:08:39.259752+0000","last_clean":"2024-09-12T18:08:39.259752+0000","last_became_active":"2024-09-12T17:30:00.964942+0000","last_became_peered":"2024-09-12T17:30:00.964942+0000","last_unstale":"2024-09-12T18:08:39.259752+0000","last_undegraded":"2024-09-12T18:08:39.259752+0000","last_fullsized":"2024-09-12T18:08:39.259752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:39.259657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:39.259657+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.259657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:46.708226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'118","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.790668+0000","last_change":"2024-09-12T18:08:38.790668+0000","last_active":"2024-09-12T18:08:38.790668+0000","last_peered":"2024-09-12T18:08:38.790668+0000","last_clean":"2024-09-12T18:08:38.790668+0000","last_became_active":"2024-09-12T17:30:02.969327+0000","last_became_peered":"2024-09-12T17:30:02.969327+0000","last_unstale":"2024-09-12T18:08:38.790668+0000","last_undegraded":"2024-09-12T18:08:38.790668+0000","last_fullsized":"2024-09-12T18:08:38.790668+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-12T18:08:38.790589+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-12T18:08:38.790589+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.790589+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:45.940956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":150,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'198","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.318566+0000","last_change":"2024-09-12T18:08:23.318566+0000","last_active":"2024-09-12T18:08:23.318566+0000","last_peered":"2024-09-12T18:08:23.318566+0000","last_clean":"2024-09-12T18:08:23.318566+0000","last_became_active":"2024-09-12T17:29:54.956020+0000","last_became_peered":"2024-09-12T17:29:54.956020+0000","last_unstale":"2024-09-12T18:08:23.318566+0000","last_undegraded":"2024-09-12T18:08:23.318566+0000","last_fullsized":"2024-09-12T18:08:23.318566+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'198","last_scrub_stamp":"2024-09-12T18:08:23.318478+0000","last_deep_scrub":"264'198","last_deep_scrub_stamp":"2024-09-12T18:08:23.318478+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.318478+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:06.926356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":702,"num_write":286,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'210","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.023692+0000","last_change":"2024-09-12T18:08:13.023692+0000","last_active":"2024-09-12T18:08:13.023692+0000","last_peered":"2024-09-12T18:08:13.023692+0000","last_clean":"2024-09-12T18:08:13.023692+0000","last_became_active":"2024-09-12T17:29:52.963118+0000","last_became_peered":"2024-09-12T17:29:52.963118+0000","last_unstale":"2024-09-12T18:08:13.023692+0000","last_undegraded":"2024-09-12T18:08:13.023692+0000","last_fullsized":"2024-09-12T18:08:13.023692+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-12T18:08:13.023594+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-12T18:08:13.023594+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.023594+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.908176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":444,"num_read_kb":2786,"num_write":996,"num_write_kb":44194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'222","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.295537+0000","last_change":"2024-09-12T18:08:22.295537+0000","last_active":"2024-09-12T18:08:22.295537+0000","last_peered":"2024-09-12T18:08:22.295537+0000","last_clean":"2024-09-12T18:08:22.295537+0000","last_became_active":"2024-09-12T17:29:54.947659+0000","last_became_peered":"2024-09-12T17:29:54.947659+0000","last_unstale":"2024-09-12T18:08:22.295537+0000","last_undegraded":"2024-09-12T18:08:22.295537+0000","last_fullsized":"2024-09-12T18:08:22.295537+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-09-12T18:08:22.295452+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-09-12T18:08:22.295452+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.295452+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.342588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":954,"num_read_kb":780,"num_write":336,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'187","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.321394+0000","last_change":"2024-09-12T18:08:12.321394+0000","last_active":"2024-09-12T18:08:12.321394+0000","last_peered":"2024-09-12T18:08:12.321394+0000","last_clean":"2024-09-12T18:08:12.321394+0000","last_became_active":"2024-09-12T17:29:52.955546+0000","last_became_peered":"2024-09-12T17:29:52.955546+0000","last_unstale":"2024-09-12T18:08:12.321394+0000","last_undegraded":"2024-09-12T18:08:12.321394+0000","last_fullsized":"2024-09-12T18:08:12.321394+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-12T18:08:12.321242+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-12T18:08:12.321242+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.321242+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:11.147772+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5712374,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":628,"num_read_kb":171668,"num_write":902,"num_write_kb":49213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'156","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.439837+0000","last_change":"2024-09-12T18:08:26.439837+0000","last_active":"2024-09-12T18:08:26.439837+0000","last_peered":"2024-09-12T18:08:26.439837+0000","last_clean":"2024-09-12T18:08:26.439837+0000","last_became_active":"2024-09-12T17:29:54.958047+0000","last_became_peered":"2024-09-12T17:29:54.958047+0000","last_unstale":"2024-09-12T18:08:26.439837+0000","last_undegraded":"2024-09-12T18:08:26.439837+0000","last_fullsized":"2024-09-12T18:08:26.439837+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-12T18:08:26.439752+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-12T18:08:26.439752+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.439752+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:46.015233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":718,"num_read_kb":592,"num_write":271,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'177","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.466300+0000","last_change":"2024-09-12T18:08:16.466300+0000","last_active":"2024-09-12T18:08:16.466300+0000","last_peered":"2024-09-12T18:08:16.466300+0000","last_clean":"2024-09-12T18:08:16.466300+0000","last_became_active":"2024-09-12T17:29:52.955924+0000","last_became_peered":"2024-09-12T17:29:52.955924+0000","last_unstale":"2024-09-12T18:08:16.466300+0000","last_undegraded":"2024-09-12T18:08:16.466300+0000","last_fullsized":"2024-09-12T18:08:16.466300+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:08:16.466188+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:08:16.466188+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.466188+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:45.623269+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4131368,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":446,"num_read_kb":86465,"num_write":876,"num_write_kb":34463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'67","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.278214+0000","last_change":"2024-09-12T18:08:20.278214+0000","last_active":"2024-09-12T18:08:20.278214+0000","last_peered":"2024-09-12T18:08:20.278214+0000","last_clean":"2024-09-12T18:08:20.278214+0000","last_became_active":"2024-09-12T17:29:54.956587+0000","last_became_peered":"2024-09-12T17:29:54.956587+0000","last_unstale":"2024-09-12T18:08:20.278214+0000","last_undegraded":"2024-09-12T18:08:20.278214+0000","last_fullsized":"2024-09-12T18:08:20.278214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-09-12T18:08:20.278133+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-09-12T18:08:20.278133+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.278133+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:53.896456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":238,"num_write":111,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'195","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.116624+0000","last_change":"2024-09-12T18:08:12.116624+0000","last_active":"2024-09-12T18:08:12.116624+0000","last_peered":"2024-09-12T18:08:12.116624+0000","last_clean":"2024-09-12T18:08:12.116624+0000","last_became_active":"2024-09-12T17:29:52.961103+0000","last_became_peered":"2024-09-12T17:29:52.961103+0000","last_unstale":"2024-09-12T18:08:12.116624+0000","last_undegraded":"2024-09-12T18:08:12.116624+0000","last_fullsized":"2024-09-12T18:08:12.116624+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T18:08:12.116514+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T18:08:12.116514+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.116514+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:09.737301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":61034,"num_write":905,"num_write_kb":21974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'80","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.006108+0000","last_change":"2024-09-12T18:08:29.006108+0000","last_active":"2024-09-12T18:08:29.006108+0000","last_peered":"2024-09-12T18:08:29.006108+0000","last_clean":"2024-09-12T18:08:29.006108+0000","last_became_active":"2024-09-12T17:29:54.955986+0000","last_became_peered":"2024-09-12T17:29:54.955986+0000","last_unstale":"2024-09-12T18:08:29.006108+0000","last_undegraded":"2024-09-12T18:08:29.006108+0000","last_fullsized":"2024-09-12T18:08:29.006108+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'80","last_scrub_stamp":"2024-09-12T18:08:29.006010+0000","last_deep_scrub":"264'80","last_deep_scrub_stamp":"2024-09-12T18:08:29.006010+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.006010+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.958435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":303,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'242","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.385914+0000","last_change":"2024-09-12T18:08:16.385838+0000","last_active":"2024-09-12T18:08:16.385914+0000","last_peered":"2024-09-12T18:08:16.385914+0000","last_clean":"2024-09-12T18:08:16.385914+0000","last_became_active":"2024-09-12T17:31:28.509017+0000","last_became_peered":"2024-09-12T17:31:28.509017+0000","last_unstale":"2024-09-12T18:08:16.385914+0000","last_undegraded":"2024-09-12T18:08:16.385914+0000","last_fullsized":"2024-09-12T18:08:16.385914+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'242","last_scrub_stamp":"2024-09-12T18:08:16.385665+0000","last_deep_scrub":"264'242","last_deep_scrub_stamp":"2024-09-12T18:08:16.385665+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.385665+0000","objects_scrubbed":12,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:17.985445+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9316189,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":509,"num_read_kb":51273,"num_write":1111,"num_write_kb":73287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"264'52","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.707353+0000","last_change":"2024-09-12T18:08:20.707353+0000","last_active":"2024-09-12T18:08:20.707353+0000","last_peered":"2024-09-12T18:08:20.707353+0000","last_clean":"2024-09-12T18:08:20.707353+0000","last_became_active":"2024-09-12T17:29:54.957480+0000","last_became_peered":"2024-09-12T17:29:54.957480+0000","last_unstale":"2024-09-12T18:08:20.707353+0000","last_undegraded":"2024-09-12T18:08:20.707353+0000","last_fullsized":"2024-09-12T18:08:20.707353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-12T18:08:20.707268+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-12T18:08:20.707268+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.707268+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:31.235559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":218,"num_write":68,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'172","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.244570+0000","last_change":"2024-09-12T18:08:15.244570+0000","last_active":"2024-09-12T18:08:15.244570+0000","last_peered":"2024-09-12T18:08:15.244570+0000","last_clean":"2024-09-12T18:08:15.244570+0000","last_became_active":"2024-09-12T17:29:52.945750+0000","last_became_peered":"2024-09-12T17:29:52.945750+0000","last_unstale":"2024-09-12T18:08:15.244570+0000","last_undegraded":"2024-09-12T18:08:15.244570+0000","last_fullsized":"2024-09-12T18:08:15.244570+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'172","last_scrub_stamp":"2024-09-12T18:08:15.244411+0000","last_deep_scrub":"264'172","last_deep_scrub_stamp":"2024-09-12T18:08:15.244411+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.244411+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:04.460342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":408,"num_read_kb":12063,"num_write":843,"num_write_kb":23165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'78","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.070644+0000","last_change":"2024-09-12T18:08:23.070644+0000","last_active":"2024-09-12T18:08:23.070644+0000","last_peered":"2024-09-12T18:08:23.070644+0000","last_clean":"2024-09-12T18:08:23.070644+0000","last_became_active":"2024-09-12T17:29:54.949704+0000","last_became_peered":"2024-09-12T17:29:54.949704+0000","last_unstale":"2024-09-12T18:08:23.070644+0000","last_undegraded":"2024-09-12T18:08:23.070644+0000","last_fullsized":"2024-09-12T18:08:23.070644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-09-12T18:08:23.070551+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-09-12T18:08:23.070551+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.070551+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:51.197271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":312,"num_write":123,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'203","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.047419+0000","last_change":"2024-09-12T18:08:14.047419+0000","last_active":"2024-09-12T18:08:14.047419+0000","last_peered":"2024-09-12T18:08:14.047419+0000","last_clean":"2024-09-12T18:08:14.047419+0000","last_became_active":"2024-09-12T17:29:52.960336+0000","last_became_peered":"2024-09-12T17:29:52.960336+0000","last_unstale":"2024-09-12T18:08:14.047419+0000","last_undegraded":"2024-09-12T18:08:14.047419+0000","last_fullsized":"2024-09-12T18:08:14.047419+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-12T18:08:14.047306+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-12T18:08:14.047306+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.047306+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:01.929338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524427,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":45667,"num_write":962,"num_write_kb":42266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'76","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.108330+0000","last_change":"2024-09-12T18:08:21.108330+0000","last_active":"2024-09-12T18:08:21.108330+0000","last_peered":"2024-09-12T18:08:21.108330+0000","last_clean":"2024-09-12T18:08:21.108330+0000","last_became_active":"2024-09-12T17:29:54.956296+0000","last_became_peered":"2024-09-12T17:29:54.956296+0000","last_unstale":"2024-09-12T18:08:21.108330+0000","last_undegraded":"2024-09-12T18:08:21.108330+0000","last_fullsized":"2024-09-12T18:08:21.108330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'76","last_scrub_stamp":"2024-09-12T18:08:21.108246+0000","last_deep_scrub":"264'76","last_deep_scrub_stamp":"2024-09-12T18:08:21.108246+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.108246+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:09.120650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":291,"num_write":101,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'208","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.066221+0000","last_change":"2024-09-12T18:08:13.066221+0000","last_active":"2024-09-12T18:08:13.066221+0000","last_peered":"2024-09-12T18:08:13.066221+0000","last_clean":"2024-09-12T18:08:13.066221+0000","last_became_active":"2024-09-12T17:29:52.953110+0000","last_became_peered":"2024-09-12T17:29:52.953110+0000","last_unstale":"2024-09-12T18:08:13.066221+0000","last_undegraded":"2024-09-12T18:08:13.066221+0000","last_fullsized":"2024-09-12T18:08:13.066221+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T18:08:13.066097+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T18:08:13.066097+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.066097+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:34.052495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":64382,"num_write":937,"num_write_kb":39967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'142","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.133795+0000","last_change":"2024-09-12T18:08:22.133795+0000","last_active":"2024-09-12T18:08:22.133795+0000","last_peered":"2024-09-12T18:08:22.133795+0000","last_clean":"2024-09-12T18:08:22.133795+0000","last_became_active":"2024-09-12T17:29:54.944775+0000","last_became_peered":"2024-09-12T17:29:54.944775+0000","last_unstale":"2024-09-12T18:08:22.133795+0000","last_undegraded":"2024-09-12T18:08:22.133795+0000","last_fullsized":"2024-09-12T18:08:22.133795+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:08:22.133695+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:08:22.133695+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.133695+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:48.310100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":576,"num_read_kb":470,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'239","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.450063+0000","last_change":"2024-09-12T18:08:17.450063+0000","last_active":"2024-09-12T18:08:17.450063+0000","last_peered":"2024-09-12T18:08:17.450063+0000","last_clean":"2024-09-12T18:08:17.450063+0000","last_became_active":"2024-09-12T17:29:52.952892+0000","last_became_peered":"2024-09-12T17:29:52.952892+0000","last_unstale":"2024-09-12T18:08:17.450063+0000","last_undegraded":"2024-09-12T18:08:17.450063+0000","last_fullsized":"2024-09-12T18:08:17.450063+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'239","last_scrub_stamp":"2024-09-12T18:08:17.449925+0000","last_deep_scrub":"264'239","last_deep_scrub_stamp":"2024-09-12T18:08:17.449925+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.449925+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:31.739549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1423505,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":801,"num_read_kb":90532,"num_write":1295,"num_write_kb":28113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'4190","reported_seq":4824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.763924+0000","last_change":"2024-09-12T18:08:22.763924+0000","last_active":"2024-09-12T18:08:22.763924+0000","last_peered":"2024-09-12T18:08:22.763924+0000","last_clean":"2024-09-12T18:08:22.763924+0000","last_became_active":"2024-09-12T17:29:54.956030+0000","last_became_peered":"2024-09-12T17:29:54.956030+0000","last_unstale":"2024-09-12T18:08:22.763924+0000","last_undegraded":"2024-09-12T18:08:22.763924+0000","last_fullsized":"2024-09-12T18:08:22.763924+0000","mapping_epoch":26,"log_start":"264'4100","ondisk_log_start":"264'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4190","last_scrub_stamp":"2024-09-12T18:08:22.763830+0000","last_deep_scrub":"264'4190","last_deep_scrub_stamp":"2024-09-12T18:08:22.763830+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.763830+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":3000,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:13.600432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16971,"num_read_kb":14174,"num_write":6344,"num_write_kb":3204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'200","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.106345+0000","last_change":"2024-09-12T18:08:15.106345+0000","last_active":"2024-09-12T18:08:15.106345+0000","last_peered":"2024-09-12T18:08:15.106345+0000","last_clean":"2024-09-12T18:08:15.106345+0000","last_became_active":"2024-09-12T17:29:52.953694+0000","last_became_peered":"2024-09-12T17:29:52.953694+0000","last_unstale":"2024-09-12T18:08:15.106345+0000","last_undegraded":"2024-09-12T18:08:15.106345+0000","last_fullsized":"2024-09-12T18:08:15.106345+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-12T18:08:15.106190+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-12T18:08:15.106190+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.106190+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:05.110290+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174802,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":9241,"num_write":950,"num_write_kb":54194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'299","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.364780+0000","last_change":"2024-09-12T18:08:14.364687+0000","last_active":"2024-09-12T18:08:14.364780+0000","last_peered":"2024-09-12T18:08:14.364780+0000","last_clean":"2024-09-12T18:08:14.364780+0000","last_became_active":"2024-09-12T17:29:54.954593+0000","last_became_peered":"2024-09-12T17:29:54.954593+0000","last_unstale":"2024-09-12T18:08:14.364780+0000","last_undegraded":"2024-09-12T18:08:14.364780+0000","last_fullsized":"2024-09-12T18:08:14.364780+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T18:08:14.364594+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T18:08:14.364594+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.364594+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:32.644840+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1407,"num_read_kb":1154,"num_write":474,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4002,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'211","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.452953+0000","last_change":"2024-09-12T18:08:19.452953+0000","last_active":"2024-09-12T18:08:19.452953+0000","last_peered":"2024-09-12T18:08:19.452953+0000","last_clean":"2024-09-12T18:08:19.452953+0000","last_became_active":"2024-09-12T17:29:52.958021+0000","last_became_peered":"2024-09-12T17:29:52.958021+0000","last_unstale":"2024-09-12T18:08:19.452953+0000","last_undegraded":"2024-09-12T18:08:19.452953+0000","last_fullsized":"2024-09-12T18:08:19.452953+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-09-12T18:08:19.452849+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-09-12T18:08:19.452849+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.452849+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:37.690114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174726,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":543,"num_read_kb":26305,"num_write":962,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'301","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.724778+0000","last_change":"2024-09-12T18:08:21.724778+0000","last_active":"2024-09-12T18:08:21.724778+0000","last_peered":"2024-09-12T18:08:21.724778+0000","last_clean":"2024-09-12T18:08:21.724778+0000","last_became_active":"2024-09-12T17:29:54.957636+0000","last_became_peered":"2024-09-12T17:29:54.957636+0000","last_unstale":"2024-09-12T18:08:21.724778+0000","last_undegraded":"2024-09-12T18:08:21.724778+0000","last_fullsized":"2024-09-12T18:08:21.724778+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'301","last_scrub_stamp":"2024-09-12T18:08:21.724693+0000","last_deep_scrub":"264'301","last_deep_scrub_stamp":"2024-09-12T18:08:21.724693+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.724693+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:40.322921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1037,"num_write":475,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'227","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.129459+0000","last_change":"2024-09-12T18:08:13.129459+0000","last_active":"2024-09-12T18:08:13.129459+0000","last_peered":"2024-09-12T18:08:13.129459+0000","last_clean":"2024-09-12T18:08:13.129459+0000","last_became_active":"2024-09-12T17:29:52.966500+0000","last_became_peered":"2024-09-12T17:29:52.966500+0000","last_unstale":"2024-09-12T18:08:13.129459+0000","last_undegraded":"2024-09-12T18:08:13.129459+0000","last_fullsized":"2024-09-12T18:08:13.129459+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-09-12T18:08:13.129341+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-09-12T18:08:13.129341+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.129341+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:16.854387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254282,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":515,"num_read_kb":34941,"num_write":1118,"num_write_kb":28764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'173","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.802210+0000","last_change":"2024-09-12T18:08:24.802210+0000","last_active":"2024-09-12T18:08:24.802210+0000","last_peered":"2024-09-12T18:08:24.802210+0000","last_clean":"2024-09-12T18:08:24.802210+0000","last_became_active":"2024-09-12T17:30:28.010055+0000","last_became_peered":"2024-09-12T17:30:28.010055+0000","last_unstale":"2024-09-12T18:08:24.802210+0000","last_undegraded":"2024-09-12T18:08:24.802210+0000","last_fullsized":"2024-09-12T18:08:24.802210+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-12T18:08:24.802122+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-12T18:08:24.802122+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.802122+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:48.646433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":614,"num_write":281,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'200","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.071442+0000","last_change":"2024-09-12T18:08:15.071442+0000","last_active":"2024-09-12T18:08:15.071442+0000","last_peered":"2024-09-12T18:08:15.071442+0000","last_clean":"2024-09-12T18:08:15.071442+0000","last_became_active":"2024-09-12T17:29:52.954238+0000","last_became_peered":"2024-09-12T17:29:52.954238+0000","last_unstale":"2024-09-12T18:08:15.071442+0000","last_undegraded":"2024-09-12T18:08:15.071442+0000","last_fullsized":"2024-09-12T18:08:15.071442+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-12T18:08:15.071334+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-12T18:08:15.071334+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.071334+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:38.079896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":33290,"num_write":857,"num_write_kb":39696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'174","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.073348+0000","last_change":"2024-09-12T18:08:20.073348+0000","last_active":"2024-09-12T18:08:20.073348+0000","last_peered":"2024-09-12T18:08:20.073348+0000","last_clean":"2024-09-12T18:08:20.073348+0000","last_became_active":"2024-09-12T17:29:54.944623+0000","last_became_peered":"2024-09-12T17:29:54.944623+0000","last_unstale":"2024-09-12T18:08:20.073348+0000","last_undegraded":"2024-09-12T18:08:20.073348+0000","last_fullsized":"2024-09-12T18:08:20.073348+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:08:20.073256+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:08:20.073256+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.073256+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:47.502492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":587,"num_write":256,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'218","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.693029+0000","last_change":"2024-09-12T18:08:19.693029+0000","last_active":"2024-09-12T18:08:19.693029+0000","last_peered":"2024-09-12T18:08:19.693029+0000","last_clean":"2024-09-12T18:08:19.693029+0000","last_became_active":"2024-09-12T17:29:52.951819+0000","last_became_peered":"2024-09-12T17:29:52.951819+0000","last_unstale":"2024-09-12T18:08:19.693029+0000","last_undegraded":"2024-09-12T18:08:19.693029+0000","last_fullsized":"2024-09-12T18:08:19.693029+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-09-12T18:08:19.692857+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-09-12T18:08:19.692857+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.692857+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:00.897060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287564,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":4445,"num_write":1040,"num_write_kb":38455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'247","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.999378+0000","last_change":"2024-09-12T18:08:25.999378+0000","last_active":"2024-09-12T18:08:25.999378+0000","last_peered":"2024-09-12T18:08:25.999378+0000","last_clean":"2024-09-12T18:08:25.999378+0000","last_became_active":"2024-09-12T17:29:54.950941+0000","last_became_peered":"2024-09-12T17:29:54.950941+0000","last_unstale":"2024-09-12T18:08:25.999378+0000","last_undegraded":"2024-09-12T18:08:25.999378+0000","last_fullsized":"2024-09-12T18:08:25.999378+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'247","last_scrub_stamp":"2024-09-12T18:08:25.999284+0000","last_deep_scrub":"264'247","last_deep_scrub_stamp":"2024-09-12T18:08:25.999284+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.999284+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:39.073844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":842,"num_write":398,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'207","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.297209+0000","last_change":"2024-09-12T18:08:11.297209+0000","last_active":"2024-09-12T18:08:11.297209+0000","last_peered":"2024-09-12T18:08:11.297209+0000","last_clean":"2024-09-12T18:08:11.297209+0000","last_became_active":"2024-09-12T17:29:52.953569+0000","last_became_peered":"2024-09-12T17:29:52.953569+0000","last_unstale":"2024-09-12T18:08:11.297209+0000","last_undegraded":"2024-09-12T18:08:11.297209+0000","last_fullsized":"2024-09-12T18:08:11.297209+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:11.297114+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:11.297114+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.297114+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:20.913969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":380,"num_read_kb":11537,"num_write":1039,"num_write_kb":39628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'119","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.771285+0000","last_change":"2024-09-12T18:08:25.771285+0000","last_active":"2024-09-12T18:08:25.771285+0000","last_peered":"2024-09-12T18:08:25.771285+0000","last_clean":"2024-09-12T18:08:25.771285+0000","last_became_active":"2024-09-12T17:29:54.961615+0000","last_became_peered":"2024-09-12T17:29:54.961615+0000","last_unstale":"2024-09-12T18:08:25.771285+0000","last_undegraded":"2024-09-12T18:08:25.771285+0000","last_fullsized":"2024-09-12T18:08:25.771285+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T18:08:25.771192+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T18:08:25.771192+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.771192+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:13.593353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":544,"num_read_kb":456,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'264","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.495069+0000","last_change":"2024-09-12T18:08:18.495069+0000","last_active":"2024-09-12T18:08:18.495069+0000","last_peered":"2024-09-12T18:08:18.495069+0000","last_clean":"2024-09-12T18:08:18.495069+0000","last_became_active":"2024-09-12T17:29:52.954363+0000","last_became_peered":"2024-09-12T17:29:52.954363+0000","last_unstale":"2024-09-12T18:08:18.495069+0000","last_undegraded":"2024-09-12T18:08:18.495069+0000","last_fullsized":"2024-09-12T18:08:18.495069+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-09-12T18:08:18.494932+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-09-12T18:08:18.494932+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.494932+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:35.278309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505373,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":610,"num_read_kb":60789,"num_write":1183,"num_write_kb":24093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'153","reported_seq":763,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.506389+0000","last_change":"2024-09-12T18:08:21.506389+0000","last_active":"2024-09-12T18:08:21.506389+0000","last_peered":"2024-09-12T18:08:21.506389+0000","last_clean":"2024-09-12T18:08:21.506389+0000","last_became_active":"2024-09-12T17:29:52.952766+0000","last_became_peered":"2024-09-12T17:29:52.952766+0000","last_unstale":"2024-09-12T18:08:21.506389+0000","last_undegraded":"2024-09-12T18:08:21.506389+0000","last_fullsized":"2024-09-12T18:08:21.506389+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-12T18:08:21.506224+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-12T18:08:21.506224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.506224+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:00.437314+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847564,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":395,"num_read_kb":30421,"num_write":779,"num_write_kb":28733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'81","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.164730+0000","last_change":"2024-09-12T18:08:23.164635+0000","last_active":"2024-09-12T18:08:23.164730+0000","last_peered":"2024-09-12T18:08:23.164730+0000","last_clean":"2024-09-12T18:08:23.164730+0000","last_became_active":"2024-09-12T17:29:54.944681+0000","last_became_peered":"2024-09-12T17:29:54.944681+0000","last_unstale":"2024-09-12T18:08:23.164730+0000","last_undegraded":"2024-09-12T18:08:23.164730+0000","last_fullsized":"2024-09-12T18:08:23.164730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'81","last_scrub_stamp":"2024-09-12T18:08:23.164513+0000","last_deep_scrub":"264'81","last_deep_scrub_stamp":"2024-09-12T18:08:23.164513+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.164513+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:48.210606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":330,"num_write":124,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'186","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.243119+0000","last_change":"2024-09-12T18:08:13.243119+0000","last_active":"2024-09-12T18:08:13.243119+0000","last_peered":"2024-09-12T18:08:13.243119+0000","last_clean":"2024-09-12T18:08:13.243119+0000","last_became_active":"2024-09-12T17:29:52.942331+0000","last_became_peered":"2024-09-12T17:29:52.942331+0000","last_unstale":"2024-09-12T18:08:13.243119+0000","last_undegraded":"2024-09-12T18:08:13.243119+0000","last_fullsized":"2024-09-12T18:08:13.243119+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'186","last_scrub_stamp":"2024-09-12T18:08:13.242996+0000","last_deep_scrub":"264'186","last_deep_scrub_stamp":"2024-09-12T18:08:13.242996+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.242996+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:49.416924+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364835,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":15046,"num_write":966,"num_write_kb":38540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'194","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.396144+0000","last_change":"2024-09-12T18:08:27.396085+0000","last_active":"2024-09-12T18:08:27.396144+0000","last_peered":"2024-09-12T18:08:27.396144+0000","last_clean":"2024-09-12T18:08:27.396144+0000","last_became_active":"2024-09-12T17:29:54.962921+0000","last_became_peered":"2024-09-12T17:29:54.962921+0000","last_unstale":"2024-09-12T18:08:27.396144+0000","last_undegraded":"2024-09-12T18:08:27.396144+0000","last_fullsized":"2024-09-12T18:08:27.396144+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'194","last_scrub_stamp":"2024-09-12T18:08:27.396001+0000","last_deep_scrub":"264'194","last_deep_scrub_stamp":"2024-09-12T18:08:27.396001+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.396001+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:39.024494+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":851,"num_read_kb":702,"num_write":304,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":4389,"num_write":1992,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2490,"num_omap_keys":5,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1064,"ondisk_log_size":1064,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":16199,"num_read_kb":15887,"num_write":16770,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2523,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1921,"ondisk_log_size":1921,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":499,"ondisk_log_size":499,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":279568,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7821,"num_read_kb":9826,"num_write":5191,"num_write_kb":2504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":677352,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2108,"ondisk_log_size":2108,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2870,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102452,"num_read_kb":85292,"num_write":37168,"num_write_kb":18720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44038,"num_omap_keys":180,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4239,"ondisk_log_size":4239,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":83899209,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":32969,"num_read_kb":2424206,"num_write":62978,"num_write_kb":2261412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127942656,"data_stored":127942656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4263,"ondisk_log_size":4263,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":207617,"num_write":161,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":201926,"num_write":161,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542619,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217944,"kb_used_data":10440,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94153896,"statfs":{"total":96636764160,"available":96413589504,"internally_reserved":0,"allocated":10690560,"data_stored":8703800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542618,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244176,"kb_used_data":20032,"kb_used_omap":1,"kb_used_meta":224126,"kb_avail":94127664,"statfs":{"total":96636764160,"available":96386727936,"internally_reserved":0,"allocated":20512768,"data_stored":18573799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":229505478},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542620,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122856,"kb_used_data":29272,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94248984,"statfs":{"total":96636764160,"available":96510959616,"internally_reserved":0,"allocated":29974528,"data_stored":27974659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542619,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93540,"kb_used_data":26260,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94278300,"statfs":{"total":96636764160,"available":96540979200,"internally_reserved":0,"allocated":26890240,"data_stored":24978624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542617,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249468,"kb_used_data":19756,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122372,"statfs":{"total":96636764160,"available":96381308928,"internally_reserved":0,"allocated":20230144,"data_stored":18248382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542618,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100664,"kb_used_data":15400,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94271176,"statfs":{"total":96636764160,"available":96533684224,"internally_reserved":0,"allocated":15769600,"data_stored":13844138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542619,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125220,"kb_used_data":13588,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94246620,"statfs":{"total":96636764160,"available":96508538880,"internally_reserved":0,"allocated":13914112,"data_stored":11951207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542618,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262484,"kb_used_data":24452,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94109356,"statfs":{"total":96636764160,"available":96367980544,"internally_reserved":0,"allocated":25038848,"data_stored":23061641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20193280,"data_stored":20193280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9674752,"data_stored":9674752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11567104,"data_stored":11567104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15970304,"data_stored":15970304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22704128,"data_stored":22704128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25698304,"data_stored":25698304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16297984,"data_stored":16297984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5836800,"data_stored":5836800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:08:51.355 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.356 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.356 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.356 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.356 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.356 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.356 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.356 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.356 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.356 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.357 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.357 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.357 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.357 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.357 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.357 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.357 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.357 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.357 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.358 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.358 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.358 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.358 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.358 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.358 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.358 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.358 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.358 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.358 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.359 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.359 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.359 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.359 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.359 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.359 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.359 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.359 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.359 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.360 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.360 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.360 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.360 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.360 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.360 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.360 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.360 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.360 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.361 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.361 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.361 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.361 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.361 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.361 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.361 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.361 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.362 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.362 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.362 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.362 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.362 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.362 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.362 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.362 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.363 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.363 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.363 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.363 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.363 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.363 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.363 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.363 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.364 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.364 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.364 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.364 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.364 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.364 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.364 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.364 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.364 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.365 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.365 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.365 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.365 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.365 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.365 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.365 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.365 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.365 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.366 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.366 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.366 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.366 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:46:41.157153+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.366 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.366 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.366 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.366 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:46:44.178769+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.366 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:45:02.866624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.367 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.368 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.368 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.368 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.369 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.369 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.369 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.369 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.370 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:30:01.943666+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:08:51.370 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:09:11.372 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:09:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:09:11.721 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-09-12T18:09:11.723 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":1445,"stamp":"2024-09-12T18:09:11.320740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84787076,"num_objects":562,"num_object_clones":0,"num_object_copies":1357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":562,"num_whiteouts":0,"num_read":168345,"num_read_kb":2952080,"num_write":124562,"num_write_kb":2564884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731870,"num_omap_keys":1795,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14426,"ondisk_log_size":14426,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1416352,"kb_used_data":159200,"kb_used_omap":12,"kb_used_meta":1257011,"kb_avail":753558368,"statfs":{"total":773094113280,"available":771643768832,"internally_reserved":0,"allocated":163020800,"data_stored":147336250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1287179826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4744,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004949"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:57.321732+0000","last_change":"2024-09-12T18:08:57.321732+0000","last_active":"2024-09-12T18:08:57.321732+0000","last_peered":"2024-09-12T18:08:57.321732+0000","last_clean":"2024-09-12T18:08:57.321732+0000","last_became_active":"2024-09-12T17:57:00.464331+0000","last_became_peered":"2024-09-12T17:57:00.464331+0000","last_unstale":"2024-09-12T18:08:57.321732+0000","last_undegraded":"2024-09-12T18:08:57.321732+0000","last_fullsized":"2024-09-12T18:08:57.321732+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:57.321603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:57.321603+0000","last_clean_scrub_stamp":"2024-09-12T18:08:57.321603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:26.113306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:53.387268+0000","last_change":"2024-09-12T18:08:53.387268+0000","last_active":"2024-09-12T18:08:53.387268+0000","last_peered":"2024-09-12T18:08:53.387268+0000","last_clean":"2024-09-12T18:08:53.387268+0000","last_became_active":"2024-09-12T17:46:45.211533+0000","last_became_peered":"2024-09-12T17:46:45.211533+0000","last_unstale":"2024-09-12T18:08:53.387268+0000","last_undegraded":"2024-09-12T18:08:53.387268+0000","last_fullsized":"2024-09-12T18:08:53.387268+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:53.387150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:53.387150+0000","last_clean_scrub_stamp":"2024-09-12T18:08:53.387150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:13.871491+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'5","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:56.067508+0000","last_change":"2024-09-12T18:08:56.067508+0000","last_active":"2024-09-12T18:08:56.067508+0000","last_peered":"2024-09-12T18:08:56.067508+0000","last_clean":"2024-09-12T18:08:56.067508+0000","last_became_active":"2024-09-12T17:46:42.179372+0000","last_became_peered":"2024-09-12T17:46:42.179372+0000","last_unstale":"2024-09-12T18:08:56.067508+0000","last_undegraded":"2024-09-12T18:08:56.067508+0000","last_fullsized":"2024-09-12T18:08:56.067508+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:56.067401+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:56.067401+0000","last_clean_scrub_stamp":"2024-09-12T18:08:56.067401+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:50.579623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6715,"num_write":5,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'32","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:52.351892+0000","last_change":"2024-09-12T18:08:52.351892+0000","last_active":"2024-09-12T18:08:52.351892+0000","last_peered":"2024-09-12T18:08:52.351892+0000","last_clean":"2024-09-12T18:08:52.351892+0000","last_became_active":"2024-09-12T17:45:03.890104+0000","last_became_peered":"2024-09-12T17:45:03.890104+0000","last_unstale":"2024-09-12T18:08:52.351892+0000","last_undegraded":"2024-09-12T18:08:52.351892+0000","last_fullsized":"2024-09-12T18:08:52.351892+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-12T18:08:52.351802+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-12T18:08:52.351802+0000","last_clean_scrub_stamp":"2024-09-12T18:08:52.351802+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:15.084091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":111,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.351466+0000","last_change":"2024-09-12T18:08:40.351466+0000","last_active":"2024-09-12T18:08:40.351466+0000","last_peered":"2024-09-12T18:08:40.351466+0000","last_clean":"2024-09-12T18:08:40.351466+0000","last_became_active":"2024-09-12T17:57:00.466304+0000","last_became_peered":"2024-09-12T17:57:00.466304+0000","last_unstale":"2024-09-12T18:08:40.351466+0000","last_undegraded":"2024-09-12T18:08:40.351466+0000","last_fullsized":"2024-09-12T18:08:40.351466+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:40.351382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:40.351382+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.351382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:41.320349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.636587+0000","last_change":"2024-09-12T18:08:54.636587+0000","last_active":"2024-09-12T18:08:54.636587+0000","last_peered":"2024-09-12T18:08:54.636587+0000","last_clean":"2024-09-12T18:08:54.636587+0000","last_became_active":"2024-09-12T17:46:45.202290+0000","last_became_peered":"2024-09-12T17:46:45.202290+0000","last_unstale":"2024-09-12T18:08:54.636587+0000","last_undegraded":"2024-09-12T18:08:54.636587+0000","last_fullsized":"2024-09-12T18:08:54.636587+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:54.636454+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:54.636454+0000","last_clean_scrub_stamp":"2024-09-12T18:08:54.636454+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:28.883428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.153255+0000","last_change":"2024-09-12T18:08:43.153255+0000","last_active":"2024-09-12T18:08:43.153255+0000","last_peered":"2024-09-12T18:08:43.153255+0000","last_clean":"2024-09-12T18:08:43.153255+0000","last_became_active":"2024-09-12T17:46:42.177112+0000","last_became_peered":"2024-09-12T17:46:42.177112+0000","last_unstale":"2024-09-12T18:08:43.153255+0000","last_undegraded":"2024-09-12T18:08:43.153255+0000","last_fullsized":"2024-09-12T18:08:43.153255+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:08:43.153171+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:08:43.153171+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.153171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:45.201159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10811,"num_write":18,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'16","reported_seq":95,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.424998+0000","last_change":"2024-09-12T18:08:31.424946+0000","last_active":"2024-09-12T18:08:31.424998+0000","last_peered":"2024-09-12T18:08:31.424998+0000","last_clean":"2024-09-12T18:08:31.424998+0000","last_became_active":"2024-09-12T17:45:03.893002+0000","last_became_peered":"2024-09-12T17:45:03.893002+0000","last_unstale":"2024-09-12T18:08:31.424998+0000","last_undegraded":"2024-09-12T18:08:31.424998+0000","last_fullsized":"2024-09-12T18:08:31.424998+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T18:08:31.424875+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T18:08:31.424875+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.424875+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:19.126454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.089939+0000","last_change":"2024-09-12T18:08:47.089855+0000","last_active":"2024-09-12T18:08:47.089939+0000","last_peered":"2024-09-12T18:08:47.089939+0000","last_clean":"2024-09-12T18:08:47.089939+0000","last_became_active":"2024-09-12T17:57:00.456939+0000","last_became_peered":"2024-09-12T17:57:00.456939+0000","last_unstale":"2024-09-12T18:08:47.089939+0000","last_undegraded":"2024-09-12T18:08:47.089939+0000","last_fullsized":"2024-09-12T18:08:47.089939+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:47.089763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:47.089763+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.089763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:55.749822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'10","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:01.381109+0000","last_change":"2024-09-12T18:09:01.381109+0000","last_active":"2024-09-12T18:09:01.381109+0000","last_peered":"2024-09-12T18:09:01.381109+0000","last_clean":"2024-09-12T18:09:01.381109+0000","last_became_active":"2024-09-12T17:46:45.536920+0000","last_became_peered":"2024-09-12T17:46:45.536920+0000","last_unstale":"2024-09-12T18:09:01.381109+0000","last_undegraded":"2024-09-12T18:09:01.381109+0000","last_fullsized":"2024-09-12T18:09:01.381109+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-12T18:09:01.380960+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-12T18:09:01.380960+0000","last_clean_scrub_stamp":"2024-09-12T18:09:01.380960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:00.858822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":15,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.367612+0000","last_change":"2024-09-12T18:08:36.367553+0000","last_active":"2024-09-12T18:08:36.367612+0000","last_peered":"2024-09-12T18:08:36.367612+0000","last_clean":"2024-09-12T18:08:36.367612+0000","last_became_active":"2024-09-12T17:46:42.185870+0000","last_became_peered":"2024-09-12T17:46:42.185870+0000","last_unstale":"2024-09-12T18:08:36.367612+0000","last_undegraded":"2024-09-12T18:08:36.367612+0000","last_fullsized":"2024-09-12T18:08:36.367612+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:36.367467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:36.367467+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.367467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:56.284371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'49","reported_seq":190,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:51.364900+0000","last_change":"2024-09-12T18:08:51.364900+0000","last_active":"2024-09-12T18:08:51.364900+0000","last_peered":"2024-09-12T18:08:51.364900+0000","last_clean":"2024-09-12T18:08:51.364900+0000","last_became_active":"2024-09-12T17:45:03.894537+0000","last_became_peered":"2024-09-12T17:45:03.894537+0000","last_unstale":"2024-09-12T18:08:51.364900+0000","last_undegraded":"2024-09-12T18:08:51.364900+0000","last_fullsized":"2024-09-12T18:08:51.364900+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-12T18:08:51.364830+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-12T18:08:51.364830+0000","last_clean_scrub_stamp":"2024-09-12T18:08:51.364830+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:53.097176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":186,"num_write":90,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:08.947514+0000","last_change":"2024-09-12T18:09:08.947451+0000","last_active":"2024-09-12T18:09:08.947514+0000","last_peered":"2024-09-12T18:09:08.947514+0000","last_clean":"2024-09-12T18:09:08.947514+0000","last_became_active":"2024-09-12T17:57:00.464157+0000","last_became_peered":"2024-09-12T17:57:00.464157+0000","last_unstale":"2024-09-12T18:09:08.947514+0000","last_undegraded":"2024-09-12T18:09:08.947514+0000","last_fullsized":"2024-09-12T18:09:08.947514+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:08.947355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:08.947355+0000","last_clean_scrub_stamp":"2024-09-12T18:09:08.947355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:32.834659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.017537+0000","last_change":"2024-09-12T18:09:05.017537+0000","last_active":"2024-09-12T18:09:05.017537+0000","last_peered":"2024-09-12T18:09:05.017537+0000","last_clean":"2024-09-12T18:09:05.017537+0000","last_became_active":"2024-09-12T17:46:45.538295+0000","last_became_peered":"2024-09-12T17:46:45.538295+0000","last_unstale":"2024-09-12T18:09:05.017537+0000","last_undegraded":"2024-09-12T18:09:05.017537+0000","last_fullsized":"2024-09-12T18:09:05.017537+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:05.017437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:05.017437+0000","last_clean_scrub_stamp":"2024-09-12T18:09:05.017437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:08.036064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:48.663622+0000","last_change":"2024-09-12T18:08:48.663622+0000","last_active":"2024-09-12T18:08:48.663622+0000","last_peered":"2024-09-12T18:08:48.663622+0000","last_clean":"2024-09-12T18:08:48.663622+0000","last_became_active":"2024-09-12T17:46:42.183792+0000","last_became_peered":"2024-09-12T17:46:42.183792+0000","last_unstale":"2024-09-12T18:08:48.663622+0000","last_undegraded":"2024-09-12T18:08:48.663622+0000","last_fullsized":"2024-09-12T18:08:48.663622+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:48.663495+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:48.663495+0000","last_clean_scrub_stamp":"2024-09-12T18:08:48.663495+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:42.602412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'18","reported_seq":104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:53.018852+0000","last_change":"2024-09-12T18:08:53.018852+0000","last_active":"2024-09-12T18:08:53.018852+0000","last_peered":"2024-09-12T18:08:53.018852+0000","last_clean":"2024-09-12T18:08:53.018852+0000","last_became_active":"2024-09-12T17:45:03.893108+0000","last_became_peered":"2024-09-12T17:45:03.893108+0000","last_unstale":"2024-09-12T18:08:53.018852+0000","last_undegraded":"2024-09-12T18:08:53.018852+0000","last_fullsized":"2024-09-12T18:08:53.018852+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-12T18:08:53.018762+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-12T18:08:53.018762+0000","last_clean_scrub_stamp":"2024-09-12T18:08:53.018762+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:53.201532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":71,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:07:04.548029+0000","last_change":"2024-09-12T17:57:00.463065+0000","last_active":"2024-09-12T18:07:04.548029+0000","last_peered":"2024-09-12T18:07:04.548029+0000","last_clean":"2024-09-12T18:07:04.548029+0000","last_became_active":"2024-09-12T17:57:00.462657+0000","last_became_peered":"2024-09-12T17:57:00.462657+0000","last_unstale":"2024-09-12T18:07:04.548029+0000","last_undegraded":"2024-09-12T18:07:04.548029+0000","last_fullsized":"2024-09-12T18:07:04.548029+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:56:59.438365+0000","last_clean_scrub_stamp":"2024-09-12T17:56:59.438365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.349421+0000","last_change":"2024-09-12T18:08:54.349421+0000","last_active":"2024-09-12T18:08:54.349421+0000","last_peered":"2024-09-12T18:08:54.349421+0000","last_clean":"2024-09-12T18:08:54.349421+0000","last_became_active":"2024-09-12T17:46:45.210259+0000","last_became_peered":"2024-09-12T17:46:45.210259+0000","last_unstale":"2024-09-12T18:08:54.349421+0000","last_undegraded":"2024-09-12T18:08:54.349421+0000","last_fullsized":"2024-09-12T18:08:54.349421+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:08:54.349325+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:08:54.349325+0000","last_clean_scrub_stamp":"2024-09-12T18:08:54.349325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:12.493878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6189,"num_write":4,"num_write_kb":3117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.366004+0000","last_change":"2024-09-12T18:08:58.366004+0000","last_active":"2024-09-12T18:08:58.366004+0000","last_peered":"2024-09-12T18:08:58.366004+0000","last_clean":"2024-09-12T18:08:58.366004+0000","last_became_active":"2024-09-12T17:46:42.178782+0000","last_became_peered":"2024-09-12T17:46:42.178782+0000","last_unstale":"2024-09-12T18:08:58.366004+0000","last_undegraded":"2024-09-12T18:08:58.366004+0000","last_fullsized":"2024-09-12T18:08:58.366004+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T18:08:58.365903+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T18:08:58.365903+0000","last_clean_scrub_stamp":"2024-09-12T18:08:58.365903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:04.926841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'102","reported_seq":364,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.027184+0000","last_change":"2024-09-12T18:08:55.027184+0000","last_active":"2024-09-12T18:08:55.027184+0000","last_peered":"2024-09-12T18:08:55.027184+0000","last_clean":"2024-09-12T18:08:55.027184+0000","last_became_active":"2024-09-12T17:45:03.899635+0000","last_became_peered":"2024-09-12T17:45:03.899635+0000","last_unstale":"2024-09-12T18:08:55.027184+0000","last_undegraded":"2024-09-12T18:08:55.027184+0000","last_fullsized":"2024-09-12T18:08:55.027184+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-12T18:08:55.027098+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-12T18:08:55.027098+0000","last_clean_scrub_stamp":"2024-09-12T18:08:55.027098+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:20.841923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":455,"num_write":132,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3992,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:51.214993+0000","last_change":"2024-09-12T18:08:51.214993+0000","last_active":"2024-09-12T18:08:51.214993+0000","last_peered":"2024-09-12T18:08:51.214993+0000","last_clean":"2024-09-12T18:08:51.214993+0000","last_became_active":"2024-09-12T17:57:00.462532+0000","last_became_peered":"2024-09-12T17:57:00.462532+0000","last_unstale":"2024-09-12T18:08:51.214993+0000","last_undegraded":"2024-09-12T18:08:51.214993+0000","last_fullsized":"2024-09-12T18:08:51.214993+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:51.214908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:51.214908+0000","last_clean_scrub_stamp":"2024-09-12T18:08:51.214908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:13.424953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.046364+0000","last_change":"2024-09-12T18:08:44.046364+0000","last_active":"2024-09-12T18:08:44.046364+0000","last_peered":"2024-09-12T18:08:44.046364+0000","last_clean":"2024-09-12T18:08:44.046364+0000","last_became_active":"2024-09-12T17:47:29.305275+0000","last_became_peered":"2024-09-12T17:47:29.305275+0000","last_unstale":"2024-09-12T18:08:44.046364+0000","last_undegraded":"2024-09-12T18:08:44.046364+0000","last_fullsized":"2024-09-12T18:08:44.046364+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:44.046274+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:44.046274+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.046274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:24.312296+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.691399+0000","last_change":"2024-09-12T18:08:44.691399+0000","last_active":"2024-09-12T18:08:44.691399+0000","last_peered":"2024-09-12T18:08:44.691399+0000","last_clean":"2024-09-12T18:08:44.691399+0000","last_became_active":"2024-09-12T17:46:42.182797+0000","last_became_peered":"2024-09-12T17:46:42.182797+0000","last_unstale":"2024-09-12T18:08:44.691399+0000","last_undegraded":"2024-09-12T18:08:44.691399+0000","last_fullsized":"2024-09-12T18:08:44.691399+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:44.691312+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:44.691312+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.691312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:34.375454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.035255+0000","last_change":"2024-09-12T18:08:39.035255+0000","last_active":"2024-09-12T18:08:39.035255+0000","last_peered":"2024-09-12T18:08:39.035255+0000","last_clean":"2024-09-12T18:08:39.035255+0000","last_became_active":"2024-09-12T17:45:03.899684+0000","last_became_peered":"2024-09-12T17:45:03.899684+0000","last_unstale":"2024-09-12T18:08:39.035255+0000","last_undegraded":"2024-09-12T18:08:39.035255+0000","last_fullsized":"2024-09-12T18:08:39.035255+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-12T18:08:39.035164+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-12T18:08:39.035164+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.035164+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:45.390604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.937737+0000","last_change":"2024-09-12T18:09:06.937737+0000","last_active":"2024-09-12T18:09:06.937737+0000","last_peered":"2024-09-12T18:09:06.937737+0000","last_clean":"2024-09-12T18:09:06.937737+0000","last_became_active":"2024-09-12T17:57:00.464581+0000","last_became_peered":"2024-09-12T17:57:00.464581+0000","last_unstale":"2024-09-12T18:09:06.937737+0000","last_undegraded":"2024-09-12T18:09:06.937737+0000","last_fullsized":"2024-09-12T18:09:06.937737+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:09:06.937625+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:09:06.937625+0000","last_clean_scrub_stamp":"2024-09-12T18:09:06.937625+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:34.230704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.059496+0000","last_change":"2024-09-12T18:08:45.059496+0000","last_active":"2024-09-12T18:08:45.059496+0000","last_peered":"2024-09-12T18:08:45.059496+0000","last_clean":"2024-09-12T18:08:45.059496+0000","last_became_active":"2024-09-12T17:46:45.208580+0000","last_became_peered":"2024-09-12T17:46:45.208580+0000","last_unstale":"2024-09-12T18:08:45.059496+0000","last_undegraded":"2024-09-12T18:08:45.059496+0000","last_fullsized":"2024-09-12T18:08:45.059496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:45.059384+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:45.059384+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.059384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:36.315465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.649158+0000","last_change":"2024-09-12T18:08:49.649158+0000","last_active":"2024-09-12T18:08:49.649158+0000","last_peered":"2024-09-12T18:08:49.649158+0000","last_clean":"2024-09-12T18:08:49.649158+0000","last_became_active":"2024-09-12T17:46:42.181972+0000","last_became_peered":"2024-09-12T17:46:42.181972+0000","last_unstale":"2024-09-12T18:08:49.649158+0000","last_undegraded":"2024-09-12T18:08:49.649158+0000","last_fullsized":"2024-09-12T18:08:49.649158+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:49.649041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:49.649041+0000","last_clean_scrub_stamp":"2024-09-12T18:08:49.649041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:48.556483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'6","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.421717+0000","last_change":"2024-09-12T18:08:49.421717+0000","last_active":"2024-09-12T18:08:49.421717+0000","last_peered":"2024-09-12T18:08:49.421717+0000","last_clean":"2024-09-12T18:08:49.421717+0000","last_became_active":"2024-09-12T17:45:03.899876+0000","last_became_peered":"2024-09-12T17:45:03.899876+0000","last_unstale":"2024-09-12T18:08:49.421717+0000","last_undegraded":"2024-09-12T18:08:49.421717+0000","last_fullsized":"2024-09-12T18:08:49.421717+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:49.421627+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:49.421627+0000","last_clean_scrub_stamp":"2024-09-12T18:08:49.421627+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:14.994460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.918045+0000","last_change":"2024-09-12T18:09:07.918045+0000","last_active":"2024-09-12T18:09:07.918045+0000","last_peered":"2024-09-12T18:09:07.918045+0000","last_clean":"2024-09-12T18:09:07.918045+0000","last_became_active":"2024-09-12T17:57:00.467385+0000","last_became_peered":"2024-09-12T17:57:00.467385+0000","last_unstale":"2024-09-12T18:09:07.918045+0000","last_undegraded":"2024-09-12T18:09:07.918045+0000","last_fullsized":"2024-09-12T18:09:07.918045+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:07.917952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:07.917952+0000","last_clean_scrub_stamp":"2024-09-12T18:09:07.917952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:41.119566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.004744+0000","last_change":"2024-09-12T18:09:04.004744+0000","last_active":"2024-09-12T18:09:04.004744+0000","last_peered":"2024-09-12T18:09:04.004744+0000","last_clean":"2024-09-12T18:09:04.004744+0000","last_became_active":"2024-09-12T17:46:45.205742+0000","last_became_peered":"2024-09-12T17:46:45.205742+0000","last_unstale":"2024-09-12T18:09:04.004744+0000","last_undegraded":"2024-09-12T18:09:04.004744+0000","last_fullsized":"2024-09-12T18:09:04.004744+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:04.004654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:04.004654+0000","last_clean_scrub_stamp":"2024-09-12T18:09:04.004654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:44.109376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:57.399234+0000","last_change":"2024-09-12T18:08:57.399234+0000","last_active":"2024-09-12T18:08:57.399234+0000","last_peered":"2024-09-12T18:08:57.399234+0000","last_clean":"2024-09-12T18:08:57.399234+0000","last_became_active":"2024-09-12T17:46:42.175501+0000","last_became_peered":"2024-09-12T17:46:42.175501+0000","last_unstale":"2024-09-12T18:08:57.399234+0000","last_undegraded":"2024-09-12T18:08:57.399234+0000","last_fullsized":"2024-09-12T18:08:57.399234+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:57.399153+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:57.399153+0000","last_clean_scrub_stamp":"2024-09-12T18:08:57.399153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:18.671141+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.139970+0000","last_change":"2024-09-12T18:08:39.139970+0000","last_active":"2024-09-12T18:08:39.139970+0000","last_peered":"2024-09-12T18:08:39.139970+0000","last_clean":"2024-09-12T18:08:39.139970+0000","last_became_active":"2024-09-12T17:45:03.894942+0000","last_became_peered":"2024-09-12T17:45:03.894942+0000","last_unstale":"2024-09-12T18:08:39.139970+0000","last_undegraded":"2024-09-12T18:08:39.139970+0000","last_fullsized":"2024-09-12T18:08:39.139970+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-12T18:08:39.139867+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-12T18:08:39.139867+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.139867+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:45.603564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.230714+0000","last_change":"2024-09-12T18:08:50.230714+0000","last_active":"2024-09-12T18:08:50.230714+0000","last_peered":"2024-09-12T18:08:50.230714+0000","last_clean":"2024-09-12T18:08:50.230714+0000","last_became_active":"2024-09-12T17:57:00.463134+0000","last_became_peered":"2024-09-12T17:57:00.463134+0000","last_unstale":"2024-09-12T18:08:50.230714+0000","last_undegraded":"2024-09-12T18:08:50.230714+0000","last_fullsized":"2024-09-12T18:08:50.230714+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:50.230613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:50.230613+0000","last_clean_scrub_stamp":"2024-09-12T18:08:50.230613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:52.747548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:02.016876+0000","last_change":"2024-09-12T18:09:02.016876+0000","last_active":"2024-09-12T18:09:02.016876+0000","last_peered":"2024-09-12T18:09:02.016876+0000","last_clean":"2024-09-12T18:09:02.016876+0000","last_became_active":"2024-09-12T17:46:45.536581+0000","last_became_peered":"2024-09-12T17:46:45.536581+0000","last_unstale":"2024-09-12T18:09:02.016876+0000","last_undegraded":"2024-09-12T18:09:02.016876+0000","last_fullsized":"2024-09-12T18:09:02.016876+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:02.016776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:02.016776+0000","last_clean_scrub_stamp":"2024-09-12T18:09:02.016776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:12.648379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.405893+0000","last_change":"2024-09-12T18:08:50.405893+0000","last_active":"2024-09-12T18:08:50.405893+0000","last_peered":"2024-09-12T18:08:50.405893+0000","last_clean":"2024-09-12T18:08:50.405893+0000","last_became_active":"2024-09-12T17:46:42.179981+0000","last_became_peered":"2024-09-12T17:46:42.179981+0000","last_unstale":"2024-09-12T18:08:50.405893+0000","last_undegraded":"2024-09-12T18:08:50.405893+0000","last_fullsized":"2024-09-12T18:08:50.405893+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:50.405808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:50.405808+0000","last_clean_scrub_stamp":"2024-09-12T18:08:50.405808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:31.112556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.412091+0000","last_change":"2024-09-12T18:08:50.412091+0000","last_active":"2024-09-12T18:08:50.412091+0000","last_peered":"2024-09-12T18:08:50.412091+0000","last_clean":"2024-09-12T18:08:50.412091+0000","last_became_active":"2024-09-12T17:45:03.892625+0000","last_became_peered":"2024-09-12T17:45:03.892625+0000","last_unstale":"2024-09-12T18:08:50.412091+0000","last_undegraded":"2024-09-12T18:08:50.412091+0000","last_fullsized":"2024-09-12T18:08:50.412091+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T18:08:50.411985+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T18:08:50.411985+0000","last_clean_scrub_stamp":"2024-09-12T18:08:50.411985+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:11.453257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.338542+0000","last_change":"2024-09-12T18:08:39.338475+0000","last_active":"2024-09-12T18:08:39.338542+0000","last_peered":"2024-09-12T18:08:39.338542+0000","last_clean":"2024-09-12T18:08:39.338542+0000","last_became_active":"2024-09-12T17:57:00.461347+0000","last_became_peered":"2024-09-12T17:57:00.461347+0000","last_unstale":"2024-09-12T18:08:39.338542+0000","last_undegraded":"2024-09-12T18:08:39.338542+0000","last_fullsized":"2024-09-12T18:08:39.338542+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:39.338385+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:39.338385+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.338385+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:37.625439+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:01.010009+0000","last_change":"2024-09-12T18:09:01.010009+0000","last_active":"2024-09-12T18:09:01.010009+0000","last_peered":"2024-09-12T18:09:01.010009+0000","last_clean":"2024-09-12T18:09:01.010009+0000","last_became_active":"2024-09-12T17:46:45.537463+0000","last_became_peered":"2024-09-12T17:46:45.537463+0000","last_unstale":"2024-09-12T18:09:01.010009+0000","last_undegraded":"2024-09-12T18:09:01.010009+0000","last_fullsized":"2024-09-12T18:09:01.010009+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:09:01.009913+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:09:01.009913+0000","last_clean_scrub_stamp":"2024-09-12T18:09:01.009913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:10.627409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:57.004343+0000","last_change":"2024-09-12T18:08:57.004343+0000","last_active":"2024-09-12T18:08:57.004343+0000","last_peered":"2024-09-12T18:08:57.004343+0000","last_clean":"2024-09-12T18:08:57.004343+0000","last_became_active":"2024-09-12T17:46:42.178809+0000","last_became_peered":"2024-09-12T17:46:42.178809+0000","last_unstale":"2024-09-12T18:08:57.004343+0000","last_undegraded":"2024-09-12T18:08:57.004343+0000","last_fullsized":"2024-09-12T18:08:57.004343+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:08:57.004254+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:08:57.004254+0000","last_clean_scrub_stamp":"2024-09-12T18:08:57.004254+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:44.467140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'40","reported_seq":158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:51.984600+0000","last_change":"2024-09-12T18:08:51.984600+0000","last_active":"2024-09-12T18:08:51.984600+0000","last_peered":"2024-09-12T18:08:51.984600+0000","last_clean":"2024-09-12T18:08:51.984600+0000","last_became_active":"2024-09-12T17:45:03.892417+0000","last_became_peered":"2024-09-12T17:45:03.892417+0000","last_unstale":"2024-09-12T18:08:51.984600+0000","last_undegraded":"2024-09-12T18:08:51.984600+0000","last_fullsized":"2024-09-12T18:08:51.984600+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-12T18:08:51.984486+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-12T18:08:51.984486+0000","last_clean_scrub_stamp":"2024-09-12T18:08:51.984486+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:41.532480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":139,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.970052+0000","last_change":"2024-09-12T18:09:05.970052+0000","last_active":"2024-09-12T18:09:05.970052+0000","last_peered":"2024-09-12T18:09:05.970052+0000","last_clean":"2024-09-12T18:09:05.970052+0000","last_became_active":"2024-09-12T17:57:00.463245+0000","last_became_peered":"2024-09-12T17:57:00.463245+0000","last_unstale":"2024-09-12T18:09:05.970052+0000","last_undegraded":"2024-09-12T18:09:05.970052+0000","last_fullsized":"2024-09-12T18:09:05.970052+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:05.969941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:05.969941+0000","last_clean_scrub_stamp":"2024-09-12T18:09:05.969941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:49.304599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:03.041885+0000","last_change":"2024-09-12T18:09:03.041885+0000","last_active":"2024-09-12T18:09:03.041885+0000","last_peered":"2024-09-12T18:09:03.041885+0000","last_clean":"2024-09-12T18:09:03.041885+0000","last_became_active":"2024-09-12T17:46:45.538337+0000","last_became_peered":"2024-09-12T17:46:45.538337+0000","last_unstale":"2024-09-12T18:09:03.041885+0000","last_undegraded":"2024-09-12T18:09:03.041885+0000","last_fullsized":"2024-09-12T18:09:03.041885+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:03.041801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:03.041801+0000","last_clean_scrub_stamp":"2024-09-12T18:09:03.041801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:06.882255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'6","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.332509+0000","last_change":"2024-09-12T18:08:34.332509+0000","last_active":"2024-09-12T18:08:34.332509+0000","last_peered":"2024-09-12T18:08:34.332509+0000","last_clean":"2024-09-12T18:08:34.332509+0000","last_became_active":"2024-09-12T17:46:42.183098+0000","last_became_peered":"2024-09-12T17:46:42.183098+0000","last_unstale":"2024-09-12T18:08:34.332509+0000","last_undegraded":"2024-09-12T18:08:34.332509+0000","last_fullsized":"2024-09-12T18:08:34.332509+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:34.332403+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:34.332403+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.332403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:28.057652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'35","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.462161+0000","last_change":"2024-09-12T18:08:30.462161+0000","last_active":"2024-09-12T18:08:30.462161+0000","last_peered":"2024-09-12T18:08:30.462161+0000","last_clean":"2024-09-12T18:08:30.462161+0000","last_became_active":"2024-09-12T17:45:03.896299+0000","last_became_peered":"2024-09-12T17:45:03.896299+0000","last_unstale":"2024-09-12T18:08:30.462161+0000","last_undegraded":"2024-09-12T18:08:30.462161+0000","last_fullsized":"2024-09-12T18:08:30.462161+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-12T18:08:30.462075+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-12T18:08:30.462075+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.462075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:31.466676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":68,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:56.350217+0000","last_change":"2024-09-12T18:08:56.350217+0000","last_active":"2024-09-12T18:08:56.350217+0000","last_peered":"2024-09-12T18:08:56.350217+0000","last_clean":"2024-09-12T18:08:56.350217+0000","last_became_active":"2024-09-12T17:57:00.461706+0000","last_became_peered":"2024-09-12T17:57:00.461706+0000","last_unstale":"2024-09-12T18:08:56.350217+0000","last_undegraded":"2024-09-12T18:08:56.350217+0000","last_fullsized":"2024-09-12T18:08:56.350217+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:56.350129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:56.350129+0000","last_clean_scrub_stamp":"2024-09-12T18:08:56.350129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:15.499827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:52.608730+0000","last_change":"2024-09-12T18:08:52.608730+0000","last_active":"2024-09-12T18:08:52.608730+0000","last_peered":"2024-09-12T18:08:52.608730+0000","last_clean":"2024-09-12T18:08:52.608730+0000","last_became_active":"2024-09-12T17:46:45.207610+0000","last_became_peered":"2024-09-12T17:46:45.207610+0000","last_unstale":"2024-09-12T18:08:52.608730+0000","last_undegraded":"2024-09-12T18:08:52.608730+0000","last_fullsized":"2024-09-12T18:08:52.608730+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:52.608625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:52.608625+0000","last_clean_scrub_stamp":"2024-09-12T18:08:52.608625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:10.007221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:56.376020+0000","last_change":"2024-09-12T18:08:56.376020+0000","last_active":"2024-09-12T18:08:56.376020+0000","last_peered":"2024-09-12T18:08:56.376020+0000","last_clean":"2024-09-12T18:08:56.376020+0000","last_became_active":"2024-09-12T17:46:42.182412+0000","last_became_peered":"2024-09-12T17:46:42.182412+0000","last_unstale":"2024-09-12T18:08:56.376020+0000","last_undegraded":"2024-09-12T18:08:56.376020+0000","last_fullsized":"2024-09-12T18:08:56.376020+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:08:56.375927+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:08:56.375927+0000","last_clean_scrub_stamp":"2024-09-12T18:08:56.375927+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:00.532634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'49","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:51.068756+0000","last_change":"2024-09-12T18:08:51.068756+0000","last_active":"2024-09-12T18:08:51.068756+0000","last_peered":"2024-09-12T18:08:51.068756+0000","last_clean":"2024-09-12T18:08:51.068756+0000","last_became_active":"2024-09-12T17:45:03.899885+0000","last_became_peered":"2024-09-12T17:45:03.899885+0000","last_unstale":"2024-09-12T18:08:51.068756+0000","last_undegraded":"2024-09-12T18:08:51.068756+0000","last_fullsized":"2024-09-12T18:08:51.068756+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-12T18:08:51.068660+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-12T18:08:51.068660+0000","last_clean_scrub_stamp":"2024-09-12T18:08:51.068660+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:08.504300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":167,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.971679+0000","last_change":"2024-09-12T18:09:07.971679+0000","last_active":"2024-09-12T18:09:07.971679+0000","last_peered":"2024-09-12T18:09:07.971679+0000","last_clean":"2024-09-12T18:09:07.971679+0000","last_became_active":"2024-09-12T17:57:00.468592+0000","last_became_peered":"2024-09-12T17:57:00.468592+0000","last_unstale":"2024-09-12T18:09:07.971679+0000","last_undegraded":"2024-09-12T18:09:07.971679+0000","last_fullsized":"2024-09-12T18:09:07.971679+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:07.971579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:07.971579+0000","last_clean_scrub_stamp":"2024-09-12T18:09:07.971579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:24.650115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:48.184219+0000","last_change":"2024-09-12T18:08:48.184219+0000","last_active":"2024-09-12T18:08:48.184219+0000","last_peered":"2024-09-12T18:08:48.184219+0000","last_clean":"2024-09-12T18:08:48.184219+0000","last_became_active":"2024-09-12T17:46:45.210413+0000","last_became_peered":"2024-09-12T17:46:45.210413+0000","last_unstale":"2024-09-12T18:08:48.184219+0000","last_undegraded":"2024-09-12T18:08:48.184219+0000","last_fullsized":"2024-09-12T18:08:48.184219+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:48.184107+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:48.184107+0000","last_clean_scrub_stamp":"2024-09-12T18:08:48.184107+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:51.708583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.720243+0000","last_change":"2024-09-12T18:08:43.720243+0000","last_active":"2024-09-12T18:08:43.720243+0000","last_peered":"2024-09-12T18:08:43.720243+0000","last_clean":"2024-09-12T18:08:43.720243+0000","last_became_active":"2024-09-12T17:46:42.176505+0000","last_became_peered":"2024-09-12T17:46:42.176505+0000","last_unstale":"2024-09-12T18:08:43.720243+0000","last_undegraded":"2024-09-12T18:08:43.720243+0000","last_fullsized":"2024-09-12T18:08:43.720243+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.720145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.720145+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.720145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:25.547287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'4","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.082448+0000","last_change":"2024-09-12T18:08:49.082448+0000","last_active":"2024-09-12T18:08:49.082448+0000","last_peered":"2024-09-12T18:08:49.082448+0000","last_clean":"2024-09-12T18:08:49.082448+0000","last_became_active":"2024-09-12T17:45:03.899726+0000","last_became_peered":"2024-09-12T17:45:03.899726+0000","last_unstale":"2024-09-12T18:08:49.082448+0000","last_undegraded":"2024-09-12T18:08:49.082448+0000","last_fullsized":"2024-09-12T18:08:49.082448+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:08:49.082362+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:08:49.082362+0000","last_clean_scrub_stamp":"2024-09-12T18:08:49.082362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:11.786278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.412864+0000","last_change":"2024-09-12T18:09:06.412864+0000","last_active":"2024-09-12T18:09:06.412864+0000","last_peered":"2024-09-12T18:09:06.412864+0000","last_clean":"2024-09-12T18:09:06.412864+0000","last_became_active":"2024-09-12T17:57:00.463766+0000","last_became_peered":"2024-09-12T17:57:00.463766+0000","last_unstale":"2024-09-12T18:09:06.412864+0000","last_undegraded":"2024-09-12T18:09:06.412864+0000","last_fullsized":"2024-09-12T18:09:06.412864+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:06.412768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:06.412768+0000","last_clean_scrub_stamp":"2024-09-12T18:09:06.412768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:08.953529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'8","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.188793+0000","last_change":"2024-09-12T18:08:46.188793+0000","last_active":"2024-09-12T18:08:46.188793+0000","last_peered":"2024-09-12T18:08:46.188793+0000","last_clean":"2024-09-12T18:08:46.188793+0000","last_became_active":"2024-09-12T17:46:45.201278+0000","last_became_peered":"2024-09-12T17:46:45.201278+0000","last_unstale":"2024-09-12T18:08:46.188793+0000","last_undegraded":"2024-09-12T18:08:46.188793+0000","last_fullsized":"2024-09-12T18:08:46.188793+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:08:46.188705+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:08:46.188705+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.188705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:52.744538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'8","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.015935+0000","last_change":"2024-09-12T18:08:54.015935+0000","last_active":"2024-09-12T18:08:54.015935+0000","last_peered":"2024-09-12T18:08:54.015935+0000","last_clean":"2024-09-12T18:08:54.015935+0000","last_became_active":"2024-09-12T17:46:42.182658+0000","last_became_peered":"2024-09-12T17:46:42.182658+0000","last_unstale":"2024-09-12T18:08:54.015935+0000","last_undegraded":"2024-09-12T18:08:54.015935+0000","last_fullsized":"2024-09-12T18:08:54.015935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:08:54.015857+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:08:54.015857+0000","last_clean_scrub_stamp":"2024-09-12T18:08:54.015857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:37.356981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":45,"num_write":18,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:48.409479+0000","last_change":"2024-09-12T18:08:48.409479+0000","last_active":"2024-09-12T18:08:48.409479+0000","last_peered":"2024-09-12T18:08:48.409479+0000","last_clean":"2024-09-12T18:08:48.409479+0000","last_became_active":"2024-09-12T17:45:03.891186+0000","last_became_peered":"2024-09-12T17:45:03.891186+0000","last_unstale":"2024-09-12T18:08:48.409479+0000","last_undegraded":"2024-09-12T18:08:48.409479+0000","last_fullsized":"2024-09-12T18:08:48.409479+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-12T18:08:48.409396+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-12T18:08:48.409396+0000","last_clean_scrub_stamp":"2024-09-12T18:08:48.409396+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:52.159634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":128,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.455929+0000","last_change":"2024-09-12T18:09:05.455929+0000","last_active":"2024-09-12T18:09:05.455929+0000","last_peered":"2024-09-12T18:09:05.455929+0000","last_clean":"2024-09-12T18:09:05.455929+0000","last_became_active":"2024-09-12T17:57:00.464910+0000","last_became_peered":"2024-09-12T17:57:00.464910+0000","last_unstale":"2024-09-12T18:09:05.455929+0000","last_undegraded":"2024-09-12T18:09:05.455929+0000","last_fullsized":"2024-09-12T18:09:05.455929+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:09:05.455828+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:09:05.455828+0000","last_clean_scrub_stamp":"2024-09-12T18:09:05.455828+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:04.633817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"261'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:00.025991+0000","last_change":"2024-09-12T18:09:00.025991+0000","last_active":"2024-09-12T18:09:00.025991+0000","last_peered":"2024-09-12T18:09:00.025991+0000","last_clean":"2024-09-12T18:09:00.025991+0000","last_became_active":"2024-09-12T17:46:45.206402+0000","last_became_peered":"2024-09-12T17:46:45.206402+0000","last_unstale":"2024-09-12T18:09:00.025991+0000","last_undegraded":"2024-09-12T18:09:00.025991+0000","last_fullsized":"2024-09-12T18:09:00.025991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:09:00.025900+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:09:00.025900+0000","last_clean_scrub_stamp":"2024-09-12T18:09:00.025900+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:02.539041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.062277+0000","last_change":"2024-09-12T18:08:41.062277+0000","last_active":"2024-09-12T18:08:41.062277+0000","last_peered":"2024-09-12T18:08:41.062277+0000","last_clean":"2024-09-12T18:08:41.062277+0000","last_became_active":"2024-09-12T17:46:42.184760+0000","last_became_peered":"2024-09-12T17:46:42.184760+0000","last_unstale":"2024-09-12T18:08:41.062277+0000","last_undegraded":"2024-09-12T18:08:41.062277+0000","last_fullsized":"2024-09-12T18:08:41.062277+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:41.062169+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:41.062169+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.062169+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:26.401540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'36","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.744438+0000","last_change":"2024-09-12T18:08:42.744438+0000","last_active":"2024-09-12T18:08:42.744438+0000","last_peered":"2024-09-12T18:08:42.744438+0000","last_clean":"2024-09-12T18:08:42.744438+0000","last_became_active":"2024-09-12T17:45:03.897616+0000","last_became_peered":"2024-09-12T17:45:03.897616+0000","last_unstale":"2024-09-12T18:08:42.744438+0000","last_undegraded":"2024-09-12T18:08:42.744438+0000","last_fullsized":"2024-09-12T18:08:42.744438+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-12T18:08:42.744348+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-12T18:08:42.744348+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.744348+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:13.467186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":138,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.963180+0000","last_change":"2024-09-12T18:09:06.963180+0000","last_active":"2024-09-12T18:09:06.963180+0000","last_peered":"2024-09-12T18:09:06.963180+0000","last_clean":"2024-09-12T18:09:06.963180+0000","last_became_active":"2024-09-12T17:57:00.463881+0000","last_became_peered":"2024-09-12T17:57:00.463881+0000","last_unstale":"2024-09-12T18:09:06.963180+0000","last_undegraded":"2024-09-12T18:09:06.963180+0000","last_fullsized":"2024-09-12T18:09:06.963180+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:09:06.963083+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:09:06.963083+0000","last_clean_scrub_stamp":"2024-09-12T18:09:06.963083+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:08.876197+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.054811+0000","last_change":"2024-09-12T18:08:43.054811+0000","last_active":"2024-09-12T18:08:43.054811+0000","last_peered":"2024-09-12T18:08:43.054811+0000","last_clean":"2024-09-12T18:08:43.054811+0000","last_became_active":"2024-09-12T17:46:45.205987+0000","last_became_peered":"2024-09-12T17:46:45.205987+0000","last_unstale":"2024-09-12T18:08:43.054811+0000","last_undegraded":"2024-09-12T18:08:43.054811+0000","last_fullsized":"2024-09-12T18:08:43.054811+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.054721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.054721+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.054721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:35.540307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.437045+0000","last_change":"2024-09-12T18:08:49.437045+0000","last_active":"2024-09-12T18:08:49.437045+0000","last_peered":"2024-09-12T18:08:49.437045+0000","last_clean":"2024-09-12T18:08:49.437045+0000","last_became_active":"2024-09-12T17:46:42.178941+0000","last_became_peered":"2024-09-12T17:46:42.178941+0000","last_unstale":"2024-09-12T18:08:49.437045+0000","last_undegraded":"2024-09-12T18:08:49.437045+0000","last_fullsized":"2024-09-12T18:08:49.437045+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:49.436952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:49.436952+0000","last_clean_scrub_stamp":"2024-09-12T18:08:49.436952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:43.113599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'33","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.980928+0000","last_change":"2024-09-12T18:08:50.980928+0000","last_active":"2024-09-12T18:08:50.980928+0000","last_peered":"2024-09-12T18:08:50.980928+0000","last_clean":"2024-09-12T18:08:50.980928+0000","last_became_active":"2024-09-12T17:45:03.893332+0000","last_became_peered":"2024-09-12T17:45:03.893332+0000","last_unstale":"2024-09-12T18:08:50.980928+0000","last_undegraded":"2024-09-12T18:08:50.980928+0000","last_fullsized":"2024-09-12T18:08:50.980928+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T18:08:50.980837+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T18:08:50.980837+0000","last_clean_scrub_stamp":"2024-09-12T18:08:50.980837+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:57.691927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.367651+0000","last_change":"2024-09-12T18:08:38.367651+0000","last_active":"2024-09-12T18:08:38.367651+0000","last_peered":"2024-09-12T18:08:38.367651+0000","last_clean":"2024-09-12T18:08:38.367651+0000","last_became_active":"2024-09-12T17:57:00.461130+0000","last_became_peered":"2024-09-12T17:57:00.461130+0000","last_unstale":"2024-09-12T18:08:38.367651+0000","last_undegraded":"2024-09-12T18:08:38.367651+0000","last_fullsized":"2024-09-12T18:08:38.367651+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:38.367554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:38.367554+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.367554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:37.306375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:57.110353+0000","last_change":"2024-09-12T18:08:57.110353+0000","last_active":"2024-09-12T18:08:57.110353+0000","last_peered":"2024-09-12T18:08:57.110353+0000","last_clean":"2024-09-12T18:08:57.110353+0000","last_became_active":"2024-09-12T17:46:45.207899+0000","last_became_peered":"2024-09-12T17:46:45.207899+0000","last_unstale":"2024-09-12T18:08:57.110353+0000","last_undegraded":"2024-09-12T18:08:57.110353+0000","last_fullsized":"2024-09-12T18:08:57.110353+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:57.110270+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:57.110270+0000","last_clean_scrub_stamp":"2024-09-12T18:08:57.110270+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:52.848589+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":571,"num_write":10,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.020230+0000","last_change":"2024-09-12T18:08:55.020230+0000","last_active":"2024-09-12T18:08:55.020230+0000","last_peered":"2024-09-12T18:08:55.020230+0000","last_clean":"2024-09-12T18:08:55.020230+0000","last_became_active":"2024-09-12T17:46:42.177867+0000","last_became_peered":"2024-09-12T17:46:42.177867+0000","last_unstale":"2024-09-12T18:08:55.020230+0000","last_undegraded":"2024-09-12T18:08:55.020230+0000","last_fullsized":"2024-09-12T18:08:55.020230+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:55.020132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:55.020132+0000","last_clean_scrub_stamp":"2024-09-12T18:08:55.020132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:36.993241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'22","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.955932+0000","last_change":"2024-09-12T18:08:49.955932+0000","last_active":"2024-09-12T18:08:49.955932+0000","last_peered":"2024-09-12T18:08:49.955932+0000","last_clean":"2024-09-12T18:08:49.955932+0000","last_became_active":"2024-09-12T17:45:03.895229+0000","last_became_peered":"2024-09-12T17:45:03.895229+0000","last_unstale":"2024-09-12T18:08:49.955932+0000","last_undegraded":"2024-09-12T18:08:49.955932+0000","last_fullsized":"2024-09-12T18:08:49.955932+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-12T18:08:49.955844+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-12T18:08:49.955844+0000","last_clean_scrub_stamp":"2024-09-12T18:08:49.955844+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:28.159320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:03.036043+0000","last_change":"2024-09-12T18:09:03.036043+0000","last_active":"2024-09-12T18:09:03.036043+0000","last_peered":"2024-09-12T18:09:03.036043+0000","last_clean":"2024-09-12T18:09:03.036043+0000","last_became_active":"2024-09-12T17:57:00.466328+0000","last_became_peered":"2024-09-12T17:57:00.466328+0000","last_unstale":"2024-09-12T18:09:03.036043+0000","last_undegraded":"2024-09-12T18:09:03.036043+0000","last_fullsized":"2024-09-12T18:09:03.036043+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:03.035945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:03.035945+0000","last_clean_scrub_stamp":"2024-09-12T18:09:03.035945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:54.743196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.108376+0000","last_change":"2024-09-12T18:08:58.108376+0000","last_active":"2024-09-12T18:08:58.108376+0000","last_peered":"2024-09-12T18:08:58.108376+0000","last_clean":"2024-09-12T18:08:58.108376+0000","last_became_active":"2024-09-12T17:46:45.204628+0000","last_became_peered":"2024-09-12T17:46:45.204628+0000","last_unstale":"2024-09-12T18:08:58.108376+0000","last_undegraded":"2024-09-12T18:08:58.108376+0000","last_fullsized":"2024-09-12T18:08:58.108376+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:58.108290+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:58.108290+0000","last_clean_scrub_stamp":"2024-09-12T18:08:58.108290+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:37.462716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'3","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.353971+0000","last_change":"2024-09-12T18:08:33.353971+0000","last_active":"2024-09-12T18:08:33.353971+0000","last_peered":"2024-09-12T18:08:33.353971+0000","last_clean":"2024-09-12T18:08:33.353971+0000","last_became_active":"2024-09-12T17:46:42.183710+0000","last_became_peered":"2024-09-12T17:46:42.183710+0000","last_unstale":"2024-09-12T18:08:33.353971+0000","last_undegraded":"2024-09-12T18:08:33.353971+0000","last_fullsized":"2024-09-12T18:08:33.353971+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:33.353886+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:33.353886+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.353886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:44.594486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'20","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:48.442441+0000","last_change":"2024-09-12T18:08:48.442441+0000","last_active":"2024-09-12T18:08:48.442441+0000","last_peered":"2024-09-12T18:08:48.442441+0000","last_clean":"2024-09-12T18:08:48.442441+0000","last_became_active":"2024-09-12T17:45:03.897609+0000","last_became_peered":"2024-09-12T17:45:03.897609+0000","last_unstale":"2024-09-12T18:08:48.442441+0000","last_undegraded":"2024-09-12T18:08:48.442441+0000","last_fullsized":"2024-09-12T18:08:48.442441+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-12T18:08:48.442360+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-12T18:08:48.442360+0000","last_clean_scrub_stamp":"2024-09-12T18:08:48.442360+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:25.329001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.065405+0000","last_change":"2024-09-12T18:08:46.065405+0000","last_active":"2024-09-12T18:08:46.065405+0000","last_peered":"2024-09-12T18:08:46.065405+0000","last_clean":"2024-09-12T18:08:46.065405+0000","last_became_active":"2024-09-12T17:57:00.458777+0000","last_became_peered":"2024-09-12T17:57:00.458777+0000","last_unstale":"2024-09-12T18:08:46.065405+0000","last_undegraded":"2024-09-12T18:08:46.065405+0000","last_fullsized":"2024-09-12T18:08:46.065405+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:46.065321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:46.065321+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.065321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:26.249202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.197561+0000","last_change":"2024-09-12T18:08:45.197561+0000","last_active":"2024-09-12T18:08:45.197561+0000","last_peered":"2024-09-12T18:08:45.197561+0000","last_clean":"2024-09-12T18:08:45.197561+0000","last_became_active":"2024-09-12T17:46:45.536980+0000","last_became_peered":"2024-09-12T17:46:45.536980+0000","last_unstale":"2024-09-12T18:08:45.197561+0000","last_undegraded":"2024-09-12T18:08:45.197561+0000","last_fullsized":"2024-09-12T18:08:45.197561+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:08:45.197475+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:08:45.197475+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.197475+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:40.764644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.369860+0000","last_change":"2024-09-12T18:08:55.369860+0000","last_active":"2024-09-12T18:08:55.369860+0000","last_peered":"2024-09-12T18:08:55.369860+0000","last_clean":"2024-09-12T18:08:55.369860+0000","last_became_active":"2024-09-12T17:46:42.180565+0000","last_became_peered":"2024-09-12T17:46:42.180565+0000","last_unstale":"2024-09-12T18:08:55.369860+0000","last_undegraded":"2024-09-12T18:08:55.369860+0000","last_fullsized":"2024-09-12T18:08:55.369860+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:55.369772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:55.369772+0000","last_clean_scrub_stamp":"2024-09-12T18:08:55.369772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:09.678109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'33","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.050500+0000","last_change":"2024-09-12T18:08:37.050500+0000","last_active":"2024-09-12T18:08:37.050500+0000","last_peered":"2024-09-12T18:08:37.050500+0000","last_clean":"2024-09-12T18:08:37.050500+0000","last_became_active":"2024-09-12T17:45:03.892226+0000","last_became_peered":"2024-09-12T17:45:03.892226+0000","last_unstale":"2024-09-12T18:08:37.050500+0000","last_undegraded":"2024-09-12T18:08:37.050500+0000","last_fullsized":"2024-09-12T18:08:37.050500+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T18:08:37.050393+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T18:08:37.050393+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.050393+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:27.394946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":124,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:02.012420+0000","last_change":"2024-09-12T18:09:02.012420+0000","last_active":"2024-09-12T18:09:02.012420+0000","last_peered":"2024-09-12T18:09:02.012420+0000","last_clean":"2024-09-12T18:09:02.012420+0000","last_became_active":"2024-09-12T17:57:00.464707+0000","last_became_peered":"2024-09-12T17:57:00.464707+0000","last_unstale":"2024-09-12T18:09:02.012420+0000","last_undegraded":"2024-09-12T18:09:02.012420+0000","last_fullsized":"2024-09-12T18:09:02.012420+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:02.012296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:02.012296+0000","last_clean_scrub_stamp":"2024-09-12T18:09:02.012296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:04.533564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.068887+0000","last_change":"2024-09-12T18:08:59.068887+0000","last_active":"2024-09-12T18:08:59.068887+0000","last_peered":"2024-09-12T18:08:59.068887+0000","last_clean":"2024-09-12T18:08:59.068887+0000","last_became_active":"2024-09-12T17:46:45.204759+0000","last_became_peered":"2024-09-12T17:46:45.204759+0000","last_unstale":"2024-09-12T18:08:59.068887+0000","last_undegraded":"2024-09-12T18:08:59.068887+0000","last_fullsized":"2024-09-12T18:08:59.068887+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:59.068782+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:59.068782+0000","last_clean_scrub_stamp":"2024-09-12T18:08:59.068782+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:19.387357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.177200+0000","last_change":"2024-09-12T18:08:44.177200+0000","last_active":"2024-09-12T18:08:44.177200+0000","last_peered":"2024-09-12T18:08:44.177200+0000","last_clean":"2024-09-12T18:08:44.177200+0000","last_became_active":"2024-09-12T17:46:42.182805+0000","last_became_peered":"2024-09-12T17:46:42.182805+0000","last_unstale":"2024-09-12T18:08:44.177200+0000","last_undegraded":"2024-09-12T18:08:44.177200+0000","last_fullsized":"2024-09-12T18:08:44.177200+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:44.177115+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:44.177115+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.177115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:06.093127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'42","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.428464+0000","last_change":"2024-09-12T18:08:29.428464+0000","last_active":"2024-09-12T18:08:29.428464+0000","last_peered":"2024-09-12T18:08:29.428464+0000","last_clean":"2024-09-12T18:08:29.428464+0000","last_became_active":"2024-09-12T17:45:03.897752+0000","last_became_peered":"2024-09-12T17:45:03.897752+0000","last_unstale":"2024-09-12T18:08:29.428464+0000","last_undegraded":"2024-09-12T18:08:29.428464+0000","last_fullsized":"2024-09-12T18:08:29.428464+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-12T18:08:29.428355+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-12T18:08:29.428355+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.428355+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:12.865787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":75,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.009864+0000","last_change":"2024-09-12T18:09:06.009864+0000","last_active":"2024-09-12T18:09:06.009864+0000","last_peered":"2024-09-12T18:09:06.009864+0000","last_clean":"2024-09-12T18:09:06.009864+0000","last_became_active":"2024-09-12T17:57:00.469072+0000","last_became_peered":"2024-09-12T17:57:00.469072+0000","last_unstale":"2024-09-12T18:09:06.009864+0000","last_undegraded":"2024-09-12T18:09:06.009864+0000","last_fullsized":"2024-09-12T18:09:06.009864+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:06.009776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:06.009776+0000","last_clean_scrub_stamp":"2024-09-12T18:09:06.009776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:36.203002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:53.594942+0000","last_change":"2024-09-12T18:08:53.594942+0000","last_active":"2024-09-12T18:08:53.594942+0000","last_peered":"2024-09-12T18:08:53.594942+0000","last_clean":"2024-09-12T18:08:53.594942+0000","last_became_active":"2024-09-12T17:46:45.202892+0000","last_became_peered":"2024-09-12T17:46:45.202892+0000","last_unstale":"2024-09-12T18:08:53.594942+0000","last_undegraded":"2024-09-12T18:08:53.594942+0000","last_fullsized":"2024-09-12T18:08:53.594942+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:08:53.594844+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:08:53.594844+0000","last_clean_scrub_stamp":"2024-09-12T18:08:53.594844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:13.873172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:53.353930+0000","last_change":"2024-09-12T18:08:53.353930+0000","last_active":"2024-09-12T18:08:53.353930+0000","last_peered":"2024-09-12T18:08:53.353930+0000","last_clean":"2024-09-12T18:08:53.353930+0000","last_became_active":"2024-09-12T17:46:42.178411+0000","last_became_peered":"2024-09-12T17:46:42.178411+0000","last_unstale":"2024-09-12T18:08:53.353930+0000","last_undegraded":"2024-09-12T18:08:53.353930+0000","last_fullsized":"2024-09-12T18:08:53.353930+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:53.353827+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:53.353827+0000","last_clean_scrub_stamp":"2024-09-12T18:08:53.353827+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:43.023148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'24","reported_seq":119,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.359028+0000","last_change":"2024-09-12T18:08:46.359028+0000","last_active":"2024-09-12T18:08:46.359028+0000","last_peered":"2024-09-12T18:08:46.359028+0000","last_clean":"2024-09-12T18:08:46.359028+0000","last_became_active":"2024-09-12T17:45:03.891369+0000","last_became_peered":"2024-09-12T17:45:03.891369+0000","last_unstale":"2024-09-12T18:08:46.359028+0000","last_undegraded":"2024-09-12T18:08:46.359028+0000","last_fullsized":"2024-09-12T18:08:46.359028+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T18:08:46.358933+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T18:08:46.358933+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.358933+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:54.486807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.016493+0000","last_change":"2024-09-12T18:09:05.016493+0000","last_active":"2024-09-12T18:09:05.016493+0000","last_peered":"2024-09-12T18:09:05.016493+0000","last_clean":"2024-09-12T18:09:05.016493+0000","last_became_active":"2024-09-12T17:57:00.465360+0000","last_became_peered":"2024-09-12T17:57:00.465360+0000","last_unstale":"2024-09-12T18:09:05.016493+0000","last_undegraded":"2024-09-12T18:09:05.016493+0000","last_fullsized":"2024-09-12T18:09:05.016493+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:05.016343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:05.016343+0000","last_clean_scrub_stamp":"2024-09-12T18:09:05.016343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:58.019097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.046410+0000","last_change":"2024-09-12T18:08:59.046410+0000","last_active":"2024-09-12T18:08:59.046410+0000","last_peered":"2024-09-12T18:08:59.046410+0000","last_clean":"2024-09-12T18:08:59.046410+0000","last_became_active":"2024-09-12T17:46:45.536056+0000","last_became_peered":"2024-09-12T17:46:45.536056+0000","last_unstale":"2024-09-12T18:08:59.046410+0000","last_undegraded":"2024-09-12T18:08:59.046410+0000","last_fullsized":"2024-09-12T18:08:59.046410+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:08:59.046321+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:08:59.046321+0000","last_clean_scrub_stamp":"2024-09-12T18:08:59.046321+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:06.911101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.080353+0000","last_change":"2024-09-12T18:08:41.080353+0000","last_active":"2024-09-12T18:08:41.080353+0000","last_peered":"2024-09-12T18:08:41.080353+0000","last_clean":"2024-09-12T18:08:41.080353+0000","last_became_active":"2024-09-12T17:46:42.182831+0000","last_became_peered":"2024-09-12T17:46:42.182831+0000","last_unstale":"2024-09-12T18:08:41.080353+0000","last_undegraded":"2024-09-12T18:08:41.080353+0000","last_fullsized":"2024-09-12T18:08:41.080353+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:41.080224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:41.080224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.080224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:51.193117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'86","reported_seq":290,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:48.062315+0000","last_change":"2024-09-12T18:08:48.062222+0000","last_active":"2024-09-12T18:08:48.062315+0000","last_peered":"2024-09-12T18:08:48.062315+0000","last_clean":"2024-09-12T18:08:48.062315+0000","last_became_active":"2024-09-12T17:45:03.893452+0000","last_became_peered":"2024-09-12T17:45:03.893452+0000","last_unstale":"2024-09-12T18:08:48.062315+0000","last_undegraded":"2024-09-12T18:08:48.062315+0000","last_fullsized":"2024-09-12T18:08:48.062315+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T18:08:48.062121+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T18:08:48.062121+0000","last_clean_scrub_stamp":"2024-09-12T18:08:48.062121+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:31.934538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":321,"num_write":137,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.057507+0000","last_change":"2024-09-12T18:09:04.057507+0000","last_active":"2024-09-12T18:09:04.057507+0000","last_peered":"2024-09-12T18:09:04.057507+0000","last_clean":"2024-09-12T18:09:04.057507+0000","last_became_active":"2024-09-12T17:57:00.464068+0000","last_became_peered":"2024-09-12T17:57:00.464068+0000","last_unstale":"2024-09-12T18:09:04.057507+0000","last_undegraded":"2024-09-12T18:09:04.057507+0000","last_fullsized":"2024-09-12T18:09:04.057507+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:09:04.057414+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:09:04.057414+0000","last_clean_scrub_stamp":"2024-09-12T18:09:04.057414+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:00.303910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.229406+0000","last_change":"2024-09-12T18:08:47.229406+0000","last_active":"2024-09-12T18:08:47.229406+0000","last_peered":"2024-09-12T18:08:47.229406+0000","last_clean":"2024-09-12T18:08:47.229406+0000","last_became_active":"2024-09-12T17:46:45.206644+0000","last_became_peered":"2024-09-12T17:46:45.206644+0000","last_unstale":"2024-09-12T18:08:47.229406+0000","last_undegraded":"2024-09-12T18:08:47.229406+0000","last_fullsized":"2024-09-12T18:08:47.229406+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:47.229261+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:47.229261+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.229261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:32.062731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.353690+0000","last_change":"2024-09-12T18:08:54.353690+0000","last_active":"2024-09-12T18:08:54.353690+0000","last_peered":"2024-09-12T18:08:54.353690+0000","last_clean":"2024-09-12T18:08:54.353690+0000","last_became_active":"2024-09-12T17:46:42.184232+0000","last_became_peered":"2024-09-12T17:46:42.184232+0000","last_unstale":"2024-09-12T18:08:54.353690+0000","last_undegraded":"2024-09-12T18:08:54.353690+0000","last_fullsized":"2024-09-12T18:08:54.353690+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:54.353598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:54.353598+0000","last_clean_scrub_stamp":"2024-09-12T18:08:54.353598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:34.108336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:48.947007+0000","last_change":"2024-09-12T18:08:48.946940+0000","last_active":"2024-09-12T18:08:48.947007+0000","last_peered":"2024-09-12T18:08:48.947007+0000","last_clean":"2024-09-12T18:08:48.947007+0000","last_became_active":"2024-09-12T17:45:03.896663+0000","last_became_peered":"2024-09-12T17:45:03.896663+0000","last_unstale":"2024-09-12T18:08:48.947007+0000","last_undegraded":"2024-09-12T18:08:48.947007+0000","last_fullsized":"2024-09-12T18:08:48.947007+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T18:08:48.946856+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T18:08:48.946856+0000","last_clean_scrub_stamp":"2024-09-12T18:08:48.946856+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:37.430452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.472940+0000","last_change":"2024-09-12T18:09:04.472940+0000","last_active":"2024-09-12T18:09:04.472940+0000","last_peered":"2024-09-12T18:09:04.472940+0000","last_clean":"2024-09-12T18:09:04.472940+0000","last_became_active":"2024-09-12T17:57:00.465596+0000","last_became_peered":"2024-09-12T17:57:00.465596+0000","last_unstale":"2024-09-12T18:09:04.472940+0000","last_undegraded":"2024-09-12T18:09:04.472940+0000","last_fullsized":"2024-09-12T18:09:04.472940+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:04.472851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:04.472851+0000","last_clean_scrub_stamp":"2024-09-12T18:09:04.472851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:44.442587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.048452+0000","last_change":"2024-09-12T18:08:58.048452+0000","last_active":"2024-09-12T18:08:58.048452+0000","last_peered":"2024-09-12T18:08:58.048452+0000","last_clean":"2024-09-12T18:08:58.048452+0000","last_became_active":"2024-09-12T17:46:45.208019+0000","last_became_peered":"2024-09-12T17:46:45.208019+0000","last_unstale":"2024-09-12T18:08:58.048452+0000","last_undegraded":"2024-09-12T18:08:58.048452+0000","last_fullsized":"2024-09-12T18:08:58.048452+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:58.048359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:58.048359+0000","last_clean_scrub_stamp":"2024-09-12T18:08:58.048359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:12.396591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.644729+0000","last_change":"2024-09-12T18:08:45.644729+0000","last_active":"2024-09-12T18:08:45.644729+0000","last_peered":"2024-09-12T18:08:45.644729+0000","last_clean":"2024-09-12T18:08:45.644729+0000","last_became_active":"2024-09-12T17:46:42.184250+0000","last_became_peered":"2024-09-12T17:46:42.184250+0000","last_unstale":"2024-09-12T18:08:45.644729+0000","last_undegraded":"2024-09-12T18:08:45.644729+0000","last_fullsized":"2024-09-12T18:08:45.644729+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:45.644627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:45.644627+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.644627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:20.380257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'40","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.074883+0000","last_change":"2024-09-12T18:08:36.074825+0000","last_active":"2024-09-12T18:08:36.074883+0000","last_peered":"2024-09-12T18:08:36.074883+0000","last_clean":"2024-09-12T18:08:36.074883+0000","last_became_active":"2024-09-12T17:45:03.897291+0000","last_became_peered":"2024-09-12T17:45:03.897291+0000","last_unstale":"2024-09-12T18:08:36.074883+0000","last_undegraded":"2024-09-12T18:08:36.074883+0000","last_fullsized":"2024-09-12T18:08:36.074883+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-12T18:08:36.074737+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-12T18:08:36.074737+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.074737+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:38.882995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.997994+0000","last_change":"2024-09-12T18:08:59.997994+0000","last_active":"2024-09-12T18:08:59.997994+0000","last_peered":"2024-09-12T18:08:59.997994+0000","last_clean":"2024-09-12T18:08:59.997994+0000","last_became_active":"2024-09-12T17:57:00.465454+0000","last_became_peered":"2024-09-12T17:57:00.465454+0000","last_unstale":"2024-09-12T18:08:59.997994+0000","last_undegraded":"2024-09-12T18:08:59.997994+0000","last_fullsized":"2024-09-12T18:08:59.997994+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:59.997861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:59.997861+0000","last_clean_scrub_stamp":"2024-09-12T18:08:59.997861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:40.745237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:00.339979+0000","last_change":"2024-09-12T18:09:00.339979+0000","last_active":"2024-09-12T18:09:00.339979+0000","last_peered":"2024-09-12T18:09:00.339979+0000","last_clean":"2024-09-12T18:09:00.339979+0000","last_became_active":"2024-09-12T17:46:45.207607+0000","last_became_peered":"2024-09-12T17:46:45.207607+0000","last_unstale":"2024-09-12T18:09:00.339979+0000","last_undegraded":"2024-09-12T18:09:00.339979+0000","last_fullsized":"2024-09-12T18:09:00.339979+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:00.339838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:00.339838+0000","last_clean_scrub_stamp":"2024-09-12T18:09:00.339838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.327678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:52.059319+0000","last_change":"2024-09-12T18:08:52.059319+0000","last_active":"2024-09-12T18:08:52.059319+0000","last_peered":"2024-09-12T18:08:52.059319+0000","last_clean":"2024-09-12T18:08:52.059319+0000","last_became_active":"2024-09-12T17:46:42.182267+0000","last_became_peered":"2024-09-12T17:46:42.182267+0000","last_unstale":"2024-09-12T18:08:52.059319+0000","last_undegraded":"2024-09-12T18:08:52.059319+0000","last_fullsized":"2024-09-12T18:08:52.059319+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:08:52.059199+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:08:52.059199+0000","last_clean_scrub_stamp":"2024-09-12T18:08:52.059199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:10.029730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'54","reported_seq":203,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.395549+0000","last_change":"2024-09-12T18:08:47.395483+0000","last_active":"2024-09-12T18:08:47.395549+0000","last_peered":"2024-09-12T18:08:47.395549+0000","last_clean":"2024-09-12T18:08:47.395549+0000","last_became_active":"2024-09-12T17:45:03.891861+0000","last_became_peered":"2024-09-12T17:45:03.891861+0000","last_unstale":"2024-09-12T18:08:47.395549+0000","last_undegraded":"2024-09-12T18:08:47.395549+0000","last_fullsized":"2024-09-12T18:08:47.395549+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'54","last_scrub_stamp":"2024-09-12T18:08:47.395375+0000","last_deep_scrub":"261'54","last_deep_scrub_stamp":"2024-09-12T18:08:47.395375+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.395375+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:12.049380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":286,"num_read_kb":219,"num_write":84,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.342893+0000","last_change":"2024-09-12T18:08:55.342893+0000","last_active":"2024-09-12T18:08:55.342893+0000","last_peered":"2024-09-12T18:08:55.342893+0000","last_clean":"2024-09-12T18:08:55.342893+0000","last_became_active":"2024-09-12T17:57:00.466761+0000","last_became_peered":"2024-09-12T17:57:00.466761+0000","last_unstale":"2024-09-12T18:08:55.342893+0000","last_undegraded":"2024-09-12T18:08:55.342893+0000","last_fullsized":"2024-09-12T18:08:55.342893+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:55.342804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:55.342804+0000","last_clean_scrub_stamp":"2024-09-12T18:08:55.342804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:49.154953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.383863+0000","last_change":"2024-09-12T18:08:59.383863+0000","last_active":"2024-09-12T18:08:59.383863+0000","last_peered":"2024-09-12T18:08:59.383863+0000","last_clean":"2024-09-12T18:08:59.383863+0000","last_became_active":"2024-09-12T17:46:45.536927+0000","last_became_peered":"2024-09-12T17:46:45.536927+0000","last_unstale":"2024-09-12T18:08:59.383863+0000","last_undegraded":"2024-09-12T18:08:59.383863+0000","last_fullsized":"2024-09-12T18:08:59.383863+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:59.383782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:59.383782+0000","last_clean_scrub_stamp":"2024-09-12T18:08:59.383782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:04.683664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'5","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.385091+0000","last_change":"2024-09-12T18:08:32.385091+0000","last_active":"2024-09-12T18:08:32.385091+0000","last_peered":"2024-09-12T18:08:32.385091+0000","last_clean":"2024-09-12T18:08:32.385091+0000","last_became_active":"2024-09-12T17:46:42.182346+0000","last_became_peered":"2024-09-12T17:46:42.182346+0000","last_unstale":"2024-09-12T18:08:32.385091+0000","last_undegraded":"2024-09-12T18:08:32.385091+0000","last_fullsized":"2024-09-12T18:08:32.385091+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:08:32.384982+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:08:32.384982+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.384982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:00.783251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'22","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.027459+0000","last_change":"2024-09-12T18:08:35.027396+0000","last_active":"2024-09-12T18:08:35.027459+0000","last_peered":"2024-09-12T18:08:35.027459+0000","last_clean":"2024-09-12T18:08:35.027459+0000","last_became_active":"2024-09-12T17:45:03.895580+0000","last_became_peered":"2024-09-12T17:45:03.895580+0000","last_unstale":"2024-09-12T18:08:35.027459+0000","last_undegraded":"2024-09-12T18:08:35.027459+0000","last_fullsized":"2024-09-12T18:08:35.027459+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-12T18:08:35.027312+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-12T18:08:35.027312+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.027312+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:45.152556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.218723+0000","last_change":"2024-09-12T18:08:49.218669+0000","last_active":"2024-09-12T18:08:49.218723+0000","last_peered":"2024-09-12T18:08:49.218723+0000","last_clean":"2024-09-12T18:08:49.218723+0000","last_became_active":"2024-09-12T17:57:00.462863+0000","last_became_peered":"2024-09-12T17:57:00.462863+0000","last_unstale":"2024-09-12T18:08:49.218723+0000","last_undegraded":"2024-09-12T18:08:49.218723+0000","last_fullsized":"2024-09-12T18:08:49.218723+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:49.218582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:49.218582+0000","last_clean_scrub_stamp":"2024-09-12T18:08:49.218582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.978566+0000","last_change":"2024-09-12T18:08:55.978566+0000","last_active":"2024-09-12T18:08:55.978566+0000","last_peered":"2024-09-12T18:08:55.978566+0000","last_clean":"2024-09-12T18:08:55.978566+0000","last_became_active":"2024-09-12T17:46:45.536831+0000","last_became_peered":"2024-09-12T17:46:45.536831+0000","last_unstale":"2024-09-12T18:08:55.978566+0000","last_undegraded":"2024-09-12T18:08:55.978566+0000","last_fullsized":"2024-09-12T18:08:55.978566+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:08:55.978474+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:08:55.978474+0000","last_clean_scrub_stamp":"2024-09-12T18:08:55.978474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:44.132663+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:51.390454+0000","last_change":"2024-09-12T18:08:51.390454+0000","last_active":"2024-09-12T18:08:51.390454+0000","last_peered":"2024-09-12T18:08:51.390454+0000","last_clean":"2024-09-12T18:08:51.390454+0000","last_became_active":"2024-09-12T17:46:42.185216+0000","last_became_peered":"2024-09-12T17:46:42.185216+0000","last_unstale":"2024-09-12T18:08:51.390454+0000","last_undegraded":"2024-09-12T18:08:51.390454+0000","last_fullsized":"2024-09-12T18:08:51.390454+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T18:08:51.390365+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T18:08:51.390365+0000","last_clean_scrub_stamp":"2024-09-12T18:08:51.390365+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.879166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.070223+0000","last_change":"2024-09-12T18:08:47.070223+0000","last_active":"2024-09-12T18:08:47.070223+0000","last_peered":"2024-09-12T18:08:47.070223+0000","last_clean":"2024-09-12T18:08:47.070223+0000","last_became_active":"2024-09-12T17:45:03.894642+0000","last_became_peered":"2024-09-12T17:45:03.894642+0000","last_unstale":"2024-09-12T18:08:47.070223+0000","last_undegraded":"2024-09-12T18:08:47.070223+0000","last_fullsized":"2024-09-12T18:08:47.070223+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:47.070132+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:47.070132+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.070132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:12.119339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.653352+0000","last_change":"2024-09-12T18:08:55.653352+0000","last_active":"2024-09-12T18:08:55.653352+0000","last_peered":"2024-09-12T18:08:55.653352+0000","last_clean":"2024-09-12T18:08:55.653352+0000","last_became_active":"2024-09-12T17:57:00.465546+0000","last_became_peered":"2024-09-12T17:57:00.465546+0000","last_unstale":"2024-09-12T18:08:55.653352+0000","last_undegraded":"2024-09-12T18:08:55.653352+0000","last_fullsized":"2024-09-12T18:08:55.653352+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:55.653257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:55.653257+0000","last_clean_scrub_stamp":"2024-09-12T18:08:55.653257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:53.336014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'13","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:51.636064+0000","last_change":"2024-09-12T18:08:51.636064+0000","last_active":"2024-09-12T18:08:51.636064+0000","last_peered":"2024-09-12T18:08:51.636064+0000","last_clean":"2024-09-12T18:08:51.636064+0000","last_became_active":"2024-09-12T17:46:45.206537+0000","last_became_peered":"2024-09-12T17:46:45.206537+0000","last_unstale":"2024-09-12T18:08:51.636064+0000","last_undegraded":"2024-09-12T18:08:51.636064+0000","last_fullsized":"2024-09-12T18:08:51.636064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T18:08:51.635976+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T18:08:51.635976+0000","last_clean_scrub_stamp":"2024-09-12T18:08:51.635976+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:54.265158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29814,"num_write":18,"num_write_kb":19003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.010820+0000","last_change":"2024-09-12T18:08:54.010820+0000","last_active":"2024-09-12T18:08:54.010820+0000","last_peered":"2024-09-12T18:08:54.010820+0000","last_clean":"2024-09-12T18:08:54.010820+0000","last_became_active":"2024-09-12T17:46:42.177427+0000","last_became_peered":"2024-09-12T17:46:42.177427+0000","last_unstale":"2024-09-12T18:08:54.010820+0000","last_undegraded":"2024-09-12T18:08:54.010820+0000","last_fullsized":"2024-09-12T18:08:54.010820+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:54.010734+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:54.010734+0000","last_clean_scrub_stamp":"2024-09-12T18:08:54.010734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:25.811116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'157","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.188055+0000","last_change":"2024-09-12T18:08:38.188055+0000","last_active":"2024-09-12T18:08:38.188055+0000","last_peered":"2024-09-12T18:08:38.188055+0000","last_clean":"2024-09-12T18:08:38.188055+0000","last_became_active":"2024-09-12T17:45:03.898292+0000","last_became_peered":"2024-09-12T17:45:03.898292+0000","last_unstale":"2024-09-12T18:08:38.188055+0000","last_undegraded":"2024-09-12T18:08:38.188055+0000","last_fullsized":"2024-09-12T18:08:38.188055+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'157","last_scrub_stamp":"2024-09-12T18:08:38.187951+0000","last_deep_scrub":"264'157","last_deep_scrub_stamp":"2024-09-12T18:08:38.187951+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.187951+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:31.196604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":951,"num_read_kb":701,"num_write":196,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2490,"num_omap_keys":5,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.397676+0000","last_change":"2024-09-12T18:08:37.397676+0000","last_active":"2024-09-12T18:08:37.397676+0000","last_peered":"2024-09-12T18:08:37.397676+0000","last_clean":"2024-09-12T18:08:37.397676+0000","last_became_active":"2024-09-12T17:57:00.464090+0000","last_became_peered":"2024-09-12T17:57:00.464090+0000","last_unstale":"2024-09-12T18:08:37.397676+0000","last_undegraded":"2024-09-12T18:08:37.397676+0000","last_fullsized":"2024-09-12T18:08:37.397676+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:37.397578+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:37.397578+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.397578+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:24.082679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.126360+0000","last_change":"2024-09-12T18:08:42.126360+0000","last_active":"2024-09-12T18:08:42.126360+0000","last_peered":"2024-09-12T18:08:42.126360+0000","last_clean":"2024-09-12T18:08:42.126360+0000","last_became_active":"2024-09-12T17:46:45.205357+0000","last_became_peered":"2024-09-12T17:46:45.205357+0000","last_unstale":"2024-09-12T18:08:42.126360+0000","last_undegraded":"2024-09-12T18:08:42.126360+0000","last_fullsized":"2024-09-12T18:08:42.126360+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:42.126244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:42.126244+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.126244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:30.798441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.072066+0000","last_change":"2024-09-12T18:08:50.072066+0000","last_active":"2024-09-12T18:08:50.072066+0000","last_peered":"2024-09-12T18:08:50.072066+0000","last_clean":"2024-09-12T18:08:50.072066+0000","last_became_active":"2024-09-12T17:46:42.176415+0000","last_became_peered":"2024-09-12T17:46:42.176415+0000","last_unstale":"2024-09-12T18:08:50.072066+0000","last_undegraded":"2024-09-12T18:08:50.072066+0000","last_fullsized":"2024-09-12T18:08:50.072066+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:50.071979+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:50.071979+0000","last_clean_scrub_stamp":"2024-09-12T18:08:50.071979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:49.464626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'25","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.428990+0000","last_change":"2024-09-12T18:08:47.428990+0000","last_active":"2024-09-12T18:08:47.428990+0000","last_peered":"2024-09-12T18:08:47.428990+0000","last_clean":"2024-09-12T18:08:47.428990+0000","last_became_active":"2024-09-12T17:45:03.889334+0000","last_became_peered":"2024-09-12T17:45:03.889334+0000","last_unstale":"2024-09-12T18:08:47.428990+0000","last_undegraded":"2024-09-12T18:08:47.428990+0000","last_fullsized":"2024-09-12T18:08:47.428990+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-12T18:08:47.428859+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-12T18:08:47.428859+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.428859+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:31.400424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:03.430138+0000","last_change":"2024-09-12T18:09:03.430138+0000","last_active":"2024-09-12T18:09:03.430138+0000","last_peered":"2024-09-12T18:09:03.430138+0000","last_clean":"2024-09-12T18:09:03.430138+0000","last_became_active":"2024-09-12T17:57:00.453435+0000","last_became_peered":"2024-09-12T17:57:00.453435+0000","last_unstale":"2024-09-12T18:09:03.430138+0000","last_undegraded":"2024-09-12T18:09:03.430138+0000","last_fullsized":"2024-09-12T18:09:03.430138+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:03.430049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:03.430049+0000","last_clean_scrub_stamp":"2024-09-12T18:09:03.430049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:32.062864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"261'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:52.386558+0000","last_change":"2024-09-12T18:08:52.386494+0000","last_active":"2024-09-12T18:08:52.386558+0000","last_peered":"2024-09-12T18:08:52.386558+0000","last_clean":"2024-09-12T18:08:52.386558+0000","last_became_active":"2024-09-12T17:46:45.210669+0000","last_became_peered":"2024-09-12T17:46:45.210669+0000","last_unstale":"2024-09-12T18:08:52.386558+0000","last_undegraded":"2024-09-12T18:08:52.386558+0000","last_fullsized":"2024-09-12T18:08:52.386558+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:52.386396+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:52.386396+0000","last_clean_scrub_stamp":"2024-09-12T18:08:52.386396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:22.455595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:53.043359+0000","last_change":"2024-09-12T18:08:53.043359+0000","last_active":"2024-09-12T18:08:53.043359+0000","last_peered":"2024-09-12T18:08:53.043359+0000","last_clean":"2024-09-12T18:08:53.043359+0000","last_became_active":"2024-09-12T17:46:42.179369+0000","last_became_peered":"2024-09-12T17:46:42.179369+0000","last_unstale":"2024-09-12T18:08:53.043359+0000","last_undegraded":"2024-09-12T18:08:53.043359+0000","last_fullsized":"2024-09-12T18:08:53.043359+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:53.043248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:53.043248+0000","last_clean_scrub_stamp":"2024-09-12T18:08:53.043248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:48.637264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'11","reported_seq":82,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.629948+0000","last_change":"2024-09-12T18:08:47.629948+0000","last_active":"2024-09-12T18:08:47.629948+0000","last_peered":"2024-09-12T18:08:47.629948+0000","last_clean":"2024-09-12T18:08:47.629948+0000","last_became_active":"2024-09-12T17:45:03.891751+0000","last_became_peered":"2024-09-12T17:45:03.891751+0000","last_unstale":"2024-09-12T18:08:47.629948+0000","last_undegraded":"2024-09-12T18:08:47.629948+0000","last_fullsized":"2024-09-12T18:08:47.629948+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-12T18:08:47.629821+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-12T18:08:47.629821+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.629821+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:13.106639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:02.396680+0000","last_change":"2024-09-12T18:09:02.396680+0000","last_active":"2024-09-12T18:09:02.396680+0000","last_peered":"2024-09-12T18:09:02.396680+0000","last_clean":"2024-09-12T18:09:02.396680+0000","last_became_active":"2024-09-12T17:57:00.465706+0000","last_became_peered":"2024-09-12T17:57:00.465706+0000","last_unstale":"2024-09-12T18:09:02.396680+0000","last_undegraded":"2024-09-12T18:09:02.396680+0000","last_fullsized":"2024-09-12T18:09:02.396680+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:02.396580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:02.396580+0000","last_clean_scrub_stamp":"2024-09-12T18:09:02.396580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:16.843859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'8","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.040678+0000","last_change":"2024-09-12T18:08:42.040678+0000","last_active":"2024-09-12T18:08:42.040678+0000","last_peered":"2024-09-12T18:08:42.040678+0000","last_clean":"2024-09-12T18:08:42.040678+0000","last_became_active":"2024-09-12T17:46:45.206384+0000","last_became_peered":"2024-09-12T17:46:45.206384+0000","last_unstale":"2024-09-12T18:08:42.040678+0000","last_undegraded":"2024-09-12T18:08:42.040678+0000","last_fullsized":"2024-09-12T18:08:42.040678+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:08:42.040581+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:08:42.040581+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.040581+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:03.377618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":22528,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.118969+0000","last_change":"2024-09-12T18:08:40.118969+0000","last_active":"2024-09-12T18:08:40.118969+0000","last_peered":"2024-09-12T18:08:40.118969+0000","last_clean":"2024-09-12T18:08:40.118969+0000","last_became_active":"2024-09-12T17:46:42.177381+0000","last_became_peered":"2024-09-12T17:46:42.177381+0000","last_unstale":"2024-09-12T18:08:40.118969+0000","last_undegraded":"2024-09-12T18:08:40.118969+0000","last_fullsized":"2024-09-12T18:08:40.118969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:40.118881+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:40.118881+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.118881+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:00.785132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.025529+0000","last_change":"2024-09-12T18:08:34.025529+0000","last_active":"2024-09-12T18:08:34.025529+0000","last_peered":"2024-09-12T18:08:34.025529+0000","last_clean":"2024-09-12T18:08:34.025529+0000","last_became_active":"2024-09-12T17:45:03.893234+0000","last_became_peered":"2024-09-12T17:45:03.893234+0000","last_unstale":"2024-09-12T18:08:34.025529+0000","last_undegraded":"2024-09-12T18:08:34.025529+0000","last_fullsized":"2024-09-12T18:08:34.025529+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T18:08:34.025436+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T18:08:34.025436+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.025436+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:27.725926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":127,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:00.965293+0000","last_change":"2024-09-12T18:09:00.965293+0000","last_active":"2024-09-12T18:09:00.965293+0000","last_peered":"2024-09-12T18:09:00.965293+0000","last_clean":"2024-09-12T18:09:00.965293+0000","last_became_active":"2024-09-12T17:57:00.466994+0000","last_became_peered":"2024-09-12T17:57:00.466994+0000","last_unstale":"2024-09-12T18:09:00.965293+0000","last_undegraded":"2024-09-12T18:09:00.965293+0000","last_fullsized":"2024-09-12T18:09:00.965293+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:00.965204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:00.965204+0000","last_clean_scrub_stamp":"2024-09-12T18:09:00.965204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:00.111849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.674925+0000","last_change":"2024-09-12T18:08:50.674925+0000","last_active":"2024-09-12T18:08:50.674925+0000","last_peered":"2024-09-12T18:08:50.674925+0000","last_clean":"2024-09-12T18:08:50.674925+0000","last_became_active":"2024-09-12T17:46:45.207552+0000","last_became_peered":"2024-09-12T17:46:45.207552+0000","last_unstale":"2024-09-12T18:08:50.674925+0000","last_undegraded":"2024-09-12T18:08:50.674925+0000","last_fullsized":"2024-09-12T18:08:50.674925+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:50.674829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:50.674829+0000","last_clean_scrub_stamp":"2024-09-12T18:08:50.674829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:03.783807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.014529+0000","last_change":"2024-09-12T18:08:40.014529+0000","last_active":"2024-09-12T18:08:40.014529+0000","last_peered":"2024-09-12T18:08:40.014529+0000","last_clean":"2024-09-12T18:08:40.014529+0000","last_became_active":"2024-09-12T17:46:42.181805+0000","last_became_peered":"2024-09-12T17:46:42.181805+0000","last_unstale":"2024-09-12T18:08:40.014529+0000","last_undegraded":"2024-09-12T18:08:40.014529+0000","last_fullsized":"2024-09-12T18:08:40.014529+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:40.014431+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:40.014431+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.014431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:47.203544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'23","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.036002+0000","last_change":"2024-09-12T18:08:46.035941+0000","last_active":"2024-09-12T18:08:46.036002+0000","last_peered":"2024-09-12T18:08:46.036002+0000","last_clean":"2024-09-12T18:08:46.036002+0000","last_became_active":"2024-09-12T17:45:03.893361+0000","last_became_peered":"2024-09-12T17:45:03.893361+0000","last_unstale":"2024-09-12T18:08:46.036002+0000","last_undegraded":"2024-09-12T18:08:46.036002+0000","last_fullsized":"2024-09-12T18:08:46.036002+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-12T18:08:46.035841+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-12T18:08:46.035841+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.035841+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:35.804923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":77,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'207","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.759272+0000","last_change":"2024-09-12T18:08:23.759272+0000","last_active":"2024-09-12T18:08:23.759272+0000","last_peered":"2024-09-12T18:08:23.759272+0000","last_clean":"2024-09-12T18:08:23.759272+0000","last_became_active":"2024-09-12T17:29:52.955124+0000","last_became_peered":"2024-09-12T17:29:52.955124+0000","last_unstale":"2024-09-12T18:08:23.759272+0000","last_undegraded":"2024-09-12T18:08:23.759272+0000","last_fullsized":"2024-09-12T18:08:23.759272+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:23.759131+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:23.759131+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.759131+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:37.285891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":3241,"num_write":1056,"num_write_kb":28474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'166","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.439354+0000","last_change":"2024-09-12T18:08:28.439354+0000","last_active":"2024-09-12T18:08:28.439354+0000","last_peered":"2024-09-12T18:08:28.439354+0000","last_clean":"2024-09-12T18:08:28.439354+0000","last_became_active":"2024-09-12T17:29:54.957047+0000","last_became_peered":"2024-09-12T17:29:54.957047+0000","last_unstale":"2024-09-12T18:08:28.439354+0000","last_undegraded":"2024-09-12T18:08:28.439354+0000","last_fullsized":"2024-09-12T18:08:28.439354+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T18:08:28.439256+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T18:08:28.439256+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.439256+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:06.350790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":598,"num_write":253,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'214","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.249725+0000","last_change":"2024-09-12T18:08:14.249725+0000","last_active":"2024-09-12T18:08:14.249725+0000","last_peered":"2024-09-12T18:08:14.249725+0000","last_clean":"2024-09-12T18:08:14.249725+0000","last_became_active":"2024-09-12T17:29:52.954249+0000","last_became_peered":"2024-09-12T17:29:52.954249+0000","last_unstale":"2024-09-12T18:08:14.249725+0000","last_undegraded":"2024-09-12T18:08:14.249725+0000","last_fullsized":"2024-09-12T18:08:14.249725+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-12T18:08:14.249628+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-12T18:08:14.249628+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.249628+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:16.628392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":62367,"num_write":1041,"num_write_kb":21747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'277","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.778646+0000","last_change":"2024-09-12T18:08:28.778646+0000","last_active":"2024-09-12T18:08:28.778646+0000","last_peered":"2024-09-12T18:08:28.778646+0000","last_clean":"2024-09-12T18:08:28.778646+0000","last_became_active":"2024-09-12T17:29:54.959503+0000","last_became_peered":"2024-09-12T17:29:54.959503+0000","last_unstale":"2024-09-12T18:08:28.778646+0000","last_undegraded":"2024-09-12T18:08:28.778646+0000","last_fullsized":"2024-09-12T18:08:28.778646+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'277","last_scrub_stamp":"2024-09-12T18:08:28.778560+0000","last_deep_scrub":"264'277","last_deep_scrub_stamp":"2024-09-12T18:08:28.778560+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.778560+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:46.698803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1203,"num_read_kb":968,"num_write":436,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'251","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.162765+0000","last_change":"2024-09-12T18:08:16.162765+0000","last_active":"2024-09-12T18:08:16.162765+0000","last_peered":"2024-09-12T18:08:16.162765+0000","last_clean":"2024-09-12T18:08:16.162765+0000","last_became_active":"2024-09-12T17:29:52.957594+0000","last_became_peered":"2024-09-12T17:29:52.957594+0000","last_unstale":"2024-09-12T18:08:16.162765+0000","last_undegraded":"2024-09-12T18:08:16.162765+0000","last_fullsized":"2024-09-12T18:08:16.162765+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T18:08:16.162633+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T18:08:16.162633+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.162633+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:03.752251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595238,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":699,"num_read_kb":82538,"num_write":1032,"num_write_kb":35611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'90","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.797499+0000","last_change":"2024-09-12T18:08:25.797499+0000","last_active":"2024-09-12T18:08:25.797499+0000","last_peered":"2024-09-12T18:08:25.797499+0000","last_clean":"2024-09-12T18:08:25.797499+0000","last_became_active":"2024-09-12T17:29:54.954764+0000","last_became_peered":"2024-09-12T17:29:54.954764+0000","last_unstale":"2024-09-12T18:08:25.797499+0000","last_undegraded":"2024-09-12T18:08:25.797499+0000","last_fullsized":"2024-09-12T18:08:25.797499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-09-12T18:08:25.797393+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-09-12T18:08:25.797393+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.797393+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:00.865693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":371,"num_write":125,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'210","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.448812+0000","last_change":"2024-09-12T18:08:22.448812+0000","last_active":"2024-09-12T18:08:22.448812+0000","last_peered":"2024-09-12T18:08:22.448812+0000","last_clean":"2024-09-12T18:08:22.448812+0000","last_became_active":"2024-09-12T17:29:52.956816+0000","last_became_peered":"2024-09-12T17:29:52.956816+0000","last_unstale":"2024-09-12T18:08:22.448812+0000","last_undegraded":"2024-09-12T18:08:22.448812+0000","last_fullsized":"2024-09-12T18:08:22.448812+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-12T18:08:22.448672+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-12T18:08:22.448672+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.448672+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:57.146612+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":70330,"num_write":999,"num_write_kb":42186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4089","reported_seq":4675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.210788+0000","last_change":"2024-09-12T18:08:24.210788+0000","last_active":"2024-09-12T18:08:24.210788+0000","last_peered":"2024-09-12T18:08:24.210788+0000","last_clean":"2024-09-12T18:08:24.210788+0000","last_became_active":"2024-09-12T17:29:54.944959+0000","last_became_peered":"2024-09-12T17:29:54.944959+0000","last_unstale":"2024-09-12T18:08:24.210788+0000","last_undegraded":"2024-09-12T18:08:24.210788+0000","last_fullsized":"2024-09-12T18:08:24.210788+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4089","last_scrub_stamp":"2024-09-12T18:08:24.210700+0000","last_deep_scrub":"264'4089","last_deep_scrub_stamp":"2024-09-12T18:08:24.210700+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.210700+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":3000,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:36.120715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16426,"num_read_kb":13705,"num_write":6135,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'163","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.724946+0000","last_change":"2024-09-12T18:08:22.724946+0000","last_active":"2024-09-12T18:08:22.724946+0000","last_peered":"2024-09-12T18:08:22.724946+0000","last_clean":"2024-09-12T18:08:22.724946+0000","last_became_active":"2024-09-12T17:29:52.960666+0000","last_became_peered":"2024-09-12T17:29:52.960666+0000","last_unstale":"2024-09-12T18:08:22.724946+0000","last_undegraded":"2024-09-12T18:08:22.724946+0000","last_fullsized":"2024-09-12T18:08:22.724946+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T18:08:22.724802+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T18:08:22.724802+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.724802+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:44.691765+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":500,"num_read_kb":127585,"num_write":826,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'125","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.067481+0000","last_change":"2024-09-12T18:08:22.067481+0000","last_active":"2024-09-12T18:08:22.067481+0000","last_peered":"2024-09-12T18:08:22.067481+0000","last_clean":"2024-09-12T18:08:22.067481+0000","last_became_active":"2024-09-12T17:29:54.955205+0000","last_became_peered":"2024-09-12T17:29:54.955205+0000","last_unstale":"2024-09-12T18:08:22.067481+0000","last_undegraded":"2024-09-12T18:08:22.067481+0000","last_fullsized":"2024-09-12T18:08:22.067481+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T18:08:22.067382+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T18:08:22.067382+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.067382+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:17.462304+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":437,"num_write":181,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'215","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.474026+0000","last_change":"2024-09-12T18:08:20.474026+0000","last_active":"2024-09-12T18:08:20.474026+0000","last_peered":"2024-09-12T18:08:20.474026+0000","last_clean":"2024-09-12T18:08:20.474026+0000","last_became_active":"2024-09-12T17:29:52.955926+0000","last_became_peered":"2024-09-12T17:29:52.955926+0000","last_unstale":"2024-09-12T18:08:20.474026+0000","last_undegraded":"2024-09-12T18:08:20.474026+0000","last_fullsized":"2024-09-12T18:08:20.474026+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'215","last_scrub_stamp":"2024-09-12T18:08:20.473907+0000","last_deep_scrub":"264'215","last_deep_scrub_stamp":"2024-09-12T18:08:20.473907+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.473907+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:59.079099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":501,"num_read_kb":5634,"num_write":1057,"num_write_kb":27185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'203","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.807971+0000","last_change":"2024-09-12T18:08:26.807971+0000","last_active":"2024-09-12T18:08:26.807971+0000","last_peered":"2024-09-12T18:08:26.807971+0000","last_clean":"2024-09-12T18:08:26.807971+0000","last_became_active":"2024-09-12T17:29:54.955119+0000","last_became_peered":"2024-09-12T17:29:54.955119+0000","last_unstale":"2024-09-12T18:08:26.807971+0000","last_undegraded":"2024-09-12T18:08:26.807971+0000","last_fullsized":"2024-09-12T18:08:26.807971+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-12T18:08:26.807847+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-12T18:08:26.807847+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.807847+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:28.820018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":872,"num_read_kb":697,"num_write":351,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'196","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.745850+0000","last_change":"2024-09-12T18:08:21.745850+0000","last_active":"2024-09-12T18:08:21.745850+0000","last_peered":"2024-09-12T18:08:21.745850+0000","last_clean":"2024-09-12T18:08:21.745850+0000","last_became_active":"2024-09-12T17:29:52.962236+0000","last_became_peered":"2024-09-12T17:29:52.962236+0000","last_unstale":"2024-09-12T18:08:21.745850+0000","last_undegraded":"2024-09-12T18:08:21.745850+0000","last_fullsized":"2024-09-12T18:08:21.745850+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-12T18:08:21.745689+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-12T18:08:21.745689+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.745689+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:04.341885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2835815,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":524,"num_read_kb":5167,"num_write":1014,"num_write_kb":25714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'272","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.447790+0000","last_change":"2024-09-12T18:08:29.447790+0000","last_active":"2024-09-12T18:08:29.447790+0000","last_peered":"2024-09-12T18:08:29.447790+0000","last_clean":"2024-09-12T18:08:29.447790+0000","last_became_active":"2024-09-12T17:29:54.963665+0000","last_became_peered":"2024-09-12T17:29:54.963665+0000","last_unstale":"2024-09-12T18:08:29.447790+0000","last_undegraded":"2024-09-12T18:08:29.447790+0000","last_fullsized":"2024-09-12T18:08:29.447790+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-12T18:08:29.447694+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-12T18:08:29.447694+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.447694+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:07.379854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1246,"num_read_kb":1040,"num_write":431,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'231","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.106919+0000","last_change":"2024-09-12T18:08:16.106919+0000","last_active":"2024-09-12T18:08:16.106919+0000","last_peered":"2024-09-12T18:08:16.106919+0000","last_clean":"2024-09-12T18:08:16.106919+0000","last_became_active":"2024-09-12T17:29:52.955333+0000","last_became_peered":"2024-09-12T17:29:52.955333+0000","last_unstale":"2024-09-12T18:08:16.106919+0000","last_undegraded":"2024-09-12T18:08:16.106919+0000","last_fullsized":"2024-09-12T18:08:16.106919+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-12T18:08:16.106773+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-12T18:08:16.106773+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.106773+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:19.227426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569139,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":94260,"num_write":1118,"num_write_kb":40355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'158","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.404145+0000","last_change":"2024-09-12T18:08:23.404145+0000","last_active":"2024-09-12T18:08:23.404145+0000","last_peered":"2024-09-12T18:08:23.404145+0000","last_clean":"2024-09-12T18:08:23.404145+0000","last_became_active":"2024-09-12T17:29:54.952536+0000","last_became_peered":"2024-09-12T17:29:54.952536+0000","last_unstale":"2024-09-12T18:08:23.404145+0000","last_undegraded":"2024-09-12T18:08:23.404145+0000","last_fullsized":"2024-09-12T18:08:23.404145+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'158","last_scrub_stamp":"2024-09-12T18:08:23.404033+0000","last_deep_scrub":"264'158","last_deep_scrub_stamp":"2024-09-12T18:08:23.404033+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.404033+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:50.664895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":604,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'402","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.806677+0000","last_change":"2024-09-12T18:08:23.806677+0000","last_active":"2024-09-12T18:08:23.806677+0000","last_peered":"2024-09-12T18:08:23.806677+0000","last_clean":"2024-09-12T18:08:23.806677+0000","last_became_active":"2024-09-12T17:29:54.954401+0000","last_became_peered":"2024-09-12T17:29:54.954401+0000","last_unstale":"2024-09-12T18:08:23.806677+0000","last_undegraded":"2024-09-12T18:08:23.806677+0000","last_fullsized":"2024-09-12T18:08:23.806677+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'402","last_scrub_stamp":"2024-09-12T18:08:23.806573+0000","last_deep_scrub":"264'402","last_deep_scrub_stamp":"2024-09-12T18:08:23.806573+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.806573+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:47.510776+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1720,"num_read_kb":1358,"num_write":655,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'182","reported_seq":769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.710577+0000","last_change":"2024-09-12T18:08:20.710509+0000","last_active":"2024-09-12T18:08:20.710577+0000","last_peered":"2024-09-12T18:08:20.710577+0000","last_clean":"2024-09-12T18:08:20.710577+0000","last_became_active":"2024-09-12T17:29:52.957715+0000","last_became_peered":"2024-09-12T17:29:52.957715+0000","last_unstale":"2024-09-12T18:08:20.710577+0000","last_undegraded":"2024-09-12T18:08:20.710577+0000","last_fullsized":"2024-09-12T18:08:20.710577+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-12T18:08:20.710410+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-12T18:08:20.710410+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.710410+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:15.953280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":380,"num_write":908,"num_write_kb":20925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'92","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.775080+0000","last_change":"2024-09-12T18:08:26.775080+0000","last_active":"2024-09-12T18:08:26.775080+0000","last_peered":"2024-09-12T18:08:26.775080+0000","last_clean":"2024-09-12T18:08:26.775080+0000","last_became_active":"2024-09-12T17:29:54.960430+0000","last_became_peered":"2024-09-12T17:29:54.960430+0000","last_unstale":"2024-09-12T18:08:26.775080+0000","last_undegraded":"2024-09-12T18:08:26.775080+0000","last_fullsized":"2024-09-12T18:08:26.775080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-12T18:08:26.774978+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-12T18:08:26.774978+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.774978+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:22.519253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":446,"num_read_kb":372,"num_write":151,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'245","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.079535+0000","last_change":"2024-09-12T18:08:16.079473+0000","last_active":"2024-09-12T18:08:16.079535+0000","last_peered":"2024-09-12T18:08:16.079535+0000","last_clean":"2024-09-12T18:08:16.079535+0000","last_became_active":"2024-09-12T17:29:52.960770+0000","last_became_peered":"2024-09-12T17:29:52.960770+0000","last_unstale":"2024-09-12T18:08:16.079535+0000","last_undegraded":"2024-09-12T18:08:16.079535+0000","last_fullsized":"2024-09-12T18:08:16.079535+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T18:08:16.079351+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T18:08:16.079351+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.079351+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:46.777517+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291498,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":825,"num_read_kb":13405,"num_write":1115,"num_write_kb":28936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'257","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.420438+0000","last_change":"2024-09-12T18:08:24.420438+0000","last_active":"2024-09-12T18:08:24.420438+0000","last_peered":"2024-09-12T18:08:24.420438+0000","last_clean":"2024-09-12T18:08:24.420438+0000","last_became_active":"2024-09-12T17:29:54.962822+0000","last_became_peered":"2024-09-12T17:29:54.962822+0000","last_unstale":"2024-09-12T18:08:24.420438+0000","last_undegraded":"2024-09-12T18:08:24.420438+0000","last_fullsized":"2024-09-12T18:08:24.420438+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-09-12T18:08:24.420342+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-09-12T18:08:24.420342+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.420342+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:43.478734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1220,"num_read_kb":1023,"num_write":434,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'208","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.047387+0000","last_change":"2024-09-12T18:08:17.047282+0000","last_active":"2024-09-12T18:08:17.047387+0000","last_peered":"2024-09-12T18:08:17.047387+0000","last_clean":"2024-09-12T18:08:17.047387+0000","last_became_active":"2024-09-12T17:29:52.956432+0000","last_became_peered":"2024-09-12T17:29:52.956432+0000","last_unstale":"2024-09-12T18:08:17.047387+0000","last_undegraded":"2024-09-12T18:08:17.047387+0000","last_fullsized":"2024-09-12T18:08:17.047387+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T18:08:17.047159+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T18:08:17.047159+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.047159+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:56.216084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306456,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":42949,"num_write":1043,"num_write_kb":37671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'84","reported_seq":678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.431445+0000","last_change":"2024-09-12T18:08:18.431383+0000","last_active":"2024-09-12T18:08:18.431445+0000","last_peered":"2024-09-12T18:08:18.431445+0000","last_clean":"2024-09-12T18:08:18.431445+0000","last_became_active":"2024-09-12T17:29:54.944588+0000","last_became_peered":"2024-09-12T17:29:54.944588+0000","last_unstale":"2024-09-12T18:08:18.431445+0000","last_undegraded":"2024-09-12T18:08:18.431445+0000","last_fullsized":"2024-09-12T18:08:18.431445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T18:08:18.431281+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T18:08:18.431281+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.431281+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:42.771743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":342,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'232","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.778834+0000","last_change":"2024-09-12T18:08:09.778762+0000","last_active":"2024-09-12T18:08:09.778834+0000","last_peered":"2024-09-12T18:08:09.778834+0000","last_clean":"2024-09-12T18:08:09.778834+0000","last_became_active":"2024-09-12T17:29:52.962814+0000","last_became_peered":"2024-09-12T17:29:52.962814+0000","last_unstale":"2024-09-12T18:08:09.778834+0000","last_undegraded":"2024-09-12T18:08:09.778834+0000","last_fullsized":"2024-09-12T18:08:09.778834+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-09-12T18:08:09.778651+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-09-12T18:08:09.778651+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.778651+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:58.056507+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":494,"num_read_kb":48249,"num_write":1130,"num_write_kb":37209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'126","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.419392+0000","last_change":"2024-09-12T18:08:19.419319+0000","last_active":"2024-09-12T18:08:19.419392+0000","last_peered":"2024-09-12T18:08:19.419392+0000","last_clean":"2024-09-12T18:08:19.419392+0000","last_became_active":"2024-09-12T17:29:54.956975+0000","last_became_peered":"2024-09-12T17:29:54.956975+0000","last_unstale":"2024-09-12T18:08:19.419392+0000","last_undegraded":"2024-09-12T18:08:19.419392+0000","last_fullsized":"2024-09-12T18:08:19.419392+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-12T18:08:19.419239+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-12T18:08:19.419239+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.419239+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:11.813359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":592,"num_read_kb":498,"num_write":187,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'266","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.067750+0000","last_change":"2024-09-12T18:08:14.067674+0000","last_active":"2024-09-12T18:08:14.067750+0000","last_peered":"2024-09-12T18:08:14.067750+0000","last_clean":"2024-09-12T18:08:14.067750+0000","last_became_active":"2024-09-12T17:29:52.954630+0000","last_became_peered":"2024-09-12T17:29:52.954630+0000","last_unstale":"2024-09-12T18:08:14.067750+0000","last_undegraded":"2024-09-12T18:08:14.067750+0000","last_fullsized":"2024-09-12T18:08:14.067750+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T18:08:14.067562+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T18:08:14.067562+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.067562+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:04.519905+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456483,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":845,"num_read_kb":67267,"num_write":1133,"num_write_kb":48740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'283","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.846460+0000","last_change":"2024-09-12T18:08:24.846394+0000","last_active":"2024-09-12T18:08:24.846460+0000","last_peered":"2024-09-12T18:08:24.846460+0000","last_clean":"2024-09-12T18:08:24.846460+0000","last_became_active":"2024-09-12T17:29:54.958852+0000","last_became_peered":"2024-09-12T17:29:54.958852+0000","last_unstale":"2024-09-12T18:08:24.846460+0000","last_undegraded":"2024-09-12T18:08:24.846460+0000","last_fullsized":"2024-09-12T18:08:24.846460+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'283","last_scrub_stamp":"2024-09-12T18:08:24.846301+0000","last_deep_scrub":"264'283","last_deep_scrub_stamp":"2024-09-12T18:08:24.846301+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.846301+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:55.554420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1254,"num_read_kb":1035,"num_write":436,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'170","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.123138+0000","last_change":"2024-09-12T18:08:14.123138+0000","last_active":"2024-09-12T18:08:14.123138+0000","last_peered":"2024-09-12T18:08:14.123138+0000","last_clean":"2024-09-12T18:08:14.123138+0000","last_became_active":"2024-09-12T17:29:52.959175+0000","last_became_peered":"2024-09-12T17:29:52.959175+0000","last_unstale":"2024-09-12T18:08:14.123138+0000","last_undegraded":"2024-09-12T18:08:14.123138+0000","last_fullsized":"2024-09-12T18:08:14.123138+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-09-12T18:08:14.123015+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-09-12T18:08:14.123015+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.123015+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:26.240900+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":1243,"num_write":851,"num_write_kb":36341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'157","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.836312+0000","last_change":"2024-09-12T18:08:37.836250+0000","last_active":"2024-09-12T18:08:37.836312+0000","last_peered":"2024-09-12T18:08:37.836312+0000","last_clean":"2024-09-12T18:08:37.836312+0000","last_became_active":"2024-09-12T17:30:02.964492+0000","last_became_peered":"2024-09-12T17:30:02.964492+0000","last_unstale":"2024-09-12T18:08:37.836312+0000","last_undegraded":"2024-09-12T18:08:37.836312+0000","last_fullsized":"2024-09-12T18:08:37.836312+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'157","last_scrub_stamp":"2024-09-12T18:08:37.836168+0000","last_deep_scrub":"264'157","last_deep_scrub_stamp":"2024-09-12T18:08:37.836168+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.836168+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:03.859804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":218,"num_read_kb":205,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'110","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.069383+0000","last_change":"2024-09-12T18:08:20.069383+0000","last_active":"2024-09-12T18:08:20.069383+0000","last_peered":"2024-09-12T18:08:20.069383+0000","last_clean":"2024-09-12T18:08:20.069383+0000","last_became_active":"2024-09-12T17:29:54.950633+0000","last_became_peered":"2024-09-12T17:29:54.950633+0000","last_unstale":"2024-09-12T18:08:20.069383+0000","last_undegraded":"2024-09-12T18:08:20.069383+0000","last_fullsized":"2024-09-12T18:08:20.069383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-12T18:08:20.069263+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-12T18:08:20.069263+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.069263+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:55.109697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":400,"num_write":147,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'201","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.722577+0000","last_change":"2024-09-12T18:08:16.722577+0000","last_active":"2024-09-12T18:08:16.722577+0000","last_peered":"2024-09-12T18:08:16.722577+0000","last_clean":"2024-09-12T18:08:16.722577+0000","last_became_active":"2024-09-12T17:30:28.007183+0000","last_became_peered":"2024-09-12T17:30:28.007183+0000","last_unstale":"2024-09-12T18:08:16.722577+0000","last_undegraded":"2024-09-12T18:08:16.722577+0000","last_fullsized":"2024-09-12T18:08:16.722577+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-12T18:08:16.722467+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-12T18:08:16.722467+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.722467+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:25.320294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":918,"num_read_kb":19617,"num_write":951,"num_write_kb":33635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"264'4","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.504138+0000","last_change":"2024-09-12T18:08:32.504066+0000","last_active":"2024-09-12T18:08:32.504138+0000","last_peered":"2024-09-12T18:08:32.504138+0000","last_clean":"2024-09-12T18:08:32.504138+0000","last_became_active":"2024-09-12T17:29:56.954488+0000","last_became_peered":"2024-09-12T17:29:56.954488+0000","last_unstale":"2024-09-12T18:08:32.504138+0000","last_undegraded":"2024-09-12T18:08:32.504138+0000","last_fullsized":"2024-09-12T18:08:32.504138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:08:32.503973+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:08:32.503973+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.503973+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:44.475732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":724,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'181","reported_seq":784,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.270942+0000","last_change":"2024-09-12T18:08:30.270883+0000","last_active":"2024-09-12T18:08:30.270942+0000","last_peered":"2024-09-12T18:08:30.270942+0000","last_clean":"2024-09-12T18:08:30.270942+0000","last_became_active":"2024-09-12T17:29:58.956916+0000","last_became_peered":"2024-09-12T17:29:58.956916+0000","last_unstale":"2024-09-12T18:08:30.270942+0000","last_undegraded":"2024-09-12T18:08:30.270942+0000","last_fullsized":"2024-09-12T18:08:30.270942+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'181","last_scrub_stamp":"2024-09-12T18:08:30.270791+0000","last_deep_scrub":"264'181","last_deep_scrub_stamp":"2024-09-12T18:08:30.270791+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.270791+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:27.185524+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4406,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":236,"num_read_kb":279,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.990492+0000","last_change":"2024-09-12T18:08:40.990391+0000","last_active":"2024-09-12T18:08:40.990492+0000","last_peered":"2024-09-12T18:08:40.990492+0000","last_clean":"2024-09-12T18:08:40.990492+0000","last_became_active":"2024-09-12T17:30:00.960409+0000","last_became_peered":"2024-09-12T17:30:00.960409+0000","last_unstale":"2024-09-12T18:08:40.990492+0000","last_undegraded":"2024-09-12T18:08:40.990492+0000","last_fullsized":"2024-09-12T18:08:40.990492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:40.990277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:40.990277+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.990277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:06.362958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2447","reported_seq":4380,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.459056+0000","last_change":"2024-09-12T18:08:46.458993+0000","last_active":"2024-09-12T18:08:46.459056+0000","last_peered":"2024-09-12T18:08:46.459056+0000","last_clean":"2024-09-12T18:08:46.459056+0000","last_became_active":"2024-09-12T17:30:02.967718+0000","last_became_peered":"2024-09-12T17:30:02.967718+0000","last_unstale":"2024-09-12T18:08:46.459056+0000","last_undegraded":"2024-09-12T18:08:46.459056+0000","last_fullsized":"2024-09-12T18:08:46.459056+0000","mapping_epoch":34,"log_start":"264'2400","ondisk_log_start":"264'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2447","last_scrub_stamp":"2024-09-12T18:08:46.458874+0000","last_deep_scrub":"264'2447","last_deep_scrub_stamp":"2024-09-12T18:08:46.458874+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.458874+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":2400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:42.505556+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1044,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6319,"num_read_kb":6274,"num_write":4873,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'137","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.422157+0000","last_change":"2024-09-12T18:08:25.422081+0000","last_active":"2024-09-12T18:08:25.422157+0000","last_peered":"2024-09-12T18:08:25.422157+0000","last_clean":"2024-09-12T18:08:25.422157+0000","last_became_active":"2024-09-12T17:29:54.957747+0000","last_became_peered":"2024-09-12T17:29:54.957747+0000","last_unstale":"2024-09-12T18:08:25.422157+0000","last_undegraded":"2024-09-12T18:08:25.422157+0000","last_fullsized":"2024-09-12T18:08:25.422157+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T18:08:25.421998+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T18:08:25.421998+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.421998+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:49.865865+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":552,"num_write":215,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2873,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'213","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.155495+0000","last_change":"2024-09-12T18:08:09.155495+0000","last_active":"2024-09-12T18:08:09.155495+0000","last_peered":"2024-09-12T18:08:09.155495+0000","last_clean":"2024-09-12T18:08:09.155495+0000","last_became_active":"2024-09-12T17:29:52.950612+0000","last_became_peered":"2024-09-12T17:29:52.950612+0000","last_unstale":"2024-09-12T18:08:09.155495+0000","last_undegraded":"2024-09-12T18:08:09.155495+0000","last_fullsized":"2024-09-12T18:08:09.155495+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-09-12T18:08:09.155405+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-09-12T18:08:09.155405+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.155405+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:06.394522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":421,"num_read_kb":10994,"num_write":1027,"num_write_kb":32732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.988172+0000","last_change":"2024-09-12T18:08:27.988172+0000","last_active":"2024-09-12T18:08:27.988172+0000","last_peered":"2024-09-12T18:08:27.988172+0000","last_clean":"2024-09-12T18:08:27.988172+0000","last_became_active":"2024-09-12T17:29:56.953546+0000","last_became_peered":"2024-09-12T17:29:56.953546+0000","last_unstale":"2024-09-12T18:08:27.988172+0000","last_undegraded":"2024-09-12T18:08:27.988172+0000","last_fullsized":"2024-09-12T18:08:27.988172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.988088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.988088+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.988088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:29.059380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'89","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.836068+0000","last_change":"2024-09-12T18:08:33.835983+0000","last_active":"2024-09-12T18:08:33.836068+0000","last_peered":"2024-09-12T18:08:33.836068+0000","last_clean":"2024-09-12T18:08:33.836068+0000","last_became_active":"2024-09-12T17:29:58.951077+0000","last_became_peered":"2024-09-12T17:29:58.951077+0000","last_unstale":"2024-09-12T18:08:33.836068+0000","last_undegraded":"2024-09-12T18:08:33.836068+0000","last_fullsized":"2024-09-12T18:08:33.836068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-09-12T18:08:33.835852+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-09-12T18:08:33.835852+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.835852+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:16.577451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.813183+0000","last_change":"2024-09-12T18:08:35.813108+0000","last_active":"2024-09-12T18:08:35.813183+0000","last_peered":"2024-09-12T18:08:35.813183+0000","last_clean":"2024-09-12T18:08:35.813183+0000","last_became_active":"2024-09-12T17:30:00.969291+0000","last_became_peered":"2024-09-12T17:30:00.969291+0000","last_unstale":"2024-09-12T18:08:35.813183+0000","last_undegraded":"2024-09-12T18:08:35.813183+0000","last_fullsized":"2024-09-12T18:08:35.813183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:35.813023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:35.813023+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.813023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:58.218750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'127","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.385530+0000","last_change":"2024-09-12T18:08:44.385530+0000","last_active":"2024-09-12T18:08:44.385530+0000","last_peered":"2024-09-12T18:08:44.385530+0000","last_clean":"2024-09-12T18:08:44.385530+0000","last_became_active":"2024-09-12T17:30:02.971843+0000","last_became_peered":"2024-09-12T17:30:02.971843+0000","last_unstale":"2024-09-12T18:08:44.385530+0000","last_undegraded":"2024-09-12T18:08:44.385530+0000","last_fullsized":"2024-09-12T18:08:44.385530+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-12T18:08:44.385450+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-12T18:08:44.385450+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.385450+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:19.255428+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'129","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.116982+0000","last_change":"2024-09-12T18:08:19.116925+0000","last_active":"2024-09-12T18:08:19.116982+0000","last_peered":"2024-09-12T18:08:19.116982+0000","last_clean":"2024-09-12T18:08:19.116982+0000","last_became_active":"2024-09-12T17:29:54.944698+0000","last_became_peered":"2024-09-12T17:29:54.944698+0000","last_unstale":"2024-09-12T18:08:19.116982+0000","last_undegraded":"2024-09-12T18:08:19.116982+0000","last_fullsized":"2024-09-12T18:08:19.116982+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T18:08:19.116839+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T18:08:19.116839+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.116839+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:21.922508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":422,"num_write":199,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'178","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.665158+0000","last_change":"2024-09-12T18:08:18.665158+0000","last_active":"2024-09-12T18:08:18.665158+0000","last_peered":"2024-09-12T18:08:18.665158+0000","last_clean":"2024-09-12T18:08:18.665158+0000","last_became_active":"2024-09-12T17:29:52.963087+0000","last_became_peered":"2024-09-12T17:29:52.963087+0000","last_unstale":"2024-09-12T18:08:18.665158+0000","last_undegraded":"2024-09-12T18:08:18.665158+0000","last_fullsized":"2024-09-12T18:08:18.665158+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-12T18:08:18.665031+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-12T18:08:18.665031+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.665031+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:53.506644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128531,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":3190,"num_write":917,"num_write_kb":30863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.998246+0000","last_change":"2024-09-12T18:08:29.998182+0000","last_active":"2024-09-12T18:08:29.998246+0000","last_peered":"2024-09-12T18:08:29.998246+0000","last_clean":"2024-09-12T18:08:29.998246+0000","last_became_active":"2024-09-12T17:29:56.952827+0000","last_became_peered":"2024-09-12T17:29:56.952827+0000","last_unstale":"2024-09-12T18:08:29.998246+0000","last_undegraded":"2024-09-12T18:08:29.998246+0000","last_fullsized":"2024-09-12T18:08:29.998246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:29.998095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:29.998095+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.998095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:17.333075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'103","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.426608+0000","last_change":"2024-09-12T18:08:26.426608+0000","last_active":"2024-09-12T18:08:26.426608+0000","last_peered":"2024-09-12T18:08:26.426608+0000","last_clean":"2024-09-12T18:08:26.426608+0000","last_became_active":"2024-09-12T17:29:58.952169+0000","last_became_peered":"2024-09-12T17:29:58.952169+0000","last_unstale":"2024-09-12T18:08:26.426608+0000","last_undegraded":"2024-09-12T18:08:26.426608+0000","last_fullsized":"2024-09-12T18:08:26.426608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'103","last_scrub_stamp":"2024-09-12T18:08:26.426525+0000","last_deep_scrub":"264'103","last_deep_scrub_stamp":"2024-09-12T18:08:26.426525+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.426525+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:57.793772+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":103,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'755","reported_seq":2414,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.994037+0000","last_change":"2024-09-12T18:08:41.993968+0000","last_active":"2024-09-12T18:08:41.994037+0000","last_peered":"2024-09-12T18:08:41.994037+0000","last_clean":"2024-09-12T18:08:41.994037+0000","last_became_active":"2024-09-12T17:30:00.954180+0000","last_became_peered":"2024-09-12T17:30:00.954180+0000","last_unstale":"2024-09-12T18:08:41.994037+0000","last_undegraded":"2024-09-12T18:08:41.994037+0000","last_fullsized":"2024-09-12T18:08:41.994037+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'755","last_scrub_stamp":"2024-09-12T18:08:41.993869+0000","last_deep_scrub":"264'755","last_deep_scrub_stamp":"2024-09-12T18:08:41.993869+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.993869+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:21.785678+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'182","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.753087+0000","last_change":"2024-09-12T18:08:40.753087+0000","last_active":"2024-09-12T18:08:40.753087+0000","last_peered":"2024-09-12T18:08:40.753087+0000","last_clean":"2024-09-12T18:08:40.753087+0000","last_became_active":"2024-09-12T17:30:02.961198+0000","last_became_peered":"2024-09-12T17:30:02.961198+0000","last_unstale":"2024-09-12T18:08:40.753087+0000","last_undegraded":"2024-09-12T18:08:40.753087+0000","last_fullsized":"2024-09-12T18:08:40.753087+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-12T18:08:40.752993+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-12T18:08:40.752993+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.752993+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:04.570541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":624,"num_write":393,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'95","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.075608+0000","last_change":"2024-09-12T18:08:21.075530+0000","last_active":"2024-09-12T18:08:21.075608+0000","last_peered":"2024-09-12T18:08:21.075608+0000","last_clean":"2024-09-12T18:08:21.075608+0000","last_became_active":"2024-09-12T17:29:54.956663+0000","last_became_peered":"2024-09-12T17:29:54.956663+0000","last_unstale":"2024-09-12T18:08:21.075608+0000","last_undegraded":"2024-09-12T18:08:21.075608+0000","last_fullsized":"2024-09-12T18:08:21.075608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'95","last_scrub_stamp":"2024-09-12T18:08:21.075428+0000","last_deep_scrub":"264'95","last_deep_scrub_stamp":"2024-09-12T18:08:21.075428+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.075428+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:39.799375+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":356,"num_write":140,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'167","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.026722+0000","last_change":"2024-09-12T18:08:12.026722+0000","last_active":"2024-09-12T18:08:12.026722+0000","last_peered":"2024-09-12T18:08:12.026722+0000","last_clean":"2024-09-12T18:08:12.026722+0000","last_became_active":"2024-09-12T17:29:52.962665+0000","last_became_peered":"2024-09-12T17:29:52.962665+0000","last_unstale":"2024-09-12T18:08:12.026722+0000","last_undegraded":"2024-09-12T18:08:12.026722+0000","last_fullsized":"2024-09-12T18:08:12.026722+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-09-12T18:08:12.026621+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-09-12T18:08:12.026621+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.026621+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:49.096759+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":354,"num_read_kb":5731,"num_write":816,"num_write_kb":29128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.503672+0000","last_change":"2024-09-12T18:08:33.503610+0000","last_active":"2024-09-12T18:08:33.503672+0000","last_peered":"2024-09-12T18:08:33.503672+0000","last_clean":"2024-09-12T18:08:33.503672+0000","last_became_active":"2024-09-12T17:29:56.952625+0000","last_became_peered":"2024-09-12T17:29:56.952625+0000","last_unstale":"2024-09-12T18:08:33.503672+0000","last_undegraded":"2024-09-12T18:08:33.503672+0000","last_fullsized":"2024-09-12T18:08:33.503672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:33.503515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:33.503515+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.503515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:18.890954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'109","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.934134+0000","last_change":"2024-09-12T18:08:36.934077+0000","last_active":"2024-09-12T18:08:36.934134+0000","last_peered":"2024-09-12T18:08:36.934134+0000","last_clean":"2024-09-12T18:08:36.934134+0000","last_became_active":"2024-09-12T17:29:58.978299+0000","last_became_peered":"2024-09-12T17:29:58.978299+0000","last_unstale":"2024-09-12T18:08:36.934134+0000","last_undegraded":"2024-09-12T18:08:36.934134+0000","last_fullsized":"2024-09-12T18:08:36.934134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-12T18:08:36.933983+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-12T18:08:36.933983+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.933983+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:11.454887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'777","reported_seq":3928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.862355+0000","last_change":"2024-09-12T18:08:40.862355+0000","last_active":"2024-09-12T18:08:40.862355+0000","last_peered":"2024-09-12T18:08:40.862355+0000","last_clean":"2024-09-12T18:08:40.862355+0000","last_became_active":"2024-09-12T17:30:00.962754+0000","last_became_peered":"2024-09-12T17:30:00.962754+0000","last_unstale":"2024-09-12T18:08:40.862355+0000","last_undegraded":"2024-09-12T18:08:40.862355+0000","last_fullsized":"2024-09-12T18:08:40.862355+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'777","last_scrub_stamp":"2024-09-12T18:08:40.862268+0000","last_deep_scrub":"264'777","last_deep_scrub_stamp":"2024-09-12T18:08:40.862268+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.862268+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:57.506437+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'251","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.399138+0000","last_change":"2024-09-12T18:08:23.399080+0000","last_active":"2024-09-12T18:08:23.399138+0000","last_peered":"2024-09-12T18:08:23.399138+0000","last_clean":"2024-09-12T18:08:23.399138+0000","last_became_active":"2024-09-12T17:29:54.957148+0000","last_became_peered":"2024-09-12T17:29:54.957148+0000","last_unstale":"2024-09-12T18:08:23.399138+0000","last_undegraded":"2024-09-12T18:08:23.399138+0000","last_fullsized":"2024-09-12T18:08:23.399138+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T18:08:23.398990+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T18:08:23.398990+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.398990+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:10.788896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":968,"num_write":398,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'237","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.672401+0000","last_change":"2024-09-12T18:08:15.672401+0000","last_active":"2024-09-12T18:08:15.672401+0000","last_peered":"2024-09-12T18:08:15.672401+0000","last_clean":"2024-09-12T18:08:15.672401+0000","last_became_active":"2024-09-12T17:29:52.964421+0000","last_became_peered":"2024-09-12T17:29:52.964421+0000","last_unstale":"2024-09-12T18:08:15.672401+0000","last_undegraded":"2024-09-12T18:08:15.672401+0000","last_fullsized":"2024-09-12T18:08:15.672401+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'237","last_scrub_stamp":"2024-09-12T18:08:15.672302+0000","last_deep_scrub":"264'237","last_deep_scrub_stamp":"2024-09-12T18:08:15.672302+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.672302+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:57.673677+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":5176,"num_write":1044,"num_write_kb":56179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.807250+0000","last_change":"2024-09-12T18:08:29.807188+0000","last_active":"2024-09-12T18:08:29.807250+0000","last_peered":"2024-09-12T18:08:29.807250+0000","last_clean":"2024-09-12T18:08:29.807250+0000","last_became_active":"2024-09-12T17:29:56.953204+0000","last_became_peered":"2024-09-12T17:29:56.953204+0000","last_unstale":"2024-09-12T18:08:29.807250+0000","last_undegraded":"2024-09-12T18:08:29.807250+0000","last_fullsized":"2024-09-12T18:08:29.807250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:29.807103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:29.807103+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.807103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:46.116812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'190","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.513439+0000","last_change":"2024-09-12T18:08:36.513371+0000","last_active":"2024-09-12T18:08:36.513439+0000","last_peered":"2024-09-12T18:08:36.513439+0000","last_clean":"2024-09-12T18:08:36.513439+0000","last_became_active":"2024-09-12T17:29:58.978213+0000","last_became_peered":"2024-09-12T17:29:58.978213+0000","last_unstale":"2024-09-12T18:08:36.513439+0000","last_undegraded":"2024-09-12T18:08:36.513439+0000","last_fullsized":"2024-09-12T18:08:36.513439+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:08:36.513264+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:08:36.513264+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.513264+0000","objects_scrubbed":9,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:02.853977+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9297,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":251,"num_read_kb":306,"num_write":140,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.312537+0000","last_change":"2024-09-12T18:08:31.312537+0000","last_active":"2024-09-12T18:08:31.312537+0000","last_peered":"2024-09-12T18:08:31.312537+0000","last_clean":"2024-09-12T18:08:31.312537+0000","last_became_active":"2024-09-12T17:30:00.958723+0000","last_became_peered":"2024-09-12T17:30:00.958723+0000","last_unstale":"2024-09-12T18:08:31.312537+0000","last_undegraded":"2024-09-12T18:08:31.312537+0000","last_fullsized":"2024-09-12T18:08:31.312537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:31.312475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:31.312475+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.312475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:56.120649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'552","reported_seq":1364,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.411227+0000","last_change":"2024-09-12T18:08:41.411227+0000","last_active":"2024-09-12T18:08:41.411227+0000","last_peered":"2024-09-12T18:08:41.411227+0000","last_clean":"2024-09-12T18:08:41.411227+0000","last_became_active":"2024-09-12T17:30:02.968515+0000","last_became_peered":"2024-09-12T17:30:02.968515+0000","last_unstale":"2024-09-12T18:08:41.411227+0000","last_undegraded":"2024-09-12T18:08:41.411227+0000","last_fullsized":"2024-09-12T18:08:41.411227+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'552","last_scrub_stamp":"2024-09-12T18:08:41.411132+0000","last_deep_scrub":"264'552","last_deep_scrub_stamp":"2024-09-12T18:08:41.411132+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.411132+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:32.937558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1325,"num_read_kb":1316,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'153","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.736689+0000","last_change":"2024-09-12T18:08:11.736621+0000","last_active":"2024-09-12T18:08:11.736689+0000","last_peered":"2024-09-12T18:08:11.736689+0000","last_clean":"2024-09-12T18:08:11.736689+0000","last_became_active":"2024-09-12T17:29:54.959140+0000","last_became_peered":"2024-09-12T17:29:54.959140+0000","last_unstale":"2024-09-12T18:08:11.736689+0000","last_undegraded":"2024-09-12T18:08:11.736689+0000","last_fullsized":"2024-09-12T18:08:11.736689+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-12T18:08:11.736532+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-12T18:08:11.736532+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.736532+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:28.497052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":582,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'177","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.657316+0000","last_change":"2024-09-12T18:08:14.657316+0000","last_active":"2024-09-12T18:08:14.657316+0000","last_peered":"2024-09-12T18:08:14.657316+0000","last_clean":"2024-09-12T18:08:14.657316+0000","last_became_active":"2024-09-12T17:29:52.964339+0000","last_became_peered":"2024-09-12T17:29:52.964339+0000","last_unstale":"2024-09-12T18:08:14.657316+0000","last_undegraded":"2024-09-12T18:08:14.657316+0000","last_fullsized":"2024-09-12T18:08:14.657316+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:08:14.657212+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:08:14.657212+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.657212+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:58.043317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395849,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":381,"num_read_kb":1621,"num_write":866,"num_write_kb":10562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.466900+0000","last_change":"2024-09-12T18:08:20.466833+0000","last_active":"2024-09-12T18:08:20.466900+0000","last_peered":"2024-09-12T18:08:20.466900+0000","last_clean":"2024-09-12T18:08:20.466900+0000","last_became_active":"2024-09-12T17:29:56.953551+0000","last_became_peered":"2024-09-12T17:29:56.953551+0000","last_unstale":"2024-09-12T18:08:20.466900+0000","last_undegraded":"2024-09-12T18:08:20.466900+0000","last_fullsized":"2024-09-12T18:08:20.466900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:20.466738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:20.466738+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.466738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:40.063398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'128","reported_seq":696,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.970220+0000","last_change":"2024-09-12T18:08:31.970220+0000","last_active":"2024-09-12T18:08:31.970220+0000","last_peered":"2024-09-12T18:08:31.970220+0000","last_clean":"2024-09-12T18:08:31.970220+0000","last_became_active":"2024-09-12T17:29:58.953107+0000","last_became_peered":"2024-09-12T17:29:58.953107+0000","last_unstale":"2024-09-12T18:08:31.970220+0000","last_undegraded":"2024-09-12T18:08:31.970220+0000","last_fullsized":"2024-09-12T18:08:31.970220+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-12T18:08:31.970110+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-12T18:08:31.970110+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.970110+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:14.593698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9938,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":239,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.872213+0000","last_change":"2024-09-12T18:08:41.872213+0000","last_active":"2024-09-12T18:08:41.872213+0000","last_peered":"2024-09-12T18:08:41.872213+0000","last_clean":"2024-09-12T18:08:41.872213+0000","last_became_active":"2024-09-12T17:30:00.961545+0000","last_became_peered":"2024-09-12T17:30:00.961545+0000","last_unstale":"2024-09-12T18:08:41.872213+0000","last_undegraded":"2024-09-12T18:08:41.872213+0000","last_fullsized":"2024-09-12T18:08:41.872213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:41.872079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:41.872079+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.872079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:14.981525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'87","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.966855+0000","last_change":"2024-09-12T18:08:31.966855+0000","last_active":"2024-09-12T18:08:31.966855+0000","last_peered":"2024-09-12T18:08:31.966855+0000","last_clean":"2024-09-12T18:08:31.966855+0000","last_became_active":"2024-09-12T17:30:02.967500+0000","last_became_peered":"2024-09-12T17:30:02.967500+0000","last_unstale":"2024-09-12T18:08:31.966855+0000","last_undegraded":"2024-09-12T18:08:31.966855+0000","last_fullsized":"2024-09-12T18:08:31.966855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'87","last_scrub_stamp":"2024-09-12T18:08:31.966730+0000","last_deep_scrub":"264'87","last_deep_scrub_stamp":"2024-09-12T18:08:31.966730+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.966730+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:38.709044+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":199,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'67","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.126192+0000","last_change":"2024-09-12T18:08:19.126105+0000","last_active":"2024-09-12T18:08:19.126192+0000","last_peered":"2024-09-12T18:08:19.126192+0000","last_clean":"2024-09-12T18:08:19.126192+0000","last_became_active":"2024-09-12T17:29:54.959979+0000","last_became_peered":"2024-09-12T17:29:54.959979+0000","last_unstale":"2024-09-12T18:08:19.126192+0000","last_undegraded":"2024-09-12T18:08:19.126192+0000","last_fullsized":"2024-09-12T18:08:19.126192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-09-12T18:08:19.125996+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-09-12T18:08:19.125996+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.125996+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:57.331669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":252,"num_write":105,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'337","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.692746+0000","last_change":"2024-09-12T18:08:13.692746+0000","last_active":"2024-09-12T18:08:13.692746+0000","last_peered":"2024-09-12T18:08:13.692746+0000","last_clean":"2024-09-12T18:08:13.692746+0000","last_became_active":"2024-09-12T17:29:52.957308+0000","last_became_peered":"2024-09-12T17:29:52.957308+0000","last_unstale":"2024-09-12T18:08:13.692746+0000","last_undegraded":"2024-09-12T18:08:13.692746+0000","last_fullsized":"2024-09-12T18:08:13.692746+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-09-12T18:08:13.692640+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-09-12T18:08:13.692640+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.692640+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:12.037962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":832,"num_read_kb":24052,"num_write":1268,"num_write_kb":42343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"264'5","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.414556+0000","last_change":"2024-09-12T18:08:24.414556+0000","last_active":"2024-09-12T18:08:24.414556+0000","last_peered":"2024-09-12T18:08:24.414556+0000","last_clean":"2024-09-12T18:08:24.414556+0000","last_became_active":"2024-09-12T17:29:56.959206+0000","last_became_peered":"2024-09-12T17:29:56.959206+0000","last_unstale":"2024-09-12T18:08:24.414556+0000","last_undegraded":"2024-09-12T18:08:24.414556+0000","last_fullsized":"2024-09-12T18:08:24.414556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:24.414472+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:24.414472+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.414472+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:13.993154+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":1192,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'166","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.920463+0000","last_change":"2024-09-12T18:08:33.920406+0000","last_active":"2024-09-12T18:08:33.920463+0000","last_peered":"2024-09-12T18:08:33.920463+0000","last_clean":"2024-09-12T18:08:33.920463+0000","last_became_active":"2024-09-12T17:29:58.955698+0000","last_became_peered":"2024-09-12T17:29:58.955698+0000","last_unstale":"2024-09-12T18:08:33.920463+0000","last_undegraded":"2024-09-12T18:08:33.920463+0000","last_fullsized":"2024-09-12T18:08:33.920463+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T18:08:33.920303+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T18:08:33.920303+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.920303+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:30.408436+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7452,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":263,"num_write":112,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'763","reported_seq":2335,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.272553+0000","last_change":"2024-09-12T18:08:33.272495+0000","last_active":"2024-09-12T18:08:33.272553+0000","last_peered":"2024-09-12T18:08:33.272553+0000","last_clean":"2024-09-12T18:08:33.272553+0000","last_became_active":"2024-09-12T17:30:00.966661+0000","last_became_peered":"2024-09-12T17:30:00.966661+0000","last_unstale":"2024-09-12T18:08:33.272553+0000","last_undegraded":"2024-09-12T18:08:33.272553+0000","last_fullsized":"2024-09-12T18:08:33.272553+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'763","last_scrub_stamp":"2024-09-12T18:08:33.272408+0000","last_deep_scrub":"264'763","last_deep_scrub_stamp":"2024-09-12T18:08:33.272408+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.272408+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:07.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'109","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.300257+0000","last_change":"2024-09-12T18:08:40.300197+0000","last_active":"2024-09-12T18:08:40.300257+0000","last_peered":"2024-09-12T18:08:40.300257+0000","last_clean":"2024-09-12T18:08:40.300257+0000","last_became_active":"2024-09-12T17:30:02.969837+0000","last_became_peered":"2024-09-12T17:30:02.969837+0000","last_unstale":"2024-09-12T18:08:40.300257+0000","last_undegraded":"2024-09-12T18:08:40.300257+0000","last_fullsized":"2024-09-12T18:08:40.300257+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-12T18:08:40.300105+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-12T18:08:40.300105+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.300105+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:02.977090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":259,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'232","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.182943+0000","last_change":"2024-09-12T18:08:17.182943+0000","last_active":"2024-09-12T18:08:17.182943+0000","last_peered":"2024-09-12T18:08:17.182943+0000","last_clean":"2024-09-12T18:08:17.182943+0000","last_became_active":"2024-09-12T17:30:28.004234+0000","last_became_peered":"2024-09-12T17:30:28.004234+0000","last_unstale":"2024-09-12T18:08:17.182943+0000","last_undegraded":"2024-09-12T18:08:17.182943+0000","last_fullsized":"2024-09-12T18:08:17.182943+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-09-12T18:08:17.182861+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-09-12T18:08:17.182861+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.182861+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:07.554492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":779,"num_write":354,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'204","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.486827+0000","last_change":"2024-09-12T18:08:15.486827+0000","last_active":"2024-09-12T18:08:15.486827+0000","last_peered":"2024-09-12T18:08:15.486827+0000","last_clean":"2024-09-12T18:08:15.486827+0000","last_became_active":"2024-09-12T17:29:52.951442+0000","last_became_peered":"2024-09-12T17:29:52.951442+0000","last_unstale":"2024-09-12T18:08:15.486827+0000","last_undegraded":"2024-09-12T18:08:15.486827+0000","last_fullsized":"2024-09-12T18:08:15.486827+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'204","last_scrub_stamp":"2024-09-12T18:08:15.486681+0000","last_deep_scrub":"264'204","last_deep_scrub_stamp":"2024-09-12T18:08:15.486681+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.486681+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:50.751228+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6462010,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":476,"num_read_kb":16166,"num_write":931,"num_write_kb":36148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.427339+0000","last_change":"2024-09-12T18:08:22.427263+0000","last_active":"2024-09-12T18:08:22.427339+0000","last_peered":"2024-09-12T18:08:22.427339+0000","last_clean":"2024-09-12T18:08:22.427339+0000","last_became_active":"2024-09-12T17:29:56.955948+0000","last_became_peered":"2024-09-12T17:29:56.955948+0000","last_unstale":"2024-09-12T18:08:22.427339+0000","last_undegraded":"2024-09-12T18:08:22.427339+0000","last_fullsized":"2024-09-12T18:08:22.427339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:22.427174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:22.427174+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.427174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:36.201160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'206","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.233832+0000","last_change":"2024-09-12T18:08:29.233740+0000","last_active":"2024-09-12T18:08:29.233832+0000","last_peered":"2024-09-12T18:08:29.233832+0000","last_clean":"2024-09-12T18:08:29.233832+0000","last_became_active":"2024-09-12T17:29:58.957183+0000","last_became_peered":"2024-09-12T17:29:58.957183+0000","last_unstale":"2024-09-12T18:08:29.233832+0000","last_undegraded":"2024-09-12T18:08:29.233832+0000","last_fullsized":"2024-09-12T18:08:29.233832+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T18:08:29.233610+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T18:08:29.233610+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.233610+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:55.220846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13747,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":267,"num_read_kb":394,"num_write":132,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.401242+0000","last_change":"2024-09-12T18:08:27.401175+0000","last_active":"2024-09-12T18:08:27.401242+0000","last_peered":"2024-09-12T18:08:27.401242+0000","last_clean":"2024-09-12T18:08:27.401242+0000","last_became_active":"2024-09-12T17:30:00.958049+0000","last_became_peered":"2024-09-12T17:30:00.958049+0000","last_unstale":"2024-09-12T18:08:27.401242+0000","last_undegraded":"2024-09-12T18:08:27.401242+0000","last_fullsized":"2024-09-12T18:08:27.401242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.401089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.401089+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.401089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:58.968537+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'147","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.243003+0000","last_change":"2024-09-12T18:08:35.242927+0000","last_active":"2024-09-12T18:08:35.243003+0000","last_peered":"2024-09-12T18:08:35.243003+0000","last_clean":"2024-09-12T18:08:35.243003+0000","last_became_active":"2024-09-12T17:30:02.970095+0000","last_became_peered":"2024-09-12T17:30:02.970095+0000","last_unstale":"2024-09-12T18:08:35.243003+0000","last_undegraded":"2024-09-12T18:08:35.243003+0000","last_fullsized":"2024-09-12T18:08:35.243003+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T18:08:35.242847+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T18:08:35.242847+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.242847+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:12.452660+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":173,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'179","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.670165+0000","last_change":"2024-09-12T18:08:14.670165+0000","last_active":"2024-09-12T18:08:14.670165+0000","last_peered":"2024-09-12T18:08:14.670165+0000","last_clean":"2024-09-12T18:08:14.670165+0000","last_became_active":"2024-09-12T17:29:54.956850+0000","last_became_peered":"2024-09-12T17:29:54.956850+0000","last_unstale":"2024-09-12T18:08:14.670165+0000","last_undegraded":"2024-09-12T18:08:14.670165+0000","last_fullsized":"2024-09-12T18:08:14.670165+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:08:14.670074+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:08:14.670074+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.670074+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:21.265957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":712,"num_read_kb":607,"num_write":242,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'175","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.059924+0000","last_change":"2024-09-12T18:08:12.059924+0000","last_active":"2024-09-12T18:08:12.059924+0000","last_peered":"2024-09-12T18:08:12.059924+0000","last_clean":"2024-09-12T18:08:12.059924+0000","last_became_active":"2024-09-12T17:29:52.958919+0000","last_became_peered":"2024-09-12T17:29:52.958919+0000","last_unstale":"2024-09-12T18:08:12.059924+0000","last_undegraded":"2024-09-12T18:08:12.059924+0000","last_fullsized":"2024-09-12T18:08:12.059924+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'175","last_scrub_stamp":"2024-09-12T18:08:12.059737+0000","last_deep_scrub":"264'175","last_deep_scrub_stamp":"2024-09-12T18:08:12.059737+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.059737+0000","objects_scrubbed":11,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:59.307212+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7687392,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":325,"num_read_kb":13812,"num_write":937,"num_write_kb":31717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.435944+0000","last_change":"2024-09-12T18:08:25.435944+0000","last_active":"2024-09-12T18:08:25.435944+0000","last_peered":"2024-09-12T18:08:25.435944+0000","last_clean":"2024-09-12T18:08:25.435944+0000","last_became_active":"2024-09-12T17:29:56.955288+0000","last_became_peered":"2024-09-12T17:29:56.955288+0000","last_unstale":"2024-09-12T18:08:25.435944+0000","last_undegraded":"2024-09-12T18:08:25.435944+0000","last_fullsized":"2024-09-12T18:08:25.435944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.435793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.435793+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.435793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:42.632232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'147","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.851189+0000","last_change":"2024-09-12T18:08:34.851189+0000","last_active":"2024-09-12T18:08:34.851189+0000","last_peered":"2024-09-12T18:08:34.851189+0000","last_clean":"2024-09-12T18:08:34.851189+0000","last_became_active":"2024-09-12T17:29:58.952878+0000","last_became_peered":"2024-09-12T17:29:58.952878+0000","last_unstale":"2024-09-12T18:08:34.851189+0000","last_undegraded":"2024-09-12T18:08:34.851189+0000","last_fullsized":"2024-09-12T18:08:34.851189+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T18:08:34.851076+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T18:08:34.851076+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.851076+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:51.169705+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":250,"num_write":156,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.272509+0000","last_change":"2024-09-12T18:08:36.272509+0000","last_active":"2024-09-12T18:08:36.272509+0000","last_peered":"2024-09-12T18:08:36.272509+0000","last_clean":"2024-09-12T18:08:36.272509+0000","last_became_active":"2024-09-12T17:30:00.970668+0000","last_became_peered":"2024-09-12T17:30:00.970668+0000","last_unstale":"2024-09-12T18:08:36.272509+0000","last_undegraded":"2024-09-12T18:08:36.272509+0000","last_fullsized":"2024-09-12T18:08:36.272509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:36.272414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:36.272414+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.272414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:46.637903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'142","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.925568+0000","last_change":"2024-09-12T18:08:42.925568+0000","last_active":"2024-09-12T18:08:42.925568+0000","last_peered":"2024-09-12T18:08:42.925568+0000","last_clean":"2024-09-12T18:08:42.925568+0000","last_became_active":"2024-09-12T17:30:02.964125+0000","last_became_peered":"2024-09-12T17:30:02.964125+0000","last_unstale":"2024-09-12T18:08:42.925568+0000","last_undegraded":"2024-09-12T18:08:42.925568+0000","last_fullsized":"2024-09-12T18:08:42.925568+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:08:42.925483+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:08:42.925483+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.925483+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:46.935130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":200,"num_read_kb":186,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'124","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.708252+0000","last_change":"2024-09-12T18:08:13.708252+0000","last_active":"2024-09-12T18:08:13.708252+0000","last_peered":"2024-09-12T18:08:13.708252+0000","last_clean":"2024-09-12T18:08:13.708252+0000","last_became_active":"2024-09-12T17:29:54.956019+0000","last_became_peered":"2024-09-12T17:29:54.956019+0000","last_unstale":"2024-09-12T18:08:13.708252+0000","last_undegraded":"2024-09-12T18:08:13.708252+0000","last_fullsized":"2024-09-12T18:08:13.708252+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-12T18:08:13.708174+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-12T18:08:13.708174+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.708174+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:20.307396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":560,"num_read_kb":466,"num_write":179,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'197","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.052806+0000","last_change":"2024-09-12T18:08:11.052727+0000","last_active":"2024-09-12T18:08:11.052806+0000","last_peered":"2024-09-12T18:08:11.052806+0000","last_clean":"2024-09-12T18:08:11.052806+0000","last_became_active":"2024-09-12T17:29:52.951013+0000","last_became_peered":"2024-09-12T17:29:52.951013+0000","last_unstale":"2024-09-12T18:08:11.052806+0000","last_undegraded":"2024-09-12T18:08:11.052806+0000","last_fullsized":"2024-09-12T18:08:11.052806+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'197","last_scrub_stamp":"2024-09-12T18:08:11.052631+0000","last_deep_scrub":"264'197","last_deep_scrub_stamp":"2024-09-12T18:08:11.052631+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.052631+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:32.972110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":90183,"num_write":908,"num_write_kb":29071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.316309+0000","last_change":"2024-09-12T18:08:25.316309+0000","last_active":"2024-09-12T18:08:25.316309+0000","last_peered":"2024-09-12T18:08:25.316309+0000","last_clean":"2024-09-12T18:08:25.316309+0000","last_became_active":"2024-09-12T17:29:56.959436+0000","last_became_peered":"2024-09-12T17:29:56.959436+0000","last_unstale":"2024-09-12T18:08:25.316309+0000","last_undegraded":"2024-09-12T18:08:25.316309+0000","last_fullsized":"2024-09-12T18:08:25.316309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.316225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.316225+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.316225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:40.776025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'149","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.346397+0000","last_change":"2024-09-12T18:08:35.346397+0000","last_active":"2024-09-12T18:08:35.346397+0000","last_peered":"2024-09-12T18:08:35.346397+0000","last_clean":"2024-09-12T18:08:35.346397+0000","last_became_active":"2024-09-12T17:29:58.954548+0000","last_became_peered":"2024-09-12T17:29:58.954548+0000","last_unstale":"2024-09-12T18:08:35.346397+0000","last_undegraded":"2024-09-12T18:08:35.346397+0000","last_fullsized":"2024-09-12T18:08:35.346397+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T18:08:35.346304+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T18:08:35.346304+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.346304+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:50.124242+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12489,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'733","reported_seq":2386,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.392882+0000","last_change":"2024-09-12T18:08:28.392882+0000","last_active":"2024-09-12T18:08:28.392882+0000","last_peered":"2024-09-12T18:08:28.392882+0000","last_clean":"2024-09-12T18:08:28.392882+0000","last_became_active":"2024-09-12T17:30:00.960402+0000","last_became_peered":"2024-09-12T17:30:00.960402+0000","last_unstale":"2024-09-12T18:08:28.392882+0000","last_undegraded":"2024-09-12T18:08:28.392882+0000","last_fullsized":"2024-09-12T18:08:28.392882+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'733","last_scrub_stamp":"2024-09-12T18:08:28.392750+0000","last_deep_scrub":"264'733","last_deep_scrub_stamp":"2024-09-12T18:08:28.392750+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.392750+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:15.282104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'98","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.233381+0000","last_change":"2024-09-12T18:08:34.233381+0000","last_active":"2024-09-12T18:08:34.233381+0000","last_peered":"2024-09-12T18:08:34.233381+0000","last_clean":"2024-09-12T18:08:34.233381+0000","last_became_active":"2024-09-12T17:30:02.969617+0000","last_became_peered":"2024-09-12T17:30:02.969617+0000","last_unstale":"2024-09-12T18:08:34.233381+0000","last_undegraded":"2024-09-12T18:08:34.233381+0000","last_fullsized":"2024-09-12T18:08:34.233381+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'98","last_scrub_stamp":"2024-09-12T18:08:34.233267+0000","last_deep_scrub":"264'98","last_deep_scrub_stamp":"2024-09-12T18:08:34.233267+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.233267+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:39.388855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":242,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'118","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.709781+0000","last_change":"2024-09-12T18:08:16.709781+0000","last_active":"2024-09-12T18:08:16.709781+0000","last_peered":"2024-09-12T18:08:16.709781+0000","last_clean":"2024-09-12T18:08:16.709781+0000","last_became_active":"2024-09-12T17:29:54.958362+0000","last_became_peered":"2024-09-12T17:29:54.958362+0000","last_unstale":"2024-09-12T18:08:16.709781+0000","last_undegraded":"2024-09-12T18:08:16.709781+0000","last_fullsized":"2024-09-12T18:08:16.709781+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-12T18:08:16.709692+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-12T18:08:16.709692+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.709692+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:36.417665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":415,"num_write":164,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'162","reported_seq":775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.276109+0000","last_change":"2024-09-12T18:08:11.276109+0000","last_active":"2024-09-12T18:08:11.276109+0000","last_peered":"2024-09-12T18:08:11.276109+0000","last_clean":"2024-09-12T18:08:11.276109+0000","last_became_active":"2024-09-12T17:30:28.005099+0000","last_became_peered":"2024-09-12T17:30:28.005099+0000","last_unstale":"2024-09-12T18:08:11.276109+0000","last_undegraded":"2024-09-12T18:08:11.276109+0000","last_fullsized":"2024-09-12T18:08:11.276109+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T18:08:11.276007+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T18:08:11.276007+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.276007+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:24.791440+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":6854,"num_write":853,"num_write_kb":33010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1455,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.457567+0000","last_change":"2024-09-12T18:08:31.457567+0000","last_active":"2024-09-12T18:08:31.457567+0000","last_peered":"2024-09-12T18:08:31.457567+0000","last_clean":"2024-09-12T18:08:31.457567+0000","last_became_active":"2024-09-12T17:29:56.955321+0000","last_became_peered":"2024-09-12T17:29:56.955321+0000","last_unstale":"2024-09-12T18:08:31.457567+0000","last_undegraded":"2024-09-12T18:08:31.457567+0000","last_fullsized":"2024-09-12T18:08:31.457567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:08:31.457480+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:08:31.457480+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.457480+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:58.605157+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":954,"num_read_kb":954,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'84","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.934809+0000","last_change":"2024-09-12T18:08:32.934809+0000","last_active":"2024-09-12T18:08:32.934809+0000","last_peered":"2024-09-12T18:08:32.934809+0000","last_clean":"2024-09-12T18:08:32.934809+0000","last_became_active":"2024-09-12T17:29:58.978480+0000","last_became_peered":"2024-09-12T17:29:58.978480+0000","last_unstale":"2024-09-12T18:08:32.934809+0000","last_undegraded":"2024-09-12T18:08:32.934809+0000","last_fullsized":"2024-09-12T18:08:32.934809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T18:08:32.934717+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T18:08:32.934717+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.934717+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:34.102936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'759","reported_seq":4536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.999531+0000","last_change":"2024-09-12T18:08:28.999531+0000","last_active":"2024-09-12T18:08:28.999531+0000","last_peered":"2024-09-12T18:08:28.999531+0000","last_clean":"2024-09-12T18:08:28.999531+0000","last_became_active":"2024-09-12T17:30:00.959015+0000","last_became_peered":"2024-09-12T17:30:00.959015+0000","last_unstale":"2024-09-12T18:08:28.999531+0000","last_undegraded":"2024-09-12T18:08:28.999531+0000","last_fullsized":"2024-09-12T18:08:28.999531+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'759","last_scrub_stamp":"2024-09-12T18:08:28.999434+0000","last_deep_scrub":"264'759","last_deep_scrub_stamp":"2024-09-12T18:08:28.999434+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.999434+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:52.947246+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'126","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.622787+0000","last_change":"2024-09-12T18:08:46.622787+0000","last_active":"2024-09-12T18:08:46.622787+0000","last_peered":"2024-09-12T18:08:46.622787+0000","last_clean":"2024-09-12T18:08:46.622787+0000","last_became_active":"2024-09-12T17:30:02.972020+0000","last_became_peered":"2024-09-12T17:30:02.972020+0000","last_unstale":"2024-09-12T18:08:46.622787+0000","last_undegraded":"2024-09-12T18:08:46.622787+0000","last_fullsized":"2024-09-12T18:08:46.622787+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-12T18:08:46.622693+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-12T18:08:46.622693+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.622693+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:18.900643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":156,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.252876+0000","last_change":"2024-09-12T18:08:21.252876+0000","last_active":"2024-09-12T18:08:21.252876+0000","last_peered":"2024-09-12T18:08:21.252876+0000","last_clean":"2024-09-12T18:08:21.252876+0000","last_became_active":"2024-09-12T17:29:54.950966+0000","last_became_peered":"2024-09-12T17:29:54.950966+0000","last_unstale":"2024-09-12T18:08:21.252876+0000","last_undegraded":"2024-09-12T18:08:21.252876+0000","last_fullsized":"2024-09-12T18:08:21.252876+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T18:08:21.252794+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T18:08:21.252794+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.252794+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:22.803219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":955,"num_read_kb":788,"num_write":339,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'177","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.082094+0000","last_change":"2024-09-12T18:08:09.082011+0000","last_active":"2024-09-12T18:08:09.082094+0000","last_peered":"2024-09-12T18:08:09.082094+0000","last_clean":"2024-09-12T18:08:09.082094+0000","last_became_active":"2024-09-12T17:29:52.948591+0000","last_became_peered":"2024-09-12T17:29:52.948591+0000","last_unstale":"2024-09-12T18:08:09.082094+0000","last_undegraded":"2024-09-12T18:08:09.082094+0000","last_fullsized":"2024-09-12T18:08:09.082094+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:08:09.081909+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:08:09.081909+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.081909+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:16.244554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1260936,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":2968,"num_write":842,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.857509+0000","last_change":"2024-09-12T18:08:28.857509+0000","last_active":"2024-09-12T18:08:28.857509+0000","last_peered":"2024-09-12T18:08:28.857509+0000","last_clean":"2024-09-12T18:08:28.857509+0000","last_became_active":"2024-09-12T17:29:56.953198+0000","last_became_peered":"2024-09-12T17:29:56.953198+0000","last_unstale":"2024-09-12T18:08:28.857509+0000","last_undegraded":"2024-09-12T18:08:28.857509+0000","last_fullsized":"2024-09-12T18:08:28.857509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:28.857430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:28.857430+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.857430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:00.350416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'199","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.502122+0000","last_change":"2024-09-12T18:08:38.502122+0000","last_active":"2024-09-12T18:08:38.502122+0000","last_peered":"2024-09-12T18:08:38.502122+0000","last_clean":"2024-09-12T18:08:38.502122+0000","last_became_active":"2024-09-12T17:29:58.956828+0000","last_became_peered":"2024-09-12T17:29:58.956828+0000","last_unstale":"2024-09-12T18:08:38.502122+0000","last_undegraded":"2024-09-12T18:08:38.502122+0000","last_fullsized":"2024-09-12T18:08:38.502122+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-12T18:08:38.502014+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-12T18:08:38.502014+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.502014+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:05.976827+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10697,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":841,"num_read_kb":909,"num_write":1328,"num_write_kb":1209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488582,"num_omap_keys":1128,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.026110+0000","last_change":"2024-09-12T18:08:27.026110+0000","last_active":"2024-09-12T18:08:27.026110+0000","last_peered":"2024-09-12T18:08:27.026110+0000","last_clean":"2024-09-12T18:08:27.026110+0000","last_became_active":"2024-09-12T17:30:00.963117+0000","last_became_peered":"2024-09-12T17:30:00.963117+0000","last_unstale":"2024-09-12T18:08:27.026110+0000","last_undegraded":"2024-09-12T18:08:27.026110+0000","last_fullsized":"2024-09-12T18:08:27.026110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.026012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.026012+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.026012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:43.754740+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'119","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.239747+0000","last_change":"2024-09-12T18:08:36.239747+0000","last_active":"2024-09-12T18:08:36.239747+0000","last_peered":"2024-09-12T18:08:36.239747+0000","last_clean":"2024-09-12T18:08:36.239747+0000","last_became_active":"2024-09-12T17:30:02.963368+0000","last_became_peered":"2024-09-12T17:30:02.963368+0000","last_unstale":"2024-09-12T18:08:36.239747+0000","last_undegraded":"2024-09-12T18:08:36.239747+0000","last_fullsized":"2024-09-12T18:08:36.239747+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T18:08:36.239656+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T18:08:36.239656+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.239656+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:33.522946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":267,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'271","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.085593+0000","last_change":"2024-09-12T18:08:18.085593+0000","last_active":"2024-09-12T18:08:18.085593+0000","last_peered":"2024-09-12T18:08:18.085593+0000","last_clean":"2024-09-12T18:08:18.085593+0000","last_became_active":"2024-09-12T17:29:54.960486+0000","last_became_peered":"2024-09-12T17:29:54.960486+0000","last_unstale":"2024-09-12T18:08:18.085593+0000","last_undegraded":"2024-09-12T18:08:18.085593+0000","last_fullsized":"2024-09-12T18:08:18.085593+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-12T18:08:18.085509+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-12T18:08:18.085509+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.085509+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:18.452979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1268,"num_write":469,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.670133+0000","last_change":"2024-09-12T18:08:10.670133+0000","last_active":"2024-09-12T18:08:10.670133+0000","last_peered":"2024-09-12T18:08:10.670133+0000","last_clean":"2024-09-12T18:08:10.670133+0000","last_became_active":"2024-09-12T17:29:36.163604+0000","last_became_peered":"2024-09-12T17:29:36.163604+0000","last_unstale":"2024-09-12T18:08:10.670133+0000","last_undegraded":"2024-09-12T18:08:10.670133+0000","last_fullsized":"2024-09-12T18:08:10.670133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T18:08:10.670050+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T18:08:10.670050+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.670050+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:28.217846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.564490+0000","last_change":"2024-09-12T18:08:09.564490+0000","last_active":"2024-09-12T18:08:09.564490+0000","last_peered":"2024-09-12T18:08:09.564490+0000","last_clean":"2024-09-12T18:08:09.564490+0000","last_became_active":"2024-09-12T17:29:41.963643+0000","last_became_peered":"2024-09-12T17:29:41.963643+0000","last_unstale":"2024-09-12T18:08:09.564490+0000","last_undegraded":"2024-09-12T18:08:09.564490+0000","last_fullsized":"2024-09-12T18:08:09.564490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:09.564408+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:09.564408+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.564408+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:57.121488+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00056994999999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'207","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.049333+0000","last_change":"2024-09-12T18:08:10.049333+0000","last_active":"2024-09-12T18:08:10.049333+0000","last_peered":"2024-09-12T18:08:10.049333+0000","last_clean":"2024-09-12T18:08:10.049333+0000","last_became_active":"2024-09-12T17:29:52.954839+0000","last_became_peered":"2024-09-12T17:29:52.954839+0000","last_unstale":"2024-09-12T18:08:10.049333+0000","last_undegraded":"2024-09-12T18:08:10.049333+0000","last_fullsized":"2024-09-12T18:08:10.049333+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:10.049250+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:10.049250+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.049250+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:44.893531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395904,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":449,"num_read_kb":3374,"num_write":1041,"num_write_kb":36567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.756334+0000","last_change":"2024-09-12T18:08:27.756334+0000","last_active":"2024-09-12T18:08:27.756334+0000","last_peered":"2024-09-12T18:08:27.756334+0000","last_clean":"2024-09-12T18:08:27.756334+0000","last_became_active":"2024-09-12T17:29:56.955260+0000","last_became_peered":"2024-09-12T17:29:56.955260+0000","last_unstale":"2024-09-12T18:08:27.756334+0000","last_undegraded":"2024-09-12T18:08:27.756334+0000","last_fullsized":"2024-09-12T18:08:27.756334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.756236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.756236+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.756236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:23.735166+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'306","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.504200+0000","last_change":"2024-09-12T18:08:34.504138+0000","last_active":"2024-09-12T18:08:34.504200+0000","last_peered":"2024-09-12T18:08:34.504200+0000","last_clean":"2024-09-12T18:08:34.504200+0000","last_became_active":"2024-09-12T17:29:58.954205+0000","last_became_peered":"2024-09-12T17:29:58.954205+0000","last_unstale":"2024-09-12T18:08:34.504200+0000","last_undegraded":"2024-09-12T18:08:34.504200+0000","last_fullsized":"2024-09-12T18:08:34.504200+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-12T18:08:34.504033+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-12T18:08:34.504033+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.504033+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:58.633159+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17428,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":763,"num_write":498,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106664,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.260704+0000","last_change":"2024-09-12T18:08:34.260603+0000","last_active":"2024-09-12T18:08:34.260704+0000","last_peered":"2024-09-12T18:08:34.260704+0000","last_clean":"2024-09-12T18:08:34.260704+0000","last_became_active":"2024-09-12T17:30:00.964241+0000","last_became_peered":"2024-09-12T17:30:00.964241+0000","last_unstale":"2024-09-12T18:08:34.260704+0000","last_undegraded":"2024-09-12T18:08:34.260704+0000","last_fullsized":"2024-09-12T18:08:34.260704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:34.260510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:34.260510+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.260510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:24.121752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'223","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.023298+0000","last_change":"2024-09-12T18:08:38.023190+0000","last_active":"2024-09-12T18:08:38.023298+0000","last_peered":"2024-09-12T18:08:38.023298+0000","last_clean":"2024-09-12T18:08:38.023298+0000","last_became_active":"2024-09-12T17:30:02.963890+0000","last_became_peered":"2024-09-12T17:30:02.963890+0000","last_unstale":"2024-09-12T18:08:38.023298+0000","last_undegraded":"2024-09-12T18:08:38.023298+0000","last_fullsized":"2024-09-12T18:08:38.023298+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:08:38.023090+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:08:38.023090+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.023090+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:44.300861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":552,"num_write":485,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'385","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.134806+0000","last_change":"2024-09-12T18:08:18.134748+0000","last_active":"2024-09-12T18:08:18.134806+0000","last_peered":"2024-09-12T18:08:18.134806+0000","last_clean":"2024-09-12T18:08:18.134806+0000","last_became_active":"2024-09-12T17:29:54.944624+0000","last_became_peered":"2024-09-12T17:29:54.944624+0000","last_unstale":"2024-09-12T18:08:18.134806+0000","last_undegraded":"2024-09-12T18:08:18.134806+0000","last_fullsized":"2024-09-12T18:08:18.134806+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T18:08:18.134658+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T18:08:18.134658+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.134658+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:17.271829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1668,"num_read_kb":1443,"num_write":651,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7559,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.685327+0000","last_change":"2024-09-12T18:08:12.685327+0000","last_active":"2024-09-12T18:08:12.685327+0000","last_peered":"2024-09-12T18:08:12.685327+0000","last_clean":"2024-09-12T18:08:12.685327+0000","last_became_active":"2024-09-12T17:29:41.963499+0000","last_became_peered":"2024-09-12T17:29:41.963499+0000","last_unstale":"2024-09-12T18:08:12.685327+0000","last_undegraded":"2024-09-12T18:08:12.685327+0000","last_fullsized":"2024-09-12T18:08:12.685327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:12.685224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:12.685224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.685224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:53.962768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470655,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'149","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:07.126035+0000","last_change":"2024-09-12T18:08:07.126035+0000","last_active":"2024-09-12T18:08:07.126035+0000","last_peered":"2024-09-12T18:08:07.126035+0000","last_clean":"2024-09-12T18:08:07.126035+0000","last_became_active":"2024-09-12T17:29:52.949339+0000","last_became_peered":"2024-09-12T17:29:52.949339+0000","last_unstale":"2024-09-12T18:08:07.126035+0000","last_undegraded":"2024-09-12T18:08:07.126035+0000","last_fullsized":"2024-09-12T18:08:07.126035+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T18:08:07.125919+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T18:08:07.125919+0000","last_clean_scrub_stamp":"2024-09-12T18:08:07.125919+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:14.630758+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":3075,"num_write":751,"num_write_kb":23555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.488139+0000","last_change":"2024-09-12T18:08:30.488074+0000","last_active":"2024-09-12T18:08:30.488139+0000","last_peered":"2024-09-12T18:08:30.488139+0000","last_clean":"2024-09-12T18:08:30.488139+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:08:30.488139+0000","last_undegraded":"2024-09-12T18:08:30.488139+0000","last_fullsized":"2024-09-12T18:08:30.488139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:30.487983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:30.487983+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.487983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:10.242355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'795","reported_seq":2190,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.321172+0000","last_change":"2024-09-12T18:08:29.321172+0000","last_active":"2024-09-12T18:08:29.321172+0000","last_peered":"2024-09-12T18:08:29.321172+0000","last_clean":"2024-09-12T18:08:29.321172+0000","last_became_active":"2024-09-12T17:29:58.958269+0000","last_became_peered":"2024-09-12T17:29:58.958269+0000","last_unstale":"2024-09-12T18:08:29.321172+0000","last_undegraded":"2024-09-12T18:08:29.321172+0000","last_fullsized":"2024-09-12T18:08:29.321172+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'795","last_scrub_stamp":"2024-09-12T18:08:29.321029+0000","last_deep_scrub":"264'795","last_deep_scrub_stamp":"2024-09-12T18:08:29.321029+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.321029+0000","objects_scrubbed":12,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:42.926498+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37829,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1137,"num_read_kb":1322,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.950826+0000","last_change":"2024-09-12T18:08:37.950826+0000","last_active":"2024-09-12T18:08:37.950826+0000","last_peered":"2024-09-12T18:08:37.950826+0000","last_clean":"2024-09-12T18:08:37.950826+0000","last_became_active":"2024-09-12T17:30:00.957628+0000","last_became_peered":"2024-09-12T17:30:00.957628+0000","last_unstale":"2024-09-12T18:08:37.950826+0000","last_undegraded":"2024-09-12T18:08:37.950826+0000","last_fullsized":"2024-09-12T18:08:37.950826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:37.950712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:37.950712+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.950712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:19.553228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'138","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.236955+0000","last_change":"2024-09-12T18:08:37.236879+0000","last_active":"2024-09-12T18:08:37.236955+0000","last_peered":"2024-09-12T18:08:37.236955+0000","last_clean":"2024-09-12T18:08:37.236955+0000","last_became_active":"2024-09-12T17:30:02.960109+0000","last_became_peered":"2024-09-12T17:30:02.960109+0000","last_unstale":"2024-09-12T18:08:37.236955+0000","last_undegraded":"2024-09-12T18:08:37.236955+0000","last_fullsized":"2024-09-12T18:08:37.236955+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-12T18:08:37.236794+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-12T18:08:37.236794+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.236794+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:16.611769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":318,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'88","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.241904+0000","last_change":"2024-09-12T18:08:18.241855+0000","last_active":"2024-09-12T18:08:18.241904+0000","last_peered":"2024-09-12T18:08:18.241904+0000","last_clean":"2024-09-12T18:08:18.241904+0000","last_became_active":"2024-09-12T17:29:54.958310+0000","last_became_peered":"2024-09-12T17:29:54.958310+0000","last_unstale":"2024-09-12T18:08:18.241904+0000","last_undegraded":"2024-09-12T18:08:18.241904+0000","last_fullsized":"2024-09-12T18:08:18.241904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'88","last_scrub_stamp":"2024-09-12T18:08:18.241756+0000","last_deep_scrub":"264'88","last_deep_scrub_stamp":"2024-09-12T18:08:18.241756+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.241756+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:31.581719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":367,"num_read_kb":311,"num_write":135,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.255313+0000","last_change":"2024-09-12T18:08:08.255313+0000","last_active":"2024-09-12T18:08:08.255313+0000","last_peered":"2024-09-12T18:08:08.255313+0000","last_clean":"2024-09-12T18:08:08.255313+0000","last_became_active":"2024-09-12T17:29:42.064972+0000","last_became_peered":"2024-09-12T17:29:42.064972+0000","last_unstale":"2024-09-12T18:08:08.255313+0000","last_undegraded":"2024-09-12T18:08:08.255313+0000","last_fullsized":"2024-09-12T18:08:08.255313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:08.255224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:08.255224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.255224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:11.379409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047741400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'211","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.313282+0000","last_change":"2024-09-12T18:08:09.313282+0000","last_active":"2024-09-12T18:08:09.313282+0000","last_peered":"2024-09-12T18:08:09.313282+0000","last_clean":"2024-09-12T18:08:09.313282+0000","last_became_active":"2024-09-12T17:29:52.949301+0000","last_became_peered":"2024-09-12T17:29:52.949301+0000","last_unstale":"2024-09-12T18:08:09.313282+0000","last_undegraded":"2024-09-12T18:08:09.313282+0000","last_fullsized":"2024-09-12T18:08:09.313282+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-09-12T18:08:09.313149+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-09-12T18:08:09.313149+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.313149+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:08.195813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":2667,"num_write":1034,"num_write_kb":7887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.462190+0000","last_change":"2024-09-12T18:08:21.462126+0000","last_active":"2024-09-12T18:08:21.462190+0000","last_peered":"2024-09-12T18:08:21.462190+0000","last_clean":"2024-09-12T18:08:21.462190+0000","last_became_active":"2024-09-12T17:29:56.956623+0000","last_became_peered":"2024-09-12T17:29:56.956623+0000","last_unstale":"2024-09-12T18:08:21.462190+0000","last_undegraded":"2024-09-12T18:08:21.462190+0000","last_fullsized":"2024-09-12T18:08:21.462190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:21.462035+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:21.462035+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.462035+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.681426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'219","reported_seq":1220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.888279+0000","last_change":"2024-09-12T18:08:35.888279+0000","last_active":"2024-09-12T18:08:35.888279+0000","last_peered":"2024-09-12T18:08:35.888279+0000","last_clean":"2024-09-12T18:08:35.888279+0000","last_became_active":"2024-09-12T17:29:58.980697+0000","last_became_peered":"2024-09-12T17:29:58.980697+0000","last_unstale":"2024-09-12T18:08:35.888279+0000","last_undegraded":"2024-09-12T18:08:35.888279+0000","last_fullsized":"2024-09-12T18:08:35.888279+0000","mapping_epoch":30,"log_start":"264'201","ondisk_log_start":"264'201","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-12T18:08:35.888176+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-12T18:08:35.888176+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.888176+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":201,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:09.387384+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":123,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.275810+0000","last_change":"2024-09-12T18:08:35.275810+0000","last_active":"2024-09-12T18:08:35.275810+0000","last_peered":"2024-09-12T18:08:35.275810+0000","last_clean":"2024-09-12T18:08:35.275810+0000","last_became_active":"2024-09-12T17:30:00.968468+0000","last_became_peered":"2024-09-12T17:30:00.968468+0000","last_unstale":"2024-09-12T18:08:35.275810+0000","last_undegraded":"2024-09-12T18:08:35.275810+0000","last_fullsized":"2024-09-12T18:08:35.275810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:35.275712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:35.275712+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.275712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:20.338020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'252","reported_seq":852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.953421+0000","last_change":"2024-09-12T18:08:43.953421+0000","last_active":"2024-09-12T18:08:43.953421+0000","last_peered":"2024-09-12T18:08:43.953421+0000","last_clean":"2024-09-12T18:08:43.953421+0000","last_became_active":"2024-09-12T17:30:02.966910+0000","last_became_peered":"2024-09-12T17:30:02.966910+0000","last_unstale":"2024-09-12T18:08:43.953421+0000","last_undegraded":"2024-09-12T18:08:43.953421+0000","last_fullsized":"2024-09-12T18:08:43.953421+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'252","last_scrub_stamp":"2024-09-12T18:08:43.953338+0000","last_deep_scrub":"264'252","last_deep_scrub_stamp":"2024-09-12T18:08:43.953338+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.953338+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:00.374909+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":529,"num_write":537,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'112","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.211065+0000","last_change":"2024-09-12T18:08:17.211065+0000","last_active":"2024-09-12T18:08:17.211065+0000","last_peered":"2024-09-12T18:08:17.211065+0000","last_clean":"2024-09-12T18:08:17.211065+0000","last_became_active":"2024-09-12T17:29:54.948402+0000","last_became_peered":"2024-09-12T17:29:54.948402+0000","last_unstale":"2024-09-12T18:08:17.211065+0000","last_undegraded":"2024-09-12T18:08:17.211065+0000","last_fullsized":"2024-09-12T18:08:17.211065+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-12T18:08:17.210956+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-12T18:08:17.210956+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.210956+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:48.357477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":452,"num_write":172,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.547679+0000","last_change":"2024-09-12T18:08:10.547679+0000","last_active":"2024-09-12T18:08:10.547679+0000","last_peered":"2024-09-12T18:08:10.547679+0000","last_clean":"2024-09-12T18:08:10.547679+0000","last_became_active":"2024-09-12T17:29:41.961122+0000","last_became_peered":"2024-09-12T17:29:41.961122+0000","last_unstale":"2024-09-12T18:08:10.547679+0000","last_undegraded":"2024-09-12T18:08:10.547679+0000","last_fullsized":"2024-09-12T18:08:10.547679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:10.547560+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:10.547560+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.547560+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:55.070358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00095277999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'244","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.748940+0000","last_change":"2024-09-12T18:08:08.748940+0000","last_active":"2024-09-12T18:08:08.748940+0000","last_peered":"2024-09-12T18:08:08.748940+0000","last_clean":"2024-09-12T18:08:08.748940+0000","last_became_active":"2024-09-12T17:29:52.958406+0000","last_became_peered":"2024-09-12T17:29:52.958406+0000","last_unstale":"2024-09-12T18:08:08.748940+0000","last_undegraded":"2024-09-12T18:08:08.748940+0000","last_fullsized":"2024-09-12T18:08:08.748940+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'244","last_scrub_stamp":"2024-09-12T18:08:08.748824+0000","last_deep_scrub":"264'244","last_deep_scrub_stamp":"2024-09-12T18:08:08.748824+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.748824+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:58.654869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":569,"num_read_kb":48737,"num_write":1100,"num_write_kb":63490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.237589+0000","last_change":"2024-09-12T18:08:26.237589+0000","last_active":"2024-09-12T18:08:26.237589+0000","last_peered":"2024-09-12T18:08:26.237589+0000","last_clean":"2024-09-12T18:08:26.237589+0000","last_became_active":"2024-09-12T17:29:56.954018+0000","last_became_peered":"2024-09-12T17:29:56.954018+0000","last_unstale":"2024-09-12T18:08:26.237589+0000","last_undegraded":"2024-09-12T18:08:26.237589+0000","last_fullsized":"2024-09-12T18:08:26.237589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:26.237500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:26.237500+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.237500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:30.090296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'118","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.963725+0000","last_change":"2024-09-12T18:08:30.963654+0000","last_active":"2024-09-12T18:08:30.963725+0000","last_peered":"2024-09-12T18:08:30.963725+0000","last_clean":"2024-09-12T18:08:30.963725+0000","last_became_active":"2024-09-12T17:29:58.953909+0000","last_became_peered":"2024-09-12T17:29:58.953909+0000","last_unstale":"2024-09-12T18:08:30.963725+0000","last_undegraded":"2024-09-12T18:08:30.963725+0000","last_fullsized":"2024-09-12T18:08:30.963725+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-12T18:08:30.963563+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-12T18:08:30.963563+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.963563+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:58.827555+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":90,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.006342+0000","last_change":"2024-09-12T18:08:26.006228+0000","last_active":"2024-09-12T18:08:26.006342+0000","last_peered":"2024-09-12T18:08:26.006342+0000","last_clean":"2024-09-12T18:08:26.006342+0000","last_became_active":"2024-09-12T17:30:00.967279+0000","last_became_peered":"2024-09-12T17:30:00.967279+0000","last_unstale":"2024-09-12T18:08:26.006342+0000","last_undegraded":"2024-09-12T18:08:26.006342+0000","last_fullsized":"2024-09-12T18:08:26.006342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:26.006129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:26.006129+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.006129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:48.986438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'207","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.412097+0000","last_change":"2024-09-12T18:08:42.412024+0000","last_active":"2024-09-12T18:08:42.412097+0000","last_peered":"2024-09-12T18:08:42.412097+0000","last_clean":"2024-09-12T18:08:42.412097+0000","last_became_active":"2024-09-12T17:30:02.969486+0000","last_became_peered":"2024-09-12T17:30:02.969486+0000","last_unstale":"2024-09-12T18:08:42.412097+0000","last_undegraded":"2024-09-12T18:08:42.412097+0000","last_fullsized":"2024-09-12T18:08:42.412097+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:42.411931+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:42.411931+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.411931+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:03.146985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":397,"num_write":473,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'156","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.251799+0000","last_change":"2024-09-12T18:08:16.251799+0000","last_active":"2024-09-12T18:08:16.251799+0000","last_peered":"2024-09-12T18:08:16.251799+0000","last_clean":"2024-09-12T18:08:16.251799+0000","last_became_active":"2024-09-12T17:29:54.963669+0000","last_became_peered":"2024-09-12T17:29:54.963669+0000","last_unstale":"2024-09-12T18:08:16.251799+0000","last_undegraded":"2024-09-12T18:08:16.251799+0000","last_fullsized":"2024-09-12T18:08:16.251799+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-12T18:08:16.251716+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-12T18:08:16.251716+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.251716+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:44.134038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":549,"num_write":259,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'205","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.503195+0000","last_change":"2024-09-12T18:08:11.503195+0000","last_active":"2024-09-12T18:08:11.503195+0000","last_peered":"2024-09-12T18:08:11.503195+0000","last_clean":"2024-09-12T18:08:11.503195+0000","last_became_active":"2024-09-12T17:29:52.954220+0000","last_became_peered":"2024-09-12T17:29:52.954220+0000","last_unstale":"2024-09-12T18:08:11.503195+0000","last_undegraded":"2024-09-12T18:08:11.503195+0000","last_fullsized":"2024-09-12T18:08:11.503195+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'205","last_scrub_stamp":"2024-09-12T18:08:11.503069+0000","last_deep_scrub":"264'205","last_deep_scrub_stamp":"2024-09-12T18:08:11.503069+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.503069+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:14.820377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":525,"num_read_kb":74998,"num_write":1066,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.352125+0000","last_change":"2024-09-12T18:08:08.352125+0000","last_active":"2024-09-12T18:08:08.352125+0000","last_peered":"2024-09-12T18:08:08.352125+0000","last_clean":"2024-09-12T18:08:08.352125+0000","last_became_active":"2024-09-12T17:29:42.064741+0000","last_became_peered":"2024-09-12T17:29:42.064741+0000","last_unstale":"2024-09-12T18:08:08.352125+0000","last_undegraded":"2024-09-12T18:08:08.352125+0000","last_fullsized":"2024-09-12T18:08:08.352125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:08.352056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:08.352056+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.352056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:03.352768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043924099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.228596+0000","last_change":"2024-09-12T18:08:25.228596+0000","last_active":"2024-09-12T18:08:25.228596+0000","last_peered":"2024-09-12T18:08:25.228596+0000","last_clean":"2024-09-12T18:08:25.228596+0000","last_became_active":"2024-09-12T17:29:56.955562+0000","last_became_peered":"2024-09-12T17:29:56.955562+0000","last_unstale":"2024-09-12T18:08:25.228596+0000","last_undegraded":"2024-09-12T18:08:25.228596+0000","last_fullsized":"2024-09-12T18:08:25.228596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.228503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.228503+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.228503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:54.858311+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'271","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.272312+0000","last_change":"2024-09-12T18:08:28.272312+0000","last_active":"2024-09-12T18:08:28.272312+0000","last_peered":"2024-09-12T18:08:28.272312+0000","last_clean":"2024-09-12T18:08:28.272312+0000","last_became_active":"2024-09-12T17:29:58.960410+0000","last_became_peered":"2024-09-12T17:29:58.960410+0000","last_unstale":"2024-09-12T18:08:28.272312+0000","last_undegraded":"2024-09-12T18:08:28.272312+0000","last_fullsized":"2024-09-12T18:08:28.272312+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-12T18:08:28.272217+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-12T18:08:28.272217+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.272217+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:32.383273+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14017,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":378,"num_read_kb":510,"num_write":242,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11880,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.834068+0000","last_change":"2024-09-12T18:08:36.834068+0000","last_active":"2024-09-12T18:08:36.834068+0000","last_peered":"2024-09-12T18:08:36.834068+0000","last_clean":"2024-09-12T18:08:36.834068+0000","last_became_active":"2024-09-12T17:30:00.963660+0000","last_became_peered":"2024-09-12T17:30:00.963660+0000","last_unstale":"2024-09-12T18:08:36.834068+0000","last_undegraded":"2024-09-12T18:08:36.834068+0000","last_fullsized":"2024-09-12T18:08:36.834068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:36.833959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:36.833959+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.833959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:36.771638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'174","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.340404+0000","last_change":"2024-09-12T18:08:42.340404+0000","last_active":"2024-09-12T18:08:42.340404+0000","last_peered":"2024-09-12T18:08:42.340404+0000","last_clean":"2024-09-12T18:08:42.340404+0000","last_became_active":"2024-09-12T17:30:02.971807+0000","last_became_peered":"2024-09-12T17:30:02.971807+0000","last_unstale":"2024-09-12T18:08:42.340404+0000","last_undegraded":"2024-09-12T18:08:42.340404+0000","last_fullsized":"2024-09-12T18:08:42.340404+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:08:42.340320+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:08:42.340320+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.340320+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:28.426511+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":246,"num_write":442,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'192","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.154129+0000","last_change":"2024-09-12T18:08:15.154129+0000","last_active":"2024-09-12T18:08:15.154129+0000","last_peered":"2024-09-12T18:08:15.154129+0000","last_clean":"2024-09-12T18:08:15.154129+0000","last_became_active":"2024-09-12T17:29:54.958998+0000","last_became_peered":"2024-09-12T17:29:54.958998+0000","last_unstale":"2024-09-12T18:08:15.154129+0000","last_undegraded":"2024-09-12T18:08:15.154129+0000","last_fullsized":"2024-09-12T18:08:15.154129+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-09-12T18:08:15.154013+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-09-12T18:08:15.154013+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.154013+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:33.665464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":764,"num_write":273,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'224","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.319484+0000","last_change":"2024-09-12T18:08:10.319484+0000","last_active":"2024-09-12T18:08:10.319484+0000","last_peered":"2024-09-12T18:08:10.319484+0000","last_clean":"2024-09-12T18:08:10.319484+0000","last_became_active":"2024-09-12T17:29:52.955429+0000","last_became_peered":"2024-09-12T17:29:52.955429+0000","last_unstale":"2024-09-12T18:08:10.319484+0000","last_undegraded":"2024-09-12T18:08:10.319484+0000","last_fullsized":"2024-09-12T18:08:10.319484+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'224","last_scrub_stamp":"2024-09-12T18:08:10.319399+0000","last_deep_scrub":"264'224","last_deep_scrub_stamp":"2024-09-12T18:08:10.319399+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.319399+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:41.245590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170313,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":39247,"num_write":990,"num_write_kb":44156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.715167+0000","last_change":"2024-09-12T18:08:11.715167+0000","last_active":"2024-09-12T18:08:11.715167+0000","last_peered":"2024-09-12T18:08:11.715167+0000","last_clean":"2024-09-12T18:08:11.715167+0000","last_became_active":"2024-09-12T17:29:42.064736+0000","last_became_peered":"2024-09-12T17:29:42.064736+0000","last_unstale":"2024-09-12T18:08:11.715167+0000","last_undegraded":"2024-09-12T18:08:11.715167+0000","last_fullsized":"2024-09-12T18:08:11.715167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:11.715042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:11.715042+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.715042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:08.443705+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045118300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.082844+0000","last_change":"2024-09-12T18:08:23.082844+0000","last_active":"2024-09-12T18:08:23.082844+0000","last_peered":"2024-09-12T18:08:23.082844+0000","last_clean":"2024-09-12T18:08:23.082844+0000","last_became_active":"2024-09-12T17:29:56.957503+0000","last_became_peered":"2024-09-12T17:29:56.957503+0000","last_unstale":"2024-09-12T18:08:23.082844+0000","last_undegraded":"2024-09-12T18:08:23.082844+0000","last_fullsized":"2024-09-12T18:08:23.082844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:23.082745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:23.082745+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.082745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:14.276157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'157","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.314767+0000","last_change":"2024-09-12T18:08:28.314767+0000","last_active":"2024-09-12T18:08:28.314767+0000","last_peered":"2024-09-12T18:08:28.314767+0000","last_clean":"2024-09-12T18:08:28.314767+0000","last_became_active":"2024-09-12T17:29:58.978487+0000","last_became_peered":"2024-09-12T17:29:58.978487+0000","last_unstale":"2024-09-12T18:08:28.314767+0000","last_undegraded":"2024-09-12T18:08:28.314767+0000","last_fullsized":"2024-09-12T18:08:28.314767+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'157","last_scrub_stamp":"2024-09-12T18:08:28.314678+0000","last_deep_scrub":"264'157","last_deep_scrub_stamp":"2024-09-12T18:08:28.314678+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.314678+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:43.823711+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":172,"num_read_kb":165,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'772","reported_seq":2453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.410854+0000","last_change":"2024-09-12T18:08:40.410854+0000","last_active":"2024-09-12T18:08:40.410854+0000","last_peered":"2024-09-12T18:08:40.410854+0000","last_clean":"2024-09-12T18:08:40.410854+0000","last_became_active":"2024-09-12T17:30:00.956655+0000","last_became_peered":"2024-09-12T17:30:00.956655+0000","last_unstale":"2024-09-12T18:08:40.410854+0000","last_undegraded":"2024-09-12T18:08:40.410854+0000","last_fullsized":"2024-09-12T18:08:40.410854+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'772","last_scrub_stamp":"2024-09-12T18:08:40.410755+0000","last_deep_scrub":"264'772","last_deep_scrub_stamp":"2024-09-12T18:08:40.410755+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.410755+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:40.083368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'122","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.932516+0000","last_change":"2024-09-12T18:08:45.932516+0000","last_active":"2024-09-12T18:08:45.932516+0000","last_peered":"2024-09-12T18:08:45.932516+0000","last_clean":"2024-09-12T18:08:45.932516+0000","last_became_active":"2024-09-12T17:30:02.968978+0000","last_became_peered":"2024-09-12T17:30:02.968978+0000","last_unstale":"2024-09-12T18:08:45.932516+0000","last_undegraded":"2024-09-12T18:08:45.932516+0000","last_fullsized":"2024-09-12T18:08:45.932516+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'122","last_scrub_stamp":"2024-09-12T18:08:45.932416+0000","last_deep_scrub":"264'122","last_deep_scrub_stamp":"2024-09-12T18:08:45.932416+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.932416+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:31.256238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1365,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":174,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'406","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.094428+0000","last_change":"2024-09-12T18:08:17.094428+0000","last_active":"2024-09-12T18:08:17.094428+0000","last_peered":"2024-09-12T18:08:17.094428+0000","last_clean":"2024-09-12T18:08:17.094428+0000","last_became_active":"2024-09-12T17:29:54.955170+0000","last_became_peered":"2024-09-12T17:29:54.955170+0000","last_unstale":"2024-09-12T18:08:17.094428+0000","last_undegraded":"2024-09-12T18:08:17.094428+0000","last_fullsized":"2024-09-12T18:08:17.094428+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-09-12T18:08:17.094343+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-09-12T18:08:17.094343+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.094343+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:22.112938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1829,"num_read_kb":1585,"num_write":674,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'168","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.262237+0000","last_change":"2024-09-12T18:08:09.262237+0000","last_active":"2024-09-12T18:08:09.262237+0000","last_peered":"2024-09-12T18:08:09.262237+0000","last_clean":"2024-09-12T18:08:09.262237+0000","last_became_active":"2024-09-12T17:30:28.004804+0000","last_became_peered":"2024-09-12T17:30:28.004804+0000","last_unstale":"2024-09-12T18:08:09.262237+0000","last_undegraded":"2024-09-12T18:08:09.262237+0000","last_fullsized":"2024-09-12T18:08:09.262237+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-12T18:08:09.262150+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-12T18:08:09.262150+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.262150+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:43.192647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262290,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":342,"num_read_kb":56981,"num_write":802,"num_write_kb":25989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:07.370369+0000","last_change":"2024-09-12T18:08:07.370292+0000","last_active":"2024-09-12T18:08:07.370369+0000","last_peered":"2024-09-12T18:08:07.370369+0000","last_clean":"2024-09-12T18:08:07.370369+0000","last_became_active":"2024-09-12T17:29:41.961194+0000","last_became_peered":"2024-09-12T17:29:41.961194+0000","last_unstale":"2024-09-12T18:08:07.370369+0000","last_undegraded":"2024-09-12T18:08:07.370369+0000","last_fullsized":"2024-09-12T18:08:07.370369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:07.370196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:07.370196+0000","last_clean_scrub_stamp":"2024-09-12T18:08:07.370196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:17.088343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049442699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.840682+0000","last_change":"2024-09-12T18:08:27.840682+0000","last_active":"2024-09-12T18:08:27.840682+0000","last_peered":"2024-09-12T18:08:27.840682+0000","last_clean":"2024-09-12T18:08:27.840682+0000","last_became_active":"2024-09-12T17:29:56.955865+0000","last_became_peered":"2024-09-12T17:29:56.955865+0000","last_unstale":"2024-09-12T18:08:27.840682+0000","last_undegraded":"2024-09-12T18:08:27.840682+0000","last_fullsized":"2024-09-12T18:08:27.840682+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.840597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.840597+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.840597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:30.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'101","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.847564+0000","last_change":"2024-09-12T18:08:31.847564+0000","last_active":"2024-09-12T18:08:31.847564+0000","last_peered":"2024-09-12T18:08:31.847564+0000","last_clean":"2024-09-12T18:08:31.847564+0000","last_became_active":"2024-09-12T17:29:58.953924+0000","last_became_peered":"2024-09-12T17:29:58.953924+0000","last_unstale":"2024-09-12T18:08:31.847564+0000","last_undegraded":"2024-09-12T18:08:31.847564+0000","last_fullsized":"2024-09-12T18:08:31.847564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'101","last_scrub_stamp":"2024-09-12T18:08:31.847468+0000","last_deep_scrub":"264'101","last_deep_scrub_stamp":"2024-09-12T18:08:31.847468+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.847468+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:50.319108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":108,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'781","reported_seq":2102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.859208+0000","last_change":"2024-09-12T18:08:38.859208+0000","last_active":"2024-09-12T18:08:38.859208+0000","last_peered":"2024-09-12T18:08:38.859208+0000","last_clean":"2024-09-12T18:08:38.859208+0000","last_became_active":"2024-09-12T17:30:00.967168+0000","last_became_peered":"2024-09-12T17:30:00.967168+0000","last_unstale":"2024-09-12T18:08:38.859208+0000","last_undegraded":"2024-09-12T18:08:38.859208+0000","last_fullsized":"2024-09-12T18:08:38.859208+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'781","last_scrub_stamp":"2024-09-12T18:08:38.859128+0000","last_deep_scrub":"264'781","last_deep_scrub_stamp":"2024-09-12T18:08:38.859128+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.859128+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:51.244607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'304","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.290565+0000","last_change":"2024-09-12T18:08:41.290565+0000","last_active":"2024-09-12T18:08:41.290565+0000","last_peered":"2024-09-12T18:08:41.290565+0000","last_clean":"2024-09-12T18:08:41.290565+0000","last_became_active":"2024-09-12T17:30:02.969526+0000","last_became_peered":"2024-09-12T17:30:02.969526+0000","last_unstale":"2024-09-12T18:08:41.290565+0000","last_undegraded":"2024-09-12T18:08:41.290565+0000","last_fullsized":"2024-09-12T18:08:41.290565+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'304","last_scrub_stamp":"2024-09-12T18:08:41.290483+0000","last_deep_scrub":"264'304","last_deep_scrub_stamp":"2024-09-12T18:08:41.290483+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.290483+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:17.435474+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":439,"num_write":657,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'44","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.696695+0000","last_change":"2024-09-12T18:08:12.696695+0000","last_active":"2024-09-12T18:08:12.696695+0000","last_peered":"2024-09-12T18:08:12.696695+0000","last_clean":"2024-09-12T18:08:12.696695+0000","last_became_active":"2024-09-12T17:29:54.957906+0000","last_became_peered":"2024-09-12T17:29:54.957906+0000","last_unstale":"2024-09-12T18:08:12.696695+0000","last_undegraded":"2024-09-12T18:08:12.696695+0000","last_fullsized":"2024-09-12T18:08:12.696695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T18:08:12.696599+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T18:08:12.696599+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.696599+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:18.217996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":180,"num_write":59,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'212","reported_seq":834,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.278838+0000","last_change":"2024-09-12T18:08:10.278838+0000","last_active":"2024-09-12T18:08:10.278838+0000","last_peered":"2024-09-12T18:08:10.278838+0000","last_clean":"2024-09-12T18:08:10.278838+0000","last_became_active":"2024-09-12T17:30:28.006884+0000","last_became_peered":"2024-09-12T17:30:28.006884+0000","last_unstale":"2024-09-12T18:08:10.278838+0000","last_undegraded":"2024-09-12T18:08:10.278838+0000","last_fullsized":"2024-09-12T18:08:10.278838+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-12T18:08:10.278730+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-12T18:08:10.278730+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.278730+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.094728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":14673,"num_write":991,"num_write_kb":46674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.055459+0000","last_change":"2024-09-12T18:08:10.055401+0000","last_active":"2024-09-12T18:08:10.055459+0000","last_peered":"2024-09-12T18:08:10.055459+0000","last_clean":"2024-09-12T18:08:10.055459+0000","last_became_active":"2024-09-12T17:29:41.961477+0000","last_became_peered":"2024-09-12T17:29:41.961477+0000","last_unstale":"2024-09-12T18:08:10.055459+0000","last_undegraded":"2024-09-12T18:08:10.055459+0000","last_fullsized":"2024-09-12T18:08:10.055459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:10.055313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:10.055313+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.055313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:09.016405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041855800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.023133+0000","last_change":"2024-09-12T18:08:25.023133+0000","last_active":"2024-09-12T18:08:25.023133+0000","last_peered":"2024-09-12T18:08:25.023133+0000","last_clean":"2024-09-12T18:08:25.023133+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:08:25.023133+0000","last_undegraded":"2024-09-12T18:08:25.023133+0000","last_fullsized":"2024-09-12T18:08:25.023133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.022986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.022986+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.022986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:42.498998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'320","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.888007+0000","last_change":"2024-09-12T18:08:32.888007+0000","last_active":"2024-09-12T18:08:32.888007+0000","last_peered":"2024-09-12T18:08:32.888007+0000","last_clean":"2024-09-12T18:08:32.888007+0000","last_became_active":"2024-09-12T17:29:58.978222+0000","last_became_peered":"2024-09-12T17:29:58.978222+0000","last_unstale":"2024-09-12T18:08:32.888007+0000","last_undegraded":"2024-09-12T18:08:32.888007+0000","last_fullsized":"2024-09-12T18:08:32.888007+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'320","last_scrub_stamp":"2024-09-12T18:08:32.887900+0000","last_deep_scrub":"264'320","last_deep_scrub_stamp":"2024-09-12T18:08:32.887900+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.887900+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:36.484816+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25498,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":718,"num_write":254,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.896645+0000","last_change":"2024-09-12T18:08:37.896645+0000","last_active":"2024-09-12T18:08:37.896645+0000","last_peered":"2024-09-12T18:08:37.896645+0000","last_clean":"2024-09-12T18:08:37.896645+0000","last_became_active":"2024-09-12T17:30:00.968527+0000","last_became_peered":"2024-09-12T17:30:00.968527+0000","last_unstale":"2024-09-12T18:08:37.896645+0000","last_undegraded":"2024-09-12T18:08:37.896645+0000","last_fullsized":"2024-09-12T18:08:37.896645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:37.896560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:37.896560+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.896560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:08.112093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'125","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.454152+0000","last_change":"2024-09-12T18:08:43.454152+0000","last_active":"2024-09-12T18:08:43.454152+0000","last_peered":"2024-09-12T18:08:43.454152+0000","last_clean":"2024-09-12T18:08:43.454152+0000","last_became_active":"2024-09-12T17:30:02.966018+0000","last_became_peered":"2024-09-12T17:30:02.966018+0000","last_unstale":"2024-09-12T18:08:43.454152+0000","last_undegraded":"2024-09-12T18:08:43.454152+0000","last_fullsized":"2024-09-12T18:08:43.454152+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T18:08:43.454064+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T18:08:43.454064+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.454064+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:24.393994+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":226,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'155","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.406175+0000","last_change":"2024-09-12T18:08:45.406175+0000","last_active":"2024-09-12T18:08:45.406175+0000","last_peered":"2024-09-12T18:08:45.406175+0000","last_clean":"2024-09-12T18:08:45.406175+0000","last_became_active":"2024-09-12T17:30:02.964133+0000","last_became_peered":"2024-09-12T17:30:02.964133+0000","last_unstale":"2024-09-12T18:08:45.406175+0000","last_undegraded":"2024-09-12T18:08:45.406175+0000","last_fullsized":"2024-09-12T18:08:45.406175+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'155","last_scrub_stamp":"2024-09-12T18:08:45.406061+0000","last_deep_scrub":"264'155","last_deep_scrub_stamp":"2024-09-12T18:08:45.406061+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.406061+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:36.421474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":286,"num_write":383,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'105","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.701136+0000","last_change":"2024-09-12T18:08:15.701136+0000","last_active":"2024-09-12T18:08:15.701136+0000","last_peered":"2024-09-12T18:08:15.701136+0000","last_clean":"2024-09-12T18:08:15.701136+0000","last_became_active":"2024-09-12T17:29:54.955716+0000","last_became_peered":"2024-09-12T17:29:54.955716+0000","last_unstale":"2024-09-12T18:08:15.701136+0000","last_undegraded":"2024-09-12T18:08:15.701136+0000","last_fullsized":"2024-09-12T18:08:15.701136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T18:08:15.701059+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T18:08:15.701059+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.701059+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:28.452054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":383,"num_write":153,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'185","reported_seq":785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.353007+0000","last_change":"2024-09-12T18:08:15.353007+0000","last_active":"2024-09-12T18:08:15.353007+0000","last_peered":"2024-09-12T18:08:15.353007+0000","last_clean":"2024-09-12T18:08:15.353007+0000","last_became_active":"2024-09-12T17:30:28.200487+0000","last_became_peered":"2024-09-12T17:30:28.200487+0000","last_unstale":"2024-09-12T18:08:15.353007+0000","last_undegraded":"2024-09-12T18:08:15.353007+0000","last_fullsized":"2024-09-12T18:08:15.353007+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-12T18:08:15.352875+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-12T18:08:15.352875+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.352875+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:15.449063+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":393,"num_read_kb":70111,"num_write":894,"num_write_kb":56875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.323914+0000","last_change":"2024-09-12T18:08:24.323914+0000","last_active":"2024-09-12T18:08:24.323914+0000","last_peered":"2024-09-12T18:08:24.323914+0000","last_clean":"2024-09-12T18:08:24.323914+0000","last_became_active":"2024-09-12T17:29:56.952578+0000","last_became_peered":"2024-09-12T17:29:56.952578+0000","last_unstale":"2024-09-12T18:08:24.323914+0000","last_undegraded":"2024-09-12T18:08:24.323914+0000","last_fullsized":"2024-09-12T18:08:24.323914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:24.323828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:24.323828+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.323828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:27.495028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'130","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.906581+0000","last_change":"2024-09-12T18:08:33.906581+0000","last_active":"2024-09-12T18:08:33.906581+0000","last_peered":"2024-09-12T18:08:33.906581+0000","last_clean":"2024-09-12T18:08:33.906581+0000","last_became_active":"2024-09-12T17:29:58.955111+0000","last_became_peered":"2024-09-12T17:29:58.955111+0000","last_unstale":"2024-09-12T18:08:33.906581+0000","last_undegraded":"2024-09-12T18:08:33.906581+0000","last_fullsized":"2024-09-12T18:08:33.906581+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T18:08:33.906456+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T18:08:33.906456+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.906456+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:56.253668+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":163,"num_read_kb":266,"num_write":84,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.811028+0000","last_change":"2024-09-12T18:08:39.811028+0000","last_active":"2024-09-12T18:08:39.811028+0000","last_peered":"2024-09-12T18:08:39.811028+0000","last_clean":"2024-09-12T18:08:39.811028+0000","last_became_active":"2024-09-12T17:30:00.965975+0000","last_became_peered":"2024-09-12T17:30:00.965975+0000","last_unstale":"2024-09-12T18:08:39.811028+0000","last_undegraded":"2024-09-12T18:08:39.811028+0000","last_fullsized":"2024-09-12T18:08:39.811028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:39.810896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:39.810896+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.810896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:04.330311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'107","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.928840+0000","last_change":"2024-09-12T18:08:47.928840+0000","last_active":"2024-09-12T18:08:47.928840+0000","last_peered":"2024-09-12T18:08:47.928840+0000","last_clean":"2024-09-12T18:08:47.928840+0000","last_became_active":"2024-09-12T17:30:02.965919+0000","last_became_peered":"2024-09-12T17:30:02.965919+0000","last_unstale":"2024-09-12T18:08:47.928840+0000","last_undegraded":"2024-09-12T18:08:47.928840+0000","last_fullsized":"2024-09-12T18:08:47.928840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-12T18:08:47.928754+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-12T18:08:47.928754+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.928754+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.514514+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":165,"num_read_kb":151,"num_write":248,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'420","reported_seq":1175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.282459+0000","last_change":"2024-09-12T18:08:19.282459+0000","last_active":"2024-09-12T18:08:19.282459+0000","last_peered":"2024-09-12T18:08:19.282459+0000","last_clean":"2024-09-12T18:08:19.282459+0000","last_became_active":"2024-09-12T17:29:54.954477+0000","last_became_peered":"2024-09-12T17:29:54.954477+0000","last_unstale":"2024-09-12T18:08:19.282459+0000","last_undegraded":"2024-09-12T18:08:19.282459+0000","last_fullsized":"2024-09-12T18:08:19.282459+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'420","last_scrub_stamp":"2024-09-12T18:08:19.282376+0000","last_deep_scrub":"264'420","last_deep_scrub_stamp":"2024-09-12T18:08:19.282376+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.282376+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:52.399922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1777,"num_write":781,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'210","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.683017+0000","last_change":"2024-09-12T18:08:17.682955+0000","last_active":"2024-09-12T18:08:17.683017+0000","last_peered":"2024-09-12T18:08:17.683017+0000","last_clean":"2024-09-12T18:08:17.683017+0000","last_became_active":"2024-09-12T17:29:52.956376+0000","last_became_peered":"2024-09-12T17:29:52.956376+0000","last_unstale":"2024-09-12T18:08:17.683017+0000","last_undegraded":"2024-09-12T18:08:17.683017+0000","last_fullsized":"2024-09-12T18:08:17.683017+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-12T18:08:17.682841+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-12T18:08:17.682841+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.682841+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:59.176548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":36390,"num_write":986,"num_write_kb":36751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.983279+0000","last_change":"2024-09-12T18:08:26.983279+0000","last_active":"2024-09-12T18:08:26.983279+0000","last_peered":"2024-09-12T18:08:26.983279+0000","last_clean":"2024-09-12T18:08:26.983279+0000","last_became_active":"2024-09-12T17:29:56.955256+0000","last_became_peered":"2024-09-12T17:29:56.955256+0000","last_unstale":"2024-09-12T18:08:26.983279+0000","last_undegraded":"2024-09-12T18:08:26.983279+0000","last_fullsized":"2024-09-12T18:08:26.983279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:26.983183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:26.983183+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.983183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:10.917322+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'54","reported_seq":559,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.221679+0000","last_change":"2024-09-12T18:08:31.221679+0000","last_active":"2024-09-12T18:08:31.221679+0000","last_peered":"2024-09-12T18:08:31.221679+0000","last_clean":"2024-09-12T18:08:31.221679+0000","last_became_active":"2024-09-12T17:29:58.960476+0000","last_became_peered":"2024-09-12T17:29:58.960476+0000","last_unstale":"2024-09-12T18:08:31.221679+0000","last_undegraded":"2024-09-12T18:08:31.221679+0000","last_fullsized":"2024-09-12T18:08:31.221679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'54","last_scrub_stamp":"2024-09-12T18:08:31.221616+0000","last_deep_scrub":"264'54","last_deep_scrub_stamp":"2024-09-12T18:08:31.221616+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.221616+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:54.384978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.997404+0000","last_change":"2024-09-12T18:08:39.997404+0000","last_active":"2024-09-12T18:08:39.997404+0000","last_peered":"2024-09-12T18:08:39.997404+0000","last_clean":"2024-09-12T18:08:39.997404+0000","last_became_active":"2024-09-12T17:30:00.958739+0000","last_became_peered":"2024-09-12T17:30:00.958739+0000","last_unstale":"2024-09-12T18:08:39.997404+0000","last_undegraded":"2024-09-12T18:08:39.997404+0000","last_fullsized":"2024-09-12T18:08:39.997404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:39.997305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:39.997305+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.997305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:54.123997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'190","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.374569+0000","last_change":"2024-09-12T18:08:43.374569+0000","last_active":"2024-09-12T18:08:43.374569+0000","last_peered":"2024-09-12T18:08:43.374569+0000","last_clean":"2024-09-12T18:08:43.374569+0000","last_became_active":"2024-09-12T17:30:02.972717+0000","last_became_peered":"2024-09-12T17:30:02.972717+0000","last_unstale":"2024-09-12T18:08:43.374569+0000","last_undegraded":"2024-09-12T18:08:43.374569+0000","last_fullsized":"2024-09-12T18:08:43.374569+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:08:43.374481+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:08:43.374481+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.374481+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:36.269631+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":309,"num_read_kb":305,"num_write":411,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'235","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.096877+0000","last_change":"2024-09-12T18:08:19.096877+0000","last_active":"2024-09-12T18:08:19.096877+0000","last_peered":"2024-09-12T18:08:19.096877+0000","last_clean":"2024-09-12T18:08:19.096877+0000","last_became_active":"2024-09-12T17:29:54.955897+0000","last_became_peered":"2024-09-12T17:29:54.955897+0000","last_unstale":"2024-09-12T18:08:19.096877+0000","last_undegraded":"2024-09-12T18:08:19.096877+0000","last_fullsized":"2024-09-12T18:08:19.096877+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'235","last_scrub_stamp":"2024-09-12T18:08:19.096790+0000","last_deep_scrub":"264'235","last_deep_scrub_stamp":"2024-09-12T18:08:19.096790+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.096790+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:13.358909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":344,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'244","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.511020+0000","last_change":"2024-09-12T18:08:12.510954+0000","last_active":"2024-09-12T18:08:12.511020+0000","last_peered":"2024-09-12T18:08:12.511020+0000","last_clean":"2024-09-12T18:08:12.511020+0000","last_became_active":"2024-09-12T17:29:52.954956+0000","last_became_peered":"2024-09-12T17:29:52.954956+0000","last_unstale":"2024-09-12T18:08:12.511020+0000","last_undegraded":"2024-09-12T18:08:12.511020+0000","last_fullsized":"2024-09-12T18:08:12.511020+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'244","last_scrub_stamp":"2024-09-12T18:08:12.510806+0000","last_deep_scrub":"264'244","last_deep_scrub_stamp":"2024-09-12T18:08:12.510806+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.510806+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:53.796805+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550036,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":646,"num_read_kb":5380,"num_write":1208,"num_write_kb":40346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.876369+0000","last_change":"2024-09-12T18:08:31.876369+0000","last_active":"2024-09-12T18:08:31.876369+0000","last_peered":"2024-09-12T18:08:31.876369+0000","last_clean":"2024-09-12T18:08:31.876369+0000","last_became_active":"2024-09-12T17:29:56.959460+0000","last_became_peered":"2024-09-12T17:29:56.959460+0000","last_unstale":"2024-09-12T18:08:31.876369+0000","last_undegraded":"2024-09-12T18:08:31.876369+0000","last_fullsized":"2024-09-12T18:08:31.876369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:31.876275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:31.876275+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.876275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:33.746738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'154","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.862640+0000","last_change":"2024-09-12T18:08:34.862640+0000","last_active":"2024-09-12T18:08:34.862640+0000","last_peered":"2024-09-12T18:08:34.862640+0000","last_clean":"2024-09-12T18:08:34.862640+0000","last_became_active":"2024-09-12T17:29:58.960824+0000","last_became_peered":"2024-09-12T17:29:58.960824+0000","last_unstale":"2024-09-12T18:08:34.862640+0000","last_undegraded":"2024-09-12T18:08:34.862640+0000","last_fullsized":"2024-09-12T18:08:34.862640+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-12T18:08:34.862546+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-12T18:08:34.862546+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.862546+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:17.967948+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":238,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.025164+0000","last_change":"2024-09-12T18:08:28.025164+0000","last_active":"2024-09-12T18:08:28.025164+0000","last_peered":"2024-09-12T18:08:28.025164+0000","last_clean":"2024-09-12T18:08:28.025164+0000","last_became_active":"2024-09-12T17:30:00.967299+0000","last_became_peered":"2024-09-12T17:30:00.967299+0000","last_unstale":"2024-09-12T18:08:28.025164+0000","last_undegraded":"2024-09-12T18:08:28.025164+0000","last_fullsized":"2024-09-12T18:08:28.025164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:28.025075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:28.025075+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.025075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:03.790015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'94","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.406416+0000","last_change":"2024-09-12T18:08:45.406416+0000","last_active":"2024-09-12T18:08:45.406416+0000","last_peered":"2024-09-12T18:08:45.406416+0000","last_clean":"2024-09-12T18:08:45.406416+0000","last_became_active":"2024-09-12T17:30:02.965644+0000","last_became_peered":"2024-09-12T17:30:02.965644+0000","last_unstale":"2024-09-12T18:08:45.406416+0000","last_undegraded":"2024-09-12T18:08:45.406416+0000","last_fullsized":"2024-09-12T18:08:45.406416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'94","last_scrub_stamp":"2024-09-12T18:08:45.406309+0000","last_deep_scrub":"264'94","last_deep_scrub_stamp":"2024-09-12T18:08:45.406309+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.406309+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:51.501146+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":207,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'4299","reported_seq":4952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.123934+0000","last_change":"2024-09-12T18:08:18.123934+0000","last_active":"2024-09-12T18:08:18.123934+0000","last_peered":"2024-09-12T18:08:18.123934+0000","last_clean":"2024-09-12T18:08:18.123934+0000","last_became_active":"2024-09-12T17:29:54.950407+0000","last_became_peered":"2024-09-12T17:29:54.950407+0000","last_unstale":"2024-09-12T18:08:18.123934+0000","last_undegraded":"2024-09-12T18:08:18.123934+0000","last_fullsized":"2024-09-12T18:08:18.123934+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4299","last_scrub_stamp":"2024-09-12T18:08:18.123846+0000","last_deep_scrub":"264'4299","last_deep_scrub_stamp":"2024-09-12T18:08:18.123846+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.123846+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:58.856015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17237,"num_read_kb":14347,"num_write":6471,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'180","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.146524+0000","last_change":"2024-09-12T18:08:08.146470+0000","last_active":"2024-09-12T18:08:08.146524+0000","last_peered":"2024-09-12T18:08:08.146524+0000","last_clean":"2024-09-12T18:08:08.146524+0000","last_became_active":"2024-09-12T17:29:52.962836+0000","last_became_peered":"2024-09-12T17:29:52.962836+0000","last_unstale":"2024-09-12T18:08:08.146524+0000","last_undegraded":"2024-09-12T18:08:08.146524+0000","last_fullsized":"2024-09-12T18:08:08.146524+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T18:08:08.146374+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T18:08:08.146374+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.146374+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:03.930960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303959,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":45090,"num_write":889,"num_write_kb":58788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.009862+0000","last_change":"2024-09-12T18:08:25.009862+0000","last_active":"2024-09-12T18:08:25.009862+0000","last_peered":"2024-09-12T18:08:25.009862+0000","last_clean":"2024-09-12T18:08:25.009862+0000","last_became_active":"2024-09-12T17:29:56.957066+0000","last_became_peered":"2024-09-12T17:29:56.957066+0000","last_unstale":"2024-09-12T18:08:25.009862+0000","last_undegraded":"2024-09-12T18:08:25.009862+0000","last_fullsized":"2024-09-12T18:08:25.009862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.009761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.009761+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.009761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:29.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'156","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.895421+0000","last_change":"2024-09-12T18:08:34.895421+0000","last_active":"2024-09-12T18:08:34.895421+0000","last_peered":"2024-09-12T18:08:34.895421+0000","last_clean":"2024-09-12T18:08:34.895421+0000","last_became_active":"2024-09-12T17:29:58.955585+0000","last_became_peered":"2024-09-12T17:29:58.955585+0000","last_unstale":"2024-09-12T18:08:34.895421+0000","last_undegraded":"2024-09-12T18:08:34.895421+0000","last_fullsized":"2024-09-12T18:08:34.895421+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-12T18:08:34.895323+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-12T18:08:34.895323+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.895323+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:29.675628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7377,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":246,"num_write":102,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.258439+0000","last_change":"2024-09-12T18:08:37.258439+0000","last_active":"2024-09-12T18:08:37.258439+0000","last_peered":"2024-09-12T18:08:37.258439+0000","last_clean":"2024-09-12T18:08:37.258439+0000","last_became_active":"2024-09-12T17:30:00.964621+0000","last_became_peered":"2024-09-12T17:30:00.964621+0000","last_unstale":"2024-09-12T18:08:37.258439+0000","last_undegraded":"2024-09-12T18:08:37.258439+0000","last_fullsized":"2024-09-12T18:08:37.258439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:37.258356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:37.258356+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.258356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:26.246711+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'546","reported_seq":1352,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.122184+0000","last_change":"2024-09-12T18:08:20.122184+0000","last_active":"2024-09-12T18:08:20.122184+0000","last_peered":"2024-09-12T18:08:20.122184+0000","last_clean":"2024-09-12T18:08:20.122184+0000","last_became_active":"2024-09-12T17:29:54.958758+0000","last_became_peered":"2024-09-12T17:29:54.958758+0000","last_unstale":"2024-09-12T18:08:20.122184+0000","last_undegraded":"2024-09-12T18:08:20.122184+0000","last_fullsized":"2024-09-12T18:08:20.122184+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'546","last_scrub_stamp":"2024-09-12T18:08:20.122059+0000","last_deep_scrub":"264'546","last_deep_scrub_stamp":"2024-09-12T18:08:20.122059+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.122059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:18.469393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2571,"num_read_kb":2181,"num_write":951,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'212","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.316856+0000","last_change":"2024-09-12T18:08:13.316799+0000","last_active":"2024-09-12T18:08:13.316856+0000","last_peered":"2024-09-12T18:08:13.316856+0000","last_clean":"2024-09-12T18:08:13.316856+0000","last_became_active":"2024-09-12T17:30:28.007001+0000","last_became_peered":"2024-09-12T17:30:28.007001+0000","last_unstale":"2024-09-12T18:08:13.316856+0000","last_undegraded":"2024-09-12T18:08:13.316856+0000","last_fullsized":"2024-09-12T18:08:13.316856+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-12T18:08:13.316690+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-12T18:08:13.316690+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.316690+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:44.403007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":31262,"num_write":918,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.278158+0000","last_change":"2024-09-12T18:08:27.278158+0000","last_active":"2024-09-12T18:08:27.278158+0000","last_peered":"2024-09-12T18:08:27.278158+0000","last_clean":"2024-09-12T18:08:27.278158+0000","last_became_active":"2024-09-12T17:29:56.954498+0000","last_became_peered":"2024-09-12T17:29:56.954498+0000","last_unstale":"2024-09-12T18:08:27.278158+0000","last_undegraded":"2024-09-12T18:08:27.278158+0000","last_fullsized":"2024-09-12T18:08:27.278158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.278068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.278068+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.278068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:27.868992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'194","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.346927+0000","last_change":"2024-09-12T18:08:30.346927+0000","last_active":"2024-09-12T18:08:30.346927+0000","last_peered":"2024-09-12T18:08:30.346927+0000","last_clean":"2024-09-12T18:08:30.346927+0000","last_became_active":"2024-09-12T17:29:58.958198+0000","last_became_peered":"2024-09-12T17:29:58.958198+0000","last_unstale":"2024-09-12T18:08:30.346927+0000","last_undegraded":"2024-09-12T18:08:30.346927+0000","last_fullsized":"2024-09-12T18:08:30.346927+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'194","last_scrub_stamp":"2024-09-12T18:08:30.346829+0000","last_deep_scrub":"264'194","last_deep_scrub_stamp":"2024-09-12T18:08:30.346829+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.346829+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:10.264119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15825,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":439,"num_write":184,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.447811+0000","last_change":"2024-09-12T18:08:39.447811+0000","last_active":"2024-09-12T18:08:39.447811+0000","last_peered":"2024-09-12T18:08:39.447811+0000","last_clean":"2024-09-12T18:08:39.447811+0000","last_became_active":"2024-09-12T17:30:00.963706+0000","last_became_peered":"2024-09-12T17:30:00.963706+0000","last_unstale":"2024-09-12T18:08:39.447811+0000","last_undegraded":"2024-09-12T18:08:39.447811+0000","last_fullsized":"2024-09-12T18:08:39.447811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:39.447720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:39.447720+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.447720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:56.940712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'178","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.967851+0000","last_change":"2024-09-12T18:08:44.967851+0000","last_active":"2024-09-12T18:08:44.967851+0000","last_peered":"2024-09-12T18:08:44.967851+0000","last_clean":"2024-09-12T18:08:44.967851+0000","last_became_active":"2024-09-12T17:30:02.964682+0000","last_became_peered":"2024-09-12T17:30:02.964682+0000","last_unstale":"2024-09-12T18:08:44.967851+0000","last_undegraded":"2024-09-12T18:08:44.967851+0000","last_fullsized":"2024-09-12T18:08:44.967851+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-12T18:08:44.967764+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-12T18:08:44.967764+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.967764+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:57.259311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":239,"num_read_kb":250,"num_write":415,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'100","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.116313+0000","last_change":"2024-09-12T18:08:21.116313+0000","last_active":"2024-09-12T18:08:21.116313+0000","last_peered":"2024-09-12T18:08:21.116313+0000","last_clean":"2024-09-12T18:08:21.116313+0000","last_became_active":"2024-09-12T17:29:54.955326+0000","last_became_peered":"2024-09-12T17:29:54.955326+0000","last_unstale":"2024-09-12T18:08:21.116313+0000","last_undegraded":"2024-09-12T18:08:21.116313+0000","last_fullsized":"2024-09-12T18:08:21.116313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T18:08:21.116224+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T18:08:21.116224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.116224+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:01.095342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":334,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'221","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.279702+0000","last_change":"2024-09-12T18:08:12.279609+0000","last_active":"2024-09-12T18:08:12.279702+0000","last_peered":"2024-09-12T18:08:12.279702+0000","last_clean":"2024-09-12T18:08:12.279702+0000","last_became_active":"2024-09-12T17:29:52.945616+0000","last_became_peered":"2024-09-12T17:29:52.945616+0000","last_unstale":"2024-09-12T18:08:12.279702+0000","last_undegraded":"2024-09-12T18:08:12.279702+0000","last_fullsized":"2024-09-12T18:08:12.279702+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-12T18:08:12.279483+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-12T18:08:12.279483+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.279483+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:42.023356+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109585,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":523,"num_read_kb":15300,"num_write":1084,"num_write_kb":27395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.034592+0000","last_change":"2024-09-12T18:08:24.034592+0000","last_active":"2024-09-12T18:08:24.034592+0000","last_peered":"2024-09-12T18:08:24.034592+0000","last_clean":"2024-09-12T18:08:24.034592+0000","last_became_active":"2024-09-12T17:29:56.959047+0000","last_became_peered":"2024-09-12T17:29:56.959047+0000","last_unstale":"2024-09-12T18:08:24.034592+0000","last_undegraded":"2024-09-12T18:08:24.034592+0000","last_fullsized":"2024-09-12T18:08:24.034592+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:24.034504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:24.034504+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.034504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:19.769078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'153","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.955655+0000","last_change":"2024-09-12T18:08:38.955655+0000","last_active":"2024-09-12T18:08:38.955655+0000","last_peered":"2024-09-12T18:08:38.955655+0000","last_clean":"2024-09-12T18:08:38.955655+0000","last_became_active":"2024-09-12T17:29:58.954747+0000","last_became_peered":"2024-09-12T17:29:58.954747+0000","last_unstale":"2024-09-12T18:08:38.955655+0000","last_undegraded":"2024-09-12T18:08:38.955655+0000","last_fullsized":"2024-09-12T18:08:38.955655+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-12T18:08:38.955556+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-12T18:08:38.955556+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.955556+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:06.885028+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10649,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":195,"num_read_kb":252,"num_write":120,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.272855+0000","last_change":"2024-09-12T18:08:32.272855+0000","last_active":"2024-09-12T18:08:32.272855+0000","last_peered":"2024-09-12T18:08:32.272855+0000","last_clean":"2024-09-12T18:08:32.272855+0000","last_became_active":"2024-09-12T17:30:00.959708+0000","last_became_peered":"2024-09-12T17:30:00.959708+0000","last_unstale":"2024-09-12T18:08:32.272855+0000","last_undegraded":"2024-09-12T18:08:32.272855+0000","last_fullsized":"2024-09-12T18:08:32.272855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:32.272771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:32.272771+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.272771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:27.610493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'221","reported_seq":727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.989954+0000","last_change":"2024-09-12T18:08:32.989954+0000","last_active":"2024-09-12T18:08:32.989954+0000","last_peered":"2024-09-12T18:08:32.989954+0000","last_clean":"2024-09-12T18:08:32.989954+0000","last_became_active":"2024-09-12T17:30:02.960928+0000","last_became_peered":"2024-09-12T17:30:02.960928+0000","last_unstale":"2024-09-12T18:08:32.989954+0000","last_undegraded":"2024-09-12T18:08:32.989954+0000","last_fullsized":"2024-09-12T18:08:32.989954+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-12T18:08:32.989843+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-12T18:08:32.989843+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.989843+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:06.325021+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":219,"num_write":570,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'158","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.027630+0000","last_change":"2024-09-12T18:08:24.027630+0000","last_active":"2024-09-12T18:08:24.027630+0000","last_peered":"2024-09-12T18:08:24.027630+0000","last_clean":"2024-09-12T18:08:24.027630+0000","last_became_active":"2024-09-12T17:29:54.950294+0000","last_became_peered":"2024-09-12T17:29:54.950294+0000","last_unstale":"2024-09-12T18:08:24.027630+0000","last_undegraded":"2024-09-12T18:08:24.027630+0000","last_fullsized":"2024-09-12T18:08:24.027630+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'158","last_scrub_stamp":"2024-09-12T18:08:24.027548+0000","last_deep_scrub":"264'158","last_deep_scrub_stamp":"2024-09-12T18:08:24.027548+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.027548+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:58.664447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":567,"num_write":224,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'195","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.782806+0000","last_change":"2024-09-12T18:08:10.782806+0000","last_active":"2024-09-12T18:08:10.782806+0000","last_peered":"2024-09-12T18:08:10.782806+0000","last_clean":"2024-09-12T18:08:10.782806+0000","last_became_active":"2024-09-12T17:29:52.947363+0000","last_became_peered":"2024-09-12T17:29:52.947363+0000","last_unstale":"2024-09-12T18:08:10.782806+0000","last_undegraded":"2024-09-12T18:08:10.782806+0000","last_fullsized":"2024-09-12T18:08:10.782806+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T18:08:10.782711+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T18:08:10.782711+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.782711+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:11.562634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":129945,"num_write":977,"num_write_kb":26137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.800844+0000","last_change":"2024-09-12T18:08:30.800844+0000","last_active":"2024-09-12T18:08:30.800844+0000","last_peered":"2024-09-12T18:08:30.800844+0000","last_clean":"2024-09-12T18:08:30.800844+0000","last_became_active":"2024-09-12T17:29:56.951825+0000","last_became_peered":"2024-09-12T17:29:56.951825+0000","last_unstale":"2024-09-12T18:08:30.800844+0000","last_undegraded":"2024-09-12T18:08:30.800844+0000","last_fullsized":"2024-09-12T18:08:30.800844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:30.800714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:30.800714+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.800714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:41.916626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'137","reported_seq":710,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.880393+0000","last_change":"2024-09-12T18:08:36.880393+0000","last_active":"2024-09-12T18:08:36.880393+0000","last_peered":"2024-09-12T18:08:36.880393+0000","last_clean":"2024-09-12T18:08:36.880393+0000","last_became_active":"2024-09-12T17:29:58.978506+0000","last_became_peered":"2024-09-12T17:29:58.978506+0000","last_unstale":"2024-09-12T18:08:36.880393+0000","last_undegraded":"2024-09-12T18:08:36.880393+0000","last_fullsized":"2024-09-12T18:08:36.880393+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T18:08:36.880305+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T18:08:36.880305+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.880305+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:41.111977+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7433,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":163,"num_read_kb":221,"num_write":86,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.246856+0000","last_change":"2024-09-12T18:08:33.246856+0000","last_active":"2024-09-12T18:08:33.246856+0000","last_peered":"2024-09-12T18:08:33.246856+0000","last_clean":"2024-09-12T18:08:33.246856+0000","last_became_active":"2024-09-12T17:30:00.965628+0000","last_became_peered":"2024-09-12T17:30:00.965628+0000","last_unstale":"2024-09-12T18:08:33.246856+0000","last_undegraded":"2024-09-12T18:08:33.246856+0000","last_fullsized":"2024-09-12T18:08:33.246856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:33.246768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:33.246768+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.246768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:12.109698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'114","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.450871+0000","last_change":"2024-09-12T18:08:44.450871+0000","last_active":"2024-09-12T18:08:44.450871+0000","last_peered":"2024-09-12T18:08:44.450871+0000","last_clean":"2024-09-12T18:08:44.450871+0000","last_became_active":"2024-09-12T17:30:02.963242+0000","last_became_peered":"2024-09-12T17:30:02.963242+0000","last_unstale":"2024-09-12T18:08:44.450871+0000","last_undegraded":"2024-09-12T18:08:44.450871+0000","last_fullsized":"2024-09-12T18:08:44.450871+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-12T18:08:44.450782+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-12T18:08:44.450782+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.450782+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:52.905420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'168","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.408456+0000","last_change":"2024-09-12T18:08:17.408456+0000","last_active":"2024-09-12T18:08:17.408456+0000","last_peered":"2024-09-12T18:08:17.408456+0000","last_clean":"2024-09-12T18:08:17.408456+0000","last_became_active":"2024-09-12T17:29:54.950429+0000","last_became_peered":"2024-09-12T17:29:54.950429+0000","last_unstale":"2024-09-12T18:08:17.408456+0000","last_undegraded":"2024-09-12T18:08:17.408456+0000","last_fullsized":"2024-09-12T18:08:17.408456+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-12T18:08:17.408371+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-12T18:08:17.408371+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.408371+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:54.397921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":726,"num_read_kb":598,"num_write":255,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'195","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.186496+0000","last_change":"2024-09-12T18:08:10.186496+0000","last_active":"2024-09-12T18:08:10.186496+0000","last_peered":"2024-09-12T18:08:10.186496+0000","last_clean":"2024-09-12T18:08:10.186496+0000","last_became_active":"2024-09-12T17:29:52.966561+0000","last_became_peered":"2024-09-12T17:29:52.966561+0000","last_unstale":"2024-09-12T18:08:10.186496+0000","last_undegraded":"2024-09-12T18:08:10.186496+0000","last_fullsized":"2024-09-12T18:08:10.186496+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T18:08:10.186388+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T18:08:10.186388+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.186388+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:55.665607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":24994,"num_write":951,"num_write_kb":31573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.295158+0000","last_change":"2024-09-12T18:08:27.295158+0000","last_active":"2024-09-12T18:08:27.295158+0000","last_peered":"2024-09-12T18:08:27.295158+0000","last_clean":"2024-09-12T18:08:27.295158+0000","last_became_active":"2024-09-12T17:29:56.959185+0000","last_became_peered":"2024-09-12T17:29:56.959185+0000","last_unstale":"2024-09-12T18:08:27.295158+0000","last_undegraded":"2024-09-12T18:08:27.295158+0000","last_fullsized":"2024-09-12T18:08:27.295158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.295061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.295061+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.295061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:11.612594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'66","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.823689+0000","last_change":"2024-09-12T18:08:32.823689+0000","last_active":"2024-09-12T18:08:32.823689+0000","last_peered":"2024-09-12T18:08:32.823689+0000","last_clean":"2024-09-12T18:08:32.823689+0000","last_became_active":"2024-09-12T17:29:58.978247+0000","last_became_peered":"2024-09-12T17:29:58.978247+0000","last_unstale":"2024-09-12T18:08:32.823689+0000","last_undegraded":"2024-09-12T18:08:32.823689+0000","last_fullsized":"2024-09-12T18:08:32.823689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-12T18:08:32.823591+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-12T18:08:32.823591+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.823591+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:19.158862+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":59,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'759","reported_seq":2193,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.983428+0000","last_change":"2024-09-12T18:08:30.983428+0000","last_active":"2024-09-12T18:08:30.983428+0000","last_peered":"2024-09-12T18:08:30.983428+0000","last_clean":"2024-09-12T18:08:30.983428+0000","last_became_active":"2024-09-12T17:30:00.961928+0000","last_became_peered":"2024-09-12T17:30:00.961928+0000","last_unstale":"2024-09-12T18:08:30.983428+0000","last_undegraded":"2024-09-12T18:08:30.983428+0000","last_fullsized":"2024-09-12T18:08:30.983428+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'759","last_scrub_stamp":"2024-09-12T18:08:30.983344+0000","last_deep_scrub":"264'759","last_deep_scrub_stamp":"2024-09-12T18:08:30.983344+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.983344+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:19.296324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'103","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.027212+0000","last_change":"2024-09-12T18:08:43.027212+0000","last_active":"2024-09-12T18:08:43.027212+0000","last_peered":"2024-09-12T18:08:43.027212+0000","last_clean":"2024-09-12T18:08:43.027212+0000","last_became_active":"2024-09-12T17:30:02.963474+0000","last_became_peered":"2024-09-12T17:30:02.963474+0000","last_unstale":"2024-09-12T18:08:43.027212+0000","last_undegraded":"2024-09-12T18:08:43.027212+0000","last_fullsized":"2024-09-12T18:08:43.027212+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'103","last_scrub_stamp":"2024-09-12T18:08:43.027123+0000","last_deep_scrub":"264'103","last_deep_scrub_stamp":"2024-09-12T18:08:43.027123+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.027123+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:42.051090+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'463","reported_seq":1195,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.709763+0000","last_change":"2024-09-12T18:08:19.709763+0000","last_active":"2024-09-12T18:08:19.709763+0000","last_peered":"2024-09-12T18:08:19.709763+0000","last_clean":"2024-09-12T18:08:19.709763+0000","last_became_active":"2024-09-12T17:29:54.954344+0000","last_became_peered":"2024-09-12T17:29:54.954344+0000","last_unstale":"2024-09-12T18:08:19.709763+0000","last_undegraded":"2024-09-12T18:08:19.709763+0000","last_fullsized":"2024-09-12T18:08:19.709763+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'463","last_scrub_stamp":"2024-09-12T18:08:19.709661+0000","last_deep_scrub":"264'463","last_deep_scrub_stamp":"2024-09-12T18:08:19.709661+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.709661+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:54.883418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":1813,"num_write":696,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25964,"num_omap_keys":102,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'216","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.485347+0000","last_change":"2024-09-12T18:08:13.485347+0000","last_active":"2024-09-12T18:08:13.485347+0000","last_peered":"2024-09-12T18:08:13.485347+0000","last_clean":"2024-09-12T18:08:13.485347+0000","last_became_active":"2024-09-12T17:30:28.008012+0000","last_became_peered":"2024-09-12T17:30:28.008012+0000","last_unstale":"2024-09-12T18:08:13.485347+0000","last_undegraded":"2024-09-12T18:08:13.485347+0000","last_fullsized":"2024-09-12T18:08:13.485347+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'216","last_scrub_stamp":"2024-09-12T18:08:13.485242+0000","last_deep_scrub":"264'216","last_deep_scrub_stamp":"2024-09-12T18:08:13.485242+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.485242+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.011332+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395846,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":11221,"num_write":1057,"num_write_kb":38249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.839996+0000","last_change":"2024-09-12T18:08:30.839996+0000","last_active":"2024-09-12T18:08:30.839996+0000","last_peered":"2024-09-12T18:08:30.839996+0000","last_clean":"2024-09-12T18:08:30.839996+0000","last_became_active":"2024-09-12T17:29:56.959496+0000","last_became_peered":"2024-09-12T17:29:56.959496+0000","last_unstale":"2024-09-12T18:08:30.839996+0000","last_undegraded":"2024-09-12T18:08:30.839996+0000","last_fullsized":"2024-09-12T18:08:30.839996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:30.839903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:30.839903+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.839903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:30.580080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'152","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.526860+0000","last_change":"2024-09-12T18:08:37.526801+0000","last_active":"2024-09-12T18:08:37.526860+0000","last_peered":"2024-09-12T18:08:37.526860+0000","last_clean":"2024-09-12T18:08:37.526860+0000","last_became_active":"2024-09-12T17:29:58.956214+0000","last_became_peered":"2024-09-12T17:29:58.956214+0000","last_unstale":"2024-09-12T18:08:37.526860+0000","last_undegraded":"2024-09-12T18:08:37.526860+0000","last_fullsized":"2024-09-12T18:08:37.526860+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-12T18:08:37.526690+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-12T18:08:37.526690+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.526690+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:57.107449+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7681,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":254,"num_write":108,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.269003+0000","last_change":"2024-09-12T18:08:38.268913+0000","last_active":"2024-09-12T18:08:38.269003+0000","last_peered":"2024-09-12T18:08:38.269003+0000","last_clean":"2024-09-12T18:08:38.269003+0000","last_became_active":"2024-09-12T17:30:00.964150+0000","last_became_peered":"2024-09-12T17:30:00.964150+0000","last_unstale":"2024-09-12T18:08:38.269003+0000","last_undegraded":"2024-09-12T18:08:38.269003+0000","last_fullsized":"2024-09-12T18:08:38.269003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:38.268825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:38.268825+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.268825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:00.721111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'179","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.027153+0000","last_change":"2024-09-12T18:08:45.027153+0000","last_active":"2024-09-12T18:08:45.027153+0000","last_peered":"2024-09-12T18:08:45.027153+0000","last_clean":"2024-09-12T18:08:45.027153+0000","last_became_active":"2024-09-12T17:30:02.972420+0000","last_became_peered":"2024-09-12T17:30:02.972420+0000","last_unstale":"2024-09-12T18:08:45.027153+0000","last_undegraded":"2024-09-12T18:08:45.027153+0000","last_fullsized":"2024-09-12T18:08:45.027153+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:08:45.027042+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:08:45.027042+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.027042+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:43.808824+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":302,"num_write":451,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'323","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.712424+0000","last_change":"2024-09-12T18:08:18.712424+0000","last_active":"2024-09-12T18:08:18.712424+0000","last_peered":"2024-09-12T18:08:18.712424+0000","last_clean":"2024-09-12T18:08:18.712424+0000","last_became_active":"2024-09-12T17:29:54.953626+0000","last_became_peered":"2024-09-12T17:29:54.953626+0000","last_unstale":"2024-09-12T18:08:18.712424+0000","last_undegraded":"2024-09-12T18:08:18.712424+0000","last_fullsized":"2024-09-12T18:08:18.712424+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-12T18:08:18.712342+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-12T18:08:18.712342+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.712342+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:25.450466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1393,"num_read_kb":1115,"num_write":522,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'171","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.435392+0000","last_change":"2024-09-12T18:08:14.435392+0000","last_active":"2024-09-12T18:08:14.435392+0000","last_peered":"2024-09-12T18:08:14.435392+0000","last_clean":"2024-09-12T18:08:14.435392+0000","last_became_active":"2024-09-12T17:30:28.200981+0000","last_became_peered":"2024-09-12T17:30:28.200981+0000","last_unstale":"2024-09-12T18:08:14.435392+0000","last_undegraded":"2024-09-12T18:08:14.435392+0000","last_fullsized":"2024-09-12T18:08:14.435392+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T18:08:14.435270+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T18:08:14.435270+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.435270+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:50.031909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755684,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":377,"num_read_kb":41427,"num_write":835,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.468324+0000","last_change":"2024-09-12T18:08:35.468324+0000","last_active":"2024-09-12T18:08:35.468324+0000","last_peered":"2024-09-12T18:08:35.468324+0000","last_clean":"2024-09-12T18:08:35.468324+0000","last_became_active":"2024-09-12T17:29:56.955532+0000","last_became_peered":"2024-09-12T17:29:56.955532+0000","last_unstale":"2024-09-12T18:08:35.468324+0000","last_undegraded":"2024-09-12T18:08:35.468324+0000","last_fullsized":"2024-09-12T18:08:35.468324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:35.468227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:35.468227+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.468227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:04.731076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'126","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.252600+0000","last_change":"2024-09-12T18:08:32.252524+0000","last_active":"2024-09-12T18:08:32.252600+0000","last_peered":"2024-09-12T18:08:32.252600+0000","last_clean":"2024-09-12T18:08:32.252600+0000","last_became_active":"2024-09-12T17:29:58.960733+0000","last_became_peered":"2024-09-12T17:29:58.960733+0000","last_unstale":"2024-09-12T18:08:32.252600+0000","last_undegraded":"2024-09-12T18:08:32.252600+0000","last_fullsized":"2024-09-12T18:08:32.252600+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-12T18:08:32.252437+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-12T18:08:32.252437+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.252437+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:58.278526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9021,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":245,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.965813+0000","last_change":"2024-09-12T18:08:29.965744+0000","last_active":"2024-09-12T18:08:29.965813+0000","last_peered":"2024-09-12T18:08:29.965813+0000","last_clean":"2024-09-12T18:08:29.965813+0000","last_became_active":"2024-09-12T17:30:00.960358+0000","last_became_peered":"2024-09-12T17:30:00.960358+0000","last_unstale":"2024-09-12T18:08:29.965813+0000","last_undegraded":"2024-09-12T18:08:29.965813+0000","last_fullsized":"2024-09-12T18:08:29.965813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:29.965658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:29.965658+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.965658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:13.910376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'158","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.885318+0000","last_change":"2024-09-12T18:08:46.885318+0000","last_active":"2024-09-12T18:08:46.885318+0000","last_peered":"2024-09-12T18:08:46.885318+0000","last_clean":"2024-09-12T18:08:46.885318+0000","last_became_active":"2024-09-12T17:30:02.964082+0000","last_became_peered":"2024-09-12T17:30:02.964082+0000","last_unstale":"2024-09-12T18:08:46.885318+0000","last_undegraded":"2024-09-12T18:08:46.885318+0000","last_fullsized":"2024-09-12T18:08:46.885318+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'158","last_scrub_stamp":"2024-09-12T18:08:46.885228+0000","last_deep_scrub":"264'158","last_deep_scrub_stamp":"2024-09-12T18:08:46.885228+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.885228+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:11.849194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":313,"num_read_kb":292,"num_write":397,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'220","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.029703+0000","last_change":"2024-09-12T18:08:22.029640+0000","last_active":"2024-09-12T18:08:22.029703+0000","last_peered":"2024-09-12T18:08:22.029703+0000","last_clean":"2024-09-12T18:08:22.029703+0000","last_became_active":"2024-09-12T17:29:54.945602+0000","last_became_peered":"2024-09-12T17:29:54.945602+0000","last_unstale":"2024-09-12T18:08:22.029703+0000","last_undegraded":"2024-09-12T18:08:22.029703+0000","last_fullsized":"2024-09-12T18:08:22.029703+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-09-12T18:08:22.029561+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-09-12T18:08:22.029561+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.029561+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:33.368230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":778,"num_write":336,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'201","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.016294+0000","last_change":"2024-09-12T18:08:11.016294+0000","last_active":"2024-09-12T18:08:11.016294+0000","last_peered":"2024-09-12T18:08:11.016294+0000","last_clean":"2024-09-12T18:08:11.016294+0000","last_became_active":"2024-09-12T17:29:52.954457+0000","last_became_peered":"2024-09-12T17:29:52.954457+0000","last_unstale":"2024-09-12T18:08:11.016294+0000","last_undegraded":"2024-09-12T18:08:11.016294+0000","last_fullsized":"2024-09-12T18:08:11.016294+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-12T18:08:11.016216+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-12T18:08:11.016216+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.016216+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:39.597855+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":114782,"num_write":980,"num_write_kb":45150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.819088+0000","last_change":"2024-09-12T18:08:29.819020+0000","last_active":"2024-09-12T18:08:29.819088+0000","last_peered":"2024-09-12T18:08:29.819088+0000","last_clean":"2024-09-12T18:08:29.819088+0000","last_became_active":"2024-09-12T17:29:56.952946+0000","last_became_peered":"2024-09-12T17:29:56.952946+0000","last_unstale":"2024-09-12T18:08:29.819088+0000","last_undegraded":"2024-09-12T18:08:29.819088+0000","last_fullsized":"2024-09-12T18:08:29.819088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:29.818910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:29.818910+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.818910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:38.285964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'107","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.857386+0000","last_change":"2024-09-12T18:08:35.857386+0000","last_active":"2024-09-12T18:08:35.857386+0000","last_peered":"2024-09-12T18:08:35.857386+0000","last_clean":"2024-09-12T18:08:35.857386+0000","last_became_active":"2024-09-12T17:29:58.953283+0000","last_became_peered":"2024-09-12T17:29:58.953283+0000","last_unstale":"2024-09-12T18:08:35.857386+0000","last_undegraded":"2024-09-12T18:08:35.857386+0000","last_fullsized":"2024-09-12T18:08:35.857386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-12T18:08:35.857292+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-12T18:08:35.857292+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.857292+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:41.329996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":172,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.730107+0000","last_change":"2024-09-12T18:08:41.730107+0000","last_active":"2024-09-12T18:08:41.730107+0000","last_peered":"2024-09-12T18:08:41.730107+0000","last_clean":"2024-09-12T18:08:41.730107+0000","last_became_active":"2024-09-12T17:30:00.962703+0000","last_became_peered":"2024-09-12T17:30:00.962703+0000","last_unstale":"2024-09-12T18:08:41.730107+0000","last_undegraded":"2024-09-12T18:08:41.730107+0000","last_fullsized":"2024-09-12T18:08:41.730107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:41.730016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:41.730016+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.730016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:48.884526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'187","reported_seq":1652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.024563+0000","last_change":"2024-09-12T18:08:44.024496+0000","last_active":"2024-09-12T18:08:44.024563+0000","last_peered":"2024-09-12T18:08:44.024563+0000","last_clean":"2024-09-12T18:08:44.024563+0000","last_became_active":"2024-09-12T17:30:02.970633+0000","last_became_peered":"2024-09-12T17:30:02.970633+0000","last_unstale":"2024-09-12T18:08:44.024563+0000","last_undegraded":"2024-09-12T18:08:44.024563+0000","last_fullsized":"2024-09-12T18:08:44.024563+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-12T18:08:44.024393+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-12T18:08:44.024393+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.024393+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:31.627824+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1219,"num_read_kb":1215,"num_write":406,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'174","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.696868+0000","last_change":"2024-09-12T18:08:17.696777+0000","last_active":"2024-09-12T18:08:17.696868+0000","last_peered":"2024-09-12T18:08:17.696868+0000","last_clean":"2024-09-12T18:08:17.696868+0000","last_became_active":"2024-09-12T17:29:54.954585+0000","last_became_peered":"2024-09-12T17:29:54.954585+0000","last_unstale":"2024-09-12T18:08:17.696868+0000","last_undegraded":"2024-09-12T18:08:17.696868+0000","last_fullsized":"2024-09-12T18:08:17.696868+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:08:17.696671+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:08:17.696671+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.696671+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:23.668390+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":606,"num_write":278,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'199","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.144279+0000","last_change":"2024-09-12T18:08:11.144279+0000","last_active":"2024-09-12T18:08:11.144279+0000","last_peered":"2024-09-12T18:08:11.144279+0000","last_clean":"2024-09-12T18:08:11.144279+0000","last_became_active":"2024-09-12T17:29:52.956621+0000","last_became_peered":"2024-09-12T17:29:52.956621+0000","last_unstale":"2024-09-12T18:08:11.144279+0000","last_undegraded":"2024-09-12T18:08:11.144279+0000","last_fullsized":"2024-09-12T18:08:11.144279+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-12T18:08:11.144146+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-12T18:08:11.144146+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.144146+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:24.182892+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3104916,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":909,"num_read_kb":17688,"num_write":1020,"num_write_kb":27781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.296375+0000","last_change":"2024-09-12T18:08:26.296277+0000","last_active":"2024-09-12T18:08:26.296375+0000","last_peered":"2024-09-12T18:08:26.296375+0000","last_clean":"2024-09-12T18:08:26.296375+0000","last_became_active":"2024-09-12T17:29:56.954952+0000","last_became_peered":"2024-09-12T17:29:56.954952+0000","last_unstale":"2024-09-12T18:08:26.296375+0000","last_undegraded":"2024-09-12T18:08:26.296375+0000","last_fullsized":"2024-09-12T18:08:26.296375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:26.296172+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:26.296172+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.296172+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:56.807921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'142","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.785541+0000","last_change":"2024-09-12T18:08:39.785541+0000","last_active":"2024-09-12T18:08:39.785541+0000","last_peered":"2024-09-12T18:08:39.785541+0000","last_clean":"2024-09-12T18:08:39.785541+0000","last_became_active":"2024-09-12T17:29:58.953076+0000","last_became_peered":"2024-09-12T17:29:58.953076+0000","last_unstale":"2024-09-12T18:08:39.785541+0000","last_undegraded":"2024-09-12T18:08:39.785541+0000","last_fullsized":"2024-09-12T18:08:39.785541+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:08:39.785415+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:08:39.785415+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.785415+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:34.382114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9014,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":204,"num_read_kb":286,"num_write":112,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.259752+0000","last_change":"2024-09-12T18:08:39.259752+0000","last_active":"2024-09-12T18:08:39.259752+0000","last_peered":"2024-09-12T18:08:39.259752+0000","last_clean":"2024-09-12T18:08:39.259752+0000","last_became_active":"2024-09-12T17:30:00.964942+0000","last_became_peered":"2024-09-12T17:30:00.964942+0000","last_unstale":"2024-09-12T18:08:39.259752+0000","last_undegraded":"2024-09-12T18:08:39.259752+0000","last_fullsized":"2024-09-12T18:08:39.259752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:39.259657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:39.259657+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.259657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:46.708226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'118","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.790668+0000","last_change":"2024-09-12T18:08:38.790668+0000","last_active":"2024-09-12T18:08:38.790668+0000","last_peered":"2024-09-12T18:08:38.790668+0000","last_clean":"2024-09-12T18:08:38.790668+0000","last_became_active":"2024-09-12T17:30:02.969327+0000","last_became_peered":"2024-09-12T17:30:02.969327+0000","last_unstale":"2024-09-12T18:08:38.790668+0000","last_undegraded":"2024-09-12T18:08:38.790668+0000","last_fullsized":"2024-09-12T18:08:38.790668+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-12T18:08:38.790589+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-12T18:08:38.790589+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.790589+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:45.940956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":150,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'198","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.318630+0000","last_change":"2024-09-12T18:08:23.318566+0000","last_active":"2024-09-12T18:08:23.318630+0000","last_peered":"2024-09-12T18:08:23.318630+0000","last_clean":"2024-09-12T18:08:23.318630+0000","last_became_active":"2024-09-12T17:29:54.956020+0000","last_became_peered":"2024-09-12T17:29:54.956020+0000","last_unstale":"2024-09-12T18:08:23.318630+0000","last_undegraded":"2024-09-12T18:08:23.318630+0000","last_fullsized":"2024-09-12T18:08:23.318630+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'198","last_scrub_stamp":"2024-09-12T18:08:23.318478+0000","last_deep_scrub":"264'198","last_deep_scrub_stamp":"2024-09-12T18:08:23.318478+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.318478+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:06.926356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":702,"num_write":286,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'210","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.023692+0000","last_change":"2024-09-12T18:08:13.023692+0000","last_active":"2024-09-12T18:08:13.023692+0000","last_peered":"2024-09-12T18:08:13.023692+0000","last_clean":"2024-09-12T18:08:13.023692+0000","last_became_active":"2024-09-12T17:29:52.963118+0000","last_became_peered":"2024-09-12T17:29:52.963118+0000","last_unstale":"2024-09-12T18:08:13.023692+0000","last_undegraded":"2024-09-12T18:08:13.023692+0000","last_fullsized":"2024-09-12T18:08:13.023692+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-12T18:08:13.023594+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-12T18:08:13.023594+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.023594+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.908176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":444,"num_read_kb":2786,"num_write":996,"num_write_kb":44194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'222","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.295599+0000","last_change":"2024-09-12T18:08:22.295537+0000","last_active":"2024-09-12T18:08:22.295599+0000","last_peered":"2024-09-12T18:08:22.295599+0000","last_clean":"2024-09-12T18:08:22.295599+0000","last_became_active":"2024-09-12T17:29:54.947659+0000","last_became_peered":"2024-09-12T17:29:54.947659+0000","last_unstale":"2024-09-12T18:08:22.295599+0000","last_undegraded":"2024-09-12T18:08:22.295599+0000","last_fullsized":"2024-09-12T18:08:22.295599+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-09-12T18:08:22.295452+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-09-12T18:08:22.295452+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.295452+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.342588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":954,"num_read_kb":780,"num_write":336,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'187","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.321394+0000","last_change":"2024-09-12T18:08:12.321394+0000","last_active":"2024-09-12T18:08:12.321394+0000","last_peered":"2024-09-12T18:08:12.321394+0000","last_clean":"2024-09-12T18:08:12.321394+0000","last_became_active":"2024-09-12T17:29:52.955546+0000","last_became_peered":"2024-09-12T17:29:52.955546+0000","last_unstale":"2024-09-12T18:08:12.321394+0000","last_undegraded":"2024-09-12T18:08:12.321394+0000","last_fullsized":"2024-09-12T18:08:12.321394+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-12T18:08:12.321242+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-12T18:08:12.321242+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.321242+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:11.147772+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5712374,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":628,"num_read_kb":171668,"num_write":902,"num_write_kb":49213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'156","reported_seq":726,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.439895+0000","last_change":"2024-09-12T18:08:26.439837+0000","last_active":"2024-09-12T18:08:26.439895+0000","last_peered":"2024-09-12T18:08:26.439895+0000","last_clean":"2024-09-12T18:08:26.439895+0000","last_became_active":"2024-09-12T17:29:54.958047+0000","last_became_peered":"2024-09-12T17:29:54.958047+0000","last_unstale":"2024-09-12T18:08:26.439895+0000","last_undegraded":"2024-09-12T18:08:26.439895+0000","last_fullsized":"2024-09-12T18:08:26.439895+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-12T18:08:26.439752+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-12T18:08:26.439752+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.439752+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:46.015233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":718,"num_read_kb":592,"num_write":271,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'177","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.466300+0000","last_change":"2024-09-12T18:08:16.466300+0000","last_active":"2024-09-12T18:08:16.466300+0000","last_peered":"2024-09-12T18:08:16.466300+0000","last_clean":"2024-09-12T18:08:16.466300+0000","last_became_active":"2024-09-12T17:29:52.955924+0000","last_became_peered":"2024-09-12T17:29:52.955924+0000","last_unstale":"2024-09-12T18:08:16.466300+0000","last_undegraded":"2024-09-12T18:08:16.466300+0000","last_fullsized":"2024-09-12T18:08:16.466300+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:08:16.466188+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:08:16.466188+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.466188+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:45.623269+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4131368,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":446,"num_read_kb":86465,"num_write":876,"num_write_kb":34463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'67","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.278272+0000","last_change":"2024-09-12T18:08:20.278214+0000","last_active":"2024-09-12T18:08:20.278272+0000","last_peered":"2024-09-12T18:08:20.278272+0000","last_clean":"2024-09-12T18:08:20.278272+0000","last_became_active":"2024-09-12T17:29:54.956587+0000","last_became_peered":"2024-09-12T17:29:54.956587+0000","last_unstale":"2024-09-12T18:08:20.278272+0000","last_undegraded":"2024-09-12T18:08:20.278272+0000","last_fullsized":"2024-09-12T18:08:20.278272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-09-12T18:08:20.278133+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-09-12T18:08:20.278133+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.278133+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:53.896456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":238,"num_write":111,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'195","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.116624+0000","last_change":"2024-09-12T18:08:12.116624+0000","last_active":"2024-09-12T18:08:12.116624+0000","last_peered":"2024-09-12T18:08:12.116624+0000","last_clean":"2024-09-12T18:08:12.116624+0000","last_became_active":"2024-09-12T17:29:52.961103+0000","last_became_peered":"2024-09-12T17:29:52.961103+0000","last_unstale":"2024-09-12T18:08:12.116624+0000","last_undegraded":"2024-09-12T18:08:12.116624+0000","last_fullsized":"2024-09-12T18:08:12.116624+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T18:08:12.116514+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T18:08:12.116514+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.116514+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:09.737301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":61034,"num_write":905,"num_write_kb":21974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'80","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.006108+0000","last_change":"2024-09-12T18:08:29.006108+0000","last_active":"2024-09-12T18:08:29.006108+0000","last_peered":"2024-09-12T18:08:29.006108+0000","last_clean":"2024-09-12T18:08:29.006108+0000","last_became_active":"2024-09-12T17:29:54.955986+0000","last_became_peered":"2024-09-12T17:29:54.955986+0000","last_unstale":"2024-09-12T18:08:29.006108+0000","last_undegraded":"2024-09-12T18:08:29.006108+0000","last_fullsized":"2024-09-12T18:08:29.006108+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'80","last_scrub_stamp":"2024-09-12T18:08:29.006010+0000","last_deep_scrub":"264'80","last_deep_scrub_stamp":"2024-09-12T18:08:29.006010+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.006010+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.958435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":303,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'242","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.385914+0000","last_change":"2024-09-12T18:08:16.385838+0000","last_active":"2024-09-12T18:08:16.385914+0000","last_peered":"2024-09-12T18:08:16.385914+0000","last_clean":"2024-09-12T18:08:16.385914+0000","last_became_active":"2024-09-12T17:31:28.509017+0000","last_became_peered":"2024-09-12T17:31:28.509017+0000","last_unstale":"2024-09-12T18:08:16.385914+0000","last_undegraded":"2024-09-12T18:08:16.385914+0000","last_fullsized":"2024-09-12T18:08:16.385914+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'242","last_scrub_stamp":"2024-09-12T18:08:16.385665+0000","last_deep_scrub":"264'242","last_deep_scrub_stamp":"2024-09-12T18:08:16.385665+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.385665+0000","objects_scrubbed":12,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:17.985445+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9316189,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":509,"num_read_kb":51273,"num_write":1111,"num_write_kb":73287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"264'52","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.707353+0000","last_change":"2024-09-12T18:08:20.707353+0000","last_active":"2024-09-12T18:08:20.707353+0000","last_peered":"2024-09-12T18:08:20.707353+0000","last_clean":"2024-09-12T18:08:20.707353+0000","last_became_active":"2024-09-12T17:29:54.957480+0000","last_became_peered":"2024-09-12T17:29:54.957480+0000","last_unstale":"2024-09-12T18:08:20.707353+0000","last_undegraded":"2024-09-12T18:08:20.707353+0000","last_fullsized":"2024-09-12T18:08:20.707353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-12T18:08:20.707268+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-12T18:08:20.707268+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.707268+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:31.235559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":218,"num_write":68,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'172","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.244662+0000","last_change":"2024-09-12T18:08:15.244570+0000","last_active":"2024-09-12T18:08:15.244662+0000","last_peered":"2024-09-12T18:08:15.244662+0000","last_clean":"2024-09-12T18:08:15.244662+0000","last_became_active":"2024-09-12T17:29:52.945750+0000","last_became_peered":"2024-09-12T17:29:52.945750+0000","last_unstale":"2024-09-12T18:08:15.244662+0000","last_undegraded":"2024-09-12T18:08:15.244662+0000","last_fullsized":"2024-09-12T18:08:15.244662+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'172","last_scrub_stamp":"2024-09-12T18:08:15.244411+0000","last_deep_scrub":"264'172","last_deep_scrub_stamp":"2024-09-12T18:08:15.244411+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.244411+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:04.460342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":408,"num_read_kb":12063,"num_write":843,"num_write_kb":23165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'78","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.070644+0000","last_change":"2024-09-12T18:08:23.070644+0000","last_active":"2024-09-12T18:08:23.070644+0000","last_peered":"2024-09-12T18:08:23.070644+0000","last_clean":"2024-09-12T18:08:23.070644+0000","last_became_active":"2024-09-12T17:29:54.949704+0000","last_became_peered":"2024-09-12T17:29:54.949704+0000","last_unstale":"2024-09-12T18:08:23.070644+0000","last_undegraded":"2024-09-12T18:08:23.070644+0000","last_fullsized":"2024-09-12T18:08:23.070644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-09-12T18:08:23.070551+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-09-12T18:08:23.070551+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.070551+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:51.197271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":312,"num_write":123,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'203","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.047478+0000","last_change":"2024-09-12T18:08:14.047419+0000","last_active":"2024-09-12T18:08:14.047478+0000","last_peered":"2024-09-12T18:08:14.047478+0000","last_clean":"2024-09-12T18:08:14.047478+0000","last_became_active":"2024-09-12T17:29:52.960336+0000","last_became_peered":"2024-09-12T17:29:52.960336+0000","last_unstale":"2024-09-12T18:08:14.047478+0000","last_undegraded":"2024-09-12T18:08:14.047478+0000","last_fullsized":"2024-09-12T18:08:14.047478+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-12T18:08:14.047306+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-12T18:08:14.047306+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.047306+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:01.929338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524427,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":45667,"num_write":962,"num_write_kb":42266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'76","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.108330+0000","last_change":"2024-09-12T18:08:21.108330+0000","last_active":"2024-09-12T18:08:21.108330+0000","last_peered":"2024-09-12T18:08:21.108330+0000","last_clean":"2024-09-12T18:08:21.108330+0000","last_became_active":"2024-09-12T17:29:54.956296+0000","last_became_peered":"2024-09-12T17:29:54.956296+0000","last_unstale":"2024-09-12T18:08:21.108330+0000","last_undegraded":"2024-09-12T18:08:21.108330+0000","last_fullsized":"2024-09-12T18:08:21.108330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'76","last_scrub_stamp":"2024-09-12T18:08:21.108246+0000","last_deep_scrub":"264'76","last_deep_scrub_stamp":"2024-09-12T18:08:21.108246+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.108246+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:09.120650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":291,"num_write":101,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'208","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.066330+0000","last_change":"2024-09-12T18:08:13.066221+0000","last_active":"2024-09-12T18:08:13.066330+0000","last_peered":"2024-09-12T18:08:13.066330+0000","last_clean":"2024-09-12T18:08:13.066330+0000","last_became_active":"2024-09-12T17:29:52.953110+0000","last_became_peered":"2024-09-12T17:29:52.953110+0000","last_unstale":"2024-09-12T18:08:13.066330+0000","last_undegraded":"2024-09-12T18:08:13.066330+0000","last_fullsized":"2024-09-12T18:08:13.066330+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T18:08:13.066097+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T18:08:13.066097+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.066097+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:34.052495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":64382,"num_write":937,"num_write_kb":39967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'142","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.133795+0000","last_change":"2024-09-12T18:08:22.133795+0000","last_active":"2024-09-12T18:08:22.133795+0000","last_peered":"2024-09-12T18:08:22.133795+0000","last_clean":"2024-09-12T18:08:22.133795+0000","last_became_active":"2024-09-12T17:29:54.944775+0000","last_became_peered":"2024-09-12T17:29:54.944775+0000","last_unstale":"2024-09-12T18:08:22.133795+0000","last_undegraded":"2024-09-12T18:08:22.133795+0000","last_fullsized":"2024-09-12T18:08:22.133795+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:08:22.133695+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:08:22.133695+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.133695+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:48.310100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":576,"num_read_kb":470,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'239","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.450127+0000","last_change":"2024-09-12T18:08:17.450063+0000","last_active":"2024-09-12T18:08:17.450127+0000","last_peered":"2024-09-12T18:08:17.450127+0000","last_clean":"2024-09-12T18:08:17.450127+0000","last_became_active":"2024-09-12T17:29:52.952892+0000","last_became_peered":"2024-09-12T17:29:52.952892+0000","last_unstale":"2024-09-12T18:08:17.450127+0000","last_undegraded":"2024-09-12T18:08:17.450127+0000","last_fullsized":"2024-09-12T18:08:17.450127+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'239","last_scrub_stamp":"2024-09-12T18:08:17.449925+0000","last_deep_scrub":"264'239","last_deep_scrub_stamp":"2024-09-12T18:08:17.449925+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.449925+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:31.739549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1423505,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":801,"num_read_kb":90532,"num_write":1295,"num_write_kb":28113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'4190","reported_seq":4824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.763924+0000","last_change":"2024-09-12T18:08:22.763924+0000","last_active":"2024-09-12T18:08:22.763924+0000","last_peered":"2024-09-12T18:08:22.763924+0000","last_clean":"2024-09-12T18:08:22.763924+0000","last_became_active":"2024-09-12T17:29:54.956030+0000","last_became_peered":"2024-09-12T17:29:54.956030+0000","last_unstale":"2024-09-12T18:08:22.763924+0000","last_undegraded":"2024-09-12T18:08:22.763924+0000","last_fullsized":"2024-09-12T18:08:22.763924+0000","mapping_epoch":26,"log_start":"264'4100","ondisk_log_start":"264'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4190","last_scrub_stamp":"2024-09-12T18:08:22.763830+0000","last_deep_scrub":"264'4190","last_deep_scrub_stamp":"2024-09-12T18:08:22.763830+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.763830+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":3000,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:13.600432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16971,"num_read_kb":14174,"num_write":6344,"num_write_kb":3204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'200","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.106345+0000","last_change":"2024-09-12T18:08:15.106345+0000","last_active":"2024-09-12T18:08:15.106345+0000","last_peered":"2024-09-12T18:08:15.106345+0000","last_clean":"2024-09-12T18:08:15.106345+0000","last_became_active":"2024-09-12T17:29:52.953694+0000","last_became_peered":"2024-09-12T17:29:52.953694+0000","last_unstale":"2024-09-12T18:08:15.106345+0000","last_undegraded":"2024-09-12T18:08:15.106345+0000","last_fullsized":"2024-09-12T18:08:15.106345+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-12T18:08:15.106190+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-12T18:08:15.106190+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.106190+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:05.110290+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174802,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":9241,"num_write":950,"num_write_kb":54194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'299","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.364780+0000","last_change":"2024-09-12T18:08:14.364687+0000","last_active":"2024-09-12T18:08:14.364780+0000","last_peered":"2024-09-12T18:08:14.364780+0000","last_clean":"2024-09-12T18:08:14.364780+0000","last_became_active":"2024-09-12T17:29:54.954593+0000","last_became_peered":"2024-09-12T17:29:54.954593+0000","last_unstale":"2024-09-12T18:08:14.364780+0000","last_undegraded":"2024-09-12T18:08:14.364780+0000","last_fullsized":"2024-09-12T18:08:14.364780+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T18:08:14.364594+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T18:08:14.364594+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.364594+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:32.644840+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1407,"num_read_kb":1154,"num_write":474,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4002,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'211","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.452953+0000","last_change":"2024-09-12T18:08:19.452953+0000","last_active":"2024-09-12T18:08:19.452953+0000","last_peered":"2024-09-12T18:08:19.452953+0000","last_clean":"2024-09-12T18:08:19.452953+0000","last_became_active":"2024-09-12T17:29:52.958021+0000","last_became_peered":"2024-09-12T17:29:52.958021+0000","last_unstale":"2024-09-12T18:08:19.452953+0000","last_undegraded":"2024-09-12T18:08:19.452953+0000","last_fullsized":"2024-09-12T18:08:19.452953+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-09-12T18:08:19.452849+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-09-12T18:08:19.452849+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.452849+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:37.690114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174726,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":543,"num_read_kb":26305,"num_write":962,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'301","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.724778+0000","last_change":"2024-09-12T18:08:21.724778+0000","last_active":"2024-09-12T18:08:21.724778+0000","last_peered":"2024-09-12T18:08:21.724778+0000","last_clean":"2024-09-12T18:08:21.724778+0000","last_became_active":"2024-09-12T17:29:54.957636+0000","last_became_peered":"2024-09-12T17:29:54.957636+0000","last_unstale":"2024-09-12T18:08:21.724778+0000","last_undegraded":"2024-09-12T18:08:21.724778+0000","last_fullsized":"2024-09-12T18:08:21.724778+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'301","last_scrub_stamp":"2024-09-12T18:08:21.724693+0000","last_deep_scrub":"264'301","last_deep_scrub_stamp":"2024-09-12T18:08:21.724693+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.724693+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:40.322921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1037,"num_write":475,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'227","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.129459+0000","last_change":"2024-09-12T18:08:13.129459+0000","last_active":"2024-09-12T18:08:13.129459+0000","last_peered":"2024-09-12T18:08:13.129459+0000","last_clean":"2024-09-12T18:08:13.129459+0000","last_became_active":"2024-09-12T17:29:52.966500+0000","last_became_peered":"2024-09-12T17:29:52.966500+0000","last_unstale":"2024-09-12T18:08:13.129459+0000","last_undegraded":"2024-09-12T18:08:13.129459+0000","last_fullsized":"2024-09-12T18:08:13.129459+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-09-12T18:08:13.129341+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-09-12T18:08:13.129341+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.129341+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:16.854387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254282,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":515,"num_read_kb":34941,"num_write":1118,"num_write_kb":28764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'173","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.802210+0000","last_change":"2024-09-12T18:08:24.802210+0000","last_active":"2024-09-12T18:08:24.802210+0000","last_peered":"2024-09-12T18:08:24.802210+0000","last_clean":"2024-09-12T18:08:24.802210+0000","last_became_active":"2024-09-12T17:30:28.010055+0000","last_became_peered":"2024-09-12T17:30:28.010055+0000","last_unstale":"2024-09-12T18:08:24.802210+0000","last_undegraded":"2024-09-12T18:08:24.802210+0000","last_fullsized":"2024-09-12T18:08:24.802210+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-12T18:08:24.802122+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-12T18:08:24.802122+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.802122+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:48.646433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":614,"num_write":281,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'200","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.071442+0000","last_change":"2024-09-12T18:08:15.071442+0000","last_active":"2024-09-12T18:08:15.071442+0000","last_peered":"2024-09-12T18:08:15.071442+0000","last_clean":"2024-09-12T18:08:15.071442+0000","last_became_active":"2024-09-12T17:29:52.954238+0000","last_became_peered":"2024-09-12T17:29:52.954238+0000","last_unstale":"2024-09-12T18:08:15.071442+0000","last_undegraded":"2024-09-12T18:08:15.071442+0000","last_fullsized":"2024-09-12T18:08:15.071442+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-12T18:08:15.071334+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-12T18:08:15.071334+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.071334+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:38.079896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":33290,"num_write":857,"num_write_kb":39696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'174","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.073348+0000","last_change":"2024-09-12T18:08:20.073348+0000","last_active":"2024-09-12T18:08:20.073348+0000","last_peered":"2024-09-12T18:08:20.073348+0000","last_clean":"2024-09-12T18:08:20.073348+0000","last_became_active":"2024-09-12T17:29:54.944623+0000","last_became_peered":"2024-09-12T17:29:54.944623+0000","last_unstale":"2024-09-12T18:08:20.073348+0000","last_undegraded":"2024-09-12T18:08:20.073348+0000","last_fullsized":"2024-09-12T18:08:20.073348+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:08:20.073256+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:08:20.073256+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.073256+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:47.502492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":587,"num_write":256,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'218","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.693029+0000","last_change":"2024-09-12T18:08:19.693029+0000","last_active":"2024-09-12T18:08:19.693029+0000","last_peered":"2024-09-12T18:08:19.693029+0000","last_clean":"2024-09-12T18:08:19.693029+0000","last_became_active":"2024-09-12T17:29:52.951819+0000","last_became_peered":"2024-09-12T17:29:52.951819+0000","last_unstale":"2024-09-12T18:08:19.693029+0000","last_undegraded":"2024-09-12T18:08:19.693029+0000","last_fullsized":"2024-09-12T18:08:19.693029+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-09-12T18:08:19.692857+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-09-12T18:08:19.692857+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.692857+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:00.897060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287564,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":4445,"num_write":1040,"num_write_kb":38455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'247","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.999378+0000","last_change":"2024-09-12T18:08:25.999378+0000","last_active":"2024-09-12T18:08:25.999378+0000","last_peered":"2024-09-12T18:08:25.999378+0000","last_clean":"2024-09-12T18:08:25.999378+0000","last_became_active":"2024-09-12T17:29:54.950941+0000","last_became_peered":"2024-09-12T17:29:54.950941+0000","last_unstale":"2024-09-12T18:08:25.999378+0000","last_undegraded":"2024-09-12T18:08:25.999378+0000","last_fullsized":"2024-09-12T18:08:25.999378+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'247","last_scrub_stamp":"2024-09-12T18:08:25.999284+0000","last_deep_scrub":"264'247","last_deep_scrub_stamp":"2024-09-12T18:08:25.999284+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.999284+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:39.073844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":842,"num_write":398,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'207","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.297209+0000","last_change":"2024-09-12T18:08:11.297209+0000","last_active":"2024-09-12T18:08:11.297209+0000","last_peered":"2024-09-12T18:08:11.297209+0000","last_clean":"2024-09-12T18:08:11.297209+0000","last_became_active":"2024-09-12T17:29:52.953569+0000","last_became_peered":"2024-09-12T17:29:52.953569+0000","last_unstale":"2024-09-12T18:08:11.297209+0000","last_undegraded":"2024-09-12T18:08:11.297209+0000","last_fullsized":"2024-09-12T18:08:11.297209+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:11.297114+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:11.297114+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.297114+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:20.913969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":380,"num_read_kb":11537,"num_write":1039,"num_write_kb":39628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'119","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.771411+0000","last_change":"2024-09-12T18:08:25.771285+0000","last_active":"2024-09-12T18:08:25.771411+0000","last_peered":"2024-09-12T18:08:25.771411+0000","last_clean":"2024-09-12T18:08:25.771411+0000","last_became_active":"2024-09-12T17:29:54.961615+0000","last_became_peered":"2024-09-12T17:29:54.961615+0000","last_unstale":"2024-09-12T18:08:25.771411+0000","last_undegraded":"2024-09-12T18:08:25.771411+0000","last_fullsized":"2024-09-12T18:08:25.771411+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T18:08:25.771192+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T18:08:25.771192+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.771192+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:13.593353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":544,"num_read_kb":456,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'264","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.495069+0000","last_change":"2024-09-12T18:08:18.495069+0000","last_active":"2024-09-12T18:08:18.495069+0000","last_peered":"2024-09-12T18:08:18.495069+0000","last_clean":"2024-09-12T18:08:18.495069+0000","last_became_active":"2024-09-12T17:29:52.954363+0000","last_became_peered":"2024-09-12T17:29:52.954363+0000","last_unstale":"2024-09-12T18:08:18.495069+0000","last_undegraded":"2024-09-12T18:08:18.495069+0000","last_fullsized":"2024-09-12T18:08:18.495069+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-09-12T18:08:18.494932+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-09-12T18:08:18.494932+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.494932+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:35.278309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505373,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":610,"num_read_kb":60789,"num_write":1183,"num_write_kb":24093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'153","reported_seq":763,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.506389+0000","last_change":"2024-09-12T18:08:21.506389+0000","last_active":"2024-09-12T18:08:21.506389+0000","last_peered":"2024-09-12T18:08:21.506389+0000","last_clean":"2024-09-12T18:08:21.506389+0000","last_became_active":"2024-09-12T17:29:52.952766+0000","last_became_peered":"2024-09-12T17:29:52.952766+0000","last_unstale":"2024-09-12T18:08:21.506389+0000","last_undegraded":"2024-09-12T18:08:21.506389+0000","last_fullsized":"2024-09-12T18:08:21.506389+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-12T18:08:21.506224+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-12T18:08:21.506224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.506224+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:00.437314+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847564,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":395,"num_read_kb":30421,"num_write":779,"num_write_kb":28733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'81","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.164730+0000","last_change":"2024-09-12T18:08:23.164635+0000","last_active":"2024-09-12T18:08:23.164730+0000","last_peered":"2024-09-12T18:08:23.164730+0000","last_clean":"2024-09-12T18:08:23.164730+0000","last_became_active":"2024-09-12T17:29:54.944681+0000","last_became_peered":"2024-09-12T17:29:54.944681+0000","last_unstale":"2024-09-12T18:08:23.164730+0000","last_undegraded":"2024-09-12T18:08:23.164730+0000","last_fullsized":"2024-09-12T18:08:23.164730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'81","last_scrub_stamp":"2024-09-12T18:08:23.164513+0000","last_deep_scrub":"264'81","last_deep_scrub_stamp":"2024-09-12T18:08:23.164513+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.164513+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:48.210606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":330,"num_write":124,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'186","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.243119+0000","last_change":"2024-09-12T18:08:13.243119+0000","last_active":"2024-09-12T18:08:13.243119+0000","last_peered":"2024-09-12T18:08:13.243119+0000","last_clean":"2024-09-12T18:08:13.243119+0000","last_became_active":"2024-09-12T17:29:52.942331+0000","last_became_peered":"2024-09-12T17:29:52.942331+0000","last_unstale":"2024-09-12T18:08:13.243119+0000","last_undegraded":"2024-09-12T18:08:13.243119+0000","last_fullsized":"2024-09-12T18:08:13.243119+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'186","last_scrub_stamp":"2024-09-12T18:08:13.242996+0000","last_deep_scrub":"264'186","last_deep_scrub_stamp":"2024-09-12T18:08:13.242996+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.242996+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:49.416924+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364835,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":15046,"num_write":966,"num_write_kb":38540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'194","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.396144+0000","last_change":"2024-09-12T18:08:27.396085+0000","last_active":"2024-09-12T18:08:27.396144+0000","last_peered":"2024-09-12T18:08:27.396144+0000","last_clean":"2024-09-12T18:08:27.396144+0000","last_became_active":"2024-09-12T17:29:54.962921+0000","last_became_peered":"2024-09-12T17:29:54.962921+0000","last_unstale":"2024-09-12T18:08:27.396144+0000","last_undegraded":"2024-09-12T18:08:27.396144+0000","last_fullsized":"2024-09-12T18:08:27.396144+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'194","last_scrub_stamp":"2024-09-12T18:08:27.396001+0000","last_deep_scrub":"264'194","last_deep_scrub_stamp":"2024-09-12T18:08:27.396001+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.396001+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:39.024494+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":851,"num_read_kb":702,"num_write":304,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":4389,"num_write":1992,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6482,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1065,"ondisk_log_size":1065,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":16199,"num_read_kb":15887,"num_write":16770,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2870,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1942,"ondisk_log_size":1942,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":499,"ondisk_log_size":499,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":279568,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7821,"num_read_kb":9826,"num_write":5191,"num_write_kb":2504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":677352,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2108,"ondisk_log_size":2108,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2870,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102452,"num_read_kb":85292,"num_write":37168,"num_write_kb":18720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44038,"num_omap_keys":180,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4239,"ondisk_log_size":4239,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":83899209,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":32969,"num_read_kb":2424206,"num_write":62978,"num_write_kb":2261412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127942656,"data_stored":127942656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4263,"ondisk_log_size":4263,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":207617,"num_write":161,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":201926,"num_write":161,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542624,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217944,"kb_used_data":10440,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94153896,"statfs":{"total":96636764160,"available":96413589504,"internally_reserved":0,"allocated":10690560,"data_stored":8703800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542623,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244176,"kb_used_data":20032,"kb_used_omap":1,"kb_used_meta":224126,"kb_avail":94127664,"statfs":{"total":96636764160,"available":96386727936,"internally_reserved":0,"allocated":20512768,"data_stored":18573799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":229505478},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542625,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122856,"kb_used_data":29272,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94248984,"statfs":{"total":96636764160,"available":96510959616,"internally_reserved":0,"allocated":29974528,"data_stored":27974659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542624,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93540,"kb_used_data":26260,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94278300,"statfs":{"total":96636764160,"available":96540979200,"internally_reserved":0,"allocated":26890240,"data_stored":24978624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542622,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249468,"kb_used_data":19756,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122372,"statfs":{"total":96636764160,"available":96381308928,"internally_reserved":0,"allocated":20230144,"data_stored":18248382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542623,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100664,"kb_used_data":15400,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94271176,"statfs":{"total":96636764160,"available":96533684224,"internally_reserved":0,"allocated":15769600,"data_stored":13844138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542624,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125220,"kb_used_data":13588,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94246620,"statfs":{"total":96636764160,"available":96508538880,"internally_reserved":0,"allocated":13914112,"data_stored":11951207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542623,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262484,"kb_used_data":24452,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94109356,"statfs":{"total":96636764160,"available":96367980544,"internally_reserved":0,"allocated":25038848,"data_stored":23061641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20193280,"data_stored":20193280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9674752,"data_stored":9674752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11567104,"data_stored":11567104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15970304,"data_stored":15970304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22704128,"data_stored":22704128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25698304,"data_stored":25698304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16297984,"data_stored":16297984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5836800,"data_stored":5836800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:09:11.739 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:56:59.438365+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=56, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:09:11.743 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:09:31.744 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:09:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-09-12T18:09:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-09-12T18:09:32.093 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":1455,"stamp":"2024-09-12T18:09:31.329188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84787076,"num_objects":562,"num_object_clones":0,"num_object_copies":1357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":562,"num_whiteouts":0,"num_read":168345,"num_read_kb":2952080,"num_write":124562,"num_write_kb":2564884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731870,"num_omap_keys":1795,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14426,"ondisk_log_size":14426,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1416352,"kb_used_data":159200,"kb_used_omap":12,"kb_used_meta":1257011,"kb_avail":753558368,"statfs":{"total":773094113280,"available":771643768832,"internally_reserved":0,"allocated":163020800,"data_stored":147336250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1287179826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004754"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:57.321813+0000","last_change":"2024-09-12T18:08:57.321732+0000","last_active":"2024-09-12T18:08:57.321813+0000","last_peered":"2024-09-12T18:08:57.321813+0000","last_clean":"2024-09-12T18:08:57.321813+0000","last_became_active":"2024-09-12T17:57:00.464331+0000","last_became_peered":"2024-09-12T17:57:00.464331+0000","last_unstale":"2024-09-12T18:08:57.321813+0000","last_undegraded":"2024-09-12T18:08:57.321813+0000","last_fullsized":"2024-09-12T18:08:57.321813+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:57.321603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:57.321603+0000","last_clean_scrub_stamp":"2024-09-12T18:08:57.321603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:26.113306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:53.387342+0000","last_change":"2024-09-12T18:08:53.387268+0000","last_active":"2024-09-12T18:08:53.387342+0000","last_peered":"2024-09-12T18:08:53.387342+0000","last_clean":"2024-09-12T18:08:53.387342+0000","last_became_active":"2024-09-12T17:46:45.211533+0000","last_became_peered":"2024-09-12T17:46:45.211533+0000","last_unstale":"2024-09-12T18:08:53.387342+0000","last_undegraded":"2024-09-12T18:08:53.387342+0000","last_fullsized":"2024-09-12T18:08:53.387342+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:53.387150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:53.387150+0000","last_clean_scrub_stamp":"2024-09-12T18:08:53.387150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:13.871491+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:56.067559+0000","last_change":"2024-09-12T18:08:56.067508+0000","last_active":"2024-09-12T18:08:56.067559+0000","last_peered":"2024-09-12T18:08:56.067559+0000","last_clean":"2024-09-12T18:08:56.067559+0000","last_became_active":"2024-09-12T17:46:42.179372+0000","last_became_peered":"2024-09-12T17:46:42.179372+0000","last_unstale":"2024-09-12T18:08:56.067559+0000","last_undegraded":"2024-09-12T18:08:56.067559+0000","last_fullsized":"2024-09-12T18:08:56.067559+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:56.067401+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:56.067401+0000","last_clean_scrub_stamp":"2024-09-12T18:08:56.067401+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:50.579623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6715,"num_write":5,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'32","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:52.351892+0000","last_change":"2024-09-12T18:08:52.351892+0000","last_active":"2024-09-12T18:08:52.351892+0000","last_peered":"2024-09-12T18:08:52.351892+0000","last_clean":"2024-09-12T18:08:52.351892+0000","last_became_active":"2024-09-12T17:45:03.890104+0000","last_became_peered":"2024-09-12T17:45:03.890104+0000","last_unstale":"2024-09-12T18:08:52.351892+0000","last_undegraded":"2024-09-12T18:08:52.351892+0000","last_fullsized":"2024-09-12T18:08:52.351892+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-12T18:08:52.351802+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-12T18:08:52.351802+0000","last_clean_scrub_stamp":"2024-09-12T18:08:52.351802+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:15.084091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":111,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.351533+0000","last_change":"2024-09-12T18:08:40.351466+0000","last_active":"2024-09-12T18:08:40.351533+0000","last_peered":"2024-09-12T18:08:40.351533+0000","last_clean":"2024-09-12T18:08:40.351533+0000","last_became_active":"2024-09-12T17:57:00.466304+0000","last_became_peered":"2024-09-12T17:57:00.466304+0000","last_unstale":"2024-09-12T18:08:40.351533+0000","last_undegraded":"2024-09-12T18:08:40.351533+0000","last_fullsized":"2024-09-12T18:08:40.351533+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:40.351382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:40.351382+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.351382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:41.320349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.636659+0000","last_change":"2024-09-12T18:08:54.636587+0000","last_active":"2024-09-12T18:08:54.636659+0000","last_peered":"2024-09-12T18:08:54.636659+0000","last_clean":"2024-09-12T18:08:54.636659+0000","last_became_active":"2024-09-12T17:46:45.202290+0000","last_became_peered":"2024-09-12T17:46:45.202290+0000","last_unstale":"2024-09-12T18:08:54.636659+0000","last_undegraded":"2024-09-12T18:08:54.636659+0000","last_fullsized":"2024-09-12T18:08:54.636659+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:54.636454+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:54.636454+0000","last_clean_scrub_stamp":"2024-09-12T18:08:54.636454+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:28.883428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'8","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.153336+0000","last_change":"2024-09-12T18:08:43.153255+0000","last_active":"2024-09-12T18:08:43.153336+0000","last_peered":"2024-09-12T18:08:43.153336+0000","last_clean":"2024-09-12T18:08:43.153336+0000","last_became_active":"2024-09-12T17:46:42.177112+0000","last_became_peered":"2024-09-12T17:46:42.177112+0000","last_unstale":"2024-09-12T18:08:43.153336+0000","last_undegraded":"2024-09-12T18:08:43.153336+0000","last_fullsized":"2024-09-12T18:08:43.153336+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:08:43.153171+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:08:43.153171+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.153171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:45.201159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10811,"num_write":18,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'16","reported_seq":95,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.424998+0000","last_change":"2024-09-12T18:08:31.424946+0000","last_active":"2024-09-12T18:08:31.424998+0000","last_peered":"2024-09-12T18:08:31.424998+0000","last_clean":"2024-09-12T18:08:31.424998+0000","last_became_active":"2024-09-12T17:45:03.893002+0000","last_became_peered":"2024-09-12T17:45:03.893002+0000","last_unstale":"2024-09-12T18:08:31.424998+0000","last_undegraded":"2024-09-12T18:08:31.424998+0000","last_fullsized":"2024-09-12T18:08:31.424998+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T18:08:31.424875+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T18:08:31.424875+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.424875+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:19.126454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.089939+0000","last_change":"2024-09-12T18:08:47.089855+0000","last_active":"2024-09-12T18:08:47.089939+0000","last_peered":"2024-09-12T18:08:47.089939+0000","last_clean":"2024-09-12T18:08:47.089939+0000","last_became_active":"2024-09-12T17:57:00.456939+0000","last_became_peered":"2024-09-12T17:57:00.456939+0000","last_unstale":"2024-09-12T18:08:47.089939+0000","last_undegraded":"2024-09-12T18:08:47.089939+0000","last_fullsized":"2024-09-12T18:08:47.089939+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:47.089763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:47.089763+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.089763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:55.749822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'10","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:01.381109+0000","last_change":"2024-09-12T18:09:01.381109+0000","last_active":"2024-09-12T18:09:01.381109+0000","last_peered":"2024-09-12T18:09:01.381109+0000","last_clean":"2024-09-12T18:09:01.381109+0000","last_became_active":"2024-09-12T17:46:45.536920+0000","last_became_peered":"2024-09-12T17:46:45.536920+0000","last_unstale":"2024-09-12T18:09:01.381109+0000","last_undegraded":"2024-09-12T18:09:01.381109+0000","last_fullsized":"2024-09-12T18:09:01.381109+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-12T18:09:01.380960+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-12T18:09:01.380960+0000","last_clean_scrub_stamp":"2024-09-12T18:09:01.380960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:00.858822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":15,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.367612+0000","last_change":"2024-09-12T18:08:36.367553+0000","last_active":"2024-09-12T18:08:36.367612+0000","last_peered":"2024-09-12T18:08:36.367612+0000","last_clean":"2024-09-12T18:08:36.367612+0000","last_became_active":"2024-09-12T17:46:42.185870+0000","last_became_peered":"2024-09-12T17:46:42.185870+0000","last_unstale":"2024-09-12T18:08:36.367612+0000","last_undegraded":"2024-09-12T18:08:36.367612+0000","last_fullsized":"2024-09-12T18:08:36.367612+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:36.367467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:36.367467+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.367467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:56.284371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'49","reported_seq":190,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:51.364900+0000","last_change":"2024-09-12T18:08:51.364900+0000","last_active":"2024-09-12T18:08:51.364900+0000","last_peered":"2024-09-12T18:08:51.364900+0000","last_clean":"2024-09-12T18:08:51.364900+0000","last_became_active":"2024-09-12T17:45:03.894537+0000","last_became_peered":"2024-09-12T17:45:03.894537+0000","last_unstale":"2024-09-12T18:08:51.364900+0000","last_undegraded":"2024-09-12T18:08:51.364900+0000","last_fullsized":"2024-09-12T18:08:51.364900+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-12T18:08:51.364830+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-12T18:08:51.364830+0000","last_clean_scrub_stamp":"2024-09-12T18:08:51.364830+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:53.097176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":186,"num_write":90,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:08.947514+0000","last_change":"2024-09-12T18:09:08.947451+0000","last_active":"2024-09-12T18:09:08.947514+0000","last_peered":"2024-09-12T18:09:08.947514+0000","last_clean":"2024-09-12T18:09:08.947514+0000","last_became_active":"2024-09-12T17:57:00.464157+0000","last_became_peered":"2024-09-12T17:57:00.464157+0000","last_unstale":"2024-09-12T18:09:08.947514+0000","last_undegraded":"2024-09-12T18:09:08.947514+0000","last_fullsized":"2024-09-12T18:09:08.947514+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:08.947355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:08.947355+0000","last_clean_scrub_stamp":"2024-09-12T18:09:08.947355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:32.834659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.017537+0000","last_change":"2024-09-12T18:09:05.017537+0000","last_active":"2024-09-12T18:09:05.017537+0000","last_peered":"2024-09-12T18:09:05.017537+0000","last_clean":"2024-09-12T18:09:05.017537+0000","last_became_active":"2024-09-12T17:46:45.538295+0000","last_became_peered":"2024-09-12T17:46:45.538295+0000","last_unstale":"2024-09-12T18:09:05.017537+0000","last_undegraded":"2024-09-12T18:09:05.017537+0000","last_fullsized":"2024-09-12T18:09:05.017537+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:05.017437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:05.017437+0000","last_clean_scrub_stamp":"2024-09-12T18:09:05.017437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:08.036064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:48.663622+0000","last_change":"2024-09-12T18:08:48.663622+0000","last_active":"2024-09-12T18:08:48.663622+0000","last_peered":"2024-09-12T18:08:48.663622+0000","last_clean":"2024-09-12T18:08:48.663622+0000","last_became_active":"2024-09-12T17:46:42.183792+0000","last_became_peered":"2024-09-12T17:46:42.183792+0000","last_unstale":"2024-09-12T18:08:48.663622+0000","last_undegraded":"2024-09-12T18:08:48.663622+0000","last_fullsized":"2024-09-12T18:08:48.663622+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:48.663495+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:48.663495+0000","last_clean_scrub_stamp":"2024-09-12T18:08:48.663495+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:42.602412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'18","reported_seq":104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:53.018852+0000","last_change":"2024-09-12T18:08:53.018852+0000","last_active":"2024-09-12T18:08:53.018852+0000","last_peered":"2024-09-12T18:08:53.018852+0000","last_clean":"2024-09-12T18:08:53.018852+0000","last_became_active":"2024-09-12T17:45:03.893108+0000","last_became_peered":"2024-09-12T17:45:03.893108+0000","last_unstale":"2024-09-12T18:08:53.018852+0000","last_undegraded":"2024-09-12T18:08:53.018852+0000","last_fullsized":"2024-09-12T18:08:53.018852+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-12T18:08:53.018762+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-12T18:08:53.018762+0000","last_clean_scrub_stamp":"2024-09-12T18:08:53.018762+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:53.201532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":71,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.927130+0000","last_change":"2024-09-12T18:09:09.927130+0000","last_active":"2024-09-12T18:09:09.927130+0000","last_peered":"2024-09-12T18:09:09.927130+0000","last_clean":"2024-09-12T18:09:09.927130+0000","last_became_active":"2024-09-12T17:57:00.462657+0000","last_became_peered":"2024-09-12T17:57:00.462657+0000","last_unstale":"2024-09-12T18:09:09.927130+0000","last_undegraded":"2024-09-12T18:09:09.927130+0000","last_fullsized":"2024-09-12T18:09:09.927130+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:09.927031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:09.927031+0000","last_clean_scrub_stamp":"2024-09-12T18:09:09.927031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:18.249526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.349421+0000","last_change":"2024-09-12T18:08:54.349421+0000","last_active":"2024-09-12T18:08:54.349421+0000","last_peered":"2024-09-12T18:08:54.349421+0000","last_clean":"2024-09-12T18:08:54.349421+0000","last_became_active":"2024-09-12T17:46:45.210259+0000","last_became_peered":"2024-09-12T17:46:45.210259+0000","last_unstale":"2024-09-12T18:08:54.349421+0000","last_undegraded":"2024-09-12T18:08:54.349421+0000","last_fullsized":"2024-09-12T18:08:54.349421+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:08:54.349325+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:08:54.349325+0000","last_clean_scrub_stamp":"2024-09-12T18:08:54.349325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:12.493878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6189,"num_write":4,"num_write_kb":3117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'8","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.366004+0000","last_change":"2024-09-12T18:08:58.366004+0000","last_active":"2024-09-12T18:08:58.366004+0000","last_peered":"2024-09-12T18:08:58.366004+0000","last_clean":"2024-09-12T18:08:58.366004+0000","last_became_active":"2024-09-12T17:46:42.178782+0000","last_became_peered":"2024-09-12T17:46:42.178782+0000","last_unstale":"2024-09-12T18:08:58.366004+0000","last_undegraded":"2024-09-12T18:08:58.366004+0000","last_fullsized":"2024-09-12T18:08:58.366004+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T18:08:58.365903+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T18:08:58.365903+0000","last_clean_scrub_stamp":"2024-09-12T18:08:58.365903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:04.926841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'102","reported_seq":364,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.027184+0000","last_change":"2024-09-12T18:08:55.027184+0000","last_active":"2024-09-12T18:08:55.027184+0000","last_peered":"2024-09-12T18:08:55.027184+0000","last_clean":"2024-09-12T18:08:55.027184+0000","last_became_active":"2024-09-12T17:45:03.899635+0000","last_became_peered":"2024-09-12T17:45:03.899635+0000","last_unstale":"2024-09-12T18:08:55.027184+0000","last_undegraded":"2024-09-12T18:08:55.027184+0000","last_fullsized":"2024-09-12T18:08:55.027184+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-12T18:08:55.027098+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-12T18:08:55.027098+0000","last_clean_scrub_stamp":"2024-09-12T18:08:55.027098+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:20.841923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":609,"num_read_kb":455,"num_write":132,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3992,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:51.215084+0000","last_change":"2024-09-12T18:08:51.214993+0000","last_active":"2024-09-12T18:08:51.215084+0000","last_peered":"2024-09-12T18:08:51.215084+0000","last_clean":"2024-09-12T18:08:51.215084+0000","last_became_active":"2024-09-12T17:57:00.462532+0000","last_became_peered":"2024-09-12T17:57:00.462532+0000","last_unstale":"2024-09-12T18:08:51.215084+0000","last_undegraded":"2024-09-12T18:08:51.215084+0000","last_fullsized":"2024-09-12T18:08:51.215084+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:51.214908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:51.214908+0000","last_clean_scrub_stamp":"2024-09-12T18:08:51.214908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:13.424953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.046364+0000","last_change":"2024-09-12T18:08:44.046364+0000","last_active":"2024-09-12T18:08:44.046364+0000","last_peered":"2024-09-12T18:08:44.046364+0000","last_clean":"2024-09-12T18:08:44.046364+0000","last_became_active":"2024-09-12T17:47:29.305275+0000","last_became_peered":"2024-09-12T17:47:29.305275+0000","last_unstale":"2024-09-12T18:08:44.046364+0000","last_undegraded":"2024-09-12T18:08:44.046364+0000","last_fullsized":"2024-09-12T18:08:44.046364+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:44.046274+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:44.046274+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.046274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:24.312296+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.691399+0000","last_change":"2024-09-12T18:08:44.691399+0000","last_active":"2024-09-12T18:08:44.691399+0000","last_peered":"2024-09-12T18:08:44.691399+0000","last_clean":"2024-09-12T18:08:44.691399+0000","last_became_active":"2024-09-12T17:46:42.182797+0000","last_became_peered":"2024-09-12T17:46:42.182797+0000","last_unstale":"2024-09-12T18:08:44.691399+0000","last_undegraded":"2024-09-12T18:08:44.691399+0000","last_fullsized":"2024-09-12T18:08:44.691399+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:44.691312+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:44.691312+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.691312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:34.375454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.035255+0000","last_change":"2024-09-12T18:08:39.035255+0000","last_active":"2024-09-12T18:08:39.035255+0000","last_peered":"2024-09-12T18:08:39.035255+0000","last_clean":"2024-09-12T18:08:39.035255+0000","last_became_active":"2024-09-12T17:45:03.899684+0000","last_became_peered":"2024-09-12T17:45:03.899684+0000","last_unstale":"2024-09-12T18:08:39.035255+0000","last_undegraded":"2024-09-12T18:08:39.035255+0000","last_fullsized":"2024-09-12T18:08:39.035255+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-12T18:08:39.035164+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-12T18:08:39.035164+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.035164+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:45.390604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":95,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.937824+0000","last_change":"2024-09-12T18:09:06.937737+0000","last_active":"2024-09-12T18:09:06.937824+0000","last_peered":"2024-09-12T18:09:06.937824+0000","last_clean":"2024-09-12T18:09:06.937824+0000","last_became_active":"2024-09-12T17:57:00.464581+0000","last_became_peered":"2024-09-12T17:57:00.464581+0000","last_unstale":"2024-09-12T18:09:06.937824+0000","last_undegraded":"2024-09-12T18:09:06.937824+0000","last_fullsized":"2024-09-12T18:09:06.937824+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:09:06.937625+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:09:06.937625+0000","last_clean_scrub_stamp":"2024-09-12T18:09:06.937625+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:34.230704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.059591+0000","last_change":"2024-09-12T18:08:45.059496+0000","last_active":"2024-09-12T18:08:45.059591+0000","last_peered":"2024-09-12T18:08:45.059591+0000","last_clean":"2024-09-12T18:08:45.059591+0000","last_became_active":"2024-09-12T17:46:45.208580+0000","last_became_peered":"2024-09-12T17:46:45.208580+0000","last_unstale":"2024-09-12T18:08:45.059591+0000","last_undegraded":"2024-09-12T18:08:45.059591+0000","last_fullsized":"2024-09-12T18:08:45.059591+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:45.059384+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:45.059384+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.059384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:36.315465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.649243+0000","last_change":"2024-09-12T18:08:49.649158+0000","last_active":"2024-09-12T18:08:49.649243+0000","last_peered":"2024-09-12T18:08:49.649243+0000","last_clean":"2024-09-12T18:08:49.649243+0000","last_became_active":"2024-09-12T17:46:42.181972+0000","last_became_peered":"2024-09-12T17:46:42.181972+0000","last_unstale":"2024-09-12T18:08:49.649243+0000","last_undegraded":"2024-09-12T18:08:49.649243+0000","last_fullsized":"2024-09-12T18:08:49.649243+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:49.649041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:49.649041+0000","last_clean_scrub_stamp":"2024-09-12T18:08:49.649041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:48.556483+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'6","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.421780+0000","last_change":"2024-09-12T18:08:49.421717+0000","last_active":"2024-09-12T18:08:49.421780+0000","last_peered":"2024-09-12T18:08:49.421780+0000","last_clean":"2024-09-12T18:08:49.421780+0000","last_became_active":"2024-09-12T17:45:03.899876+0000","last_became_peered":"2024-09-12T17:45:03.899876+0000","last_unstale":"2024-09-12T18:08:49.421780+0000","last_undegraded":"2024-09-12T18:08:49.421780+0000","last_fullsized":"2024-09-12T18:08:49.421780+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:49.421627+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:49.421627+0000","last_clean_scrub_stamp":"2024-09-12T18:08:49.421627+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:14.994460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.918104+0000","last_change":"2024-09-12T18:09:07.918045+0000","last_active":"2024-09-12T18:09:07.918104+0000","last_peered":"2024-09-12T18:09:07.918104+0000","last_clean":"2024-09-12T18:09:07.918104+0000","last_became_active":"2024-09-12T17:57:00.467385+0000","last_became_peered":"2024-09-12T17:57:00.467385+0000","last_unstale":"2024-09-12T18:09:07.918104+0000","last_undegraded":"2024-09-12T18:09:07.918104+0000","last_fullsized":"2024-09-12T18:09:07.918104+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:07.917952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:07.917952+0000","last_clean_scrub_stamp":"2024-09-12T18:09:07.917952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:41.119566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.004823+0000","last_change":"2024-09-12T18:09:04.004744+0000","last_active":"2024-09-12T18:09:04.004823+0000","last_peered":"2024-09-12T18:09:04.004823+0000","last_clean":"2024-09-12T18:09:04.004823+0000","last_became_active":"2024-09-12T17:46:45.205742+0000","last_became_peered":"2024-09-12T17:46:45.205742+0000","last_unstale":"2024-09-12T18:09:04.004823+0000","last_undegraded":"2024-09-12T18:09:04.004823+0000","last_fullsized":"2024-09-12T18:09:04.004823+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:04.004654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:04.004654+0000","last_clean_scrub_stamp":"2024-09-12T18:09:04.004654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:44.109376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:57.399308+0000","last_change":"2024-09-12T18:08:57.399234+0000","last_active":"2024-09-12T18:08:57.399308+0000","last_peered":"2024-09-12T18:08:57.399308+0000","last_clean":"2024-09-12T18:08:57.399308+0000","last_became_active":"2024-09-12T17:46:42.175501+0000","last_became_peered":"2024-09-12T17:46:42.175501+0000","last_unstale":"2024-09-12T18:08:57.399308+0000","last_undegraded":"2024-09-12T18:08:57.399308+0000","last_fullsized":"2024-09-12T18:08:57.399308+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:57.399153+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:57.399153+0000","last_clean_scrub_stamp":"2024-09-12T18:08:57.399153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:18.671141+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.140083+0000","last_change":"2024-09-12T18:08:39.139970+0000","last_active":"2024-09-12T18:08:39.140083+0000","last_peered":"2024-09-12T18:08:39.140083+0000","last_clean":"2024-09-12T18:08:39.140083+0000","last_became_active":"2024-09-12T17:45:03.894942+0000","last_became_peered":"2024-09-12T17:45:03.894942+0000","last_unstale":"2024-09-12T18:08:39.140083+0000","last_undegraded":"2024-09-12T18:08:39.140083+0000","last_fullsized":"2024-09-12T18:08:39.140083+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-12T18:08:39.139867+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-12T18:08:39.139867+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.139867+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:45.603564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":114,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.230714+0000","last_change":"2024-09-12T18:08:50.230714+0000","last_active":"2024-09-12T18:08:50.230714+0000","last_peered":"2024-09-12T18:08:50.230714+0000","last_clean":"2024-09-12T18:08:50.230714+0000","last_became_active":"2024-09-12T17:57:00.463134+0000","last_became_peered":"2024-09-12T17:57:00.463134+0000","last_unstale":"2024-09-12T18:08:50.230714+0000","last_undegraded":"2024-09-12T18:08:50.230714+0000","last_fullsized":"2024-09-12T18:08:50.230714+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:50.230613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:50.230613+0000","last_clean_scrub_stamp":"2024-09-12T18:08:50.230613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:52.747548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:02.016876+0000","last_change":"2024-09-12T18:09:02.016876+0000","last_active":"2024-09-12T18:09:02.016876+0000","last_peered":"2024-09-12T18:09:02.016876+0000","last_clean":"2024-09-12T18:09:02.016876+0000","last_became_active":"2024-09-12T17:46:45.536581+0000","last_became_peered":"2024-09-12T17:46:45.536581+0000","last_unstale":"2024-09-12T18:09:02.016876+0000","last_undegraded":"2024-09-12T18:09:02.016876+0000","last_fullsized":"2024-09-12T18:09:02.016876+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:02.016776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:02.016776+0000","last_clean_scrub_stamp":"2024-09-12T18:09:02.016776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:12.648379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.405893+0000","last_change":"2024-09-12T18:08:50.405893+0000","last_active":"2024-09-12T18:08:50.405893+0000","last_peered":"2024-09-12T18:08:50.405893+0000","last_clean":"2024-09-12T18:08:50.405893+0000","last_became_active":"2024-09-12T17:46:42.179981+0000","last_became_peered":"2024-09-12T17:46:42.179981+0000","last_unstale":"2024-09-12T18:08:50.405893+0000","last_undegraded":"2024-09-12T18:08:50.405893+0000","last_fullsized":"2024-09-12T18:08:50.405893+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:50.405808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:50.405808+0000","last_clean_scrub_stamp":"2024-09-12T18:08:50.405808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:31.112556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":95,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.412187+0000","last_change":"2024-09-12T18:08:50.412091+0000","last_active":"2024-09-12T18:08:50.412187+0000","last_peered":"2024-09-12T18:08:50.412187+0000","last_clean":"2024-09-12T18:08:50.412187+0000","last_became_active":"2024-09-12T17:45:03.892625+0000","last_became_peered":"2024-09-12T17:45:03.892625+0000","last_unstale":"2024-09-12T18:08:50.412187+0000","last_undegraded":"2024-09-12T18:08:50.412187+0000","last_fullsized":"2024-09-12T18:08:50.412187+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T18:08:50.411985+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T18:08:50.411985+0000","last_clean_scrub_stamp":"2024-09-12T18:08:50.411985+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:11.453257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.338542+0000","last_change":"2024-09-12T18:08:39.338475+0000","last_active":"2024-09-12T18:08:39.338542+0000","last_peered":"2024-09-12T18:08:39.338542+0000","last_clean":"2024-09-12T18:08:39.338542+0000","last_became_active":"2024-09-12T17:57:00.461347+0000","last_became_peered":"2024-09-12T17:57:00.461347+0000","last_unstale":"2024-09-12T18:08:39.338542+0000","last_undegraded":"2024-09-12T18:08:39.338542+0000","last_fullsized":"2024-09-12T18:08:39.338542+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:39.338385+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:39.338385+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.338385+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:37.625439+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:01.010009+0000","last_change":"2024-09-12T18:09:01.010009+0000","last_active":"2024-09-12T18:09:01.010009+0000","last_peered":"2024-09-12T18:09:01.010009+0000","last_clean":"2024-09-12T18:09:01.010009+0000","last_became_active":"2024-09-12T17:46:45.537463+0000","last_became_peered":"2024-09-12T17:46:45.537463+0000","last_unstale":"2024-09-12T18:09:01.010009+0000","last_undegraded":"2024-09-12T18:09:01.010009+0000","last_fullsized":"2024-09-12T18:09:01.010009+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:09:01.009913+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:09:01.009913+0000","last_clean_scrub_stamp":"2024-09-12T18:09:01.009913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:10.627409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:57.004343+0000","last_change":"2024-09-12T18:08:57.004343+0000","last_active":"2024-09-12T18:08:57.004343+0000","last_peered":"2024-09-12T18:08:57.004343+0000","last_clean":"2024-09-12T18:08:57.004343+0000","last_became_active":"2024-09-12T17:46:42.178809+0000","last_became_peered":"2024-09-12T17:46:42.178809+0000","last_unstale":"2024-09-12T18:08:57.004343+0000","last_undegraded":"2024-09-12T18:08:57.004343+0000","last_fullsized":"2024-09-12T18:08:57.004343+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:08:57.004254+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:08:57.004254+0000","last_clean_scrub_stamp":"2024-09-12T18:08:57.004254+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:44.467140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'40","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:51.984685+0000","last_change":"2024-09-12T18:08:51.984600+0000","last_active":"2024-09-12T18:08:51.984685+0000","last_peered":"2024-09-12T18:08:51.984685+0000","last_clean":"2024-09-12T18:08:51.984685+0000","last_became_active":"2024-09-12T17:45:03.892417+0000","last_became_peered":"2024-09-12T17:45:03.892417+0000","last_unstale":"2024-09-12T18:08:51.984685+0000","last_undegraded":"2024-09-12T18:08:51.984685+0000","last_fullsized":"2024-09-12T18:08:51.984685+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-12T18:08:51.984486+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-12T18:08:51.984486+0000","last_clean_scrub_stamp":"2024-09-12T18:08:51.984486+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:41.532480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":139,"num_write":73,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.970052+0000","last_change":"2024-09-12T18:09:05.970052+0000","last_active":"2024-09-12T18:09:05.970052+0000","last_peered":"2024-09-12T18:09:05.970052+0000","last_clean":"2024-09-12T18:09:05.970052+0000","last_became_active":"2024-09-12T17:57:00.463245+0000","last_became_peered":"2024-09-12T17:57:00.463245+0000","last_unstale":"2024-09-12T18:09:05.970052+0000","last_undegraded":"2024-09-12T18:09:05.970052+0000","last_fullsized":"2024-09-12T18:09:05.970052+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:05.969941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:05.969941+0000","last_clean_scrub_stamp":"2024-09-12T18:09:05.969941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:49.304599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:03.041885+0000","last_change":"2024-09-12T18:09:03.041885+0000","last_active":"2024-09-12T18:09:03.041885+0000","last_peered":"2024-09-12T18:09:03.041885+0000","last_clean":"2024-09-12T18:09:03.041885+0000","last_became_active":"2024-09-12T17:46:45.538337+0000","last_became_peered":"2024-09-12T17:46:45.538337+0000","last_unstale":"2024-09-12T18:09:03.041885+0000","last_undegraded":"2024-09-12T18:09:03.041885+0000","last_fullsized":"2024-09-12T18:09:03.041885+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:03.041801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:03.041801+0000","last_clean_scrub_stamp":"2024-09-12T18:09:03.041801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:06.882255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'6","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.332509+0000","last_change":"2024-09-12T18:08:34.332509+0000","last_active":"2024-09-12T18:08:34.332509+0000","last_peered":"2024-09-12T18:08:34.332509+0000","last_clean":"2024-09-12T18:08:34.332509+0000","last_became_active":"2024-09-12T17:46:42.183098+0000","last_became_peered":"2024-09-12T17:46:42.183098+0000","last_unstale":"2024-09-12T18:08:34.332509+0000","last_undegraded":"2024-09-12T18:08:34.332509+0000","last_fullsized":"2024-09-12T18:08:34.332509+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:34.332403+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:34.332403+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.332403+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:28.057652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'35","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.462227+0000","last_change":"2024-09-12T18:08:30.462161+0000","last_active":"2024-09-12T18:08:30.462227+0000","last_peered":"2024-09-12T18:08:30.462227+0000","last_clean":"2024-09-12T18:08:30.462227+0000","last_became_active":"2024-09-12T17:45:03.896299+0000","last_became_peered":"2024-09-12T17:45:03.896299+0000","last_unstale":"2024-09-12T18:08:30.462227+0000","last_undegraded":"2024-09-12T18:08:30.462227+0000","last_fullsized":"2024-09-12T18:08:30.462227+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-12T18:08:30.462075+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-12T18:08:30.462075+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.462075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:31.466676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":68,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:56.350217+0000","last_change":"2024-09-12T18:08:56.350217+0000","last_active":"2024-09-12T18:08:56.350217+0000","last_peered":"2024-09-12T18:08:56.350217+0000","last_clean":"2024-09-12T18:08:56.350217+0000","last_became_active":"2024-09-12T17:57:00.461706+0000","last_became_peered":"2024-09-12T17:57:00.461706+0000","last_unstale":"2024-09-12T18:08:56.350217+0000","last_undegraded":"2024-09-12T18:08:56.350217+0000","last_fullsized":"2024-09-12T18:08:56.350217+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:56.350129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:56.350129+0000","last_clean_scrub_stamp":"2024-09-12T18:08:56.350129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:15.499827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:52.608730+0000","last_change":"2024-09-12T18:08:52.608730+0000","last_active":"2024-09-12T18:08:52.608730+0000","last_peered":"2024-09-12T18:08:52.608730+0000","last_clean":"2024-09-12T18:08:52.608730+0000","last_became_active":"2024-09-12T17:46:45.207610+0000","last_became_peered":"2024-09-12T17:46:45.207610+0000","last_unstale":"2024-09-12T18:08:52.608730+0000","last_undegraded":"2024-09-12T18:08:52.608730+0000","last_fullsized":"2024-09-12T18:08:52.608730+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:52.608625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:52.608625+0000","last_clean_scrub_stamp":"2024-09-12T18:08:52.608625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:10.007221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:56.376020+0000","last_change":"2024-09-12T18:08:56.376020+0000","last_active":"2024-09-12T18:08:56.376020+0000","last_peered":"2024-09-12T18:08:56.376020+0000","last_clean":"2024-09-12T18:08:56.376020+0000","last_became_active":"2024-09-12T17:46:42.182412+0000","last_became_peered":"2024-09-12T17:46:42.182412+0000","last_unstale":"2024-09-12T18:08:56.376020+0000","last_undegraded":"2024-09-12T18:08:56.376020+0000","last_fullsized":"2024-09-12T18:08:56.376020+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:08:56.375927+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:08:56.375927+0000","last_clean_scrub_stamp":"2024-09-12T18:08:56.375927+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:00.532634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'49","reported_seq":182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:51.068756+0000","last_change":"2024-09-12T18:08:51.068756+0000","last_active":"2024-09-12T18:08:51.068756+0000","last_peered":"2024-09-12T18:08:51.068756+0000","last_clean":"2024-09-12T18:08:51.068756+0000","last_became_active":"2024-09-12T17:45:03.899885+0000","last_became_peered":"2024-09-12T17:45:03.899885+0000","last_unstale":"2024-09-12T18:08:51.068756+0000","last_undegraded":"2024-09-12T18:08:51.068756+0000","last_fullsized":"2024-09-12T18:08:51.068756+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-12T18:08:51.068660+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-12T18:08:51.068660+0000","last_clean_scrub_stamp":"2024-09-12T18:08:51.068660+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:08.504300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":167,"num_write":104,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.971679+0000","last_change":"2024-09-12T18:09:07.971679+0000","last_active":"2024-09-12T18:09:07.971679+0000","last_peered":"2024-09-12T18:09:07.971679+0000","last_clean":"2024-09-12T18:09:07.971679+0000","last_became_active":"2024-09-12T17:57:00.468592+0000","last_became_peered":"2024-09-12T17:57:00.468592+0000","last_unstale":"2024-09-12T18:09:07.971679+0000","last_undegraded":"2024-09-12T18:09:07.971679+0000","last_fullsized":"2024-09-12T18:09:07.971679+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:07.971579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:07.971579+0000","last_clean_scrub_stamp":"2024-09-12T18:09:07.971579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:24.650115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"261'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:48.184219+0000","last_change":"2024-09-12T18:08:48.184219+0000","last_active":"2024-09-12T18:08:48.184219+0000","last_peered":"2024-09-12T18:08:48.184219+0000","last_clean":"2024-09-12T18:08:48.184219+0000","last_became_active":"2024-09-12T17:46:45.210413+0000","last_became_peered":"2024-09-12T17:46:45.210413+0000","last_unstale":"2024-09-12T18:08:48.184219+0000","last_undegraded":"2024-09-12T18:08:48.184219+0000","last_fullsized":"2024-09-12T18:08:48.184219+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:48.184107+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:48.184107+0000","last_clean_scrub_stamp":"2024-09-12T18:08:48.184107+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:51.708583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.720243+0000","last_change":"2024-09-12T18:08:43.720243+0000","last_active":"2024-09-12T18:08:43.720243+0000","last_peered":"2024-09-12T18:08:43.720243+0000","last_clean":"2024-09-12T18:08:43.720243+0000","last_became_active":"2024-09-12T17:46:42.176505+0000","last_became_peered":"2024-09-12T17:46:42.176505+0000","last_unstale":"2024-09-12T18:08:43.720243+0000","last_undegraded":"2024-09-12T18:08:43.720243+0000","last_fullsized":"2024-09-12T18:08:43.720243+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.720145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.720145+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.720145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:25.547287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'4","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.082448+0000","last_change":"2024-09-12T18:08:49.082448+0000","last_active":"2024-09-12T18:08:49.082448+0000","last_peered":"2024-09-12T18:08:49.082448+0000","last_clean":"2024-09-12T18:08:49.082448+0000","last_became_active":"2024-09-12T17:45:03.899726+0000","last_became_peered":"2024-09-12T17:45:03.899726+0000","last_unstale":"2024-09-12T18:08:49.082448+0000","last_undegraded":"2024-09-12T18:08:49.082448+0000","last_fullsized":"2024-09-12T18:08:49.082448+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:08:49.082362+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:08:49.082362+0000","last_clean_scrub_stamp":"2024-09-12T18:08:49.082362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:11.786278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.412864+0000","last_change":"2024-09-12T18:09:06.412864+0000","last_active":"2024-09-12T18:09:06.412864+0000","last_peered":"2024-09-12T18:09:06.412864+0000","last_clean":"2024-09-12T18:09:06.412864+0000","last_became_active":"2024-09-12T17:57:00.463766+0000","last_became_peered":"2024-09-12T17:57:00.463766+0000","last_unstale":"2024-09-12T18:09:06.412864+0000","last_undegraded":"2024-09-12T18:09:06.412864+0000","last_fullsized":"2024-09-12T18:09:06.412864+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:06.412768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:06.412768+0000","last_clean_scrub_stamp":"2024-09-12T18:09:06.412768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:08.953529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'8","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.188793+0000","last_change":"2024-09-12T18:08:46.188793+0000","last_active":"2024-09-12T18:08:46.188793+0000","last_peered":"2024-09-12T18:08:46.188793+0000","last_clean":"2024-09-12T18:08:46.188793+0000","last_became_active":"2024-09-12T17:46:45.201278+0000","last_became_peered":"2024-09-12T17:46:45.201278+0000","last_unstale":"2024-09-12T18:08:46.188793+0000","last_undegraded":"2024-09-12T18:08:46.188793+0000","last_fullsized":"2024-09-12T18:08:46.188793+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:08:46.188705+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:08:46.188705+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.188705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:52.744538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'8","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.015935+0000","last_change":"2024-09-12T18:08:54.015935+0000","last_active":"2024-09-12T18:08:54.015935+0000","last_peered":"2024-09-12T18:08:54.015935+0000","last_clean":"2024-09-12T18:08:54.015935+0000","last_became_active":"2024-09-12T17:46:42.182658+0000","last_became_peered":"2024-09-12T17:46:42.182658+0000","last_unstale":"2024-09-12T18:08:54.015935+0000","last_undegraded":"2024-09-12T18:08:54.015935+0000","last_fullsized":"2024-09-12T18:08:54.015935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:08:54.015857+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:08:54.015857+0000","last_clean_scrub_stamp":"2024-09-12T18:08:54.015857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:37.356981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":45,"num_write":18,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:48.409479+0000","last_change":"2024-09-12T18:08:48.409479+0000","last_active":"2024-09-12T18:08:48.409479+0000","last_peered":"2024-09-12T18:08:48.409479+0000","last_clean":"2024-09-12T18:08:48.409479+0000","last_became_active":"2024-09-12T17:45:03.891186+0000","last_became_peered":"2024-09-12T17:45:03.891186+0000","last_unstale":"2024-09-12T18:08:48.409479+0000","last_undegraded":"2024-09-12T18:08:48.409479+0000","last_fullsized":"2024-09-12T18:08:48.409479+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-12T18:08:48.409396+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-12T18:08:48.409396+0000","last_clean_scrub_stamp":"2024-09-12T18:08:48.409396+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:52.159634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":128,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.455929+0000","last_change":"2024-09-12T18:09:05.455929+0000","last_active":"2024-09-12T18:09:05.455929+0000","last_peered":"2024-09-12T18:09:05.455929+0000","last_clean":"2024-09-12T18:09:05.455929+0000","last_became_active":"2024-09-12T17:57:00.464910+0000","last_became_peered":"2024-09-12T17:57:00.464910+0000","last_unstale":"2024-09-12T18:09:05.455929+0000","last_undegraded":"2024-09-12T18:09:05.455929+0000","last_fullsized":"2024-09-12T18:09:05.455929+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:09:05.455828+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:09:05.455828+0000","last_clean_scrub_stamp":"2024-09-12T18:09:05.455828+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:04.633817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"261'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:00.025991+0000","last_change":"2024-09-12T18:09:00.025991+0000","last_active":"2024-09-12T18:09:00.025991+0000","last_peered":"2024-09-12T18:09:00.025991+0000","last_clean":"2024-09-12T18:09:00.025991+0000","last_became_active":"2024-09-12T17:46:45.206402+0000","last_became_peered":"2024-09-12T17:46:45.206402+0000","last_unstale":"2024-09-12T18:09:00.025991+0000","last_undegraded":"2024-09-12T18:09:00.025991+0000","last_fullsized":"2024-09-12T18:09:00.025991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:09:00.025900+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:09:00.025900+0000","last_clean_scrub_stamp":"2024-09-12T18:09:00.025900+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:02.539041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.062277+0000","last_change":"2024-09-12T18:08:41.062277+0000","last_active":"2024-09-12T18:08:41.062277+0000","last_peered":"2024-09-12T18:08:41.062277+0000","last_clean":"2024-09-12T18:08:41.062277+0000","last_became_active":"2024-09-12T17:46:42.184760+0000","last_became_peered":"2024-09-12T17:46:42.184760+0000","last_unstale":"2024-09-12T18:08:41.062277+0000","last_undegraded":"2024-09-12T18:08:41.062277+0000","last_fullsized":"2024-09-12T18:08:41.062277+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:41.062169+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:41.062169+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.062169+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:26.401540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'36","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.744438+0000","last_change":"2024-09-12T18:08:42.744438+0000","last_active":"2024-09-12T18:08:42.744438+0000","last_peered":"2024-09-12T18:08:42.744438+0000","last_clean":"2024-09-12T18:08:42.744438+0000","last_became_active":"2024-09-12T17:45:03.897616+0000","last_became_peered":"2024-09-12T17:45:03.897616+0000","last_unstale":"2024-09-12T18:08:42.744438+0000","last_undegraded":"2024-09-12T18:08:42.744438+0000","last_fullsized":"2024-09-12T18:08:42.744438+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-12T18:08:42.744348+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-12T18:08:42.744348+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.744348+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:13.467186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":138,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.963180+0000","last_change":"2024-09-12T18:09:06.963180+0000","last_active":"2024-09-12T18:09:06.963180+0000","last_peered":"2024-09-12T18:09:06.963180+0000","last_clean":"2024-09-12T18:09:06.963180+0000","last_became_active":"2024-09-12T17:57:00.463881+0000","last_became_peered":"2024-09-12T17:57:00.463881+0000","last_unstale":"2024-09-12T18:09:06.963180+0000","last_undegraded":"2024-09-12T18:09:06.963180+0000","last_fullsized":"2024-09-12T18:09:06.963180+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:09:06.963083+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:09:06.963083+0000","last_clean_scrub_stamp":"2024-09-12T18:09:06.963083+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:08.876197+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.054811+0000","last_change":"2024-09-12T18:08:43.054811+0000","last_active":"2024-09-12T18:08:43.054811+0000","last_peered":"2024-09-12T18:08:43.054811+0000","last_clean":"2024-09-12T18:08:43.054811+0000","last_became_active":"2024-09-12T17:46:45.205987+0000","last_became_peered":"2024-09-12T17:46:45.205987+0000","last_unstale":"2024-09-12T18:08:43.054811+0000","last_undegraded":"2024-09-12T18:08:43.054811+0000","last_fullsized":"2024-09-12T18:08:43.054811+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:43.054721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:43.054721+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.054721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:35.540307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.437045+0000","last_change":"2024-09-12T18:08:49.437045+0000","last_active":"2024-09-12T18:08:49.437045+0000","last_peered":"2024-09-12T18:08:49.437045+0000","last_clean":"2024-09-12T18:08:49.437045+0000","last_became_active":"2024-09-12T17:46:42.178941+0000","last_became_peered":"2024-09-12T17:46:42.178941+0000","last_unstale":"2024-09-12T18:08:49.437045+0000","last_undegraded":"2024-09-12T18:08:49.437045+0000","last_fullsized":"2024-09-12T18:08:49.437045+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:49.436952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:49.436952+0000","last_clean_scrub_stamp":"2024-09-12T18:08:49.436952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:43.113599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'33","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.980928+0000","last_change":"2024-09-12T18:08:50.980928+0000","last_active":"2024-09-12T18:08:50.980928+0000","last_peered":"2024-09-12T18:08:50.980928+0000","last_clean":"2024-09-12T18:08:50.980928+0000","last_became_active":"2024-09-12T17:45:03.893332+0000","last_became_peered":"2024-09-12T17:45:03.893332+0000","last_unstale":"2024-09-12T18:08:50.980928+0000","last_undegraded":"2024-09-12T18:08:50.980928+0000","last_fullsized":"2024-09-12T18:08:50.980928+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T18:08:50.980837+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T18:08:50.980837+0000","last_clean_scrub_stamp":"2024-09-12T18:08:50.980837+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:57.691927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.367651+0000","last_change":"2024-09-12T18:08:38.367651+0000","last_active":"2024-09-12T18:08:38.367651+0000","last_peered":"2024-09-12T18:08:38.367651+0000","last_clean":"2024-09-12T18:08:38.367651+0000","last_became_active":"2024-09-12T17:57:00.461130+0000","last_became_peered":"2024-09-12T17:57:00.461130+0000","last_unstale":"2024-09-12T18:08:38.367651+0000","last_undegraded":"2024-09-12T18:08:38.367651+0000","last_fullsized":"2024-09-12T18:08:38.367651+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:38.367554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:38.367554+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.367554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:37.306375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:57.110408+0000","last_change":"2024-09-12T18:08:57.110353+0000","last_active":"2024-09-12T18:08:57.110408+0000","last_peered":"2024-09-12T18:08:57.110408+0000","last_clean":"2024-09-12T18:08:57.110408+0000","last_became_active":"2024-09-12T17:46:45.207899+0000","last_became_peered":"2024-09-12T17:46:45.207899+0000","last_unstale":"2024-09-12T18:08:57.110408+0000","last_undegraded":"2024-09-12T18:08:57.110408+0000","last_fullsized":"2024-09-12T18:08:57.110408+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:57.110270+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:57.110270+0000","last_clean_scrub_stamp":"2024-09-12T18:08:57.110270+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:52.848589+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":571,"num_write":10,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.020284+0000","last_change":"2024-09-12T18:08:55.020230+0000","last_active":"2024-09-12T18:08:55.020284+0000","last_peered":"2024-09-12T18:08:55.020284+0000","last_clean":"2024-09-12T18:08:55.020284+0000","last_became_active":"2024-09-12T17:46:42.177867+0000","last_became_peered":"2024-09-12T17:46:42.177867+0000","last_unstale":"2024-09-12T18:08:55.020284+0000","last_undegraded":"2024-09-12T18:08:55.020284+0000","last_fullsized":"2024-09-12T18:08:55.020284+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:55.020132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:55.020132+0000","last_clean_scrub_stamp":"2024-09-12T18:08:55.020132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:36.993241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'22","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.955932+0000","last_change":"2024-09-12T18:08:49.955932+0000","last_active":"2024-09-12T18:08:49.955932+0000","last_peered":"2024-09-12T18:08:49.955932+0000","last_clean":"2024-09-12T18:08:49.955932+0000","last_became_active":"2024-09-12T17:45:03.895229+0000","last_became_peered":"2024-09-12T17:45:03.895229+0000","last_unstale":"2024-09-12T18:08:49.955932+0000","last_undegraded":"2024-09-12T18:08:49.955932+0000","last_fullsized":"2024-09-12T18:08:49.955932+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-12T18:08:49.955844+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-12T18:08:49.955844+0000","last_clean_scrub_stamp":"2024-09-12T18:08:49.955844+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:28.159320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:03.036043+0000","last_change":"2024-09-12T18:09:03.036043+0000","last_active":"2024-09-12T18:09:03.036043+0000","last_peered":"2024-09-12T18:09:03.036043+0000","last_clean":"2024-09-12T18:09:03.036043+0000","last_became_active":"2024-09-12T17:57:00.466328+0000","last_became_peered":"2024-09-12T17:57:00.466328+0000","last_unstale":"2024-09-12T18:09:03.036043+0000","last_undegraded":"2024-09-12T18:09:03.036043+0000","last_fullsized":"2024-09-12T18:09:03.036043+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:03.035945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:03.035945+0000","last_clean_scrub_stamp":"2024-09-12T18:09:03.035945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:54.743196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.108444+0000","last_change":"2024-09-12T18:08:58.108376+0000","last_active":"2024-09-12T18:08:58.108444+0000","last_peered":"2024-09-12T18:08:58.108444+0000","last_clean":"2024-09-12T18:08:58.108444+0000","last_became_active":"2024-09-12T17:46:45.204628+0000","last_became_peered":"2024-09-12T17:46:45.204628+0000","last_unstale":"2024-09-12T18:08:58.108444+0000","last_undegraded":"2024-09-12T18:08:58.108444+0000","last_fullsized":"2024-09-12T18:08:58.108444+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:58.108290+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:58.108290+0000","last_clean_scrub_stamp":"2024-09-12T18:08:58.108290+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:37.462716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'3","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.354036+0000","last_change":"2024-09-12T18:08:33.353971+0000","last_active":"2024-09-12T18:08:33.354036+0000","last_peered":"2024-09-12T18:08:33.354036+0000","last_clean":"2024-09-12T18:08:33.354036+0000","last_became_active":"2024-09-12T17:46:42.183710+0000","last_became_peered":"2024-09-12T17:46:42.183710+0000","last_unstale":"2024-09-12T18:08:33.354036+0000","last_undegraded":"2024-09-12T18:08:33.354036+0000","last_fullsized":"2024-09-12T18:08:33.354036+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:33.353886+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:33.353886+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.353886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:44.594486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'20","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:48.442441+0000","last_change":"2024-09-12T18:08:48.442441+0000","last_active":"2024-09-12T18:08:48.442441+0000","last_peered":"2024-09-12T18:08:48.442441+0000","last_clean":"2024-09-12T18:08:48.442441+0000","last_became_active":"2024-09-12T17:45:03.897609+0000","last_became_peered":"2024-09-12T17:45:03.897609+0000","last_unstale":"2024-09-12T18:08:48.442441+0000","last_undegraded":"2024-09-12T18:08:48.442441+0000","last_fullsized":"2024-09-12T18:08:48.442441+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-12T18:08:48.442360+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-12T18:08:48.442360+0000","last_clean_scrub_stamp":"2024-09-12T18:08:48.442360+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:25.329001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.065405+0000","last_change":"2024-09-12T18:08:46.065405+0000","last_active":"2024-09-12T18:08:46.065405+0000","last_peered":"2024-09-12T18:08:46.065405+0000","last_clean":"2024-09-12T18:08:46.065405+0000","last_became_active":"2024-09-12T17:57:00.458777+0000","last_became_peered":"2024-09-12T17:57:00.458777+0000","last_unstale":"2024-09-12T18:08:46.065405+0000","last_undegraded":"2024-09-12T18:08:46.065405+0000","last_fullsized":"2024-09-12T18:08:46.065405+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:46.065321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:46.065321+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.065321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:26.249202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.197641+0000","last_change":"2024-09-12T18:08:45.197561+0000","last_active":"2024-09-12T18:08:45.197641+0000","last_peered":"2024-09-12T18:08:45.197641+0000","last_clean":"2024-09-12T18:08:45.197641+0000","last_became_active":"2024-09-12T17:46:45.536980+0000","last_became_peered":"2024-09-12T17:46:45.536980+0000","last_unstale":"2024-09-12T18:08:45.197641+0000","last_undegraded":"2024-09-12T18:08:45.197641+0000","last_fullsized":"2024-09-12T18:08:45.197641+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:08:45.197475+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:08:45.197475+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.197475+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:40.764644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.369928+0000","last_change":"2024-09-12T18:08:55.369860+0000","last_active":"2024-09-12T18:08:55.369928+0000","last_peered":"2024-09-12T18:08:55.369928+0000","last_clean":"2024-09-12T18:08:55.369928+0000","last_became_active":"2024-09-12T17:46:42.180565+0000","last_became_peered":"2024-09-12T17:46:42.180565+0000","last_unstale":"2024-09-12T18:08:55.369928+0000","last_undegraded":"2024-09-12T18:08:55.369928+0000","last_fullsized":"2024-09-12T18:08:55.369928+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:55.369772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:55.369772+0000","last_clean_scrub_stamp":"2024-09-12T18:08:55.369772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:09.678109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'33","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.050500+0000","last_change":"2024-09-12T18:08:37.050500+0000","last_active":"2024-09-12T18:08:37.050500+0000","last_peered":"2024-09-12T18:08:37.050500+0000","last_clean":"2024-09-12T18:08:37.050500+0000","last_became_active":"2024-09-12T17:45:03.892226+0000","last_became_peered":"2024-09-12T17:45:03.892226+0000","last_unstale":"2024-09-12T18:08:37.050500+0000","last_undegraded":"2024-09-12T18:08:37.050500+0000","last_fullsized":"2024-09-12T18:08:37.050500+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T18:08:37.050393+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T18:08:37.050393+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.050393+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:27.394946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":124,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:02.012420+0000","last_change":"2024-09-12T18:09:02.012420+0000","last_active":"2024-09-12T18:09:02.012420+0000","last_peered":"2024-09-12T18:09:02.012420+0000","last_clean":"2024-09-12T18:09:02.012420+0000","last_became_active":"2024-09-12T17:57:00.464707+0000","last_became_peered":"2024-09-12T17:57:00.464707+0000","last_unstale":"2024-09-12T18:09:02.012420+0000","last_undegraded":"2024-09-12T18:09:02.012420+0000","last_fullsized":"2024-09-12T18:09:02.012420+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:02.012296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:02.012296+0000","last_clean_scrub_stamp":"2024-09-12T18:09:02.012296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:04.533564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.068995+0000","last_change":"2024-09-12T18:08:59.068887+0000","last_active":"2024-09-12T18:08:59.068995+0000","last_peered":"2024-09-12T18:08:59.068995+0000","last_clean":"2024-09-12T18:08:59.068995+0000","last_became_active":"2024-09-12T17:46:45.204759+0000","last_became_peered":"2024-09-12T17:46:45.204759+0000","last_unstale":"2024-09-12T18:08:59.068995+0000","last_undegraded":"2024-09-12T18:08:59.068995+0000","last_fullsized":"2024-09-12T18:08:59.068995+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:59.068782+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:59.068782+0000","last_clean_scrub_stamp":"2024-09-12T18:08:59.068782+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:19.387357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.177282+0000","last_change":"2024-09-12T18:08:44.177200+0000","last_active":"2024-09-12T18:08:44.177282+0000","last_peered":"2024-09-12T18:08:44.177282+0000","last_clean":"2024-09-12T18:08:44.177282+0000","last_became_active":"2024-09-12T17:46:42.182805+0000","last_became_peered":"2024-09-12T17:46:42.182805+0000","last_unstale":"2024-09-12T18:08:44.177282+0000","last_undegraded":"2024-09-12T18:08:44.177282+0000","last_fullsized":"2024-09-12T18:08:44.177282+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:44.177115+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:44.177115+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.177115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:06.093127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'42","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.428464+0000","last_change":"2024-09-12T18:08:29.428464+0000","last_active":"2024-09-12T18:08:29.428464+0000","last_peered":"2024-09-12T18:08:29.428464+0000","last_clean":"2024-09-12T18:08:29.428464+0000","last_became_active":"2024-09-12T17:45:03.897752+0000","last_became_peered":"2024-09-12T17:45:03.897752+0000","last_unstale":"2024-09-12T18:08:29.428464+0000","last_undegraded":"2024-09-12T18:08:29.428464+0000","last_fullsized":"2024-09-12T18:08:29.428464+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-12T18:08:29.428355+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-12T18:08:29.428355+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.428355+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:12.865787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":75,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.009864+0000","last_change":"2024-09-12T18:09:06.009864+0000","last_active":"2024-09-12T18:09:06.009864+0000","last_peered":"2024-09-12T18:09:06.009864+0000","last_clean":"2024-09-12T18:09:06.009864+0000","last_became_active":"2024-09-12T17:57:00.469072+0000","last_became_peered":"2024-09-12T17:57:00.469072+0000","last_unstale":"2024-09-12T18:09:06.009864+0000","last_undegraded":"2024-09-12T18:09:06.009864+0000","last_fullsized":"2024-09-12T18:09:06.009864+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:06.009776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:06.009776+0000","last_clean_scrub_stamp":"2024-09-12T18:09:06.009776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:36.203002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:53.594942+0000","last_change":"2024-09-12T18:08:53.594942+0000","last_active":"2024-09-12T18:08:53.594942+0000","last_peered":"2024-09-12T18:08:53.594942+0000","last_clean":"2024-09-12T18:08:53.594942+0000","last_became_active":"2024-09-12T17:46:45.202892+0000","last_became_peered":"2024-09-12T17:46:45.202892+0000","last_unstale":"2024-09-12T18:08:53.594942+0000","last_undegraded":"2024-09-12T18:08:53.594942+0000","last_fullsized":"2024-09-12T18:08:53.594942+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:08:53.594844+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:08:53.594844+0000","last_clean_scrub_stamp":"2024-09-12T18:08:53.594844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:13.873172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:53.353930+0000","last_change":"2024-09-12T18:08:53.353930+0000","last_active":"2024-09-12T18:08:53.353930+0000","last_peered":"2024-09-12T18:08:53.353930+0000","last_clean":"2024-09-12T18:08:53.353930+0000","last_became_active":"2024-09-12T17:46:42.178411+0000","last_became_peered":"2024-09-12T17:46:42.178411+0000","last_unstale":"2024-09-12T18:08:53.353930+0000","last_undegraded":"2024-09-12T18:08:53.353930+0000","last_fullsized":"2024-09-12T18:08:53.353930+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:53.353827+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:53.353827+0000","last_clean_scrub_stamp":"2024-09-12T18:08:53.353827+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:43.023148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'24","reported_seq":119,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.359028+0000","last_change":"2024-09-12T18:08:46.359028+0000","last_active":"2024-09-12T18:08:46.359028+0000","last_peered":"2024-09-12T18:08:46.359028+0000","last_clean":"2024-09-12T18:08:46.359028+0000","last_became_active":"2024-09-12T17:45:03.891369+0000","last_became_peered":"2024-09-12T17:45:03.891369+0000","last_unstale":"2024-09-12T18:08:46.359028+0000","last_undegraded":"2024-09-12T18:08:46.359028+0000","last_fullsized":"2024-09-12T18:08:46.359028+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T18:08:46.358933+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T18:08:46.358933+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.358933+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:54.486807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.016493+0000","last_change":"2024-09-12T18:09:05.016493+0000","last_active":"2024-09-12T18:09:05.016493+0000","last_peered":"2024-09-12T18:09:05.016493+0000","last_clean":"2024-09-12T18:09:05.016493+0000","last_became_active":"2024-09-12T17:57:00.465360+0000","last_became_peered":"2024-09-12T17:57:00.465360+0000","last_unstale":"2024-09-12T18:09:05.016493+0000","last_undegraded":"2024-09-12T18:09:05.016493+0000","last_fullsized":"2024-09-12T18:09:05.016493+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:05.016343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:05.016343+0000","last_clean_scrub_stamp":"2024-09-12T18:09:05.016343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:58.019097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.046410+0000","last_change":"2024-09-12T18:08:59.046410+0000","last_active":"2024-09-12T18:08:59.046410+0000","last_peered":"2024-09-12T18:08:59.046410+0000","last_clean":"2024-09-12T18:08:59.046410+0000","last_became_active":"2024-09-12T17:46:45.536056+0000","last_became_peered":"2024-09-12T17:46:45.536056+0000","last_unstale":"2024-09-12T18:08:59.046410+0000","last_undegraded":"2024-09-12T18:08:59.046410+0000","last_fullsized":"2024-09-12T18:08:59.046410+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:08:59.046321+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:08:59.046321+0000","last_clean_scrub_stamp":"2024-09-12T18:08:59.046321+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:06.911101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.080353+0000","last_change":"2024-09-12T18:08:41.080353+0000","last_active":"2024-09-12T18:08:41.080353+0000","last_peered":"2024-09-12T18:08:41.080353+0000","last_clean":"2024-09-12T18:08:41.080353+0000","last_became_active":"2024-09-12T17:46:42.182831+0000","last_became_peered":"2024-09-12T17:46:42.182831+0000","last_unstale":"2024-09-12T18:08:41.080353+0000","last_undegraded":"2024-09-12T18:08:41.080353+0000","last_fullsized":"2024-09-12T18:08:41.080353+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:41.080224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:41.080224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.080224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:51.193117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'86","reported_seq":290,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:48.062315+0000","last_change":"2024-09-12T18:08:48.062222+0000","last_active":"2024-09-12T18:08:48.062315+0000","last_peered":"2024-09-12T18:08:48.062315+0000","last_clean":"2024-09-12T18:08:48.062315+0000","last_became_active":"2024-09-12T17:45:03.893452+0000","last_became_peered":"2024-09-12T17:45:03.893452+0000","last_unstale":"2024-09-12T18:08:48.062315+0000","last_undegraded":"2024-09-12T18:08:48.062315+0000","last_fullsized":"2024-09-12T18:08:48.062315+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-12T18:08:48.062121+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-12T18:08:48.062121+0000","last_clean_scrub_stamp":"2024-09-12T18:08:48.062121+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:31.934538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":452,"num_read_kb":321,"num_write":137,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.057507+0000","last_change":"2024-09-12T18:09:04.057507+0000","last_active":"2024-09-12T18:09:04.057507+0000","last_peered":"2024-09-12T18:09:04.057507+0000","last_clean":"2024-09-12T18:09:04.057507+0000","last_became_active":"2024-09-12T17:57:00.464068+0000","last_became_peered":"2024-09-12T17:57:00.464068+0000","last_unstale":"2024-09-12T18:09:04.057507+0000","last_undegraded":"2024-09-12T18:09:04.057507+0000","last_fullsized":"2024-09-12T18:09:04.057507+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:09:04.057414+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:09:04.057414+0000","last_clean_scrub_stamp":"2024-09-12T18:09:04.057414+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:00.303910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"264'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.229501+0000","last_change":"2024-09-12T18:08:47.229406+0000","last_active":"2024-09-12T18:08:47.229501+0000","last_peered":"2024-09-12T18:08:47.229501+0000","last_clean":"2024-09-12T18:08:47.229501+0000","last_became_active":"2024-09-12T17:46:45.206644+0000","last_became_peered":"2024-09-12T17:46:45.206644+0000","last_unstale":"2024-09-12T18:08:47.229501+0000","last_undegraded":"2024-09-12T18:08:47.229501+0000","last_fullsized":"2024-09-12T18:08:47.229501+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:47.229261+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:47.229261+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.229261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:32.062731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.353690+0000","last_change":"2024-09-12T18:08:54.353690+0000","last_active":"2024-09-12T18:08:54.353690+0000","last_peered":"2024-09-12T18:08:54.353690+0000","last_clean":"2024-09-12T18:08:54.353690+0000","last_became_active":"2024-09-12T17:46:42.184232+0000","last_became_peered":"2024-09-12T17:46:42.184232+0000","last_unstale":"2024-09-12T18:08:54.353690+0000","last_undegraded":"2024-09-12T18:08:54.353690+0000","last_fullsized":"2024-09-12T18:08:54.353690+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:54.353598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:54.353598+0000","last_clean_scrub_stamp":"2024-09-12T18:08:54.353598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:34.108336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:48.947007+0000","last_change":"2024-09-12T18:08:48.946940+0000","last_active":"2024-09-12T18:08:48.947007+0000","last_peered":"2024-09-12T18:08:48.947007+0000","last_clean":"2024-09-12T18:08:48.947007+0000","last_became_active":"2024-09-12T17:45:03.896663+0000","last_became_peered":"2024-09-12T17:45:03.896663+0000","last_unstale":"2024-09-12T18:08:48.947007+0000","last_undegraded":"2024-09-12T18:08:48.947007+0000","last_fullsized":"2024-09-12T18:08:48.947007+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T18:08:48.946856+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T18:08:48.946856+0000","last_clean_scrub_stamp":"2024-09-12T18:08:48.946856+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:37.430452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":95,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.472940+0000","last_change":"2024-09-12T18:09:04.472940+0000","last_active":"2024-09-12T18:09:04.472940+0000","last_peered":"2024-09-12T18:09:04.472940+0000","last_clean":"2024-09-12T18:09:04.472940+0000","last_became_active":"2024-09-12T17:57:00.465596+0000","last_became_peered":"2024-09-12T17:57:00.465596+0000","last_unstale":"2024-09-12T18:09:04.472940+0000","last_undegraded":"2024-09-12T18:09:04.472940+0000","last_fullsized":"2024-09-12T18:09:04.472940+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:04.472851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:04.472851+0000","last_clean_scrub_stamp":"2024-09-12T18:09:04.472851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:44.442587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.048452+0000","last_change":"2024-09-12T18:08:58.048452+0000","last_active":"2024-09-12T18:08:58.048452+0000","last_peered":"2024-09-12T18:08:58.048452+0000","last_clean":"2024-09-12T18:08:58.048452+0000","last_became_active":"2024-09-12T17:46:45.208019+0000","last_became_peered":"2024-09-12T17:46:45.208019+0000","last_unstale":"2024-09-12T18:08:58.048452+0000","last_undegraded":"2024-09-12T18:08:58.048452+0000","last_fullsized":"2024-09-12T18:08:58.048452+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:58.048359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:58.048359+0000","last_clean_scrub_stamp":"2024-09-12T18:08:58.048359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:12.396591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.644805+0000","last_change":"2024-09-12T18:08:45.644729+0000","last_active":"2024-09-12T18:08:45.644805+0000","last_peered":"2024-09-12T18:08:45.644805+0000","last_clean":"2024-09-12T18:08:45.644805+0000","last_became_active":"2024-09-12T17:46:42.184250+0000","last_became_peered":"2024-09-12T17:46:42.184250+0000","last_unstale":"2024-09-12T18:08:45.644805+0000","last_undegraded":"2024-09-12T18:08:45.644805+0000","last_fullsized":"2024-09-12T18:08:45.644805+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:45.644627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:45.644627+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.644627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:20.380257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'40","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.074883+0000","last_change":"2024-09-12T18:08:36.074825+0000","last_active":"2024-09-12T18:08:36.074883+0000","last_peered":"2024-09-12T18:08:36.074883+0000","last_clean":"2024-09-12T18:08:36.074883+0000","last_became_active":"2024-09-12T17:45:03.897291+0000","last_became_peered":"2024-09-12T17:45:03.897291+0000","last_unstale":"2024-09-12T18:08:36.074883+0000","last_undegraded":"2024-09-12T18:08:36.074883+0000","last_fullsized":"2024-09-12T18:08:36.074883+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-12T18:08:36.074737+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-12T18:08:36.074737+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.074737+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:38.882995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.998072+0000","last_change":"2024-09-12T18:08:59.997994+0000","last_active":"2024-09-12T18:08:59.998072+0000","last_peered":"2024-09-12T18:08:59.998072+0000","last_clean":"2024-09-12T18:08:59.998072+0000","last_became_active":"2024-09-12T17:57:00.465454+0000","last_became_peered":"2024-09-12T17:57:00.465454+0000","last_unstale":"2024-09-12T18:08:59.998072+0000","last_undegraded":"2024-09-12T18:08:59.998072+0000","last_fullsized":"2024-09-12T18:08:59.998072+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:59.997861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:59.997861+0000","last_clean_scrub_stamp":"2024-09-12T18:08:59.997861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:40.745237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:00.339979+0000","last_change":"2024-09-12T18:09:00.339979+0000","last_active":"2024-09-12T18:09:00.339979+0000","last_peered":"2024-09-12T18:09:00.339979+0000","last_clean":"2024-09-12T18:09:00.339979+0000","last_became_active":"2024-09-12T17:46:45.207607+0000","last_became_peered":"2024-09-12T17:46:45.207607+0000","last_unstale":"2024-09-12T18:09:00.339979+0000","last_undegraded":"2024-09-12T18:09:00.339979+0000","last_fullsized":"2024-09-12T18:09:00.339979+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:00.339838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:00.339838+0000","last_clean_scrub_stamp":"2024-09-12T18:09:00.339838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.327678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:52.059319+0000","last_change":"2024-09-12T18:08:52.059319+0000","last_active":"2024-09-12T18:08:52.059319+0000","last_peered":"2024-09-12T18:08:52.059319+0000","last_clean":"2024-09-12T18:08:52.059319+0000","last_became_active":"2024-09-12T17:46:42.182267+0000","last_became_peered":"2024-09-12T17:46:42.182267+0000","last_unstale":"2024-09-12T18:08:52.059319+0000","last_undegraded":"2024-09-12T18:08:52.059319+0000","last_fullsized":"2024-09-12T18:08:52.059319+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T18:08:52.059199+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T18:08:52.059199+0000","last_clean_scrub_stamp":"2024-09-12T18:08:52.059199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:10.029730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"261'54","reported_seq":203,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.395549+0000","last_change":"2024-09-12T18:08:47.395483+0000","last_active":"2024-09-12T18:08:47.395549+0000","last_peered":"2024-09-12T18:08:47.395549+0000","last_clean":"2024-09-12T18:08:47.395549+0000","last_became_active":"2024-09-12T17:45:03.891861+0000","last_became_peered":"2024-09-12T17:45:03.891861+0000","last_unstale":"2024-09-12T18:08:47.395549+0000","last_undegraded":"2024-09-12T18:08:47.395549+0000","last_fullsized":"2024-09-12T18:08:47.395549+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'54","last_scrub_stamp":"2024-09-12T18:08:47.395375+0000","last_deep_scrub":"261'54","last_deep_scrub_stamp":"2024-09-12T18:08:47.395375+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.395375+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:12.049380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":286,"num_read_kb":219,"num_write":84,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.342965+0000","last_change":"2024-09-12T18:08:55.342893+0000","last_active":"2024-09-12T18:08:55.342965+0000","last_peered":"2024-09-12T18:08:55.342965+0000","last_clean":"2024-09-12T18:08:55.342965+0000","last_became_active":"2024-09-12T17:57:00.466761+0000","last_became_peered":"2024-09-12T17:57:00.466761+0000","last_unstale":"2024-09-12T18:08:55.342965+0000","last_undegraded":"2024-09-12T18:08:55.342965+0000","last_fullsized":"2024-09-12T18:08:55.342965+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:55.342804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:55.342804+0000","last_clean_scrub_stamp":"2024-09-12T18:08:55.342804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:49.154953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.383863+0000","last_change":"2024-09-12T18:08:59.383863+0000","last_active":"2024-09-12T18:08:59.383863+0000","last_peered":"2024-09-12T18:08:59.383863+0000","last_clean":"2024-09-12T18:08:59.383863+0000","last_became_active":"2024-09-12T17:46:45.536927+0000","last_became_peered":"2024-09-12T17:46:45.536927+0000","last_unstale":"2024-09-12T18:08:59.383863+0000","last_undegraded":"2024-09-12T18:08:59.383863+0000","last_fullsized":"2024-09-12T18:08:59.383863+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:59.383782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:59.383782+0000","last_clean_scrub_stamp":"2024-09-12T18:08:59.383782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:04.683664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"261'5","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.385091+0000","last_change":"2024-09-12T18:08:32.385091+0000","last_active":"2024-09-12T18:08:32.385091+0000","last_peered":"2024-09-12T18:08:32.385091+0000","last_clean":"2024-09-12T18:08:32.385091+0000","last_became_active":"2024-09-12T17:46:42.182346+0000","last_became_peered":"2024-09-12T17:46:42.182346+0000","last_unstale":"2024-09-12T18:08:32.385091+0000","last_undegraded":"2024-09-12T18:08:32.385091+0000","last_fullsized":"2024-09-12T18:08:32.385091+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:08:32.384982+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:08:32.384982+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.384982+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:00.783251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'22","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.027459+0000","last_change":"2024-09-12T18:08:35.027396+0000","last_active":"2024-09-12T18:08:35.027459+0000","last_peered":"2024-09-12T18:08:35.027459+0000","last_clean":"2024-09-12T18:08:35.027459+0000","last_became_active":"2024-09-12T17:45:03.895580+0000","last_became_peered":"2024-09-12T17:45:03.895580+0000","last_unstale":"2024-09-12T18:08:35.027459+0000","last_undegraded":"2024-09-12T18:08:35.027459+0000","last_fullsized":"2024-09-12T18:08:35.027459+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-12T18:08:35.027312+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-12T18:08:35.027312+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.027312+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:45.152556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":39,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.218723+0000","last_change":"2024-09-12T18:08:49.218669+0000","last_active":"2024-09-12T18:08:49.218723+0000","last_peered":"2024-09-12T18:08:49.218723+0000","last_clean":"2024-09-12T18:08:49.218723+0000","last_became_active":"2024-09-12T17:57:00.462863+0000","last_became_peered":"2024-09-12T17:57:00.462863+0000","last_unstale":"2024-09-12T18:08:49.218723+0000","last_undegraded":"2024-09-12T18:08:49.218723+0000","last_fullsized":"2024-09-12T18:08:49.218723+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:49.218582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:49.218582+0000","last_clean_scrub_stamp":"2024-09-12T18:08:49.218582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.978566+0000","last_change":"2024-09-12T18:08:55.978566+0000","last_active":"2024-09-12T18:08:55.978566+0000","last_peered":"2024-09-12T18:08:55.978566+0000","last_clean":"2024-09-12T18:08:55.978566+0000","last_became_active":"2024-09-12T17:46:45.536831+0000","last_became_peered":"2024-09-12T17:46:45.536831+0000","last_unstale":"2024-09-12T18:08:55.978566+0000","last_undegraded":"2024-09-12T18:08:55.978566+0000","last_fullsized":"2024-09-12T18:08:55.978566+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T18:08:55.978474+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T18:08:55.978474+0000","last_clean_scrub_stamp":"2024-09-12T18:08:55.978474+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:44.132663+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'7","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:51.390454+0000","last_change":"2024-09-12T18:08:51.390454+0000","last_active":"2024-09-12T18:08:51.390454+0000","last_peered":"2024-09-12T18:08:51.390454+0000","last_clean":"2024-09-12T18:08:51.390454+0000","last_became_active":"2024-09-12T17:46:42.185216+0000","last_became_peered":"2024-09-12T17:46:42.185216+0000","last_unstale":"2024-09-12T18:08:51.390454+0000","last_undegraded":"2024-09-12T18:08:51.390454+0000","last_fullsized":"2024-09-12T18:08:51.390454+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T18:08:51.390365+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T18:08:51.390365+0000","last_clean_scrub_stamp":"2024-09-12T18:08:51.390365+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.879166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.070223+0000","last_change":"2024-09-12T18:08:47.070223+0000","last_active":"2024-09-12T18:08:47.070223+0000","last_peered":"2024-09-12T18:08:47.070223+0000","last_clean":"2024-09-12T18:08:47.070223+0000","last_became_active":"2024-09-12T17:45:03.894642+0000","last_became_peered":"2024-09-12T17:45:03.894642+0000","last_unstale":"2024-09-12T18:08:47.070223+0000","last_undegraded":"2024-09-12T18:08:47.070223+0000","last_fullsized":"2024-09-12T18:08:47.070223+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:47.070132+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:47.070132+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.070132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:12.119339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.653423+0000","last_change":"2024-09-12T18:08:55.653352+0000","last_active":"2024-09-12T18:08:55.653423+0000","last_peered":"2024-09-12T18:08:55.653423+0000","last_clean":"2024-09-12T18:08:55.653423+0000","last_became_active":"2024-09-12T17:57:00.465546+0000","last_became_peered":"2024-09-12T17:57:00.465546+0000","last_unstale":"2024-09-12T18:08:55.653423+0000","last_undegraded":"2024-09-12T18:08:55.653423+0000","last_fullsized":"2024-09-12T18:08:55.653423+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:55.653257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:55.653257+0000","last_clean_scrub_stamp":"2024-09-12T18:08:55.653257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:53.336014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'13","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:51.636064+0000","last_change":"2024-09-12T18:08:51.636064+0000","last_active":"2024-09-12T18:08:51.636064+0000","last_peered":"2024-09-12T18:08:51.636064+0000","last_clean":"2024-09-12T18:08:51.636064+0000","last_became_active":"2024-09-12T17:46:45.206537+0000","last_became_peered":"2024-09-12T17:46:45.206537+0000","last_unstale":"2024-09-12T18:08:51.636064+0000","last_undegraded":"2024-09-12T18:08:51.636064+0000","last_fullsized":"2024-09-12T18:08:51.636064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T18:08:51.635976+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T18:08:51.635976+0000","last_clean_scrub_stamp":"2024-09-12T18:08:51.635976+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:54.265158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29814,"num_write":18,"num_write_kb":19003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.010820+0000","last_change":"2024-09-12T18:08:54.010820+0000","last_active":"2024-09-12T18:08:54.010820+0000","last_peered":"2024-09-12T18:08:54.010820+0000","last_clean":"2024-09-12T18:08:54.010820+0000","last_became_active":"2024-09-12T17:46:42.177427+0000","last_became_peered":"2024-09-12T17:46:42.177427+0000","last_unstale":"2024-09-12T18:08:54.010820+0000","last_undegraded":"2024-09-12T18:08:54.010820+0000","last_fullsized":"2024-09-12T18:08:54.010820+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:54.010734+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:54.010734+0000","last_clean_scrub_stamp":"2024-09-12T18:08:54.010734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:25.811116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'157","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.188055+0000","last_change":"2024-09-12T18:08:38.188055+0000","last_active":"2024-09-12T18:08:38.188055+0000","last_peered":"2024-09-12T18:08:38.188055+0000","last_clean":"2024-09-12T18:08:38.188055+0000","last_became_active":"2024-09-12T17:45:03.898292+0000","last_became_peered":"2024-09-12T17:45:03.898292+0000","last_unstale":"2024-09-12T18:08:38.188055+0000","last_undegraded":"2024-09-12T18:08:38.188055+0000","last_fullsized":"2024-09-12T18:08:38.188055+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'157","last_scrub_stamp":"2024-09-12T18:08:38.187951+0000","last_deep_scrub":"264'157","last_deep_scrub_stamp":"2024-09-12T18:08:38.187951+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.187951+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:31.196604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":951,"num_read_kb":701,"num_write":196,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2490,"num_omap_keys":5,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.397676+0000","last_change":"2024-09-12T18:08:37.397676+0000","last_active":"2024-09-12T18:08:37.397676+0000","last_peered":"2024-09-12T18:08:37.397676+0000","last_clean":"2024-09-12T18:08:37.397676+0000","last_became_active":"2024-09-12T17:57:00.464090+0000","last_became_peered":"2024-09-12T17:57:00.464090+0000","last_unstale":"2024-09-12T18:08:37.397676+0000","last_undegraded":"2024-09-12T18:08:37.397676+0000","last_fullsized":"2024-09-12T18:08:37.397676+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:37.397578+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:37.397578+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.397578+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:24.082679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.126360+0000","last_change":"2024-09-12T18:08:42.126360+0000","last_active":"2024-09-12T18:08:42.126360+0000","last_peered":"2024-09-12T18:08:42.126360+0000","last_clean":"2024-09-12T18:08:42.126360+0000","last_became_active":"2024-09-12T17:46:45.205357+0000","last_became_peered":"2024-09-12T17:46:45.205357+0000","last_unstale":"2024-09-12T18:08:42.126360+0000","last_undegraded":"2024-09-12T18:08:42.126360+0000","last_fullsized":"2024-09-12T18:08:42.126360+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:42.126244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:42.126244+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.126244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:30.798441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.072066+0000","last_change":"2024-09-12T18:08:50.072066+0000","last_active":"2024-09-12T18:08:50.072066+0000","last_peered":"2024-09-12T18:08:50.072066+0000","last_clean":"2024-09-12T18:08:50.072066+0000","last_became_active":"2024-09-12T17:46:42.176415+0000","last_became_peered":"2024-09-12T17:46:42.176415+0000","last_unstale":"2024-09-12T18:08:50.072066+0000","last_undegraded":"2024-09-12T18:08:50.072066+0000","last_fullsized":"2024-09-12T18:08:50.072066+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:50.071979+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:50.071979+0000","last_clean_scrub_stamp":"2024-09-12T18:08:50.071979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:49.464626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'25","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.428990+0000","last_change":"2024-09-12T18:08:47.428990+0000","last_active":"2024-09-12T18:08:47.428990+0000","last_peered":"2024-09-12T18:08:47.428990+0000","last_clean":"2024-09-12T18:08:47.428990+0000","last_became_active":"2024-09-12T17:45:03.889334+0000","last_became_peered":"2024-09-12T17:45:03.889334+0000","last_unstale":"2024-09-12T18:08:47.428990+0000","last_undegraded":"2024-09-12T18:08:47.428990+0000","last_fullsized":"2024-09-12T18:08:47.428990+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-12T18:08:47.428859+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-12T18:08:47.428859+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.428859+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:31.400424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:03.430138+0000","last_change":"2024-09-12T18:09:03.430138+0000","last_active":"2024-09-12T18:09:03.430138+0000","last_peered":"2024-09-12T18:09:03.430138+0000","last_clean":"2024-09-12T18:09:03.430138+0000","last_became_active":"2024-09-12T17:57:00.453435+0000","last_became_peered":"2024-09-12T17:57:00.453435+0000","last_unstale":"2024-09-12T18:09:03.430138+0000","last_undegraded":"2024-09-12T18:09:03.430138+0000","last_fullsized":"2024-09-12T18:09:03.430138+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:03.430049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:03.430049+0000","last_clean_scrub_stamp":"2024-09-12T18:09:03.430049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:32.062864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"261'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:52.386558+0000","last_change":"2024-09-12T18:08:52.386494+0000","last_active":"2024-09-12T18:08:52.386558+0000","last_peered":"2024-09-12T18:08:52.386558+0000","last_clean":"2024-09-12T18:08:52.386558+0000","last_became_active":"2024-09-12T17:46:45.210669+0000","last_became_peered":"2024-09-12T17:46:45.210669+0000","last_unstale":"2024-09-12T18:08:52.386558+0000","last_undegraded":"2024-09-12T18:08:52.386558+0000","last_fullsized":"2024-09-12T18:08:52.386558+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T18:08:52.386396+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T18:08:52.386396+0000","last_clean_scrub_stamp":"2024-09-12T18:08:52.386396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:22.455595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:53.043359+0000","last_change":"2024-09-12T18:08:53.043359+0000","last_active":"2024-09-12T18:08:53.043359+0000","last_peered":"2024-09-12T18:08:53.043359+0000","last_clean":"2024-09-12T18:08:53.043359+0000","last_became_active":"2024-09-12T17:46:42.179369+0000","last_became_peered":"2024-09-12T17:46:42.179369+0000","last_unstale":"2024-09-12T18:08:53.043359+0000","last_undegraded":"2024-09-12T18:08:53.043359+0000","last_fullsized":"2024-09-12T18:08:53.043359+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:53.043248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:53.043248+0000","last_clean_scrub_stamp":"2024-09-12T18:08:53.043248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:48.637264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'11","reported_seq":82,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.629948+0000","last_change":"2024-09-12T18:08:47.629948+0000","last_active":"2024-09-12T18:08:47.629948+0000","last_peered":"2024-09-12T18:08:47.629948+0000","last_clean":"2024-09-12T18:08:47.629948+0000","last_became_active":"2024-09-12T17:45:03.891751+0000","last_became_peered":"2024-09-12T17:45:03.891751+0000","last_unstale":"2024-09-12T18:08:47.629948+0000","last_undegraded":"2024-09-12T18:08:47.629948+0000","last_fullsized":"2024-09-12T18:08:47.629948+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-12T18:08:47.629821+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-12T18:08:47.629821+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.629821+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:13.106639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:02.396731+0000","last_change":"2024-09-12T18:09:02.396680+0000","last_active":"2024-09-12T18:09:02.396731+0000","last_peered":"2024-09-12T18:09:02.396731+0000","last_clean":"2024-09-12T18:09:02.396731+0000","last_became_active":"2024-09-12T17:57:00.465706+0000","last_became_peered":"2024-09-12T17:57:00.465706+0000","last_unstale":"2024-09-12T18:09:02.396731+0000","last_undegraded":"2024-09-12T18:09:02.396731+0000","last_fullsized":"2024-09-12T18:09:02.396731+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:02.396580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:02.396580+0000","last_clean_scrub_stamp":"2024-09-12T18:09:02.396580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:16.843859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'8","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.040678+0000","last_change":"2024-09-12T18:08:42.040678+0000","last_active":"2024-09-12T18:08:42.040678+0000","last_peered":"2024-09-12T18:08:42.040678+0000","last_clean":"2024-09-12T18:08:42.040678+0000","last_became_active":"2024-09-12T17:46:45.206384+0000","last_became_peered":"2024-09-12T17:46:45.206384+0000","last_unstale":"2024-09-12T18:08:42.040678+0000","last_undegraded":"2024-09-12T18:08:42.040678+0000","last_fullsized":"2024-09-12T18:08:42.040678+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T18:08:42.040581+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T18:08:42.040581+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.040581+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:03.377618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":22528,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.118969+0000","last_change":"2024-09-12T18:08:40.118969+0000","last_active":"2024-09-12T18:08:40.118969+0000","last_peered":"2024-09-12T18:08:40.118969+0000","last_clean":"2024-09-12T18:08:40.118969+0000","last_became_active":"2024-09-12T17:46:42.177381+0000","last_became_peered":"2024-09-12T17:46:42.177381+0000","last_unstale":"2024-09-12T18:08:40.118969+0000","last_undegraded":"2024-09-12T18:08:40.118969+0000","last_fullsized":"2024-09-12T18:08:40.118969+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:40.118881+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:40.118881+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.118881+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:00.785132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.025529+0000","last_change":"2024-09-12T18:08:34.025529+0000","last_active":"2024-09-12T18:08:34.025529+0000","last_peered":"2024-09-12T18:08:34.025529+0000","last_clean":"2024-09-12T18:08:34.025529+0000","last_became_active":"2024-09-12T17:45:03.893234+0000","last_became_peered":"2024-09-12T17:45:03.893234+0000","last_unstale":"2024-09-12T18:08:34.025529+0000","last_undegraded":"2024-09-12T18:08:34.025529+0000","last_fullsized":"2024-09-12T18:08:34.025529+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T18:08:34.025436+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T18:08:34.025436+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.025436+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:27.725926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":127,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:09:00.965293+0000","last_change":"2024-09-12T18:09:00.965293+0000","last_active":"2024-09-12T18:09:00.965293+0000","last_peered":"2024-09-12T18:09:00.965293+0000","last_clean":"2024-09-12T18:09:00.965293+0000","last_became_active":"2024-09-12T17:57:00.466994+0000","last_became_peered":"2024-09-12T17:57:00.466994+0000","last_unstale":"2024-09-12T18:09:00.965293+0000","last_undegraded":"2024-09-12T18:09:00.965293+0000","last_fullsized":"2024-09-12T18:09:00.965293+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:09:00.965204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:09:00.965204+0000","last_clean_scrub_stamp":"2024-09-12T18:09:00.965204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:00.111849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.674925+0000","last_change":"2024-09-12T18:08:50.674925+0000","last_active":"2024-09-12T18:08:50.674925+0000","last_peered":"2024-09-12T18:08:50.674925+0000","last_clean":"2024-09-12T18:08:50.674925+0000","last_became_active":"2024-09-12T17:46:45.207552+0000","last_became_peered":"2024-09-12T17:46:45.207552+0000","last_unstale":"2024-09-12T18:08:50.674925+0000","last_undegraded":"2024-09-12T18:08:50.674925+0000","last_fullsized":"2024-09-12T18:08:50.674925+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:50.674829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:50.674829+0000","last_clean_scrub_stamp":"2024-09-12T18:08:50.674829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:03.783807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.014529+0000","last_change":"2024-09-12T18:08:40.014529+0000","last_active":"2024-09-12T18:08:40.014529+0000","last_peered":"2024-09-12T18:08:40.014529+0000","last_clean":"2024-09-12T18:08:40.014529+0000","last_became_active":"2024-09-12T17:46:42.181805+0000","last_became_peered":"2024-09-12T17:46:42.181805+0000","last_unstale":"2024-09-12T18:08:40.014529+0000","last_undegraded":"2024-09-12T18:08:40.014529+0000","last_fullsized":"2024-09-12T18:08:40.014529+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T18:08:40.014431+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T18:08:40.014431+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.014431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:47.203544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'23","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.036002+0000","last_change":"2024-09-12T18:08:46.035941+0000","last_active":"2024-09-12T18:08:46.036002+0000","last_peered":"2024-09-12T18:08:46.036002+0000","last_clean":"2024-09-12T18:08:46.036002+0000","last_became_active":"2024-09-12T17:45:03.893361+0000","last_became_peered":"2024-09-12T17:45:03.893361+0000","last_unstale":"2024-09-12T18:08:46.036002+0000","last_undegraded":"2024-09-12T18:08:46.036002+0000","last_fullsized":"2024-09-12T18:08:46.036002+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-12T18:08:46.035841+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-12T18:08:46.035841+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.035841+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:35.804923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":77,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'207","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.759390+0000","last_change":"2024-09-12T18:08:23.759272+0000","last_active":"2024-09-12T18:08:23.759390+0000","last_peered":"2024-09-12T18:08:23.759390+0000","last_clean":"2024-09-12T18:08:23.759390+0000","last_became_active":"2024-09-12T17:29:52.955124+0000","last_became_peered":"2024-09-12T17:29:52.955124+0000","last_unstale":"2024-09-12T18:08:23.759390+0000","last_undegraded":"2024-09-12T18:08:23.759390+0000","last_fullsized":"2024-09-12T18:08:23.759390+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:23.759131+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:23.759131+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.759131+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:37.285891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35675,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":3241,"num_write":1056,"num_write_kb":28474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'166","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.439354+0000","last_change":"2024-09-12T18:08:28.439354+0000","last_active":"2024-09-12T18:08:28.439354+0000","last_peered":"2024-09-12T18:08:28.439354+0000","last_clean":"2024-09-12T18:08:28.439354+0000","last_became_active":"2024-09-12T17:29:54.957047+0000","last_became_peered":"2024-09-12T17:29:54.957047+0000","last_unstale":"2024-09-12T18:08:28.439354+0000","last_undegraded":"2024-09-12T18:08:28.439354+0000","last_fullsized":"2024-09-12T18:08:28.439354+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T18:08:28.439256+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T18:08:28.439256+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.439256+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:06.350790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":598,"num_write":253,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'214","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.249789+0000","last_change":"2024-09-12T18:08:14.249725+0000","last_active":"2024-09-12T18:08:14.249789+0000","last_peered":"2024-09-12T18:08:14.249789+0000","last_clean":"2024-09-12T18:08:14.249789+0000","last_became_active":"2024-09-12T17:29:52.954249+0000","last_became_peered":"2024-09-12T17:29:52.954249+0000","last_unstale":"2024-09-12T18:08:14.249789+0000","last_undegraded":"2024-09-12T18:08:14.249789+0000","last_fullsized":"2024-09-12T18:08:14.249789+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-12T18:08:14.249628+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-12T18:08:14.249628+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.249628+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:16.628392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":62367,"num_write":1041,"num_write_kb":21747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'277","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.778646+0000","last_change":"2024-09-12T18:08:28.778646+0000","last_active":"2024-09-12T18:08:28.778646+0000","last_peered":"2024-09-12T18:08:28.778646+0000","last_clean":"2024-09-12T18:08:28.778646+0000","last_became_active":"2024-09-12T17:29:54.959503+0000","last_became_peered":"2024-09-12T17:29:54.959503+0000","last_unstale":"2024-09-12T18:08:28.778646+0000","last_undegraded":"2024-09-12T18:08:28.778646+0000","last_fullsized":"2024-09-12T18:08:28.778646+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'277","last_scrub_stamp":"2024-09-12T18:08:28.778560+0000","last_deep_scrub":"264'277","last_deep_scrub_stamp":"2024-09-12T18:08:28.778560+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.778560+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:46.698803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1203,"num_read_kb":968,"num_write":436,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'251","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.162824+0000","last_change":"2024-09-12T18:08:16.162765+0000","last_active":"2024-09-12T18:08:16.162824+0000","last_peered":"2024-09-12T18:08:16.162824+0000","last_clean":"2024-09-12T18:08:16.162824+0000","last_became_active":"2024-09-12T17:29:52.957594+0000","last_became_peered":"2024-09-12T17:29:52.957594+0000","last_unstale":"2024-09-12T18:08:16.162824+0000","last_undegraded":"2024-09-12T18:08:16.162824+0000","last_fullsized":"2024-09-12T18:08:16.162824+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T18:08:16.162633+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T18:08:16.162633+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.162633+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:03.752251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595238,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":699,"num_read_kb":82538,"num_write":1032,"num_write_kb":35611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'90","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.797499+0000","last_change":"2024-09-12T18:08:25.797499+0000","last_active":"2024-09-12T18:08:25.797499+0000","last_peered":"2024-09-12T18:08:25.797499+0000","last_clean":"2024-09-12T18:08:25.797499+0000","last_became_active":"2024-09-12T17:29:54.954764+0000","last_became_peered":"2024-09-12T17:29:54.954764+0000","last_unstale":"2024-09-12T18:08:25.797499+0000","last_undegraded":"2024-09-12T18:08:25.797499+0000","last_fullsized":"2024-09-12T18:08:25.797499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-09-12T18:08:25.797393+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-09-12T18:08:25.797393+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.797393+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:00.865693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":429,"num_read_kb":371,"num_write":125,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'210","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.448812+0000","last_change":"2024-09-12T18:08:22.448812+0000","last_active":"2024-09-12T18:08:22.448812+0000","last_peered":"2024-09-12T18:08:22.448812+0000","last_clean":"2024-09-12T18:08:22.448812+0000","last_became_active":"2024-09-12T17:29:52.956816+0000","last_became_peered":"2024-09-12T17:29:52.956816+0000","last_unstale":"2024-09-12T18:08:22.448812+0000","last_undegraded":"2024-09-12T18:08:22.448812+0000","last_fullsized":"2024-09-12T18:08:22.448812+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-12T18:08:22.448672+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-12T18:08:22.448672+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.448672+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:57.146612+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":70330,"num_write":999,"num_write_kb":42186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4089","reported_seq":4675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.210788+0000","last_change":"2024-09-12T18:08:24.210788+0000","last_active":"2024-09-12T18:08:24.210788+0000","last_peered":"2024-09-12T18:08:24.210788+0000","last_clean":"2024-09-12T18:08:24.210788+0000","last_became_active":"2024-09-12T17:29:54.944959+0000","last_became_peered":"2024-09-12T17:29:54.944959+0000","last_unstale":"2024-09-12T18:08:24.210788+0000","last_undegraded":"2024-09-12T18:08:24.210788+0000","last_fullsized":"2024-09-12T18:08:24.210788+0000","mapping_epoch":26,"log_start":"264'4000","ondisk_log_start":"264'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4089","last_scrub_stamp":"2024-09-12T18:08:24.210700+0000","last_deep_scrub":"264'4089","last_deep_scrub_stamp":"2024-09-12T18:08:24.210700+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.210700+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":3000,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:36.120715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16426,"num_read_kb":13705,"num_write":6135,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'163","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.724946+0000","last_change":"2024-09-12T18:08:22.724946+0000","last_active":"2024-09-12T18:08:22.724946+0000","last_peered":"2024-09-12T18:08:22.724946+0000","last_clean":"2024-09-12T18:08:22.724946+0000","last_became_active":"2024-09-12T17:29:52.960666+0000","last_became_peered":"2024-09-12T17:29:52.960666+0000","last_unstale":"2024-09-12T18:08:22.724946+0000","last_undegraded":"2024-09-12T18:08:22.724946+0000","last_fullsized":"2024-09-12T18:08:22.724946+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T18:08:22.724802+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T18:08:22.724802+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.724802+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:44.691765+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":500,"num_read_kb":127585,"num_write":826,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'125","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.067481+0000","last_change":"2024-09-12T18:08:22.067481+0000","last_active":"2024-09-12T18:08:22.067481+0000","last_peered":"2024-09-12T18:08:22.067481+0000","last_clean":"2024-09-12T18:08:22.067481+0000","last_became_active":"2024-09-12T17:29:54.955205+0000","last_became_peered":"2024-09-12T17:29:54.955205+0000","last_unstale":"2024-09-12T18:08:22.067481+0000","last_undegraded":"2024-09-12T18:08:22.067481+0000","last_fullsized":"2024-09-12T18:08:22.067481+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T18:08:22.067382+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T18:08:22.067382+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.067382+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:17.462304+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":437,"num_write":181,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'215","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.474026+0000","last_change":"2024-09-12T18:08:20.474026+0000","last_active":"2024-09-12T18:08:20.474026+0000","last_peered":"2024-09-12T18:08:20.474026+0000","last_clean":"2024-09-12T18:08:20.474026+0000","last_became_active":"2024-09-12T17:29:52.955926+0000","last_became_peered":"2024-09-12T17:29:52.955926+0000","last_unstale":"2024-09-12T18:08:20.474026+0000","last_undegraded":"2024-09-12T18:08:20.474026+0000","last_fullsized":"2024-09-12T18:08:20.474026+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'215","last_scrub_stamp":"2024-09-12T18:08:20.473907+0000","last_deep_scrub":"264'215","last_deep_scrub_stamp":"2024-09-12T18:08:20.473907+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.473907+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:59.079099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":501,"num_read_kb":5634,"num_write":1057,"num_write_kb":27185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'203","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.808057+0000","last_change":"2024-09-12T18:08:26.807971+0000","last_active":"2024-09-12T18:08:26.808057+0000","last_peered":"2024-09-12T18:08:26.808057+0000","last_clean":"2024-09-12T18:08:26.808057+0000","last_became_active":"2024-09-12T17:29:54.955119+0000","last_became_peered":"2024-09-12T17:29:54.955119+0000","last_unstale":"2024-09-12T18:08:26.808057+0000","last_undegraded":"2024-09-12T18:08:26.808057+0000","last_fullsized":"2024-09-12T18:08:26.808057+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-12T18:08:26.807847+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-12T18:08:26.807847+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.807847+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:28.820018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":872,"num_read_kb":697,"num_write":351,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'196","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.745850+0000","last_change":"2024-09-12T18:08:21.745850+0000","last_active":"2024-09-12T18:08:21.745850+0000","last_peered":"2024-09-12T18:08:21.745850+0000","last_clean":"2024-09-12T18:08:21.745850+0000","last_became_active":"2024-09-12T17:29:52.962236+0000","last_became_peered":"2024-09-12T17:29:52.962236+0000","last_unstale":"2024-09-12T18:08:21.745850+0000","last_undegraded":"2024-09-12T18:08:21.745850+0000","last_fullsized":"2024-09-12T18:08:21.745850+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-12T18:08:21.745689+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-12T18:08:21.745689+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.745689+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:04.341885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2835815,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":524,"num_read_kb":5167,"num_write":1014,"num_write_kb":25714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'272","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.447888+0000","last_change":"2024-09-12T18:08:29.447790+0000","last_active":"2024-09-12T18:08:29.447888+0000","last_peered":"2024-09-12T18:08:29.447888+0000","last_clean":"2024-09-12T18:08:29.447888+0000","last_became_active":"2024-09-12T17:29:54.963665+0000","last_became_peered":"2024-09-12T17:29:54.963665+0000","last_unstale":"2024-09-12T18:08:29.447888+0000","last_undegraded":"2024-09-12T18:08:29.447888+0000","last_fullsized":"2024-09-12T18:08:29.447888+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-12T18:08:29.447694+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-12T18:08:29.447694+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.447694+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:07.379854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1246,"num_read_kb":1040,"num_write":431,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'231","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.106919+0000","last_change":"2024-09-12T18:08:16.106919+0000","last_active":"2024-09-12T18:08:16.106919+0000","last_peered":"2024-09-12T18:08:16.106919+0000","last_clean":"2024-09-12T18:08:16.106919+0000","last_became_active":"2024-09-12T17:29:52.955333+0000","last_became_peered":"2024-09-12T17:29:52.955333+0000","last_unstale":"2024-09-12T18:08:16.106919+0000","last_undegraded":"2024-09-12T18:08:16.106919+0000","last_fullsized":"2024-09-12T18:08:16.106919+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-12T18:08:16.106773+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-12T18:08:16.106773+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.106773+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:19.227426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569139,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":94260,"num_write":1118,"num_write_kb":40355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'158","reported_seq":776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.404201+0000","last_change":"2024-09-12T18:08:23.404145+0000","last_active":"2024-09-12T18:08:23.404201+0000","last_peered":"2024-09-12T18:08:23.404201+0000","last_clean":"2024-09-12T18:08:23.404201+0000","last_became_active":"2024-09-12T17:29:54.952536+0000","last_became_peered":"2024-09-12T17:29:54.952536+0000","last_unstale":"2024-09-12T18:08:23.404201+0000","last_undegraded":"2024-09-12T18:08:23.404201+0000","last_fullsized":"2024-09-12T18:08:23.404201+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'158","last_scrub_stamp":"2024-09-12T18:08:23.404033+0000","last_deep_scrub":"264'158","last_deep_scrub_stamp":"2024-09-12T18:08:23.404033+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.404033+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:50.664895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":729,"num_read_kb":604,"num_write":248,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'402","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.806677+0000","last_change":"2024-09-12T18:08:23.806677+0000","last_active":"2024-09-12T18:08:23.806677+0000","last_peered":"2024-09-12T18:08:23.806677+0000","last_clean":"2024-09-12T18:08:23.806677+0000","last_became_active":"2024-09-12T17:29:54.954401+0000","last_became_peered":"2024-09-12T17:29:54.954401+0000","last_unstale":"2024-09-12T18:08:23.806677+0000","last_undegraded":"2024-09-12T18:08:23.806677+0000","last_fullsized":"2024-09-12T18:08:23.806677+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'402","last_scrub_stamp":"2024-09-12T18:08:23.806573+0000","last_deep_scrub":"264'402","last_deep_scrub_stamp":"2024-09-12T18:08:23.806573+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.806573+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:47.510776+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1720,"num_read_kb":1358,"num_write":655,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'182","reported_seq":769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.710577+0000","last_change":"2024-09-12T18:08:20.710509+0000","last_active":"2024-09-12T18:08:20.710577+0000","last_peered":"2024-09-12T18:08:20.710577+0000","last_clean":"2024-09-12T18:08:20.710577+0000","last_became_active":"2024-09-12T17:29:52.957715+0000","last_became_peered":"2024-09-12T17:29:52.957715+0000","last_unstale":"2024-09-12T18:08:20.710577+0000","last_undegraded":"2024-09-12T18:08:20.710577+0000","last_fullsized":"2024-09-12T18:08:20.710577+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-12T18:08:20.710410+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-12T18:08:20.710410+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.710410+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:15.953280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":322,"num_read_kb":380,"num_write":908,"num_write_kb":20925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'92","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.775080+0000","last_change":"2024-09-12T18:08:26.775080+0000","last_active":"2024-09-12T18:08:26.775080+0000","last_peered":"2024-09-12T18:08:26.775080+0000","last_clean":"2024-09-12T18:08:26.775080+0000","last_became_active":"2024-09-12T17:29:54.960430+0000","last_became_peered":"2024-09-12T17:29:54.960430+0000","last_unstale":"2024-09-12T18:08:26.775080+0000","last_undegraded":"2024-09-12T18:08:26.775080+0000","last_fullsized":"2024-09-12T18:08:26.775080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-12T18:08:26.774978+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-12T18:08:26.774978+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.774978+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:22.519253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":446,"num_read_kb":372,"num_write":151,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'245","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.079535+0000","last_change":"2024-09-12T18:08:16.079473+0000","last_active":"2024-09-12T18:08:16.079535+0000","last_peered":"2024-09-12T18:08:16.079535+0000","last_clean":"2024-09-12T18:08:16.079535+0000","last_became_active":"2024-09-12T17:29:52.960770+0000","last_became_peered":"2024-09-12T17:29:52.960770+0000","last_unstale":"2024-09-12T18:08:16.079535+0000","last_undegraded":"2024-09-12T18:08:16.079535+0000","last_fullsized":"2024-09-12T18:08:16.079535+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T18:08:16.079351+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T18:08:16.079351+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.079351+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:46.777517+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291498,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":825,"num_read_kb":13405,"num_write":1115,"num_write_kb":28936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'257","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.420438+0000","last_change":"2024-09-12T18:08:24.420438+0000","last_active":"2024-09-12T18:08:24.420438+0000","last_peered":"2024-09-12T18:08:24.420438+0000","last_clean":"2024-09-12T18:08:24.420438+0000","last_became_active":"2024-09-12T17:29:54.962822+0000","last_became_peered":"2024-09-12T17:29:54.962822+0000","last_unstale":"2024-09-12T18:08:24.420438+0000","last_undegraded":"2024-09-12T18:08:24.420438+0000","last_fullsized":"2024-09-12T18:08:24.420438+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-09-12T18:08:24.420342+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-09-12T18:08:24.420342+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.420342+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:43.478734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1220,"num_read_kb":1023,"num_write":434,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'208","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.047387+0000","last_change":"2024-09-12T18:08:17.047282+0000","last_active":"2024-09-12T18:08:17.047387+0000","last_peered":"2024-09-12T18:08:17.047387+0000","last_clean":"2024-09-12T18:08:17.047387+0000","last_became_active":"2024-09-12T17:29:52.956432+0000","last_became_peered":"2024-09-12T17:29:52.956432+0000","last_unstale":"2024-09-12T18:08:17.047387+0000","last_undegraded":"2024-09-12T18:08:17.047387+0000","last_fullsized":"2024-09-12T18:08:17.047387+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T18:08:17.047159+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T18:08:17.047159+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.047159+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:56.216084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306456,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":42949,"num_write":1043,"num_write_kb":37671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'84","reported_seq":678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.431445+0000","last_change":"2024-09-12T18:08:18.431383+0000","last_active":"2024-09-12T18:08:18.431445+0000","last_peered":"2024-09-12T18:08:18.431445+0000","last_clean":"2024-09-12T18:08:18.431445+0000","last_became_active":"2024-09-12T17:29:54.944588+0000","last_became_peered":"2024-09-12T17:29:54.944588+0000","last_unstale":"2024-09-12T18:08:18.431445+0000","last_undegraded":"2024-09-12T18:08:18.431445+0000","last_fullsized":"2024-09-12T18:08:18.431445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T18:08:18.431281+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T18:08:18.431281+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.431281+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:42.771743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":342,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'232","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.778834+0000","last_change":"2024-09-12T18:08:09.778762+0000","last_active":"2024-09-12T18:08:09.778834+0000","last_peered":"2024-09-12T18:08:09.778834+0000","last_clean":"2024-09-12T18:08:09.778834+0000","last_became_active":"2024-09-12T17:29:52.962814+0000","last_became_peered":"2024-09-12T17:29:52.962814+0000","last_unstale":"2024-09-12T18:08:09.778834+0000","last_undegraded":"2024-09-12T18:08:09.778834+0000","last_fullsized":"2024-09-12T18:08:09.778834+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-09-12T18:08:09.778651+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-09-12T18:08:09.778651+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.778651+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:58.056507+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":494,"num_read_kb":48249,"num_write":1130,"num_write_kb":37209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'126","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.419392+0000","last_change":"2024-09-12T18:08:19.419319+0000","last_active":"2024-09-12T18:08:19.419392+0000","last_peered":"2024-09-12T18:08:19.419392+0000","last_clean":"2024-09-12T18:08:19.419392+0000","last_became_active":"2024-09-12T17:29:54.956975+0000","last_became_peered":"2024-09-12T17:29:54.956975+0000","last_unstale":"2024-09-12T18:08:19.419392+0000","last_undegraded":"2024-09-12T18:08:19.419392+0000","last_fullsized":"2024-09-12T18:08:19.419392+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-12T18:08:19.419239+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-12T18:08:19.419239+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.419239+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:11.813359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":592,"num_read_kb":498,"num_write":187,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'266","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.067750+0000","last_change":"2024-09-12T18:08:14.067674+0000","last_active":"2024-09-12T18:08:14.067750+0000","last_peered":"2024-09-12T18:08:14.067750+0000","last_clean":"2024-09-12T18:08:14.067750+0000","last_became_active":"2024-09-12T17:29:52.954630+0000","last_became_peered":"2024-09-12T17:29:52.954630+0000","last_unstale":"2024-09-12T18:08:14.067750+0000","last_undegraded":"2024-09-12T18:08:14.067750+0000","last_fullsized":"2024-09-12T18:08:14.067750+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T18:08:14.067562+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T18:08:14.067562+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.067562+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:04.519905+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456483,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":845,"num_read_kb":67267,"num_write":1133,"num_write_kb":48740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'283","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.846460+0000","last_change":"2024-09-12T18:08:24.846394+0000","last_active":"2024-09-12T18:08:24.846460+0000","last_peered":"2024-09-12T18:08:24.846460+0000","last_clean":"2024-09-12T18:08:24.846460+0000","last_became_active":"2024-09-12T17:29:54.958852+0000","last_became_peered":"2024-09-12T17:29:54.958852+0000","last_unstale":"2024-09-12T18:08:24.846460+0000","last_undegraded":"2024-09-12T18:08:24.846460+0000","last_fullsized":"2024-09-12T18:08:24.846460+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'283","last_scrub_stamp":"2024-09-12T18:08:24.846301+0000","last_deep_scrub":"264'283","last_deep_scrub_stamp":"2024-09-12T18:08:24.846301+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.846301+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:55.554420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1254,"num_read_kb":1035,"num_write":436,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'170","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.123138+0000","last_change":"2024-09-12T18:08:14.123138+0000","last_active":"2024-09-12T18:08:14.123138+0000","last_peered":"2024-09-12T18:08:14.123138+0000","last_clean":"2024-09-12T18:08:14.123138+0000","last_became_active":"2024-09-12T17:29:52.959175+0000","last_became_peered":"2024-09-12T17:29:52.959175+0000","last_unstale":"2024-09-12T18:08:14.123138+0000","last_undegraded":"2024-09-12T18:08:14.123138+0000","last_fullsized":"2024-09-12T18:08:14.123138+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-09-12T18:08:14.123015+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-09-12T18:08:14.123015+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.123015+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:26.240900+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":1243,"num_write":851,"num_write_kb":36341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'157","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.836312+0000","last_change":"2024-09-12T18:08:37.836250+0000","last_active":"2024-09-12T18:08:37.836312+0000","last_peered":"2024-09-12T18:08:37.836312+0000","last_clean":"2024-09-12T18:08:37.836312+0000","last_became_active":"2024-09-12T17:30:02.964492+0000","last_became_peered":"2024-09-12T17:30:02.964492+0000","last_unstale":"2024-09-12T18:08:37.836312+0000","last_undegraded":"2024-09-12T18:08:37.836312+0000","last_fullsized":"2024-09-12T18:08:37.836312+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'157","last_scrub_stamp":"2024-09-12T18:08:37.836168+0000","last_deep_scrub":"264'157","last_deep_scrub_stamp":"2024-09-12T18:08:37.836168+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.836168+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:03.859804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":218,"num_read_kb":205,"num_write":360,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'110","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.069383+0000","last_change":"2024-09-12T18:08:20.069383+0000","last_active":"2024-09-12T18:08:20.069383+0000","last_peered":"2024-09-12T18:08:20.069383+0000","last_clean":"2024-09-12T18:08:20.069383+0000","last_became_active":"2024-09-12T17:29:54.950633+0000","last_became_peered":"2024-09-12T17:29:54.950633+0000","last_unstale":"2024-09-12T18:08:20.069383+0000","last_undegraded":"2024-09-12T18:08:20.069383+0000","last_fullsized":"2024-09-12T18:08:20.069383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-12T18:08:20.069263+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-12T18:08:20.069263+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.069263+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:55.109697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":400,"num_write":147,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'201","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.722577+0000","last_change":"2024-09-12T18:08:16.722577+0000","last_active":"2024-09-12T18:08:16.722577+0000","last_peered":"2024-09-12T18:08:16.722577+0000","last_clean":"2024-09-12T18:08:16.722577+0000","last_became_active":"2024-09-12T17:30:28.007183+0000","last_became_peered":"2024-09-12T17:30:28.007183+0000","last_unstale":"2024-09-12T18:08:16.722577+0000","last_undegraded":"2024-09-12T18:08:16.722577+0000","last_fullsized":"2024-09-12T18:08:16.722577+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-12T18:08:16.722467+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-12T18:08:16.722467+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.722467+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:25.320294+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":918,"num_read_kb":19617,"num_write":951,"num_write_kb":33635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"264'4","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.504138+0000","last_change":"2024-09-12T18:08:32.504066+0000","last_active":"2024-09-12T18:08:32.504138+0000","last_peered":"2024-09-12T18:08:32.504138+0000","last_clean":"2024-09-12T18:08:32.504138+0000","last_became_active":"2024-09-12T17:29:56.954488+0000","last_became_peered":"2024-09-12T17:29:56.954488+0000","last_unstale":"2024-09-12T18:08:32.504138+0000","last_undegraded":"2024-09-12T18:08:32.504138+0000","last_fullsized":"2024-09-12T18:08:32.504138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:08:32.503973+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:08:32.503973+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.503973+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:44.475732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":724,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'181","reported_seq":784,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.270942+0000","last_change":"2024-09-12T18:08:30.270883+0000","last_active":"2024-09-12T18:08:30.270942+0000","last_peered":"2024-09-12T18:08:30.270942+0000","last_clean":"2024-09-12T18:08:30.270942+0000","last_became_active":"2024-09-12T17:29:58.956916+0000","last_became_peered":"2024-09-12T17:29:58.956916+0000","last_unstale":"2024-09-12T18:08:30.270942+0000","last_undegraded":"2024-09-12T18:08:30.270942+0000","last_fullsized":"2024-09-12T18:08:30.270942+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'181","last_scrub_stamp":"2024-09-12T18:08:30.270791+0000","last_deep_scrub":"264'181","last_deep_scrub_stamp":"2024-09-12T18:08:30.270791+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.270791+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:27.185524+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4406,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":236,"num_read_kb":279,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.990492+0000","last_change":"2024-09-12T18:08:40.990391+0000","last_active":"2024-09-12T18:08:40.990492+0000","last_peered":"2024-09-12T18:08:40.990492+0000","last_clean":"2024-09-12T18:08:40.990492+0000","last_became_active":"2024-09-12T17:30:00.960409+0000","last_became_peered":"2024-09-12T17:30:00.960409+0000","last_unstale":"2024-09-12T18:08:40.990492+0000","last_undegraded":"2024-09-12T18:08:40.990492+0000","last_fullsized":"2024-09-12T18:08:40.990492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:40.990277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:40.990277+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.990277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:06.362958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2447","reported_seq":4380,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.459056+0000","last_change":"2024-09-12T18:08:46.458993+0000","last_active":"2024-09-12T18:08:46.459056+0000","last_peered":"2024-09-12T18:08:46.459056+0000","last_clean":"2024-09-12T18:08:46.459056+0000","last_became_active":"2024-09-12T17:30:02.967718+0000","last_became_peered":"2024-09-12T17:30:02.967718+0000","last_unstale":"2024-09-12T18:08:46.459056+0000","last_undegraded":"2024-09-12T18:08:46.459056+0000","last_fullsized":"2024-09-12T18:08:46.459056+0000","mapping_epoch":34,"log_start":"264'2400","ondisk_log_start":"264'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2447","last_scrub_stamp":"2024-09-12T18:08:46.458874+0000","last_deep_scrub":"264'2447","last_deep_scrub_stamp":"2024-09-12T18:08:46.458874+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.458874+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":2400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:42.505556+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1044,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6319,"num_read_kb":6274,"num_write":4873,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'137","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.422157+0000","last_change":"2024-09-12T18:08:25.422081+0000","last_active":"2024-09-12T18:08:25.422157+0000","last_peered":"2024-09-12T18:08:25.422157+0000","last_clean":"2024-09-12T18:08:25.422157+0000","last_became_active":"2024-09-12T17:29:54.957747+0000","last_became_peered":"2024-09-12T17:29:54.957747+0000","last_unstale":"2024-09-12T18:08:25.422157+0000","last_undegraded":"2024-09-12T18:08:25.422157+0000","last_fullsized":"2024-09-12T18:08:25.422157+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T18:08:25.421998+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T18:08:25.421998+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.421998+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:49.865865+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":552,"num_write":215,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2873,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'213","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.155495+0000","last_change":"2024-09-12T18:08:09.155495+0000","last_active":"2024-09-12T18:08:09.155495+0000","last_peered":"2024-09-12T18:08:09.155495+0000","last_clean":"2024-09-12T18:08:09.155495+0000","last_became_active":"2024-09-12T17:29:52.950612+0000","last_became_peered":"2024-09-12T17:29:52.950612+0000","last_unstale":"2024-09-12T18:08:09.155495+0000","last_undegraded":"2024-09-12T18:08:09.155495+0000","last_fullsized":"2024-09-12T18:08:09.155495+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-09-12T18:08:09.155405+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-09-12T18:08:09.155405+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.155405+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:06.394522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":421,"num_read_kb":10994,"num_write":1027,"num_write_kb":32732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.988172+0000","last_change":"2024-09-12T18:08:27.988172+0000","last_active":"2024-09-12T18:08:27.988172+0000","last_peered":"2024-09-12T18:08:27.988172+0000","last_clean":"2024-09-12T18:08:27.988172+0000","last_became_active":"2024-09-12T17:29:56.953546+0000","last_became_peered":"2024-09-12T17:29:56.953546+0000","last_unstale":"2024-09-12T18:08:27.988172+0000","last_undegraded":"2024-09-12T18:08:27.988172+0000","last_fullsized":"2024-09-12T18:08:27.988172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.988088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.988088+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.988088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:29.059380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'89","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.836068+0000","last_change":"2024-09-12T18:08:33.835983+0000","last_active":"2024-09-12T18:08:33.836068+0000","last_peered":"2024-09-12T18:08:33.836068+0000","last_clean":"2024-09-12T18:08:33.836068+0000","last_became_active":"2024-09-12T17:29:58.951077+0000","last_became_peered":"2024-09-12T17:29:58.951077+0000","last_unstale":"2024-09-12T18:08:33.836068+0000","last_undegraded":"2024-09-12T18:08:33.836068+0000","last_fullsized":"2024-09-12T18:08:33.836068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-09-12T18:08:33.835852+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-09-12T18:08:33.835852+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.835852+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:16.577451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":84,"num_read_kb":80,"num_write":58,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.813183+0000","last_change":"2024-09-12T18:08:35.813108+0000","last_active":"2024-09-12T18:08:35.813183+0000","last_peered":"2024-09-12T18:08:35.813183+0000","last_clean":"2024-09-12T18:08:35.813183+0000","last_became_active":"2024-09-12T17:30:00.969291+0000","last_became_peered":"2024-09-12T17:30:00.969291+0000","last_unstale":"2024-09-12T18:08:35.813183+0000","last_undegraded":"2024-09-12T18:08:35.813183+0000","last_fullsized":"2024-09-12T18:08:35.813183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:35.813023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:35.813023+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.813023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:58.218750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'127","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.385530+0000","last_change":"2024-09-12T18:08:44.385530+0000","last_active":"2024-09-12T18:08:44.385530+0000","last_peered":"2024-09-12T18:08:44.385530+0000","last_clean":"2024-09-12T18:08:44.385530+0000","last_became_active":"2024-09-12T17:30:02.971843+0000","last_became_peered":"2024-09-12T17:30:02.971843+0000","last_unstale":"2024-09-12T18:08:44.385530+0000","last_undegraded":"2024-09-12T18:08:44.385530+0000","last_fullsized":"2024-09-12T18:08:44.385530+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-12T18:08:44.385450+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-12T18:08:44.385450+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.385450+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:19.255428+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":313,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'129","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.116982+0000","last_change":"2024-09-12T18:08:19.116925+0000","last_active":"2024-09-12T18:08:19.116982+0000","last_peered":"2024-09-12T18:08:19.116982+0000","last_clean":"2024-09-12T18:08:19.116982+0000","last_became_active":"2024-09-12T17:29:54.944698+0000","last_became_peered":"2024-09-12T17:29:54.944698+0000","last_unstale":"2024-09-12T18:08:19.116982+0000","last_undegraded":"2024-09-12T18:08:19.116982+0000","last_fullsized":"2024-09-12T18:08:19.116982+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T18:08:19.116839+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T18:08:19.116839+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.116839+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:21.922508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":422,"num_write":199,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'178","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.665158+0000","last_change":"2024-09-12T18:08:18.665158+0000","last_active":"2024-09-12T18:08:18.665158+0000","last_peered":"2024-09-12T18:08:18.665158+0000","last_clean":"2024-09-12T18:08:18.665158+0000","last_became_active":"2024-09-12T17:29:52.963087+0000","last_became_peered":"2024-09-12T17:29:52.963087+0000","last_unstale":"2024-09-12T18:08:18.665158+0000","last_undegraded":"2024-09-12T18:08:18.665158+0000","last_fullsized":"2024-09-12T18:08:18.665158+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-12T18:08:18.665031+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-12T18:08:18.665031+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.665031+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:53.506644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128531,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":3190,"num_write":917,"num_write_kb":30863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.998246+0000","last_change":"2024-09-12T18:08:29.998182+0000","last_active":"2024-09-12T18:08:29.998246+0000","last_peered":"2024-09-12T18:08:29.998246+0000","last_clean":"2024-09-12T18:08:29.998246+0000","last_became_active":"2024-09-12T17:29:56.952827+0000","last_became_peered":"2024-09-12T17:29:56.952827+0000","last_unstale":"2024-09-12T18:08:29.998246+0000","last_undegraded":"2024-09-12T18:08:29.998246+0000","last_fullsized":"2024-09-12T18:08:29.998246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:29.998095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:29.998095+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.998095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:17.333075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'103","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.426608+0000","last_change":"2024-09-12T18:08:26.426608+0000","last_active":"2024-09-12T18:08:26.426608+0000","last_peered":"2024-09-12T18:08:26.426608+0000","last_clean":"2024-09-12T18:08:26.426608+0000","last_became_active":"2024-09-12T17:29:58.952169+0000","last_became_peered":"2024-09-12T17:29:58.952169+0000","last_unstale":"2024-09-12T18:08:26.426608+0000","last_undegraded":"2024-09-12T18:08:26.426608+0000","last_fullsized":"2024-09-12T18:08:26.426608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'103","last_scrub_stamp":"2024-09-12T18:08:26.426525+0000","last_deep_scrub":"264'103","last_deep_scrub_stamp":"2024-09-12T18:08:26.426525+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.426525+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:57.793772+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":103,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'755","reported_seq":2414,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.994037+0000","last_change":"2024-09-12T18:08:41.993968+0000","last_active":"2024-09-12T18:08:41.994037+0000","last_peered":"2024-09-12T18:08:41.994037+0000","last_clean":"2024-09-12T18:08:41.994037+0000","last_became_active":"2024-09-12T17:30:00.954180+0000","last_became_peered":"2024-09-12T17:30:00.954180+0000","last_unstale":"2024-09-12T18:08:41.994037+0000","last_undegraded":"2024-09-12T18:08:41.994037+0000","last_fullsized":"2024-09-12T18:08:41.994037+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'755","last_scrub_stamp":"2024-09-12T18:08:41.993869+0000","last_deep_scrub":"264'755","last_deep_scrub_stamp":"2024-09-12T18:08:41.993869+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.993869+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:21.785678+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'182","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.753087+0000","last_change":"2024-09-12T18:08:40.753087+0000","last_active":"2024-09-12T18:08:40.753087+0000","last_peered":"2024-09-12T18:08:40.753087+0000","last_clean":"2024-09-12T18:08:40.753087+0000","last_became_active":"2024-09-12T17:30:02.961198+0000","last_became_peered":"2024-09-12T17:30:02.961198+0000","last_unstale":"2024-09-12T18:08:40.753087+0000","last_undegraded":"2024-09-12T18:08:40.753087+0000","last_fullsized":"2024-09-12T18:08:40.753087+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-12T18:08:40.752993+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-12T18:08:40.752993+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.752993+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:04.570541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":624,"num_write":393,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'95","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.075608+0000","last_change":"2024-09-12T18:08:21.075530+0000","last_active":"2024-09-12T18:08:21.075608+0000","last_peered":"2024-09-12T18:08:21.075608+0000","last_clean":"2024-09-12T18:08:21.075608+0000","last_became_active":"2024-09-12T17:29:54.956663+0000","last_became_peered":"2024-09-12T17:29:54.956663+0000","last_unstale":"2024-09-12T18:08:21.075608+0000","last_undegraded":"2024-09-12T18:08:21.075608+0000","last_fullsized":"2024-09-12T18:08:21.075608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'95","last_scrub_stamp":"2024-09-12T18:08:21.075428+0000","last_deep_scrub":"264'95","last_deep_scrub_stamp":"2024-09-12T18:08:21.075428+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.075428+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:39.799375+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":356,"num_write":140,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'167","reported_seq":772,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.026722+0000","last_change":"2024-09-12T18:08:12.026722+0000","last_active":"2024-09-12T18:08:12.026722+0000","last_peered":"2024-09-12T18:08:12.026722+0000","last_clean":"2024-09-12T18:08:12.026722+0000","last_became_active":"2024-09-12T17:29:52.962665+0000","last_became_peered":"2024-09-12T17:29:52.962665+0000","last_unstale":"2024-09-12T18:08:12.026722+0000","last_undegraded":"2024-09-12T18:08:12.026722+0000","last_fullsized":"2024-09-12T18:08:12.026722+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-09-12T18:08:12.026621+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-09-12T18:08:12.026621+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.026621+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:49.096759+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":354,"num_read_kb":5731,"num_write":816,"num_write_kb":29128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.503672+0000","last_change":"2024-09-12T18:08:33.503610+0000","last_active":"2024-09-12T18:08:33.503672+0000","last_peered":"2024-09-12T18:08:33.503672+0000","last_clean":"2024-09-12T18:08:33.503672+0000","last_became_active":"2024-09-12T17:29:56.952625+0000","last_became_peered":"2024-09-12T17:29:56.952625+0000","last_unstale":"2024-09-12T18:08:33.503672+0000","last_undegraded":"2024-09-12T18:08:33.503672+0000","last_fullsized":"2024-09-12T18:08:33.503672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:33.503515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:33.503515+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.503515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:18.890954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'109","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.934134+0000","last_change":"2024-09-12T18:08:36.934077+0000","last_active":"2024-09-12T18:08:36.934134+0000","last_peered":"2024-09-12T18:08:36.934134+0000","last_clean":"2024-09-12T18:08:36.934134+0000","last_became_active":"2024-09-12T17:29:58.978299+0000","last_became_peered":"2024-09-12T17:29:58.978299+0000","last_unstale":"2024-09-12T18:08:36.934134+0000","last_undegraded":"2024-09-12T18:08:36.934134+0000","last_fullsized":"2024-09-12T18:08:36.934134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-12T18:08:36.933983+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-12T18:08:36.933983+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.933983+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:11.454887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'777","reported_seq":3928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.862355+0000","last_change":"2024-09-12T18:08:40.862355+0000","last_active":"2024-09-12T18:08:40.862355+0000","last_peered":"2024-09-12T18:08:40.862355+0000","last_clean":"2024-09-12T18:08:40.862355+0000","last_became_active":"2024-09-12T17:30:00.962754+0000","last_became_peered":"2024-09-12T17:30:00.962754+0000","last_unstale":"2024-09-12T18:08:40.862355+0000","last_undegraded":"2024-09-12T18:08:40.862355+0000","last_fullsized":"2024-09-12T18:08:40.862355+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'777","last_scrub_stamp":"2024-09-12T18:08:40.862268+0000","last_deep_scrub":"264'777","last_deep_scrub_stamp":"2024-09-12T18:08:40.862268+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.862268+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:57.506437+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'251","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.399138+0000","last_change":"2024-09-12T18:08:23.399080+0000","last_active":"2024-09-12T18:08:23.399138+0000","last_peered":"2024-09-12T18:08:23.399138+0000","last_clean":"2024-09-12T18:08:23.399138+0000","last_became_active":"2024-09-12T17:29:54.957148+0000","last_became_peered":"2024-09-12T17:29:54.957148+0000","last_unstale":"2024-09-12T18:08:23.399138+0000","last_undegraded":"2024-09-12T18:08:23.399138+0000","last_fullsized":"2024-09-12T18:08:23.399138+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T18:08:23.398990+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T18:08:23.398990+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.398990+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:10.788896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":968,"num_write":398,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'237","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.672401+0000","last_change":"2024-09-12T18:08:15.672401+0000","last_active":"2024-09-12T18:08:15.672401+0000","last_peered":"2024-09-12T18:08:15.672401+0000","last_clean":"2024-09-12T18:08:15.672401+0000","last_became_active":"2024-09-12T17:29:52.964421+0000","last_became_peered":"2024-09-12T17:29:52.964421+0000","last_unstale":"2024-09-12T18:08:15.672401+0000","last_undegraded":"2024-09-12T18:08:15.672401+0000","last_fullsized":"2024-09-12T18:08:15.672401+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'237","last_scrub_stamp":"2024-09-12T18:08:15.672302+0000","last_deep_scrub":"264'237","last_deep_scrub_stamp":"2024-09-12T18:08:15.672302+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.672302+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:57.673677+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":5176,"num_write":1044,"num_write_kb":56179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.807250+0000","last_change":"2024-09-12T18:08:29.807188+0000","last_active":"2024-09-12T18:08:29.807250+0000","last_peered":"2024-09-12T18:08:29.807250+0000","last_clean":"2024-09-12T18:08:29.807250+0000","last_became_active":"2024-09-12T17:29:56.953204+0000","last_became_peered":"2024-09-12T17:29:56.953204+0000","last_unstale":"2024-09-12T18:08:29.807250+0000","last_undegraded":"2024-09-12T18:08:29.807250+0000","last_fullsized":"2024-09-12T18:08:29.807250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:29.807103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:29.807103+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.807103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:46.116812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'190","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.513439+0000","last_change":"2024-09-12T18:08:36.513371+0000","last_active":"2024-09-12T18:08:36.513439+0000","last_peered":"2024-09-12T18:08:36.513439+0000","last_clean":"2024-09-12T18:08:36.513439+0000","last_became_active":"2024-09-12T17:29:58.978213+0000","last_became_peered":"2024-09-12T17:29:58.978213+0000","last_unstale":"2024-09-12T18:08:36.513439+0000","last_undegraded":"2024-09-12T18:08:36.513439+0000","last_fullsized":"2024-09-12T18:08:36.513439+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:08:36.513264+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:08:36.513264+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.513264+0000","objects_scrubbed":9,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:02.853977+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9297,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":251,"num_read_kb":306,"num_write":140,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.312537+0000","last_change":"2024-09-12T18:08:31.312537+0000","last_active":"2024-09-12T18:08:31.312537+0000","last_peered":"2024-09-12T18:08:31.312537+0000","last_clean":"2024-09-12T18:08:31.312537+0000","last_became_active":"2024-09-12T17:30:00.958723+0000","last_became_peered":"2024-09-12T17:30:00.958723+0000","last_unstale":"2024-09-12T18:08:31.312537+0000","last_undegraded":"2024-09-12T18:08:31.312537+0000","last_fullsized":"2024-09-12T18:08:31.312537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:31.312475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:31.312475+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.312475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:56.120649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'552","reported_seq":1364,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.411227+0000","last_change":"2024-09-12T18:08:41.411227+0000","last_active":"2024-09-12T18:08:41.411227+0000","last_peered":"2024-09-12T18:08:41.411227+0000","last_clean":"2024-09-12T18:08:41.411227+0000","last_became_active":"2024-09-12T17:30:02.968515+0000","last_became_peered":"2024-09-12T17:30:02.968515+0000","last_unstale":"2024-09-12T18:08:41.411227+0000","last_undegraded":"2024-09-12T18:08:41.411227+0000","last_fullsized":"2024-09-12T18:08:41.411227+0000","mapping_epoch":34,"log_start":"264'500","ondisk_log_start":"264'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'552","last_scrub_stamp":"2024-09-12T18:08:41.411132+0000","last_deep_scrub":"264'552","last_deep_scrub_stamp":"2024-09-12T18:08:41.411132+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.411132+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:32.937558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1325,"num_read_kb":1316,"num_write":1141,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'153","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.736689+0000","last_change":"2024-09-12T18:08:11.736621+0000","last_active":"2024-09-12T18:08:11.736689+0000","last_peered":"2024-09-12T18:08:11.736689+0000","last_clean":"2024-09-12T18:08:11.736689+0000","last_became_active":"2024-09-12T17:29:54.959140+0000","last_became_peered":"2024-09-12T17:29:54.959140+0000","last_unstale":"2024-09-12T18:08:11.736689+0000","last_undegraded":"2024-09-12T18:08:11.736689+0000","last_fullsized":"2024-09-12T18:08:11.736689+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-12T18:08:11.736532+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-12T18:08:11.736532+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.736532+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:28.497052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":582,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'177","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.657316+0000","last_change":"2024-09-12T18:08:14.657316+0000","last_active":"2024-09-12T18:08:14.657316+0000","last_peered":"2024-09-12T18:08:14.657316+0000","last_clean":"2024-09-12T18:08:14.657316+0000","last_became_active":"2024-09-12T17:29:52.964339+0000","last_became_peered":"2024-09-12T17:29:52.964339+0000","last_unstale":"2024-09-12T18:08:14.657316+0000","last_undegraded":"2024-09-12T18:08:14.657316+0000","last_fullsized":"2024-09-12T18:08:14.657316+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:08:14.657212+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:08:14.657212+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.657212+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:58.043317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395849,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":381,"num_read_kb":1621,"num_write":866,"num_write_kb":10562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.466900+0000","last_change":"2024-09-12T18:08:20.466833+0000","last_active":"2024-09-12T18:08:20.466900+0000","last_peered":"2024-09-12T18:08:20.466900+0000","last_clean":"2024-09-12T18:08:20.466900+0000","last_became_active":"2024-09-12T17:29:56.953551+0000","last_became_peered":"2024-09-12T17:29:56.953551+0000","last_unstale":"2024-09-12T18:08:20.466900+0000","last_undegraded":"2024-09-12T18:08:20.466900+0000","last_fullsized":"2024-09-12T18:08:20.466900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:20.466738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:20.466738+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.466738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:40.063398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'128","reported_seq":696,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.970220+0000","last_change":"2024-09-12T18:08:31.970220+0000","last_active":"2024-09-12T18:08:31.970220+0000","last_peered":"2024-09-12T18:08:31.970220+0000","last_clean":"2024-09-12T18:08:31.970220+0000","last_became_active":"2024-09-12T17:29:58.953107+0000","last_became_peered":"2024-09-12T17:29:58.953107+0000","last_unstale":"2024-09-12T18:08:31.970220+0000","last_undegraded":"2024-09-12T18:08:31.970220+0000","last_fullsized":"2024-09-12T18:08:31.970220+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-12T18:08:31.970110+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-12T18:08:31.970110+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.970110+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:14.593698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9938,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":239,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.872299+0000","last_change":"2024-09-12T18:08:41.872213+0000","last_active":"2024-09-12T18:08:41.872299+0000","last_peered":"2024-09-12T18:08:41.872299+0000","last_clean":"2024-09-12T18:08:41.872299+0000","last_became_active":"2024-09-12T17:30:00.961545+0000","last_became_peered":"2024-09-12T17:30:00.961545+0000","last_unstale":"2024-09-12T18:08:41.872299+0000","last_undegraded":"2024-09-12T18:08:41.872299+0000","last_fullsized":"2024-09-12T18:08:41.872299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:41.872079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:41.872079+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.872079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:14.981525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'87","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.966855+0000","last_change":"2024-09-12T18:08:31.966855+0000","last_active":"2024-09-12T18:08:31.966855+0000","last_peered":"2024-09-12T18:08:31.966855+0000","last_clean":"2024-09-12T18:08:31.966855+0000","last_became_active":"2024-09-12T17:30:02.967500+0000","last_became_peered":"2024-09-12T17:30:02.967500+0000","last_unstale":"2024-09-12T18:08:31.966855+0000","last_undegraded":"2024-09-12T18:08:31.966855+0000","last_fullsized":"2024-09-12T18:08:31.966855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'87","last_scrub_stamp":"2024-09-12T18:08:31.966730+0000","last_deep_scrub":"264'87","last_deep_scrub_stamp":"2024-09-12T18:08:31.966730+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.966730+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:38.709044+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":199,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'67","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.126192+0000","last_change":"2024-09-12T18:08:19.126105+0000","last_active":"2024-09-12T18:08:19.126192+0000","last_peered":"2024-09-12T18:08:19.126192+0000","last_clean":"2024-09-12T18:08:19.126192+0000","last_became_active":"2024-09-12T17:29:54.959979+0000","last_became_peered":"2024-09-12T17:29:54.959979+0000","last_unstale":"2024-09-12T18:08:19.126192+0000","last_undegraded":"2024-09-12T18:08:19.126192+0000","last_fullsized":"2024-09-12T18:08:19.126192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-09-12T18:08:19.125996+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-09-12T18:08:19.125996+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.125996+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:57.331669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":252,"num_write":105,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'337","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.692746+0000","last_change":"2024-09-12T18:08:13.692746+0000","last_active":"2024-09-12T18:08:13.692746+0000","last_peered":"2024-09-12T18:08:13.692746+0000","last_clean":"2024-09-12T18:08:13.692746+0000","last_became_active":"2024-09-12T17:29:52.957308+0000","last_became_peered":"2024-09-12T17:29:52.957308+0000","last_unstale":"2024-09-12T18:08:13.692746+0000","last_undegraded":"2024-09-12T18:08:13.692746+0000","last_fullsized":"2024-09-12T18:08:13.692746+0000","mapping_epoch":24,"log_start":"264'300","ondisk_log_start":"264'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-09-12T18:08:13.692640+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-09-12T18:08:13.692640+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.692640+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:12.037962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133695,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":832,"num_read_kb":24052,"num_write":1268,"num_write_kb":42343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"264'5","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.414556+0000","last_change":"2024-09-12T18:08:24.414556+0000","last_active":"2024-09-12T18:08:24.414556+0000","last_peered":"2024-09-12T18:08:24.414556+0000","last_clean":"2024-09-12T18:08:24.414556+0000","last_became_active":"2024-09-12T17:29:56.959206+0000","last_became_peered":"2024-09-12T17:29:56.959206+0000","last_unstale":"2024-09-12T18:08:24.414556+0000","last_undegraded":"2024-09-12T18:08:24.414556+0000","last_fullsized":"2024-09-12T18:08:24.414556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T18:08:24.414472+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T18:08:24.414472+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.414472+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:13.993154+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":1192,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'166","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.920463+0000","last_change":"2024-09-12T18:08:33.920406+0000","last_active":"2024-09-12T18:08:33.920463+0000","last_peered":"2024-09-12T18:08:33.920463+0000","last_clean":"2024-09-12T18:08:33.920463+0000","last_became_active":"2024-09-12T17:29:58.955698+0000","last_became_peered":"2024-09-12T17:29:58.955698+0000","last_unstale":"2024-09-12T18:08:33.920463+0000","last_undegraded":"2024-09-12T18:08:33.920463+0000","last_fullsized":"2024-09-12T18:08:33.920463+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'166","last_scrub_stamp":"2024-09-12T18:08:33.920303+0000","last_deep_scrub":"264'166","last_deep_scrub_stamp":"2024-09-12T18:08:33.920303+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.920303+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:30.408436+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7452,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":263,"num_write":112,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'763","reported_seq":2335,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.272553+0000","last_change":"2024-09-12T18:08:33.272495+0000","last_active":"2024-09-12T18:08:33.272553+0000","last_peered":"2024-09-12T18:08:33.272553+0000","last_clean":"2024-09-12T18:08:33.272553+0000","last_became_active":"2024-09-12T17:30:00.966661+0000","last_became_peered":"2024-09-12T17:30:00.966661+0000","last_unstale":"2024-09-12T18:08:33.272553+0000","last_undegraded":"2024-09-12T18:08:33.272553+0000","last_fullsized":"2024-09-12T18:08:33.272553+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'763","last_scrub_stamp":"2024-09-12T18:08:33.272408+0000","last_deep_scrub":"264'763","last_deep_scrub_stamp":"2024-09-12T18:08:33.272408+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.272408+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:07.796307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'109","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.300257+0000","last_change":"2024-09-12T18:08:40.300197+0000","last_active":"2024-09-12T18:08:40.300257+0000","last_peered":"2024-09-12T18:08:40.300257+0000","last_clean":"2024-09-12T18:08:40.300257+0000","last_became_active":"2024-09-12T17:30:02.969837+0000","last_became_peered":"2024-09-12T17:30:02.969837+0000","last_unstale":"2024-09-12T18:08:40.300257+0000","last_undegraded":"2024-09-12T18:08:40.300257+0000","last_fullsized":"2024-09-12T18:08:40.300257+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-12T18:08:40.300105+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-12T18:08:40.300105+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.300105+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:02.977090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":259,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'232","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.182943+0000","last_change":"2024-09-12T18:08:17.182943+0000","last_active":"2024-09-12T18:08:17.182943+0000","last_peered":"2024-09-12T18:08:17.182943+0000","last_clean":"2024-09-12T18:08:17.182943+0000","last_became_active":"2024-09-12T17:30:28.004234+0000","last_became_peered":"2024-09-12T17:30:28.004234+0000","last_unstale":"2024-09-12T18:08:17.182943+0000","last_undegraded":"2024-09-12T18:08:17.182943+0000","last_fullsized":"2024-09-12T18:08:17.182943+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-09-12T18:08:17.182861+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-09-12T18:08:17.182861+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.182861+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:07.554492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":977,"num_read_kb":779,"num_write":354,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'204","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.486827+0000","last_change":"2024-09-12T18:08:15.486827+0000","last_active":"2024-09-12T18:08:15.486827+0000","last_peered":"2024-09-12T18:08:15.486827+0000","last_clean":"2024-09-12T18:08:15.486827+0000","last_became_active":"2024-09-12T17:29:52.951442+0000","last_became_peered":"2024-09-12T17:29:52.951442+0000","last_unstale":"2024-09-12T18:08:15.486827+0000","last_undegraded":"2024-09-12T18:08:15.486827+0000","last_fullsized":"2024-09-12T18:08:15.486827+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'204","last_scrub_stamp":"2024-09-12T18:08:15.486681+0000","last_deep_scrub":"264'204","last_deep_scrub_stamp":"2024-09-12T18:08:15.486681+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.486681+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:50.751228+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6462010,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":476,"num_read_kb":16166,"num_write":931,"num_write_kb":36148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.427339+0000","last_change":"2024-09-12T18:08:22.427263+0000","last_active":"2024-09-12T18:08:22.427339+0000","last_peered":"2024-09-12T18:08:22.427339+0000","last_clean":"2024-09-12T18:08:22.427339+0000","last_became_active":"2024-09-12T17:29:56.955948+0000","last_became_peered":"2024-09-12T17:29:56.955948+0000","last_unstale":"2024-09-12T18:08:22.427339+0000","last_undegraded":"2024-09-12T18:08:22.427339+0000","last_fullsized":"2024-09-12T18:08:22.427339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:22.427174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:22.427174+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.427174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:36.201160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'206","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.233832+0000","last_change":"2024-09-12T18:08:29.233740+0000","last_active":"2024-09-12T18:08:29.233832+0000","last_peered":"2024-09-12T18:08:29.233832+0000","last_clean":"2024-09-12T18:08:29.233832+0000","last_became_active":"2024-09-12T17:29:58.957183+0000","last_became_peered":"2024-09-12T17:29:58.957183+0000","last_unstale":"2024-09-12T18:08:29.233832+0000","last_undegraded":"2024-09-12T18:08:29.233832+0000","last_fullsized":"2024-09-12T18:08:29.233832+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T18:08:29.233610+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T18:08:29.233610+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.233610+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:55.220846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13747,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":267,"num_read_kb":394,"num_write":132,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.401242+0000","last_change":"2024-09-12T18:08:27.401175+0000","last_active":"2024-09-12T18:08:27.401242+0000","last_peered":"2024-09-12T18:08:27.401242+0000","last_clean":"2024-09-12T18:08:27.401242+0000","last_became_active":"2024-09-12T17:30:00.958049+0000","last_became_peered":"2024-09-12T17:30:00.958049+0000","last_unstale":"2024-09-12T18:08:27.401242+0000","last_undegraded":"2024-09-12T18:08:27.401242+0000","last_fullsized":"2024-09-12T18:08:27.401242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.401089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.401089+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.401089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:58.968537+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'147","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.243003+0000","last_change":"2024-09-12T18:08:35.242927+0000","last_active":"2024-09-12T18:08:35.243003+0000","last_peered":"2024-09-12T18:08:35.243003+0000","last_clean":"2024-09-12T18:08:35.243003+0000","last_became_active":"2024-09-12T17:30:02.970095+0000","last_became_peered":"2024-09-12T17:30:02.970095+0000","last_unstale":"2024-09-12T18:08:35.243003+0000","last_undegraded":"2024-09-12T18:08:35.243003+0000","last_fullsized":"2024-09-12T18:08:35.243003+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T18:08:35.242847+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T18:08:35.242847+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.242847+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:12.452660+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":173,"num_write":338,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'179","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.670165+0000","last_change":"2024-09-12T18:08:14.670165+0000","last_active":"2024-09-12T18:08:14.670165+0000","last_peered":"2024-09-12T18:08:14.670165+0000","last_clean":"2024-09-12T18:08:14.670165+0000","last_became_active":"2024-09-12T17:29:54.956850+0000","last_became_peered":"2024-09-12T17:29:54.956850+0000","last_unstale":"2024-09-12T18:08:14.670165+0000","last_undegraded":"2024-09-12T18:08:14.670165+0000","last_fullsized":"2024-09-12T18:08:14.670165+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:08:14.670074+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:08:14.670074+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.670074+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:21.265957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":712,"num_read_kb":607,"num_write":242,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'175","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.059924+0000","last_change":"2024-09-12T18:08:12.059924+0000","last_active":"2024-09-12T18:08:12.059924+0000","last_peered":"2024-09-12T18:08:12.059924+0000","last_clean":"2024-09-12T18:08:12.059924+0000","last_became_active":"2024-09-12T17:29:52.958919+0000","last_became_peered":"2024-09-12T17:29:52.958919+0000","last_unstale":"2024-09-12T18:08:12.059924+0000","last_undegraded":"2024-09-12T18:08:12.059924+0000","last_fullsized":"2024-09-12T18:08:12.059924+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'175","last_scrub_stamp":"2024-09-12T18:08:12.059737+0000","last_deep_scrub":"264'175","last_deep_scrub_stamp":"2024-09-12T18:08:12.059737+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.059737+0000","objects_scrubbed":11,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:59.307212+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7687392,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":325,"num_read_kb":13812,"num_write":937,"num_write_kb":31717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.435944+0000","last_change":"2024-09-12T18:08:25.435944+0000","last_active":"2024-09-12T18:08:25.435944+0000","last_peered":"2024-09-12T18:08:25.435944+0000","last_clean":"2024-09-12T18:08:25.435944+0000","last_became_active":"2024-09-12T17:29:56.955288+0000","last_became_peered":"2024-09-12T17:29:56.955288+0000","last_unstale":"2024-09-12T18:08:25.435944+0000","last_undegraded":"2024-09-12T18:08:25.435944+0000","last_fullsized":"2024-09-12T18:08:25.435944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.435793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.435793+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.435793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:42.632232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'147","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.851189+0000","last_change":"2024-09-12T18:08:34.851189+0000","last_active":"2024-09-12T18:08:34.851189+0000","last_peered":"2024-09-12T18:08:34.851189+0000","last_clean":"2024-09-12T18:08:34.851189+0000","last_became_active":"2024-09-12T17:29:58.952878+0000","last_became_peered":"2024-09-12T17:29:58.952878+0000","last_unstale":"2024-09-12T18:08:34.851189+0000","last_undegraded":"2024-09-12T18:08:34.851189+0000","last_fullsized":"2024-09-12T18:08:34.851189+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T18:08:34.851076+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T18:08:34.851076+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.851076+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:51.169705+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":197,"num_read_kb":250,"num_write":156,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.272509+0000","last_change":"2024-09-12T18:08:36.272509+0000","last_active":"2024-09-12T18:08:36.272509+0000","last_peered":"2024-09-12T18:08:36.272509+0000","last_clean":"2024-09-12T18:08:36.272509+0000","last_became_active":"2024-09-12T17:30:00.970668+0000","last_became_peered":"2024-09-12T17:30:00.970668+0000","last_unstale":"2024-09-12T18:08:36.272509+0000","last_undegraded":"2024-09-12T18:08:36.272509+0000","last_fullsized":"2024-09-12T18:08:36.272509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:36.272414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:36.272414+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.272414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:46.637903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'142","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.925568+0000","last_change":"2024-09-12T18:08:42.925568+0000","last_active":"2024-09-12T18:08:42.925568+0000","last_peered":"2024-09-12T18:08:42.925568+0000","last_clean":"2024-09-12T18:08:42.925568+0000","last_became_active":"2024-09-12T17:30:02.964125+0000","last_became_peered":"2024-09-12T17:30:02.964125+0000","last_unstale":"2024-09-12T18:08:42.925568+0000","last_undegraded":"2024-09-12T18:08:42.925568+0000","last_fullsized":"2024-09-12T18:08:42.925568+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:08:42.925483+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:08:42.925483+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.925483+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:46.935130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":200,"num_read_kb":186,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'124","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.708252+0000","last_change":"2024-09-12T18:08:13.708252+0000","last_active":"2024-09-12T18:08:13.708252+0000","last_peered":"2024-09-12T18:08:13.708252+0000","last_clean":"2024-09-12T18:08:13.708252+0000","last_became_active":"2024-09-12T17:29:54.956019+0000","last_became_peered":"2024-09-12T17:29:54.956019+0000","last_unstale":"2024-09-12T18:08:13.708252+0000","last_undegraded":"2024-09-12T18:08:13.708252+0000","last_fullsized":"2024-09-12T18:08:13.708252+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-12T18:08:13.708174+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-12T18:08:13.708174+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.708174+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:20.307396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":560,"num_read_kb":466,"num_write":179,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'197","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.052806+0000","last_change":"2024-09-12T18:08:11.052727+0000","last_active":"2024-09-12T18:08:11.052806+0000","last_peered":"2024-09-12T18:08:11.052806+0000","last_clean":"2024-09-12T18:08:11.052806+0000","last_became_active":"2024-09-12T17:29:52.951013+0000","last_became_peered":"2024-09-12T17:29:52.951013+0000","last_unstale":"2024-09-12T18:08:11.052806+0000","last_undegraded":"2024-09-12T18:08:11.052806+0000","last_fullsized":"2024-09-12T18:08:11.052806+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'197","last_scrub_stamp":"2024-09-12T18:08:11.052631+0000","last_deep_scrub":"264'197","last_deep_scrub_stamp":"2024-09-12T18:08:11.052631+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.052631+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:32.972110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":90183,"num_write":908,"num_write_kb":29071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.316309+0000","last_change":"2024-09-12T18:08:25.316309+0000","last_active":"2024-09-12T18:08:25.316309+0000","last_peered":"2024-09-12T18:08:25.316309+0000","last_clean":"2024-09-12T18:08:25.316309+0000","last_became_active":"2024-09-12T17:29:56.959436+0000","last_became_peered":"2024-09-12T17:29:56.959436+0000","last_unstale":"2024-09-12T18:08:25.316309+0000","last_undegraded":"2024-09-12T18:08:25.316309+0000","last_fullsized":"2024-09-12T18:08:25.316309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.316225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.316225+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.316225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:40.776025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'149","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.346397+0000","last_change":"2024-09-12T18:08:35.346397+0000","last_active":"2024-09-12T18:08:35.346397+0000","last_peered":"2024-09-12T18:08:35.346397+0000","last_clean":"2024-09-12T18:08:35.346397+0000","last_became_active":"2024-09-12T17:29:58.954548+0000","last_became_peered":"2024-09-12T17:29:58.954548+0000","last_unstale":"2024-09-12T18:08:35.346397+0000","last_undegraded":"2024-09-12T18:08:35.346397+0000","last_fullsized":"2024-09-12T18:08:35.346397+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T18:08:35.346304+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T18:08:35.346304+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.346304+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:50.124242+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12489,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":192,"num_read_kb":263,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'733","reported_seq":2386,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.392882+0000","last_change":"2024-09-12T18:08:28.392882+0000","last_active":"2024-09-12T18:08:28.392882+0000","last_peered":"2024-09-12T18:08:28.392882+0000","last_clean":"2024-09-12T18:08:28.392882+0000","last_became_active":"2024-09-12T17:30:00.960402+0000","last_became_peered":"2024-09-12T17:30:00.960402+0000","last_unstale":"2024-09-12T18:08:28.392882+0000","last_undegraded":"2024-09-12T18:08:28.392882+0000","last_fullsized":"2024-09-12T18:08:28.392882+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'733","last_scrub_stamp":"2024-09-12T18:08:28.392750+0000","last_deep_scrub":"264'733","last_deep_scrub_stamp":"2024-09-12T18:08:28.392750+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.392750+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:15.282104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'98","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.233381+0000","last_change":"2024-09-12T18:08:34.233381+0000","last_active":"2024-09-12T18:08:34.233381+0000","last_peered":"2024-09-12T18:08:34.233381+0000","last_clean":"2024-09-12T18:08:34.233381+0000","last_became_active":"2024-09-12T17:30:02.969617+0000","last_became_peered":"2024-09-12T17:30:02.969617+0000","last_unstale":"2024-09-12T18:08:34.233381+0000","last_undegraded":"2024-09-12T18:08:34.233381+0000","last_fullsized":"2024-09-12T18:08:34.233381+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'98","last_scrub_stamp":"2024-09-12T18:08:34.233267+0000","last_deep_scrub":"264'98","last_deep_scrub_stamp":"2024-09-12T18:08:34.233267+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.233267+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:39.388855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":242,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'118","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.709781+0000","last_change":"2024-09-12T18:08:16.709781+0000","last_active":"2024-09-12T18:08:16.709781+0000","last_peered":"2024-09-12T18:08:16.709781+0000","last_clean":"2024-09-12T18:08:16.709781+0000","last_became_active":"2024-09-12T17:29:54.958362+0000","last_became_peered":"2024-09-12T17:29:54.958362+0000","last_unstale":"2024-09-12T18:08:16.709781+0000","last_undegraded":"2024-09-12T18:08:16.709781+0000","last_fullsized":"2024-09-12T18:08:16.709781+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-12T18:08:16.709692+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-12T18:08:16.709692+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.709692+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:36.417665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":415,"num_write":164,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'162","reported_seq":776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.276194+0000","last_change":"2024-09-12T18:08:11.276109+0000","last_active":"2024-09-12T18:08:11.276194+0000","last_peered":"2024-09-12T18:08:11.276194+0000","last_clean":"2024-09-12T18:08:11.276194+0000","last_became_active":"2024-09-12T17:30:28.005099+0000","last_became_peered":"2024-09-12T17:30:28.005099+0000","last_unstale":"2024-09-12T18:08:11.276194+0000","last_undegraded":"2024-09-12T18:08:11.276194+0000","last_fullsized":"2024-09-12T18:08:11.276194+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-12T18:08:11.276007+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-12T18:08:11.276007+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.276007+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:24.791440+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":6854,"num_write":853,"num_write_kb":33010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,7],"acting":[1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1455,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.457567+0000","last_change":"2024-09-12T18:08:31.457567+0000","last_active":"2024-09-12T18:08:31.457567+0000","last_peered":"2024-09-12T18:08:31.457567+0000","last_clean":"2024-09-12T18:08:31.457567+0000","last_became_active":"2024-09-12T17:29:56.955321+0000","last_became_peered":"2024-09-12T17:29:56.955321+0000","last_unstale":"2024-09-12T18:08:31.457567+0000","last_undegraded":"2024-09-12T18:08:31.457567+0000","last_fullsized":"2024-09-12T18:08:31.457567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T18:08:31.457480+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T18:08:31.457480+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.457480+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:58.605157+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":954,"num_read_kb":954,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'84","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.934809+0000","last_change":"2024-09-12T18:08:32.934809+0000","last_active":"2024-09-12T18:08:32.934809+0000","last_peered":"2024-09-12T18:08:32.934809+0000","last_clean":"2024-09-12T18:08:32.934809+0000","last_became_active":"2024-09-12T17:29:58.978480+0000","last_became_peered":"2024-09-12T17:29:58.978480+0000","last_unstale":"2024-09-12T18:08:32.934809+0000","last_undegraded":"2024-09-12T18:08:32.934809+0000","last_fullsized":"2024-09-12T18:08:32.934809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T18:08:32.934717+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T18:08:32.934717+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.934717+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:34.102936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'759","reported_seq":4536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.999531+0000","last_change":"2024-09-12T18:08:28.999531+0000","last_active":"2024-09-12T18:08:28.999531+0000","last_peered":"2024-09-12T18:08:28.999531+0000","last_clean":"2024-09-12T18:08:28.999531+0000","last_became_active":"2024-09-12T17:30:00.959015+0000","last_became_peered":"2024-09-12T17:30:00.959015+0000","last_unstale":"2024-09-12T18:08:28.999531+0000","last_undegraded":"2024-09-12T18:08:28.999531+0000","last_fullsized":"2024-09-12T18:08:28.999531+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'759","last_scrub_stamp":"2024-09-12T18:08:28.999434+0000","last_deep_scrub":"264'759","last_deep_scrub_stamp":"2024-09-12T18:08:28.999434+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.999434+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:52.947246+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'126","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.622787+0000","last_change":"2024-09-12T18:08:46.622787+0000","last_active":"2024-09-12T18:08:46.622787+0000","last_peered":"2024-09-12T18:08:46.622787+0000","last_clean":"2024-09-12T18:08:46.622787+0000","last_became_active":"2024-09-12T17:30:02.972020+0000","last_became_peered":"2024-09-12T17:30:02.972020+0000","last_unstale":"2024-09-12T18:08:46.622787+0000","last_undegraded":"2024-09-12T18:08:46.622787+0000","last_fullsized":"2024-09-12T18:08:46.622787+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-12T18:08:46.622693+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-12T18:08:46.622693+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.622693+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:18.900643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":156,"num_write":307,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.252876+0000","last_change":"2024-09-12T18:08:21.252876+0000","last_active":"2024-09-12T18:08:21.252876+0000","last_peered":"2024-09-12T18:08:21.252876+0000","last_clean":"2024-09-12T18:08:21.252876+0000","last_became_active":"2024-09-12T17:29:54.950966+0000","last_became_peered":"2024-09-12T17:29:54.950966+0000","last_unstale":"2024-09-12T18:08:21.252876+0000","last_undegraded":"2024-09-12T18:08:21.252876+0000","last_fullsized":"2024-09-12T18:08:21.252876+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T18:08:21.252794+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T18:08:21.252794+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.252794+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:22.803219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":955,"num_read_kb":788,"num_write":339,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'177","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.082094+0000","last_change":"2024-09-12T18:08:09.082011+0000","last_active":"2024-09-12T18:08:09.082094+0000","last_peered":"2024-09-12T18:08:09.082094+0000","last_clean":"2024-09-12T18:08:09.082094+0000","last_became_active":"2024-09-12T17:29:52.948591+0000","last_became_peered":"2024-09-12T17:29:52.948591+0000","last_unstale":"2024-09-12T18:08:09.082094+0000","last_undegraded":"2024-09-12T18:08:09.082094+0000","last_fullsized":"2024-09-12T18:08:09.082094+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:08:09.081909+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:08:09.081909+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.081909+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:16.244554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1260936,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":2968,"num_write":842,"num_write_kb":20319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.857509+0000","last_change":"2024-09-12T18:08:28.857509+0000","last_active":"2024-09-12T18:08:28.857509+0000","last_peered":"2024-09-12T18:08:28.857509+0000","last_clean":"2024-09-12T18:08:28.857509+0000","last_became_active":"2024-09-12T17:29:56.953198+0000","last_became_peered":"2024-09-12T17:29:56.953198+0000","last_unstale":"2024-09-12T18:08:28.857509+0000","last_undegraded":"2024-09-12T18:08:28.857509+0000","last_fullsized":"2024-09-12T18:08:28.857509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:28.857430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:28.857430+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.857430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:00.350416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'199","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.502122+0000","last_change":"2024-09-12T18:08:38.502122+0000","last_active":"2024-09-12T18:08:38.502122+0000","last_peered":"2024-09-12T18:08:38.502122+0000","last_clean":"2024-09-12T18:08:38.502122+0000","last_became_active":"2024-09-12T17:29:58.956828+0000","last_became_peered":"2024-09-12T17:29:58.956828+0000","last_unstale":"2024-09-12T18:08:38.502122+0000","last_undegraded":"2024-09-12T18:08:38.502122+0000","last_fullsized":"2024-09-12T18:08:38.502122+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-12T18:08:38.502014+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-12T18:08:38.502014+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.502014+0000","objects_scrubbed":9,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:05.976827+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10697,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":841,"num_read_kb":909,"num_write":1328,"num_write_kb":1209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488582,"num_omap_keys":1128,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.026110+0000","last_change":"2024-09-12T18:08:27.026110+0000","last_active":"2024-09-12T18:08:27.026110+0000","last_peered":"2024-09-12T18:08:27.026110+0000","last_clean":"2024-09-12T18:08:27.026110+0000","last_became_active":"2024-09-12T17:30:00.963117+0000","last_became_peered":"2024-09-12T17:30:00.963117+0000","last_unstale":"2024-09-12T18:08:27.026110+0000","last_undegraded":"2024-09-12T18:08:27.026110+0000","last_fullsized":"2024-09-12T18:08:27.026110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.026012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.026012+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.026012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:43.754740+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'119","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.239747+0000","last_change":"2024-09-12T18:08:36.239747+0000","last_active":"2024-09-12T18:08:36.239747+0000","last_peered":"2024-09-12T18:08:36.239747+0000","last_clean":"2024-09-12T18:08:36.239747+0000","last_became_active":"2024-09-12T17:30:02.963368+0000","last_became_peered":"2024-09-12T17:30:02.963368+0000","last_unstale":"2024-09-12T18:08:36.239747+0000","last_undegraded":"2024-09-12T18:08:36.239747+0000","last_fullsized":"2024-09-12T18:08:36.239747+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T18:08:36.239656+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T18:08:36.239656+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.239656+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:33.522946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":466,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":267,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'271","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.085593+0000","last_change":"2024-09-12T18:08:18.085593+0000","last_active":"2024-09-12T18:08:18.085593+0000","last_peered":"2024-09-12T18:08:18.085593+0000","last_clean":"2024-09-12T18:08:18.085593+0000","last_became_active":"2024-09-12T17:29:54.960486+0000","last_became_peered":"2024-09-12T17:29:54.960486+0000","last_unstale":"2024-09-12T18:08:18.085593+0000","last_undegraded":"2024-09-12T18:08:18.085593+0000","last_fullsized":"2024-09-12T18:08:18.085593+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-12T18:08:18.085509+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-12T18:08:18.085509+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.085509+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:18.452979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1431,"num_read_kb":1268,"num_write":469,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.670133+0000","last_change":"2024-09-12T18:08:10.670133+0000","last_active":"2024-09-12T18:08:10.670133+0000","last_peered":"2024-09-12T18:08:10.670133+0000","last_clean":"2024-09-12T18:08:10.670133+0000","last_became_active":"2024-09-12T17:29:36.163604+0000","last_became_peered":"2024-09-12T17:29:36.163604+0000","last_unstale":"2024-09-12T18:08:10.670133+0000","last_undegraded":"2024-09-12T18:08:10.670133+0000","last_fullsized":"2024-09-12T18:08:10.670133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T18:08:10.670050+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T18:08:10.670050+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.670050+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:28.217846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.564560+0000","last_change":"2024-09-12T18:08:09.564490+0000","last_active":"2024-09-12T18:08:09.564560+0000","last_peered":"2024-09-12T18:08:09.564560+0000","last_clean":"2024-09-12T18:08:09.564560+0000","last_became_active":"2024-09-12T17:29:41.963643+0000","last_became_peered":"2024-09-12T17:29:41.963643+0000","last_unstale":"2024-09-12T18:08:09.564560+0000","last_undegraded":"2024-09-12T18:08:09.564560+0000","last_fullsized":"2024-09-12T18:08:09.564560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:09.564408+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:09.564408+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.564408+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:57.121488+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00056994999999999995,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'207","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.049382+0000","last_change":"2024-09-12T18:08:10.049333+0000","last_active":"2024-09-12T18:08:10.049382+0000","last_peered":"2024-09-12T18:08:10.049382+0000","last_clean":"2024-09-12T18:08:10.049382+0000","last_became_active":"2024-09-12T17:29:52.954839+0000","last_became_peered":"2024-09-12T17:29:52.954839+0000","last_unstale":"2024-09-12T18:08:10.049382+0000","last_undegraded":"2024-09-12T18:08:10.049382+0000","last_fullsized":"2024-09-12T18:08:10.049382+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:10.049250+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:10.049250+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.049250+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:44.893531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395904,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":449,"num_read_kb":3374,"num_write":1041,"num_write_kb":36567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.756334+0000","last_change":"2024-09-12T18:08:27.756334+0000","last_active":"2024-09-12T18:08:27.756334+0000","last_peered":"2024-09-12T18:08:27.756334+0000","last_clean":"2024-09-12T18:08:27.756334+0000","last_became_active":"2024-09-12T17:29:56.955260+0000","last_became_peered":"2024-09-12T17:29:56.955260+0000","last_unstale":"2024-09-12T18:08:27.756334+0000","last_undegraded":"2024-09-12T18:08:27.756334+0000","last_fullsized":"2024-09-12T18:08:27.756334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.756236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.756236+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.756236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:23.735166+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'306","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.504200+0000","last_change":"2024-09-12T18:08:34.504138+0000","last_active":"2024-09-12T18:08:34.504200+0000","last_peered":"2024-09-12T18:08:34.504200+0000","last_clean":"2024-09-12T18:08:34.504200+0000","last_became_active":"2024-09-12T17:29:58.954205+0000","last_became_peered":"2024-09-12T17:29:58.954205+0000","last_unstale":"2024-09-12T18:08:34.504200+0000","last_undegraded":"2024-09-12T18:08:34.504200+0000","last_fullsized":"2024-09-12T18:08:34.504200+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-12T18:08:34.504033+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-12T18:08:34.504033+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.504033+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:58.633159+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17428,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":560,"num_read_kb":763,"num_write":498,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106664,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.260704+0000","last_change":"2024-09-12T18:08:34.260603+0000","last_active":"2024-09-12T18:08:34.260704+0000","last_peered":"2024-09-12T18:08:34.260704+0000","last_clean":"2024-09-12T18:08:34.260704+0000","last_became_active":"2024-09-12T17:30:00.964241+0000","last_became_peered":"2024-09-12T17:30:00.964241+0000","last_unstale":"2024-09-12T18:08:34.260704+0000","last_undegraded":"2024-09-12T18:08:34.260704+0000","last_fullsized":"2024-09-12T18:08:34.260704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:34.260510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:34.260510+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.260510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:24.121752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'223","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.023298+0000","last_change":"2024-09-12T18:08:38.023190+0000","last_active":"2024-09-12T18:08:38.023298+0000","last_peered":"2024-09-12T18:08:38.023298+0000","last_clean":"2024-09-12T18:08:38.023298+0000","last_became_active":"2024-09-12T17:30:02.963890+0000","last_became_peered":"2024-09-12T17:30:02.963890+0000","last_unstale":"2024-09-12T18:08:38.023298+0000","last_undegraded":"2024-09-12T18:08:38.023298+0000","last_fullsized":"2024-09-12T18:08:38.023298+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-12T18:08:38.023090+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-12T18:08:38.023090+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.023090+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:44.300861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":552,"num_write":485,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'385","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.134806+0000","last_change":"2024-09-12T18:08:18.134748+0000","last_active":"2024-09-12T18:08:18.134806+0000","last_peered":"2024-09-12T18:08:18.134806+0000","last_clean":"2024-09-12T18:08:18.134806+0000","last_became_active":"2024-09-12T17:29:54.944624+0000","last_became_peered":"2024-09-12T17:29:54.944624+0000","last_unstale":"2024-09-12T18:08:18.134806+0000","last_undegraded":"2024-09-12T18:08:18.134806+0000","last_fullsized":"2024-09-12T18:08:18.134806+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T18:08:18.134658+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T18:08:18.134658+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.134658+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:17.271829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1668,"num_read_kb":1443,"num_write":651,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7559,"num_omap_keys":32,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.685327+0000","last_change":"2024-09-12T18:08:12.685327+0000","last_active":"2024-09-12T18:08:12.685327+0000","last_peered":"2024-09-12T18:08:12.685327+0000","last_clean":"2024-09-12T18:08:12.685327+0000","last_became_active":"2024-09-12T17:29:41.963499+0000","last_became_peered":"2024-09-12T17:29:41.963499+0000","last_unstale":"2024-09-12T18:08:12.685327+0000","last_undegraded":"2024-09-12T18:08:12.685327+0000","last_fullsized":"2024-09-12T18:08:12.685327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:12.685224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:12.685224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.685224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:53.962768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000470655,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'149","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:07.126130+0000","last_change":"2024-09-12T18:08:07.126035+0000","last_active":"2024-09-12T18:08:07.126130+0000","last_peered":"2024-09-12T18:08:07.126130+0000","last_clean":"2024-09-12T18:08:07.126130+0000","last_became_active":"2024-09-12T17:29:52.949339+0000","last_became_peered":"2024-09-12T17:29:52.949339+0000","last_unstale":"2024-09-12T18:08:07.126130+0000","last_undegraded":"2024-09-12T18:08:07.126130+0000","last_fullsized":"2024-09-12T18:08:07.126130+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T18:08:07.125919+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T18:08:07.125919+0000","last_clean_scrub_stamp":"2024-09-12T18:08:07.125919+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:14.630758+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":3075,"num_write":751,"num_write_kb":23555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.488139+0000","last_change":"2024-09-12T18:08:30.488074+0000","last_active":"2024-09-12T18:08:30.488139+0000","last_peered":"2024-09-12T18:08:30.488139+0000","last_clean":"2024-09-12T18:08:30.488139+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:08:30.488139+0000","last_undegraded":"2024-09-12T18:08:30.488139+0000","last_fullsized":"2024-09-12T18:08:30.488139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:30.487983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:30.487983+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.487983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:10.242355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'795","reported_seq":2190,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.321172+0000","last_change":"2024-09-12T18:08:29.321172+0000","last_active":"2024-09-12T18:08:29.321172+0000","last_peered":"2024-09-12T18:08:29.321172+0000","last_clean":"2024-09-12T18:08:29.321172+0000","last_became_active":"2024-09-12T17:29:58.958269+0000","last_became_peered":"2024-09-12T17:29:58.958269+0000","last_unstale":"2024-09-12T18:08:29.321172+0000","last_undegraded":"2024-09-12T18:08:29.321172+0000","last_fullsized":"2024-09-12T18:08:29.321172+0000","mapping_epoch":30,"log_start":"264'700","ondisk_log_start":"264'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'795","last_scrub_stamp":"2024-09-12T18:08:29.321029+0000","last_deep_scrub":"264'795","last_deep_scrub_stamp":"2024-09-12T18:08:29.321029+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.321029+0000","objects_scrubbed":12,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:42.926498+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37829,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1137,"num_read_kb":1322,"num_write":242,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.950826+0000","last_change":"2024-09-12T18:08:37.950826+0000","last_active":"2024-09-12T18:08:37.950826+0000","last_peered":"2024-09-12T18:08:37.950826+0000","last_clean":"2024-09-12T18:08:37.950826+0000","last_became_active":"2024-09-12T17:30:00.957628+0000","last_became_peered":"2024-09-12T17:30:00.957628+0000","last_unstale":"2024-09-12T18:08:37.950826+0000","last_undegraded":"2024-09-12T18:08:37.950826+0000","last_fullsized":"2024-09-12T18:08:37.950826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:37.950712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:37.950712+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.950712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:19.553228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'138","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.236955+0000","last_change":"2024-09-12T18:08:37.236879+0000","last_active":"2024-09-12T18:08:37.236955+0000","last_peered":"2024-09-12T18:08:37.236955+0000","last_clean":"2024-09-12T18:08:37.236955+0000","last_became_active":"2024-09-12T17:30:02.960109+0000","last_became_peered":"2024-09-12T17:30:02.960109+0000","last_unstale":"2024-09-12T18:08:37.236955+0000","last_undegraded":"2024-09-12T18:08:37.236955+0000","last_fullsized":"2024-09-12T18:08:37.236955+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-12T18:08:37.236794+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-12T18:08:37.236794+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.236794+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:16.611769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":318,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'88","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.241904+0000","last_change":"2024-09-12T18:08:18.241855+0000","last_active":"2024-09-12T18:08:18.241904+0000","last_peered":"2024-09-12T18:08:18.241904+0000","last_clean":"2024-09-12T18:08:18.241904+0000","last_became_active":"2024-09-12T17:29:54.958310+0000","last_became_peered":"2024-09-12T17:29:54.958310+0000","last_unstale":"2024-09-12T18:08:18.241904+0000","last_undegraded":"2024-09-12T18:08:18.241904+0000","last_fullsized":"2024-09-12T18:08:18.241904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'88","last_scrub_stamp":"2024-09-12T18:08:18.241756+0000","last_deep_scrub":"264'88","last_deep_scrub_stamp":"2024-09-12T18:08:18.241756+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.241756+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:31.581719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":367,"num_read_kb":311,"num_write":135,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.255373+0000","last_change":"2024-09-12T18:08:08.255313+0000","last_active":"2024-09-12T18:08:08.255373+0000","last_peered":"2024-09-12T18:08:08.255373+0000","last_clean":"2024-09-12T18:08:08.255373+0000","last_became_active":"2024-09-12T17:29:42.064972+0000","last_became_peered":"2024-09-12T17:29:42.064972+0000","last_unstale":"2024-09-12T18:08:08.255373+0000","last_undegraded":"2024-09-12T18:08:08.255373+0000","last_fullsized":"2024-09-12T18:08:08.255373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:08.255224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:08.255224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.255224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:11.379409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047741400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'211","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.313282+0000","last_change":"2024-09-12T18:08:09.313282+0000","last_active":"2024-09-12T18:08:09.313282+0000","last_peered":"2024-09-12T18:08:09.313282+0000","last_clean":"2024-09-12T18:08:09.313282+0000","last_became_active":"2024-09-12T17:29:52.949301+0000","last_became_peered":"2024-09-12T17:29:52.949301+0000","last_unstale":"2024-09-12T18:08:09.313282+0000","last_undegraded":"2024-09-12T18:08:09.313282+0000","last_fullsized":"2024-09-12T18:08:09.313282+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-09-12T18:08:09.313149+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-09-12T18:08:09.313149+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.313149+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:08.195813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":2667,"num_write":1034,"num_write_kb":7887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.462190+0000","last_change":"2024-09-12T18:08:21.462126+0000","last_active":"2024-09-12T18:08:21.462190+0000","last_peered":"2024-09-12T18:08:21.462190+0000","last_clean":"2024-09-12T18:08:21.462190+0000","last_became_active":"2024-09-12T17:29:56.956623+0000","last_became_peered":"2024-09-12T17:29:56.956623+0000","last_unstale":"2024-09-12T18:08:21.462190+0000","last_undegraded":"2024-09-12T18:08:21.462190+0000","last_fullsized":"2024-09-12T18:08:21.462190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:21.462035+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:21.462035+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.462035+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.681426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'219","reported_seq":1220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.888279+0000","last_change":"2024-09-12T18:08:35.888279+0000","last_active":"2024-09-12T18:08:35.888279+0000","last_peered":"2024-09-12T18:08:35.888279+0000","last_clean":"2024-09-12T18:08:35.888279+0000","last_became_active":"2024-09-12T17:29:58.980697+0000","last_became_peered":"2024-09-12T17:29:58.980697+0000","last_unstale":"2024-09-12T18:08:35.888279+0000","last_undegraded":"2024-09-12T18:08:35.888279+0000","last_fullsized":"2024-09-12T18:08:35.888279+0000","mapping_epoch":30,"log_start":"264'201","ondisk_log_start":"264'201","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-12T18:08:35.888176+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-12T18:08:35.888176+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.888176+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":201,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:09.387384+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":123,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.275810+0000","last_change":"2024-09-12T18:08:35.275810+0000","last_active":"2024-09-12T18:08:35.275810+0000","last_peered":"2024-09-12T18:08:35.275810+0000","last_clean":"2024-09-12T18:08:35.275810+0000","last_became_active":"2024-09-12T17:30:00.968468+0000","last_became_peered":"2024-09-12T17:30:00.968468+0000","last_unstale":"2024-09-12T18:08:35.275810+0000","last_undegraded":"2024-09-12T18:08:35.275810+0000","last_fullsized":"2024-09-12T18:08:35.275810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:35.275712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:35.275712+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.275712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:20.338020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'252","reported_seq":852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.953421+0000","last_change":"2024-09-12T18:08:43.953421+0000","last_active":"2024-09-12T18:08:43.953421+0000","last_peered":"2024-09-12T18:08:43.953421+0000","last_clean":"2024-09-12T18:08:43.953421+0000","last_became_active":"2024-09-12T17:30:02.966910+0000","last_became_peered":"2024-09-12T17:30:02.966910+0000","last_unstale":"2024-09-12T18:08:43.953421+0000","last_undegraded":"2024-09-12T18:08:43.953421+0000","last_fullsized":"2024-09-12T18:08:43.953421+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'252","last_scrub_stamp":"2024-09-12T18:08:43.953338+0000","last_deep_scrub":"264'252","last_deep_scrub_stamp":"2024-09-12T18:08:43.953338+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.953338+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:00.374909+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":627,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":529,"num_write":537,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'112","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.211122+0000","last_change":"2024-09-12T18:08:17.211065+0000","last_active":"2024-09-12T18:08:17.211122+0000","last_peered":"2024-09-12T18:08:17.211122+0000","last_clean":"2024-09-12T18:08:17.211122+0000","last_became_active":"2024-09-12T17:29:54.948402+0000","last_became_peered":"2024-09-12T17:29:54.948402+0000","last_unstale":"2024-09-12T18:08:17.211122+0000","last_undegraded":"2024-09-12T18:08:17.211122+0000","last_fullsized":"2024-09-12T18:08:17.211122+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-12T18:08:17.210956+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-12T18:08:17.210956+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.210956+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:48.357477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":452,"num_write":172,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.547746+0000","last_change":"2024-09-12T18:08:10.547679+0000","last_active":"2024-09-12T18:08:10.547746+0000","last_peered":"2024-09-12T18:08:10.547746+0000","last_clean":"2024-09-12T18:08:10.547746+0000","last_became_active":"2024-09-12T17:29:41.961122+0000","last_became_peered":"2024-09-12T17:29:41.961122+0000","last_unstale":"2024-09-12T18:08:10.547746+0000","last_undegraded":"2024-09-12T18:08:10.547746+0000","last_fullsized":"2024-09-12T18:08:10.547746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T18:08:10.547560+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T18:08:10.547560+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.547560+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:55.070358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00095277999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'244","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.749009+0000","last_change":"2024-09-12T18:08:08.748940+0000","last_active":"2024-09-12T18:08:08.749009+0000","last_peered":"2024-09-12T18:08:08.749009+0000","last_clean":"2024-09-12T18:08:08.749009+0000","last_became_active":"2024-09-12T17:29:52.958406+0000","last_became_peered":"2024-09-12T17:29:52.958406+0000","last_unstale":"2024-09-12T18:08:08.749009+0000","last_undegraded":"2024-09-12T18:08:08.749009+0000","last_fullsized":"2024-09-12T18:08:08.749009+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'244","last_scrub_stamp":"2024-09-12T18:08:08.748824+0000","last_deep_scrub":"264'244","last_deep_scrub_stamp":"2024-09-12T18:08:08.748824+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.748824+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:58.654869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":569,"num_read_kb":48737,"num_write":1100,"num_write_kb":63490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.237589+0000","last_change":"2024-09-12T18:08:26.237589+0000","last_active":"2024-09-12T18:08:26.237589+0000","last_peered":"2024-09-12T18:08:26.237589+0000","last_clean":"2024-09-12T18:08:26.237589+0000","last_became_active":"2024-09-12T17:29:56.954018+0000","last_became_peered":"2024-09-12T17:29:56.954018+0000","last_unstale":"2024-09-12T18:08:26.237589+0000","last_undegraded":"2024-09-12T18:08:26.237589+0000","last_fullsized":"2024-09-12T18:08:26.237589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:26.237500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:26.237500+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.237500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:30.090296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'118","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.963725+0000","last_change":"2024-09-12T18:08:30.963654+0000","last_active":"2024-09-12T18:08:30.963725+0000","last_peered":"2024-09-12T18:08:30.963725+0000","last_clean":"2024-09-12T18:08:30.963725+0000","last_became_active":"2024-09-12T17:29:58.953909+0000","last_became_peered":"2024-09-12T17:29:58.953909+0000","last_unstale":"2024-09-12T18:08:30.963725+0000","last_undegraded":"2024-09-12T18:08:30.963725+0000","last_fullsized":"2024-09-12T18:08:30.963725+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-12T18:08:30.963563+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-12T18:08:30.963563+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.963563+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:58.827555+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":123,"num_read_kb":117,"num_write":90,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.006342+0000","last_change":"2024-09-12T18:08:26.006228+0000","last_active":"2024-09-12T18:08:26.006342+0000","last_peered":"2024-09-12T18:08:26.006342+0000","last_clean":"2024-09-12T18:08:26.006342+0000","last_became_active":"2024-09-12T17:30:00.967279+0000","last_became_peered":"2024-09-12T17:30:00.967279+0000","last_unstale":"2024-09-12T18:08:26.006342+0000","last_undegraded":"2024-09-12T18:08:26.006342+0000","last_fullsized":"2024-09-12T18:08:26.006342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:26.006129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:26.006129+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.006129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:48.986438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'207","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.412097+0000","last_change":"2024-09-12T18:08:42.412024+0000","last_active":"2024-09-12T18:08:42.412097+0000","last_peered":"2024-09-12T18:08:42.412097+0000","last_clean":"2024-09-12T18:08:42.412097+0000","last_became_active":"2024-09-12T17:30:02.969486+0000","last_became_peered":"2024-09-12T17:30:02.969486+0000","last_unstale":"2024-09-12T18:08:42.412097+0000","last_undegraded":"2024-09-12T18:08:42.412097+0000","last_fullsized":"2024-09-12T18:08:42.412097+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:42.411931+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:42.411931+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.411931+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:03.146985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":397,"num_write":473,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'156","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.251870+0000","last_change":"2024-09-12T18:08:16.251799+0000","last_active":"2024-09-12T18:08:16.251870+0000","last_peered":"2024-09-12T18:08:16.251870+0000","last_clean":"2024-09-12T18:08:16.251870+0000","last_became_active":"2024-09-12T17:29:54.963669+0000","last_became_peered":"2024-09-12T17:29:54.963669+0000","last_unstale":"2024-09-12T18:08:16.251870+0000","last_undegraded":"2024-09-12T18:08:16.251870+0000","last_fullsized":"2024-09-12T18:08:16.251870+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-12T18:08:16.251716+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-12T18:08:16.251716+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.251716+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:44.134038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":549,"num_write":259,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'205","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.503195+0000","last_change":"2024-09-12T18:08:11.503195+0000","last_active":"2024-09-12T18:08:11.503195+0000","last_peered":"2024-09-12T18:08:11.503195+0000","last_clean":"2024-09-12T18:08:11.503195+0000","last_became_active":"2024-09-12T17:29:52.954220+0000","last_became_peered":"2024-09-12T17:29:52.954220+0000","last_unstale":"2024-09-12T18:08:11.503195+0000","last_undegraded":"2024-09-12T18:08:11.503195+0000","last_fullsized":"2024-09-12T18:08:11.503195+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'205","last_scrub_stamp":"2024-09-12T18:08:11.503069+0000","last_deep_scrub":"264'205","last_deep_scrub_stamp":"2024-09-12T18:08:11.503069+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.503069+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:14.820377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":525,"num_read_kb":74998,"num_write":1066,"num_write_kb":38098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.352179+0000","last_change":"2024-09-12T18:08:08.352125+0000","last_active":"2024-09-12T18:08:08.352179+0000","last_peered":"2024-09-12T18:08:08.352179+0000","last_clean":"2024-09-12T18:08:08.352179+0000","last_became_active":"2024-09-12T17:29:42.064741+0000","last_became_peered":"2024-09-12T17:29:42.064741+0000","last_unstale":"2024-09-12T18:08:08.352179+0000","last_undegraded":"2024-09-12T18:08:08.352179+0000","last_fullsized":"2024-09-12T18:08:08.352179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:08.352056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:08.352056+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.352056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:03.352768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043924099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.228596+0000","last_change":"2024-09-12T18:08:25.228596+0000","last_active":"2024-09-12T18:08:25.228596+0000","last_peered":"2024-09-12T18:08:25.228596+0000","last_clean":"2024-09-12T18:08:25.228596+0000","last_became_active":"2024-09-12T17:29:56.955562+0000","last_became_peered":"2024-09-12T17:29:56.955562+0000","last_unstale":"2024-09-12T18:08:25.228596+0000","last_undegraded":"2024-09-12T18:08:25.228596+0000","last_fullsized":"2024-09-12T18:08:25.228596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.228503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.228503+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.228503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:54.858311+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'271","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.272312+0000","last_change":"2024-09-12T18:08:28.272312+0000","last_active":"2024-09-12T18:08:28.272312+0000","last_peered":"2024-09-12T18:08:28.272312+0000","last_clean":"2024-09-12T18:08:28.272312+0000","last_became_active":"2024-09-12T17:29:58.960410+0000","last_became_peered":"2024-09-12T17:29:58.960410+0000","last_unstale":"2024-09-12T18:08:28.272312+0000","last_undegraded":"2024-09-12T18:08:28.272312+0000","last_fullsized":"2024-09-12T18:08:28.272312+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-12T18:08:28.272217+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-12T18:08:28.272217+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.272217+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:32.383273+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14017,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":378,"num_read_kb":510,"num_write":242,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11880,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.834068+0000","last_change":"2024-09-12T18:08:36.834068+0000","last_active":"2024-09-12T18:08:36.834068+0000","last_peered":"2024-09-12T18:08:36.834068+0000","last_clean":"2024-09-12T18:08:36.834068+0000","last_became_active":"2024-09-12T17:30:00.963660+0000","last_became_peered":"2024-09-12T17:30:00.963660+0000","last_unstale":"2024-09-12T18:08:36.834068+0000","last_undegraded":"2024-09-12T18:08:36.834068+0000","last_fullsized":"2024-09-12T18:08:36.834068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:36.833959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:36.833959+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.833959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:36.771638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'174","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:42.340404+0000","last_change":"2024-09-12T18:08:42.340404+0000","last_active":"2024-09-12T18:08:42.340404+0000","last_peered":"2024-09-12T18:08:42.340404+0000","last_clean":"2024-09-12T18:08:42.340404+0000","last_became_active":"2024-09-12T17:30:02.971807+0000","last_became_peered":"2024-09-12T17:30:02.971807+0000","last_unstale":"2024-09-12T18:08:42.340404+0000","last_undegraded":"2024-09-12T18:08:42.340404+0000","last_fullsized":"2024-09-12T18:08:42.340404+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:08:42.340320+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:08:42.340320+0000","last_clean_scrub_stamp":"2024-09-12T18:08:42.340320+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:28.426511+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":246,"num_write":442,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'192","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.154219+0000","last_change":"2024-09-12T18:08:15.154129+0000","last_active":"2024-09-12T18:08:15.154219+0000","last_peered":"2024-09-12T18:08:15.154219+0000","last_clean":"2024-09-12T18:08:15.154219+0000","last_became_active":"2024-09-12T17:29:54.958998+0000","last_became_peered":"2024-09-12T17:29:54.958998+0000","last_unstale":"2024-09-12T18:08:15.154219+0000","last_undegraded":"2024-09-12T18:08:15.154219+0000","last_fullsized":"2024-09-12T18:08:15.154219+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-09-12T18:08:15.154013+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-09-12T18:08:15.154013+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.154013+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:33.665464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":908,"num_read_kb":764,"num_write":273,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'224","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.319544+0000","last_change":"2024-09-12T18:08:10.319484+0000","last_active":"2024-09-12T18:08:10.319544+0000","last_peered":"2024-09-12T18:08:10.319544+0000","last_clean":"2024-09-12T18:08:10.319544+0000","last_became_active":"2024-09-12T17:29:52.955429+0000","last_became_peered":"2024-09-12T17:29:52.955429+0000","last_unstale":"2024-09-12T18:08:10.319544+0000","last_undegraded":"2024-09-12T18:08:10.319544+0000","last_fullsized":"2024-09-12T18:08:10.319544+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'224","last_scrub_stamp":"2024-09-12T18:08:10.319399+0000","last_deep_scrub":"264'224","last_deep_scrub_stamp":"2024-09-12T18:08:10.319399+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.319399+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:41.245590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170313,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":39247,"num_write":990,"num_write_kb":44156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.715261+0000","last_change":"2024-09-12T18:08:11.715167+0000","last_active":"2024-09-12T18:08:11.715261+0000","last_peered":"2024-09-12T18:08:11.715261+0000","last_clean":"2024-09-12T18:08:11.715261+0000","last_became_active":"2024-09-12T17:29:42.064736+0000","last_became_peered":"2024-09-12T17:29:42.064736+0000","last_unstale":"2024-09-12T18:08:11.715261+0000","last_undegraded":"2024-09-12T18:08:11.715261+0000","last_fullsized":"2024-09-12T18:08:11.715261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:11.715042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:11.715042+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.715042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:08.443705+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045118300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.082844+0000","last_change":"2024-09-12T18:08:23.082844+0000","last_active":"2024-09-12T18:08:23.082844+0000","last_peered":"2024-09-12T18:08:23.082844+0000","last_clean":"2024-09-12T18:08:23.082844+0000","last_became_active":"2024-09-12T17:29:56.957503+0000","last_became_peered":"2024-09-12T17:29:56.957503+0000","last_unstale":"2024-09-12T18:08:23.082844+0000","last_undegraded":"2024-09-12T18:08:23.082844+0000","last_fullsized":"2024-09-12T18:08:23.082844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:23.082745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:23.082745+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.082745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:14.276157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'157","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.314767+0000","last_change":"2024-09-12T18:08:28.314767+0000","last_active":"2024-09-12T18:08:28.314767+0000","last_peered":"2024-09-12T18:08:28.314767+0000","last_clean":"2024-09-12T18:08:28.314767+0000","last_became_active":"2024-09-12T17:29:58.978487+0000","last_became_peered":"2024-09-12T17:29:58.978487+0000","last_unstale":"2024-09-12T18:08:28.314767+0000","last_undegraded":"2024-09-12T18:08:28.314767+0000","last_fullsized":"2024-09-12T18:08:28.314767+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'157","last_scrub_stamp":"2024-09-12T18:08:28.314678+0000","last_deep_scrub":"264'157","last_deep_scrub_stamp":"2024-09-12T18:08:28.314678+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.314678+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:43.823711+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":172,"num_read_kb":165,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'772","reported_seq":2453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.410854+0000","last_change":"2024-09-12T18:08:40.410854+0000","last_active":"2024-09-12T18:08:40.410854+0000","last_peered":"2024-09-12T18:08:40.410854+0000","last_clean":"2024-09-12T18:08:40.410854+0000","last_became_active":"2024-09-12T17:30:00.956655+0000","last_became_peered":"2024-09-12T17:30:00.956655+0000","last_unstale":"2024-09-12T18:08:40.410854+0000","last_undegraded":"2024-09-12T18:08:40.410854+0000","last_fullsized":"2024-09-12T18:08:40.410854+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'772","last_scrub_stamp":"2024-09-12T18:08:40.410755+0000","last_deep_scrub":"264'772","last_deep_scrub_stamp":"2024-09-12T18:08:40.410755+0000","last_clean_scrub_stamp":"2024-09-12T18:08:40.410755+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:40.083368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'122","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.932516+0000","last_change":"2024-09-12T18:08:45.932516+0000","last_active":"2024-09-12T18:08:45.932516+0000","last_peered":"2024-09-12T18:08:45.932516+0000","last_clean":"2024-09-12T18:08:45.932516+0000","last_became_active":"2024-09-12T17:30:02.968978+0000","last_became_peered":"2024-09-12T17:30:02.968978+0000","last_unstale":"2024-09-12T18:08:45.932516+0000","last_undegraded":"2024-09-12T18:08:45.932516+0000","last_fullsized":"2024-09-12T18:08:45.932516+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'122","last_scrub_stamp":"2024-09-12T18:08:45.932416+0000","last_deep_scrub":"264'122","last_deep_scrub_stamp":"2024-09-12T18:08:45.932416+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.932416+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:31.256238+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1365,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":174,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'406","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.094428+0000","last_change":"2024-09-12T18:08:17.094428+0000","last_active":"2024-09-12T18:08:17.094428+0000","last_peered":"2024-09-12T18:08:17.094428+0000","last_clean":"2024-09-12T18:08:17.094428+0000","last_became_active":"2024-09-12T17:29:54.955170+0000","last_became_peered":"2024-09-12T17:29:54.955170+0000","last_unstale":"2024-09-12T18:08:17.094428+0000","last_undegraded":"2024-09-12T18:08:17.094428+0000","last_fullsized":"2024-09-12T18:08:17.094428+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-09-12T18:08:17.094343+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-09-12T18:08:17.094343+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.094343+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:22.112938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1829,"num_read_kb":1585,"num_write":674,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'168","reported_seq":768,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:09.262301+0000","last_change":"2024-09-12T18:08:09.262237+0000","last_active":"2024-09-12T18:08:09.262301+0000","last_peered":"2024-09-12T18:08:09.262301+0000","last_clean":"2024-09-12T18:08:09.262301+0000","last_became_active":"2024-09-12T17:30:28.004804+0000","last_became_peered":"2024-09-12T17:30:28.004804+0000","last_unstale":"2024-09-12T18:08:09.262301+0000","last_undegraded":"2024-09-12T18:08:09.262301+0000","last_fullsized":"2024-09-12T18:08:09.262301+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-12T18:08:09.262150+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-12T18:08:09.262150+0000","last_clean_scrub_stamp":"2024-09-12T18:08:09.262150+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:43.192647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262290,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":342,"num_read_kb":56981,"num_write":802,"num_write_kb":25989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7],"acting":[2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:07.370369+0000","last_change":"2024-09-12T18:08:07.370292+0000","last_active":"2024-09-12T18:08:07.370369+0000","last_peered":"2024-09-12T18:08:07.370369+0000","last_clean":"2024-09-12T18:08:07.370369+0000","last_became_active":"2024-09-12T17:29:41.961194+0000","last_became_peered":"2024-09-12T17:29:41.961194+0000","last_unstale":"2024-09-12T18:08:07.370369+0000","last_undegraded":"2024-09-12T18:08:07.370369+0000","last_fullsized":"2024-09-12T18:08:07.370369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:07.370196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:07.370196+0000","last_clean_scrub_stamp":"2024-09-12T18:08:07.370196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:17.088343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00049442699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.840682+0000","last_change":"2024-09-12T18:08:27.840682+0000","last_active":"2024-09-12T18:08:27.840682+0000","last_peered":"2024-09-12T18:08:27.840682+0000","last_clean":"2024-09-12T18:08:27.840682+0000","last_became_active":"2024-09-12T17:29:56.955865+0000","last_became_peered":"2024-09-12T17:29:56.955865+0000","last_unstale":"2024-09-12T18:08:27.840682+0000","last_undegraded":"2024-09-12T18:08:27.840682+0000","last_fullsized":"2024-09-12T18:08:27.840682+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.840597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.840597+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.840597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:30.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'101","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.847564+0000","last_change":"2024-09-12T18:08:31.847564+0000","last_active":"2024-09-12T18:08:31.847564+0000","last_peered":"2024-09-12T18:08:31.847564+0000","last_clean":"2024-09-12T18:08:31.847564+0000","last_became_active":"2024-09-12T17:29:58.953924+0000","last_became_peered":"2024-09-12T17:29:58.953924+0000","last_unstale":"2024-09-12T18:08:31.847564+0000","last_undegraded":"2024-09-12T18:08:31.847564+0000","last_fullsized":"2024-09-12T18:08:31.847564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'101","last_scrub_stamp":"2024-09-12T18:08:31.847468+0000","last_deep_scrub":"264'101","last_deep_scrub_stamp":"2024-09-12T18:08:31.847468+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.847468+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:50.319108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":108,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'781","reported_seq":2102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.859208+0000","last_change":"2024-09-12T18:08:38.859208+0000","last_active":"2024-09-12T18:08:38.859208+0000","last_peered":"2024-09-12T18:08:38.859208+0000","last_clean":"2024-09-12T18:08:38.859208+0000","last_became_active":"2024-09-12T17:30:00.967168+0000","last_became_peered":"2024-09-12T17:30:00.967168+0000","last_unstale":"2024-09-12T18:08:38.859208+0000","last_undegraded":"2024-09-12T18:08:38.859208+0000","last_fullsized":"2024-09-12T18:08:38.859208+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'781","last_scrub_stamp":"2024-09-12T18:08:38.859128+0000","last_deep_scrub":"264'781","last_deep_scrub_stamp":"2024-09-12T18:08:38.859128+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.859128+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:51.244607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'304","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.290565+0000","last_change":"2024-09-12T18:08:41.290565+0000","last_active":"2024-09-12T18:08:41.290565+0000","last_peered":"2024-09-12T18:08:41.290565+0000","last_clean":"2024-09-12T18:08:41.290565+0000","last_became_active":"2024-09-12T17:30:02.969526+0000","last_became_peered":"2024-09-12T17:30:02.969526+0000","last_unstale":"2024-09-12T18:08:41.290565+0000","last_undegraded":"2024-09-12T18:08:41.290565+0000","last_fullsized":"2024-09-12T18:08:41.290565+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'304","last_scrub_stamp":"2024-09-12T18:08:41.290483+0000","last_deep_scrub":"264'304","last_deep_scrub_stamp":"2024-09-12T18:08:41.290483+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.290483+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:17.435474+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":439,"num_write":657,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'44","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.696767+0000","last_change":"2024-09-12T18:08:12.696695+0000","last_active":"2024-09-12T18:08:12.696767+0000","last_peered":"2024-09-12T18:08:12.696767+0000","last_clean":"2024-09-12T18:08:12.696767+0000","last_became_active":"2024-09-12T17:29:54.957906+0000","last_became_peered":"2024-09-12T17:29:54.957906+0000","last_unstale":"2024-09-12T18:08:12.696767+0000","last_undegraded":"2024-09-12T18:08:12.696767+0000","last_fullsized":"2024-09-12T18:08:12.696767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T18:08:12.696599+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T18:08:12.696599+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.696599+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:18.217996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":180,"num_write":59,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'212","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.278928+0000","last_change":"2024-09-12T18:08:10.278838+0000","last_active":"2024-09-12T18:08:10.278928+0000","last_peered":"2024-09-12T18:08:10.278928+0000","last_clean":"2024-09-12T18:08:10.278928+0000","last_became_active":"2024-09-12T17:30:28.006884+0000","last_became_peered":"2024-09-12T17:30:28.006884+0000","last_unstale":"2024-09-12T18:08:10.278928+0000","last_undegraded":"2024-09-12T18:08:10.278928+0000","last_fullsized":"2024-09-12T18:08:10.278928+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-12T18:08:10.278730+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-12T18:08:10.278730+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.278730+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.094728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":14673,"num_write":991,"num_write_kb":46674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.055459+0000","last_change":"2024-09-12T18:08:10.055401+0000","last_active":"2024-09-12T18:08:10.055459+0000","last_peered":"2024-09-12T18:08:10.055459+0000","last_clean":"2024-09-12T18:08:10.055459+0000","last_became_active":"2024-09-12T17:29:41.961477+0000","last_became_peered":"2024-09-12T17:29:41.961477+0000","last_unstale":"2024-09-12T18:08:10.055459+0000","last_undegraded":"2024-09-12T18:08:10.055459+0000","last_fullsized":"2024-09-12T18:08:10.055459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:10.055313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:10.055313+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.055313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:09.016405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041855800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.023133+0000","last_change":"2024-09-12T18:08:25.023133+0000","last_active":"2024-09-12T18:08:25.023133+0000","last_peered":"2024-09-12T18:08:25.023133+0000","last_clean":"2024-09-12T18:08:25.023133+0000","last_became_active":"2024-09-12T17:29:56.954168+0000","last_became_peered":"2024-09-12T17:29:56.954168+0000","last_unstale":"2024-09-12T18:08:25.023133+0000","last_undegraded":"2024-09-12T18:08:25.023133+0000","last_fullsized":"2024-09-12T18:08:25.023133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.022986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.022986+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.022986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:42.498998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'320","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.888007+0000","last_change":"2024-09-12T18:08:32.888007+0000","last_active":"2024-09-12T18:08:32.888007+0000","last_peered":"2024-09-12T18:08:32.888007+0000","last_clean":"2024-09-12T18:08:32.888007+0000","last_became_active":"2024-09-12T17:29:58.978222+0000","last_became_peered":"2024-09-12T17:29:58.978222+0000","last_unstale":"2024-09-12T18:08:32.888007+0000","last_undegraded":"2024-09-12T18:08:32.888007+0000","last_fullsized":"2024-09-12T18:08:32.888007+0000","mapping_epoch":30,"log_start":"264'300","ondisk_log_start":"264'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'320","last_scrub_stamp":"2024-09-12T18:08:32.887900+0000","last_deep_scrub":"264'320","last_deep_scrub_stamp":"2024-09-12T18:08:32.887900+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.887900+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:36.484816+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25498,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":718,"num_write":254,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.896645+0000","last_change":"2024-09-12T18:08:37.896645+0000","last_active":"2024-09-12T18:08:37.896645+0000","last_peered":"2024-09-12T18:08:37.896645+0000","last_clean":"2024-09-12T18:08:37.896645+0000","last_became_active":"2024-09-12T17:30:00.968527+0000","last_became_peered":"2024-09-12T17:30:00.968527+0000","last_unstale":"2024-09-12T18:08:37.896645+0000","last_undegraded":"2024-09-12T18:08:37.896645+0000","last_fullsized":"2024-09-12T18:08:37.896645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:37.896560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:37.896560+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.896560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:08.112093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'125","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.454152+0000","last_change":"2024-09-12T18:08:43.454152+0000","last_active":"2024-09-12T18:08:43.454152+0000","last_peered":"2024-09-12T18:08:43.454152+0000","last_clean":"2024-09-12T18:08:43.454152+0000","last_became_active":"2024-09-12T17:30:02.966018+0000","last_became_peered":"2024-09-12T17:30:02.966018+0000","last_unstale":"2024-09-12T18:08:43.454152+0000","last_undegraded":"2024-09-12T18:08:43.454152+0000","last_fullsized":"2024-09-12T18:08:43.454152+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-12T18:08:43.454064+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-12T18:08:43.454064+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.454064+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:24.393994+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":226,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'155","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.406175+0000","last_change":"2024-09-12T18:08:45.406175+0000","last_active":"2024-09-12T18:08:45.406175+0000","last_peered":"2024-09-12T18:08:45.406175+0000","last_clean":"2024-09-12T18:08:45.406175+0000","last_became_active":"2024-09-12T17:30:02.964133+0000","last_became_peered":"2024-09-12T17:30:02.964133+0000","last_unstale":"2024-09-12T18:08:45.406175+0000","last_undegraded":"2024-09-12T18:08:45.406175+0000","last_fullsized":"2024-09-12T18:08:45.406175+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'155","last_scrub_stamp":"2024-09-12T18:08:45.406061+0000","last_deep_scrub":"264'155","last_deep_scrub_stamp":"2024-09-12T18:08:45.406061+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.406061+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:36.421474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":286,"num_write":383,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'105","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.701136+0000","last_change":"2024-09-12T18:08:15.701136+0000","last_active":"2024-09-12T18:08:15.701136+0000","last_peered":"2024-09-12T18:08:15.701136+0000","last_clean":"2024-09-12T18:08:15.701136+0000","last_became_active":"2024-09-12T17:29:54.955716+0000","last_became_peered":"2024-09-12T17:29:54.955716+0000","last_unstale":"2024-09-12T18:08:15.701136+0000","last_undegraded":"2024-09-12T18:08:15.701136+0000","last_fullsized":"2024-09-12T18:08:15.701136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-12T18:08:15.701059+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-12T18:08:15.701059+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.701059+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:28.452054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":383,"num_write":153,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'185","reported_seq":785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.353007+0000","last_change":"2024-09-12T18:08:15.353007+0000","last_active":"2024-09-12T18:08:15.353007+0000","last_peered":"2024-09-12T18:08:15.353007+0000","last_clean":"2024-09-12T18:08:15.353007+0000","last_became_active":"2024-09-12T17:30:28.200487+0000","last_became_peered":"2024-09-12T17:30:28.200487+0000","last_unstale":"2024-09-12T18:08:15.353007+0000","last_undegraded":"2024-09-12T18:08:15.353007+0000","last_fullsized":"2024-09-12T18:08:15.353007+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-12T18:08:15.352875+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-12T18:08:15.352875+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.352875+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:15.449063+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":393,"num_read_kb":70111,"num_write":894,"num_write_kb":56875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.323914+0000","last_change":"2024-09-12T18:08:24.323914+0000","last_active":"2024-09-12T18:08:24.323914+0000","last_peered":"2024-09-12T18:08:24.323914+0000","last_clean":"2024-09-12T18:08:24.323914+0000","last_became_active":"2024-09-12T17:29:56.952578+0000","last_became_peered":"2024-09-12T17:29:56.952578+0000","last_unstale":"2024-09-12T18:08:24.323914+0000","last_undegraded":"2024-09-12T18:08:24.323914+0000","last_fullsized":"2024-09-12T18:08:24.323914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:24.323828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:24.323828+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.323828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:27.495028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'130","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.906581+0000","last_change":"2024-09-12T18:08:33.906581+0000","last_active":"2024-09-12T18:08:33.906581+0000","last_peered":"2024-09-12T18:08:33.906581+0000","last_clean":"2024-09-12T18:08:33.906581+0000","last_became_active":"2024-09-12T17:29:58.955111+0000","last_became_peered":"2024-09-12T17:29:58.955111+0000","last_unstale":"2024-09-12T18:08:33.906581+0000","last_undegraded":"2024-09-12T18:08:33.906581+0000","last_fullsized":"2024-09-12T18:08:33.906581+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T18:08:33.906456+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T18:08:33.906456+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.906456+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:56.253668+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":163,"num_read_kb":266,"num_write":84,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.811028+0000","last_change":"2024-09-12T18:08:39.811028+0000","last_active":"2024-09-12T18:08:39.811028+0000","last_peered":"2024-09-12T18:08:39.811028+0000","last_clean":"2024-09-12T18:08:39.811028+0000","last_became_active":"2024-09-12T17:30:00.965975+0000","last_became_peered":"2024-09-12T17:30:00.965975+0000","last_unstale":"2024-09-12T18:08:39.811028+0000","last_undegraded":"2024-09-12T18:08:39.811028+0000","last_fullsized":"2024-09-12T18:08:39.811028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:39.810896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:39.810896+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.810896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:04.330311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'107","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:47.928840+0000","last_change":"2024-09-12T18:08:47.928840+0000","last_active":"2024-09-12T18:08:47.928840+0000","last_peered":"2024-09-12T18:08:47.928840+0000","last_clean":"2024-09-12T18:08:47.928840+0000","last_became_active":"2024-09-12T17:30:02.965919+0000","last_became_peered":"2024-09-12T17:30:02.965919+0000","last_unstale":"2024-09-12T18:08:47.928840+0000","last_undegraded":"2024-09-12T18:08:47.928840+0000","last_fullsized":"2024-09-12T18:08:47.928840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-12T18:08:47.928754+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-12T18:08:47.928754+0000","last_clean_scrub_stamp":"2024-09-12T18:08:47.928754+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.514514+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":165,"num_read_kb":151,"num_write":248,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'420","reported_seq":1175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.282459+0000","last_change":"2024-09-12T18:08:19.282459+0000","last_active":"2024-09-12T18:08:19.282459+0000","last_peered":"2024-09-12T18:08:19.282459+0000","last_clean":"2024-09-12T18:08:19.282459+0000","last_became_active":"2024-09-12T17:29:54.954477+0000","last_became_peered":"2024-09-12T17:29:54.954477+0000","last_unstale":"2024-09-12T18:08:19.282459+0000","last_undegraded":"2024-09-12T18:08:19.282459+0000","last_fullsized":"2024-09-12T18:08:19.282459+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'420","last_scrub_stamp":"2024-09-12T18:08:19.282376+0000","last_deep_scrub":"264'420","last_deep_scrub_stamp":"2024-09-12T18:08:19.282376+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.282376+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:52.399922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1777,"num_write":781,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'210","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.683017+0000","last_change":"2024-09-12T18:08:17.682955+0000","last_active":"2024-09-12T18:08:17.683017+0000","last_peered":"2024-09-12T18:08:17.683017+0000","last_clean":"2024-09-12T18:08:17.683017+0000","last_became_active":"2024-09-12T17:29:52.956376+0000","last_became_peered":"2024-09-12T17:29:52.956376+0000","last_unstale":"2024-09-12T18:08:17.683017+0000","last_undegraded":"2024-09-12T18:08:17.683017+0000","last_fullsized":"2024-09-12T18:08:17.683017+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-12T18:08:17.682841+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-12T18:08:17.682841+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.682841+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:59.176548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":36390,"num_write":986,"num_write_kb":36751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.983279+0000","last_change":"2024-09-12T18:08:26.983279+0000","last_active":"2024-09-12T18:08:26.983279+0000","last_peered":"2024-09-12T18:08:26.983279+0000","last_clean":"2024-09-12T18:08:26.983279+0000","last_became_active":"2024-09-12T17:29:56.955256+0000","last_became_peered":"2024-09-12T17:29:56.955256+0000","last_unstale":"2024-09-12T18:08:26.983279+0000","last_undegraded":"2024-09-12T18:08:26.983279+0000","last_fullsized":"2024-09-12T18:08:26.983279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:26.983183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:26.983183+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.983183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:10.917322+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'54","reported_seq":559,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.221679+0000","last_change":"2024-09-12T18:08:31.221679+0000","last_active":"2024-09-12T18:08:31.221679+0000","last_peered":"2024-09-12T18:08:31.221679+0000","last_clean":"2024-09-12T18:08:31.221679+0000","last_became_active":"2024-09-12T17:29:58.960476+0000","last_became_peered":"2024-09-12T17:29:58.960476+0000","last_unstale":"2024-09-12T18:08:31.221679+0000","last_undegraded":"2024-09-12T18:08:31.221679+0000","last_fullsized":"2024-09-12T18:08:31.221679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'54","last_scrub_stamp":"2024-09-12T18:08:31.221616+0000","last_deep_scrub":"264'54","last_deep_scrub_stamp":"2024-09-12T18:08:31.221616+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.221616+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:54.384978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.997404+0000","last_change":"2024-09-12T18:08:39.997404+0000","last_active":"2024-09-12T18:08:39.997404+0000","last_peered":"2024-09-12T18:08:39.997404+0000","last_clean":"2024-09-12T18:08:39.997404+0000","last_became_active":"2024-09-12T17:30:00.958739+0000","last_became_peered":"2024-09-12T17:30:00.958739+0000","last_unstale":"2024-09-12T18:08:39.997404+0000","last_undegraded":"2024-09-12T18:08:39.997404+0000","last_fullsized":"2024-09-12T18:08:39.997404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:39.997305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:39.997305+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.997305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:54.123997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'190","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.374569+0000","last_change":"2024-09-12T18:08:43.374569+0000","last_active":"2024-09-12T18:08:43.374569+0000","last_peered":"2024-09-12T18:08:43.374569+0000","last_clean":"2024-09-12T18:08:43.374569+0000","last_became_active":"2024-09-12T17:30:02.972717+0000","last_became_peered":"2024-09-12T17:30:02.972717+0000","last_unstale":"2024-09-12T18:08:43.374569+0000","last_undegraded":"2024-09-12T18:08:43.374569+0000","last_fullsized":"2024-09-12T18:08:43.374569+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-12T18:08:43.374481+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-12T18:08:43.374481+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.374481+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:36.269631+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":309,"num_read_kb":305,"num_write":411,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'235","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.096877+0000","last_change":"2024-09-12T18:08:19.096877+0000","last_active":"2024-09-12T18:08:19.096877+0000","last_peered":"2024-09-12T18:08:19.096877+0000","last_clean":"2024-09-12T18:08:19.096877+0000","last_became_active":"2024-09-12T17:29:54.955897+0000","last_became_peered":"2024-09-12T17:29:54.955897+0000","last_unstale":"2024-09-12T18:08:19.096877+0000","last_undegraded":"2024-09-12T18:08:19.096877+0000","last_fullsized":"2024-09-12T18:08:19.096877+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'235","last_scrub_stamp":"2024-09-12T18:08:19.096790+0000","last_deep_scrub":"264'235","last_deep_scrub_stamp":"2024-09-12T18:08:19.096790+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.096790+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:13.358909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":344,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'244","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.511020+0000","last_change":"2024-09-12T18:08:12.510954+0000","last_active":"2024-09-12T18:08:12.511020+0000","last_peered":"2024-09-12T18:08:12.511020+0000","last_clean":"2024-09-12T18:08:12.511020+0000","last_became_active":"2024-09-12T17:29:52.954956+0000","last_became_peered":"2024-09-12T17:29:52.954956+0000","last_unstale":"2024-09-12T18:08:12.511020+0000","last_undegraded":"2024-09-12T18:08:12.511020+0000","last_fullsized":"2024-09-12T18:08:12.511020+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'244","last_scrub_stamp":"2024-09-12T18:08:12.510806+0000","last_deep_scrub":"264'244","last_deep_scrub_stamp":"2024-09-12T18:08:12.510806+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.510806+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:53.796805+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550036,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":646,"num_read_kb":5380,"num_write":1208,"num_write_kb":40346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:31.876369+0000","last_change":"2024-09-12T18:08:31.876369+0000","last_active":"2024-09-12T18:08:31.876369+0000","last_peered":"2024-09-12T18:08:31.876369+0000","last_clean":"2024-09-12T18:08:31.876369+0000","last_became_active":"2024-09-12T17:29:56.959460+0000","last_became_peered":"2024-09-12T17:29:56.959460+0000","last_unstale":"2024-09-12T18:08:31.876369+0000","last_undegraded":"2024-09-12T18:08:31.876369+0000","last_fullsized":"2024-09-12T18:08:31.876369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:31.876275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:31.876275+0000","last_clean_scrub_stamp":"2024-09-12T18:08:31.876275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:33.746738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'154","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.862640+0000","last_change":"2024-09-12T18:08:34.862640+0000","last_active":"2024-09-12T18:08:34.862640+0000","last_peered":"2024-09-12T18:08:34.862640+0000","last_clean":"2024-09-12T18:08:34.862640+0000","last_became_active":"2024-09-12T17:29:58.960824+0000","last_became_peered":"2024-09-12T17:29:58.960824+0000","last_unstale":"2024-09-12T18:08:34.862640+0000","last_undegraded":"2024-09-12T18:08:34.862640+0000","last_fullsized":"2024-09-12T18:08:34.862640+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-12T18:08:34.862546+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-12T18:08:34.862546+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.862546+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:17.967948+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":238,"num_write":106,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:28.025164+0000","last_change":"2024-09-12T18:08:28.025164+0000","last_active":"2024-09-12T18:08:28.025164+0000","last_peered":"2024-09-12T18:08:28.025164+0000","last_clean":"2024-09-12T18:08:28.025164+0000","last_became_active":"2024-09-12T17:30:00.967299+0000","last_became_peered":"2024-09-12T17:30:00.967299+0000","last_unstale":"2024-09-12T18:08:28.025164+0000","last_undegraded":"2024-09-12T18:08:28.025164+0000","last_fullsized":"2024-09-12T18:08:28.025164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:28.025075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:28.025075+0000","last_clean_scrub_stamp":"2024-09-12T18:08:28.025075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:03.790015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'94","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.406416+0000","last_change":"2024-09-12T18:08:45.406416+0000","last_active":"2024-09-12T18:08:45.406416+0000","last_peered":"2024-09-12T18:08:45.406416+0000","last_clean":"2024-09-12T18:08:45.406416+0000","last_became_active":"2024-09-12T17:30:02.965644+0000","last_became_peered":"2024-09-12T17:30:02.965644+0000","last_unstale":"2024-09-12T18:08:45.406416+0000","last_undegraded":"2024-09-12T18:08:45.406416+0000","last_fullsized":"2024-09-12T18:08:45.406416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'94","last_scrub_stamp":"2024-09-12T18:08:45.406309+0000","last_deep_scrub":"264'94","last_deep_scrub_stamp":"2024-09-12T18:08:45.406309+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.406309+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:51.501146+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":207,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'4299","reported_seq":4952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.123934+0000","last_change":"2024-09-12T18:08:18.123934+0000","last_active":"2024-09-12T18:08:18.123934+0000","last_peered":"2024-09-12T18:08:18.123934+0000","last_clean":"2024-09-12T18:08:18.123934+0000","last_became_active":"2024-09-12T17:29:54.950407+0000","last_became_peered":"2024-09-12T17:29:54.950407+0000","last_unstale":"2024-09-12T18:08:18.123934+0000","last_undegraded":"2024-09-12T18:08:18.123934+0000","last_fullsized":"2024-09-12T18:08:18.123934+0000","mapping_epoch":26,"log_start":"264'4200","ondisk_log_start":"264'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4299","last_scrub_stamp":"2024-09-12T18:08:18.123846+0000","last_deep_scrub":"264'4299","last_deep_scrub_stamp":"2024-09-12T18:08:18.123846+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.123846+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:58.856015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17237,"num_read_kb":14347,"num_write":6471,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'180","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:08.146524+0000","last_change":"2024-09-12T18:08:08.146470+0000","last_active":"2024-09-12T18:08:08.146524+0000","last_peered":"2024-09-12T18:08:08.146524+0000","last_clean":"2024-09-12T18:08:08.146524+0000","last_became_active":"2024-09-12T17:29:52.962836+0000","last_became_peered":"2024-09-12T17:29:52.962836+0000","last_unstale":"2024-09-12T18:08:08.146524+0000","last_undegraded":"2024-09-12T18:08:08.146524+0000","last_fullsized":"2024-09-12T18:08:08.146524+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T18:08:08.146374+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T18:08:08.146374+0000","last_clean_scrub_stamp":"2024-09-12T18:08:08.146374+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:03.930960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303959,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":45090,"num_write":889,"num_write_kb":58788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.009862+0000","last_change":"2024-09-12T18:08:25.009862+0000","last_active":"2024-09-12T18:08:25.009862+0000","last_peered":"2024-09-12T18:08:25.009862+0000","last_clean":"2024-09-12T18:08:25.009862+0000","last_became_active":"2024-09-12T17:29:56.957066+0000","last_became_peered":"2024-09-12T17:29:56.957066+0000","last_unstale":"2024-09-12T18:08:25.009862+0000","last_undegraded":"2024-09-12T18:08:25.009862+0000","last_fullsized":"2024-09-12T18:08:25.009862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:25.009761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:25.009761+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.009761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:29.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'156","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.895421+0000","last_change":"2024-09-12T18:08:34.895421+0000","last_active":"2024-09-12T18:08:34.895421+0000","last_peered":"2024-09-12T18:08:34.895421+0000","last_clean":"2024-09-12T18:08:34.895421+0000","last_became_active":"2024-09-12T17:29:58.955585+0000","last_became_peered":"2024-09-12T17:29:58.955585+0000","last_unstale":"2024-09-12T18:08:34.895421+0000","last_undegraded":"2024-09-12T18:08:34.895421+0000","last_fullsized":"2024-09-12T18:08:34.895421+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-12T18:08:34.895323+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-12T18:08:34.895323+0000","last_clean_scrub_stamp":"2024-09-12T18:08:34.895323+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:29.675628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7377,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":246,"num_write":102,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.258439+0000","last_change":"2024-09-12T18:08:37.258439+0000","last_active":"2024-09-12T18:08:37.258439+0000","last_peered":"2024-09-12T18:08:37.258439+0000","last_clean":"2024-09-12T18:08:37.258439+0000","last_became_active":"2024-09-12T17:30:00.964621+0000","last_became_peered":"2024-09-12T17:30:00.964621+0000","last_unstale":"2024-09-12T18:08:37.258439+0000","last_undegraded":"2024-09-12T18:08:37.258439+0000","last_fullsized":"2024-09-12T18:08:37.258439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:37.258356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:37.258356+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.258356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:26.246711+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'546","reported_seq":1353,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.122252+0000","last_change":"2024-09-12T18:08:20.122184+0000","last_active":"2024-09-12T18:08:20.122252+0000","last_peered":"2024-09-12T18:08:20.122252+0000","last_clean":"2024-09-12T18:08:20.122252+0000","last_became_active":"2024-09-12T17:29:54.958758+0000","last_became_peered":"2024-09-12T17:29:54.958758+0000","last_unstale":"2024-09-12T18:08:20.122252+0000","last_undegraded":"2024-09-12T18:08:20.122252+0000","last_fullsized":"2024-09-12T18:08:20.122252+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'546","last_scrub_stamp":"2024-09-12T18:08:20.122059+0000","last_deep_scrub":"264'546","last_deep_scrub_stamp":"2024-09-12T18:08:20.122059+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.122059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:18.469393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2571,"num_read_kb":2181,"num_write":951,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'212","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.316856+0000","last_change":"2024-09-12T18:08:13.316799+0000","last_active":"2024-09-12T18:08:13.316856+0000","last_peered":"2024-09-12T18:08:13.316856+0000","last_clean":"2024-09-12T18:08:13.316856+0000","last_became_active":"2024-09-12T17:30:28.007001+0000","last_became_peered":"2024-09-12T17:30:28.007001+0000","last_unstale":"2024-09-12T18:08:13.316856+0000","last_undegraded":"2024-09-12T18:08:13.316856+0000","last_fullsized":"2024-09-12T18:08:13.316856+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-12T18:08:13.316690+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-12T18:08:13.316690+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.316690+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:44.403007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":31262,"num_write":918,"num_write_kb":33441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.278158+0000","last_change":"2024-09-12T18:08:27.278158+0000","last_active":"2024-09-12T18:08:27.278158+0000","last_peered":"2024-09-12T18:08:27.278158+0000","last_clean":"2024-09-12T18:08:27.278158+0000","last_became_active":"2024-09-12T17:29:56.954498+0000","last_became_peered":"2024-09-12T17:29:56.954498+0000","last_unstale":"2024-09-12T18:08:27.278158+0000","last_undegraded":"2024-09-12T18:08:27.278158+0000","last_fullsized":"2024-09-12T18:08:27.278158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.278068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.278068+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.278068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:27.868992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'194","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.346927+0000","last_change":"2024-09-12T18:08:30.346927+0000","last_active":"2024-09-12T18:08:30.346927+0000","last_peered":"2024-09-12T18:08:30.346927+0000","last_clean":"2024-09-12T18:08:30.346927+0000","last_became_active":"2024-09-12T17:29:58.958198+0000","last_became_peered":"2024-09-12T17:29:58.958198+0000","last_unstale":"2024-09-12T18:08:30.346927+0000","last_undegraded":"2024-09-12T18:08:30.346927+0000","last_fullsized":"2024-09-12T18:08:30.346927+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'194","last_scrub_stamp":"2024-09-12T18:08:30.346829+0000","last_deep_scrub":"264'194","last_deep_scrub_stamp":"2024-09-12T18:08:30.346829+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.346829+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:10.264119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15825,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":439,"num_write":184,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.447811+0000","last_change":"2024-09-12T18:08:39.447811+0000","last_active":"2024-09-12T18:08:39.447811+0000","last_peered":"2024-09-12T18:08:39.447811+0000","last_clean":"2024-09-12T18:08:39.447811+0000","last_became_active":"2024-09-12T17:30:00.963706+0000","last_became_peered":"2024-09-12T17:30:00.963706+0000","last_unstale":"2024-09-12T18:08:39.447811+0000","last_undegraded":"2024-09-12T18:08:39.447811+0000","last_fullsized":"2024-09-12T18:08:39.447811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:39.447720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:39.447720+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.447720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:56.940712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'178","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.967851+0000","last_change":"2024-09-12T18:08:44.967851+0000","last_active":"2024-09-12T18:08:44.967851+0000","last_peered":"2024-09-12T18:08:44.967851+0000","last_clean":"2024-09-12T18:08:44.967851+0000","last_became_active":"2024-09-12T17:30:02.964682+0000","last_became_peered":"2024-09-12T17:30:02.964682+0000","last_unstale":"2024-09-12T18:08:44.967851+0000","last_undegraded":"2024-09-12T18:08:44.967851+0000","last_fullsized":"2024-09-12T18:08:44.967851+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-12T18:08:44.967764+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-12T18:08:44.967764+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.967764+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:57.259311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":239,"num_read_kb":250,"num_write":415,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'100","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.116313+0000","last_change":"2024-09-12T18:08:21.116313+0000","last_active":"2024-09-12T18:08:21.116313+0000","last_peered":"2024-09-12T18:08:21.116313+0000","last_clean":"2024-09-12T18:08:21.116313+0000","last_became_active":"2024-09-12T17:29:54.955326+0000","last_became_peered":"2024-09-12T17:29:54.955326+0000","last_unstale":"2024-09-12T18:08:21.116313+0000","last_undegraded":"2024-09-12T18:08:21.116313+0000","last_fullsized":"2024-09-12T18:08:21.116313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T18:08:21.116224+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T18:08:21.116224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.116224+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:01.095342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":334,"num_write":151,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'221","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.279702+0000","last_change":"2024-09-12T18:08:12.279609+0000","last_active":"2024-09-12T18:08:12.279702+0000","last_peered":"2024-09-12T18:08:12.279702+0000","last_clean":"2024-09-12T18:08:12.279702+0000","last_became_active":"2024-09-12T17:29:52.945616+0000","last_became_peered":"2024-09-12T17:29:52.945616+0000","last_unstale":"2024-09-12T18:08:12.279702+0000","last_undegraded":"2024-09-12T18:08:12.279702+0000","last_fullsized":"2024-09-12T18:08:12.279702+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-12T18:08:12.279483+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-12T18:08:12.279483+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.279483+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:42.023356+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109585,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":523,"num_read_kb":15300,"num_write":1084,"num_write_kb":27395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.034592+0000","last_change":"2024-09-12T18:08:24.034592+0000","last_active":"2024-09-12T18:08:24.034592+0000","last_peered":"2024-09-12T18:08:24.034592+0000","last_clean":"2024-09-12T18:08:24.034592+0000","last_became_active":"2024-09-12T17:29:56.959047+0000","last_became_peered":"2024-09-12T17:29:56.959047+0000","last_unstale":"2024-09-12T18:08:24.034592+0000","last_undegraded":"2024-09-12T18:08:24.034592+0000","last_fullsized":"2024-09-12T18:08:24.034592+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:24.034504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:24.034504+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.034504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:19.769078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'153","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.955655+0000","last_change":"2024-09-12T18:08:38.955655+0000","last_active":"2024-09-12T18:08:38.955655+0000","last_peered":"2024-09-12T18:08:38.955655+0000","last_clean":"2024-09-12T18:08:38.955655+0000","last_became_active":"2024-09-12T17:29:58.954747+0000","last_became_peered":"2024-09-12T17:29:58.954747+0000","last_unstale":"2024-09-12T18:08:38.955655+0000","last_undegraded":"2024-09-12T18:08:38.955655+0000","last_fullsized":"2024-09-12T18:08:38.955655+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-12T18:08:38.955556+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-12T18:08:38.955556+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.955556+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:06.885028+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10649,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":195,"num_read_kb":252,"num_write":120,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.272855+0000","last_change":"2024-09-12T18:08:32.272855+0000","last_active":"2024-09-12T18:08:32.272855+0000","last_peered":"2024-09-12T18:08:32.272855+0000","last_clean":"2024-09-12T18:08:32.272855+0000","last_became_active":"2024-09-12T17:30:00.959708+0000","last_became_peered":"2024-09-12T17:30:00.959708+0000","last_unstale":"2024-09-12T18:08:32.272855+0000","last_undegraded":"2024-09-12T18:08:32.272855+0000","last_fullsized":"2024-09-12T18:08:32.272855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:32.272771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:32.272771+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.272771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:27.610493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'221","reported_seq":727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.989954+0000","last_change":"2024-09-12T18:08:32.989954+0000","last_active":"2024-09-12T18:08:32.989954+0000","last_peered":"2024-09-12T18:08:32.989954+0000","last_clean":"2024-09-12T18:08:32.989954+0000","last_became_active":"2024-09-12T17:30:02.960928+0000","last_became_peered":"2024-09-12T17:30:02.960928+0000","last_unstale":"2024-09-12T18:08:32.989954+0000","last_undegraded":"2024-09-12T18:08:32.989954+0000","last_fullsized":"2024-09-12T18:08:32.989954+0000","mapping_epoch":34,"log_start":"264'200","ondisk_log_start":"264'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-12T18:08:32.989843+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-12T18:08:32.989843+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.989843+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:06.325021+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1837,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":219,"num_write":570,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'158","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.027630+0000","last_change":"2024-09-12T18:08:24.027630+0000","last_active":"2024-09-12T18:08:24.027630+0000","last_peered":"2024-09-12T18:08:24.027630+0000","last_clean":"2024-09-12T18:08:24.027630+0000","last_became_active":"2024-09-12T17:29:54.950294+0000","last_became_peered":"2024-09-12T17:29:54.950294+0000","last_unstale":"2024-09-12T18:08:24.027630+0000","last_undegraded":"2024-09-12T18:08:24.027630+0000","last_fullsized":"2024-09-12T18:08:24.027630+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'158","last_scrub_stamp":"2024-09-12T18:08:24.027548+0000","last_deep_scrub":"264'158","last_deep_scrub_stamp":"2024-09-12T18:08:24.027548+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.027548+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:58.664447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":567,"num_write":224,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'195","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.782806+0000","last_change":"2024-09-12T18:08:10.782806+0000","last_active":"2024-09-12T18:08:10.782806+0000","last_peered":"2024-09-12T18:08:10.782806+0000","last_clean":"2024-09-12T18:08:10.782806+0000","last_became_active":"2024-09-12T17:29:52.947363+0000","last_became_peered":"2024-09-12T17:29:52.947363+0000","last_unstale":"2024-09-12T18:08:10.782806+0000","last_undegraded":"2024-09-12T18:08:10.782806+0000","last_fullsized":"2024-09-12T18:08:10.782806+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T18:08:10.782711+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T18:08:10.782711+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.782711+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:11.562634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":129945,"num_write":977,"num_write_kb":26137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.800844+0000","last_change":"2024-09-12T18:08:30.800844+0000","last_active":"2024-09-12T18:08:30.800844+0000","last_peered":"2024-09-12T18:08:30.800844+0000","last_clean":"2024-09-12T18:08:30.800844+0000","last_became_active":"2024-09-12T17:29:56.951825+0000","last_became_peered":"2024-09-12T17:29:56.951825+0000","last_unstale":"2024-09-12T18:08:30.800844+0000","last_undegraded":"2024-09-12T18:08:30.800844+0000","last_fullsized":"2024-09-12T18:08:30.800844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:30.800714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:30.800714+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.800714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:41.916626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'137","reported_seq":710,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:36.880393+0000","last_change":"2024-09-12T18:08:36.880393+0000","last_active":"2024-09-12T18:08:36.880393+0000","last_peered":"2024-09-12T18:08:36.880393+0000","last_clean":"2024-09-12T18:08:36.880393+0000","last_became_active":"2024-09-12T17:29:58.978506+0000","last_became_peered":"2024-09-12T17:29:58.978506+0000","last_unstale":"2024-09-12T18:08:36.880393+0000","last_undegraded":"2024-09-12T18:08:36.880393+0000","last_fullsized":"2024-09-12T18:08:36.880393+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T18:08:36.880305+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T18:08:36.880305+0000","last_clean_scrub_stamp":"2024-09-12T18:08:36.880305+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:41.111977+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7433,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":163,"num_read_kb":221,"num_write":86,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:33.246856+0000","last_change":"2024-09-12T18:08:33.246856+0000","last_active":"2024-09-12T18:08:33.246856+0000","last_peered":"2024-09-12T18:08:33.246856+0000","last_clean":"2024-09-12T18:08:33.246856+0000","last_became_active":"2024-09-12T17:30:00.965628+0000","last_became_peered":"2024-09-12T17:30:00.965628+0000","last_unstale":"2024-09-12T18:08:33.246856+0000","last_undegraded":"2024-09-12T18:08:33.246856+0000","last_fullsized":"2024-09-12T18:08:33.246856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:33.246768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:33.246768+0000","last_clean_scrub_stamp":"2024-09-12T18:08:33.246768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:12.109698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'114","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.450871+0000","last_change":"2024-09-12T18:08:44.450871+0000","last_active":"2024-09-12T18:08:44.450871+0000","last_peered":"2024-09-12T18:08:44.450871+0000","last_clean":"2024-09-12T18:08:44.450871+0000","last_became_active":"2024-09-12T17:30:02.963242+0000","last_became_peered":"2024-09-12T17:30:02.963242+0000","last_unstale":"2024-09-12T18:08:44.450871+0000","last_undegraded":"2024-09-12T18:08:44.450871+0000","last_fullsized":"2024-09-12T18:08:44.450871+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-12T18:08:44.450782+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-12T18:08:44.450782+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.450782+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:52.905420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'168","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.408456+0000","last_change":"2024-09-12T18:08:17.408456+0000","last_active":"2024-09-12T18:08:17.408456+0000","last_peered":"2024-09-12T18:08:17.408456+0000","last_clean":"2024-09-12T18:08:17.408456+0000","last_became_active":"2024-09-12T17:29:54.950429+0000","last_became_peered":"2024-09-12T17:29:54.950429+0000","last_unstale":"2024-09-12T18:08:17.408456+0000","last_undegraded":"2024-09-12T18:08:17.408456+0000","last_fullsized":"2024-09-12T18:08:17.408456+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-12T18:08:17.408371+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-12T18:08:17.408371+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.408371+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:54.397921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":726,"num_read_kb":598,"num_write":255,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'195","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:10.186496+0000","last_change":"2024-09-12T18:08:10.186496+0000","last_active":"2024-09-12T18:08:10.186496+0000","last_peered":"2024-09-12T18:08:10.186496+0000","last_clean":"2024-09-12T18:08:10.186496+0000","last_became_active":"2024-09-12T17:29:52.966561+0000","last_became_peered":"2024-09-12T17:29:52.966561+0000","last_unstale":"2024-09-12T18:08:10.186496+0000","last_undegraded":"2024-09-12T18:08:10.186496+0000","last_fullsized":"2024-09-12T18:08:10.186496+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T18:08:10.186388+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T18:08:10.186388+0000","last_clean_scrub_stamp":"2024-09-12T18:08:10.186388+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:55.665607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":24994,"num_write":951,"num_write_kb":31573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.295158+0000","last_change":"2024-09-12T18:08:27.295158+0000","last_active":"2024-09-12T18:08:27.295158+0000","last_peered":"2024-09-12T18:08:27.295158+0000","last_clean":"2024-09-12T18:08:27.295158+0000","last_became_active":"2024-09-12T17:29:56.959185+0000","last_became_peered":"2024-09-12T17:29:56.959185+0000","last_unstale":"2024-09-12T18:08:27.295158+0000","last_undegraded":"2024-09-12T18:08:27.295158+0000","last_fullsized":"2024-09-12T18:08:27.295158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:27.295061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:27.295061+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.295061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:11.612594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'66","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.823689+0000","last_change":"2024-09-12T18:08:32.823689+0000","last_active":"2024-09-12T18:08:32.823689+0000","last_peered":"2024-09-12T18:08:32.823689+0000","last_clean":"2024-09-12T18:08:32.823689+0000","last_became_active":"2024-09-12T17:29:58.978247+0000","last_became_peered":"2024-09-12T17:29:58.978247+0000","last_unstale":"2024-09-12T18:08:32.823689+0000","last_undegraded":"2024-09-12T18:08:32.823689+0000","last_fullsized":"2024-09-12T18:08:32.823689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-12T18:08:32.823591+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-12T18:08:32.823591+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.823591+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:19.158862+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":59,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'759","reported_seq":2193,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.983428+0000","last_change":"2024-09-12T18:08:30.983428+0000","last_active":"2024-09-12T18:08:30.983428+0000","last_peered":"2024-09-12T18:08:30.983428+0000","last_clean":"2024-09-12T18:08:30.983428+0000","last_became_active":"2024-09-12T17:30:00.961928+0000","last_became_peered":"2024-09-12T17:30:00.961928+0000","last_unstale":"2024-09-12T18:08:30.983428+0000","last_undegraded":"2024-09-12T18:08:30.983428+0000","last_fullsized":"2024-09-12T18:08:30.983428+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'759","last_scrub_stamp":"2024-09-12T18:08:30.983344+0000","last_deep_scrub":"264'759","last_deep_scrub_stamp":"2024-09-12T18:08:30.983344+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.983344+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:19.296324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'103","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:43.027212+0000","last_change":"2024-09-12T18:08:43.027212+0000","last_active":"2024-09-12T18:08:43.027212+0000","last_peered":"2024-09-12T18:08:43.027212+0000","last_clean":"2024-09-12T18:08:43.027212+0000","last_became_active":"2024-09-12T17:30:02.963474+0000","last_became_peered":"2024-09-12T17:30:02.963474+0000","last_unstale":"2024-09-12T18:08:43.027212+0000","last_undegraded":"2024-09-12T18:08:43.027212+0000","last_fullsized":"2024-09-12T18:08:43.027212+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'103","last_scrub_stamp":"2024-09-12T18:08:43.027123+0000","last_deep_scrub":"264'103","last_deep_scrub_stamp":"2024-09-12T18:08:43.027123+0000","last_clean_scrub_stamp":"2024-09-12T18:08:43.027123+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:42.051090+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":237,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'463","reported_seq":1195,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.709763+0000","last_change":"2024-09-12T18:08:19.709763+0000","last_active":"2024-09-12T18:08:19.709763+0000","last_peered":"2024-09-12T18:08:19.709763+0000","last_clean":"2024-09-12T18:08:19.709763+0000","last_became_active":"2024-09-12T17:29:54.954344+0000","last_became_peered":"2024-09-12T17:29:54.954344+0000","last_unstale":"2024-09-12T18:08:19.709763+0000","last_undegraded":"2024-09-12T18:08:19.709763+0000","last_fullsized":"2024-09-12T18:08:19.709763+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'463","last_scrub_stamp":"2024-09-12T18:08:19.709661+0000","last_deep_scrub":"264'463","last_deep_scrub_stamp":"2024-09-12T18:08:19.709661+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.709661+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:54.883418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":1813,"num_write":696,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25964,"num_omap_keys":102,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'216","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.485347+0000","last_change":"2024-09-12T18:08:13.485347+0000","last_active":"2024-09-12T18:08:13.485347+0000","last_peered":"2024-09-12T18:08:13.485347+0000","last_clean":"2024-09-12T18:08:13.485347+0000","last_became_active":"2024-09-12T17:30:28.008012+0000","last_became_peered":"2024-09-12T17:30:28.008012+0000","last_unstale":"2024-09-12T18:08:13.485347+0000","last_undegraded":"2024-09-12T18:08:13.485347+0000","last_fullsized":"2024-09-12T18:08:13.485347+0000","mapping_epoch":37,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'216","last_scrub_stamp":"2024-09-12T18:08:13.485242+0000","last_deep_scrub":"264'216","last_deep_scrub_stamp":"2024-09-12T18:08:13.485242+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.485242+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:45.011332+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395846,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":11221,"num_write":1057,"num_write_kb":38249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:30.839996+0000","last_change":"2024-09-12T18:08:30.839996+0000","last_active":"2024-09-12T18:08:30.839996+0000","last_peered":"2024-09-12T18:08:30.839996+0000","last_clean":"2024-09-12T18:08:30.839996+0000","last_became_active":"2024-09-12T17:29:56.959496+0000","last_became_peered":"2024-09-12T17:29:56.959496+0000","last_unstale":"2024-09-12T18:08:30.839996+0000","last_undegraded":"2024-09-12T18:08:30.839996+0000","last_fullsized":"2024-09-12T18:08:30.839996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:30.839903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:30.839903+0000","last_clean_scrub_stamp":"2024-09-12T18:08:30.839903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:30.580080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'152","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:37.526860+0000","last_change":"2024-09-12T18:08:37.526801+0000","last_active":"2024-09-12T18:08:37.526860+0000","last_peered":"2024-09-12T18:08:37.526860+0000","last_clean":"2024-09-12T18:08:37.526860+0000","last_became_active":"2024-09-12T17:29:58.956214+0000","last_became_peered":"2024-09-12T17:29:58.956214+0000","last_unstale":"2024-09-12T18:08:37.526860+0000","last_undegraded":"2024-09-12T18:08:37.526860+0000","last_fullsized":"2024-09-12T18:08:37.526860+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-12T18:08:37.526690+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-12T18:08:37.526690+0000","last_clean_scrub_stamp":"2024-09-12T18:08:37.526690+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:57.107449+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7681,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":193,"num_read_kb":254,"num_write":108,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.269003+0000","last_change":"2024-09-12T18:08:38.268913+0000","last_active":"2024-09-12T18:08:38.269003+0000","last_peered":"2024-09-12T18:08:38.269003+0000","last_clean":"2024-09-12T18:08:38.269003+0000","last_became_active":"2024-09-12T17:30:00.964150+0000","last_became_peered":"2024-09-12T17:30:00.964150+0000","last_unstale":"2024-09-12T18:08:38.269003+0000","last_undegraded":"2024-09-12T18:08:38.269003+0000","last_fullsized":"2024-09-12T18:08:38.269003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:38.268825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:38.268825+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.268825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:00.721111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'179","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:45.027153+0000","last_change":"2024-09-12T18:08:45.027153+0000","last_active":"2024-09-12T18:08:45.027153+0000","last_peered":"2024-09-12T18:08:45.027153+0000","last_clean":"2024-09-12T18:08:45.027153+0000","last_became_active":"2024-09-12T17:30:02.972420+0000","last_became_peered":"2024-09-12T17:30:02.972420+0000","last_unstale":"2024-09-12T18:08:45.027153+0000","last_undegraded":"2024-09-12T18:08:45.027153+0000","last_fullsized":"2024-09-12T18:08:45.027153+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-12T18:08:45.027042+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-12T18:08:45.027042+0000","last_clean_scrub_stamp":"2024-09-12T18:08:45.027042+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:43.808824+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":302,"num_write":451,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'323","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.712424+0000","last_change":"2024-09-12T18:08:18.712424+0000","last_active":"2024-09-12T18:08:18.712424+0000","last_peered":"2024-09-12T18:08:18.712424+0000","last_clean":"2024-09-12T18:08:18.712424+0000","last_became_active":"2024-09-12T17:29:54.953626+0000","last_became_peered":"2024-09-12T17:29:54.953626+0000","last_unstale":"2024-09-12T18:08:18.712424+0000","last_undegraded":"2024-09-12T18:08:18.712424+0000","last_fullsized":"2024-09-12T18:08:18.712424+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-12T18:08:18.712342+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-12T18:08:18.712342+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.712342+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:25.450466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1393,"num_read_kb":1115,"num_write":522,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'171","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.435392+0000","last_change":"2024-09-12T18:08:14.435392+0000","last_active":"2024-09-12T18:08:14.435392+0000","last_peered":"2024-09-12T18:08:14.435392+0000","last_clean":"2024-09-12T18:08:14.435392+0000","last_became_active":"2024-09-12T17:30:28.200981+0000","last_became_peered":"2024-09-12T17:30:28.200981+0000","last_unstale":"2024-09-12T18:08:14.435392+0000","last_undegraded":"2024-09-12T18:08:14.435392+0000","last_fullsized":"2024-09-12T18:08:14.435392+0000","mapping_epoch":37,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T18:08:14.435270+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T18:08:14.435270+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.435270+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:50.031909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755684,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":377,"num_read_kb":41427,"num_write":835,"num_write_kb":40457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.468324+0000","last_change":"2024-09-12T18:08:35.468324+0000","last_active":"2024-09-12T18:08:35.468324+0000","last_peered":"2024-09-12T18:08:35.468324+0000","last_clean":"2024-09-12T18:08:35.468324+0000","last_became_active":"2024-09-12T17:29:56.955532+0000","last_became_peered":"2024-09-12T17:29:56.955532+0000","last_unstale":"2024-09-12T18:08:35.468324+0000","last_undegraded":"2024-09-12T18:08:35.468324+0000","last_fullsized":"2024-09-12T18:08:35.468324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:35.468227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:35.468227+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.468227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:04.731076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'126","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:32.252600+0000","last_change":"2024-09-12T18:08:32.252524+0000","last_active":"2024-09-12T18:08:32.252600+0000","last_peered":"2024-09-12T18:08:32.252600+0000","last_clean":"2024-09-12T18:08:32.252600+0000","last_became_active":"2024-09-12T17:29:58.960733+0000","last_became_peered":"2024-09-12T17:29:58.960733+0000","last_unstale":"2024-09-12T18:08:32.252600+0000","last_undegraded":"2024-09-12T18:08:32.252600+0000","last_fullsized":"2024-09-12T18:08:32.252600+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-12T18:08:32.252437+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-12T18:08:32.252437+0000","last_clean_scrub_stamp":"2024-09-12T18:08:32.252437+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:58.278526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9021,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":245,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.965813+0000","last_change":"2024-09-12T18:08:29.965744+0000","last_active":"2024-09-12T18:08:29.965813+0000","last_peered":"2024-09-12T18:08:29.965813+0000","last_clean":"2024-09-12T18:08:29.965813+0000","last_became_active":"2024-09-12T17:30:00.960358+0000","last_became_peered":"2024-09-12T17:30:00.960358+0000","last_unstale":"2024-09-12T18:08:29.965813+0000","last_undegraded":"2024-09-12T18:08:29.965813+0000","last_fullsized":"2024-09-12T18:08:29.965813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:29.965658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:29.965658+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.965658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:13.910376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'158","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:46.885318+0000","last_change":"2024-09-12T18:08:46.885318+0000","last_active":"2024-09-12T18:08:46.885318+0000","last_peered":"2024-09-12T18:08:46.885318+0000","last_clean":"2024-09-12T18:08:46.885318+0000","last_became_active":"2024-09-12T17:30:02.964082+0000","last_became_peered":"2024-09-12T17:30:02.964082+0000","last_unstale":"2024-09-12T18:08:46.885318+0000","last_undegraded":"2024-09-12T18:08:46.885318+0000","last_fullsized":"2024-09-12T18:08:46.885318+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'158","last_scrub_stamp":"2024-09-12T18:08:46.885228+0000","last_deep_scrub":"264'158","last_deep_scrub_stamp":"2024-09-12T18:08:46.885228+0000","last_clean_scrub_stamp":"2024-09-12T18:08:46.885228+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:11.849194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":313,"num_read_kb":292,"num_write":397,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'220","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.029703+0000","last_change":"2024-09-12T18:08:22.029640+0000","last_active":"2024-09-12T18:08:22.029703+0000","last_peered":"2024-09-12T18:08:22.029703+0000","last_clean":"2024-09-12T18:08:22.029703+0000","last_became_active":"2024-09-12T17:29:54.945602+0000","last_became_peered":"2024-09-12T17:29:54.945602+0000","last_unstale":"2024-09-12T18:08:22.029703+0000","last_undegraded":"2024-09-12T18:08:22.029703+0000","last_fullsized":"2024-09-12T18:08:22.029703+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-09-12T18:08:22.029561+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-09-12T18:08:22.029561+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.029561+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:33.368230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":778,"num_write":336,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'201","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.016294+0000","last_change":"2024-09-12T18:08:11.016294+0000","last_active":"2024-09-12T18:08:11.016294+0000","last_peered":"2024-09-12T18:08:11.016294+0000","last_clean":"2024-09-12T18:08:11.016294+0000","last_became_active":"2024-09-12T17:29:52.954457+0000","last_became_peered":"2024-09-12T17:29:52.954457+0000","last_unstale":"2024-09-12T18:08:11.016294+0000","last_undegraded":"2024-09-12T18:08:11.016294+0000","last_fullsized":"2024-09-12T18:08:11.016294+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-12T18:08:11.016216+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-12T18:08:11.016216+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.016216+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:39.597855+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":114782,"num_write":980,"num_write_kb":45150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.819088+0000","last_change":"2024-09-12T18:08:29.819020+0000","last_active":"2024-09-12T18:08:29.819088+0000","last_peered":"2024-09-12T18:08:29.819088+0000","last_clean":"2024-09-12T18:08:29.819088+0000","last_became_active":"2024-09-12T17:29:56.952946+0000","last_became_peered":"2024-09-12T17:29:56.952946+0000","last_unstale":"2024-09-12T18:08:29.819088+0000","last_undegraded":"2024-09-12T18:08:29.819088+0000","last_fullsized":"2024-09-12T18:08:29.819088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:29.818910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:29.818910+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.818910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:38.285964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'107","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.857386+0000","last_change":"2024-09-12T18:08:35.857386+0000","last_active":"2024-09-12T18:08:35.857386+0000","last_peered":"2024-09-12T18:08:35.857386+0000","last_clean":"2024-09-12T18:08:35.857386+0000","last_became_active":"2024-09-12T17:29:58.953283+0000","last_became_peered":"2024-09-12T17:29:58.953283+0000","last_unstale":"2024-09-12T18:08:35.857386+0000","last_undegraded":"2024-09-12T18:08:35.857386+0000","last_fullsized":"2024-09-12T18:08:35.857386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-12T18:08:35.857292+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-12T18:08:35.857292+0000","last_clean_scrub_stamp":"2024-09-12T18:08:35.857292+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:41.329996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":172,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.730107+0000","last_change":"2024-09-12T18:08:41.730107+0000","last_active":"2024-09-12T18:08:41.730107+0000","last_peered":"2024-09-12T18:08:41.730107+0000","last_clean":"2024-09-12T18:08:41.730107+0000","last_became_active":"2024-09-12T17:30:00.962703+0000","last_became_peered":"2024-09-12T17:30:00.962703+0000","last_unstale":"2024-09-12T18:08:41.730107+0000","last_undegraded":"2024-09-12T18:08:41.730107+0000","last_fullsized":"2024-09-12T18:08:41.730107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:41.730016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:41.730016+0000","last_clean_scrub_stamp":"2024-09-12T18:08:41.730016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:48.884526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'187","reported_seq":1652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.024563+0000","last_change":"2024-09-12T18:08:44.024496+0000","last_active":"2024-09-12T18:08:44.024563+0000","last_peered":"2024-09-12T18:08:44.024563+0000","last_clean":"2024-09-12T18:08:44.024563+0000","last_became_active":"2024-09-12T17:30:02.970633+0000","last_became_peered":"2024-09-12T17:30:02.970633+0000","last_unstale":"2024-09-12T18:08:44.024563+0000","last_undegraded":"2024-09-12T18:08:44.024563+0000","last_fullsized":"2024-09-12T18:08:44.024563+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-12T18:08:44.024393+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-12T18:08:44.024393+0000","last_clean_scrub_stamp":"2024-09-12T18:08:44.024393+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:31.627824+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1219,"num_read_kb":1215,"num_write":406,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'174","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.696868+0000","last_change":"2024-09-12T18:08:17.696777+0000","last_active":"2024-09-12T18:08:17.696868+0000","last_peered":"2024-09-12T18:08:17.696868+0000","last_clean":"2024-09-12T18:08:17.696868+0000","last_became_active":"2024-09-12T17:29:54.954585+0000","last_became_peered":"2024-09-12T17:29:54.954585+0000","last_unstale":"2024-09-12T18:08:17.696868+0000","last_undegraded":"2024-09-12T18:08:17.696868+0000","last_fullsized":"2024-09-12T18:08:17.696868+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:08:17.696671+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:08:17.696671+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.696671+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:23.668390+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":606,"num_write":278,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'199","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.144364+0000","last_change":"2024-09-12T18:08:11.144279+0000","last_active":"2024-09-12T18:08:11.144364+0000","last_peered":"2024-09-12T18:08:11.144364+0000","last_clean":"2024-09-12T18:08:11.144364+0000","last_became_active":"2024-09-12T17:29:52.956621+0000","last_became_peered":"2024-09-12T17:29:52.956621+0000","last_unstale":"2024-09-12T18:08:11.144364+0000","last_undegraded":"2024-09-12T18:08:11.144364+0000","last_fullsized":"2024-09-12T18:08:11.144364+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-12T18:08:11.144146+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-12T18:08:11.144146+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.144146+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:24.182892+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3104916,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":909,"num_read_kb":17688,"num_write":1020,"num_write_kb":27781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.296375+0000","last_change":"2024-09-12T18:08:26.296277+0000","last_active":"2024-09-12T18:08:26.296375+0000","last_peered":"2024-09-12T18:08:26.296375+0000","last_clean":"2024-09-12T18:08:26.296375+0000","last_became_active":"2024-09-12T17:29:56.954952+0000","last_became_peered":"2024-09-12T17:29:56.954952+0000","last_unstale":"2024-09-12T18:08:26.296375+0000","last_undegraded":"2024-09-12T18:08:26.296375+0000","last_fullsized":"2024-09-12T18:08:26.296375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T18:08:26.296172+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T18:08:26.296172+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.296172+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:56.807921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'142","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.785541+0000","last_change":"2024-09-12T18:08:39.785541+0000","last_active":"2024-09-12T18:08:39.785541+0000","last_peered":"2024-09-12T18:08:39.785541+0000","last_clean":"2024-09-12T18:08:39.785541+0000","last_became_active":"2024-09-12T17:29:58.953076+0000","last_became_peered":"2024-09-12T17:29:58.953076+0000","last_unstale":"2024-09-12T18:08:39.785541+0000","last_undegraded":"2024-09-12T18:08:39.785541+0000","last_fullsized":"2024-09-12T18:08:39.785541+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:08:39.785415+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:08:39.785415+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.785415+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:34.382114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9014,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":204,"num_read_kb":286,"num_write":112,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.259752+0000","last_change":"2024-09-12T18:08:39.259752+0000","last_active":"2024-09-12T18:08:39.259752+0000","last_peered":"2024-09-12T18:08:39.259752+0000","last_clean":"2024-09-12T18:08:39.259752+0000","last_became_active":"2024-09-12T17:30:00.964942+0000","last_became_peered":"2024-09-12T17:30:00.964942+0000","last_unstale":"2024-09-12T18:08:39.259752+0000","last_undegraded":"2024-09-12T18:08:39.259752+0000","last_fullsized":"2024-09-12T18:08:39.259752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:08:39.259657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:08:39.259657+0000","last_clean_scrub_stamp":"2024-09-12T18:08:39.259657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:46.708226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'118","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:38.790668+0000","last_change":"2024-09-12T18:08:38.790668+0000","last_active":"2024-09-12T18:08:38.790668+0000","last_peered":"2024-09-12T18:08:38.790668+0000","last_clean":"2024-09-12T18:08:38.790668+0000","last_became_active":"2024-09-12T17:30:02.969327+0000","last_became_peered":"2024-09-12T17:30:02.969327+0000","last_unstale":"2024-09-12T18:08:38.790668+0000","last_undegraded":"2024-09-12T18:08:38.790668+0000","last_fullsized":"2024-09-12T18:08:38.790668+0000","mapping_epoch":34,"log_start":"264'100","ondisk_log_start":"264'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-12T18:08:38.790589+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-12T18:08:38.790589+0000","last_clean_scrub_stamp":"2024-09-12T18:08:38.790589+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:45.940956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":150,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'198","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.318630+0000","last_change":"2024-09-12T18:08:23.318566+0000","last_active":"2024-09-12T18:08:23.318630+0000","last_peered":"2024-09-12T18:08:23.318630+0000","last_clean":"2024-09-12T18:08:23.318630+0000","last_became_active":"2024-09-12T17:29:54.956020+0000","last_became_peered":"2024-09-12T17:29:54.956020+0000","last_unstale":"2024-09-12T18:08:23.318630+0000","last_undegraded":"2024-09-12T18:08:23.318630+0000","last_fullsized":"2024-09-12T18:08:23.318630+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'198","last_scrub_stamp":"2024-09-12T18:08:23.318478+0000","last_deep_scrub":"264'198","last_deep_scrub_stamp":"2024-09-12T18:08:23.318478+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.318478+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:06.926356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":702,"num_write":286,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'210","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.023762+0000","last_change":"2024-09-12T18:08:13.023692+0000","last_active":"2024-09-12T18:08:13.023762+0000","last_peered":"2024-09-12T18:08:13.023762+0000","last_clean":"2024-09-12T18:08:13.023762+0000","last_became_active":"2024-09-12T17:29:52.963118+0000","last_became_peered":"2024-09-12T17:29:52.963118+0000","last_unstale":"2024-09-12T18:08:13.023762+0000","last_undegraded":"2024-09-12T18:08:13.023762+0000","last_fullsized":"2024-09-12T18:08:13.023762+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-12T18:08:13.023594+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-12T18:08:13.023594+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.023594+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:19.908176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":444,"num_read_kb":2786,"num_write":996,"num_write_kb":44194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'222","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.295599+0000","last_change":"2024-09-12T18:08:22.295537+0000","last_active":"2024-09-12T18:08:22.295599+0000","last_peered":"2024-09-12T18:08:22.295599+0000","last_clean":"2024-09-12T18:08:22.295599+0000","last_became_active":"2024-09-12T17:29:54.947659+0000","last_became_peered":"2024-09-12T17:29:54.947659+0000","last_unstale":"2024-09-12T18:08:22.295599+0000","last_undegraded":"2024-09-12T18:08:22.295599+0000","last_fullsized":"2024-09-12T18:08:22.295599+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-09-12T18:08:22.295452+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-09-12T18:08:22.295452+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.295452+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.342588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":954,"num_read_kb":780,"num_write":336,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'187","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.321464+0000","last_change":"2024-09-12T18:08:12.321394+0000","last_active":"2024-09-12T18:08:12.321464+0000","last_peered":"2024-09-12T18:08:12.321464+0000","last_clean":"2024-09-12T18:08:12.321464+0000","last_became_active":"2024-09-12T17:29:52.955546+0000","last_became_peered":"2024-09-12T17:29:52.955546+0000","last_unstale":"2024-09-12T18:08:12.321464+0000","last_undegraded":"2024-09-12T18:08:12.321464+0000","last_fullsized":"2024-09-12T18:08:12.321464+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-12T18:08:12.321242+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-12T18:08:12.321242+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.321242+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:11.147772+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5712374,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":628,"num_read_kb":171668,"num_write":902,"num_write_kb":49213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'156","reported_seq":726,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:26.439895+0000","last_change":"2024-09-12T18:08:26.439837+0000","last_active":"2024-09-12T18:08:26.439895+0000","last_peered":"2024-09-12T18:08:26.439895+0000","last_clean":"2024-09-12T18:08:26.439895+0000","last_became_active":"2024-09-12T17:29:54.958047+0000","last_became_peered":"2024-09-12T17:29:54.958047+0000","last_unstale":"2024-09-12T18:08:26.439895+0000","last_undegraded":"2024-09-12T18:08:26.439895+0000","last_fullsized":"2024-09-12T18:08:26.439895+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-12T18:08:26.439752+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-12T18:08:26.439752+0000","last_clean_scrub_stamp":"2024-09-12T18:08:26.439752+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:46.015233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":718,"num_read_kb":592,"num_write":271,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'177","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.466372+0000","last_change":"2024-09-12T18:08:16.466300+0000","last_active":"2024-09-12T18:08:16.466372+0000","last_peered":"2024-09-12T18:08:16.466372+0000","last_clean":"2024-09-12T18:08:16.466372+0000","last_became_active":"2024-09-12T17:29:52.955924+0000","last_became_peered":"2024-09-12T17:29:52.955924+0000","last_unstale":"2024-09-12T18:08:16.466372+0000","last_undegraded":"2024-09-12T18:08:16.466372+0000","last_fullsized":"2024-09-12T18:08:16.466372+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T18:08:16.466188+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T18:08:16.466188+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.466188+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:45.623269+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4131368,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":446,"num_read_kb":86465,"num_write":876,"num_write_kb":34463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'67","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.278272+0000","last_change":"2024-09-12T18:08:20.278214+0000","last_active":"2024-09-12T18:08:20.278272+0000","last_peered":"2024-09-12T18:08:20.278272+0000","last_clean":"2024-09-12T18:08:20.278272+0000","last_became_active":"2024-09-12T17:29:54.956587+0000","last_became_peered":"2024-09-12T17:29:54.956587+0000","last_unstale":"2024-09-12T18:08:20.278272+0000","last_undegraded":"2024-09-12T18:08:20.278272+0000","last_fullsized":"2024-09-12T18:08:20.278272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-09-12T18:08:20.278133+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-09-12T18:08:20.278133+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.278133+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:53.896456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":238,"num_write":111,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'195","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:12.116624+0000","last_change":"2024-09-12T18:08:12.116624+0000","last_active":"2024-09-12T18:08:12.116624+0000","last_peered":"2024-09-12T18:08:12.116624+0000","last_clean":"2024-09-12T18:08:12.116624+0000","last_became_active":"2024-09-12T17:29:52.961103+0000","last_became_peered":"2024-09-12T17:29:52.961103+0000","last_unstale":"2024-09-12T18:08:12.116624+0000","last_undegraded":"2024-09-12T18:08:12.116624+0000","last_fullsized":"2024-09-12T18:08:12.116624+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T18:08:12.116514+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T18:08:12.116514+0000","last_clean_scrub_stamp":"2024-09-12T18:08:12.116514+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:09.737301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":894,"num_read_kb":61034,"num_write":905,"num_write_kb":21974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'80","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.006108+0000","last_change":"2024-09-12T18:08:29.006108+0000","last_active":"2024-09-12T18:08:29.006108+0000","last_peered":"2024-09-12T18:08:29.006108+0000","last_clean":"2024-09-12T18:08:29.006108+0000","last_became_active":"2024-09-12T17:29:54.955986+0000","last_became_peered":"2024-09-12T17:29:54.955986+0000","last_unstale":"2024-09-12T18:08:29.006108+0000","last_undegraded":"2024-09-12T18:08:29.006108+0000","last_fullsized":"2024-09-12T18:08:29.006108+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'80","last_scrub_stamp":"2024-09-12T18:08:29.006010+0000","last_deep_scrub":"264'80","last_deep_scrub_stamp":"2024-09-12T18:08:29.006010+0000","last_clean_scrub_stamp":"2024-09-12T18:08:29.006010+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:19.958435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":361,"num_read_kb":303,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'242","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:16.385914+0000","last_change":"2024-09-12T18:08:16.385838+0000","last_active":"2024-09-12T18:08:16.385914+0000","last_peered":"2024-09-12T18:08:16.385914+0000","last_clean":"2024-09-12T18:08:16.385914+0000","last_became_active":"2024-09-12T17:31:28.509017+0000","last_became_peered":"2024-09-12T17:31:28.509017+0000","last_unstale":"2024-09-12T18:08:16.385914+0000","last_undegraded":"2024-09-12T18:08:16.385914+0000","last_fullsized":"2024-09-12T18:08:16.385914+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'242","last_scrub_stamp":"2024-09-12T18:08:16.385665+0000","last_deep_scrub":"264'242","last_deep_scrub_stamp":"2024-09-12T18:08:16.385665+0000","last_clean_scrub_stamp":"2024-09-12T18:08:16.385665+0000","objects_scrubbed":12,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:17.985445+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9316189,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":509,"num_read_kb":51273,"num_write":1111,"num_write_kb":73287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0],"acting":[2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"264'52","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.707419+0000","last_change":"2024-09-12T18:08:20.707353+0000","last_active":"2024-09-12T18:08:20.707419+0000","last_peered":"2024-09-12T18:08:20.707419+0000","last_clean":"2024-09-12T18:08:20.707419+0000","last_became_active":"2024-09-12T17:29:54.957480+0000","last_became_peered":"2024-09-12T17:29:54.957480+0000","last_unstale":"2024-09-12T18:08:20.707419+0000","last_undegraded":"2024-09-12T18:08:20.707419+0000","last_fullsized":"2024-09-12T18:08:20.707419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-12T18:08:20.707268+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-12T18:08:20.707268+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.707268+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:31.235559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":218,"num_write":68,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'172","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.244662+0000","last_change":"2024-09-12T18:08:15.244570+0000","last_active":"2024-09-12T18:08:15.244662+0000","last_peered":"2024-09-12T18:08:15.244662+0000","last_clean":"2024-09-12T18:08:15.244662+0000","last_became_active":"2024-09-12T17:29:52.945750+0000","last_became_peered":"2024-09-12T17:29:52.945750+0000","last_unstale":"2024-09-12T18:08:15.244662+0000","last_undegraded":"2024-09-12T18:08:15.244662+0000","last_fullsized":"2024-09-12T18:08:15.244662+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'172","last_scrub_stamp":"2024-09-12T18:08:15.244411+0000","last_deep_scrub":"264'172","last_deep_scrub_stamp":"2024-09-12T18:08:15.244411+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.244411+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:04.460342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":408,"num_read_kb":12063,"num_write":843,"num_write_kb":23165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'78","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.070700+0000","last_change":"2024-09-12T18:08:23.070644+0000","last_active":"2024-09-12T18:08:23.070700+0000","last_peered":"2024-09-12T18:08:23.070700+0000","last_clean":"2024-09-12T18:08:23.070700+0000","last_became_active":"2024-09-12T17:29:54.949704+0000","last_became_peered":"2024-09-12T17:29:54.949704+0000","last_unstale":"2024-09-12T18:08:23.070700+0000","last_undegraded":"2024-09-12T18:08:23.070700+0000","last_fullsized":"2024-09-12T18:08:23.070700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-09-12T18:08:23.070551+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-09-12T18:08:23.070551+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.070551+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:51.197271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":312,"num_write":123,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'203","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.047478+0000","last_change":"2024-09-12T18:08:14.047419+0000","last_active":"2024-09-12T18:08:14.047478+0000","last_peered":"2024-09-12T18:08:14.047478+0000","last_clean":"2024-09-12T18:08:14.047478+0000","last_became_active":"2024-09-12T17:29:52.960336+0000","last_became_peered":"2024-09-12T17:29:52.960336+0000","last_unstale":"2024-09-12T18:08:14.047478+0000","last_undegraded":"2024-09-12T18:08:14.047478+0000","last_fullsized":"2024-09-12T18:08:14.047478+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-12T18:08:14.047306+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-12T18:08:14.047306+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.047306+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:01.929338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524427,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":45667,"num_write":962,"num_write_kb":42266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'76","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.108387+0000","last_change":"2024-09-12T18:08:21.108330+0000","last_active":"2024-09-12T18:08:21.108387+0000","last_peered":"2024-09-12T18:08:21.108387+0000","last_clean":"2024-09-12T18:08:21.108387+0000","last_became_active":"2024-09-12T17:29:54.956296+0000","last_became_peered":"2024-09-12T17:29:54.956296+0000","last_unstale":"2024-09-12T18:08:21.108387+0000","last_undegraded":"2024-09-12T18:08:21.108387+0000","last_fullsized":"2024-09-12T18:08:21.108387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'76","last_scrub_stamp":"2024-09-12T18:08:21.108246+0000","last_deep_scrub":"264'76","last_deep_scrub_stamp":"2024-09-12T18:08:21.108246+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.108246+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:09.120650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":291,"num_write":101,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'208","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.066330+0000","last_change":"2024-09-12T18:08:13.066221+0000","last_active":"2024-09-12T18:08:13.066330+0000","last_peered":"2024-09-12T18:08:13.066330+0000","last_clean":"2024-09-12T18:08:13.066330+0000","last_became_active":"2024-09-12T17:29:52.953110+0000","last_became_peered":"2024-09-12T17:29:52.953110+0000","last_unstale":"2024-09-12T18:08:13.066330+0000","last_undegraded":"2024-09-12T18:08:13.066330+0000","last_fullsized":"2024-09-12T18:08:13.066330+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T18:08:13.066097+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T18:08:13.066097+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.066097+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:34.052495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":64382,"num_write":937,"num_write_kb":39967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'142","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.133795+0000","last_change":"2024-09-12T18:08:22.133795+0000","last_active":"2024-09-12T18:08:22.133795+0000","last_peered":"2024-09-12T18:08:22.133795+0000","last_clean":"2024-09-12T18:08:22.133795+0000","last_became_active":"2024-09-12T17:29:54.944775+0000","last_became_peered":"2024-09-12T17:29:54.944775+0000","last_unstale":"2024-09-12T18:08:22.133795+0000","last_undegraded":"2024-09-12T18:08:22.133795+0000","last_fullsized":"2024-09-12T18:08:22.133795+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T18:08:22.133695+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T18:08:22.133695+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.133695+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:48.310100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":576,"num_read_kb":470,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'239","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:17.450127+0000","last_change":"2024-09-12T18:08:17.450063+0000","last_active":"2024-09-12T18:08:17.450127+0000","last_peered":"2024-09-12T18:08:17.450127+0000","last_clean":"2024-09-12T18:08:17.450127+0000","last_became_active":"2024-09-12T17:29:52.952892+0000","last_became_peered":"2024-09-12T17:29:52.952892+0000","last_unstale":"2024-09-12T18:08:17.450127+0000","last_undegraded":"2024-09-12T18:08:17.450127+0000","last_fullsized":"2024-09-12T18:08:17.450127+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'239","last_scrub_stamp":"2024-09-12T18:08:17.449925+0000","last_deep_scrub":"264'239","last_deep_scrub_stamp":"2024-09-12T18:08:17.449925+0000","last_clean_scrub_stamp":"2024-09-12T18:08:17.449925+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:31.739549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1423505,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":801,"num_read_kb":90532,"num_write":1295,"num_write_kb":28113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'4190","reported_seq":4824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:22.763924+0000","last_change":"2024-09-12T18:08:22.763924+0000","last_active":"2024-09-12T18:08:22.763924+0000","last_peered":"2024-09-12T18:08:22.763924+0000","last_clean":"2024-09-12T18:08:22.763924+0000","last_became_active":"2024-09-12T17:29:54.956030+0000","last_became_peered":"2024-09-12T17:29:54.956030+0000","last_unstale":"2024-09-12T18:08:22.763924+0000","last_undegraded":"2024-09-12T18:08:22.763924+0000","last_fullsized":"2024-09-12T18:08:22.763924+0000","mapping_epoch":26,"log_start":"264'4100","ondisk_log_start":"264'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4190","last_scrub_stamp":"2024-09-12T18:08:22.763830+0000","last_deep_scrub":"264'4190","last_deep_scrub_stamp":"2024-09-12T18:08:22.763830+0000","last_clean_scrub_stamp":"2024-09-12T18:08:22.763830+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":3000,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:13.600432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16971,"num_read_kb":14174,"num_write":6344,"num_write_kb":3204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'200","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.106345+0000","last_change":"2024-09-12T18:08:15.106345+0000","last_active":"2024-09-12T18:08:15.106345+0000","last_peered":"2024-09-12T18:08:15.106345+0000","last_clean":"2024-09-12T18:08:15.106345+0000","last_became_active":"2024-09-12T17:29:52.953694+0000","last_became_peered":"2024-09-12T17:29:52.953694+0000","last_unstale":"2024-09-12T18:08:15.106345+0000","last_undegraded":"2024-09-12T18:08:15.106345+0000","last_fullsized":"2024-09-12T18:08:15.106345+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-12T18:08:15.106190+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-12T18:08:15.106190+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.106190+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:05.110290+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174802,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":428,"num_read_kb":9241,"num_write":950,"num_write_kb":54194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'299","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.364780+0000","last_change":"2024-09-12T18:08:14.364687+0000","last_active":"2024-09-12T18:08:14.364780+0000","last_peered":"2024-09-12T18:08:14.364780+0000","last_clean":"2024-09-12T18:08:14.364780+0000","last_became_active":"2024-09-12T17:29:54.954593+0000","last_became_peered":"2024-09-12T17:29:54.954593+0000","last_unstale":"2024-09-12T18:08:14.364780+0000","last_undegraded":"2024-09-12T18:08:14.364780+0000","last_fullsized":"2024-09-12T18:08:14.364780+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T18:08:14.364594+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T18:08:14.364594+0000","last_clean_scrub_stamp":"2024-09-12T18:08:14.364594+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:32.644840+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1407,"num_read_kb":1154,"num_write":474,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4002,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'211","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.452953+0000","last_change":"2024-09-12T18:08:19.452953+0000","last_active":"2024-09-12T18:08:19.452953+0000","last_peered":"2024-09-12T18:08:19.452953+0000","last_clean":"2024-09-12T18:08:19.452953+0000","last_became_active":"2024-09-12T17:29:52.958021+0000","last_became_peered":"2024-09-12T17:29:52.958021+0000","last_unstale":"2024-09-12T18:08:19.452953+0000","last_undegraded":"2024-09-12T18:08:19.452953+0000","last_fullsized":"2024-09-12T18:08:19.452953+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'211","last_scrub_stamp":"2024-09-12T18:08:19.452849+0000","last_deep_scrub":"264'211","last_deep_scrub_stamp":"2024-09-12T18:08:19.452849+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.452849+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:37.690114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174726,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":543,"num_read_kb":26305,"num_write":962,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'301","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.724778+0000","last_change":"2024-09-12T18:08:21.724778+0000","last_active":"2024-09-12T18:08:21.724778+0000","last_peered":"2024-09-12T18:08:21.724778+0000","last_clean":"2024-09-12T18:08:21.724778+0000","last_became_active":"2024-09-12T17:29:54.957636+0000","last_became_peered":"2024-09-12T17:29:54.957636+0000","last_unstale":"2024-09-12T18:08:21.724778+0000","last_undegraded":"2024-09-12T18:08:21.724778+0000","last_fullsized":"2024-09-12T18:08:21.724778+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'301","last_scrub_stamp":"2024-09-12T18:08:21.724693+0000","last_deep_scrub":"264'301","last_deep_scrub_stamp":"2024-09-12T18:08:21.724693+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.724693+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:40.322921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1277,"num_read_kb":1037,"num_write":475,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'227","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.129459+0000","last_change":"2024-09-12T18:08:13.129459+0000","last_active":"2024-09-12T18:08:13.129459+0000","last_peered":"2024-09-12T18:08:13.129459+0000","last_clean":"2024-09-12T18:08:13.129459+0000","last_became_active":"2024-09-12T17:29:52.966500+0000","last_became_peered":"2024-09-12T17:29:52.966500+0000","last_unstale":"2024-09-12T18:08:13.129459+0000","last_undegraded":"2024-09-12T18:08:13.129459+0000","last_fullsized":"2024-09-12T18:08:13.129459+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-09-12T18:08:13.129341+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-09-12T18:08:13.129341+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.129341+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:16.854387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254282,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":515,"num_read_kb":34941,"num_write":1118,"num_write_kb":28764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'173","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.802210+0000","last_change":"2024-09-12T18:08:24.802210+0000","last_active":"2024-09-12T18:08:24.802210+0000","last_peered":"2024-09-12T18:08:24.802210+0000","last_clean":"2024-09-12T18:08:24.802210+0000","last_became_active":"2024-09-12T17:30:28.010055+0000","last_became_peered":"2024-09-12T17:30:28.010055+0000","last_unstale":"2024-09-12T18:08:24.802210+0000","last_undegraded":"2024-09-12T18:08:24.802210+0000","last_fullsized":"2024-09-12T18:08:24.802210+0000","mapping_epoch":37,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-12T18:08:24.802122+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-12T18:08:24.802122+0000","last_clean_scrub_stamp":"2024-09-12T18:08:24.802122+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:48.646433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":741,"num_read_kb":614,"num_write":281,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'200","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.071442+0000","last_change":"2024-09-12T18:08:15.071442+0000","last_active":"2024-09-12T18:08:15.071442+0000","last_peered":"2024-09-12T18:08:15.071442+0000","last_clean":"2024-09-12T18:08:15.071442+0000","last_became_active":"2024-09-12T17:29:52.954238+0000","last_became_peered":"2024-09-12T17:29:52.954238+0000","last_unstale":"2024-09-12T18:08:15.071442+0000","last_undegraded":"2024-09-12T18:08:15.071442+0000","last_fullsized":"2024-09-12T18:08:15.071442+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-12T18:08:15.071334+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-12T18:08:15.071334+0000","last_clean_scrub_stamp":"2024-09-12T18:08:15.071334+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:38.079896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":448,"num_read_kb":33290,"num_write":857,"num_write_kb":39696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'174","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.073348+0000","last_change":"2024-09-12T18:08:20.073348+0000","last_active":"2024-09-12T18:08:20.073348+0000","last_peered":"2024-09-12T18:08:20.073348+0000","last_clean":"2024-09-12T18:08:20.073348+0000","last_became_active":"2024-09-12T17:29:54.944623+0000","last_became_peered":"2024-09-12T17:29:54.944623+0000","last_unstale":"2024-09-12T18:08:20.073348+0000","last_undegraded":"2024-09-12T18:08:20.073348+0000","last_fullsized":"2024-09-12T18:08:20.073348+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-12T18:08:20.073256+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-12T18:08:20.073256+0000","last_clean_scrub_stamp":"2024-09-12T18:08:20.073256+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:47.502492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":587,"num_write":256,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'218","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.693029+0000","last_change":"2024-09-12T18:08:19.693029+0000","last_active":"2024-09-12T18:08:19.693029+0000","last_peered":"2024-09-12T18:08:19.693029+0000","last_clean":"2024-09-12T18:08:19.693029+0000","last_became_active":"2024-09-12T17:29:52.951819+0000","last_became_peered":"2024-09-12T17:29:52.951819+0000","last_unstale":"2024-09-12T18:08:19.693029+0000","last_undegraded":"2024-09-12T18:08:19.693029+0000","last_fullsized":"2024-09-12T18:08:19.693029+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-09-12T18:08:19.692857+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-09-12T18:08:19.692857+0000","last_clean_scrub_stamp":"2024-09-12T18:08:19.692857+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:00.897060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287564,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":478,"num_read_kb":4445,"num_write":1040,"num_write_kb":38455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'247","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.999378+0000","last_change":"2024-09-12T18:08:25.999378+0000","last_active":"2024-09-12T18:08:25.999378+0000","last_peered":"2024-09-12T18:08:25.999378+0000","last_clean":"2024-09-12T18:08:25.999378+0000","last_became_active":"2024-09-12T17:29:54.950941+0000","last_became_peered":"2024-09-12T17:29:54.950941+0000","last_unstale":"2024-09-12T18:08:25.999378+0000","last_undegraded":"2024-09-12T18:08:25.999378+0000","last_fullsized":"2024-09-12T18:08:25.999378+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'247","last_scrub_stamp":"2024-09-12T18:08:25.999284+0000","last_deep_scrub":"264'247","last_deep_scrub_stamp":"2024-09-12T18:08:25.999284+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.999284+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:39.073844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":842,"num_write":398,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'207","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:11.297209+0000","last_change":"2024-09-12T18:08:11.297209+0000","last_active":"2024-09-12T18:08:11.297209+0000","last_peered":"2024-09-12T18:08:11.297209+0000","last_clean":"2024-09-12T18:08:11.297209+0000","last_became_active":"2024-09-12T17:29:52.953569+0000","last_became_peered":"2024-09-12T17:29:52.953569+0000","last_unstale":"2024-09-12T18:08:11.297209+0000","last_undegraded":"2024-09-12T18:08:11.297209+0000","last_fullsized":"2024-09-12T18:08:11.297209+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-12T18:08:11.297114+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-12T18:08:11.297114+0000","last_clean_scrub_stamp":"2024-09-12T18:08:11.297114+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:20.913969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":380,"num_read_kb":11537,"num_write":1039,"num_write_kb":39628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'119","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:25.771411+0000","last_change":"2024-09-12T18:08:25.771285+0000","last_active":"2024-09-12T18:08:25.771411+0000","last_peered":"2024-09-12T18:08:25.771411+0000","last_clean":"2024-09-12T18:08:25.771411+0000","last_became_active":"2024-09-12T17:29:54.961615+0000","last_became_peered":"2024-09-12T17:29:54.961615+0000","last_unstale":"2024-09-12T18:08:25.771411+0000","last_undegraded":"2024-09-12T18:08:25.771411+0000","last_fullsized":"2024-09-12T18:08:25.771411+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T18:08:25.771192+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T18:08:25.771192+0000","last_clean_scrub_stamp":"2024-09-12T18:08:25.771192+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:13.593353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":544,"num_read_kb":456,"num_write":175,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'264","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:18.495069+0000","last_change":"2024-09-12T18:08:18.495069+0000","last_active":"2024-09-12T18:08:18.495069+0000","last_peered":"2024-09-12T18:08:18.495069+0000","last_clean":"2024-09-12T18:08:18.495069+0000","last_became_active":"2024-09-12T17:29:52.954363+0000","last_became_peered":"2024-09-12T17:29:52.954363+0000","last_unstale":"2024-09-12T18:08:18.495069+0000","last_undegraded":"2024-09-12T18:08:18.495069+0000","last_fullsized":"2024-09-12T18:08:18.495069+0000","mapping_epoch":24,"log_start":"264'200","ondisk_log_start":"264'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-09-12T18:08:18.494932+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-09-12T18:08:18.494932+0000","last_clean_scrub_stamp":"2024-09-12T18:08:18.494932+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:35.278309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1505373,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":610,"num_read_kb":60789,"num_write":1183,"num_write_kb":24093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'153","reported_seq":763,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:21.506389+0000","last_change":"2024-09-12T18:08:21.506389+0000","last_active":"2024-09-12T18:08:21.506389+0000","last_peered":"2024-09-12T18:08:21.506389+0000","last_clean":"2024-09-12T18:08:21.506389+0000","last_became_active":"2024-09-12T17:29:52.952766+0000","last_became_peered":"2024-09-12T17:29:52.952766+0000","last_unstale":"2024-09-12T18:08:21.506389+0000","last_undegraded":"2024-09-12T18:08:21.506389+0000","last_fullsized":"2024-09-12T18:08:21.506389+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-12T18:08:21.506224+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-12T18:08:21.506224+0000","last_clean_scrub_stamp":"2024-09-12T18:08:21.506224+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:00.437314+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847564,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":395,"num_read_kb":30421,"num_write":779,"num_write_kb":28733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'81","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:23.164730+0000","last_change":"2024-09-12T18:08:23.164635+0000","last_active":"2024-09-12T18:08:23.164730+0000","last_peered":"2024-09-12T18:08:23.164730+0000","last_clean":"2024-09-12T18:08:23.164730+0000","last_became_active":"2024-09-12T17:29:54.944681+0000","last_became_peered":"2024-09-12T17:29:54.944681+0000","last_unstale":"2024-09-12T18:08:23.164730+0000","last_undegraded":"2024-09-12T18:08:23.164730+0000","last_fullsized":"2024-09-12T18:08:23.164730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'81","last_scrub_stamp":"2024-09-12T18:08:23.164513+0000","last_deep_scrub":"264'81","last_deep_scrub_stamp":"2024-09-12T18:08:23.164513+0000","last_clean_scrub_stamp":"2024-09-12T18:08:23.164513+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:48.210606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":330,"num_write":124,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'186","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:13.243119+0000","last_change":"2024-09-12T18:08:13.243119+0000","last_active":"2024-09-12T18:08:13.243119+0000","last_peered":"2024-09-12T18:08:13.243119+0000","last_clean":"2024-09-12T18:08:13.243119+0000","last_became_active":"2024-09-12T17:29:52.942331+0000","last_became_peered":"2024-09-12T17:29:52.942331+0000","last_unstale":"2024-09-12T18:08:13.243119+0000","last_undegraded":"2024-09-12T18:08:13.243119+0000","last_fullsized":"2024-09-12T18:08:13.243119+0000","mapping_epoch":24,"log_start":"264'100","ondisk_log_start":"264'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'186","last_scrub_stamp":"2024-09-12T18:08:13.242996+0000","last_deep_scrub":"264'186","last_deep_scrub_stamp":"2024-09-12T18:08:13.242996+0000","last_clean_scrub_stamp":"2024-09-12T18:08:13.242996+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:49.416924+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364835,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":15046,"num_write":966,"num_write_kb":38540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'194","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T18:08:27.396144+0000","last_change":"2024-09-12T18:08:27.396085+0000","last_active":"2024-09-12T18:08:27.396144+0000","last_peered":"2024-09-12T18:08:27.396144+0000","last_clean":"2024-09-12T18:08:27.396144+0000","last_became_active":"2024-09-12T17:29:54.962921+0000","last_became_peered":"2024-09-12T17:29:54.962921+0000","last_unstale":"2024-09-12T18:08:27.396144+0000","last_undegraded":"2024-09-12T18:08:27.396144+0000","last_fullsized":"2024-09-12T18:08:27.396144+0000","mapping_epoch":26,"log_start":"264'100","ondisk_log_start":"264'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'194","last_scrub_stamp":"2024-09-12T18:08:27.396001+0000","last_deep_scrub":"264'194","last_deep_scrub_stamp":"2024-09-12T18:08:27.396001+0000","last_clean_scrub_stamp":"2024-09-12T18:08:27.396001+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:39.024494+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":851,"num_read_kb":702,"num_write":304,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6137,"num_read_kb":4389,"num_write":1992,"num_write_kb":890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6482,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1065,"ondisk_log_size":1065,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":16199,"num_read_kb":15887,"num_write":16770,"num_write_kb":4891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2870,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1942,"ondisk_log_size":1942,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":499,"ondisk_log_size":499,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":279568,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7821,"num_read_kb":9826,"num_write":5191,"num_write_kb":2504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":677352,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2108,"ondisk_log_size":2108,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2870,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102452,"num_read_kb":85292,"num_write":37168,"num_write_kb":18720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44038,"num_omap_keys":180,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4239,"ondisk_log_size":4239,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":83899209,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":32969,"num_read_kb":2424206,"num_write":62978,"num_write_kb":2261412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127942656,"data_stored":127942656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4263,"ondisk_log_size":4263,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":207617,"num_write":161,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":201926,"num_write":161,"num_write_kb":137406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542628,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217944,"kb_used_data":10440,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94153896,"statfs":{"total":96636764160,"available":96413589504,"internally_reserved":0,"allocated":10690560,"data_stored":8703800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542627,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244176,"kb_used_data":20032,"kb_used_omap":1,"kb_used_meta":224126,"kb_avail":94127664,"statfs":{"total":96636764160,"available":96386727936,"internally_reserved":0,"allocated":20512768,"data_stored":18573799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":229505478},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542629,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122856,"kb_used_data":29272,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94248984,"statfs":{"total":96636764160,"available":96510959616,"internally_reserved":0,"allocated":29974528,"data_stored":27974659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542628,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93540,"kb_used_data":26260,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94278300,"statfs":{"total":96636764160,"available":96540979200,"internally_reserved":0,"allocated":26890240,"data_stored":24978624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542626,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249468,"kb_used_data":19756,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122372,"statfs":{"total":96636764160,"available":96381308928,"internally_reserved":0,"allocated":20230144,"data_stored":18248382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542627,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100664,"kb_used_data":15400,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94271176,"statfs":{"total":96636764160,"available":96533684224,"internally_reserved":0,"allocated":15769600,"data_stored":13844138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542628,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125220,"kb_used_data":13588,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94246620,"statfs":{"total":96636764160,"available":96508538880,"internally_reserved":0,"allocated":13914112,"data_stored":11951207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542627,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262484,"kb_used_data":24452,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94109356,"statfs":{"total":96636764160,"available":96367980544,"internally_reserved":0,"allocated":25038848,"data_stored":23061641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20193280,"data_stored":20193280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9674752,"data_stored":9674752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11567104,"data_stored":11567104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15970304,"data_stored":15970304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22704128,"data_stored":22704128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25698304,"data_stored":25698304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16297984,"data_stored":16297984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5836800,"data_stored":5836800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:09:32.114 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T18:09:32.443 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T18:09:32.443 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T18:09:32.443 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T18:09:32.443 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:32.497 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T18:09:32.497 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T18:09:32.497 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:32.546 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T18:09:32.546 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T18:09:32.546 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:32.586 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T18:09:32.586 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T18:09:32.586 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:32.661 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T18:09:32.661 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T18:09:32.661 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:32.700 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T18:09:32.701 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T18:09:32.701 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:32.785 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T18:09:32.786 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T18:09:32.786 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:32.835 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T18:09:32.836 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T18:09:32.836 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:32.874 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T18:09:32.874 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T18:09:32.875 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T18:09:32.875 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:32.900 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T18:09:32.901 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T18:09:32.901 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:32.945 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T18:09:32.945 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T18:09:32.946 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T18:09:32.946 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:32.960 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T18:09:32.960 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T18:09:32.960 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:33.012 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T18:09:33.012 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T18:09:33.012 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:09:33.025 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T18:09:33.025 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T18:09:33.025 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T18:09:33.092 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T18:09:33.093 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T18:09:33.367 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T18:09:33.367 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T18:09:33.467 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T18:09:33.467 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T18:09:33.549 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T18:09:33.549 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T18:09:33.631 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T18:09:33.631 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T18:09:33.812 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T18:09:33.812 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T18:09:33.897 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T18:09:33.897 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T18:09:33.975 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T18:09:33.976 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T18:09:34.050 INFO:tasks.ceph:Archiving mon data... 2024-09-12T18:09:34.052 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731/data/mon.a.tgz 2024-09-12T18:09:34.052 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-09-12T18:09:34.082 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.MDEHTElvnj 2024-09-12T18:09:34.082 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.MDEHTElvnj 2024-09-12T18:09:34.276 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.MDEHTElvnj 2024-09-12T18:09:34.386 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.MDEHTElvnj is 462KB 2024-09-12T18:09:34.483 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.MDEHTElvnj 2024-09-12T18:09:34.511 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731/data/mon.c.tgz 2024-09-12T18:09:34.511 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-09-12T18:09:34.579 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.sUHiZrDOZf 2024-09-12T18:09:34.579 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.sUHiZrDOZf 2024-09-12T18:09:34.761 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.sUHiZrDOZf 2024-09-12T18:09:34.870 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.sUHiZrDOZf is 474KB 2024-09-12T18:09:34.966 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.sUHiZrDOZf 2024-09-12T18:09:34.994 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731/data/mon.b.tgz 2024-09-12T18:09:34.995 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-09-12T18:09:35.027 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.HriRUr5gxe 2024-09-12T18:09:35.028 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.HriRUr5gxe 2024-09-12T18:09:35.273 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.HriRUr5gxe 2024-09-12T18:09:35.383 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.HriRUr5gxe is 474KB 2024-09-12T18:09:35.486 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.HriRUr5gxe 2024-09-12T18:09:35.514 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T18:09:35.514 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:09:35.517 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:09:35.625 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:09:35.661 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:09:35.662 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T18:09:35.663 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731/remote/smithi107/crash 2024-09-12T18:09:35.664 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:09:35.703 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731/remote/smithi148/crash 2024-09-12T18:09:35.704 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:09:35.742 INFO:tasks.ceph:Compressing logs... 2024-09-12T18:09:35.742 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:09:35.747 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:09:35.783 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T18:09:35.783 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112432.log 2024-09-12T18:09:35.783 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45305.log 2024-09-12T18:09:35.835 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32898.log 2024-09-12T18:09:35.835 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T18:09:35.835 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32667.log 2024-09-12T18:09:35.835 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32898.log.gz 2024-09-12T18:09:35.835 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32766.log 2024-09-12T18:09:35.835 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32667.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T18:09:35.835 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32667.log.gz 2024-09-12T18:09:35.835 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32766.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:09:35.835 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32766.log.gz 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32722.log 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32722.log: gzip -5 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32722.log.gz 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr: --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32579.log 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32854.log 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32579.log.gz 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32623.log 2024-09-12T18:09:35.836 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32854.log.gz 2024-09-12T18:09:35.837 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32810.log 2024-09-12T18:09:35.837 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32623.log.gz 2024-09-12T18:09:35.837 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32810.log.gz 2024-09-12T18:09:35.837 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:09:35.965 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.112432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38457.log 2024-09-12T18:09:35.966 INFO:teuthology.orchestra.run.smithi107.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.112432.log.gz 2024-09-12T18:09:35.966 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191034.log 2024-09-12T18:09:35.966 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190896.log 2024-09-12T18:09:35.966 INFO:teuthology.orchestra.run.smithi107.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.45305.log.gz 2024-09-12T18:09:35.966 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38457.log.gz 2024-09-12T18:09:35.966 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52224.log 2024-09-12T18:09:35.966 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191034.log.gz 2024-09-12T18:09:35.966 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.190896.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.190896.log.gz -5 2024-09-12T18:09:35.966 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.143064.log 2024-09-12T18:09:35.966 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144831.log 2024-09-12T18:09:35.966 INFO:teuthology.orchestra.run.smithi107.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.52224.log.gz 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.143064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117736.log 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.143064.log.gz 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.144831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38715.log 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.144831.log.gz 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.117736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175687.log 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.117736.log.gz 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69892.log 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38715.log.gz 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.175687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92994.log 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.69892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173596.log 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175687.log.gz 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.92994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191310.log 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.92994.log.gz 2024-09-12T18:09:35.967 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.173596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179982.log 2024-09-12T18:09:35.968 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191310.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.173596.log.gz 2024-09-12T18:09:35.968 INFO:teuthology.orchestra.run.smithi107.stderr: 88.4% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69892.log.gz -- replaced with /var/log/ceph/ceph-client.admin.191310.log.gz 2024-09-12T18:09:35.968 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:35.968 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79447.log 2024-09-12T18:09:35.968 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165566.log 2024-09-12T18:09:35.968 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.179982.log: /var/log/ceph/ceph-client.admin.79447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63610.log 2024-09-12T18:09:35.968 INFO:teuthology.orchestra.run.smithi107.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.179982.log.gz 2024-09-12T18:09:35.968 INFO:teuthology.orchestra.run.smithi107.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.79447.log.gz 2024-09-12T18:09:35.968 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39833.log 2024-09-12T18:09:35.968 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.165566.log: /var/log/ceph/ceph-client.admin.63610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84159.log 2024-09-12T18:09:35.968 INFO:teuthology.orchestra.run.smithi107.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.165566.log.gz 2024-09-12T18:09:35.968 INFO:teuthology.orchestra.run.smithi107.stderr: 22.0% -- replaced with /var/log/ceph/ceph-client.admin.63610.log.gz 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39833.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39833.log.gz -5 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.156023.log 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.84159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83570.log 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.156023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55758.log 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84159.log.gz 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.156023.log.gz 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.83570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39653.log 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.83570.log.gz 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.55758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39058.log 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.55758.log.gz 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106542.log 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39653.log.gz 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141297.log 2024-09-12T18:09:35.969 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39058.log.gz 2024-09-12T18:09:35.970 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.106542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145420.log 2024-09-12T18:09:35.970 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.106542.log.gz 2024-09-12T18:09:35.970 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.141297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142475.log 2024-09-12T18:09:35.970 INFO:teuthology.orchestra.run.smithi107.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.141297.log.gz 2024-09-12T18:09:35.970 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.145420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191725.log 2024-09-12T18:09:35.970 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.145420.log.gz 2024-09-12T18:09:35.970 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.142475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39483.log 2024-09-12T18:09:35.970 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74656.log 2024-09-12T18:09:35.970 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191725.log.gz 2024-09-12T18:09:35.970 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39483.log.gz 2024-09-12T18:09:35.970 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139530.log 2024-09-12T18:09:35.970 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.74656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176935.log 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr: 86.2% 81.0% -- replaced with /var/log/ceph/ceph-client.admin.142475.log.gz 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74656.log.gz 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.139530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167612.log 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.139530.log.gz 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113610.log 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.176935.log: /var/log/ceph/ceph-client.0.167612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125982.log 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.0.176935.log.gz 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.167612.log.gz 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.113610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57525.log 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.125982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51635.log 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.57525.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.125982.log.gz 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57525.log.gz 2024-09-12T18:09:35.971 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104186.log 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110076.log 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.51635.log.gz 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.104186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85337.log 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.113610.log.gz 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104186.log.gz 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75247.log 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.110076.log: /var/log/ceph/ceph-client.admin.85337.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.110076.log.gz 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.85337.log.gz 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.75247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133051.log 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.75247.log.gz 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143653.log 2024-09-12T18:09:35.972 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.133051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49820.log 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.133051.log.gz 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.143653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76616.log 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.143653.log.gz 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49820.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.49820.log.gz 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.76616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110665.log 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.0.76616.log.gz 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191448.log 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.110665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133640.log 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.110665.log.gz 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95350.log 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191448.log.gz 2024-09-12T18:09:35.973 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62329.log 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.133640.log: /var/log/ceph/ceph-client.admin.95350.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.133640.log.gz 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129517.log 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95350.log.gz 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.62329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160757.log 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr: 55.3% -- replaced with /var/log/ceph/ceph-client.admin.62329.log.gz 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39053.log 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.129517.log: /var/log/ceph/ceph-client.admin.160757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98884.log 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.129517.log.gz 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.160757.log.gz 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96528.log 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39053.log.gz 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.98884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163751.log 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.96528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39397.log 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.96528.log.gz 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.163751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43070.log 2024-09-12T18:09:35.974 INFO:teuthology.orchestra.run.smithi107.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.163751.log.gz 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111254.log 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39397.log.gz 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.98884.log.gz 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.43070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105364.log 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43070.log.gz 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.111254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115969.log 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.111254.log.gz 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.105364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88871.log 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.115969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148955.log 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.105364.log.gz 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.115969.log.gz 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.88871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88282.log 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.88871.log.gz 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.148955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140708.log 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.88282.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.148955.log.gz 2024-09-12T18:09:35.975 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109487.log 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.88282.log.gz 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.140708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98295.log 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.109487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38306.log 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.140708.log.gz 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.109487.log.gz 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.98295.log: -5 --verbose -- /var/log/ceph/ceph-client.0.184854.log 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38306.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.98295.log.gz 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38306.log.gz 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146009.log 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39309.log 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.184854.log: /var/log/ceph/ceph-client.admin.146009.log: gzip 84.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.191402.log 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.0.184854.log.gz 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.146009.log.gz 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137763.log 2024-09-12T18:09:35.976 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39309.log.gz 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144242.log 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191402.log.gz 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.137763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50409.log 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.137763.log.gz 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.144242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150722.log 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50409.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.144242.log.gz 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.50409.log.gz 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48005.log 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191218.log 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.150722.log: /var/log/ceph/ceph-client.admin.48005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87693.log 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.48005.log.gz 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127160.log 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191218.log.gz 2024-09-12T18:09:35.977 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62822.log 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.87693.log: /var/log/ceph/ceph-client.admin.127160.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.87693.log.gz 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116558.log 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.150722.log.gz 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.127160.log.gz 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.62822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102419.log 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.116558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141886.log 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.116558.log.gz 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.102419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117147.log 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.102419.log.gz 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.141886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39059.log 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.141886.log.gz 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.117147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191494.log 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39059.log: gzip -5 85.7% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117147.log.gz -- replaced with /var/log/ceph/ceph-client.admin.39059.log.gz 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:35.978 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.0.76007.log 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191494.log.gz 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33186.log 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.76007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188479.log 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.76007.log.gz 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.33186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33186.log.gz 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85926.log 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.188479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66795.log 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr: 25.9% -- replaced with /var/log/ceph/ceph-client.admin.188479.log.gz 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.85926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160147.log 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.85926.log.gz 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.66795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39419.log 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.160147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53402.log 2024-09-12T18:09:35.979 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160147.log.gz 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182418.log 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39419.log.gz 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53402.log: -- /var/log/ceph/ceph-client.admin.154256.log 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.182418.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.53402.log.gz 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41255.log 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.182418.log.gz 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.154256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95939.log 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92405.log 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.41255.log: /var/log/ceph/ceph-client.admin.95939.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.41255.log.gz 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.95939.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118914.log 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.154256.log.gz 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.92405.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92405.log.gz 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189293.log 2024-09-12T18:09:35.980 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.118914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158379.log 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.118914.log.gz 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.189293.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.66795.log.gz 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137174.log 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.189293.log.gz 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128927.log 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.158379.log: gzip 81.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.158379.log.gz --verbose 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr: -- /var/log/ceph/ceph-client.admin.114199.log 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.137174.log: /var/log/ceph/ceph-client.admin.128927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74066.log 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr: 81.9% 81.4% -- replaced with /var/log/ceph/ceph-client.admin.128927.log.gz 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.137174.log.gz/var/log/ceph/ceph-client.admin.114199.log: 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40609.log 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.114199.log.gz 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.74066.log: -- /var/log/ceph/ceph-client.admin.115380.log 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.40609.log: gzip 43.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.71130.log 2024-09-12T18:09:35.981 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.0.40609.log.gz 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.74066.log.gz 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.115380.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.115380.log.gz 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156612.log 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.71130.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91227.log 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.156612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38707.log 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.156612.log.gz 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.91227.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.91227.log.gz 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67414.log 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62822.log.gz 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38707.log.gz 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38717.log 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.67414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103008.log 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38717.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52813.log 2024-09-12T18:09:35.982 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.103008.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.103008.log.gz 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39055.log 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.67414.log.gz 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.52813.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.71130.log.gz 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68652.log 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.52813.log.gz 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38411.log 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39055.log.gz 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188574.log 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.68652.log: /var/log/ceph/ceph-client.admin.38411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38411.log.gz 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162524.log 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77991.log 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.188574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188574.log.gz 2024-09-12T18:09:35.983 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.162524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59340.log 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.162524.log.gz 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.77991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38706.log 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr: 80.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63724.log 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.59340.log: -- replaced with /var/log/ceph/ceph-client.0.77991.log.gz 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123626.log 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.59340.log.gz 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38706.log.gz 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.63724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175079.log 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.63724.log.gz 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.123626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135407.log 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.123626.log.gz 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5/var/log/ceph/ceph-client.admin.175079.log: --verbose -- /var/log/ceph/ceph-client.admin.164340.log 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.135407.log: gzip 81.3% -- replaced with /var/log/ceph/ceph-client.admin.135407.log.gz 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.147187.log 2024-09-12T18:09:35.984 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.164340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176326.log 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.175079.log.gz 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.164340.log.gz 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.147187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84748.log 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.147187.log.gz 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.176326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180591.log 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.176326.log.gz 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.84748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59929.log 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.84748.log.gz 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5/var/log/ceph/ceph-client.0.180591.log: --verbose -- /var/log/ceph/ceph-client.admin.190942.log 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.59929.log: 83.2% -- replaced with /var/log/ceph/ceph-client.0.180591.log.gz 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59929.log.gz 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62952.log 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191586.log 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.190942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190942.log.gz 2024-09-12T18:09:35.985 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.62952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151900.log 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.62952.log.gz 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191586.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191586.log.gz 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.191080.log 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.151900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181809.log 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.151900.log.gz 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191080.log.gz 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46827.log 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.181809.log: /var/log/ceph/ceph-client.admin.46827.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.181809.log.gz 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80625.log 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.46827.log.gz 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188549.log 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.80625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99473.log 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.80625.log.gz 2024-09-12T18:09:35.986 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.188549.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188549.log.gz 2024-09-12T18:09:35.987 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.188525.log 2024-09-12T18:09:35.987 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.99473.log: gzip -5 81.7% -- replaced with /var/log/ceph/ceph-client.admin.99473.log.gz 2024-09-12T18:09:35.987 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.154845.log 2024-09-12T18:09:35.987 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.188525.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131284.log 2024-09-12T18:09:35.987 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.188525.log.gz 2024-09-12T18:09:35.987 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.154845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152489.log 2024-09-12T18:09:35.987 INFO:teuthology.orchestra.run.smithi107.stderr: 81.9%/var/log/ceph/ceph-client.admin.131284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121270.log 2024-09-12T18:09:35.987 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154845.log.gz 2024-09-12T18:09:35.987 INFO:teuthology.orchestra.run.smithi107.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.131284.log.gz 2024-09-12T18:09:35.987 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42467.log 2024-09-12T18:09:35.987 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.152489.log: /var/log/ceph/ceph-client.admin.121270.log: gzip -5 --verbose -- 82.2% -- replaced with /var/log/ceph/ceph-client.admin.121270.log.gz 2024-09-12T18:09:35.988 INFO:teuthology.orchestra.run.smithi107.stderr: /var/log/ceph/ceph-client.admin.149544.log 2024-09-12T18:09:35.988 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.42467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147776.log 2024-09-12T18:09:35.988 INFO:teuthology.orchestra.run.smithi107.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42467.log.gz 2024-09-12T18:09:35.988 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.149544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120681.log 2024-09-12T18:09:35.988 INFO:teuthology.orchestra.run.smithi107.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.149544.log.gz 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T18:09:35.988 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:35.988 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.147776.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.147776.log.gzgzip 2024-09-12T18:09:35.988 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.171625.log 2024-09-12T18:09:35.988 INFO:teuthology.orchestra.run.smithi107.stderr:gzip/var/log/ceph/ceph-client.admin.120681.log: -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T18:09:35.988 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% 85.9% -- replaced with /var/log/ceph/ceph-client.admin.152489.log.gz 2024-09-12T18:09:35.988 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.171625.log: -- replaced with /var/log/ceph/ceph-client.admin.120681.log.gz 2024-09-12T18:09:35.989 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190712.log 2024-09-12T18:09:35.989 INFO:teuthology.orchestra.run.smithi107.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171625.log.gz 2024-09-12T18:09:35.989 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178764.log 2024-09-12T18:09:35.989 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.190712.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.161935.log 2024-09-12T18:09:35.989 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.190712.log.gz 2024-09-12T18:09:35.989 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.178764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159557.log 2024-09-12T18:09:35.989 INFO:teuthology.orchestra.run.smithi107.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.178764.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163114.log 2024-09-12T18:09:35.989 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:35.989 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.161935.log: /var/log/ceph/ceph-client.admin.159557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188501.log 2024-09-12T18:09:35.989 INFO:teuthology.orchestra.run.smithi107.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.161935.log.gz 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr: 81.0%/var/log/ceph/ceph-client.admin.163114.log: -- replaced with /var/log/ceph/ceph-client.admin.159557.log.gz 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163114.log.gz 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53991.log 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191540.log 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.188501.log: /var/log/ceph/ceph-client.admin.53991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136585.log 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188501.log.gz 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191540.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.53991.log.gz 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191540.log.gz 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.191172.log 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.136585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49183.log 80.7% 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.136585.log.gz 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191172.log.gz 2024-09-12T18:09:35.990 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97706.log 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49183.log.gz 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75838.log 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191679.log 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.97706.log.gz 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.75838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48594.log 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr: 26.2% -- replaced with /var/log/ceph/ceph-client.admin.75838.log.gz 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77326.log 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191679.log.gz 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97117.log 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.48594.log: /var/log/ceph/ceph-client.admin.77326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41864.log 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.77326.log.gz 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.48594.log.gz 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.97117.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.134818.log 2024-09-12T18:09:35.991 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97117.log.gz 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.41864.log: -- /var/log/ceph/ceph-client.admin.120092.log 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.41864.log.gz 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.134818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131873.log 82.0% -- replaced with /var/log/ceph/ceph-client.admin.134818.log.gz 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.120092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123037.log 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120092.log.gz 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.131873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158968.log 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.131873.log.gz 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.123037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124215.log 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.123037.log.gz 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.158968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72885.log 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.158968.log.gz 2024-09-12T18:09:35.992 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.124215.log: gzip -5 81.8% -- replaced with /var/log/ceph/ceph-client.admin.124215.log.gz 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.187865.log 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.72885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62674.log 81.1% -- replaced with /var/log/ceph/ceph-client.admin.72885.log.gz 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.187865.log: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.68652.log.gz 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187865.log.gz 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183027.log 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.62674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32761.log 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.62674.log.gz 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.183027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78858.log 84.0% -- replaced with /var/log/ceph/ceph-client.0.183027.log.gz 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.32761.log: 28.9% -- replaced with /var/log/ceph/ceph-client.admin.32761.log.gz 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39037.log 2024-09-12T18:09:35.993 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.78858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101830.log 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.78858.log.gz 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184245.log 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39037.log.gz 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70511.log 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.101830.log.gz 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.184245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121859.log 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.184245.log.gz 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.70511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39745.log 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157201.log 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.121859.log: /var/log/ceph/ceph-client.admin.39745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105953.log 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39745.log.gz 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.157201.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70511.log.gz 2024-09-12T18:09:35.994 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122448.log 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.157201.log.gz 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.105953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155434.log 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.105953.log.gz 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.122448.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.122448.log.gz 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.121859.log.gz 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51587.log 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.155434.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125393.log 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.155434.log.gz 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51587.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51587.log.gz 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94761.log 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135996.log 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.125393.log: /var/log/ceph/ceph-client.admin.94761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38716.log 2024-09-12T18:09:35.995 INFO:teuthology.orchestra.run.smithi107.stderr: 81.7% 81.9% -- replaced with /var/log/ceph/ceph-client.admin.94761.log.gz 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.125393.log.gz 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.135996.log: 86.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100652.log 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.135996.log.gz 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191264.log 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38716.log.gz 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39699.log 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191264.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100652.log.gz 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59977.log 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191264.log.gz 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47416.log 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39699.log.gz 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94172.log 2024-09-12T18:09:35.996 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.59977.log: /var/log/ceph/ceph-client.admin.47416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108309.log 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.59977.log.gz 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.94172.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.47416.log.gz 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr:gzip 81.3% -- replaced with /var/log/ceph/ceph-client.admin.94172.log.gz 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62447.log 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.108309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179373.log 81.4% -- replaced with /var/log/ceph/ceph-client.admin.108309.log.gz 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.62447.log: 49.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190758.log 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62447.log.gz 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.179373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163162.log 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.179373.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55169.log 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.190758.log: /var/log/ceph/ceph-client.admin.163162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190758.log.gz 2024-09-12T18:09:35.997 INFO:teuthology.orchestra.run.smithi107.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.163162.log.gz 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190620.log 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.55169.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr: 82.2%/var/log/ceph/ceph-client.admin.190620.log: -- replaced with /var/log/ceph/ceph-client.admin.55169.log.gz 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190620.log.gz 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91816.log 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60566.log 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39472.log 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.91816.log: /var/log/ceph/ceph-client.admin.60566.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.91816.log.gz 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.60566.log.gz 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38124.log 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.39472.log: /var/log/ceph/ceph-client.admin.168262.log 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39472.log.gz 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127749.log 2024-09-12T18:09:35.998 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.168262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38124.log.gz 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.168262.log.gz 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51611.log 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.127749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151311.log 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.51611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51611.log.gz 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.127749.log.gz 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150133.log 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.151311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93583.log 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.151311.log.gz 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.150133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172380.log 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.93583.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.150133.log.gz 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93583.log.gz 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57573.log 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.172380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77382.log 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.172380.log.gz 2024-09-12T18:09:35.999 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.57573.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.57573.log.gz 2024-09-12T18:09:36.000 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38708.log 2024-09-12T18:09:36.000 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.77382.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.77382.log.gz 2024-09-12T18:09:36.000 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T18:09:36.000 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38708.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171017.log 2024-09-12T18:09:36.000 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38708.log.gz 2024-09-12T18:09:36.000 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58162.log 2024-09-12T18:09:36.000 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.171017.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171017.log.gz 2024-09-12T18:09:36.000 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57549.log 2024-09-12T18:09:36.000 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.58162.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.58162.log.gz 2024-09-12T18:09:36.000 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39992.log 2024-09-12T18:09:36.000 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.57549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57549.log.gz 2024-09-12T18:09:36.000 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.39992.log: 95.8% -- replaced with /var/log/ceph/ceph-client.0.39992.log.gz 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191356.log 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100062.log 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191356.log: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39789.log 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.100062.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.100062.log.gz 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191356.log.gz 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111843.log 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39789.log.gz 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190850.log 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.111843.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.111843.log.gz 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71794.log 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.190850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190850.log.gz 2024-09-12T18:09:36.001 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39225.log 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.71794.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.71794.log.gz 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62053.log 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39225.log.gz 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58751.log 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.62053.log: 57.1% -- replaced with /var/log/ceph/ceph-client.admin.62053.log.gz 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132462.log 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.58751.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.58751.log.gz 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38281.log 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.132462.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.132462.log.gz 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104775.log 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38281.log.gz 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38217.log 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.104775.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104775.log.gz 2024-09-12T18:09:36.002 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39010.log 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38217.log.gz 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138352.log 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39010.log.gz 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114788.log 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.138352.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.138352.log.gz 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181200.log 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.114788.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.114788.log.gz 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146598.log 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.181200.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.181200.log.gz 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26668.log 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.146598.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.146598.log.gz 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82981.log 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.tmp-client.admin.26668.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26668.log.gz 2024-09-12T18:09:36.003 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190988.log 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.82981.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.82981.log.gz 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169801.log 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.190988.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39923.log 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.190988.log.gz 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50998.log 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.169801.log: /var/log/ceph/ceph-client.admin.39923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39923.log.gz 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56936.log 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr: 94.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.50998.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.169801.log.gz 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr: 80.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191633.log 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50998.log.gz 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.56936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39418.log 2024-09-12T18:09:36.004 INFO:teuthology.orchestra.run.smithi107.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.56936.log.gz 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191633.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191633.log.gz 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108898.log 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39418.log.gz 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191126.log 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.108898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187229.log 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108898.log.gz 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191126.log.gz 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160168.log 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61155.log 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.187229.log: /var/log/ceph/ceph-client.admin.160168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54580.log 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr: 82.2%/var/log/ceph/ceph-client.admin.61155.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.160168.log.gz -- replaced with /var/log/ceph/ceph-client.admin.187229.log.gz 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:36.005 INFO:teuthology.orchestra.run.smithi107.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.61155.log.gz 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107720.log 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.54580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178155.log 81.5% -- replaced with /var/log/ceph/ceph-client.admin.54580.log.gz 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.107720.log: gzip -5 --verbose 82.2% -- replaced with /var/log/ceph/ceph-client.admin.107720.log.gz 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr: -- /var/log/ceph/ceph-client.admin.163138.log 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.178155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138941.log 80.5% -- replaced with /var/log/ceph/ceph-client.0.178155.log.gz 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.163138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163138.log.gz 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49231.log 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.138941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89460.log 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.138941.log.gz 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49231.log: gzip -5 --verbose 80.5% -- replaced with /var/log/ceph/ceph-client.admin.49231.log.gz 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr: -- /var/log/ceph/ceph-client.admin.39879.log 2024-09-12T18:09:36.006 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.89460.log: gzip 81.6% -- replaced with /var/log/ceph/ceph-client.admin.89460.log.gz 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65555.log 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39879.log.gz 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39423.log 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.65555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168870.log 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.39423.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87104.log 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39423.log.gz 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148366.log 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.168870.log: /var/log/ceph/ceph-client.admin.87104.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.168870.log.gz 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.87104.log.gz 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126571.log 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130106.log 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.126571.log: /var/log/ceph/ceph-client.admin.148366.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.148366.log.gz 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.126571.log.gz 2024-09-12T18:09:36.007 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189988.log 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130695.log 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.130106.log: /var/log/ceph/ceph-client.0.189988.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.130106.log.gz 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166155.log 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.130695.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.130695.log.gz 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81214.log 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.166155.log: 90.6% 82.0% -- replaced with /var/log/ceph/ceph-client.admin.166155.log.gz 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.0.189988.log.gz 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39286.log 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164953.log 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.81214.log: /var/log/ceph/ceph-client.admin.39286.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65555.log.gz 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr: 87.5% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39286.log.gz 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81214.log.gz 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59953.log 2024-09-12T18:09:36.008 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.164953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164953.log.gz 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185463.log 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.59953.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59953.log.gz 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49207.log 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.185463.log: gzip -5 --verbose -- 80.3% -- replaced with /var/log/ceph/ceph-client.0.185463.log.gz 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr: /var/log/ceph/ceph-client.admin.69272.log 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.49207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49207.log.gz 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.69272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56347.log 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39056.log 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.56347.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.56347.log.gz 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68033.log 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr: 92.7%/var/log/ceph/ceph-client.admin.39056.log: -- replaced with /var/log/ceph/ceph-client.admin.69272.log.gz 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39056.log.gz 2024-09-12T18:09:36.009 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183636.log 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.68033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90049.log 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.183636.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.183636.log.gz 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82392.log 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.90049.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.90049.log.gz 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68033.log.gz 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177546.log 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107131.log 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.82392.log: /var/log/ceph/ceph-client.0.177546.log: 81.8% 83.8% -- replaced with /var/log/ceph/ceph-client.0.177546.log.gz 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.82392.log.gz 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45909.log 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.107131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187841.log 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.45909.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.45909.log.gz 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101241.log 2024-09-12T18:09:36.010 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.187841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187841.log.gz 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.107131.log.gz 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161346.log 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188598.log 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.101241.log: /var/log/ceph/ceph-client.admin.161346.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101241.log.gz 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.161346.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187889.log 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174204.log 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.188598.log: /var/log/ceph/ceph-client.admin.187889.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.188598.log.gz 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr: 79.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191769.log 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.187889.log.gz 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.174204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119503.log 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.191769.log: 92.2% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174204.log.gz -- replaced with /var/log/ceph/ceph-client.admin.191769.log.gz 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153078.log 2024-09-12T18:09:36.011 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.119503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90638.log 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.119503.log.gz 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.153078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190666.log 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.153078.log.gz 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.90638.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.90638.log.gz 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172988.log 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.190666.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103597.log 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph-client.admin.190666.log.gz 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80036.log 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.172988.log: /var/log/ceph/ceph-client.admin.103597.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172988.log.gz 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103597.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38702.log 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.80036.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.80036.log.gz 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153667.log 2024-09-12T18:09:36.012 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63532.log 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38702.log.gz 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.153667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164929.log 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.153667.log.gz 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.63532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73474.log 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr: 21.2%/var/log/ceph/ceph-client.admin.164929.log: -- replaced with /var/log/ceph/ceph-client.admin.63532.log.gz 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164929.log.gz 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38365.log 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187819.log 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.73474.log: /var/log/ceph/ceph-client.admin.38365.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.73474.log.gz 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38365.log.gz 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43673.log 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.187819.log: -- /var/log/ceph/ceph-client.admin.134229.log 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.187819.log.gz 2024-09-12T18:09:36.013 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.0.43673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38503.log 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr: 43.5%/var/log/ceph/ceph-client.admin.134229.log: -- replaced with /var/log/ceph/ceph-client.0.43673.log.gz 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38503.log.gz 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:gzip 86.1% -- replaced with /var/log/ceph/ceph-client.admin.134229.log.gz 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39969.log 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38705.log 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.39969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39969.log.gz 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81803.log 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.38705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38705.log.gz 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164977.log 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.81803.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.81803.log.gz 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62888.log 2024-09-12T18:09:36.014 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.164977.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164977.log.gz 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170409.log 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.62888.log: 54.5% -- replaced with /var/log/ceph/ceph-client.admin.62888.log.gz 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157790.log 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.170409.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170409.log.gz 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186640.log 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.157790.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.157790.log.gz 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64936.log 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.186640.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.186640.log.gz 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124804.log 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.64936.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.64936.log.gz 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66175.log 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.124804.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.124804.log.gz 2024-09-12T18:09:36.015 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118325.log 2024-09-12T18:09:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.66175.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.66175.log.gz 2024-09-12T18:09:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64313.log 2024-09-12T18:09:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.118325.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.118325.log.gz 2024-09-12T18:09:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113021.log 2024-09-12T18:09:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.64313.log: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.64313.log.gz 2024-09-12T18:09:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140119.log 2024-09-12T18:09:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.113021.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.113021.log.gz 2024-09-12T18:09:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128338.log 2024-09-12T18:09:36.019 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.140119.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.140119.log.gz 2024-09-12T18:09:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62757.log 2024-09-12T18:09:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.128338.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.128338.log.gz 2024-09-12T18:09:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33099.log 2024-09-12T18:09:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.62757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62757.log.gz 2024-09-12T18:09:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86515.log 2024-09-12T18:09:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.33099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33099.log.gz 2024-09-12T18:09:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190804.log 2024-09-12T18:09:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.86515.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.86515.log.gz 2024-09-12T18:09:36.020 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.190804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190804.log.gz 2024-09-12T18:09:36.225 INFO:teuthology.orchestra.run.smithi148.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T18:09:36.421 INFO:teuthology.orchestra.run.smithi107.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T18:09:36.444 INFO:teuthology.orchestra.run.smithi148.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T18:09:37.946 INFO:teuthology.orchestra.run.smithi107.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T18:09:38.864 INFO:teuthology.orchestra.run.smithi107.stderr: 93.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T18:09:42.164 INFO:teuthology.orchestra.run.smithi107.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T18:09:42.755 INFO:teuthology.orchestra.run.smithi107.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T18:09:42.930 INFO:teuthology.orchestra.run.smithi148.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T18:09:43.736 INFO:teuthology.orchestra.run.smithi148.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T18:09:43.883 INFO:teuthology.orchestra.run.smithi148.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T18:09:48.525 INFO:teuthology.orchestra.run.smithi107.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T18:09:51.548 INFO:teuthology.orchestra.run.smithi148.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T18:09:51.550 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-12T18:09:51.550 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m15.739s 2024-09-12T18:09:51.550 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m38.344s 2024-09-12T18:09:51.550 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m1.441s 2024-09-12T18:09:55.914 INFO:teuthology.orchestra.run.smithi107.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T18:09:55.916 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-09-12T18:09:55.916 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m20.143s 2024-09-12T18:09:55.916 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m50.072s 2024-09-12T18:09:55.916 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m1.984s 2024-09-12T18:09:55.917 INFO:tasks.ceph:Archiving logs... 2024-09-12T18:09:55.917 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731/remote/smithi107/log 2024-09-12T18:09:55.918 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:10:02.808 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731/remote/smithi148/log 2024-09-12T18:10:02.809 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:10:08.149 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T18:10:08.160 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T18:10:08.160 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:10:08.163 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:10:08.269 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T18:10:08.280 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T18:10:08.280 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:10:08.283 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:10:08.311 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-09-12T18:10:08.313 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-12T18:10:08.316 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T18:10:08.316 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-09-12T18:10:08.316 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +903us[ +889us] +/- 50ms 2024-09-12T18:10:08.316 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 34 +95us[ +81us] +/- 62ms 2024-09-12T18:10:08.316 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -1285us[-1285us] +/- 62ms 2024-09-12T18:10:08.316 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T18:10:08.318 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T18:10:08.318 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-12T18:10:08.318 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv01.front.sepia.ceph.com 3 6 377 28 +886us[ +895us] +/- 50ms 2024-09-12T18:10:08.318 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 32 +77us[ +86us] +/- 62ms 2024-09-12T18:10:08.318 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -1312us[-1303us] +/- 62ms 2024-09-12T18:10:08.318 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T18:10:08.319 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T18:10:08.337 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T18:10:08.338 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T18:10:08.384 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T18:10:08.466 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T18:10:08.547 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T18:10:08.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:10:08.589 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T18:10:08.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:10:08.632 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T18:10:08.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T18:10:08.707 INFO:teuthology.task.internal:Duration was 2848.492905 seconds 2024-09-12T18:10:08.707 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T18:10:08.764 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T18:10:08.765 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:10:08.767 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:10:08.817 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T18:10:08.821 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T18:10:09.203 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T18:10:09.203 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-09-12T18:10:09.204 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:10:09.238 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T18:10:09.238 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:10:09.272 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T18:10:09.272 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:10:09.281 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:10:09.352 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T18:10:09.352 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:10:09.360 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:10:09.504 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T18:10:09.517 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T18:10:09.517 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:10:09.556 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:10:09.594 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T18:10:09.605 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:10:09.608 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:10:09.642 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-09-12T18:10:09.671 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-09-12T18:10:09.697 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:10:09.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:10:09.724 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:10:09.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:10:09.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T18:10:09.777 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T18:10:09.778 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731/remote/smithi107 2024-09-12T18:10:09.778 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:10:09.828 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902731/remote/smithi148 2024-09-12T18:10:09.828 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:10:09.874 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T18:10:09.874 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:10:09.876 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:10:09.937 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T18:10:09.950 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T18:10:09.950 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T18:10:09.997 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T18:10:09.997 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:10:10.000 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:10:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:10 /home/ubuntu/cephtest 2024-09-12T18:10:10.027 INFO:teuthology.orchestra.run.smithi148.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:10 /home/ubuntu/cephtest 2024-09-12T18:10:10.029 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T18:10:10.040 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T18:10:10.161 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 2848.492905139923 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T18:10:10.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T18:10:10.280 INFO:teuthology.run:pass